2024-09-21T03:34:08.910 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T03:34:08.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T03:34:09.028 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913479 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/direct_io}} email: pdonnell@redhat.com first_in_suite: false job_id: '7913479' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cephfs: max_mds: 1 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mgr/snap_schedule/log_level: debug mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request mgr-modules: - snap_schedule sha1: 1843221895adccfb3b692060251dd6a0183bc410 subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount dry_run: true install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi046.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAa8rWsKiliP9waFpZCN1YqT/4z3yqRQlHMxMFpa27K2xYaSAYQmx/OOgz14cYys1SoCmCREMAdoOupIK8SgvCQ= smithi105.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP5413ZkywoijXzCNwI1FHwCUmvPLK4ub2do1cGTHLy3fVYKePPDuOkJRqw+UJ0y0pKuDHeBdYA5sBe1Vs4TVy4= smithi162.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLfyjganUxqDMFSFfj8N2DWJPnmjj20TdgzpCmk2ugReArR1yOAQdKgdYS2mtIsZSQmXoIYqhbBD+U434L3QXas= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - direct_io teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T03:34:09.028 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T03:34:09.029 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T03:34:09.029 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T03:34:09.031 INFO:teuthology.task.internal:Checking packages... 2024-09-21T03:34:09.051 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T03:34:09.051 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T03:34:09.051 INFO:teuthology.packaging:ref: None 2024-09-21T03:34:09.051 INFO:teuthology.packaging:tag: None 2024-09-21T03:34:09.051 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T03:34:09.051 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:34:09.052 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T03:34:09.191 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T03:34:09.193 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T03:34:09.200 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T03:34:09.200 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T03:34:09.243 INFO:teuthology.task.internal:Saving configuration 2024-09-21T03:34:09.263 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T03:34:09.277 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T03:34:09.304 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913479', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 03:28:55.793195', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAa8rWsKiliP9waFpZCN1YqT/4z3yqRQlHMxMFpa27K2xYaSAYQmx/OOgz14cYys1SoCmCREMAdoOupIK8SgvCQ='} 2024-09-21T03:34:09.329 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi105.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913479', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 03:28:55.791532', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP5413ZkywoijXzCNwI1FHwCUmvPLK4ub2do1cGTHLy3fVYKePPDuOkJRqw+UJ0y0pKuDHeBdYA5sBe1Vs4TVy4='} 2024-09-21T03:34:09.350 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913479', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 03:28:55.794362', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLfyjganUxqDMFSFfj8N2DWJPnmjj20TdgzpCmk2ugReArR1yOAQdKgdYS2mtIsZSQmXoIYqhbBD+U434L3QXas='} 2024-09-21T03:34:09.351 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T03:34:09.357 INFO:teuthology.task.internal:roles: ubuntu@smithi046.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-21T03:34:09.357 INFO:teuthology.task.internal:roles: ubuntu@smithi105.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-21T03:34:09.357 INFO:teuthology.task.internal:roles: ubuntu@smithi162.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-21T03:34:09.357 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T03:34:09.488 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe57e154160>, signals=[15]) 2024-09-21T03:34:09.488 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T03:34:09.494 INFO:teuthology.task.internal:Opening connections... 2024-09-21T03:34:09.494 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi046.front.sepia.ceph.com 2024-09-21T03:34:09.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:34:09.570 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi105.front.sepia.ceph.com 2024-09-21T03:34:09.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:34:09.649 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi162.front.sepia.ceph.com 2024-09-21T03:34:09.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:34:09.723 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T03:34:09.729 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2024-09-21T03:34:09.748 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2024-09-21T03:34:09.748 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2024-09-21T03:34:09.805 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Stream" 2024-09-21T03:34:09.806 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="9" 2024-09-21T03:34:09.806 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos" 2024-09-21T03:34:09.806 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora" 2024-09-21T03:34:09.806 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="9" 2024-09-21T03:34:09.806 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el9" 2024-09-21T03:34:09.806 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T03:34:09.806 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2024-09-21T03:34:09.806 INFO:teuthology.orchestra.run.smithi046.stdout:LOGO="fedora-logo-icon" 2024-09-21T03:34:09.806 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T03:34:09.806 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/" 2024-09-21T03:34:09.806 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T03:34:09.806 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T03:34:09.807 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T03:34:09.807 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2024-09-21T03:34:09.830 DEBUG:teuthology.orchestra.run.smithi105:> uname -m 2024-09-21T03:34:09.848 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2024-09-21T03:34:09.849 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2024-09-21T03:34:09.906 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2024-09-21T03:34:09.906 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="9" 2024-09-21T03:34:09.906 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2024-09-21T03:34:09.906 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2024-09-21T03:34:09.906 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="9" 2024-09-21T03:34:09.906 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el9" 2024-09-21T03:34:09.906 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T03:34:09.907 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2024-09-21T03:34:09.907 INFO:teuthology.orchestra.run.smithi105.stdout:LOGO="fedora-logo-icon" 2024-09-21T03:34:09.907 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T03:34:09.907 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2024-09-21T03:34:09.907 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T03:34:09.907 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T03:34:09.907 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T03:34:09.907 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2024-09-21T03:34:09.930 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2024-09-21T03:34:09.949 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2024-09-21T03:34:09.949 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2024-09-21T03:34:10.007 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream" 2024-09-21T03:34:10.008 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="9" 2024-09-21T03:34:10.008 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos" 2024-09-21T03:34:10.008 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora" 2024-09-21T03:34:10.008 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="9" 2024-09-21T03:34:10.008 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el9" 2024-09-21T03:34:10.008 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T03:34:10.008 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2024-09-21T03:34:10.008 INFO:teuthology.orchestra.run.smithi162.stdout:LOGO="fedora-logo-icon" 2024-09-21T03:34:10.008 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T03:34:10.008 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/" 2024-09-21T03:34:10.008 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T03:34:10.008 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T03:34:10.008 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T03:34:10.009 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2024-09-21T03:34:10.030 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T03:34:10.040 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T03:34:10.079 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T03:34:10.080 DEBUG:teuthology.orchestra.run.smithi046:> test '!' -e /home/ubuntu/cephtest 2024-09-21T03:34:10.082 DEBUG:teuthology.orchestra.run.smithi105:> test '!' -e /home/ubuntu/cephtest 2024-09-21T03:34:10.084 DEBUG:teuthology.orchestra.run.smithi162:> test '!' -e /home/ubuntu/cephtest 2024-09-21T03:34:10.101 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T03:34:10.110 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T03:34:10.110 DEBUG:teuthology.orchestra.run.smithi046:> test -z $(ls -A /var/lib/ceph) 2024-09-21T03:34:10.139 DEBUG:teuthology.orchestra.run.smithi105:> test -z $(ls -A /var/lib/ceph) 2024-09-21T03:34:10.142 DEBUG:teuthology.orchestra.run.smithi162:> test -z $(ls -A /var/lib/ceph) 2024-09-21T03:34:10.250 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T03:34:10.328 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T03:34:10.342 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-21T03:34:10.342 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-21T03:34:10.342 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-21T03:34:10.342 DEBUG:teuthology.orchestra.run.smithi046:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T03:34:10.358 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:34:10.359 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-09-21T03:34:10.416 INFO:teuthology.orchestra.run.smithi046.stdout:5.14.0-503.el9.x86_64 2024-09-21T03:34:10.416 INFO:teuthology.task.kernel:Running kernel on smithi046: 5.14.0-503.el9.x86_64 2024-09-21T03:34:10.417 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum install -y kernel 2024-09-21T03:34:14.230 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - BaseOS 3.9 MB/s | 8.3 MB 00:02 2024-09-21T03:34:16.014 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-21T03:34:20.782 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - CRB 7.7 MB/s | 6.5 MB 00:00 2024-09-21T03:34:22.366 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - Extras packages 67 kB/s | 19 kB 00:00 2024-09-21T03:34:23.836 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 17 MB/s | 23 MB 00:01 2024-09-21T03:34:29.525 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2024-09-21T03:34:31.473 INFO:teuthology.orchestra.run.smithi046.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T03:34:31.473 INFO:teuthology.orchestra.run.smithi046.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T03:34:31.556 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-21T03:34:31.563 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T03:34:31.563 INFO:teuthology.orchestra.run.smithi046.stdout: Package Architecture Version Repository Size 2024-09-21T03:34:31.563 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T03:34:31.563 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-21T03:34:31.563 INFO:teuthology.orchestra.run.smithi046.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T03:34:31.563 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-09-21T03:34:31.563 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T03:34:31.563 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T03:34:31.563 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T03:34:31.563 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:34:31.564 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-21T03:34:31.564 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T03:34:31.564 INFO:teuthology.orchestra.run.smithi046.stdout:Install 4 Packages 2024-09-21T03:34:31.564 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:34:31.564 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 79 M 2024-09-21T03:34:31.564 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 126 M 2024-09-21T03:34:31.564 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-21T03:34:31.760 INFO:teuthology.orchestra.run.smithi046.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 486 kB/s | 36 kB 00:00 2024-09-21T03:34:35.627 INFO:teuthology.orchestra.run.smithi046.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 4.0 MB/s | 16 MB 00:03 2024-09-21T03:34:38.977 INFO:teuthology.orchestra.run.smithi046.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 4.0 MB/s | 29 MB 00:07 2024-09-21T03:34:40.510 INFO:teuthology.orchestra.run.smithi046.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 3.9 MB/s | 35 MB 00:08 2024-09-21T03:34:40.510 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-21T03:34:40.510 INFO:teuthology.orchestra.run.smithi046.stdout:Total 8.8 MB/s | 79 MB 00:08 2024-09-21T03:34:41.219 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-21T03:34:41.585 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-21T03:34:41.585 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-21T03:34:42.580 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-21T03:34:42.580 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-21T03:34:45.159 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-21T03:34:45.829 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T03:34:45.927 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T03:34:48.671 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T03:34:48.804 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T03:34:53.934 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T03:34:53.972 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:34:59.120 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:35:38.251 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:35:38.291 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:35:38.624 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:35:38.624 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T03:35:38.624 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T03:35:38.624 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T03:35:39.474 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:35:39.474 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:35:39.474 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-21T03:35:39.474 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T03:35:39.474 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T03:35:39.474 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T03:35:39.474 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T03:35:39.475 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:35:39.475 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-21T03:35:39.844 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T03:35:39.927 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T03:35:39.927 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T03:35:39.927 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T03:35:39.927 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T03:35:39.927 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T03:35:39.928 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-21T03:35:39.928 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi046.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T03:35:39.928 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T03:35:39.986 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T03:35:39.986 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T03:35:39.986 DEBUG:teuthology.orchestra.run.smithi046:> sudo rpm -qi grub2-tools 2024-09-21T03:35:40.024 INFO:teuthology.orchestra.run.smithi046.stdout:Name : grub2-tools 2024-09-21T03:35:40.024 INFO:teuthology.orchestra.run.smithi046.stdout:Epoch : 1 2024-09-21T03:35:40.025 INFO:teuthology.orchestra.run.smithi046.stdout:Version : 2.06 2024-09-21T03:35:40.025 INFO:teuthology.orchestra.run.smithi046.stdout:Release : 82.el9 2024-09-21T03:35:40.025 INFO:teuthology.orchestra.run.smithi046.stdout:Architecture: x86_64 2024-09-21T03:35:40.025 INFO:teuthology.orchestra.run.smithi046.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T03:35:40.025 INFO:teuthology.orchestra.run.smithi046.stdout:Group : Unspecified 2024-09-21T03:35:40.025 INFO:teuthology.orchestra.run.smithi046.stdout:Size : 8274670 2024-09-21T03:35:40.025 INFO:teuthology.orchestra.run.smithi046.stdout:License : GPLv3+ 2024-09-21T03:35:40.025 INFO:teuthology.orchestra.run.smithi046.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T03:35:40.025 INFO:teuthology.orchestra.run.smithi046.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T03:35:40.025 INFO:teuthology.orchestra.run.smithi046.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T03:35:40.026 INFO:teuthology.orchestra.run.smithi046.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T03:35:40.026 INFO:teuthology.orchestra.run.smithi046.stdout:Packager : builder@centos.org 2024-09-21T03:35:40.026 INFO:teuthology.orchestra.run.smithi046.stdout:Vendor : CentOS 2024-09-21T03:35:40.026 INFO:teuthology.orchestra.run.smithi046.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T03:35:40.026 INFO:teuthology.orchestra.run.smithi046.stdout:Summary : Support tools for GRUB. 2024-09-21T03:35:40.026 INFO:teuthology.orchestra.run.smithi046.stdout:Description : 2024-09-21T03:35:40.026 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:35:40.026 INFO:teuthology.orchestra.run.smithi046.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T03:35:40.026 INFO:teuthology.orchestra.run.smithi046.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T03:35:40.026 INFO:teuthology.orchestra.run.smithi046.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T03:35:40.026 INFO:teuthology.orchestra.run.smithi046.stdout:hardware devices. 2024-09-21T03:35:40.026 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:35:40.026 INFO:teuthology.orchestra.run.smithi046.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T03:35:40.027 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T03:35:40.027 INFO:teuthology.task.kernel:Updating grub on smithi046 to boot 5.14.0-508.el9.x86_64 2024-09-21T03:35:40.027 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T03:35:40.652 INFO:teuthology.orchestra.run.smithi046.stderr:Generating grub configuration file ... 2024-09-21T03:35:42.014 INFO:teuthology.orchestra.run.smithi046.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T03:35:42.047 INFO:teuthology.orchestra.run.smithi046.stderr:done 2024-09-21T03:35:42.049 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2024-09-21T03:35:42.064 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.9cH9Daq7mL 2024-09-21T03:35:42.064 DEBUG:teuthology.orchestra.run.smithi046:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.9cH9Daq7mL 2024-09-21T03:35:42.136 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.9cH9Daq7mL 2024-09-21T03:35:42.276 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.9cH9Daq7mL is 6KB 2024-09-21T03:35:42.325 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.9cH9Daq7mL 2024-09-21T03:35:42.340 DEBUG:teuthology.orchestra.run.smithi046:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T03:35:42.403 INFO:teuthology.orchestra.run.smithi046.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T03:35:42.404 INFO:teuthology.orchestra.run.smithi046.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T03:35:42.404 INFO:teuthology.orchestra.run.smithi046.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T03:35:42.404 INFO:teuthology.orchestra.run.smithi046.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T03:35:42.405 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T03:35:42.555 DEBUG:teuthology.orchestra.run.smithi046:> sudo shutdown -r now 2024-09-21T03:36:12.559 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-21T03:36:12.559 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-21T03:36:12.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:37:12.562 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T03:37:21.563 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-21T03:37:21.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:37:37.295 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-09-21T03:37:37.684 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-21T03:37:37.684 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-21T03:37:37.684 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-09-21T03:37:37.699 INFO:teuthology.orchestra.run.smithi046.stdout:5.14.0-508.el9.x86_64 2024-09-21T03:37:37.699 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T03:37:37.699 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T03:37:37.699 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T03:37:38.700 DEBUG:teuthology.parallel:result is None 2024-09-21T03:37:38.701 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T03:37:38.708 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T03:37:38.708 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T03:37:38.711 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T03:37:38.713 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T03:37:38.732 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T03:37:38.776 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T03:37:38.827 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T03:37:38.827 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T03:37:38.830 DEBUG:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T03:37:38.832 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T03:37:39.101 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T03:37:39.108 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T03:37:39.108 DEBUG:teuthology.orchestra.run.smithi105:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T03:37:39.125 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:37:39.125 DEBUG:teuthology.orchestra.run.smithi162:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T03:37:39.142 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:37:39.142 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T03:37:39.147 DEBUG:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T03:37:39.168 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T03:37:39.200 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T03:37:39.217 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T03:37:39.243 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T03:37:39.258 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T03:37:39.260 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T03:37:39.474 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T03:37:39.477 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T03:37:39.484 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T03:37:39.484 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T03:37:39.486 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T03:37:39.489 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T03:37:39.538 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T03:37:39.554 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T03:37:39.554 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T03:37:39.557 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T03:37:39.559 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T03:37:39.597 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T03:37:39.649 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T03:37:39.741 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T03:37:39.818 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T03:37:39.886 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T03:37:39.886 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T03:37:39.958 DEBUG:teuthology.orchestra.run.smithi105:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T03:37:40.002 DEBUG:teuthology.orchestra.run.smithi105:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T03:37:40.060 DEBUG:teuthology.orchestra.run.smithi105:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T03:37:40.145 DEBUG:teuthology.orchestra.run.smithi105:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T03:37:40.189 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:37:40.190 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T03:37:40.259 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T03:37:40.303 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T03:37:40.361 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T03:37:40.444 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T03:37:40.488 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:37:40.488 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T03:37:40.555 DEBUG:teuthology.orchestra.run.smithi046:> sudo service rsyslog restart 2024-09-21T03:37:40.558 DEBUG:teuthology.orchestra.run.smithi105:> sudo service rsyslog restart 2024-09-21T03:37:40.560 DEBUG:teuthology.orchestra.run.smithi162:> sudo service rsyslog restart 2024-09-21T03:37:40.597 INFO:teuthology.orchestra.run.smithi105.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T03:37:40.633 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T03:37:40.642 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T03:37:41.198 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T03:37:41.206 INFO:teuthology.task.internal:Starting timer... 2024-09-21T03:37:41.206 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T03:37:41.264 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T03:37:41.315 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-21T03:37:41.315 DEBUG:teuthology.orchestra.run.smithi046:> sudo service auditd rotate 2024-09-21T03:37:41.366 INFO:teuthology.orchestra.run.smithi046.stdout:Rotating logs: 2024-09-21T03:37:41.368 DEBUG:teuthology.orchestra.run.smithi105:> sudo service auditd rotate 2024-09-21T03:37:41.423 INFO:teuthology.orchestra.run.smithi105.stdout:Rotating logs: 2024-09-21T03:37:41.425 DEBUG:teuthology.orchestra.run.smithi162:> sudo service auditd rotate 2024-09-21T03:37:41.486 INFO:teuthology.orchestra.run.smithi162.stdout:Rotating logs: 2024-09-21T03:37:41.488 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T03:37:41.488 DEBUG:teuthology.orchestra.run.smithi046:> /usr/sbin/getenforce 2024-09-21T03:37:41.508 INFO:teuthology.orchestra.run.smithi046.stdout:Permissive 2024-09-21T03:37:41.508 DEBUG:teuthology.orchestra.run.smithi105:> /usr/sbin/getenforce 2024-09-21T03:37:41.538 INFO:teuthology.orchestra.run.smithi105.stdout:Permissive 2024-09-21T03:37:41.538 DEBUG:teuthology.orchestra.run.smithi162:> /usr/sbin/getenforce 2024-09-21T03:37:41.562 INFO:teuthology.orchestra.run.smithi162.stdout:Permissive 2024-09-21T03:37:41.563 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi046.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi105.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi162.front.sepia.ceph.com': 'permissive'} 2024-09-21T03:37:41.563 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T03:37:41.589 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:37:41.589 DEBUG:teuthology.orchestra.run.smithi105:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T03:37:41.618 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:37:41.619 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T03:37:41.647 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:37:41.647 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T03:37:41.648 DEBUG:teuthology.orchestra.run.smithi046:> sudo /usr/sbin/setenforce permissive 2024-09-21T03:37:41.675 DEBUG:teuthology.orchestra.run.smithi105:> sudo /usr/sbin/setenforce permissive 2024-09-21T03:37:41.713 DEBUG:teuthology.orchestra.run.smithi162:> sudo /usr/sbin/setenforce permissive 2024-09-21T03:37:41.752 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T03:37:41.761 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-21T03:37:41.763 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-21T03:37:41.868 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T03:37:41.879 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T03:37:41.880 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi046.front.sepia.ceph.com,smithi105.front.sepia.ceph.com,smithi162.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T03:41:35.159 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi046.front.sepia.ceph.com'), Remote(name='ubuntu@smithi105.front.sepia.ceph.com'), Remote(name='ubuntu@smithi162.front.sepia.ceph.com')] 2024-09-21T03:41:35.160 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-21T03:41:35.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:41:35.235 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-09-21T03:41:35.314 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-21T03:41:35.315 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-09-21T03:41:35.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:41:35.391 DEBUG:teuthology.orchestra.run.smithi105:> true 2024-09-21T03:41:35.478 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-09-21T03:41:35.478 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-21T03:41:35.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:41:35.552 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-09-21T03:41:35.630 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-21T03:41:35.631 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T03:41:35.641 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T03:41:35.641 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T03:41:35.642 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T03:41:35.644 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T03:41:35.644 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T03:41:35.647 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T03:41:35.647 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T03:41:35.674 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T03:41:35.675 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T03:41:35.689 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T03:41:35.691 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T03:41:35.699 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T03:41:35.713 INFO:teuthology.orchestra.run.smithi105.stderr:sudo: ntpd: command not found 2024-09-21T03:41:35.714 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T03:41:35.718 INFO:teuthology.orchestra.run.smithi046.stderr:sudo: ntpd: command not found 2024-09-21T03:41:35.724 INFO:teuthology.orchestra.run.smithi105.stdout:506 Cannot talk to daemon 2024-09-21T03:41:35.730 INFO:teuthology.orchestra.run.smithi046.stdout:506 Cannot talk to daemon 2024-09-21T03:41:35.737 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T03:41:35.739 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: ntpd: command not found 2024-09-21T03:41:35.746 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T03:41:35.750 INFO:teuthology.orchestra.run.smithi162.stdout:506 Cannot talk to daemon 2024-09-21T03:41:35.752 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T03:41:35.760 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T03:41:35.764 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T03:41:35.778 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T03:41:35.808 INFO:teuthology.orchestra.run.smithi105.stderr:bash: line 1: ntpq: command not found 2024-09-21T03:41:35.812 INFO:teuthology.orchestra.run.smithi105.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T03:41:35.812 INFO:teuthology.orchestra.run.smithi105.stdout:=============================================================================== 2024-09-21T03:41:35.812 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:41:35.812 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:41:35.813 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:41:35.813 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:41:35.822 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 1: ntpq: command not found 2024-09-21T03:41:35.826 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T03:41:35.826 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2024-09-21T03:41:35.826 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:41:35.826 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:41:35.826 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:41:35.826 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:41:35.832 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-09-21T03:41:35.836 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T03:41:35.836 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-09-21T03:41:35.836 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:41:35.836 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:41:35.836 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:41:35.837 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:41:35.837 INFO:teuthology.run_tasks:Running task install... 2024-09-21T03:41:35.845 DEBUG:teuthology.task.install:project ceph 2024-09-21T03:41:35.845 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T03:41:35.845 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T03:41:35.845 INFO:teuthology.task.install:Using flavor: default 2024-09-21T03:41:35.851 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T03:41:35.851 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T03:41:35.851 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T03:41:35.851 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:41:35.853 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T03:41:35.853 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:41:35.854 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T03:41:35.854 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:41:35.995 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T03:41:35.995 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T03:41:36.005 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T03:41:36.005 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T03:41:36.013 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T03:41:36.013 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T03:41:36.102 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T03:41:36.102 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T03:41:36.103 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T03:41:36.115 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T03:41:36.116 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:41:36.116 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T03:41:36.119 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T03:41:36.119 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:41:36.119 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T03:41:36.129 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T03:41:36.129 DEBUG:teuthology.orchestra.run.smithi046:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T03:41:36.146 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T03:41:36.146 DEBUG:teuthology.orchestra.run.smithi162:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T03:41:36.147 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T03:41:36.147 DEBUG:teuthology.orchestra.run.smithi105:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T03:41:36.195 DEBUG:teuthology.orchestra.run.smithi046:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T03:41:36.211 DEBUG:teuthology.orchestra.run.smithi162:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T03:41:36.213 DEBUG:teuthology.orchestra.run.smithi105:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T03:41:36.271 DEBUG:teuthology.orchestra.run.smithi046:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T03:41:36.287 DEBUG:teuthology.orchestra.run.smithi162:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T03:41:36.288 DEBUG:teuthology.orchestra.run.smithi105:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T03:41:36.336 INFO:teuthology.orchestra.run.smithi046.stdout:check_obsoletes = 1 2024-09-21T03:41:36.337 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum clean all 2024-09-21T03:41:36.351 INFO:teuthology.orchestra.run.smithi162.stdout:check_obsoletes = 1 2024-09-21T03:41:36.352 INFO:teuthology.orchestra.run.smithi105.stdout:check_obsoletes = 1 2024-09-21T03:41:36.353 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum clean all 2024-09-21T03:41:36.354 DEBUG:teuthology.orchestra.run.smithi105:> sudo yum clean all 2024-09-21T03:41:36.576 INFO:teuthology.orchestra.run.smithi046.stdout:45 files removed 2024-09-21T03:41:36.577 INFO:teuthology.orchestra.run.smithi105.stdout:45 files removed 2024-09-21T03:41:36.578 INFO:teuthology.orchestra.run.smithi162.stdout:45 files removed 2024-09-21T03:41:36.603 DEBUG:teuthology.orchestra.run.smithi105:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T03:41:36.605 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T03:41:36.606 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T03:41:37.143 INFO:teuthology.orchestra.run.smithi162.stdout:ceph packages for x86_64 327 kB/s | 84 kB 00:00 2024-09-21T03:41:37.175 INFO:teuthology.orchestra.run.smithi105.stdout:ceph packages for x86_64 287 kB/s | 84 kB 00:00 2024-09-21T03:41:37.177 INFO:teuthology.orchestra.run.smithi046.stdout:ceph packages for x86_64 312 kB/s | 84 kB 00:00 2024-09-21T03:41:37.436 INFO:teuthology.orchestra.run.smithi162.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-21T03:41:37.467 INFO:teuthology.orchestra.run.smithi105.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-21T03:41:37.478 INFO:teuthology.orchestra.run.smithi046.stdout:ceph noarch packages 95 kB/s | 24 kB 00:00 2024-09-21T03:41:37.719 INFO:teuthology.orchestra.run.smithi162.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-21T03:41:37.743 INFO:teuthology.orchestra.run.smithi105.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-21T03:41:37.762 INFO:teuthology.orchestra.run.smithi046.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-21T03:41:38.212 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - BaseOS 20 MB/s | 8.3 MB 00:00 2024-09-21T03:41:38.426 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.3 MB 00:00 2024-09-21T03:41:39.872 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - AppStream 36 MB/s | 20 MB 00:00 2024-09-21T03:41:40.703 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - BaseOS 2.8 MB/s | 8.3 MB 00:02 2024-09-21T03:41:42.637 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-21T03:41:44.715 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - CRB 7.2 MB/s | 6.5 MB 00:00 2024-09-21T03:41:46.407 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - Extras packages 49 kB/s | 19 kB 00:00 2024-09-21T03:41:46.863 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-21T03:41:47.578 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-21T03:41:48.247 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - Extras packages 112 kB/s | 19 kB 00:00 2024-09-21T03:41:49.059 INFO:teuthology.orchestra.run.smithi162.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-21T03:41:53.211 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-21T03:41:53.335 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - AppStream 1.5 MB/s | 20 MB 00:13 2024-09-21T03:41:54.465 INFO:teuthology.orchestra.run.smithi162.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-09-21T03:41:55.506 INFO:teuthology.orchestra.run.smithi046.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T03:41:55.507 INFO:teuthology.orchestra.run.smithi046.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T03:41:55.519 INFO:teuthology.orchestra.run.smithi046.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T03:41:55.520 INFO:teuthology.orchestra.run.smithi046.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T03:41:55.521 INFO:teuthology.orchestra.run.smithi046.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T03:41:55.522 INFO:teuthology.orchestra.run.smithi046.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T03:41:55.524 INFO:teuthology.orchestra.run.smithi046.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T03:41:55.526 INFO:teuthology.orchestra.run.smithi046.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T03:41:55.527 INFO:teuthology.orchestra.run.smithi046.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T03:41:55.596 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-21T03:41:55.606 INFO:teuthology.orchestra.run.smithi046.stdout:======================================================================================= 2024-09-21T03:41:55.606 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-09-21T03:41:55.606 INFO:teuthology.orchestra.run.smithi046.stdout:======================================================================================= 2024-09-21T03:41:55.606 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-21T03:41:55.607 INFO:teuthology.orchestra.run.smithi046.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T03:41:55.607 INFO:teuthology.orchestra.run.smithi046.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T03:41:55.607 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T03:41:55.607 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T03:41:55.607 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T03:41:55.607 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T03:41:55.607 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T03:41:55.607 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T03:41:55.607 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T03:41:55.607 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T03:41:55.607 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T03:41:55.607 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T03:41:55.608 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T03:41:55.608 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T03:41:55.608 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T03:41:55.608 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T03:41:55.608 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T03:41:55.608 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T03:41:55.608 INFO:teuthology.orchestra.run.smithi046.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T03:41:55.608 INFO:teuthology.orchestra.run.smithi046.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T03:41:55.608 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T03:41:55.608 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T03:41:55.608 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T03:41:55.608 INFO:teuthology.orchestra.run.smithi046.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T03:41:55.609 INFO:teuthology.orchestra.run.smithi046.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T03:41:55.609 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T03:41:55.609 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T03:41:55.609 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T03:41:55.609 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T03:41:55.609 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T03:41:55.609 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T03:41:55.609 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T03:41:55.609 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T03:41:55.609 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T03:41:55.609 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T03:41:55.609 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T03:41:55.609 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T03:41:55.610 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrading: 2024-09-21T03:41:55.610 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T03:41:55.610 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T03:41:55.610 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T03:41:55.610 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T03:41:55.610 INFO:teuthology.orchestra.run.smithi046.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T03:41:55.610 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T03:41:55.610 INFO:teuthology.orchestra.run.smithi046.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T03:41:55.610 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T03:41:55.610 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-09-21T03:41:55.610 INFO:teuthology.orchestra.run.smithi046.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T03:41:55.610 INFO:teuthology.orchestra.run.smithi046.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T03:41:55.611 INFO:teuthology.orchestra.run.smithi046.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T03:41:55.611 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T03:41:55.611 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T03:41:55.611 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T03:41:55.611 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T03:41:55.611 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T03:41:55.611 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T03:41:55.611 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T03:41:55.611 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T03:41:55.611 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T03:41:55.611 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T03:41:55.611 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T03:41:55.611 INFO:teuthology.orchestra.run.smithi046.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T03:41:55.612 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T03:41:55.612 INFO:teuthology.orchestra.run.smithi046.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T03:41:55.612 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T03:41:55.612 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T03:41:55.612 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T03:41:55.612 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T03:41:55.612 INFO:teuthology.orchestra.run.smithi046.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T03:41:55.612 INFO:teuthology.orchestra.run.smithi046.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T03:41:55.612 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T03:41:55.612 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T03:41:55.612 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T03:41:55.612 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T03:41:55.613 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T03:41:55.613 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T03:41:55.613 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T03:41:55.613 INFO:teuthology.orchestra.run.smithi046.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T03:41:55.613 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T03:41:55.613 INFO:teuthology.orchestra.run.smithi046.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T03:41:55.613 INFO:teuthology.orchestra.run.smithi046.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T03:41:55.613 INFO:teuthology.orchestra.run.smithi046.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T03:41:55.613 INFO:teuthology.orchestra.run.smithi046.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T03:41:55.613 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T03:41:55.613 INFO:teuthology.orchestra.run.smithi046.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T03:41:55.613 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T03:41:55.613 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T03:41:55.614 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T03:41:55.614 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T03:41:55.614 INFO:teuthology.orchestra.run.smithi046.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T03:41:55.614 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T03:41:55.614 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T03:41:55.614 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T03:41:55.614 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T03:41:55.614 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T03:41:55.614 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T03:41:55.614 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T03:41:55.614 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T03:41:55.614 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T03:41:55.614 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T03:41:55.615 INFO:teuthology.orchestra.run.smithi046.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T03:41:55.615 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T03:41:55.615 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T03:41:55.615 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T03:41:55.615 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T03:41:55.615 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T03:41:55.615 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T03:41:55.615 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T03:41:55.615 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T03:41:55.615 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T03:41:55.615 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T03:41:55.615 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T03:41:55.615 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T03:41:55.615 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T03:41:55.616 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T03:41:55.616 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T03:41:55.616 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T03:41:55.616 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T03:41:55.616 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T03:41:55.616 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T03:41:55.616 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T03:41:55.616 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T03:41:55.616 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T03:41:55.616 INFO:teuthology.orchestra.run.smithi046.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T03:41:55.616 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T03:41:55.616 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T03:41:55.616 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T03:41:55.617 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T03:41:55.617 INFO:teuthology.orchestra.run.smithi046.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T03:41:55.617 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T03:41:55.617 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T03:41:55.617 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T03:41:55.617 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T03:41:55.617 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T03:41:55.617 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T03:41:55.617 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T03:41:55.617 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T03:41:55.617 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T03:41:55.617 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T03:41:55.617 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T03:41:55.618 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T03:41:55.618 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T03:41:55.618 INFO:teuthology.orchestra.run.smithi046.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T03:41:55.618 INFO:teuthology.orchestra.run.smithi046.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T03:41:55.618 INFO:teuthology.orchestra.run.smithi046.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T03:41:55.618 INFO:teuthology.orchestra.run.smithi046.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T03:41:55.618 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T03:41:55.618 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T03:41:55.618 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T03:41:55.618 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T03:41:55.618 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T03:41:55.618 INFO:teuthology.orchestra.run.smithi046.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T03:41:55.618 INFO:teuthology.orchestra.run.smithi046.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T03:41:55.619 INFO:teuthology.orchestra.run.smithi046.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T03:41:55.619 INFO:teuthology.orchestra.run.smithi046.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T03:41:55.619 INFO:teuthology.orchestra.run.smithi046.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T03:41:55.619 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T03:41:55.619 INFO:teuthology.orchestra.run.smithi046.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T03:41:55.619 INFO:teuthology.orchestra.run.smithi046.stdout:Installing weak dependencies: 2024-09-21T03:41:55.619 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T03:41:55.619 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:41:55.619 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-21T03:41:55.619 INFO:teuthology.orchestra.run.smithi046.stdout:======================================================================================= 2024-09-21T03:41:55.619 INFO:teuthology.orchestra.run.smithi046.stdout:Install 149 Packages 2024-09-21T03:41:55.619 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrade 8 Packages 2024-09-21T03:41:55.619 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:41:55.620 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 228 M 2024-09-21T03:41:55.620 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-21T03:41:56.204 INFO:teuthology.orchestra.run.smithi046.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 50 kB/s | 6.6 kB 00:00 2024-09-21T03:41:56.388 INFO:teuthology.orchestra.run.smithi046.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.7 MB/s | 873 kB 00:00 2024-09-21T03:41:56.471 INFO:teuthology.orchestra.run.smithi046.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.7 MB/s | 148 kB 00:00 2024-09-21T03:41:56.547 INFO:teuthology.orchestra.run.smithi046.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 12 MB/s | 5.5 MB 00:00 2024-09-21T03:41:56.595 INFO:teuthology.orchestra.run.smithi162.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T03:41:56.595 INFO:teuthology.orchestra.run.smithi162.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T03:41:56.609 INFO:teuthology.orchestra.run.smithi162.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T03:41:56.611 INFO:teuthology.orchestra.run.smithi162.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T03:41:56.611 INFO:teuthology.orchestra.run.smithi162.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T03:41:56.612 INFO:teuthology.orchestra.run.smithi162.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T03:41:56.614 INFO:teuthology.orchestra.run.smithi162.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T03:41:56.617 INFO:teuthology.orchestra.run.smithi162.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T03:41:56.618 INFO:teuthology.orchestra.run.smithi162.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T03:41:56.647 INFO:teuthology.orchestra.run.smithi046.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 15 MB/s | 1.5 MB 00:00 2024-09-21T03:41:56.680 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T03:41:56.689 INFO:teuthology.orchestra.run.smithi046.stdout:(6/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 11 MB/s | 2.3 MB 00:00 2024-09-21T03:41:56.700 INFO:teuthology.orchestra.run.smithi162.stdout:======================================================================================= 2024-09-21T03:41:56.700 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-09-21T03:41:56.700 INFO:teuthology.orchestra.run.smithi162.stdout:======================================================================================= 2024-09-21T03:41:56.700 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T03:41:56.700 INFO:teuthology.orchestra.run.smithi162.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T03:41:56.700 INFO:teuthology.orchestra.run.smithi162.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T03:41:56.700 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T03:41:56.700 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T03:41:56.700 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T03:41:56.700 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T03:41:56.701 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T03:41:56.701 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T03:41:56.701 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T03:41:56.701 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T03:41:56.701 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T03:41:56.701 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T03:41:56.701 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T03:41:56.701 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T03:41:56.701 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T03:41:56.701 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T03:41:56.701 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T03:41:56.701 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T03:41:56.702 INFO:teuthology.orchestra.run.smithi162.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T03:41:56.702 INFO:teuthology.orchestra.run.smithi162.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T03:41:56.702 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T03:41:56.702 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T03:41:56.702 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T03:41:56.702 INFO:teuthology.orchestra.run.smithi162.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T03:41:56.702 INFO:teuthology.orchestra.run.smithi162.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T03:41:56.702 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T03:41:56.702 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T03:41:56.702 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T03:41:56.702 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T03:41:56.703 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T03:41:56.703 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T03:41:56.703 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T03:41:56.703 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T03:41:56.703 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T03:41:56.703 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T03:41:56.703 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T03:41:56.703 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T03:41:56.703 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrading: 2024-09-21T03:41:56.703 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T03:41:56.703 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T03:41:56.704 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T03:41:56.704 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T03:41:56.704 INFO:teuthology.orchestra.run.smithi162.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T03:41:56.704 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T03:41:56.704 INFO:teuthology.orchestra.run.smithi162.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T03:41:56.704 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T03:41:56.704 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-09-21T03:41:56.704 INFO:teuthology.orchestra.run.smithi162.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T03:41:56.704 INFO:teuthology.orchestra.run.smithi162.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T03:41:56.704 INFO:teuthology.orchestra.run.smithi162.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T03:41:56.704 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T03:41:56.705 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T03:41:56.705 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T03:41:56.705 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T03:41:56.705 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T03:41:56.705 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T03:41:56.705 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T03:41:56.705 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T03:41:56.705 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T03:41:56.705 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T03:41:56.705 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T03:41:56.705 INFO:teuthology.orchestra.run.smithi162.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T03:41:56.706 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T03:41:56.706 INFO:teuthology.orchestra.run.smithi162.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T03:41:56.706 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T03:41:56.706 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T03:41:56.706 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T03:41:56.706 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T03:41:56.706 INFO:teuthology.orchestra.run.smithi162.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T03:41:56.706 INFO:teuthology.orchestra.run.smithi162.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T03:41:56.706 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T03:41:56.706 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T03:41:56.706 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T03:41:56.706 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T03:41:56.707 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T03:41:56.707 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T03:41:56.707 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T03:41:56.707 INFO:teuthology.orchestra.run.smithi162.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T03:41:56.707 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T03:41:56.707 INFO:teuthology.orchestra.run.smithi162.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T03:41:56.707 INFO:teuthology.orchestra.run.smithi162.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T03:41:56.707 INFO:teuthology.orchestra.run.smithi162.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T03:41:56.707 INFO:teuthology.orchestra.run.smithi162.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T03:41:56.707 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T03:41:56.707 INFO:teuthology.orchestra.run.smithi162.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T03:41:56.707 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T03:41:56.708 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T03:41:56.708 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T03:41:56.708 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T03:41:56.708 INFO:teuthology.orchestra.run.smithi162.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T03:41:56.708 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T03:41:56.708 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T03:41:56.708 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T03:41:56.708 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T03:41:56.708 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T03:41:56.708 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T03:41:56.708 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T03:41:56.709 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T03:41:56.709 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T03:41:56.709 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T03:41:56.709 INFO:teuthology.orchestra.run.smithi162.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T03:41:56.709 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T03:41:56.709 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T03:41:56.709 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T03:41:56.709 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T03:41:56.709 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T03:41:56.709 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T03:41:56.709 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T03:41:56.709 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T03:41:56.710 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T03:41:56.710 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T03:41:56.710 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T03:41:56.710 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T03:41:56.710 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T03:41:56.710 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T03:41:56.710 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T03:41:56.710 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T03:41:56.710 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T03:41:56.710 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T03:41:56.711 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T03:41:56.711 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T03:41:56.711 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T03:41:56.711 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T03:41:56.711 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T03:41:56.711 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T03:41:56.711 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T03:41:56.711 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T03:41:56.711 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T03:41:56.711 INFO:teuthology.orchestra.run.smithi162.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T03:41:56.711 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T03:41:56.711 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T03:41:56.712 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T03:41:56.712 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T03:41:56.712 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T03:41:56.712 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T03:41:56.712 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T03:41:56.712 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T03:41:56.712 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T03:41:56.712 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T03:41:56.712 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T03:41:56.712 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T03:41:56.712 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T03:41:56.712 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T03:41:56.712 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T03:41:56.712 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T03:41:56.713 INFO:teuthology.orchestra.run.smithi162.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T03:41:56.713 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T03:41:56.713 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T03:41:56.713 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T03:41:56.713 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T03:41:56.713 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T03:41:56.713 INFO:teuthology.orchestra.run.smithi162.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T03:41:56.713 INFO:teuthology.orchestra.run.smithi162.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T03:41:56.713 INFO:teuthology.orchestra.run.smithi162.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T03:41:56.713 INFO:teuthology.orchestra.run.smithi162.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T03:41:56.713 INFO:teuthology.orchestra.run.smithi162.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T03:41:56.714 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T03:41:56.714 INFO:teuthology.orchestra.run.smithi162.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T03:41:56.714 INFO:teuthology.orchestra.run.smithi162.stdout:Installing weak dependencies: 2024-09-21T03:41:56.714 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T03:41:56.714 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:41:56.714 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T03:41:56.714 INFO:teuthology.orchestra.run.smithi162.stdout:======================================================================================= 2024-09-21T03:41:56.714 INFO:teuthology.orchestra.run.smithi162.stdout:Install 149 Packages 2024-09-21T03:41:56.714 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrade 8 Packages 2024-09-21T03:41:56.714 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:41:56.715 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 228 M 2024-09-21T03:41:56.715 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T03:41:56.981 INFO:teuthology.orchestra.run.smithi046.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 15 MB/s | 5.0 MB 00:00 2024-09-21T03:41:57.189 INFO:teuthology.orchestra.run.smithi046.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 18 MB/s | 20 MB 00:01 2024-09-21T03:41:57.240 INFO:teuthology.orchestra.run.smithi046.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 505 kB/s | 25 kB 00:00 2024-09-21T03:41:57.442 INFO:teuthology.orchestra.run.smithi162.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 28 kB/s | 6.6 kB 00:00 2024-09-21T03:41:57.532 INFO:teuthology.orchestra.run.smithi046.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 19 MB/s | 10 MB 00:00 2024-09-21T03:41:57.535 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-21T03:41:57.607 INFO:teuthology.orchestra.run.smithi046.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 2.9 MB/s | 226 kB 00:00 2024-09-21T03:41:57.699 INFO:teuthology.orchestra.run.smithi046.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 295 kB/s | 27 kB 00:00 2024-09-21T03:41:57.700 INFO:teuthology.orchestra.run.smithi162.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 3.3 MB/s | 873 kB 00:00 2024-09-21T03:41:57.782 INFO:teuthology.orchestra.run.smithi046.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 381 kB/s | 32 kB 00:00 2024-09-21T03:41:57.792 INFO:teuthology.orchestra.run.smithi162.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.6 MB/s | 148 kB 00:00 2024-09-21T03:41:57.883 INFO:teuthology.orchestra.run.smithi046.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 7.5 MB/s | 766 kB 00:00 2024-09-21T03:41:58.051 INFO:teuthology.orchestra.run.smithi162.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 6.5 MB/s | 5.5 MB 00:00 2024-09-21T03:41:58.101 INFO:teuthology.orchestra.run.smithi162.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 7.4 MB/s | 2.3 MB 00:00 2024-09-21T03:41:58.108 INFO:teuthology.orchestra.run.smithi046.stdout:(15/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 13 MB/s | 18 MB 00:01 2024-09-21T03:41:58.167 INFO:teuthology.orchestra.run.smithi046.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 558 kB/s | 158 kB 00:00 2024-09-21T03:41:58.176 INFO:teuthology.orchestra.run.smithi162.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 12 MB/s | 1.5 MB 00:00 2024-09-21T03:41:58.192 INFO:teuthology.orchestra.run.smithi046.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 1.5 MB/s | 127 kB 00:00 2024-09-21T03:41:58.225 INFO:teuthology.orchestra.run.smithi046.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 8.5 MB/s | 507 kB 00:00 2024-09-21T03:41:58.309 INFO:teuthology.orchestra.run.smithi046.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 542 kB/s | 45 kB 00:00 2024-09-21T03:41:58.743 INFO:teuthology.orchestra.run.smithi046.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 342 kB/s | 148 kB 00:00 2024-09-21T03:41:58.801 INFO:teuthology.orchestra.run.smithi162.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 7.1 MB/s | 5.0 MB 00:00 2024-09-21T03:41:58.834 INFO:teuthology.orchestra.run.smithi046.stdout:(21/157): librgw2-19.3.0-5120.g18432218.el9.x86 8.2 MB/s | 5.3 MB 00:00 2024-09-21T03:41:58.860 INFO:teuthology.orchestra.run.smithi046.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 1.3 MB/s | 161 kB 00:00 2024-09-21T03:41:58.902 INFO:teuthology.orchestra.run.smithi046.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 4.7 MB/s | 321 kB 00:00 2024-09-21T03:41:58.927 INFO:teuthology.orchestra.run.smithi046.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 4.5 MB/s | 307 kB 00:00 2024-09-21T03:41:58.952 INFO:teuthology.orchestra.run.smithi046.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T03:41:58.986 INFO:teuthology.orchestra.run.smithi046.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.4 MB/s | 86 kB 00:00 2024-09-21T03:41:59.052 INFO:teuthology.orchestra.run.smithi162.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 11 MB/s | 20 MB 00:01 2024-09-21T03:41:59.053 INFO:teuthology.orchestra.run.smithi046.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.5 MB/s | 170 kB 00:00 2024-09-21T03:41:59.102 INFO:teuthology.orchestra.run.smithi162.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 506 kB/s | 25 kB 00:00 2024-09-21T03:41:59.137 INFO:teuthology.orchestra.run.smithi046.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 412 kB/s | 34 kB 00:00 2024-09-21T03:41:59.237 INFO:teuthology.orchestra.run.smithi046.stdout:(29/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 1.5 MB/s | 154 kB 00:00 2024-09-21T03:41:59.287 INFO:teuthology.orchestra.run.smithi046.stdout:(30/157): rbd-mirror-19.3.0-5120.g18432218.el9. 9.3 MB/s | 3.1 MB 00:00 2024-09-21T03:41:59.702 INFO:teuthology.orchestra.run.smithi162.stdout:(10/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 12 MB/s | 18 MB 00:01 2024-09-21T03:41:59.803 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 19 kB 00:01 2024-09-21T03:41:59.828 INFO:teuthology.orchestra.run.smithi162.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 1.8 MB/s | 226 kB 00:00 2024-09-21T03:41:59.928 INFO:teuthology.orchestra.run.smithi162.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 270 kB/s | 27 kB 00:00 2024-09-21T03:42:00.020 INFO:teuthology.orchestra.run.smithi162.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 347 kB/s | 32 kB 00:00 2024-09-21T03:42:00.095 INFO:teuthology.orchestra.run.smithi162.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 10 MB/s | 766 kB 00:00 2024-09-21T03:42:00.154 INFO:teuthology.orchestra.run.smithi162.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 2.6 MB/s | 158 kB 00:00 2024-09-21T03:42:00.271 INFO:teuthology.orchestra.run.smithi162.stdout:(16/157): ceph-radosgw-19.3.0-5120.g18432218.el 7.1 MB/s | 10 MB 00:01 2024-09-21T03:42:00.296 INFO:teuthology.orchestra.run.smithi162.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 893 kB/s | 127 kB 00:00 2024-09-21T03:42:00.322 INFO:teuthology.orchestra.run.smithi162.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 9.9 MB/s | 507 kB 00:00 2024-09-21T03:42:00.346 INFO:teuthology.orchestra.run.smithi046.stdout:(31/157): ceph-test-19.3.0-5120.g18432218.el9.x 13 MB/s | 40 MB 00:03 2024-09-21T03:42:00.372 INFO:teuthology.orchestra.run.smithi162.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 905 kB/s | 45 kB 00:00 2024-09-21T03:42:00.438 INFO:teuthology.orchestra.run.smithi046.stdout:(32/157): ceph-mgr-diskprediction-local-19.3.0- 6.4 MB/s | 7.4 MB 00:01 2024-09-21T03:42:00.456 INFO:teuthology.orchestra.run.smithi162.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.7 MB/s | 148 kB 00:00 2024-09-21T03:42:00.463 INFO:teuthology.orchestra.run.smithi046.stdout:(33/157): ceph-mgr-modules-core-19.3.0-5120.g18 2.4 MB/s | 292 kB 00:00 2024-09-21T03:42:00.488 INFO:teuthology.orchestra.run.smithi046.stdout:(34/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 989 kB/s | 49 kB 00:00 2024-09-21T03:42:00.522 INFO:teuthology.orchestra.run.smithi046.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 281 kB/s | 16 kB 00:00 2024-09-21T03:42:00.522 INFO:teuthology.orchestra.run.smithi162.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 2.4 MB/s | 161 kB 00:00 2024-09-21T03:42:00.623 INFO:teuthology.orchestra.run.smithi162.stdout:(22/157): librgw2-19.3.0-5120.g18432218.el9.x86 16 MB/s | 5.3 MB 00:00 2024-09-21T03:42:00.648 INFO:teuthology.orchestra.run.smithi162.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 2.5 MB/s | 321 kB 00:00 2024-09-21T03:42:00.672 INFO:teuthology.orchestra.run.smithi046.stdout:(36/157): ceph-mgr-dashboard-19.3.0-5120.g18432 9.9 MB/s | 14 MB 00:01 2024-09-21T03:42:00.682 INFO:teuthology.orchestra.run.smithi162.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 5.1 MB/s | 307 kB 00:00 2024-09-21T03:42:00.697 INFO:teuthology.orchestra.run.smithi046.stdout:(37/157): ceph-volume-19.3.0-5120.g18432218.el9 1.3 MB/s | 285 kB 00:00 2024-09-21T03:42:00.707 INFO:teuthology.orchestra.run.smithi162.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.7 MB/s | 99 kB 00:00 2024-09-21T03:42:00.723 INFO:teuthology.orchestra.run.smithi046.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 370 kB/s | 18 kB 00:00 2024-09-21T03:42:00.723 INFO:teuthology.orchestra.run.smithi105.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-21T03:42:00.732 INFO:teuthology.orchestra.run.smithi162.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T03:42:00.766 INFO:teuthology.orchestra.run.smithi046.stdout:(39/157): cephadm-19.3.0-5120.g18432218.el9.noa 3.2 MB/s | 784 kB 00:00 2024-09-21T03:42:00.791 INFO:teuthology.orchestra.run.smithi162.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.9 MB/s | 170 kB 00:00 2024-09-21T03:42:00.850 INFO:teuthology.orchestra.run.smithi162.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 588 kB/s | 34 kB 00:00 2024-09-21T03:42:00.908 INFO:teuthology.orchestra.run.smithi162.stdout:(29/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 2.6 MB/s | 154 kB 00:00 2024-09-21T03:42:00.992 INFO:teuthology.orchestra.run.smithi162.stdout:(30/157): rbd-mirror-19.3.0-5120.g18432218.el9. 11 MB/s | 3.1 MB 00:00 2024-09-21T03:42:01.190 INFO:teuthology.orchestra.run.smithi046.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 162 kB/s | 80 kB 00:00 2024-09-21T03:42:01.315 INFO:teuthology.orchestra.run.smithi046.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 347 kB/s | 191 kB 00:00 2024-09-21T03:42:01.426 INFO:teuthology.orchestra.run.smithi162.stdout:(31/157): ceph-test-19.3.0-5120.g18432218.el9.x 17 MB/s | 40 MB 00:02 2024-09-21T03:42:01.484 INFO:teuthology.orchestra.run.smithi162.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 4.9 MB/s | 292 kB 00:00 2024-09-21T03:42:01.548 INFO:teuthology.orchestra.run.smithi162.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 776 kB/s | 49 kB 00:00 2024-09-21T03:42:01.574 INFO:teuthology.orchestra.run.smithi046.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 660 kB/s | 253 kB 00:00 2024-09-21T03:42:01.607 INFO:teuthology.orchestra.run.smithi162.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 282 kB/s | 16 kB 00:00 2024-09-21T03:42:01.624 INFO:teuthology.orchestra.run.smithi046.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 889 kB/s | 801 kB 00:00 2024-09-21T03:42:01.691 INFO:teuthology.orchestra.run.smithi046.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 910 kB/s | 106 kB 00:00 2024-09-21T03:42:01.699 INFO:teuthology.orchestra.run.smithi162.stdout:(35/157): ceph-mgr-diskprediction-local-19.3.0- 10 MB/s | 7.4 MB 00:00 2024-09-21T03:42:01.724 INFO:teuthology.orchestra.run.smithi162.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 2.4 MB/s | 285 kB 00:00 2024-09-21T03:42:01.741 INFO:teuthology.orchestra.run.smithi046.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-21T03:42:01.767 INFO:teuthology.orchestra.run.smithi162.stdout:(37/157): cephfs-top-19.3.0-5120.g18432218.el9. 439 kB/s | 18 kB 00:00 2024-09-21T03:42:01.800 INFO:teuthology.orchestra.run.smithi046.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-09-21T03:42:01.808 INFO:teuthology.orchestra.run.smithi162.stdout:(38/157): cephadm-19.3.0-5120.g18432218.el9.noa 7.0 MB/s | 784 kB 00:00 2024-09-21T03:42:01.858 INFO:teuthology.orchestra.run.smithi046.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-21T03:42:01.892 INFO:teuthology.orchestra.run.smithi046.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 2.1 MB/s | 1.2 MB 00:00 2024-09-21T03:42:01.950 INFO:teuthology.orchestra.run.smithi162.stdout:(39/157): ceph-mgr-dashboard-19.3.0-5120.g18432 14 MB/s | 14 MB 00:01 2024-09-21T03:42:01.976 INFO:teuthology.orchestra.run.smithi162.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 382 kB/s | 80 kB 00:00 2024-09-21T03:42:02.026 INFO:teuthology.orchestra.run.smithi046.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 801 kB/s | 107 kB 00:00 2024-09-21T03:42:02.076 INFO:teuthology.orchestra.run.smithi046.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 435 kB/s | 22 kB 00:00 2024-09-21T03:42:02.084 INFO:teuthology.orchestra.run.smithi162.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-21T03:42:02.118 INFO:teuthology.orchestra.run.smithi162.stdout:(42/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-21T03:42:02.118 INFO:teuthology.orchestra.run.smithi046.stdout:(51/157): automake-1.16.2-8.el9.noarch.rpm 2.1 MB/s | 689 kB 00:00 2024-09-21T03:42:02.152 INFO:teuthology.orchestra.run.smithi162.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.3 MB/s | 801 kB 00:00 2024-09-21T03:42:02.177 INFO:teuthology.orchestra.run.smithi162.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-21T03:42:02.185 INFO:teuthology.orchestra.run.smithi046.stdout:(52/157): flexiblas-3.0.4-8.el9.x86_64.rpm 492 kB/s | 33 kB 00:00 2024-09-21T03:42:02.210 INFO:teuthology.orchestra.run.smithi046.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 2.3 MB/s | 313 kB 00:00 2024-09-21T03:42:02.211 INFO:teuthology.orchestra.run.smithi162.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-21T03:42:02.236 INFO:teuthology.orchestra.run.smithi162.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-21T03:42:02.236 INFO:teuthology.orchestra.run.smithi046.stdout:(54/157): bison-3.7.4-5.el9.x86_64.rpm 2.4 MB/s | 943 kB 00:00 2024-09-21T03:42:02.261 INFO:teuthology.orchestra.run.smithi046.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-09-21T03:42:02.261 INFO:teuthology.orchestra.run.smithi162.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-21T03:42:02.286 INFO:teuthology.orchestra.run.smithi046.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-21T03:42:02.295 INFO:teuthology.orchestra.run.smithi162.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 5.8 MB/s | 1.2 MB 00:00 2024-09-21T03:42:02.337 INFO:teuthology.orchestra.run.smithi046.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.2 MB/s | 171 kB 00:00 2024-09-21T03:42:02.362 INFO:teuthology.orchestra.run.smithi046.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-21T03:42:02.387 INFO:teuthology.orchestra.run.smithi046.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 904 kB/s | 45 kB 00:00 2024-09-21T03:42:02.463 INFO:teuthology.orchestra.run.smithi162.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 641 kB/s | 107 kB 00:00 2024-09-21T03:42:02.512 INFO:teuthology.orchestra.run.smithi162.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 432 kB/s | 22 kB 00:00 2024-09-21T03:42:02.538 INFO:teuthology.orchestra.run.smithi162.stdout:(51/157): automake-1.16.2-8.el9.noarch.rpm 2.2 MB/s | 689 kB 00:00 2024-09-21T03:42:02.571 INFO:teuthology.orchestra.run.smithi162.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 3.0 MB/s | 943 kB 00:00 2024-09-21T03:42:02.587 INFO:teuthology.orchestra.run.smithi046.stdout:(60/157): libtool-2.4.6-46.el9.x86_64.rpm 2.8 MB/s | 581 kB 00:00 2024-09-21T03:42:02.597 INFO:teuthology.orchestra.run.smithi162.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 556 kB/s | 33 kB 00:00 2024-09-21T03:42:02.629 INFO:teuthology.orchestra.run.smithi046.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 590 kB/s | 24 kB 00:00 2024-09-21T03:42:02.630 INFO:teuthology.orchestra.run.smithi162.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-21T03:42:02.656 INFO:teuthology.orchestra.run.smithi162.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 310 kB/s | 18 kB 00:00 2024-09-21T03:42:02.671 INFO:teuthology.orchestra.run.smithi046.stdout:(62/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-21T03:42:02.681 INFO:teuthology.orchestra.run.smithi162.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-09-21T03:42:02.705 INFO:teuthology.orchestra.run.smithi046.stdout:(63/157): librdkafka-1.6.1-102.el9.x86_64.rpm 1.9 MB/s | 662 kB 00:00 2024-09-21T03:42:02.714 INFO:teuthology.orchestra.run.smithi162.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.8 MB/s | 171 kB 00:00 2024-09-21T03:42:02.740 INFO:teuthology.orchestra.run.smithi162.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-21T03:42:02.773 INFO:teuthology.orchestra.run.smithi162.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 771 kB/s | 45 kB 00:00 2024-09-21T03:42:02.780 INFO:teuthology.orchestra.run.smithi046.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-21T03:42:02.805 INFO:teuthology.orchestra.run.smithi046.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-21T03:42:02.830 INFO:teuthology.orchestra.run.smithi046.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 766 kB/s | 38 kB 00:00 2024-09-21T03:42:02.865 INFO:teuthology.orchestra.run.smithi162.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-09-21T03:42:02.899 INFO:teuthology.orchestra.run.smithi162.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 4.5 MB/s | 581 kB 00:00 2024-09-21T03:42:02.949 INFO:teuthology.orchestra.run.smithi162.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 293 kB/s | 24 kB 00:00 2024-09-21T03:42:02.974 INFO:teuthology.orchestra.run.smithi162.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 630 kB/s | 47 kB 00:00 2024-09-21T03:42:02.997 INFO:teuthology.orchestra.run.smithi046.stdout:(67/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.7 MB/s | 3.0 MB 00:00 2024-09-21T03:42:03.008 INFO:teuthology.orchestra.run.smithi162.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-21T03:42:03.058 INFO:teuthology.orchestra.run.smithi162.stdout:(65/157): openblas-0.3.26-2.el9.x86_64.rpm 772 kB/s | 38 kB 00:00 2024-09-21T03:42:03.084 INFO:teuthology.orchestra.run.smithi162.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-21T03:42:03.331 INFO:teuthology.orchestra.run.smithi046.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 4.8 MB/s | 1.6 MB 00:00 2024-09-21T03:42:03.443 INFO:teuthology.orchestra.run.smithi162.stdout:(67/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-21T03:42:03.526 INFO:teuthology.orchestra.run.smithi162.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-21T03:42:03.531 INFO:teuthology.orchestra.run.smithi046.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 4.4 MB/s | 910 kB 00:00 2024-09-21T03:42:03.590 INFO:teuthology.orchestra.run.smithi046.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-21T03:42:03.601 INFO:teuthology.orchestra.run.smithi162.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 12 MB/s | 910 kB 00:00 2024-09-21T03:42:03.685 INFO:teuthology.orchestra.run.smithi162.stdout:(70/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.7 MB/s | 3.0 MB 00:01 2024-09-21T03:42:03.710 INFO:teuthology.orchestra.run.smithi162.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 1.2 MB/s | 137 kB 00:00 2024-09-21T03:42:03.786 INFO:teuthology.orchestra.run.smithi162.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-21T03:42:03.853 INFO:teuthology.orchestra.run.smithi162.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-21T03:42:04.028 INFO:teuthology.orchestra.run.smithi162.stdout:(74/157): python3-babel-2.9.1-2.el9.noarch.rpm 34 MB/s | 6.0 MB 00:00 2024-09-21T03:42:04.079 INFO:teuthology.orchestra.run.smithi162.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-21T03:42:04.090 INFO:teuthology.orchestra.run.smithi046.stdout:(71/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.5 MB/s | 4.4 MB 00:01 2024-09-21T03:42:04.137 INFO:teuthology.orchestra.run.smithi162.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-21T03:42:04.196 INFO:teuthology.orchestra.run.smithi162.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-09-21T03:42:04.207 INFO:teuthology.orchestra.run.smithi046.stdout:(72/157): openblas-openmp-0.3.26-2.el9.x86_64.r 3.5 MB/s | 4.9 MB 00:01 2024-09-21T03:42:04.246 INFO:teuthology.orchestra.run.smithi162.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 514 kB/s | 26 kB 00:00 2024-09-21T03:42:04.257 INFO:teuthology.orchestra.run.smithi046.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-09-21T03:42:04.297 INFO:teuthology.orchestra.run.smithi162.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-21T03:42:04.355 INFO:teuthology.orchestra.run.smithi162.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-21T03:42:04.405 INFO:teuthology.orchestra.run.smithi162.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-09-21T03:42:04.432 INFO:teuthology.orchestra.run.smithi046.stdout:(74/157): protobuf-3.14.0-13.el9.x86_64.rpm 2.9 MB/s | 1.0 MB 00:00 2024-09-21T03:42:04.491 INFO:teuthology.orchestra.run.smithi046.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-21T03:42:04.556 INFO:teuthology.orchestra.run.smithi162.stdout:(82/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 5.1 MB 00:00 2024-09-21T03:42:04.614 INFO:teuthology.orchestra.run.smithi162.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-21T03:42:04.625 INFO:teuthology.orchestra.run.smithi046.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 5.6 MB/s | 5.8 MB 00:01 2024-09-21T03:42:04.650 INFO:teuthology.orchestra.run.smithi046.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.5 MB/s | 245 kB 00:00 2024-09-21T03:42:04.673 INFO:teuthology.orchestra.run.smithi162.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-21T03:42:04.684 INFO:teuthology.orchestra.run.smithi046.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-09-21T03:42:04.709 INFO:teuthology.orchestra.run.smithi046.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 438 kB/s | 26 kB 00:00 2024-09-21T03:42:04.724 INFO:teuthology.orchestra.run.smithi162.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-21T03:42:04.742 INFO:teuthology.orchestra.run.smithi046.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 328 kB/s | 19 kB 00:00 2024-09-21T03:42:04.790 INFO:teuthology.orchestra.run.smithi162.stdout:(86/157): openblas-openmp-0.3.26-2.el9.x86_64.r 2.9 MB/s | 4.9 MB 00:01 2024-09-21T03:42:04.801 INFO:teuthology.orchestra.run.smithi046.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 596 kB/s | 35 kB 00:00 2024-09-21T03:42:04.816 INFO:teuthology.orchestra.run.smithi162.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 460 kB/s | 42 kB 00:00 2024-09-21T03:42:04.835 INFO:teuthology.orchestra.run.smithi046.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-21T03:42:04.849 INFO:teuthology.orchestra.run.smithi162.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-21T03:42:04.875 INFO:teuthology.orchestra.run.smithi162.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-21T03:42:04.917 INFO:teuthology.orchestra.run.smithi162.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 4.0 MB/s | 279 kB 00:00 2024-09-21T03:42:04.942 INFO:teuthology.orchestra.run.smithi162.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 760 kB/s | 51 kB 00:00 2024-09-21T03:42:04.952 INFO:teuthology.orchestra.run.smithi046.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-21T03:42:05.026 INFO:teuthology.orchestra.run.smithi162.stdout:(92/157): postgresql-server-13.16-1.el9.x86_64. 4.3 MB/s | 5.8 MB 00:01 2024-09-21T03:42:05.051 INFO:teuthology.orchestra.run.smithi162.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 402 kB/s | 54 kB 00:00 2024-09-21T03:42:05.060 INFO:teuthology.orchestra.run.smithi046.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-09-21T03:42:05.076 INFO:teuthology.orchestra.run.smithi162.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 831 kB/s | 42 kB 00:00 2024-09-21T03:42:05.101 INFO:teuthology.orchestra.run.smithi162.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 880 kB/s | 44 kB 00:00 2024-09-21T03:42:05.135 INFO:teuthology.orchestra.run.smithi162.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-21T03:42:05.160 INFO:teuthology.orchestra.run.smithi162.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 611 kB/s | 36 kB 00:00 2024-09-21T03:42:05.186 INFO:teuthology.orchestra.run.smithi162.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 941 kB/s | 47 kB 00:00 2024-09-21T03:42:05.220 INFO:teuthology.orchestra.run.smithi162.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-21T03:42:05.236 INFO:teuthology.orchestra.run.smithi046.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 441 kB/s | 77 kB 00:00 2024-09-21T03:42:05.245 INFO:teuthology.orchestra.run.smithi162.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 985 kB/s | 58 kB 00:00 2024-09-21T03:42:05.287 INFO:teuthology.orchestra.run.smithi162.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.4 MB/s | 96 kB 00:00 2024-09-21T03:42:05.294 INFO:teuthology.orchestra.run.smithi046.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 728 kB/s | 42 kB 00:00 2024-09-21T03:42:05.312 INFO:teuthology.orchestra.run.smithi162.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 948 kB/s | 64 kB 00:00 2024-09-21T03:42:05.338 INFO:teuthology.orchestra.run.smithi162.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-09-21T03:42:05.395 INFO:teuthology.orchestra.run.smithi046.stdout:(87/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.6 MB/s | 5.1 MB 00:00 2024-09-21T03:42:05.461 INFO:teuthology.orchestra.run.smithi046.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 1.6 MB/s | 269 kB 00:00 2024-09-21T03:42:05.529 INFO:teuthology.orchestra.run.smithi046.stdout:(89/157): python3-babel-2.9.1-2.el9.noarch.rpm 4.7 MB/s | 6.0 MB 00:01 2024-09-21T03:42:05.554 INFO:teuthology.orchestra.run.smithi046.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.0 MB/s | 159 kB 00:00 2024-09-21T03:42:05.555 INFO:teuthology.orchestra.run.smithi162.stdout:(104/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-09-21T03:42:05.579 INFO:teuthology.orchestra.run.smithi046.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-21T03:42:05.604 INFO:teuthology.orchestra.run.smithi046.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-21T03:42:05.621 INFO:teuthology.orchestra.run.smithi162.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-09-21T03:42:05.629 INFO:teuthology.orchestra.run.smithi046.stdout:(93/157): python3-pyasn1-modules-0.4.8-6.el9.no 1.6 MB/s | 279 kB 00:00 2024-09-21T03:42:05.655 INFO:teuthology.orchestra.run.smithi046.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 829 kB/s | 42 kB 00:00 2024-09-21T03:42:05.680 INFO:teuthology.orchestra.run.smithi046.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 880 kB/s | 44 kB 00:00 2024-09-21T03:42:05.705 INFO:teuthology.orchestra.run.smithi046.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-21T03:42:05.713 INFO:teuthology.orchestra.run.smithi162.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 3.3 MB/s | 308 kB 00:00 2024-09-21T03:42:05.731 INFO:teuthology.orchestra.run.smithi046.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 712 kB/s | 36 kB 00:00 2024-09-21T03:42:05.747 INFO:teuthology.orchestra.run.smithi162.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 1.0 MB/s | 19 kB 00:00 2024-09-21T03:42:05.839 INFO:teuthology.orchestra.run.smithi046.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 355 kB/s | 47 kB 00:00 2024-09-21T03:42:05.865 INFO:teuthology.orchestra.run.smithi046.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.2 MB/s | 304 kB 00:00 2024-09-21T03:42:05.897 INFO:teuthology.orchestra.run.smithi162.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 29 MB/s | 4.4 MB 00:00 2024-09-21T03:42:05.914 INFO:teuthology.orchestra.run.smithi162.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-09-21T03:42:05.915 INFO:teuthology.orchestra.run.smithi046.stdout:(100/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-21T03:42:05.931 INFO:teuthology.orchestra.run.smithi162.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 2.9 MB/s | 49 kB 00:00 2024-09-21T03:42:05.940 INFO:teuthology.orchestra.run.smithi046.stdout:(101/157): uuid-1.6.2-55.el9.x86_64.rpm 575 kB/s | 58 kB 00:00 2024-09-21T03:42:05.957 INFO:teuthology.orchestra.run.smithi162.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T03:42:05.965 INFO:teuthology.orchestra.run.smithi046.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T03:42:05.990 INFO:teuthology.orchestra.run.smithi162.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-21T03:42:05.991 INFO:teuthology.orchestra.run.smithi046.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-09-21T03:42:06.041 INFO:teuthology.orchestra.run.smithi162.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-21T03:42:06.066 INFO:teuthology.orchestra.run.smithi162.stdout:(114/157): lua-devel-5.4.4-4.el9.x86_64.rpm 30 kB/s | 22 kB 00:00 2024-09-21T03:42:06.108 INFO:teuthology.orchestra.run.smithi046.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 157 kB/s | 22 kB 00:00 2024-09-21T03:42:06.116 INFO:teuthology.orchestra.run.smithi162.stdout:(115/157): python3-asyncssh-2.13.2-5.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-09-21T03:42:06.150 INFO:teuthology.orchestra.run.smithi162.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.0 MB/s | 32 kB 00:00 2024-09-21T03:42:06.158 INFO:teuthology.orchestra.run.smithi046.stdout:(105/157): protobuf-compiler-3.14.0-13.el9.x86_ 5.1 MB/s | 863 kB 00:00 2024-09-21T03:42:06.175 INFO:teuthology.orchestra.run.smithi162.stdout:(117/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 399 kB/s | 43 kB 00:00 2024-09-21T03:42:06.197 INFO:teuthology.orchestra.run.smithi105.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-21T03:42:06.200 INFO:teuthology.orchestra.run.smithi162.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-21T03:42:06.208 INFO:teuthology.orchestra.run.smithi046.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 5.3 MB/s | 548 kB 00:00 2024-09-21T03:42:06.226 INFO:teuthology.orchestra.run.smithi162.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-21T03:42:06.234 INFO:teuthology.orchestra.run.smithi046.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 782 kB/s | 19 kB 00:00 2024-09-21T03:42:06.259 INFO:teuthology.orchestra.run.smithi162.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-21T03:42:06.267 INFO:teuthology.orchestra.run.smithi046.stdout:(108/157): gperftools-libs-2.9.1-3.el9.x86_64.r 2.8 MB/s | 308 kB 00:00 2024-09-21T03:42:06.285 INFO:teuthology.orchestra.run.smithi162.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.0 MB/s | 303 kB 00:00 2024-09-21T03:42:06.293 INFO:teuthology.orchestra.run.smithi046.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T03:42:06.310 INFO:teuthology.orchestra.run.smithi162.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T03:42:06.318 INFO:teuthology.orchestra.run.smithi046.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T03:42:06.343 INFO:teuthology.orchestra.run.smithi046.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T03:42:06.344 INFO:teuthology.orchestra.run.smithi162.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-21T03:42:06.369 INFO:teuthology.orchestra.run.smithi162.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-21T03:42:06.377 INFO:teuthology.orchestra.run.smithi046.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-21T03:42:06.394 INFO:teuthology.orchestra.run.smithi162.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 705 kB/s | 18 kB 00:00 2024-09-21T03:42:06.435 INFO:teuthology.orchestra.run.smithi046.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-21T03:42:06.453 INFO:teuthology.orchestra.run.smithi162.stdout:(126/157): python3-grpcio-1.46.7-10.el9.x86_64. 12 MB/s | 2.0 MB 00:00 2024-09-21T03:42:06.479 INFO:teuthology.orchestra.run.smithi162.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 276 kB/s | 23 kB 00:00 2024-09-21T03:42:06.486 INFO:teuthology.orchestra.run.smithi046.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-21T03:42:06.504 INFO:teuthology.orchestra.run.smithi162.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-09-21T03:42:06.511 INFO:teuthology.orchestra.run.smithi046.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T03:42:06.529 INFO:teuthology.orchestra.run.smithi162.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-21T03:42:06.536 INFO:teuthology.orchestra.run.smithi046.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T03:42:06.562 INFO:teuthology.orchestra.run.smithi046.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 563 kB/s | 14 kB 00:00 2024-09-21T03:42:06.571 INFO:teuthology.orchestra.run.smithi162.stdout:(130/157): protobuf-compiler-3.14.0-13.el9.x86_ 700 kB/s | 863 kB 00:01 2024-09-21T03:42:06.596 INFO:teuthology.orchestra.run.smithi162.stdout:(131/157): python3-logutils-0.3.5-21.el9.noarch 692 kB/s | 46 kB 00:00 2024-09-21T03:42:06.621 INFO:teuthology.orchestra.run.smithi046.stdout:(118/157): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-21T03:42:06.630 INFO:teuthology.orchestra.run.smithi162.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.2 MB/s | 58 kB 00:00 2024-09-21T03:42:06.646 INFO:teuthology.orchestra.run.smithi046.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-09-21T03:42:06.656 INFO:teuthology.orchestra.run.smithi162.stdout:(133/157): python3-more-itertools-8.12.0-2.el9. 940 kB/s | 79 kB 00:00 2024-09-21T03:42:06.671 INFO:teuthology.orchestra.run.smithi046.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-21T03:42:06.681 INFO:teuthology.orchestra.run.smithi162.stdout:(134/157): python3-pecan-1.4.2-3.el9.noarch.rpm 5.5 MB/s | 272 kB 00:00 2024-09-21T03:42:06.696 INFO:teuthology.orchestra.run.smithi046.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-21T03:42:06.706 INFO:teuthology.orchestra.run.smithi162.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-09-21T03:42:06.722 INFO:teuthology.orchestra.run.smithi046.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T03:42:06.731 INFO:teuthology.orchestra.run.smithi162.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-21T03:42:06.757 INFO:teuthology.orchestra.run.smithi162.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-21T03:42:06.766 INFO:teuthology.orchestra.run.smithi046.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 3.2 MB/s | 144 kB 00:00 2024-09-21T03:42:06.782 INFO:teuthology.orchestra.run.smithi162.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-21T03:42:06.797 INFO:teuthology.orchestra.run.smithi046.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 351 kB/s | 11 kB 00:00 2024-09-21T03:42:06.807 INFO:teuthology.orchestra.run.smithi162.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T03:42:06.823 INFO:teuthology.orchestra.run.smithi046.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 709 kB/s | 18 kB 00:00 2024-09-21T03:42:06.832 INFO:teuthology.orchestra.run.smithi162.stdout:(140/157): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-21T03:42:06.848 INFO:teuthology.orchestra.run.smithi046.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 930 kB/s | 23 kB 00:00 2024-09-21T03:42:06.858 INFO:teuthology.orchestra.run.smithi162.stdout:(141/157): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-21T03:42:06.873 INFO:teuthology.orchestra.run.smithi046.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 783 kB/s | 19 kB 00:00 2024-09-21T03:42:06.883 INFO:teuthology.orchestra.run.smithi162.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-21T03:42:06.899 INFO:teuthology.orchestra.run.smithi046.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 788 kB/s | 20 kB 00:00 2024-09-21T03:42:06.917 INFO:teuthology.orchestra.run.smithi162.stdout:(143/157): python3-kubernetes-26.1.0-2.el9.noar 2.5 MB/s | 1.0 MB 00:00 2024-09-21T03:42:06.942 INFO:teuthology.orchestra.run.smithi162.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-09-21T03:42:06.957 INFO:teuthology.orchestra.run.smithi046.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 7.8 MB/s | 2.0 MB 00:00 2024-09-21T03:42:06.967 INFO:teuthology.orchestra.run.smithi162.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-21T03:42:06.982 INFO:teuthology.orchestra.run.smithi046.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T03:42:06.984 INFO:teuthology.orchestra.run.smithi162.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 477 kB/s | 20 kB 00:00 2024-09-21T03:42:07.010 INFO:teuthology.orchestra.run.smithi162.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-21T03:42:07.016 INFO:teuthology.orchestra.run.smithi046.stdout:(131/157): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-09-21T03:42:07.035 INFO:teuthology.orchestra.run.smithi162.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-09-21T03:42:07.041 INFO:teuthology.orchestra.run.smithi046.stdout:(132/157): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-09-21T03:42:07.067 INFO:teuthology.orchestra.run.smithi046.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-21T03:42:07.085 INFO:teuthology.orchestra.run.smithi162.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T03:42:07.109 INFO:teuthology.orchestra.run.smithi046.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 396 kB/s | 16 kB 00:00 2024-09-21T03:42:07.134 INFO:teuthology.orchestra.run.smithi046.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-21T03:42:07.159 INFO:teuthology.orchestra.run.smithi046.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-09-21T03:42:07.184 INFO:teuthology.orchestra.run.smithi046.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-21T03:42:07.194 INFO:teuthology.orchestra.run.smithi162.stdout:(150/157): NetworkManager-1.51.0-1.el9.x86_64.r 21 MB/s | 2.3 MB 00:00 2024-09-21T03:42:07.218 INFO:teuthology.orchestra.run.smithi046.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 522 kB/s | 31 kB 00:00 2024-09-21T03:42:07.244 INFO:teuthology.orchestra.run.smithi046.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T03:42:07.261 INFO:teuthology.orchestra.run.smithi162.stdout:(151/157): NetworkManager-libnm-1.51.0-1.el9.x8 27 MB/s | 1.8 MB 00:00 2024-09-21T03:42:07.269 INFO:teuthology.orchestra.run.smithi046.stdout:(140/157): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-21T03:42:07.294 INFO:teuthology.orchestra.run.smithi046.stdout:(141/157): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-09-21T03:42:07.303 INFO:teuthology.orchestra.run.smithi162.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 987 kB/s | 41 kB 00:00 2024-09-21T03:42:07.320 INFO:teuthology.orchestra.run.smithi046.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T03:42:07.345 INFO:teuthology.orchestra.run.smithi046.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T03:42:07.353 INFO:teuthology.orchestra.run.smithi162.stdout:(153/157): librados2-19.3.0-5120.g18432218.el9. 9.9 MB/s | 3.4 MB 00:00 2024-09-21T03:42:07.370 INFO:teuthology.orchestra.run.smithi046.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T03:42:07.395 INFO:teuthology.orchestra.run.smithi046.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 802 kB/s | 20 kB 00:00 2024-09-21T03:42:07.412 INFO:teuthology.orchestra.run.smithi162.stdout:(154/157): librbd1-19.3.0-5120.g18432218.el9.x8 8.4 MB/s | 3.2 MB 00:00 2024-09-21T03:42:07.421 INFO:teuthology.orchestra.run.smithi046.stdout:(146/157): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-21T03:42:07.438 INFO:teuthology.orchestra.run.smithi162.stdout:(155/157): NetworkManager-tui-1.51.0-1.el9.x86_ 1.8 MB/s | 249 kB 00:00 2024-09-21T03:42:07.454 INFO:teuthology.orchestra.run.smithi046.stdout:(147/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-09-21T03:42:07.513 INFO:teuthology.orchestra.run.smithi046.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-21T03:42:07.621 INFO:teuthology.orchestra.run.smithi162.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 5.1 MB/s | 1.4 MB 00:00 2024-09-21T03:42:07.704 INFO:teuthology.orchestra.run.smithi162.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 8.2 MB/s | 2.4 MB 00:00 2024-09-21T03:42:07.711 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T03:42:07.711 INFO:teuthology.orchestra.run.smithi162.stdout:Total 21 MB/s | 228 MB 00:11 2024-09-21T03:42:07.713 INFO:teuthology.orchestra.run.smithi046.stdout:(149/157): librados2-19.3.0-5120.g18432218.el9. 13 MB/s | 3.4 MB 00:00 2024-09-21T03:42:07.790 INFO:teuthology.orchestra.run.smithi046.stdout:(150/157): librbd1-19.3.0-5120.g18432218.el9.x8 11 MB/s | 3.2 MB 00:00 2024-09-21T03:42:08.335 INFO:teuthology.orchestra.run.smithi105.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T03:42:08.335 INFO:teuthology.orchestra.run.smithi105.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T03:42:08.348 INFO:teuthology.orchestra.run.smithi105.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T03:42:08.349 INFO:teuthology.orchestra.run.smithi105.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T03:42:08.350 INFO:teuthology.orchestra.run.smithi105.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T03:42:08.351 INFO:teuthology.orchestra.run.smithi105.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T03:42:08.353 INFO:teuthology.orchestra.run.smithi105.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T03:42:08.356 INFO:teuthology.orchestra.run.smithi105.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T03:42:08.357 INFO:teuthology.orchestra.run.smithi105.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T03:42:08.420 INFO:teuthology.orchestra.run.smithi105.stdout:Dependencies resolved. 2024-09-21T03:42:08.437 INFO:teuthology.orchestra.run.smithi105.stdout:======================================================================================= 2024-09-21T03:42:08.437 INFO:teuthology.orchestra.run.smithi105.stdout: Package Arch Version Repository Size 2024-09-21T03:42:08.437 INFO:teuthology.orchestra.run.smithi105.stdout:======================================================================================= 2024-09-21T03:42:08.437 INFO:teuthology.orchestra.run.smithi105.stdout:Installing: 2024-09-21T03:42:08.437 INFO:teuthology.orchestra.run.smithi105.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T03:42:08.437 INFO:teuthology.orchestra.run.smithi105.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T03:42:08.437 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T03:42:08.437 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T03:42:08.438 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T03:42:08.438 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T03:42:08.438 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T03:42:08.438 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T03:42:08.438 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T03:42:08.438 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T03:42:08.438 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T03:42:08.438 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T03:42:08.438 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T03:42:08.438 INFO:teuthology.orchestra.run.smithi105.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T03:42:08.438 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T03:42:08.438 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T03:42:08.438 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T03:42:08.439 INFO:teuthology.orchestra.run.smithi105.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T03:42:08.439 INFO:teuthology.orchestra.run.smithi105.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T03:42:08.439 INFO:teuthology.orchestra.run.smithi105.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T03:42:08.439 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T03:42:08.439 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T03:42:08.439 INFO:teuthology.orchestra.run.smithi105.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T03:42:08.439 INFO:teuthology.orchestra.run.smithi105.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T03:42:08.439 INFO:teuthology.orchestra.run.smithi105.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T03:42:08.439 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T03:42:08.439 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T03:42:08.439 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T03:42:08.439 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T03:42:08.439 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T03:42:08.439 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T03:42:08.440 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T03:42:08.440 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T03:42:08.440 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T03:42:08.440 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T03:42:08.440 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T03:42:08.440 INFO:teuthology.orchestra.run.smithi105.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T03:42:08.440 INFO:teuthology.orchestra.run.smithi105.stdout:Upgrading: 2024-09-21T03:42:08.440 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T03:42:08.440 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T03:42:08.440 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T03:42:08.440 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T03:42:08.440 INFO:teuthology.orchestra.run.smithi105.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T03:42:08.440 INFO:teuthology.orchestra.run.smithi105.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T03:42:08.440 INFO:teuthology.orchestra.run.smithi105.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T03:42:08.441 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T03:42:08.441 INFO:teuthology.orchestra.run.smithi105.stdout:Installing dependencies: 2024-09-21T03:42:08.441 INFO:teuthology.orchestra.run.smithi105.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T03:42:08.441 INFO:teuthology.orchestra.run.smithi105.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T03:42:08.441 INFO:teuthology.orchestra.run.smithi105.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T03:42:08.441 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T03:42:08.441 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T03:42:08.441 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T03:42:08.441 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T03:42:08.441 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T03:42:08.441 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T03:42:08.441 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T03:42:08.441 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T03:42:08.441 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T03:42:08.441 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T03:42:08.442 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T03:42:08.442 INFO:teuthology.orchestra.run.smithi105.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T03:42:08.442 INFO:teuthology.orchestra.run.smithi105.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T03:42:08.442 INFO:teuthology.orchestra.run.smithi105.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T03:42:08.442 INFO:teuthology.orchestra.run.smithi105.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T03:42:08.442 INFO:teuthology.orchestra.run.smithi105.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T03:42:08.442 INFO:teuthology.orchestra.run.smithi105.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T03:42:08.442 INFO:teuthology.orchestra.run.smithi105.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T03:42:08.442 INFO:teuthology.orchestra.run.smithi105.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T03:42:08.442 INFO:teuthology.orchestra.run.smithi105.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T03:42:08.442 INFO:teuthology.orchestra.run.smithi105.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T03:42:08.442 INFO:teuthology.orchestra.run.smithi105.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T03:42:08.443 INFO:teuthology.orchestra.run.smithi105.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T03:42:08.443 INFO:teuthology.orchestra.run.smithi105.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T03:42:08.443 INFO:teuthology.orchestra.run.smithi105.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T03:42:08.443 INFO:teuthology.orchestra.run.smithi105.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T03:42:08.443 INFO:teuthology.orchestra.run.smithi105.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T03:42:08.443 INFO:teuthology.orchestra.run.smithi105.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T03:42:08.443 INFO:teuthology.orchestra.run.smithi105.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T03:42:08.443 INFO:teuthology.orchestra.run.smithi105.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T03:42:08.443 INFO:teuthology.orchestra.run.smithi105.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T03:42:08.443 INFO:teuthology.orchestra.run.smithi105.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T03:42:08.443 INFO:teuthology.orchestra.run.smithi105.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T03:42:08.443 INFO:teuthology.orchestra.run.smithi105.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T03:42:08.443 INFO:teuthology.orchestra.run.smithi105.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T03:42:08.443 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T03:42:08.444 INFO:teuthology.orchestra.run.smithi105.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T03:42:08.444 INFO:teuthology.orchestra.run.smithi105.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T03:42:08.444 INFO:teuthology.orchestra.run.smithi105.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T03:42:08.444 INFO:teuthology.orchestra.run.smithi105.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T03:42:08.444 INFO:teuthology.orchestra.run.smithi105.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T03:42:08.444 INFO:teuthology.orchestra.run.smithi105.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T03:42:08.444 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T03:42:08.444 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T03:42:08.444 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T03:42:08.444 INFO:teuthology.orchestra.run.smithi105.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T03:42:08.444 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T03:42:08.444 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T03:42:08.445 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T03:42:08.445 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T03:42:08.445 INFO:teuthology.orchestra.run.smithi105.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T03:42:08.445 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T03:42:08.445 INFO:teuthology.orchestra.run.smithi105.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T03:42:08.445 INFO:teuthology.orchestra.run.smithi105.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T03:42:08.445 INFO:teuthology.orchestra.run.smithi105.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T03:42:08.445 INFO:teuthology.orchestra.run.smithi105.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T03:42:08.445 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T03:42:08.445 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T03:42:08.445 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T03:42:08.445 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T03:42:08.445 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T03:42:08.445 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T03:42:08.446 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T03:42:08.446 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T03:42:08.446 INFO:teuthology.orchestra.run.smithi105.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T03:42:08.446 INFO:teuthology.orchestra.run.smithi105.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T03:42:08.446 INFO:teuthology.orchestra.run.smithi105.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T03:42:08.446 INFO:teuthology.orchestra.run.smithi105.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T03:42:08.446 INFO:teuthology.orchestra.run.smithi105.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T03:42:08.446 INFO:teuthology.orchestra.run.smithi105.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T03:42:08.446 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T03:42:08.446 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T03:42:08.446 INFO:teuthology.orchestra.run.smithi105.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T03:42:08.446 INFO:teuthology.orchestra.run.smithi105.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T03:42:08.446 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T03:42:08.446 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T03:42:08.447 INFO:teuthology.orchestra.run.smithi105.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T03:42:08.447 INFO:teuthology.orchestra.run.smithi105.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T03:42:08.447 INFO:teuthology.orchestra.run.smithi105.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T03:42:08.447 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T03:42:08.447 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T03:42:08.447 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T03:42:08.447 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T03:42:08.447 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T03:42:08.447 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T03:42:08.447 INFO:teuthology.orchestra.run.smithi105.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T03:42:08.447 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T03:42:08.447 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T03:42:08.447 INFO:teuthology.orchestra.run.smithi105.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T03:42:08.447 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T03:42:08.448 INFO:teuthology.orchestra.run.smithi105.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T03:42:08.448 INFO:teuthology.orchestra.run.smithi105.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T03:42:08.448 INFO:teuthology.orchestra.run.smithi105.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T03:42:08.448 INFO:teuthology.orchestra.run.smithi105.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T03:42:08.448 INFO:teuthology.orchestra.run.smithi105.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T03:42:08.448 INFO:teuthology.orchestra.run.smithi105.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T03:42:08.448 INFO:teuthology.orchestra.run.smithi105.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T03:42:08.448 INFO:teuthology.orchestra.run.smithi105.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T03:42:08.448 INFO:teuthology.orchestra.run.smithi105.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T03:42:08.448 INFO:teuthology.orchestra.run.smithi105.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T03:42:08.448 INFO:teuthology.orchestra.run.smithi105.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T03:42:08.448 INFO:teuthology.orchestra.run.smithi105.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T03:42:08.448 INFO:teuthology.orchestra.run.smithi105.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T03:42:08.449 INFO:teuthology.orchestra.run.smithi105.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T03:42:08.449 INFO:teuthology.orchestra.run.smithi105.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T03:42:08.449 INFO:teuthology.orchestra.run.smithi105.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T03:42:08.449 INFO:teuthology.orchestra.run.smithi105.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T03:42:08.449 INFO:teuthology.orchestra.run.smithi105.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T03:42:08.449 INFO:teuthology.orchestra.run.smithi105.stdout:Installing weak dependencies: 2024-09-21T03:42:08.449 INFO:teuthology.orchestra.run.smithi105.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T03:42:08.449 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:42:08.449 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction Summary 2024-09-21T03:42:08.449 INFO:teuthology.orchestra.run.smithi105.stdout:======================================================================================= 2024-09-21T03:42:08.449 INFO:teuthology.orchestra.run.smithi105.stdout:Install 149 Packages 2024-09-21T03:42:08.449 INFO:teuthology.orchestra.run.smithi105.stdout:Upgrade 8 Packages 2024-09-21T03:42:08.449 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:42:08.450 INFO:teuthology.orchestra.run.smithi105.stdout:Total download size: 228 M 2024-09-21T03:42:08.450 INFO:teuthology.orchestra.run.smithi105.stdout:Downloading Packages: 2024-09-21T03:42:08.852 INFO:teuthology.orchestra.run.smithi046.stdout:(151/157): NetworkManager-1.51.0-1.el9.x86_64.r 2.0 MB/s | 2.3 MB 00:01 2024-09-21T03:42:08.891 INFO:teuthology.orchestra.run.smithi046.stdout:(152/157): NetworkManager-libnm-1.51.0-1.el9.x8 1.6 MB/s | 1.8 MB 00:01 2024-09-21T03:42:08.955 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T03:42:08.966 INFO:teuthology.orchestra.run.smithi046.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 360 kB/s | 41 kB 00:00 2024-09-21T03:42:09.006 INFO:teuthology.orchestra.run.smithi105.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 50 kB/s | 6.6 kB 00:00 2024-09-21T03:42:09.008 INFO:teuthology.orchestra.run.smithi046.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 2.1 MB/s | 249 kB 00:00 2024-09-21T03:42:09.110 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T03:42:09.111 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T03:42:09.181 INFO:teuthology.orchestra.run.smithi105.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.9 MB/s | 873 kB 00:00 2024-09-21T03:42:09.183 INFO:teuthology.orchestra.run.smithi046.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 6.2 MB/s | 1.4 MB 00:00 2024-09-21T03:42:09.249 INFO:teuthology.orchestra.run.smithi105.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 2.2 MB/s | 148 kB 00:00 2024-09-21T03:42:09.424 INFO:teuthology.orchestra.run.smithi105.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 10 MB/s | 5.5 MB 00:00 2024-09-21T03:42:09.474 INFO:teuthology.orchestra.run.smithi105.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 10 MB/s | 2.3 MB 00:00 2024-09-21T03:42:09.558 INFO:teuthology.orchestra.run.smithi105.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 11 MB/s | 1.5 MB 00:00 2024-09-21T03:42:09.833 INFO:teuthology.orchestra.run.smithi046.stdout:(156/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.8 MB/s | 16 MB 00:04 2024-09-21T03:42:09.875 INFO:teuthology.orchestra.run.smithi105.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 12 MB/s | 5.0 MB 00:00 2024-09-21T03:42:10.125 INFO:teuthology.orchestra.run.smithi105.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 16 MB/s | 20 MB 00:01 2024-09-21T03:42:10.167 INFO:teuthology.orchestra.run.smithi105.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 607 kB/s | 25 kB 00:00 2024-09-21T03:42:10.233 INFO:teuthology.orchestra.run.smithi046.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.0 MB/s | 2.4 MB 00:01 2024-09-21T03:42:10.238 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-21T03:42:10.238 INFO:teuthology.orchestra.run.smithi046.stdout:Total 16 MB/s | 228 MB 00:14 2024-09-21T03:42:10.593 INFO:teuthology.orchestra.run.smithi105.stdout:(10/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 17 MB/s | 18 MB 00:01 2024-09-21T03:42:10.709 INFO:teuthology.orchestra.run.smithi105.stdout:(11/157): ceph-radosgw-19.3.0-5120.g18432218.el 12 MB/s | 10 MB 00:00 2024-09-21T03:42:10.734 INFO:teuthology.orchestra.run.smithi105.stdout:(12/157): cephfs-mirror-19.3.0-5120.g18432218.e 1.6 MB/s | 226 kB 00:00 2024-09-21T03:42:10.751 INFO:teuthology.orchestra.run.smithi105.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 646 kB/s | 27 kB 00:00 2024-09-21T03:42:10.768 INFO:teuthology.orchestra.run.smithi105.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 944 kB/s | 32 kB 00:00 2024-09-21T03:42:10.810 INFO:teuthology.orchestra.run.smithi105.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 13 MB/s | 766 kB 00:00 2024-09-21T03:42:10.835 INFO:teuthology.orchestra.run.smithi105.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 2.3 MB/s | 158 kB 00:00 2024-09-21T03:42:10.886 INFO:teuthology.orchestra.run.smithi105.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 1.6 MB/s | 127 kB 00:00 2024-09-21T03:42:10.911 INFO:teuthology.orchestra.run.smithi105.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 6.6 MB/s | 507 kB 00:00 2024-09-21T03:42:10.932 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T03:42:10.933 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T03:42:10.970 INFO:teuthology.orchestra.run.smithi105.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 771 kB/s | 45 kB 00:00 2024-09-21T03:42:11.062 INFO:teuthology.orchestra.run.smithi105.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.6 MB/s | 148 kB 00:00 2024-09-21T03:42:11.145 INFO:teuthology.orchestra.run.smithi105.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 1.9 MB/s | 161 kB 00:00 2024-09-21T03:42:11.237 INFO:teuthology.orchestra.run.smithi105.stdout:(22/157): librgw2-19.3.0-5120.g18432218.el9.x86 15 MB/s | 5.3 MB 00:00 2024-09-21T03:42:11.271 INFO:teuthology.orchestra.run.smithi105.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 2.5 MB/s | 321 kB 00:00 2024-09-21T03:42:11.298 INFO:teuthology.orchestra.run.smithi105.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 5.0 MB/s | 307 kB 00:00 2024-09-21T03:42:11.323 INFO:teuthology.orchestra.run.smithi105.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T03:42:11.435 INFO:teuthology.orchestra.run.smithi105.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 632 kB/s | 86 kB 00:00 2024-09-21T03:42:11.507 INFO:teuthology.orchestra.run.smithi105.stdout:(27/157): rbd-mirror-19.3.0-5120.g18432218.el9. 17 MB/s | 3.1 MB 00:00 2024-09-21T03:42:11.518 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-21T03:42:11.532 INFO:teuthology.orchestra.run.smithi105.stdout:(28/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 1.7 MB/s | 170 kB 00:00 2024-09-21T03:42:11.558 INFO:teuthology.orchestra.run.smithi105.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 681 kB/s | 34 kB 00:00 2024-09-21T03:42:11.583 INFO:teuthology.orchestra.run.smithi105.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T03:42:11.689 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-21T03:42:11.689 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-21T03:42:12.333 INFO:teuthology.orchestra.run.smithi105.stdout:(31/157): ceph-test-19.3.0-5120.g18432218.el9.x 18 MB/s | 40 MB 00:02 2024-09-21T03:42:12.467 INFO:teuthology.orchestra.run.smithi105.stdout:(32/157): ceph-mgr-diskprediction-local-19.3.0- 8.3 MB/s | 7.4 MB 00:00 2024-09-21T03:42:12.492 INFO:teuthology.orchestra.run.smithi105.stdout:(33/157): ceph-mgr-modules-core-19.3.0-5120.g18 1.8 MB/s | 292 kB 00:00 2024-09-21T03:42:12.517 INFO:teuthology.orchestra.run.smithi105.stdout:(34/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 986 kB/s | 49 kB 00:00 2024-09-21T03:42:12.534 INFO:teuthology.orchestra.run.smithi105.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 394 kB/s | 16 kB 00:00 2024-09-21T03:42:12.577 INFO:teuthology.orchestra.run.smithi105.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 4.8 MB/s | 285 kB 00:00 2024-09-21T03:42:12.618 INFO:teuthology.orchestra.run.smithi105.stdout:(37/157): cephfs-top-19.3.0-5120.g18432218.el9. 444 kB/s | 18 kB 00:00 2024-09-21T03:42:12.644 INFO:teuthology.orchestra.run.smithi105.stdout:(38/157): cephadm-19.3.0-5120.g18432218.el9.noa 7.0 MB/s | 784 kB 00:00 2024-09-21T03:42:12.778 INFO:teuthology.orchestra.run.smithi105.stdout:(39/157): ceph-mgr-dashboard-19.3.0-5120.g18432 12 MB/s | 14 MB 00:01 2024-09-21T03:42:12.894 INFO:teuthology.orchestra.run.smithi105.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 290 kB/s | 80 kB 00:00 2024-09-21T03:42:12.969 INFO:teuthology.orchestra.run.smithi105.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 998 kB/s | 191 kB 00:00 2024-09-21T03:42:13.003 INFO:teuthology.orchestra.run.smithi105.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-21T03:42:13.045 INFO:teuthology.orchestra.run.smithi105.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 801 kB 00:00 2024-09-21T03:42:13.070 INFO:teuthology.orchestra.run.smithi105.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-21T03:42:13.121 INFO:teuthology.orchestra.run.smithi105.stdout:(45/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-21T03:42:13.146 INFO:teuthology.orchestra.run.smithi105.stdout:(46/157): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 135 kB 00:00 2024-09-21T03:42:13.205 INFO:teuthology.orchestra.run.smithi105.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-21T03:42:13.322 INFO:teuthology.orchestra.run.smithi105.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 3.5 MB/s | 1.2 MB 00:00 2024-09-21T03:42:13.355 INFO:teuthology.orchestra.run.smithi105.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 689 kB 00:00 2024-09-21T03:42:13.397 INFO:teuthology.orchestra.run.smithi105.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 520 kB/s | 22 kB 00:00 2024-09-21T03:42:13.422 INFO:teuthology.orchestra.run.smithi105.stdout:(51/157): bison-3.7.4-5.el9.x86_64.rpm 4.2 MB/s | 943 kB 00:00 2024-09-21T03:42:13.448 INFO:teuthology.orchestra.run.smithi105.stdout:(52/157): boost-program-options-1.75.0-8.el9.x8 848 kB/s | 107 kB 00:00 2024-09-21T03:42:13.473 INFO:teuthology.orchestra.run.smithi105.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 650 kB/s | 33 kB 00:00 2024-09-21T03:42:13.498 INFO:teuthology.orchestra.run.smithi105.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 3.0 MB/s | 313 kB 00:00 2024-09-21T03:42:13.524 INFO:teuthology.orchestra.run.smithi105.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-09-21T03:42:13.549 INFO:teuthology.orchestra.run.smithi105.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-21T03:42:13.574 INFO:teuthology.orchestra.run.smithi105.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-21T03:42:13.616 INFO:teuthology.orchestra.run.smithi105.stdout:(58/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-21T03:42:13.641 INFO:teuthology.orchestra.run.smithi105.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-09-21T03:42:13.725 INFO:teuthology.orchestra.run.smithi105.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 662 kB 00:00 2024-09-21T03:42:13.767 INFO:teuthology.orchestra.run.smithi105.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 591 kB/s | 24 kB 00:00 2024-09-21T03:42:13.809 INFO:teuthology.orchestra.run.smithi105.stdout:(62/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-21T03:42:13.842 INFO:teuthology.orchestra.run.smithi105.stdout:(63/157): libtool-2.4.6-46.el9.x86_64.rpm 2.8 MB/s | 581 kB 00:00 2024-09-21T03:42:13.909 INFO:teuthology.orchestra.run.smithi105.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-21T03:42:13.935 INFO:teuthology.orchestra.run.smithi105.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-09-21T03:42:13.960 INFO:teuthology.orchestra.run.smithi105.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 763 kB/s | 38 kB 00:00 2024-09-21T03:42:14.020 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-21T03:42:14.020 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-21T03:42:14.069 INFO:teuthology.orchestra.run.smithi105.stdout:(67/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.8 MB/s | 3.0 MB 00:00 2024-09-21T03:42:14.219 INFO:teuthology.orchestra.run.smithi105.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-21T03:42:14.311 INFO:teuthology.orchestra.run.smithi105.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 9.7 MB/s | 910 kB 00:00 2024-09-21T03:42:14.368 INFO:teuthology.orchestra.run.smithi105.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-21T03:42:14.820 INFO:teuthology.orchestra.run.smithi105.stdout:(71/157): postgresql-server-13.16-1.el9.x86_64. 13 MB/s | 5.8 MB 00:00 2024-09-21T03:42:14.928 INFO:teuthology.orchestra.run.smithi105.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-09-21T03:42:14.979 INFO:teuthology.orchestra.run.smithi105.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-09-21T03:42:15.337 INFO:teuthology.orchestra.run.smithi105.stdout:(74/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.2 MB/s | 4.4 MB 00:01 2024-09-21T03:42:15.371 INFO:teuthology.orchestra.run.smithi105.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.8 MB/s | 61 kB 00:00 2024-09-21T03:42:15.471 INFO:teuthology.orchestra.run.smithi105.stdout:(76/157): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-09-21T03:42:15.538 INFO:teuthology.orchestra.run.smithi105.stdout:(77/157): openblas-openmp-0.3.26-2.el9.x86_64.r 3.1 MB/s | 4.9 MB 00:01 2024-09-21T03:42:15.563 INFO:teuthology.orchestra.run.smithi105.stdout:(78/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.2 MB/s | 245 kB 00:00 2024-09-21T03:42:15.580 INFO:teuthology.orchestra.run.smithi105.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 611 kB/s | 26 kB 00:00 2024-09-21T03:42:15.597 INFO:teuthology.orchestra.run.smithi105.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 568 kB/s | 19 kB 00:00 2024-09-21T03:42:15.623 INFO:teuthology.orchestra.run.smithi105.stdout:(81/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.6 MB/s | 248 kB 00:00 2024-09-21T03:42:15.639 INFO:teuthology.orchestra.run.smithi105.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 830 kB/s | 35 kB 00:00 2024-09-21T03:42:15.665 INFO:teuthology.orchestra.run.smithi105.stdout:(83/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-21T03:42:15.707 INFO:teuthology.orchestra.run.smithi105.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 5.2 MB/s | 222 kB 00:00 2024-09-21T03:42:15.757 INFO:teuthology.orchestra.run.smithi105.stdout:(85/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-21T03:42:15.808 INFO:teuthology.orchestra.run.smithi105.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 769 kB/s | 77 kB 00:00 2024-09-21T03:42:15.833 INFO:teuthology.orchestra.run.smithi105.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 562 kB/s | 42 kB 00:00 2024-09-21T03:42:15.927 INFO:teuthology.orchestra.run.smithi105.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-09-21T03:42:15.950 INFO:teuthology.orchestra.run.smithi105.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 1.9 MB/s | 269 kB 00:00 2024-09-21T03:42:15.992 INFO:teuthology.orchestra.run.smithi105.stdout:(90/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-21T03:42:16.034 INFO:teuthology.orchestra.run.smithi105.stdout:(91/157): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 54 kB 00:00 2024-09-21T03:42:16.059 INFO:teuthology.orchestra.run.smithi105.stdout:(92/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.0 MB/s | 279 kB 00:00 2024-09-21T03:42:16.101 INFO:teuthology.orchestra.run.smithi105.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-21T03:42:16.185 INFO:teuthology.orchestra.run.smithi105.stdout:(94/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 9.1 MB/s | 5.1 MB 00:00 2024-09-21T03:42:16.210 INFO:teuthology.orchestra.run.smithi105.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 407 kB/s | 44 kB 00:00 2024-09-21T03:42:16.235 INFO:teuthology.orchestra.run.smithi105.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-21T03:42:16.261 INFO:teuthology.orchestra.run.smithi105.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 716 kB/s | 36 kB 00:00 2024-09-21T03:42:16.286 INFO:teuthology.orchestra.run.smithi105.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-09-21T03:42:16.327 INFO:teuthology.orchestra.run.smithi105.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-09-21T03:42:16.370 INFO:teuthology.orchestra.run.smithi105.stdout:(100/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 2.2 MB/s | 96 kB 00:00 2024-09-21T03:42:16.395 INFO:teuthology.orchestra.run.smithi105.stdout:(101/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.2 MB/s | 304 kB 00:00 2024-09-21T03:42:16.420 INFO:teuthology.orchestra.run.smithi105.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T03:42:16.446 INFO:teuthology.orchestra.run.smithi105.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 890 kB/s | 45 kB 00:00 2024-09-21T03:42:16.538 INFO:teuthology.orchestra.run.smithi105.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-09-21T03:42:16.629 INFO:teuthology.orchestra.run.smithi105.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 5.8 MB/s | 548 kB 00:00 2024-09-21T03:42:16.655 INFO:teuthology.orchestra.run.smithi105.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 12 MB/s | 308 kB 00:00 2024-09-21T03:42:16.680 INFO:teuthology.orchestra.run.smithi105.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-21T03:42:16.714 INFO:teuthology.orchestra.run.smithi105.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 3.1 MB/s | 863 kB 00:00 2024-09-21T03:42:16.764 INFO:teuthology.orchestra.run.smithi105.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 521 kB/s | 26 kB 00:00 2024-09-21T03:42:16.798 INFO:teuthology.orchestra.run.smithi105.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-21T03:42:16.831 INFO:teuthology.orchestra.run.smithi105.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-21T03:42:16.907 INFO:teuthology.orchestra.run.smithi105.stdout:(112/157): libarrow-9.0.0-11.el9.x86_64.rpm 19 MB/s | 4.4 MB 00:00 2024-09-21T03:42:16.932 INFO:teuthology.orchestra.run.smithi105.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 1.5 MB/s | 151 kB 00:00 2024-09-21T03:42:16.966 INFO:teuthology.orchestra.run.smithi105.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-21T03:42:16.983 INFO:teuthology.orchestra.run.smithi105.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-21T03:42:17.016 INFO:teuthology.orchestra.run.smithi105.stdout:(116/157): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-09-21T03:42:17.033 INFO:teuthology.orchestra.run.smithi105.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 639 kB/s | 32 kB 00:00 2024-09-21T03:42:17.058 INFO:teuthology.orchestra.run.smithi105.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 338 kB/s | 14 kB 00:00 2024-09-21T03:42:17.092 INFO:teuthology.orchestra.run.smithi105.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-21T03:42:17.126 INFO:teuthology.orchestra.run.smithi105.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-21T03:42:17.159 INFO:teuthology.orchestra.run.smithi105.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-21T03:42:17.185 INFO:teuthology.orchestra.run.smithi105.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-21T03:42:17.218 INFO:teuthology.orchestra.run.smithi105.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-21T03:42:17.244 INFO:teuthology.orchestra.run.smithi105.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-09-21T03:42:17.269 INFO:teuthology.orchestra.run.smithi105.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 714 kB/s | 18 kB 00:00 2024-09-21T03:42:17.294 INFO:teuthology.orchestra.run.smithi105.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 930 kB/s | 23 kB 00:00 2024-09-21T03:42:17.319 INFO:teuthology.orchestra.run.smithi105.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 778 kB/s | 19 kB 00:00 2024-09-21T03:42:17.345 INFO:teuthology.orchestra.run.smithi105.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 788 kB/s | 20 kB 00:00 2024-09-21T03:42:17.387 INFO:teuthology.orchestra.run.smithi105.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 9.0 MB/s | 2.0 MB 00:00 2024-09-21T03:42:17.412 INFO:teuthology.orchestra.run.smithi105.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T03:42:17.437 INFO:teuthology.orchestra.run.smithi105.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T03:42:17.463 INFO:teuthology.orchestra.run.smithi105.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T03:42:17.486 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T03:42:17.496 INFO:teuthology.orchestra.run.smithi105.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-09-21T03:42:17.521 INFO:teuthology.orchestra.run.smithi105.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-09-21T03:42:17.547 INFO:teuthology.orchestra.run.smithi105.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-21T03:42:17.581 INFO:teuthology.orchestra.run.smithi105.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-09-21T03:42:17.599 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T03:42:17.606 INFO:teuthology.orchestra.run.smithi105.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 479 kB/s | 28 kB 00:00 2024-09-21T03:42:17.631 INFO:teuthology.orchestra.run.smithi105.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 615 kB/s | 31 kB 00:00 2024-09-21T03:42:17.657 INFO:teuthology.orchestra.run.smithi105.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T03:42:17.682 INFO:teuthology.orchestra.run.smithi105.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-21T03:42:17.707 INFO:teuthology.orchestra.run.smithi105.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-09-21T03:42:17.732 INFO:teuthology.orchestra.run.smithi105.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T03:42:17.741 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T03:42:17.758 INFO:teuthology.orchestra.run.smithi105.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T03:42:17.783 INFO:teuthology.orchestra.run.smithi105.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T03:42:17.808 INFO:teuthology.orchestra.run.smithi105.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 804 kB/s | 20 kB 00:00 2024-09-21T03:42:17.833 INFO:teuthology.orchestra.run.smithi105.stdout:(146/157): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-21T03:42:17.859 INFO:teuthology.orchestra.run.smithi105.stdout:(147/157): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-21T03:42:17.910 INFO:teuthology.orchestra.run.smithi105.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-21T03:42:17.918 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T03:42:17.959 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T03:42:17.984 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T03:42:18.028 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T03:42:18.110 INFO:teuthology.orchestra.run.smithi105.stdout:(149/157): librados2-19.3.0-5120.g18432218.el9. 14 MB/s | 3.4 MB 00:00 2024-09-21T03:42:18.185 INFO:teuthology.orchestra.run.smithi105.stdout:(150/157): librbd1-19.3.0-5120.g18432218.el9.x8 12 MB/s | 3.2 MB 00:00 2024-09-21T03:42:18.371 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T03:42:18.494 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:42:18.586 INFO:teuthology.orchestra.run.smithi105.stdout:(151/157): NetworkManager-1.51.0-1.el9.x86_64.r 4.9 MB/s | 2.3 MB 00:00 2024-09-21T03:42:18.603 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:42:18.627 INFO:teuthology.orchestra.run.smithi105.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 986 kB/s | 41 kB 00:00 2024-09-21T03:42:18.628 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:42:18.711 INFO:teuthology.orchestra.run.smithi105.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 2.9 MB/s | 249 kB 00:00 2024-09-21T03:42:18.720 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:42:18.749 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T03:42:18.779 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T03:42:18.919 INFO:teuthology.orchestra.run.smithi105.stdout:(154/157): NetworkManager-libnm-1.51.0-1.el9.x8 2.5 MB/s | 1.8 MB 00:00 2024-09-21T03:42:18.932 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T03:42:18.961 INFO:teuthology.orchestra.run.smithi105.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 5.4 MB/s | 1.4 MB 00:00 2024-09-21T03:42:18.981 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T03:42:19.009 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:42:19.114 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:42:19.143 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T03:42:19.206 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T03:42:19.228 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T03:42:19.264 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T03:42:19.421 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T03:42:19.566 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T03:42:19.603 INFO:teuthology.orchestra.run.smithi105.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.5 MB/s | 2.4 MB 00:00 2024-09-21T03:42:19.702 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T03:42:19.804 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:42:19.862 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:42:20.100 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:42:20.208 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T03:42:20.237 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T03:42:20.272 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T03:42:20.345 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T03:42:20.390 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T03:42:20.430 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T03:42:20.474 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T03:42:20.506 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T03:42:20.534 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T03:42:20.611 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T03:42:20.673 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T03:42:20.703 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T03:42:20.739 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T03:42:20.822 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T03:42:20.858 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T03:42:20.910 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T03:42:20.939 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T03:42:20.957 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-21T03:42:21.007 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T03:42:21.055 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T03:42:21.062 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T03:42:21.078 INFO:teuthology.orchestra.run.smithi105.stdout:(157/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.2 MB/s | 16 MB 00:05 2024-09-21T03:42:21.084 INFO:teuthology.orchestra.run.smithi105.stdout:-------------------------------------------------------------------------------- 2024-09-21T03:42:21.084 INFO:teuthology.orchestra.run.smithi105.stdout:Total 18 MB/s | 228 MB 00:12 2024-09-21T03:42:21.098 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T03:42:21.144 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T03:42:21.156 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T03:42:21.197 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T03:42:21.222 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T03:42:21.276 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T03:42:21.281 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T03:42:21.331 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T03:42:21.701 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T03:42:21.756 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:42:21.858 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T03:42:21.886 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:42:21.942 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:42:21.943 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T03:42:21.973 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T03:42:22.016 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T03:42:22.033 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:42:22.054 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T03:42:22.062 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T03:42:22.092 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T03:42:22.095 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T03:42:22.261 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T03:42:22.280 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T03:42:22.313 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T03:42:22.320 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction check 2024-09-21T03:42:22.335 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T03:42:22.363 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:42:22.403 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T03:42:22.468 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T03:42:22.471 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:42:22.476 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction check succeeded. 2024-09-21T03:42:22.476 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction test 2024-09-21T03:42:22.505 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T03:42:22.541 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T03:42:22.573 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T03:42:22.575 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T03:42:22.606 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T03:42:22.609 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T03:42:22.630 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T03:42:22.664 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T03:42:22.708 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T03:42:22.752 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T03:42:22.776 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T03:42:22.794 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T03:42:22.930 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T03:42:22.954 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T03:42:23.080 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T03:42:23.080 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T03:42:23.121 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T03:42:23.189 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:42:23.225 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T03:42:23.248 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:42:23.263 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T03:42:23.303 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T03:42:23.329 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T03:42:23.353 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T03:42:23.428 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T03:42:23.475 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:42:23.555 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T03:42:23.590 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T03:42:23.603 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T03:42:23.623 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T03:42:23.639 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T03:42:23.663 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T03:42:23.682 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T03:42:23.721 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T03:42:23.737 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T03:42:23.753 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T03:42:23.783 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T03:42:23.788 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T03:42:23.817 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T03:42:23.829 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T03:42:23.851 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T03:42:23.873 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T03:42:23.892 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T03:42:23.914 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T03:42:23.927 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T03:42:23.941 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T03:42:24.013 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T03:42:24.014 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T03:42:24.065 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T03:42:24.072 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T03:42:24.102 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T03:42:24.105 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T03:42:24.151 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T03:42:24.208 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T03:42:24.238 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T03:42:24.257 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T03:42:24.273 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T03:42:24.317 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T03:42:24.345 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T03:42:24.357 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction test succeeded. 2024-09-21T03:42:24.357 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction 2024-09-21T03:42:24.418 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T03:42:24.469 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T03:42:24.547 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T03:42:24.691 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T03:42:24.748 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T03:42:24.974 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T03:42:25.029 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T03:42:25.063 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T03:42:25.161 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T03:42:25.218 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T03:42:25.263 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T03:42:25.309 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T03:42:25.350 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T03:42:25.391 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T03:42:25.402 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T03:42:25.437 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T03:42:25.480 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T03:42:25.518 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T03:42:25.561 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T03:42:25.576 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T03:42:25.613 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T03:42:25.691 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T03:42:25.718 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T03:42:25.780 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T03:42:25.875 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T03:42:25.937 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T03:42:26.011 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T03:42:26.057 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T03:42:26.093 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T03:42:26.149 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T03:42:26.184 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T03:42:26.227 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T03:42:26.342 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T03:42:26.453 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T03:42:26.515 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T03:42:26.678 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T03:42:26.721 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T03:42:26.763 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T03:42:26.870 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T03:42:26.913 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T03:42:26.977 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T03:42:27.011 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T03:42:27.040 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T03:42:27.138 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T03:42:27.273 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T03:42:27.314 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T03:42:27.351 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T03:42:27.385 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T03:42:27.424 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T03:42:27.464 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T03:42:27.493 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T03:42:27.528 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T03:42:27.561 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T03:42:27.603 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T03:42:27.637 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T03:42:27.673 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T03:42:27.727 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T03:42:27.754 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T03:42:27.782 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T03:42:27.785 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T03:42:27.815 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T03:42:27.816 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T03:42:27.922 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T03:42:27.975 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T03:42:28.142 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T03:42:28.204 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T03:42:28.287 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T03:42:28.317 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T03:42:28.361 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T03:42:28.737 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T03:42:28.788 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T03:42:28.822 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T03:42:28.878 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T03:42:28.907 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T03:42:28.926 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T03:42:28.978 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T03:42:28.979 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T03:42:29.009 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T03:42:29.025 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T03:42:29.115 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T03:42:29.151 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T03:42:29.344 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T03:42:29.399 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T03:42:29.479 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T03:42:30.169 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T03:42:30.292 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T03:42:30.664 INFO:teuthology.orchestra.run.smithi105.stdout: Preparing : 1/1 2024-09-21T03:42:30.749 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T03:42:30.787 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T03:42:31.060 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T03:42:31.109 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T03:42:31.134 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T03:42:31.178 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T03:42:31.262 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:42:31.297 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:42:31.517 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T03:42:31.626 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:42:31.627 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T03:42:31.703 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T03:42:31.731 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T03:42:31.751 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:42:31.764 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T03:42:31.785 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:42:31.868 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:42:31.877 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:42:31.909 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T03:42:31.915 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T03:42:31.944 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T03:42:32.003 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T03:42:32.003 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T03:42:32.004 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T03:42:32.004 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:42:32.035 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T03:42:32.108 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T03:42:32.116 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T03:42:32.160 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T03:42:32.164 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T03:42:32.191 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:42:32.252 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T03:42:32.281 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T03:42:32.297 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:42:32.319 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T03:42:32.325 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T03:42:32.387 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T03:42:32.409 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T03:42:32.431 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T03:42:32.619 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T03:42:32.761 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T03:42:32.844 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T03:42:32.871 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T03:42:32.892 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T03:42:32.951 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T03:42:32.981 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T03:42:33.001 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:42:33.088 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:42:33.318 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:42:33.433 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T03:42:33.475 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T03:42:33.510 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T03:42:33.583 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T03:42:33.628 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T03:42:33.660 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T03:42:33.711 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T03:42:33.752 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T03:42:33.780 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T03:42:33.850 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T03:42:33.928 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T03:42:33.959 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T03:42:34.003 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T03:42:34.085 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T03:42:34.122 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T03:42:34.165 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T03:42:34.203 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T03:42:34.274 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T03:42:34.326 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T03:42:34.401 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T03:42:34.537 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T03:42:34.586 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T03:42:35.130 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T03:42:35.217 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T03:42:35.245 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T03:42:35.288 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T03:42:35.326 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T03:42:35.368 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T03:42:35.528 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T03:42:35.548 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:42:35.578 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:42:35.596 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T03:42:35.687 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T03:42:35.761 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T03:42:35.834 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T03:42:35.865 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T03:42:35.901 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T03:42:36.040 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T03:42:36.134 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T03:42:36.178 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T03:42:36.207 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:42:36.229 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T03:42:36.256 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T03:42:36.349 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T03:42:36.349 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T03:42:36.349 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T03:42:36.350 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:42:36.374 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T03:42:36.399 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T03:42:36.421 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T03:42:36.462 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T03:42:36.568 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T03:42:36.606 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T03:42:36.646 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T03:42:36.672 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T03:42:36.697 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T03:42:36.772 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T03:42:36.898 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T03:42:36.962 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T03:42:37.129 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T03:42:37.268 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T03:42:37.372 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T03:42:37.412 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T03:42:37.442 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T03:42:37.476 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T03:42:37.510 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T03:42:37.551 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T03:42:37.586 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T03:42:37.682 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T03:42:37.733 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T03:42:37.764 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T03:42:37.892 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T03:42:37.940 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T03:42:38.690 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T03:42:38.737 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T03:42:38.771 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T03:42:38.871 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T03:42:38.917 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T03:42:38.962 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T03:42:39.051 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T03:42:39.107 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T03:42:39.290 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T03:42:39.321 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T03:42:39.398 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T03:42:40.044 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T03:42:40.161 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T03:42:41.384 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T03:42:41.467 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T03:42:41.495 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T03:42:41.528 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T03:42:41.852 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T03:42:41.899 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T03:42:41.999 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T03:42:42.037 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T03:42:42.074 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T03:42:42.579 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T03:42:42.610 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T03:42:42.681 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T03:42:42.712 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T03:42:44.094 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T03:42:44.094 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /sys 2024-09-21T03:42:44.094 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /proc 2024-09-21T03:42:44.094 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /mnt 2024-09-21T03:42:44.094 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /var/tmp 2024-09-21T03:42:44.094 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /home 2024-09-21T03:42:44.094 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /root 2024-09-21T03:42:44.094 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /tmp 2024-09-21T03:42:44.094 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:42:44.274 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T03:42:44.289 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T03:42:44.289 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:42:44.289 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T03:42:44.289 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:42:44.987 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:42:45.025 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:42:45.597 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:42:45.637 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T03:42:45.729 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T03:42:45.729 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T03:42:45.729 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T03:42:45.729 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:42:45.763 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T03:42:45.875 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T03:42:45.902 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T03:42:45.902 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:42:45.902 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T03:42:45.902 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T03:42:45.902 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T03:42:45.902 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:42:46.135 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T03:42:46.159 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T03:42:46.159 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:42:46.159 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T03:42:46.159 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T03:42:46.159 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T03:42:46.160 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:42:46.646 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T03:42:46.670 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T03:42:46.670 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:42:46.670 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T03:42:46.670 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T03:42:46.670 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T03:42:46.670 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:42:46.776 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T03:42:46.834 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T03:42:46.888 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T03:42:47.082 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T03:42:47.131 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T03:42:47.218 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T03:42:47.306 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T03:42:47.453 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T03:42:47.489 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T03:42:47.521 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T03:42:47.549 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T03:42:48.009 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T03:42:48.039 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T03:42:48.072 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T03:42:48.138 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T03:42:48.163 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T03:42:48.737 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T03:42:48.737 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /sys 2024-09-21T03:42:48.737 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /proc 2024-09-21T03:42:48.737 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /mnt 2024-09-21T03:42:48.737 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /var/tmp 2024-09-21T03:42:48.738 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /home 2024-09-21T03:42:48.738 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /root 2024-09-21T03:42:48.738 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /tmp 2024-09-21T03:42:48.738 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:42:48.922 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T03:42:48.941 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T03:42:48.941 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:42:48.941 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T03:42:48.941 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:42:50.592 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T03:42:50.620 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T03:42:50.620 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:42:50.620 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T03:42:50.620 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T03:42:50.620 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T03:42:50.620 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:42:50.850 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T03:42:50.875 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T03:42:50.875 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:42:50.875 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T03:42:50.875 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T03:42:50.875 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T03:42:50.875 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:42:51.357 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T03:42:51.368 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T03:42:51.393 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T03:42:51.393 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:42:51.393 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T03:42:51.393 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T03:42:51.393 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T03:42:51.393 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:42:51.418 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T03:42:51.507 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T03:42:51.565 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T03:42:51.629 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T03:42:51.825 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T03:42:51.878 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T03:42:51.959 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T03:42:52.065 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T03:42:52.224 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T03:42:52.261 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T03:42:52.293 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T03:42:52.320 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T03:42:52.384 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T03:42:52.403 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T03:42:52.517 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T03:42:52.695 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T03:42:52.722 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T03:42:52.747 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T03:42:52.747 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:42:52.747 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T03:42:52.747 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T03:42:52.747 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T03:42:52.747 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:42:52.791 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T03:42:52.798 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T03:42:52.810 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T03:42:52.819 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T03:42:52.852 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T03:42:52.908 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T03:42:52.921 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T03:42:52.950 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T03:42:52.962 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T03:42:53.927 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T03:42:53.959 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T03:42:53.983 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T03:42:53.983 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:42:53.983 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T03:42:53.983 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T03:42:53.985 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T03:42:53.985 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:42:54.026 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T03:42:54.049 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T03:42:54.050 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:42:54.050 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T03:42:54.050 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:42:54.102 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T03:42:54.125 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T03:42:54.125 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:42:54.125 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T03:42:54.125 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T03:42:54.125 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T03:42:54.126 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:42:54.452 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T03:42:54.476 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T03:42:54.476 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:42:54.476 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T03:42:54.476 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T03:42:54.476 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T03:42:54.477 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:42:56.341 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T03:42:56.398 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T03:42:57.414 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T03:42:57.422 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T03:42:57.422 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /sys 2024-09-21T03:42:57.422 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /proc 2024-09-21T03:42:57.422 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /mnt 2024-09-21T03:42:57.422 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /var/tmp 2024-09-21T03:42:57.422 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /home 2024-09-21T03:42:57.422 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /root 2024-09-21T03:42:57.422 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /tmp 2024-09-21T03:42:57.422 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:42:57.440 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T03:42:57.565 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T03:42:57.592 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T03:42:57.609 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T03:42:57.609 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:42:57.609 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T03:42:57.609 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:42:57.740 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T03:42:57.767 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T03:42:57.792 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T03:42:57.792 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:42:57.792 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T03:42:57.792 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T03:42:57.792 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T03:42:57.792 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:42:57.843 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T03:42:57.854 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T03:42:57.958 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T03:42:58.016 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T03:42:58.449 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T03:42:58.490 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T03:42:58.531 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T03:42:58.562 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T03:42:58.590 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T03:42:58.771 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T03:42:58.821 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T03:42:58.842 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T03:42:58.872 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T03:42:58.918 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T03:42:59.037 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T03:42:59.078 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T03:42:59.103 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T03:42:59.103 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:42:59.103 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T03:42:59.103 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T03:42:59.104 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T03:42:59.104 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:42:59.146 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T03:42:59.170 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T03:42:59.170 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:42:59.170 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T03:42:59.170 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:42:59.187 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T03:42:59.214 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T03:42:59.215 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:42:59.215 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T03:42:59.215 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T03:42:59.215 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T03:42:59.215 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:42:59.221 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T03:42:59.245 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T03:42:59.245 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:42:59.245 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T03:42:59.246 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T03:42:59.246 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T03:42:59.246 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:42:59.438 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T03:42:59.440 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:42:59.461 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T03:42:59.461 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:42:59.461 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T03:42:59.461 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T03:42:59.462 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T03:42:59.462 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:42:59.484 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:42:59.505 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:42:59.581 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T03:42:59.606 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T03:42:59.606 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:42:59.606 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T03:42:59.606 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T03:42:59.606 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T03:42:59.606 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:42:59.930 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T03:42:59.953 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T03:42:59.954 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:42:59.954 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T03:42:59.954 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T03:42:59.954 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T03:42:59.954 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:43:00.069 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T03:43:00.126 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T03:43:00.181 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T03:43:00.335 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T03:43:00.368 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T03:43:00.423 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T03:43:00.431 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T03:43:00.455 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T03:43:00.509 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T03:43:00.545 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T03:43:00.601 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T03:43:00.605 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T03:43:00.626 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T03:43:00.653 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T03:43:00.653 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T03:43:00.728 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T03:43:00.728 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T03:43:00.746 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T03:43:00.789 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T03:43:00.813 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T03:43:00.821 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T03:43:00.837 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T03:43:00.843 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:43:00.843 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:43:00.849 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T03:43:01.031 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:43:01.031 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T03:43:01.115 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T03:43:01.179 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:43:01.276 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T03:43:01.315 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T03:43:01.347 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T03:43:01.413 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T03:43:01.437 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T03:43:03.851 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T03:43:03.894 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T03:43:03.935 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T03:43:03.966 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T03:43:03.993 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T03:43:04.203 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T03:43:04.248 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T03:43:04.278 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T03:43:04.308 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T03:43:04.354 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T03:43:04.662 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T03:43:04.728 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T03:43:05.013 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:43:05.052 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:43:05.073 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:43:05.688 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T03:43:05.711 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T03:43:05.826 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T03:43:05.969 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T03:43:06.003 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T03:43:06.030 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T03:43:06.049 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T03:43:06.054 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T03:43:06.054 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:43:06.054 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T03:43:06.054 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T03:43:06.055 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T03:43:06.055 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:43:06.092 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T03:43:06.105 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T03:43:06.117 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T03:43:06.193 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T03:43:06.216 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T03:43:06.227 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T03:43:06.252 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T03:43:06.270 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T03:43:06.278 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T03:43:06.278 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T03:43:06.371 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T03:43:06.371 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T03:43:06.455 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T03:43:06.480 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T03:43:06.485 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:43:06.485 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:43:06.690 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:43:06.690 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T03:43:06.774 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T03:43:06.843 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:43:07.232 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T03:43:07.266 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T03:43:07.291 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T03:43:07.291 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:43:07.291 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T03:43:07.291 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T03:43:07.291 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T03:43:07.291 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:43:07.334 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T03:43:07.357 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T03:43:07.357 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:43:07.357 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T03:43:07.357 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:43:07.409 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T03:43:07.433 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T03:43:07.433 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:43:07.433 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T03:43:07.433 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T03:43:07.433 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T03:43:07.433 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:43:07.752 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T03:43:07.776 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T03:43:07.776 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:43:07.776 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T03:43:07.776 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T03:43:07.776 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T03:43:07.776 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:43:07.864 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:43:07.865 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T03:43:07.865 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T03:43:07.865 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T03:43:07.865 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T03:43:07.865 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T03:43:07.865 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T03:43:07.865 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T03:43:07.865 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:43:07.865 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:43:07.865 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T03:43:07.865 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T03:43:07.865 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T03:43:07.865 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T03:43:07.866 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:43:07.866 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T03:43:07.866 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T03:43:07.866 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T03:43:07.866 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T03:43:07.866 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T03:43:07.866 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T03:43:07.866 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T03:43:07.866 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T03:43:07.866 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T03:43:07.866 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T03:43:07.866 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T03:43:07.866 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T03:43:07.867 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T03:43:07.878 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T03:43:07.878 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T03:43:07.878 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T03:43:07.878 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T03:43:07.878 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T03:43:07.878 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T03:43:07.878 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T03:43:07.878 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T03:43:07.878 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T03:43:07.878 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T03:43:07.878 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T03:43:07.878 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T03:43:07.878 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T03:43:07.879 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T03:43:07.879 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T03:43:07.879 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T03:43:07.879 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T03:43:07.879 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T03:43:07.879 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T03:43:07.879 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T03:43:07.879 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T03:43:07.879 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T03:43:07.879 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T03:43:07.879 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T03:43:07.879 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T03:43:07.879 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T03:43:07.880 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T03:43:07.880 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T03:43:07.880 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T03:43:07.880 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T03:43:07.880 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T03:43:07.880 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T03:43:07.880 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T03:43:07.880 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T03:43:07.880 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T03:43:07.880 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T03:43:07.880 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T03:43:07.880 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T03:43:07.880 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T03:43:07.880 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T03:43:07.881 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T03:43:07.881 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T03:43:07.881 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T03:43:07.881 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T03:43:07.881 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T03:43:07.881 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T03:43:07.881 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T03:43:07.881 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T03:43:07.881 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T03:43:07.881 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T03:43:07.881 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T03:43:07.881 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T03:43:07.881 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T03:43:07.882 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T03:43:07.882 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T03:43:07.882 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T03:43:07.882 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T03:43:07.882 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T03:43:07.882 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T03:43:07.882 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T03:43:07.882 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T03:43:07.882 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T03:43:07.882 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T03:43:07.882 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T03:43:07.882 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T03:43:07.882 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T03:43:07.882 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T03:43:07.883 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T03:43:07.883 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T03:43:07.883 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T03:43:07.883 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T03:43:07.883 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T03:43:07.883 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T03:43:07.883 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T03:43:07.883 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T03:43:07.883 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T03:43:07.883 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T03:43:07.883 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T03:43:07.883 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T03:43:07.883 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T03:43:07.883 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T03:43:07.884 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T03:43:07.884 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T03:43:07.884 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T03:43:07.884 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T03:43:07.884 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T03:43:07.884 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T03:43:07.884 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T03:43:07.884 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T03:43:07.884 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T03:43:07.884 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T03:43:07.884 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T03:43:07.884 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T03:43:07.884 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T03:43:07.885 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T03:43:07.885 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T03:43:07.885 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T03:43:07.885 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T03:43:07.885 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T03:43:07.885 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T03:43:07.885 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T03:43:07.885 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T03:43:07.885 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T03:43:07.885 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T03:43:07.885 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T03:43:07.885 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T03:43:07.885 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T03:43:07.885 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T03:43:07.886 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T03:43:07.886 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T03:43:07.886 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T03:43:07.886 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T03:43:07.886 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T03:43:07.886 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T03:43:07.886 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T03:43:07.886 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T03:43:07.886 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T03:43:07.886 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T03:43:07.886 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T03:43:07.886 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T03:43:07.886 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T03:43:07.887 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T03:43:07.887 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T03:43:07.887 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T03:43:07.887 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T03:43:07.887 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T03:43:07.887 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T03:43:07.887 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T03:43:07.887 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T03:43:07.887 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T03:43:07.887 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T03:43:07.887 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T03:43:07.887 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T03:43:07.887 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T03:43:07.887 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T03:43:07.887 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T03:43:07.888 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T03:43:10.729 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:43:10.729 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:43:10.729 INFO:teuthology.orchestra.run.smithi162.stdout:Upgraded: 2024-09-21T03:43:10.729 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T03:43:10.729 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T03:43:10.729 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T03:43:10.729 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T03:43:10.729 INFO:teuthology.orchestra.run.smithi162.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:10.730 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:10.730 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T03:43:10.730 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T03:43:10.730 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T03:43:10.730 INFO:teuthology.orchestra.run.smithi162.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T03:43:10.730 INFO:teuthology.orchestra.run.smithi162.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T03:43:10.730 INFO:teuthology.orchestra.run.smithi162.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T03:43:10.730 INFO:teuthology.orchestra.run.smithi162.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T03:43:10.730 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:10.730 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:10.730 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:10.730 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:10.730 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:43:10.731 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:10.731 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:10.731 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:10.731 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:43:10.731 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:43:10.731 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:43:10.731 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:43:10.731 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:43:10.731 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:10.731 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:10.731 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:43:10.731 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:10.731 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:10.731 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:10.732 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:43:10.732 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:43:10.732 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:10.732 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:10.732 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:43:10.732 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T03:43:10.732 INFO:teuthology.orchestra.run.smithi162.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T03:43:10.732 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T03:43:10.732 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T03:43:10.732 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T03:43:10.732 INFO:teuthology.orchestra.run.smithi162.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T03:43:10.732 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T03:43:10.732 INFO:teuthology.orchestra.run.smithi162.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T03:43:10.733 INFO:teuthology.orchestra.run.smithi162.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T03:43:10.733 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T03:43:10.733 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T03:43:10.733 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:10.733 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:10.733 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:10.733 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T03:43:10.733 INFO:teuthology.orchestra.run.smithi162.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T03:43:10.733 INFO:teuthology.orchestra.run.smithi162.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T03:43:10.733 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T03:43:10.733 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T03:43:10.733 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T03:43:10.733 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:10.733 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:10.734 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T03:43:10.734 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:10.734 INFO:teuthology.orchestra.run.smithi162.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T03:43:10.734 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T03:43:10.734 INFO:teuthology.orchestra.run.smithi162.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T03:43:10.734 INFO:teuthology.orchestra.run.smithi162.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T03:43:10.734 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T03:43:10.734 INFO:teuthology.orchestra.run.smithi162.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T03:43:10.734 INFO:teuthology.orchestra.run.smithi162.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T03:43:10.734 INFO:teuthology.orchestra.run.smithi162.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T03:43:10.734 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T03:43:10.734 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T03:43:10.734 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T03:43:10.734 INFO:teuthology.orchestra.run.smithi162.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T03:43:10.735 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T03:43:10.735 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T03:43:10.735 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T03:43:10.735 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T03:43:10.735 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T03:43:10.735 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T03:43:10.735 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T03:43:10.735 INFO:teuthology.orchestra.run.smithi162.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T03:43:10.735 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T03:43:10.735 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T03:43:10.735 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T03:43:10.735 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:10.735 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:10.736 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:10.736 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T03:43:10.736 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T03:43:10.736 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T03:43:10.736 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T03:43:10.736 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T03:43:10.736 INFO:teuthology.orchestra.run.smithi162.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T03:43:10.736 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T03:43:10.736 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T03:43:10.736 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T03:43:10.736 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T03:43:10.736 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T03:43:10.736 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T03:43:10.736 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T03:43:10.736 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T03:43:10.737 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T03:43:10.737 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T03:43:10.737 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T03:43:10.737 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T03:43:10.737 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T03:43:10.737 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T03:43:10.737 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T03:43:10.737 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T03:43:10.737 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T03:43:10.737 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T03:43:10.737 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T03:43:10.737 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T03:43:10.737 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T03:43:10.738 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T03:43:10.738 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T03:43:10.738 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T03:43:10.738 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T03:43:10.738 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T03:43:10.738 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T03:43:10.738 INFO:teuthology.orchestra.run.smithi162.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T03:43:10.738 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T03:43:10.738 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T03:43:10.738 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T03:43:10.738 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T03:43:10.738 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T03:43:10.738 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T03:43:10.739 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:10.739 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:10.739 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T03:43:10.739 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T03:43:10.739 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T03:43:10.739 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:10.739 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T03:43:10.739 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T03:43:10.739 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T03:43:10.739 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T03:43:10.739 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T03:43:10.739 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T03:43:10.739 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T03:43:10.739 INFO:teuthology.orchestra.run.smithi162.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T03:43:10.740 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T03:43:10.740 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T03:43:10.740 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T03:43:10.740 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T03:43:10.740 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T03:43:10.740 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T03:43:10.740 INFO:teuthology.orchestra.run.smithi162.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T03:43:10.740 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:10.740 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:10.740 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:10.740 INFO:teuthology.orchestra.run.smithi162.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T03:43:10.740 INFO:teuthology.orchestra.run.smithi162.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T03:43:10.740 INFO:teuthology.orchestra.run.smithi162.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T03:43:10.740 INFO:teuthology.orchestra.run.smithi162.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T03:43:10.740 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T03:43:10.741 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T03:43:10.741 INFO:teuthology.orchestra.run.smithi162.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T03:43:10.741 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:43:10.741 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T03:43:11.165 DEBUG:teuthology.parallel:result is None 2024-09-21T03:43:11.731 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T03:43:11.780 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T03:43:11.830 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T03:43:11.870 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T03:43:11.897 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T03:43:12.080 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T03:43:12.128 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T03:43:12.158 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T03:43:12.187 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T03:43:12.225 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T03:43:12.849 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:43:12.890 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:43:12.911 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:43:13.053 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:43:13.053 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T03:43:13.053 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T03:43:13.053 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T03:43:13.053 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T03:43:13.054 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T03:43:13.054 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T03:43:13.054 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T03:43:13.054 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:43:13.054 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:43:13.054 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T03:43:13.054 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T03:43:13.054 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T03:43:13.054 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T03:43:13.054 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:43:13.054 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T03:43:13.054 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T03:43:13.055 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T03:43:13.055 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T03:43:13.055 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T03:43:13.055 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T03:43:13.055 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T03:43:13.055 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T03:43:13.055 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T03:43:13.055 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T03:43:13.055 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T03:43:13.055 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T03:43:13.055 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T03:43:13.055 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T03:43:13.055 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T03:43:13.055 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T03:43:13.056 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T03:43:13.056 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T03:43:13.056 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T03:43:13.056 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T03:43:13.056 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T03:43:13.056 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T03:43:13.056 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T03:43:13.056 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T03:43:13.056 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T03:43:13.056 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T03:43:13.056 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T03:43:13.056 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T03:43:13.056 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T03:43:13.057 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T03:43:13.057 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T03:43:13.057 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T03:43:13.057 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T03:43:13.057 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T03:43:13.057 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T03:43:13.057 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T03:43:13.057 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T03:43:13.057 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T03:43:13.057 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T03:43:13.057 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T03:43:13.057 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T03:43:13.057 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T03:43:13.058 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T03:43:13.058 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T03:43:13.058 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T03:43:13.058 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T03:43:13.058 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T03:43:13.058 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T03:43:13.058 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T03:43:13.058 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T03:43:13.058 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T03:43:13.058 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T03:43:13.058 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T03:43:13.058 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T03:43:13.058 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T03:43:13.059 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T03:43:13.059 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T03:43:13.059 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T03:43:13.059 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T03:43:13.059 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T03:43:13.059 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T03:43:13.059 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T03:43:13.059 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T03:43:13.059 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T03:43:13.059 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T03:43:13.059 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T03:43:13.059 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T03:43:13.059 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T03:43:13.059 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T03:43:13.060 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T03:43:13.060 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T03:43:13.060 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T03:43:13.060 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T03:43:13.060 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T03:43:13.060 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T03:43:13.060 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T03:43:13.060 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T03:43:13.060 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T03:43:13.060 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T03:43:13.060 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T03:43:13.060 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T03:43:13.060 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T03:43:13.060 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T03:43:13.061 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T03:43:13.061 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T03:43:13.061 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T03:43:13.061 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T03:43:13.061 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T03:43:13.061 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T03:43:13.061 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T03:43:13.061 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T03:43:13.061 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T03:43:13.061 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T03:43:13.061 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T03:43:13.061 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T03:43:13.061 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T03:43:13.062 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T03:43:13.062 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T03:43:13.062 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T03:43:13.062 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T03:43:13.062 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T03:43:13.062 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T03:43:13.062 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T03:43:13.062 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T03:43:13.062 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T03:43:13.062 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T03:43:13.062 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T03:43:13.062 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T03:43:13.063 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T03:43:13.063 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T03:43:13.063 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T03:43:13.063 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T03:43:13.063 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T03:43:13.063 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T03:43:13.063 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T03:43:13.063 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T03:43:13.063 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T03:43:13.063 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T03:43:13.063 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T03:43:13.063 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T03:43:13.063 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T03:43:13.063 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T03:43:13.064 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T03:43:13.064 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T03:43:13.064 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T03:43:13.064 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T03:43:13.064 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T03:43:13.064 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T03:43:13.064 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T03:43:13.064 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T03:43:13.064 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T03:43:13.064 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T03:43:13.064 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T03:43:13.064 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T03:43:13.064 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T03:43:13.064 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T03:43:13.065 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T03:43:13.065 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T03:43:13.065 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T03:43:13.065 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T03:43:13.065 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T03:43:13.065 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T03:43:13.065 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T03:43:13.065 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T03:43:13.065 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T03:43:13.065 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T03:43:13.065 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T03:43:13.065 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T03:43:13.065 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T03:43:13.066 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T03:43:13.752 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T03:43:13.845 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T03:43:13.886 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T03:43:13.969 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T03:43:13.998 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T03:43:14.023 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T03:43:14.049 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T03:43:14.049 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T03:43:14.142 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T03:43:14.142 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T03:43:14.226 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T03:43:14.251 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T03:43:14.256 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:43:14.256 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:43:14.444 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:43:14.445 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T03:43:14.520 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T03:43:14.583 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:43:15.884 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:43:15.884 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:43:15.884 INFO:teuthology.orchestra.run.smithi046.stdout:Upgraded: 2024-09-21T03:43:15.884 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T03:43:15.884 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T03:43:15.884 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T03:43:15.885 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T03:43:15.885 INFO:teuthology.orchestra.run.smithi046.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:15.885 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:15.885 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T03:43:15.885 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T03:43:15.885 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-21T03:43:15.885 INFO:teuthology.orchestra.run.smithi046.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T03:43:15.885 INFO:teuthology.orchestra.run.smithi046.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T03:43:15.885 INFO:teuthology.orchestra.run.smithi046.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T03:43:15.885 INFO:teuthology.orchestra.run.smithi046.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T03:43:15.885 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:15.886 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:15.886 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:15.886 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:15.886 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:43:15.886 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:15.886 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:15.886 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:15.886 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:43:15.886 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:43:15.887 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:43:15.887 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:43:15.887 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:43:15.887 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:15.887 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:15.887 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:43:15.887 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:15.887 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:15.887 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:15.887 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:43:15.887 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:43:15.887 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:15.887 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:15.888 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:43:15.888 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T03:43:15.888 INFO:teuthology.orchestra.run.smithi046.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T03:43:15.888 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T03:43:15.888 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T03:43:15.888 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T03:43:15.888 INFO:teuthology.orchestra.run.smithi046.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T03:43:15.888 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T03:43:15.888 INFO:teuthology.orchestra.run.smithi046.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T03:43:15.888 INFO:teuthology.orchestra.run.smithi046.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T03:43:15.888 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T03:43:15.888 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T03:43:15.888 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:15.889 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:15.889 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:15.889 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T03:43:15.889 INFO:teuthology.orchestra.run.smithi046.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T03:43:15.889 INFO:teuthology.orchestra.run.smithi046.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T03:43:15.889 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T03:43:15.889 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T03:43:15.889 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T03:43:15.889 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:15.889 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:15.889 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T03:43:15.889 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:15.890 INFO:teuthology.orchestra.run.smithi046.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T03:43:15.890 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T03:43:15.890 INFO:teuthology.orchestra.run.smithi046.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T03:43:15.890 INFO:teuthology.orchestra.run.smithi046.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T03:43:15.890 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T03:43:15.890 INFO:teuthology.orchestra.run.smithi046.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T03:43:15.890 INFO:teuthology.orchestra.run.smithi046.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T03:43:15.890 INFO:teuthology.orchestra.run.smithi046.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T03:43:15.890 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T03:43:15.890 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T03:43:15.890 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T03:43:15.891 INFO:teuthology.orchestra.run.smithi046.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T03:43:15.891 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T03:43:15.891 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T03:43:15.891 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T03:43:15.891 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T03:43:15.891 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T03:43:15.891 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T03:43:15.891 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T03:43:15.891 INFO:teuthology.orchestra.run.smithi046.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T03:43:15.891 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T03:43:15.891 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T03:43:15.891 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T03:43:15.892 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:15.892 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:15.892 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:15.892 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T03:43:15.892 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T03:43:15.892 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T03:43:15.892 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T03:43:15.892 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T03:43:15.892 INFO:teuthology.orchestra.run.smithi046.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T03:43:15.892 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T03:43:15.892 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T03:43:15.892 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T03:43:15.892 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T03:43:15.892 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T03:43:15.893 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T03:43:15.893 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T03:43:15.893 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T03:43:15.893 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T03:43:15.893 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T03:43:15.893 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T03:43:15.893 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T03:43:15.893 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T03:43:15.893 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T03:43:15.893 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T03:43:15.893 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T03:43:15.893 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T03:43:15.894 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T03:43:15.894 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T03:43:15.894 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T03:43:15.894 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T03:43:15.894 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T03:43:15.894 INFO:teuthology.orchestra.run.smithi046.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T03:43:15.894 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T03:43:15.894 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T03:43:15.894 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T03:43:15.894 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T03:43:15.894 INFO:teuthology.orchestra.run.smithi046.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T03:43:15.894 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T03:43:15.894 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T03:43:15.895 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T03:43:15.895 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T03:43:15.895 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T03:43:15.895 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T03:43:15.895 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:15.895 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:15.895 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T03:43:15.895 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T03:43:15.895 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T03:43:15.895 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:15.896 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T03:43:15.896 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T03:43:15.896 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T03:43:15.896 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T03:43:15.896 INFO:teuthology.orchestra.run.smithi046.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T03:43:15.896 INFO:teuthology.orchestra.run.smithi046.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T03:43:15.896 INFO:teuthology.orchestra.run.smithi046.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T03:43:15.896 INFO:teuthology.orchestra.run.smithi046.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T03:43:15.897 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T03:43:15.897 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T03:43:15.897 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T03:43:15.897 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T03:43:15.897 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T03:43:15.898 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T03:43:15.898 INFO:teuthology.orchestra.run.smithi046.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T03:43:15.898 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:15.898 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:15.898 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:15.898 INFO:teuthology.orchestra.run.smithi046.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T03:43:15.898 INFO:teuthology.orchestra.run.smithi046.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T03:43:15.898 INFO:teuthology.orchestra.run.smithi046.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T03:43:15.898 INFO:teuthology.orchestra.run.smithi046.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T03:43:15.898 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T03:43:15.898 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T03:43:15.899 INFO:teuthology.orchestra.run.smithi046.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T03:43:15.899 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:43:15.899 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-21T03:43:16.417 DEBUG:teuthology.parallel:result is None 2024-09-21T03:43:20.740 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:43:20.740 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T03:43:20.740 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T03:43:20.741 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T03:43:20.741 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T03:43:20.741 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T03:43:20.741 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T03:43:20.741 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T03:43:20.741 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:43:20.741 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:43:20.741 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T03:43:20.741 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T03:43:20.741 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T03:43:20.741 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T03:43:20.742 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:43:20.742 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T03:43:20.742 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T03:43:20.742 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T03:43:20.742 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T03:43:20.742 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T03:43:20.742 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T03:43:20.742 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T03:43:20.742 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T03:43:20.742 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T03:43:20.742 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T03:43:20.742 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T03:43:20.742 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T03:43:20.743 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T03:43:20.754 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T03:43:20.754 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T03:43:20.754 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T03:43:20.754 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T03:43:20.754 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T03:43:20.754 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T03:43:20.754 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T03:43:20.754 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T03:43:20.755 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T03:43:20.755 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T03:43:20.755 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T03:43:20.755 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T03:43:20.755 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T03:43:20.755 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T03:43:20.755 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T03:43:20.755 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T03:43:20.755 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T03:43:20.755 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T03:43:20.755 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T03:43:20.755 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T03:43:20.756 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T03:43:20.756 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T03:43:20.756 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T03:43:20.756 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T03:43:20.756 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T03:43:20.756 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T03:43:20.756 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T03:43:20.756 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T03:43:20.756 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T03:43:20.756 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T03:43:20.756 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T03:43:20.756 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T03:43:20.756 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T03:43:20.757 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T03:43:20.757 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T03:43:20.757 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T03:43:20.757 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T03:43:20.757 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T03:43:20.757 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T03:43:20.757 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T03:43:20.757 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T03:43:20.757 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T03:43:20.757 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T03:43:20.757 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T03:43:20.757 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T03:43:20.758 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T03:43:20.758 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T03:43:20.758 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T03:43:20.758 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T03:43:20.758 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T03:43:20.758 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T03:43:20.758 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T03:43:20.758 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T03:43:20.758 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T03:43:20.758 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T03:43:20.758 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T03:43:20.758 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T03:43:20.759 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T03:43:20.759 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T03:43:20.759 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T03:43:20.759 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T03:43:20.759 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T03:43:20.759 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T03:43:20.759 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T03:43:20.759 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T03:43:20.759 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T03:43:20.759 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T03:43:20.759 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T03:43:20.760 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T03:43:20.760 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T03:43:20.760 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T03:43:20.760 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T03:43:20.760 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T03:43:20.760 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T03:43:20.760 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T03:43:20.760 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T03:43:20.760 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T03:43:20.760 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T03:43:20.760 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T03:43:20.760 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T03:43:20.760 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T03:43:20.760 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T03:43:20.761 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T03:43:20.761 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T03:43:20.761 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T03:43:20.761 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T03:43:20.761 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T03:43:20.761 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T03:43:20.761 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T03:43:20.761 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T03:43:20.761 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T03:43:20.761 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T03:43:20.761 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T03:43:20.761 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T03:43:20.761 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T03:43:20.762 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T03:43:20.762 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T03:43:20.762 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T03:43:20.762 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T03:43:20.762 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T03:43:20.762 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T03:43:20.762 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T03:43:20.762 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T03:43:20.762 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T03:43:20.762 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T03:43:20.762 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T03:43:20.762 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T03:43:20.762 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T03:43:20.763 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T03:43:20.763 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T03:43:20.763 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T03:43:20.763 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T03:43:20.763 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T03:43:20.763 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T03:43:20.763 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T03:43:20.763 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T03:43:20.763 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T03:43:20.763 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T03:43:20.763 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T03:43:20.763 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T03:43:20.764 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T03:43:20.764 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T03:43:20.764 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T03:43:20.764 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T03:43:20.764 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T03:43:20.764 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T03:43:20.764 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T03:43:20.764 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T03:43:20.764 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T03:43:20.764 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T03:43:20.764 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T03:43:20.764 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T03:43:20.764 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T03:43:20.764 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T03:43:20.765 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T03:43:20.765 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T03:43:20.765 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T03:43:23.582 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:43:23.582 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:43:23.582 INFO:teuthology.orchestra.run.smithi105.stdout:Upgraded: 2024-09-21T03:43:23.582 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T03:43:23.582 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T03:43:23.582 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T03:43:23.582 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T03:43:23.583 INFO:teuthology.orchestra.run.smithi105.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:23.583 INFO:teuthology.orchestra.run.smithi105.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:23.583 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T03:43:23.583 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T03:43:23.583 INFO:teuthology.orchestra.run.smithi105.stdout:Installed: 2024-09-21T03:43:23.583 INFO:teuthology.orchestra.run.smithi105.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T03:43:23.583 INFO:teuthology.orchestra.run.smithi105.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T03:43:23.583 INFO:teuthology.orchestra.run.smithi105.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T03:43:23.583 INFO:teuthology.orchestra.run.smithi105.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T03:43:23.583 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:23.583 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:23.583 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:23.583 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:23.583 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:43:23.584 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:23.584 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:23.584 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:23.584 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:43:23.584 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:43:23.584 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:43:23.584 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:43:23.584 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:43:23.584 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:23.584 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:23.584 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:43:23.584 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:23.584 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:23.585 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:23.585 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:43:23.585 INFO:teuthology.orchestra.run.smithi105.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:43:23.585 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:23.585 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:23.585 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:43:23.585 INFO:teuthology.orchestra.run.smithi105.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T03:43:23.585 INFO:teuthology.orchestra.run.smithi105.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T03:43:23.585 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T03:43:23.585 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T03:43:23.585 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T03:43:23.585 INFO:teuthology.orchestra.run.smithi105.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T03:43:23.586 INFO:teuthology.orchestra.run.smithi105.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T03:43:23.586 INFO:teuthology.orchestra.run.smithi105.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T03:43:23.586 INFO:teuthology.orchestra.run.smithi105.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T03:43:23.586 INFO:teuthology.orchestra.run.smithi105.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T03:43:23.586 INFO:teuthology.orchestra.run.smithi105.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T03:43:23.586 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:23.586 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:23.586 INFO:teuthology.orchestra.run.smithi105.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:23.586 INFO:teuthology.orchestra.run.smithi105.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T03:43:23.586 INFO:teuthology.orchestra.run.smithi105.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T03:43:23.586 INFO:teuthology.orchestra.run.smithi105.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T03:43:23.586 INFO:teuthology.orchestra.run.smithi105.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T03:43:23.586 INFO:teuthology.orchestra.run.smithi105.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T03:43:23.586 INFO:teuthology.orchestra.run.smithi105.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T03:43:23.587 INFO:teuthology.orchestra.run.smithi105.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:23.587 INFO:teuthology.orchestra.run.smithi105.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:23.587 INFO:teuthology.orchestra.run.smithi105.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T03:43:23.587 INFO:teuthology.orchestra.run.smithi105.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:23.587 INFO:teuthology.orchestra.run.smithi105.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T03:43:23.587 INFO:teuthology.orchestra.run.smithi105.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T03:43:23.587 INFO:teuthology.orchestra.run.smithi105.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T03:43:23.587 INFO:teuthology.orchestra.run.smithi105.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T03:43:23.587 INFO:teuthology.orchestra.run.smithi105.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T03:43:23.587 INFO:teuthology.orchestra.run.smithi105.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T03:43:23.587 INFO:teuthology.orchestra.run.smithi105.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T03:43:23.587 INFO:teuthology.orchestra.run.smithi105.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T03:43:23.587 INFO:teuthology.orchestra.run.smithi105.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T03:43:23.587 INFO:teuthology.orchestra.run.smithi105.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T03:43:23.588 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T03:43:23.588 INFO:teuthology.orchestra.run.smithi105.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T03:43:23.588 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T03:43:23.588 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T03:43:23.588 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T03:43:23.588 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T03:43:23.588 INFO:teuthology.orchestra.run.smithi105.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T03:43:23.588 INFO:teuthology.orchestra.run.smithi105.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T03:43:23.588 INFO:teuthology.orchestra.run.smithi105.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T03:43:23.588 INFO:teuthology.orchestra.run.smithi105.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T03:43:23.588 INFO:teuthology.orchestra.run.smithi105.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T03:43:23.588 INFO:teuthology.orchestra.run.smithi105.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T03:43:23.588 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T03:43:23.588 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:23.588 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:23.589 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:23.589 INFO:teuthology.orchestra.run.smithi105.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T03:43:23.589 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T03:43:23.589 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T03:43:23.589 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T03:43:23.589 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T03:43:23.589 INFO:teuthology.orchestra.run.smithi105.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T03:43:23.589 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T03:43:23.589 INFO:teuthology.orchestra.run.smithi105.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T03:43:23.589 INFO:teuthology.orchestra.run.smithi105.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T03:43:23.589 INFO:teuthology.orchestra.run.smithi105.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T03:43:23.589 INFO:teuthology.orchestra.run.smithi105.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T03:43:23.589 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T03:43:23.589 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T03:43:23.590 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T03:43:23.590 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T03:43:23.590 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T03:43:23.590 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T03:43:23.590 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T03:43:23.590 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T03:43:23.590 INFO:teuthology.orchestra.run.smithi105.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T03:43:23.590 INFO:teuthology.orchestra.run.smithi105.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T03:43:23.590 INFO:teuthology.orchestra.run.smithi105.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T03:43:23.590 INFO:teuthology.orchestra.run.smithi105.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T03:43:23.590 INFO:teuthology.orchestra.run.smithi105.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T03:43:23.590 INFO:teuthology.orchestra.run.smithi105.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T03:43:23.591 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T03:43:23.591 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T03:43:23.591 INFO:teuthology.orchestra.run.smithi105.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T03:43:23.591 INFO:teuthology.orchestra.run.smithi105.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T03:43:23.591 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T03:43:23.591 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T03:43:23.591 INFO:teuthology.orchestra.run.smithi105.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T03:43:23.591 INFO:teuthology.orchestra.run.smithi105.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T03:43:23.591 INFO:teuthology.orchestra.run.smithi105.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T03:43:23.591 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T03:43:23.591 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T03:43:23.591 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T03:43:23.591 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T03:43:23.591 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T03:43:23.592 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T03:43:23.592 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:23.592 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:23.592 INFO:teuthology.orchestra.run.smithi105.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T03:43:23.592 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T03:43:23.592 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T03:43:23.592 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:23.592 INFO:teuthology.orchestra.run.smithi105.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T03:43:23.592 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T03:43:23.592 INFO:teuthology.orchestra.run.smithi105.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T03:43:23.592 INFO:teuthology.orchestra.run.smithi105.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T03:43:23.592 INFO:teuthology.orchestra.run.smithi105.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T03:43:23.592 INFO:teuthology.orchestra.run.smithi105.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T03:43:23.592 INFO:teuthology.orchestra.run.smithi105.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T03:43:23.592 INFO:teuthology.orchestra.run.smithi105.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T03:43:23.593 INFO:teuthology.orchestra.run.smithi105.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T03:43:23.593 INFO:teuthology.orchestra.run.smithi105.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T03:43:23.593 INFO:teuthology.orchestra.run.smithi105.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T03:43:23.593 INFO:teuthology.orchestra.run.smithi105.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T03:43:23.593 INFO:teuthology.orchestra.run.smithi105.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T03:43:23.593 INFO:teuthology.orchestra.run.smithi105.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T03:43:23.593 INFO:teuthology.orchestra.run.smithi105.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T03:43:23.593 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:23.593 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:23.593 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:43:23.593 INFO:teuthology.orchestra.run.smithi105.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T03:43:23.593 INFO:teuthology.orchestra.run.smithi105.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T03:43:23.593 INFO:teuthology.orchestra.run.smithi105.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T03:43:23.593 INFO:teuthology.orchestra.run.smithi105.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T03:43:23.593 INFO:teuthology.orchestra.run.smithi105.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T03:43:23.594 INFO:teuthology.orchestra.run.smithi105.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T03:43:23.594 INFO:teuthology.orchestra.run.smithi105.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T03:43:23.594 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:43:23.594 INFO:teuthology.orchestra.run.smithi105.stdout:Complete! 2024-09-21T03:43:24.017 DEBUG:teuthology.parallel:result is None 2024-09-21T03:43:24.018 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:43:24.152 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T03:43:24.179 INFO:teuthology.orchestra.run.smithi046.stdout:19.3.0-5120.g18432218.el9 2024-09-21T03:43:24.180 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T03:43:24.180 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T03:43:24.181 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:43:24.315 DEBUG:teuthology.orchestra.run.smithi105:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T03:43:24.337 INFO:teuthology.orchestra.run.smithi105.stdout:19.3.0-5120.g18432218.el9 2024-09-21T03:43:24.337 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T03:43:24.338 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T03:43:24.339 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:43:24.479 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T03:43:24.506 INFO:teuthology.orchestra.run.smithi162.stdout:19.3.0-5120.g18432218.el9 2024-09-21T03:43:24.506 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T03:43:24.506 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T03:43:24.508 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T03:43:24.508 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T03:43:24.508 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T03:43:24.542 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:43:24.542 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T03:43:24.569 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:43:24.569 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T03:43:24.603 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T03:43:24.603 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T03:43:24.603 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T03:43:24.633 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T03:43:24.702 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:43:24.703 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T03:43:24.728 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T03:43:24.794 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:43:24.794 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T03:43:24.823 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T03:43:24.893 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T03:43:24.894 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T03:43:24.894 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T03:43:24.925 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T03:43:24.994 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:43:24.994 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T03:43:25.020 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T03:43:25.085 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:43:25.085 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T03:43:25.111 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T03:43:25.176 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T03:43:25.176 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T03:43:25.176 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T03:43:25.205 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T03:43:25.275 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:43:25.276 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T03:43:25.301 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T03:43:25.365 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:43:25.365 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T03:43:25.390 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T03:43:25.455 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T03:43:25.541 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 1, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True, 'mgr/snap_schedule/log_level': 'debug', 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'mgr-modules': ['snap_schedule'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-21T03:43:25.541 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:43:25.542 INFO:tasks.cephadm:Cluster fsid is a82de5ec-77cb-11ef-baf5-efdc52797490 2024-09-21T03:43:25.542 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T03:43:25.542 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.46', 'mon.b': '172.21.15.105', 'mon.c': '172.21.15.162'} 2024-09-21T03:43:25.542 INFO:tasks.cephadm:First mon is mon.a on smithi046 2024-09-21T03:43:25.542 INFO:tasks.cephadm:First mgr is x 2024-09-21T03:43:25.542 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T03:43:25.543 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname $(hostname -s) 2024-09-21T03:43:25.574 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname $(hostname -s) 2024-09-21T03:43:25.599 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname $(hostname -s) 2024-09-21T03:43:25.623 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-21T03:43:25.624 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:43:25.770 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.4.75+confusa13', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-21 00:04:17.484514', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['x86_64', 'source', 'arm64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.2.22+braggi22', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-20 22:54:16.499090', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-21T03:43:25.912 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-pdonnell-testing-20240920.212106-debug, sha1 1843221895adccfb3b692060251dd6a0183bc410 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:43:25.914 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T03:43:25.914 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T03:43:25.914 DEBUG:teuthology.orchestra.run.smithi046:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T03:43:26.618 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 03:43 /home/ubuntu/cephtest/cephadm 2024-09-21T03:43:26.618 DEBUG:teuthology.orchestra.run.smithi105:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T03:43:27.155 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 03:43 /home/ubuntu/cephtest/cephadm 2024-09-21T03:43:27.156 DEBUG:teuthology.orchestra.run.smithi162:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T03:43:27.695 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 03:43 /home/ubuntu/cephtest/cephadm 2024-09-21T03:43:27.695 DEBUG:teuthology.orchestra.run.smithi046:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T03:43:27.715 DEBUG:teuthology.orchestra.run.smithi105:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T03:43:27.734 DEBUG:teuthology.orchestra.run.smithi162:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T03:43:27.770 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 on all hosts... 2024-09-21T03:43:27.770 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T03:43:27.773 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T03:43:27.777 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T03:43:29.425 INFO:teuthology.orchestra.run.smithi162.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T03:43:29.442 INFO:teuthology.orchestra.run.smithi046.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T03:43:29.472 INFO:teuthology.orchestra.run.smithi105.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T03:44:03.691 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-21T03:44:03.691 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T03:44:03.691 INFO:teuthology.orchestra.run.smithi105.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T03:44:03.691 INFO:teuthology.orchestra.run.smithi105.stdout: "repo_digests": [ 2024-09-21T03:44:03.691 INFO:teuthology.orchestra.run.smithi105.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T03:44:03.691 INFO:teuthology.orchestra.run.smithi105.stdout: ] 2024-09-21T03:44:03.691 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-21T03:44:07.377 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T03:44:07.377 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T03:44:07.377 INFO:teuthology.orchestra.run.smithi046.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T03:44:07.377 INFO:teuthology.orchestra.run.smithi046.stdout: "repo_digests": [ 2024-09-21T03:44:07.377 INFO:teuthology.orchestra.run.smithi046.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T03:44:07.377 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-09-21T03:44:07.377 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T03:44:22.613 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-21T03:44:22.613 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T03:44:22.613 INFO:teuthology.orchestra.run.smithi162.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T03:44:22.613 INFO:teuthology.orchestra.run.smithi162.stdout: "repo_digests": [ 2024-09-21T03:44:22.613 INFO:teuthology.orchestra.run.smithi162.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T03:44:22.613 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-21T03:44:22.613 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-21T03:44:22.642 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /etc/ceph 2024-09-21T03:44:22.676 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /etc/ceph 2024-09-21T03:44:22.709 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /etc/ceph 2024-09-21T03:44:22.738 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 777 /etc/ceph 2024-09-21T03:44:22.767 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 777 /etc/ceph 2024-09-21T03:44:22.796 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 777 /etc/ceph 2024-09-21T03:44:22.821 INFO:tasks.cephadm:Writing seed config... 2024-09-21T03:44:22.822 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-21T03:44:22.823 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-21T03:44:22.823 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T03:44:22.823 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T03:44:22.823 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T03:44:22.823 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T03:44:22.823 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T03:44:22.823 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-21T03:44:22.823 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-21T03:44:22.823 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-21T03:44:22.823 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-21T03:44:22.823 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-21T03:44:22.823 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-21T03:44:22.823 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T03:44:22.824 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T03:44:22.824 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-21T03:44:22.824 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-21T03:44:22.824 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-21T03:44:22.824 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-21T03:44:22.824 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-21T03:44:22.824 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-21T03:44:22.824 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-21T03:44:22.824 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-21T03:44:22.825 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T03:44:22.825 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T03:44:22.843 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = a82de5ec-77cb-11ef-baf5-efdc52797490 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-21T03:44:22.844 DEBUG:teuthology.orchestra.run.smithi046:mon.a> sudo journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mon.a.service 2024-09-21T03:44:22.886 DEBUG:teuthology.orchestra.run.smithi046:mgr.x> sudo journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mgr.x.service 2024-09-21T03:44:22.929 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T03:44:22.929 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 -v bootstrap --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.46 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T03:44:23.147 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-21T03:44:23.147 INFO:teuthology.orchestra.run.smithi046.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', '-v', 'bootstrap', '--fsid', 'a82de5ec-77cb-11ef-baf5-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.46', '--skip-admin-label'] 2024-09-21T03:44:23.148 INFO:teuthology.orchestra.run.smithi046.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T03:44:23.148 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying podman|docker is present... 2024-09-21T03:44:23.179 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stdout 5.2.2 2024-09-21T03:44:23.179 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying lvm2 is present... 2024-09-21T03:44:23.179 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying time synchronization is in place... 2024-09-21T03:44:23.187 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T03:44:23.187 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T03:44:23.194 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T03:44:23.194 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-09-21T03:44:23.201 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout enabled 2024-09-21T03:44:23.207 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout active 2024-09-21T03:44:23.208 INFO:teuthology.orchestra.run.smithi046.stdout:Unit chronyd.service is enabled and running 2024-09-21T03:44:23.208 INFO:teuthology.orchestra.run.smithi046.stdout:Repeating the final host check... 2024-09-21T03:44:23.230 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stdout 5.2.2 2024-09-21T03:44:23.230 INFO:teuthology.orchestra.run.smithi046.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-21T03:44:23.230 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl is present 2024-09-21T03:44:23.230 INFO:teuthology.orchestra.run.smithi046.stdout:lvcreate is present 2024-09-21T03:44:23.237 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T03:44:23.237 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T03:44:23.243 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T03:44:23.244 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-09-21T03:44:23.250 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout enabled 2024-09-21T03:44:23.257 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout active 2024-09-21T03:44:23.257 INFO:teuthology.orchestra.run.smithi046.stdout:Unit chronyd.service is enabled and running 2024-09-21T03:44:23.257 INFO:teuthology.orchestra.run.smithi046.stdout:Host looks OK 2024-09-21T03:44:23.258 INFO:teuthology.orchestra.run.smithi046.stdout:Cluster fsid: a82de5ec-77cb-11ef-baf5-efdc52797490 2024-09-21T03:44:23.258 INFO:teuthology.orchestra.run.smithi046.stdout:Acquiring lock 140128538282352 on /run/cephadm/a82de5ec-77cb-11ef-baf5-efdc52797490.lock 2024-09-21T03:44:23.258 INFO:teuthology.orchestra.run.smithi046.stdout:Lock 140128538282352 acquired on /run/cephadm/a82de5ec-77cb-11ef-baf5-efdc52797490.lock 2024-09-21T03:44:23.258 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying IP 172.21.15.46 port 3300 ... 2024-09-21T03:44:23.258 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying IP 172.21.15.46 port 6789 ... 2024-09-21T03:44:23.258 INFO:teuthology.orchestra.run.smithi046.stdout:Base mon IP(s) is [172.21.15.46:3300, 172.21.15.46:6789], mon addrv is [v2:172.21.15.46:3300,v1:172.21.15.46:6789] 2024-09-21T03:44:23.262 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.46 metric 100 2024-09-21T03:44:23.262 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.46 metric 100 2024-09-21T03:44:23.264 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T03:44:23.264 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-21T03:44:23.264 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1799sec hoplimit 64 pref medium 2024-09-21T03:44:23.267 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T03:44:23.267 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T03:44:23.267 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T03:44:23.267 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-21T03:44:23.267 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:15f8/64 scope link 2024-09-21T03:44:23.267 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T03:44:23.268 INFO:teuthology.orchestra.run.smithi046.stdout:Mon IP `172.21.15.46` is in CIDR network `172.21.0.0/20` 2024-09-21T03:44:23.268 INFO:teuthology.orchestra.run.smithi046.stdout:Mon IP `172.21.15.46` is in CIDR network `172.21.0.0/20` 2024-09-21T03:44:23.268 INFO:teuthology.orchestra.run.smithi046.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-21T03:44:23.268 INFO:teuthology.orchestra.run.smithi046.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T03:44:23.269 INFO:teuthology.orchestra.run.smithi046.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T03:44:23.736 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stdout ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T03:44:23.736 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T03:44:23.736 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Getting image source signatures 2024-09-21T03:44:23.736 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Copying blob sha256:8425bc7408d91b180e7fdc62f23e7ae6603757f4f36e9969a4eaf9fd9416b764 2024-09-21T03:44:23.736 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-21T03:44:23.736 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Copying config sha256:ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T03:44:23.737 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-21T03:44:24.674 INFO:teuthology.orchestra.run.smithi046.stdout:ceph: stdout ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T03:44:24.675 INFO:teuthology.orchestra.run.smithi046.stdout:Ceph version: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T03:44:24.675 INFO:teuthology.orchestra.run.smithi046.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T03:44:25.555 INFO:teuthology.orchestra.run.smithi046.stdout:stat: stdout 167 167 2024-09-21T03:44:25.555 INFO:teuthology.orchestra.run.smithi046.stdout:Creating initial keys... 2024-09-21T03:44:26.419 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph-authtool: stdout AQAZQe5mQgJKNBAAySMaq5JtkPrGwyCxKZZLyw== 2024-09-21T03:44:27.325 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph-authtool: stdout AQAaQe5mA/gSLBAAgbFokZyYz/UMcoR5r1PfFg== 2024-09-21T03:44:28.214 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph-authtool: stdout AQAbQe5mHx37JxAAD7fhdiQorUYlcsEl3gywGA== 2024-09-21T03:44:28.214 INFO:teuthology.orchestra.run.smithi046.stdout:Creating initial monmap... 2024-09-21T03:44:29.086 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T03:44:29.086 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-21T03:44:29.087 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to a82de5ec-77cb-11ef-baf5-efdc52797490 2024-09-21T03:44:29.087 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T03:44:29.087 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool for a [v2:172.21.15.46:3300,v1:172.21.15.46:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T03:44:29.087 INFO:teuthology.orchestra.run.smithi046.stdout:setting min_mon_release = quincy 2024-09-21T03:44:29.087 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: set fsid to a82de5ec-77cb-11ef-baf5-efdc52797490 2024-09-21T03:44:29.087 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T03:44:29.087 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:44:29.087 INFO:teuthology.orchestra.run.smithi046.stdout:Creating mon... 2024-09-21T03:44:29.984 INFO:teuthology.orchestra.run.smithi046.stdout:create mon.a on 2024-09-21T03:44:30.203 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-21T03:44:30.366 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-21T03:44:30.555 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-a82de5ec-77cb-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-a82de5ec-77cb-11ef-baf5-efdc52797490.target. 2024-09-21T03:44:30.556 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-a82de5ec-77cb-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-a82de5ec-77cb-11ef-baf5-efdc52797490.target. 2024-09-21T03:44:30.827 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mon.a 2024-09-21T03:44:30.827 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Failed to reset failed state of unit ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mon.a.service: Unit ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mon.a.service not loaded. 2024-09-21T03:44:31.000 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-a82de5ec-77cb-11ef-baf5-efdc52797490.target.wants/ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mon.a.service → /etc/systemd/system/ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@.service. 2024-09-21T03:44:31.060 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:31 smithi046 systemd[1]: Starting Ceph mon.a for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T03:44:31.359 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:31 smithi046 podman[30572]: 2024-09-21 03:44:31.167140632 +0000 UTC m=+0.023432347 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:44:31.359 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:31 smithi046 podman[30572]: 2024-09-21 03:44:31.265220628 +0000 UTC m=+0.121512333 container create 0432d8f0e01bc7aa13d279b6535969a512970f0600bd615b24bca168d6f41bc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:44:31.533 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T03:44:31.534 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout disabled 2024-09-21T03:44:31.541 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T03:44:31.541 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-09-21T03:44:31.541 INFO:teuthology.orchestra.run.smithi046.stdout:firewalld.service is not enabled 2024-09-21T03:44:31.541 INFO:teuthology.orchestra.run.smithi046.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T03:44:31.542 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mon to start... 2024-09-21T03:44:31.542 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mon... 2024-09-21T03:44:31.711 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:31 smithi046 podman[30572]: 2024-09-21 03:44:31.459080688 +0000 UTC m=+0.315372399 container init 0432d8f0e01bc7aa13d279b6535969a512970f0600bd615b24bca168d6f41bc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mon-a, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T03:44:31.711 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:31 smithi046 podman[30572]: 2024-09-21 03:44:31.462453702 +0000 UTC m=+0.318745416 container start 0432d8f0e01bc7aa13d279b6535969a512970f0600bd615b24bca168d6f41bc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mon-a, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T03:44:31.711 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:31 smithi046 ceph-mon[30591]: mkfs a82de5ec-77cb-11ef-baf5-efdc52797490 2024-09-21T03:44:31.711 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:31 smithi046 bash[30572]: 0432d8f0e01bc7aa13d279b6535969a512970f0600bd615b24bca168d6f41bc8 2024-09-21T03:44:31.711 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:31 smithi046 ceph-mon[30591]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T03:44:31.711 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:31 smithi046 systemd[1]: Started Ceph mon.a for a82de5ec-77cb-11ef-baf5-efdc52797490. 2024-09-21T03:44:32.827 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:32 smithi046 ceph-mon[30591]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T03:44:32.827 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:32 smithi046 ceph-mon[30591]: monmap epoch 1 2024-09-21T03:44:32.827 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:32 smithi046 ceph-mon[30591]: fsid a82de5ec-77cb-11ef-baf5-efdc52797490 2024-09-21T03:44:32.827 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:32 smithi046 ceph-mon[30591]: last_changed 2024-09-21T03:44:28.574692+0000 2024-09-21T03:44:32.827 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:32 smithi046 ceph-mon[30591]: created 2024-09-21T03:44:28.574692+0000 2024-09-21T03:44:32.827 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:32 smithi046 ceph-mon[30591]: min_mon_release 19 (squid) 2024-09-21T03:44:32.827 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:32 smithi046 ceph-mon[30591]: election_strategy: 1 2024-09-21T03:44:32.827 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:32 smithi046 ceph-mon[30591]: 0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-09-21T03:44:32.827 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:32 smithi046 ceph-mon[30591]: fsmap 2024-09-21T03:44:32.827 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:32 smithi046 ceph-mon[30591]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T03:44:32.827 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:32 smithi046 ceph-mon[30591]: mgrmap e1: no daemons active 2024-09-21T03:44:34.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:33 smithi046 ceph-mon[30591]: from='client.? 172.21.15.46:0/2961038913' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-21T03:44:40.151 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T03:44:40.153 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout id: a82de5ec-77cb-11ef-baf5-efdc52797490 2024-09-21T03:44:40.153 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T03:44:40.153 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-21T03:44:40.153 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout services: 2024-09-21T03:44:40.153 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 2s) 2024-09-21T03:44:40.154 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T03:44:40.154 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T03:44:40.154 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-21T03:44:40.154 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout data: 2024-09-21T03:44:40.154 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T03:44:40.154 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T03:44:40.154 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T03:44:40.154 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T03:44:40.154 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-21T03:44:40.154 INFO:teuthology.orchestra.run.smithi046.stdout:mon is available 2024-09-21T03:44:40.154 INFO:teuthology.orchestra.run.smithi046.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T03:44:43.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:43 smithi046 ceph-mon[30591]: from='client.? 172.21.15.46:0/3061625597' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T03:44:43.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:43 smithi046 ceph-mon[30591]: from='client.? 172.21.15.46:0/3061625597' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-21T03:44:45.033 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-21T03:44:45.034 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T03:44:45.034 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout fsid = a82de5ec-77cb-11ef-baf5-efdc52797490 2024-09-21T03:44:45.034 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T03:44:45.034 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.46:3300,v1:172.21.15.46:6789] 2024-09-21T03:44:45.034 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T03:44:45.034 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T03:44:45.034 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T03:44:45.034 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T03:44:45.034 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-21T03:44:45.034 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T03:44:45.034 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T03:44:45.034 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-21T03:44:45.034 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T03:44:45.034 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T03:44:45.035 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T03:44:45.035 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T03:44:45.035 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T03:44:45.035 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T03:44:45.035 INFO:teuthology.orchestra.run.smithi046.stdout:Generating new minimal ceph.conf... 2024-09-21T03:44:45.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:45 smithi046 ceph-mon[30591]: from='client.? 172.21.15.46:0/2475885873' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:44:46.063 INFO:teuthology.orchestra.run.smithi046.stdout:Restarting the monitor... 2024-09-21T03:44:46.355 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:46 smithi046 systemd[1]: Stopping Ceph mon.a for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T03:44:46.742 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:46 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mon-a[30587]: 2024-09-21T03:44:46.352+0000 7fd61eb8d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:44:46.742 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:46 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mon-a[30587]: 2024-09-21T03:44:46.352+0000 7fd61eb8d640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T03:44:46.742 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:46 smithi046 podman[30833]: 2024-09-21 03:44:46.47625964 +0000 UTC m=+0.242056268 container died 0432d8f0e01bc7aa13d279b6535969a512970f0600bd615b24bca168d6f41bc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mon-a, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-21T03:44:47.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:46 smithi046 podman[30833]: 2024-09-21 03:44:46.769309769 +0000 UTC m=+0.535106438 container cleanup 0432d8f0e01bc7aa13d279b6535969a512970f0600bd615b24bca168d6f41bc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mon-a, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-21T03:44:47.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:46 smithi046 bash[30833]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mon-a 2024-09-21T03:44:47.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:46 smithi046 podman[30847]: 2024-09-21 03:44:46.97837924 +0000 UTC m=+0.493293086 container remove 0432d8f0e01bc7aa13d279b6535969a512970f0600bd615b24bca168d6f41bc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mon-a, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T03:44:47.420 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 systemd[1]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T03:44:47.420 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 systemd[1]: Stopped Ceph mon.a for a82de5ec-77cb-11ef-baf5-efdc52797490. 2024-09-21T03:44:47.420 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 systemd[1]: Starting Ceph mon.a for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T03:44:47.421 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 podman[30936]: 2024-09-21 03:44:47.304212877 +0000 UTC m=+0.108468492 container create 2da122372490c3567152fd5393c05a2ac84f9adc25f3c2737c803a74d4df320a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mon-a, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T03:44:47.421 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 podman[30936]: 2024-09-21 03:44:47.212084257 +0000 UTC m=+0.016339881 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:44:47.595 INFO:teuthology.orchestra.run.smithi046.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-21T03:44:47.787 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 podman[30936]: 2024-09-21 03:44:47.514987268 +0000 UTC m=+0.319242901 container init 2da122372490c3567152fd5393c05a2ac84f9adc25f3c2737c803a74d4df320a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mon-a, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T03:44:47.788 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 podman[30936]: 2024-09-21 03:44:47.518235829 +0000 UTC m=+0.322491444 container start 2da122372490c3567152fd5393c05a2ac84f9adc25f3c2737c803a74d4df320a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-21T03:44:47.788 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T03:44:47.788 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T03:44:47.788 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: pidfile_write: ignore empty --pid-file 2024-09-21T03:44:47.788 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: load: jerasure load: lrc 2024-09-21T03:44:47.788 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: RocksDB version: 7.9.2 2024-09-21T03:44:47.788 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Git sha 0 2024-09-21T03:44:47.788 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T03:44:47.788 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: DB SUMMARY 2024-09-21T03:44:47.788 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: DB Session ID: 783EPEA8QZPIAAZ7GWN7 2024-09-21T03:44:47.788 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: CURRENT file: CURRENT 2024-09-21T03:44:47.788 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T03:44:47.789 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-21T03:44:47.789 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T03:44:47.789 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 94547 ; 2024-09-21T03:44:47.789 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.error_if_exists: 0 2024-09-21T03:44:47.789 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.create_if_missing: 0 2024-09-21T03:44:47.789 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.paranoid_checks: 1 2024-09-21T03:44:47.789 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T03:44:47.789 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T03:44:47.789 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T03:44:47.789 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.env: 0x5619c1925d60 2024-09-21T03:44:47.789 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T03:44:47.789 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.info_log: 0x5619c6ca7360 2024-09-21T03:44:47.789 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T03:44:47.791 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.statistics: (nil) 2024-09-21T03:44:47.791 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.use_fsync: 0 2024-09-21T03:44:47.791 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.max_log_file_size: 0 2024-09-21T03:44:47.791 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T03:44:47.791 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T03:44:47.791 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T03:44:47.791 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T03:44:47.791 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.allow_fallocate: 1 2024-09-21T03:44:47.791 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T03:44:47.791 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T03:44:47.791 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.use_direct_reads: 0 2024-09-21T03:44:47.792 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T03:44:47.792 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T03:44:47.792 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.db_log_dir: 2024-09-21T03:44:47.792 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.wal_dir: 2024-09-21T03:44:47.792 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T03:44:47.792 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T03:44:47.792 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T03:44:47.792 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T03:44:47.792 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T03:44:47.792 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T03:44:47.792 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T03:44:47.792 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T03:44:47.792 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.write_buffer_manager: 0x5619c6cabd60 2024-09-21T03:44:47.793 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T03:44:47.793 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T03:44:47.793 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T03:44:47.793 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T03:44:47.793 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T03:44:47.793 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T03:44:47.793 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T03:44:47.793 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T03:44:47.793 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.unordered_write: 0 2024-09-21T03:44:47.793 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T03:44:47.793 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T03:44:47.793 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T03:44:47.793 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T03:44:47.794 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.row_cache: None 2024-09-21T03:44:47.794 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.wal_filter: None 2024-09-21T03:44:47.794 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T03:44:47.794 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T03:44:47.794 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.two_write_queues: 0 2024-09-21T03:44:47.794 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T03:44:47.794 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.wal_compression: 0 2024-09-21T03:44:47.794 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.atomic_flush: 0 2024-09-21T03:44:47.794 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T03:44:47.794 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T03:44:47.794 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T03:44:47.794 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.log_readahead_size: 0 2024-09-21T03:44:47.794 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T03:44:47.795 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T03:44:47.795 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T03:44:47.795 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T03:44:47.795 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T03:44:47.795 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T03:44:47.795 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T03:44:47.795 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.max_background_jobs: 2 2024-09-21T03:44:47.795 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.max_background_compactions: -1 2024-09-21T03:44:47.795 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.max_subcompactions: 1 2024-09-21T03:44:47.795 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T03:44:47.795 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T03:44:47.795 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T03:44:47.795 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T03:44:47.795 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T03:44:47.795 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T03:44:47.796 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T03:44:47.796 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T03:44:47.796 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.max_open_files: -1 2024-09-21T03:44:47.796 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T03:44:47.796 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T03:44:47.796 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T03:44:47.796 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T03:44:47.796 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.max_background_flushes: -1 2024-09-21T03:44:47.796 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Compression algorithms supported: 2024-09-21T03:44:47.796 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: kZSTD supported: 0 2024-09-21T03:44:47.796 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: kXpressCompression supported: 0 2024-09-21T03:44:47.796 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: kBZip2Compression supported: 0 2024-09-21T03:44:47.796 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T03:44:47.796 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: kLZ4Compression supported: 1 2024-09-21T03:44:47.797 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: kZlibCompression supported: 1 2024-09-21T03:44:47.797 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T03:44:47.797 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: kSnappyCompression supported: 1 2024-09-21T03:44:47.797 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T03:44:47.797 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T03:44:47.797 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-21T03:44:47.797 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T03:44:47.797 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T03:44:47.797 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.merge_operator: 2024-09-21T03:44:47.797 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.compaction_filter: None 2024-09-21T03:44:47.797 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T03:44:47.797 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T03:44:47.797 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T03:44:47.797 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T03:44:47.798 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5619c6ca6fa0) 2024-09-21T03:44:47.798 INFO:journalctl@ceph.mon.a.smithi046.stdout: cache_index_and_filter_blocks: 1 2024-09-21T03:44:47.798 INFO:journalctl@ceph.mon.a.smithi046.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T03:44:47.798 INFO:journalctl@ceph.mon.a.smithi046.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T03:44:47.798 INFO:journalctl@ceph.mon.a.smithi046.stdout: pin_top_level_index_and_filter: 1 2024-09-21T03:44:47.798 INFO:journalctl@ceph.mon.a.smithi046.stdout: index_type: 0 2024-09-21T03:44:47.798 INFO:journalctl@ceph.mon.a.smithi046.stdout: data_block_index_type: 0 2024-09-21T03:44:47.798 INFO:journalctl@ceph.mon.a.smithi046.stdout: index_shortening: 1 2024-09-21T03:44:47.798 INFO:journalctl@ceph.mon.a.smithi046.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T03:44:47.798 INFO:journalctl@ceph.mon.a.smithi046.stdout: checksum: 4 2024-09-21T03:44:47.798 INFO:journalctl@ceph.mon.a.smithi046.stdout: no_block_cache: 0 2024-09-21T03:44:47.798 INFO:journalctl@ceph.mon.a.smithi046.stdout: block_cache: 0x5619c2c6b610 2024-09-21T03:44:47.798 INFO:journalctl@ceph.mon.a.smithi046.stdout: block_cache_name: BinnedLRUCache 2024-09-21T03:44:47.799 INFO:journalctl@ceph.mon.a.smithi046.stdout: block_cache_options: 2024-09-21T03:44:47.799 INFO:journalctl@ceph.mon.a.smithi046.stdout: capacity : 536870912 2024-09-21T03:44:47.799 INFO:journalctl@ceph.mon.a.smithi046.stdout: num_shard_bits : 4 2024-09-21T03:44:47.799 INFO:journalctl@ceph.mon.a.smithi046.stdout: strict_capacity_limit : 0 2024-09-21T03:44:47.799 INFO:journalctl@ceph.mon.a.smithi046.stdout: high_pri_pool_ratio: 0.000 2024-09-21T03:44:47.799 INFO:journalctl@ceph.mon.a.smithi046.stdout: block_cache_compressed: (nil) 2024-09-21T03:44:47.799 INFO:journalctl@ceph.mon.a.smithi046.stdout: persistent_cache: (nil) 2024-09-21T03:44:47.799 INFO:journalctl@ceph.mon.a.smithi046.stdout: block_size: 4096 2024-09-21T03:44:47.799 INFO:journalctl@ceph.mon.a.smithi046.stdout: block_size_deviation: 10 2024-09-21T03:44:47.799 INFO:journalctl@ceph.mon.a.smithi046.stdout: block_restart_interval: 16 2024-09-21T03:44:47.799 INFO:journalctl@ceph.mon.a.smithi046.stdout: index_block_restart_interval: 1 2024-09-21T03:44:47.799 INFO:journalctl@ceph.mon.a.smithi046.stdout: metadata_block_size: 4096 2024-09-21T03:44:47.799 INFO:journalctl@ceph.mon.a.smithi046.stdout: partition_filters: 0 2024-09-21T03:44:47.799 INFO:journalctl@ceph.mon.a.smithi046.stdout: use_delta_encoding: 1 2024-09-21T03:44:47.799 INFO:journalctl@ceph.mon.a.smithi046.stdout: filter_policy: bloomfilter 2024-09-21T03:44:47.800 INFO:journalctl@ceph.mon.a.smithi046.stdout: whole_key_filtering: 1 2024-09-21T03:44:47.800 INFO:journalctl@ceph.mon.a.smithi046.stdout: verify_compression: 0 2024-09-21T03:44:47.800 INFO:journalctl@ceph.mon.a.smithi046.stdout: read_amp_bytes_per_bit: 0 2024-09-21T03:44:47.800 INFO:journalctl@ceph.mon.a.smithi046.stdout: format_version: 5 2024-09-21T03:44:47.800 INFO:journalctl@ceph.mon.a.smithi046.stdout: enable_index_compression: 1 2024-09-21T03:44:47.800 INFO:journalctl@ceph.mon.a.smithi046.stdout: block_align: 0 2024-09-21T03:44:47.800 INFO:journalctl@ceph.mon.a.smithi046.stdout: max_auto_readahead_size: 262144 2024-09-21T03:44:47.800 INFO:journalctl@ceph.mon.a.smithi046.stdout: prepopulate_block_cache: 0 2024-09-21T03:44:47.800 INFO:journalctl@ceph.mon.a.smithi046.stdout: initial_auto_readahead_size: 8192 2024-09-21T03:44:47.800 INFO:journalctl@ceph.mon.a.smithi046.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T03:44:47.800 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T03:44:47.800 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T03:44:47.800 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.compression: NoCompression 2024-09-21T03:44:47.800 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T03:44:47.801 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T03:44:47.801 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T03:44:47.801 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.num_levels: 7 2024-09-21T03:44:47.801 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T03:44:47.801 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T03:44:47.801 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T03:44:47.801 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T03:44:47.801 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T03:44:47.801 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T03:44:47.801 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T03:44:47.801 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T03:44:47.801 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T03:44:47.801 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T03:44:47.801 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T03:44:47.802 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T03:44:47.802 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T03:44:47.802 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T03:44:47.802 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T03:44:47.802 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T03:44:47.802 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T03:44:47.802 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T03:44:47.802 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T03:44:47.802 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T03:44:47.802 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T03:44:47.802 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T03:44:47.802 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T03:44:47.802 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T03:44:47.802 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T03:44:47.803 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T03:44:47.803 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T03:44:47.803 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T03:44:47.803 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T03:44:47.803 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T03:44:47.803 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T03:44:47.803 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T03:44:47.803 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T03:44:47.803 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T03:44:47.803 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T03:44:47.803 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T03:44:47.803 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T03:44:47.803 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T03:44:47.803 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T03:44:47.804 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T03:44:47.804 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T03:44:47.804 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T03:44:47.804 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T03:44:47.804 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T03:44:47.804 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T03:44:47.804 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T03:44:47.804 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T03:44:47.804 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T03:44:47.804 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T03:44:47.804 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T03:44:47.804 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T03:44:47.804 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T03:44:47.804 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T03:44:47.805 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T03:44:47.805 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.inplace_update_support: 0 2024-09-21T03:44:47.805 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T03:44:47.805 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T03:44:47.805 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T03:44:47.805 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T03:44:47.805 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.bloom_locality: 0 2024-09-21T03:44:47.805 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.max_successive_merges: 0 2024-09-21T03:44:47.805 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T03:44:47.805 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T03:44:47.805 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T03:44:47.805 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T03:44:47.805 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.ttl: 2592000 2024-09-21T03:44:47.805 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T03:44:47.806 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T03:44:47.806 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T03:44:47.806 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.enable_blob_files: false 2024-09-21T03:44:47.806 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.min_blob_size: 0 2024-09-21T03:44:47.806 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T03:44:47.806 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T03:44:47.806 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T03:44:47.806 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T03:44:47.806 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T03:44:47.806 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T03:44:47.806 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T03:44:47.806 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T03:44:47.806 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-21T03:44:47.806 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-21T03:44:47.807 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: f376b8c7-0e5c-491e-8371-859a5a469178 2024-09-21T03:44:47.807 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726890287554714, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-21T03:44:47.807 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-21T03:44:47.807 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726890287555956, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 90632, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 287, "table_properties": {"data_size": 88684, "index_size": 268, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11494, "raw_average_key_size": 47, "raw_value_size": 82196, "raw_average_value_size": 339, "num_data_blocks": 12, "num_entries": 242, "num_filter_entries": 242, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726890287, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "f376b8c7-0e5c-491e-8371-859a5a469178", "db_session_id": "783EPEA8QZPIAAZ7GWN7", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-21T03:44:47.807 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726890287556039, "job": 1, "event": "recovery_finished"} 2024-09-21T03:44:47.807 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-21T03:44:47.807 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T03:44:47.807 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5619c6ccaa80 2024-09-21T03:44:47.807 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: DB pointer 0x5619c7a70000 2024-09-21T03:44:47.807 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T03:44:47.807 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T03:44:47.807 INFO:journalctl@ceph.mon.a.smithi046.stdout: ** DB Stats ** 2024-09-21T03:44:47.807 INFO:journalctl@ceph.mon.a.smithi046.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T03:44:47.808 INFO:journalctl@ceph.mon.a.smithi046.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T03:44:47.808 INFO:journalctl@ceph.mon.a.smithi046.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T03:44:47.808 INFO:journalctl@ceph.mon.a.smithi046.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T03:44:47.808 INFO:journalctl@ceph.mon.a.smithi046.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T03:44:47.808 INFO:journalctl@ceph.mon.a.smithi046.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T03:44:47.808 INFO:journalctl@ceph.mon.a.smithi046.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T03:44:47.808 INFO:journalctl@ceph.mon.a.smithi046.stdout: 2024-09-21T03:44:47.808 INFO:journalctl@ceph.mon.a.smithi046.stdout: ** Compaction Stats [default] ** 2024-09-21T03:44:47.808 INFO:journalctl@ceph.mon.a.smithi046.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T03:44:47.808 INFO:journalctl@ceph.mon.a.smithi046.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T03:44:47.808 INFO:journalctl@ceph.mon.a.smithi046.stdout: L0 2/0 90.37 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 111.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T03:44:47.809 INFO:journalctl@ceph.mon.a.smithi046.stdout: Sum 2/0 90.37 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 111.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T03:44:47.809 INFO:journalctl@ceph.mon.a.smithi046.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 111.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T03:44:47.809 INFO:journalctl@ceph.mon.a.smithi046.stdout: 2024-09-21T03:44:47.809 INFO:journalctl@ceph.mon.a.smithi046.stdout: ** Compaction Stats [default] ** 2024-09-21T03:44:47.809 INFO:journalctl@ceph.mon.a.smithi046.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T03:44:47.809 INFO:journalctl@ceph.mon.a.smithi046.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T03:44:47.809 INFO:journalctl@ceph.mon.a.smithi046.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 111.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T03:44:47.809 INFO:journalctl@ceph.mon.a.smithi046.stdout: 2024-09-21T03:44:47.809 INFO:journalctl@ceph.mon.a.smithi046.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T03:44:47.809 INFO:journalctl@ceph.mon.a.smithi046.stdout: 2024-09-21T03:44:47.810 INFO:journalctl@ceph.mon.a.smithi046.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T03:44:47.810 INFO:journalctl@ceph.mon.a.smithi046.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T03:44:47.810 INFO:journalctl@ceph.mon.a.smithi046.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T03:44:47.810 INFO:journalctl@ceph.mon.a.smithi046.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T03:44:47.810 INFO:journalctl@ceph.mon.a.smithi046.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T03:44:47.810 INFO:journalctl@ceph.mon.a.smithi046.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T03:44:47.810 INFO:journalctl@ceph.mon.a.smithi046.stdout: Cumulative compaction: 0.00 GB write, 25.05 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T03:44:47.810 INFO:journalctl@ceph.mon.a.smithi046.stdout: Interval compaction: 0.00 GB write, 25.05 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T03:44:47.810 INFO:journalctl@ceph.mon.a.smithi046.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T03:44:47.810 INFO:journalctl@ceph.mon.a.smithi046.stdout: Block cache BinnedLRUCache@0x5619c2c6b610#2 capacity: 512.00 MB usage: 1.31 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-21T03:44:47.810 INFO:journalctl@ceph.mon.a.smithi046.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-21T03:44:47.810 INFO:journalctl@ceph.mon.a.smithi046.stdout: 2024-09-21T03:44:47.810 INFO:journalctl@ceph.mon.a.smithi046.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T03:44:47.811 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: starting mon.a rank 0 at public addrs [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] at bind addrs [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid a82de5ec-77cb-11ef-baf5-efdc52797490 2024-09-21T03:44:47.811 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: mon.a@-1(???) e1 preinit fsid a82de5ec-77cb-11ef-baf5-efdc52797490 2024-09-21T03:44:47.811 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: mon.a@-1(???).mds e1 new map 2024-09-21T03:44:47.811 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: mon.a@-1(???).mds e1 print_map 2024-09-21T03:44:47.811 INFO:journalctl@ceph.mon.a.smithi046.stdout: e1 2024-09-21T03:44:47.811 INFO:journalctl@ceph.mon.a.smithi046.stdout: btime 2024-09-21T03:44:31:512068+0000 2024-09-21T03:44:47.811 INFO:journalctl@ceph.mon.a.smithi046.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T03:44:47.811 INFO:journalctl@ceph.mon.a.smithi046.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T03:44:47.811 INFO:journalctl@ceph.mon.a.smithi046.stdout: legacy client fscid: -1 2024-09-21T03:44:47.811 INFO:journalctl@ceph.mon.a.smithi046.stdout: 2024-09-21T03:44:47.811 INFO:journalctl@ceph.mon.a.smithi046.stdout: No filesystems configured 2024-09-21T03:44:47.811 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T03:44:47.811 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T03:44:47.811 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T03:44:47.812 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T03:44:47.812 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T03:44:47.812 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 bash[30936]: 2da122372490c3567152fd5393c05a2ac84f9adc25f3c2737c803a74d4df320a 2024-09-21T03:44:47.812 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 systemd[1]: Started Ceph mon.a for a82de5ec-77cb-11ef-baf5-efdc52797490. 2024-09-21T03:44:47.812 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T03:44:47.812 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: monmap epoch 1 2024-09-21T03:44:47.812 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: fsid a82de5ec-77cb-11ef-baf5-efdc52797490 2024-09-21T03:44:47.812 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: last_changed 2024-09-21T03:44:28.574692+0000 2024-09-21T03:44:47.812 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: created 2024-09-21T03:44:28.574692+0000 2024-09-21T03:44:47.812 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: min_mon_release 19 (squid) 2024-09-21T03:44:47.812 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: election_strategy: 1 2024-09-21T03:44:47.812 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: 0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-09-21T03:44:47.812 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: fsmap 2024-09-21T03:44:47.812 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T03:44:47.813 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:47 smithi046 ceph-mon[30954]: mgrmap e1: no daemons active 2024-09-21T03:44:48.550 INFO:teuthology.orchestra.run.smithi046.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T03:44:48.580 INFO:teuthology.orchestra.run.smithi046.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T03:44:48.581 INFO:teuthology.orchestra.run.smithi046.stdout:Creating mgr... 2024-09-21T03:44:48.581 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T03:44:48.581 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T03:44:48.848 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mgr.x 2024-09-21T03:44:48.848 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Failed to reset failed state of unit ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mgr.x.service: Unit ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mgr.x.service not loaded. 2024-09-21T03:44:49.006 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-a82de5ec-77cb-11ef-baf5-efdc52797490.target.wants/ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mgr.x.service → /etc/systemd/system/ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@.service. 2024-09-21T03:44:49.225 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:49 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/315246298' entity='client.admin' 2024-09-21T03:44:49.502 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:44:49 smithi046 podman[31167]: 2024-09-21 03:44:49.436832736 +0000 UTC m=+0.313922846 container start b1ecd01064dea992b24db4559f088c72ff1f93f83f58e67ac2d4c1f7978564c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:44:49.524 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T03:44:49.525 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout disabled 2024-09-21T03:44:49.532 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T03:44:49.532 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-09-21T03:44:49.532 INFO:teuthology.orchestra.run.smithi046.stdout:firewalld.service is not enabled 2024-09-21T03:44:49.532 INFO:teuthology.orchestra.run.smithi046.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T03:44:49.541 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T03:44:49.541 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout disabled 2024-09-21T03:44:49.549 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T03:44:49.549 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-09-21T03:44:49.549 INFO:teuthology.orchestra.run.smithi046.stdout:firewalld.service is not enabled 2024-09-21T03:44:49.549 INFO:teuthology.orchestra.run.smithi046.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-21T03:44:49.549 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mgr to start... 2024-09-21T03:44:49.549 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mgr... 2024-09-21T03:44:49.953 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:44:49 smithi046 bash[31167]: b1ecd01064dea992b24db4559f088c72ff1f93f83f58e67ac2d4c1f7978564c0 2024-09-21T03:44:49.953 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:44:49 smithi046 systemd[1]: Started Ceph mgr.x for a82de5ec-77cb-11ef-baf5-efdc52797490. 2024-09-21T03:44:50.667 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:50 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/524659751' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T03:44:50.914 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-21T03:44:50.914 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-09-21T03:44:50.914 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsid": "a82de5ec-77cb-11ef-baf5-efdc52797490", 2024-09-21T03:44:50.914 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T03:44:50.914 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T03:44:50.914 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T03:44:50.914 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T03:44:50.914 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:44:50.914 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T03:44:50.914 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T03:44:50.915 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 0 2024-09-21T03:44:50.915 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-21T03:44:50.915 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T03:44:50.915 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T03:44:50.915 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-21T03:44:50.915 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-21T03:44:50.915 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T03:44:50.915 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:44:50.915 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T03:44:50.915 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T03:44:50.915 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:44:50.915 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T03:44:50.915 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:44:50.915 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T03:44:50.916 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T03:44:50.916 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T03:44:50.916 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T03:44:50.919 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T03:44:50.919 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T03:44:50.919 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:44:50.919 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T03:44:50.919 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T03:44:50.919 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T03:44:50.919 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T03:44:50.919 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T03:44:50.919 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T03:44:50.920 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T03:44:50.920 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T03:44:50.920 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T03:44:50.920 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:44:50.920 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T03:44:50.920 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:44:50.920 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T03:44:31:512068+0000", 2024-09-21T03:44:50.920 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T03:44:50.920 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T03:44:50.920 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:44:50.920 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T03:44:50.920 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T03:44:50.920 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T03:44:50.921 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T03:44:50.921 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T03:44:50.921 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T03:44:50.921 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T03:44:50.921 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-21T03:44:50.921 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T03:44:50.921 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:44:50.921 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T03:44:50.921 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:44:50.921 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T03:44:31.513035+0000", 2024-09-21T03:44:50.921 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T03:44:50.921 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:44:50.921 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T03:44:50.921 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-09-21T03:44:50.921 INFO:teuthology.orchestra.run.smithi046.stdout:mgr not available, waiting (1/15)... 2024-09-21T03:44:53.681 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:53 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3567310747' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T03:44:53.962 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-21T03:44:53.962 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-09-21T03:44:53.962 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsid": "a82de5ec-77cb-11ef-baf5-efdc52797490", 2024-09-21T03:44:53.962 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T03:44:53.962 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T03:44:53.962 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T03:44:53.962 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T03:44:53.963 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:44:53.963 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T03:44:53.963 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T03:44:53.963 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 0 2024-09-21T03:44:53.963 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-21T03:44:53.963 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T03:44:53.963 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T03:44:53.963 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-21T03:44:53.963 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-21T03:44:53.963 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T03:44:53.963 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:44:53.963 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T03:44:53.964 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T03:44:53.964 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:44:53.964 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T03:44:53.964 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:44:53.964 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T03:44:53.964 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T03:44:53.964 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T03:44:53.964 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T03:44:53.964 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T03:44:53.964 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T03:44:53.968 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:44:53.968 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T03:44:53.968 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T03:44:53.968 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T03:44:53.968 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T03:44:53.968 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T03:44:53.968 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T03:44:53.968 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T03:44:53.968 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T03:44:53.969 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T03:44:53.969 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:44:53.969 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T03:44:53.969 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:44:53.969 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T03:44:31:512068+0000", 2024-09-21T03:44:53.969 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T03:44:53.969 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T03:44:53.969 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:44:53.969 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T03:44:53.969 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T03:44:53.969 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T03:44:53.969 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T03:44:53.969 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T03:44:53.970 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T03:44:53.970 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T03:44:53.970 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-21T03:44:53.970 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T03:44:53.970 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:44:53.970 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T03:44:53.970 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:44:53.970 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T03:44:31.513035+0000", 2024-09-21T03:44:53.970 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T03:44:53.970 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:44:53.970 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T03:44:53.970 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-09-21T03:44:53.970 INFO:teuthology.orchestra.run.smithi046.stdout:mgr not available, waiting (2/15)... 2024-09-21T03:44:55.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:54 smithi046 ceph-mon[30954]: Activating manager daemon x 2024-09-21T03:44:55.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:54 smithi046 ceph-mon[30954]: mgrmap e2: x(active, starting, since 0.00361207s) 2024-09-21T03:44:55.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:54 smithi046 ceph-mon[30954]: from='mgr.14100 172.21.15.46:0/1275205952' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T03:44:55.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:54 smithi046 ceph-mon[30954]: from='mgr.14100 172.21.15.46:0/1275205952' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T03:44:55.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:54 smithi046 ceph-mon[30954]: from='mgr.14100 172.21.15.46:0/1275205952' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T03:44:55.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:54 smithi046 ceph-mon[30954]: from='mgr.14100 172.21.15.46:0/1275205952' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:44:55.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:54 smithi046 ceph-mon[30954]: from='mgr.14100 172.21.15.46:0/1275205952' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T03:44:55.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:54 smithi046 ceph-mon[30954]: Manager daemon x is now available 2024-09-21T03:44:55.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:54 smithi046 ceph-mon[30954]: from='mgr.14100 172.21.15.46:0/1275205952' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T03:44:55.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:54 smithi046 ceph-mon[30954]: from='mgr.14100 172.21.15.46:0/1275205952' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T03:44:55.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:54 smithi046 ceph-mon[30954]: from='mgr.14100 172.21.15.46:0/1275205952' entity='mgr.x' 2024-09-21T03:44:55.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:54 smithi046 ceph-mon[30954]: from='mgr.14100 172.21.15.46:0/1275205952' entity='mgr.x' 2024-09-21T03:44:55.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:54 smithi046 ceph-mon[30954]: from='mgr.14100 172.21.15.46:0/1275205952' entity='mgr.x' 2024-09-21T03:44:56.962 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:56 smithi046 ceph-mon[30954]: mgrmap e3: x(active, since 1.00781s) 2024-09-21T03:44:56.962 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:56 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/758021244' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T03:44:57.226 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-21T03:44:57.226 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-09-21T03:44:57.226 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsid": "a82de5ec-77cb-11ef-baf5-efdc52797490", 2024-09-21T03:44:57.226 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T03:44:57.226 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T03:44:57.227 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T03:44:57.227 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T03:44:57.227 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:44:57.227 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T03:44:57.227 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T03:44:57.227 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 0 2024-09-21T03:44:57.227 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-21T03:44:57.227 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T03:44:57.227 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T03:44:57.227 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-21T03:44:57.227 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-21T03:44:57.227 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T03:44:57.227 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:44:57.227 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T03:44:57.228 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T03:44:57.228 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:44:57.228 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T03:44:57.228 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:44:57.228 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T03:44:57.228 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T03:44:57.228 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T03:44:57.228 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T03:44:57.228 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T03:44:57.228 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T03:44:57.231 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:44:57.231 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T03:44:57.232 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T03:44:57.232 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T03:44:57.232 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T03:44:57.232 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T03:44:57.232 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T03:44:57.232 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T03:44:57.232 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T03:44:57.232 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T03:44:57.232 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:44:57.232 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T03:44:57.232 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:44:57.232 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T03:44:31:512068+0000", 2024-09-21T03:44:57.232 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T03:44:57.232 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T03:44:57.233 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:44:57.233 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T03:44:57.233 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T03:44:57.233 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T03:44:57.233 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T03:44:57.233 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T03:44:57.233 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T03:44:57.233 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T03:44:57.233 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-21T03:44:57.233 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T03:44:57.233 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:44:57.233 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T03:44:57.233 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:44:57.233 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T03:44:31.513035+0000", 2024-09-21T03:44:57.234 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T03:44:57.234 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:44:57.234 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T03:44:57.234 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-09-21T03:44:57.234 INFO:teuthology.orchestra.run.smithi046.stdout:mgr is available 2024-09-21T03:44:57.803 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:57 smithi046 ceph-mon[30954]: mgrmap e4: x(active, since 2s) 2024-09-21T03:44:58.341 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-21T03:44:58.341 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T03:44:58.341 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout fsid = a82de5ec-77cb-11ef-baf5-efdc52797490 2024-09-21T03:44:58.341 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T03:44:58.341 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.46:3300,v1:172.21.15.46:6789] 2024-09-21T03:44:58.341 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T03:44:58.341 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T03:44:58.341 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T03:44:58.341 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T03:44:58.342 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-21T03:44:58.342 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T03:44:58.342 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T03:44:58.342 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-21T03:44:58.342 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T03:44:58.342 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T03:44:58.342 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T03:44:58.342 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T03:44:58.342 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T03:44:58.343 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T03:44:58.343 INFO:teuthology.orchestra.run.smithi046.stdout:Enabling cephadm module... 2024-09-21T03:44:59.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:58 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/4225222368' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T03:45:00.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:44:59 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/2822507272' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-21T03:45:00.001 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:44:59 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: ignoring --setuser ceph since I am not root 2024-09-21T03:45:00.001 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:44:59 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: ignoring --setgroup ceph since I am not root 2024-09-21T03:45:00.984 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:00 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/2822507272' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T03:45:00.984 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:00 smithi046 ceph-mon[30954]: mgrmap e5: x(active, since 5s) 2024-09-21T03:45:01.493 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-09-21T03:45:01.493 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-21T03:45:01.493 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T03:45:01.494 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T03:45:01.494 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T03:45:01.494 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-09-21T03:45:01.494 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for the mgr to restart... 2024-09-21T03:45:01.494 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mgr epoch 5... 2024-09-21T03:45:01.876 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:01 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3964274170' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T03:45:05.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:05 smithi046 ceph-mon[30954]: Active manager daemon x restarted 2024-09-21T03:45:05.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:05 smithi046 ceph-mon[30954]: Activating manager daemon x 2024-09-21T03:45:05.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:05 smithi046 ceph-mon[30954]: osdmap e2: 0 total, 0 up, 0 in 2024-09-21T03:45:05.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:05 smithi046 ceph-mon[30954]: mgrmap e6: x(active, starting, since 0.00356571s) 2024-09-21T03:45:05.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:05 smithi046 ceph-mon[30954]: from='mgr.14118 172.21.15.46:0/1614114110' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:45:05.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:05 smithi046 ceph-mon[30954]: from='mgr.14118 172.21.15.46:0/1614114110' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T03:45:05.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:05 smithi046 ceph-mon[30954]: from='mgr.14118 172.21.15.46:0/1614114110' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T03:45:05.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:05 smithi046 ceph-mon[30954]: from='mgr.14118 172.21.15.46:0/1614114110' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T03:45:05.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:05 smithi046 ceph-mon[30954]: from='mgr.14118 172.21.15.46:0/1614114110' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T03:45:05.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:05 smithi046 ceph-mon[30954]: Manager daemon x is now available 2024-09-21T03:45:06.657 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-09-21T03:45:06.657 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-21T03:45:06.657 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T03:45:06.657 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-09-21T03:45:06.657 INFO:teuthology.orchestra.run.smithi046.stdout:mgr epoch 5 is available 2024-09-21T03:45:06.657 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying orchestrator module is enabled... 2024-09-21T03:45:07.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:07 smithi046 ceph-mon[30954]: mgrmap e7: x(active, since 1.00543s) 2024-09-21T03:45:07.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:07 smithi046 ceph-mon[30954]: from='mgr.14118 172.21.15.46:0/1614114110' entity='mgr.x' 2024-09-21T03:45:07.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:07 smithi046 ceph-mon[30954]: from='mgr.14118 172.21.15.46:0/1614114110' entity='mgr.x' 2024-09-21T03:45:07.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:07 smithi046 ceph-mon[30954]: Found migration_current of "None". Setting to last migration. 2024-09-21T03:45:07.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:07 smithi046 ceph-mon[30954]: from='mgr.14118 172.21.15.46:0/1614114110' entity='mgr.x' 2024-09-21T03:45:07.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:07 smithi046 ceph-mon[30954]: from='mgr.14118 172.21.15.46:0/1614114110' entity='mgr.x' 2024-09-21T03:45:07.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:07 smithi046 ceph-mon[30954]: from='mgr.14118 172.21.15.46:0/1614114110' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:45:07.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:07 smithi046 ceph-mon[30954]: from='mgr.14118 172.21.15.46:0/1614114110' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:45:07.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:07 smithi046 ceph-mon[30954]: from='mgr.14118 172.21.15.46:0/1614114110' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T03:45:07.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:07 smithi046 ceph-mon[30954]: from='mgr.14118 172.21.15.46:0/1614114110' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T03:45:07.896 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2024-09-21T03:45:07.896 INFO:teuthology.orchestra.run.smithi046.stdout:Setting orchestrator backend to cephadm... 2024-09-21T03:45:08.416 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:08 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3145678406' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2024-09-21T03:45:08.416 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:08 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3145678406' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2024-09-21T03:45:08.416 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:08 smithi046 ceph-mon[30954]: mgrmap e8: x(active, since 2s) 2024-09-21T03:45:08.416 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:08 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: 2024-09-21T03:45:08.185+0000 7f6657b3c640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:03:45:08] ENGINE Error in HTTPServer.serve 2024-09-21T03:45:08.417 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:08 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: Traceback (most recent call last): 2024-09-21T03:45:08.417 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:08 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T03:45:08.417 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:08 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: self._connections.run(self.expiration_interval) 2024-09-21T03:45:08.417 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:08 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T03:45:08.417 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:08 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: self._run(expiration_interval) 2024-09-21T03:45:08.417 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:08 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T03:45:08.417 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:08 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T03:45:08.417 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:08 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T03:45:08.417 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:08 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T03:45:08.417 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:08 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T03:45:08.417 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:08 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: s = self.context.wrap_socket( 2024-09-21T03:45:08.417 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:08 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T03:45:08.418 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:08 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: return self.sslsocket_class._create( 2024-09-21T03:45:08.418 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:08 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T03:45:08.418 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:08 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: self.do_handshake() 2024-09-21T03:45:08.418 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:08 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T03:45:08.418 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:08 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: self._sslobj.do_handshake() 2024-09-21T03:45:08.418 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:08 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T03:45:08.418 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:08 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: 2024-09-21T03:45:09.395 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:09 smithi046 ceph-mon[30954]: [21/Sep/2024:03:45:08] ENGINE Bus STARTING 2024-09-21T03:45:09.395 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:09 smithi046 ceph-mon[30954]: [21/Sep/2024:03:45:08] ENGINE Serving on https://172.21.15.46:7150 2024-09-21T03:45:09.395 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:09 smithi046 ceph-mon[30954]: [21/Sep/2024:03:45:08] ENGINE Error in HTTPServer.serve 2024-09-21T03:45:09.395 INFO:journalctl@ceph.mon.a.smithi046.stdout: Traceback (most recent call last): 2024-09-21T03:45:09.395 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T03:45:09.395 INFO:journalctl@ceph.mon.a.smithi046.stdout: self._connections.run(self.expiration_interval) 2024-09-21T03:45:09.395 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T03:45:09.395 INFO:journalctl@ceph.mon.a.smithi046.stdout: self._run(expiration_interval) 2024-09-21T03:45:09.396 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T03:45:09.396 INFO:journalctl@ceph.mon.a.smithi046.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T03:45:09.396 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T03:45:09.396 INFO:journalctl@ceph.mon.a.smithi046.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T03:45:09.396 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T03:45:09.396 INFO:journalctl@ceph.mon.a.smithi046.stdout: s = self.context.wrap_socket( 2024-09-21T03:45:09.396 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T03:45:09.396 INFO:journalctl@ceph.mon.a.smithi046.stdout: return self.sslsocket_class._create( 2024-09-21T03:45:09.396 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T03:45:09.396 INFO:journalctl@ceph.mon.a.smithi046.stdout: self.do_handshake() 2024-09-21T03:45:09.396 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T03:45:09.396 INFO:journalctl@ceph.mon.a.smithi046.stdout: self._sslobj.do_handshake() 2024-09-21T03:45:09.396 INFO:journalctl@ceph.mon.a.smithi046.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T03:45:09.397 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:09 smithi046 ceph-mon[30954]: [21/Sep/2024:03:45:08] ENGINE Serving on http://172.21.15.46:8765 2024-09-21T03:45:09.397 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:09 smithi046 ceph-mon[30954]: [21/Sep/2024:03:45:08] ENGINE Bus STARTED 2024-09-21T03:45:09.397 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:09 smithi046 ceph-mon[30954]: from='mgr.14118 172.21.15.46:0/1614114110' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:45:09.397 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:09 smithi046 ceph-mon[30954]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:09.397 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:09 smithi046 ceph-mon[30954]: from='mgr.14118 172.21.15.46:0/1614114110' entity='mgr.x' 2024-09-21T03:45:09.397 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:09 smithi046 ceph-mon[30954]: from='mgr.14118 172.21.15.46:0/1614114110' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:45:10.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:10 smithi046 ceph-mon[30954]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:10.426 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T03:45:10.427 INFO:teuthology.orchestra.run.smithi046.stdout:Generating ssh key... 2024-09-21T03:45:11.496 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:11 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: Generating public/private rsa key pair. 2024-09-21T03:45:11.496 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:11 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: Your identification has been saved in /tmp/tmplb5rfc5m/key 2024-09-21T03:45:11.497 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:11 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: Your public key has been saved in /tmp/tmplb5rfc5m/key.pub 2024-09-21T03:45:11.497 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:11 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: The key fingerprint is: 2024-09-21T03:45:11.497 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:11 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: SHA256:OnaaQ5/a39O8bCDhflLqDBlOEm51Q3+KjszGYihyM2g ceph-a82de5ec-77cb-11ef-baf5-efdc52797490 2024-09-21T03:45:11.497 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:11 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: The key's randomart image is: 2024-09-21T03:45:11.497 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:11 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: +---[RSA 3072]----+ 2024-09-21T03:45:11.497 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:11 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: | . | 2024-09-21T03:45:11.497 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:11 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: | . . | 2024-09-21T03:45:11.497 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:11 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: | . . o . . | 2024-09-21T03:45:11.497 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:11 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: | . o ..o o | 2024-09-21T03:45:11.497 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:11 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: | + S.... | 2024-09-21T03:45:11.497 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:11 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: | . o.O =o o | 2024-09-21T03:45:11.497 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:11 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: |oE= ..*.@o.+ + | 2024-09-21T03:45:11.497 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:11 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: |.o + o.Ooo+.o.+ | 2024-09-21T03:45:11.497 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:11 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: | +o.o+o.oo. | 2024-09-21T03:45:11.497 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:11 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: +----[SHA256]-----+ 2024-09-21T03:45:12.385 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:12 smithi046 ceph-mon[30954]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:12.386 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:12 smithi046 ceph-mon[30954]: Generating ssh key... 2024-09-21T03:45:12.386 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:12 smithi046 ceph-mon[30954]: from='mgr.14118 172.21.15.46:0/1614114110' entity='mgr.x' 2024-09-21T03:45:12.386 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:12 smithi046 ceph-mon[30954]: from='mgr.14118 172.21.15.46:0/1614114110' entity='mgr.x' 2024-09-21T03:45:12.955 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4KdsECLO0ag6LihITAHIlPAIaEigwYW2dK+vDqM0W1/8tVwOgts7p1N+CQDnSU1KhcamaKJdnBUS9nQTStY9CldLV8PoRCRhPRwu0ZYX7T6jdWy15I6b2nc9yXJfexz/yHJ2uF9M3iAWdfkkqE0GB4iPuTg0jXMOAX1+WCEH0unxi91teIcyhrmqWBTFIzF3UKNapmsQfEEEyRKIe8vVD5i/jwJgMG6Kr6OMnPe80/zRb+AyM3jNcFo96erQpkCjxK6TNwxQYYffNSEJG0QCBjGcEUdH3Q2bKS6NF5IAUxIDo99AlojQ70wnX4lUXPcHtYXlaeElnV4H2YyRyf+Zc/+05ixVLx9F2FuqT+EsIrd851b2ixPJftg2N5z6953VVsT/s4o/BZIy0cbOGIpAgapxneeKLjIn8jEOhBgCDIlzRYABMK2zxwlA/8WTUOXBnaF+xWBsyUcWjPammeS5IRBk4oYHYwpmk+EHBOdRpKXMBxCQfcEMhWEyn4eDtVz8= ceph-a82de5ec-77cb-11ef-baf5-efdc52797490 2024-09-21T03:45:12.955 INFO:teuthology.orchestra.run.smithi046.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T03:45:12.956 INFO:teuthology.orchestra.run.smithi046.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T03:45:12.962 INFO:teuthology.orchestra.run.smithi046.stdout:Adding host smithi046... 2024-09-21T03:45:13.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:13 smithi046 ceph-mon[30954]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:14.261 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:14 smithi046 ceph-mon[30954]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi046", "addr": "172.21.15.46", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:15.417 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:15 smithi046 ceph-mon[30954]: Deploying cephadm binary to smithi046 2024-09-21T03:45:18.099 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Added host 'smithi046' with addr '172.21.15.46' 2024-09-21T03:45:18.099 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying unmanaged mon service... 2024-09-21T03:45:18.437 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:18 smithi046 ceph-mon[30954]: from='mgr.14118 172.21.15.46:0/1614114110' entity='mgr.x' 2024-09-21T03:45:18.437 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:18 smithi046 ceph-mon[30954]: Added host smithi046 2024-09-21T03:45:18.437 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:18 smithi046 ceph-mon[30954]: from='mgr.14118 172.21.15.46:0/1614114110' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:45:20.078 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:19 smithi046 ceph-mon[30954]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:20.078 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:19 smithi046 ceph-mon[30954]: Saving service mon spec with placement count:5 2024-09-21T03:45:20.078 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:19 smithi046 ceph-mon[30954]: from='mgr.14118 172.21.15.46:0/1614114110' entity='mgr.x' 2024-09-21T03:45:20.078 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:19 smithi046 ceph-mon[30954]: from='mgr.14118 172.21.15.46:0/1614114110' entity='mgr.x' 2024-09-21T03:45:20.505 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T03:45:20.505 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying unmanaged mgr service... 2024-09-21T03:45:21.851 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:21 smithi046 ceph-mon[30954]: from='mgr.14118 172.21.15.46:0/1614114110' entity='mgr.x' 2024-09-21T03:45:21.851 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:21 smithi046 ceph-mon[30954]: from='mgr.14118 172.21.15.46:0/1614114110' entity='mgr.x' 2024-09-21T03:45:21.854 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T03:45:22.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:22 smithi046 ceph-mon[30954]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:22.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:22 smithi046 ceph-mon[30954]: Saving service mgr spec with placement count:2 2024-09-21T03:45:22.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:22 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/79615484' entity='client.admin' 2024-09-21T03:45:24.193 INFO:teuthology.orchestra.run.smithi046.stdout:Enabling the dashboard module... 2024-09-21T03:45:25.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:24 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/1170138952' entity='client.admin' 2024-09-21T03:45:25.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:24 smithi046 ceph-mon[30954]: from='mgr.14118 172.21.15.46:0/1614114110' entity='mgr.x' 2024-09-21T03:45:26.067 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:25 smithi046 ceph-mon[30954]: from='mgr.14118 172.21.15.46:0/1614114110' entity='mgr.x' 2024-09-21T03:45:26.067 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:25 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/1077354695' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-21T03:45:26.068 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:25 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: ignoring --setuser ceph since I am not root 2024-09-21T03:45:26.068 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:25 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: ignoring --setgroup ceph since I am not root 2024-09-21T03:45:27.004 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:26 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/1077354695' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T03:45:27.005 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:26 smithi046 ceph-mon[30954]: mgrmap e9: x(active, since 20s) 2024-09-21T03:45:27.938 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-09-21T03:45:27.939 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-21T03:45:27.939 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T03:45:27.939 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T03:45:27.939 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T03:45:27.939 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-09-21T03:45:27.939 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for the mgr to restart... 2024-09-21T03:45:27.939 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mgr epoch 9... 2024-09-21T03:45:28.060 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:27 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3143370753' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T03:45:31.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:31 smithi046 ceph-mon[30954]: Active manager daemon x restarted 2024-09-21T03:45:31.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:31 smithi046 ceph-mon[30954]: Activating manager daemon x 2024-09-21T03:45:31.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:31 smithi046 ceph-mon[30954]: osdmap e3: 0 total, 0 up, 0 in 2024-09-21T03:45:31.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:31 smithi046 ceph-mon[30954]: mgrmap e10: x(active, starting, since 0.00399606s) 2024-09-21T03:45:31.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:31 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:45:31.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:31 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T03:45:31.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:31 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T03:45:31.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:31 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T03:45:31.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:31 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T03:45:31.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:31 smithi046 ceph-mon[30954]: Manager daemon x is now available 2024-09-21T03:45:32.476 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:32 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:45:32.477 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:32 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T03:45:32.477 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:32 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T03:45:32.477 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:32 smithi046 ceph-mon[30954]: mgrmap e11: x(active, since 1.00727s) 2024-09-21T03:45:32.752 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:32 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: 2024-09-21T03:45:32.673+0000 7fd03bc6e640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:03:45:32] ENGINE Error in HTTPServer.serve 2024-09-21T03:45:32.752 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:32 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: Traceback (most recent call last): 2024-09-21T03:45:32.752 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:32 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T03:45:32.752 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:32 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: self._connections.run(self.expiration_interval) 2024-09-21T03:45:32.752 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:32 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T03:45:32.752 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:32 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: self._run(expiration_interval) 2024-09-21T03:45:32.752 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:32 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T03:45:32.753 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:32 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T03:45:32.753 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:32 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T03:45:32.753 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:32 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T03:45:32.753 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:32 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T03:45:32.753 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:32 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: s = self.context.wrap_socket( 2024-09-21T03:45:32.753 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:32 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T03:45:32.753 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:32 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: return self.sslsocket_class._create( 2024-09-21T03:45:32.753 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:32 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T03:45:32.753 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:32 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: self.do_handshake() 2024-09-21T03:45:32.753 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:32 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T03:45:32.753 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:32 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: self._sslobj.do_handshake() 2024-09-21T03:45:32.753 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:32 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T03:45:32.753 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:45:32 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: 2024-09-21T03:45:32.929 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-09-21T03:45:32.929 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-21T03:45:32.929 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T03:45:32.929 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-09-21T03:45:32.929 INFO:teuthology.orchestra.run.smithi046.stdout:mgr epoch 9 is available 2024-09-21T03:45:32.929 INFO:teuthology.orchestra.run.smithi046.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-21T03:45:33.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:33 smithi046 ceph-mon[30954]: [21/Sep/2024:03:45:32] ENGINE Bus STARTING 2024-09-21T03:45:33.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:33 smithi046 ceph-mon[30954]: [21/Sep/2024:03:45:32] ENGINE Serving on http://172.21.15.46:8765 2024-09-21T03:45:33.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:33 smithi046 ceph-mon[30954]: [21/Sep/2024:03:45:32] ENGINE Serving on https://172.21.15.46:7150 2024-09-21T03:45:33.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:33 smithi046 ceph-mon[30954]: [21/Sep/2024:03:45:32] ENGINE Bus STARTED 2024-09-21T03:45:33.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:33 smithi046 ceph-mon[30954]: [21/Sep/2024:03:45:32] ENGINE Error in HTTPServer.serve 2024-09-21T03:45:33.252 INFO:journalctl@ceph.mon.a.smithi046.stdout: Traceback (most recent call last): 2024-09-21T03:45:33.252 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T03:45:33.252 INFO:journalctl@ceph.mon.a.smithi046.stdout: self._connections.run(self.expiration_interval) 2024-09-21T03:45:33.252 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T03:45:33.252 INFO:journalctl@ceph.mon.a.smithi046.stdout: self._run(expiration_interval) 2024-09-21T03:45:33.252 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T03:45:33.252 INFO:journalctl@ceph.mon.a.smithi046.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T03:45:33.252 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T03:45:33.253 INFO:journalctl@ceph.mon.a.smithi046.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T03:45:33.253 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T03:45:33.253 INFO:journalctl@ceph.mon.a.smithi046.stdout: s = self.context.wrap_socket( 2024-09-21T03:45:33.253 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T03:45:33.253 INFO:journalctl@ceph.mon.a.smithi046.stdout: return self.sslsocket_class._create( 2024-09-21T03:45:33.253 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T03:45:33.253 INFO:journalctl@ceph.mon.a.smithi046.stdout: self.do_handshake() 2024-09-21T03:45:33.253 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T03:45:33.253 INFO:journalctl@ceph.mon.a.smithi046.stdout: self._sslobj.do_handshake() 2024-09-21T03:45:33.253 INFO:journalctl@ceph.mon.a.smithi046.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T03:45:34.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:34 smithi046 ceph-mon[30954]: mgrmap e12: x(active, since 2s) 2024-09-21T03:45:34.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:34 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:45:34.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:34 smithi046 ceph-mon[30954]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:34.803 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+zCCAuOgAwIBAgIUbNRPsqc++bvVmNc7Nm6rBGxdGB0wDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkyMTAzNDUzNFoXDTM0\nMDkyMjAzNDUzNFowFzEVMBMGA1UEAwwMMTcyLjIxLjE1LjQ2MIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEAsjqTO+951JL6Xs9u33tBHM77T7CvRnYGPgkW\nv73IBB3KMgh0jtLozhLI7LDsenD5jDfeAadUVN+odQ99fgt3OEMMg00I25o7Fux/\n6BJhk8gtfsUCEN6ZXx+064vCe5gUeDoM3VtjGwtdVUW9QborSEtPhDMxLv17OOzR\nel2MQtH4KZQjltCcaTBubbIVx1ybjlcSNQa9lW8yrHrDE6iqR831McUZ/RRy9sEc\n1sr6pUBV/qHT3JexIqetHRxZEMoTdCuFqngmuVl9ogH9v2YeTC2zMY+o3pmHRqvv\nwCNleMW5huqlEu1ujt++EI9sk6bHadFbxnkESq/7qKU0Nd03BgSmqYNAlFbOMik0\nFFarosrgrysKhwgZF1vl1V3+LrVco+is6tgyM9ZS52g0VNPf4JJOTDNU7QGS2II5\n6r+uUmMI7CkNfFHmmwTPVpzln2KrRUI+cVaycK4+J91ugDe2Fhmh5DR1YWD9cnWU\nR8650l+sum7ECfuW7eFKdKhSGbR8iwAVtvms41m1tvBCH5xK96wjJf6N5OtdS593\nGcjEKF8XqqWZEHvNaSOipOucsXwGbQNP+tuomXuyiUlYlxgDE4BoX9XgFH+WZcMz\ngZFpKO85MXuTIkWwNmJWE4ryfYW8fE6ga6Kzo9vBNcfhLR50bAYVuagBqJvB5L3+\nRg/ZNMsCAwEAAaM/MD0wLQYDVR0RBCYwJIIJc21pdGhpMDQ2ghFkYXNoYm9hcmRf\nc2VydmVyc4cErBUPLjAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQAm\n3fSjx5vYgqc5LFKgfi1znLRuoNn4KMrV9mvFcszX/5H5XQ+82Pdd1Gz74k2chUW/\nQ6uaaiiZpBv8ZAcAnqUzw9nc2G+3SGuDHao0sVUyGbBhTCfY5aYuktiunfjxzhj5\nvygShBTPkmcik1eX0VX1BYDQ76AHNsp3Ydew6R+NYY2cwr0KliDaSFT//ZThLHah\nxqYJeg9ooWa50k2avjC2Fu54CtaDvwlHP+UHI2C3UDJooQlNN637ghfcV5BK3iZq\ntKqdNMrvKn1bssGkooIqUZX9dQUK1EfhJ7SsMlD39yyJcaMW8MGmAh8TJKt9NikF\n+zqaHqy2UwZ9RmWl/d1+pkSmakp7CUMiJPfmgr8iF6G59Qs0rNPsWzqij15zEG4A\n3pBKug1ooyhYBMegb3gVo9S547KP+HJmMBAJXas4wHtkoxA6zMxoekjDuFD59bGb\nZe1zrJ2qUufXmsTljTnJMlbovDmWMRijuUh/yzdRuEnW0FkIr3Hg09uwHyokq5Hv\n8O6fWt/mnUJ4OXF2aopQwX7tGKjHW4n7luzT7+JApq8o1lfzvJpKsGHTLAbYWb/c\nudTEMadC4JoMjKmjJ9PWwg3W+eVzetgpopG2iU5icxwtirxFkogjur+NHBCaQicE\nRLwAu2lL46RySQuGJwJgITFKxtGStl+xgp2+fLfSmA==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJJwIBAAKCAgEAsjqTO+951JL6Xs9u33tBHM77T7CvRnYGPgkWv73IBB3KMgh0\njtLozhLI7LDsenD5jDfeAadUVN+odQ99fgt3OEMMg00I25o7Fux/6BJhk8gtfsUC\nEN6ZXx+064vCe5gUeDoM3VtjGwtdVUW9QborSEtPhDMxLv17OOzRel2MQtH4KZQj\nltCcaTBubbIVx1ybjlcSNQa9lW8yrHrDE6iqR831McUZ/RRy9sEc1sr6pUBV/qHT\n3JexIqetHRxZEMoTdCuFqngmuVl9ogH9v2YeTC2zMY+o3pmHRqvvwCNleMW5huql\nEu1ujt++EI9sk6bHadFbxnkESq/7qKU0Nd03BgSmqYNAlFbOMik0FFarosrgrysK\nhwgZF1vl1V3+LrVco+is6tgyM9ZS52g0VNPf4JJOTDNU7QGS2II56r+uUmMI7CkN\nfFHmmwTPVpzln2KrRUI+cVaycK4+J91ugDe2Fhmh5DR1YWD9cnWUR8650l+sum7E\nCfuW7eFKdKhSGbR8iwAVtvms41m1tvBCH5xK96wjJf6N5OtdS593GcjEKF8XqqWZ\nEHvNaSOipOucsXwGbQNP+tuomXuyiUlYlxgDE4BoX9XgFH+WZcMzgZFpKO85MXuT\nIkWwNmJWE4ryfYW8fE6ga6Kzo9vBNcfhLR50bAYVuagBqJvB5L3+Rg/ZNMsCAwEA\nAQKCAgBT9Jq5n3+0vn2ZHr6cIGvWHbwtWE3gc6VSIKbqMIRhSAUgl3IMe1Z2CExE\njrz+mmw6/HAkOEXV6ztn1SGot87znkXtLeMPyzGthT9lOw9i9WdU8YmdF7aIpB9t\n23qEDOoLjlDUDwH60don2n+h0AgmeG9fF1xCRd5/PLMaoKl7KnxrXaB8IQ2k0U8b\ndkmjDUErhmGJwACbPXPR4sw03P1FcMPhK3coC7NyABrNJXV3VXyMw39QyNYEvJak\nAWAFNCOA1CWVXR7krb6sC6MTv49jFB32qTUDkq+x/zkjOalJgF56KtsStOyg+c2G\n8IDVdrk15AyGzCfU5Nw3n4aeHvQVJN+GVJeNY1F3Ue2BBDilRmjWYK+5YRuImOpe\n2w1vx7SUI6cb0b49ocPXxxIfhFGGoulV+D99IBbfrebH2Yo7+Ex2W4xdqPhwjYR+\n6kBv0EgJrgy2rvnWP+2i02vLb8dyMErnE5cPEp/mNbBT0RduD4CtXo+cKD75Lope\nM0BBX45PVlK1Tfu6p56hKmszr7VMUyHdR6KAruggir6ysnjZ4F4k7Y03gnOFv/xO\nsTGysSLdS2pRtX6gBGEQTFqLrsyvG6U9E1vic9h3yt4+BwV8PovHkEfeKzSU/41/\ntvlQW7rXz++zVuFnyyi6jPYyb+fkUmPGAbl4dgeRof/y/dQRwQKCAQEA2iksIuIu\n0kMgrTzSq+CMpRz4zdxa3iNBNNXqk2phVJQPtKsFUj+l4IQ5STDqaW7WxRylZ3b2\nBn2AP+xvPNMIvW9BLyFqX5EZU1vCZqhu/3rdPUbygWCnAopl1oQSwHs+4Dj50vMh\nLufTq4/FGVbUNVquUu4LAPY2fS8AcGLyov5SLmG7u20MYZ4DG4aGr3rqKPDBMn5w\nl/LlWhwH//89GDxpcNV7fEeiGn/AnnG0A2JuV8pfWxa65C6e2e34o9QtKEjhReh9\nO2ATJW57pPsxlVKpz5xsIJzfvcQ7BqaHB8g5eXZM6mKEa8H0s92mE1XCZ4+YRBJV\nZh4o2tqzR7hbCwKCAQEA0SRU+Hcobr1OkCWeuAj02Dmh8ZOr4ZwIKRo1wF7/Va1N\nXxJ3EKaDj7k2/zEipB13rDcUdpE2BO4/chvhEOSWawGnXFSvjuYH+zQ6vAJ8fl94\nar6xx8taYT298lhoQNpogXuYaQMnxdwuD52hYgiAFm/5zAvXVYUnJNszwZjqFDpg\n1U01QWZ02q9sNXPneuU9XEVEn1luyHkm9H+SwVBcnsKhy3g1GD33qqfq6RZgRdt0\niEHi3lVyUUT2VeblvbaeZXRS/jtmU6QUjYqBF9UCjuKFCMPUW5NUnk4HKobWH0LZ\nIGwlcLnqw21XxvM5tRIQgVzgXHBN2CVwUmTOT5SlQQKCAQAZ+Yr6wElo2Xs7hSFk\nO4Eja5aoFBNxnWr3Gn0qfiEGi/ZuwWoJx/A9EiEr+LoAQaUqpOWAsyZJ0YmCkukP\nqeTBgUyWivj6VfFY/nTf+i/1FTDgSeE3zEU2RToo12LQLhxnYAFGv5H03r9SDvUd\ntjvf+mMFFriSrb4BG6aGuxE+nN82DIboouw1dzXRgivpGs5kf33RQEKxpMbv+qRt\nM3uXtiGrwI9KVdEULJ/Hfaw8Nu0CYOMHmmY4IuDg+7d98hZKVJsV0r+OYTsGWug3\n1Xyq1cPIJ0yseWEeXA3XFd6/63QEZTR1N7OijN5QyBQs+yoBYJR1jmVCmlas8Bsm\nb+nPAoIBAHFSpXQIZPE0RHiY2drQh5MOD3Dt2kmiGU3kNNHq56HOCMmGINv1zf23\nl1RJlIKmsOyw37arUkDzs48qChb0NYj/2WaPQJ1GiXaVQ2oSUtDK/F2ivIQM7QkZ\nwm2pd7wEXHIkvV3RZuCwQIkXmZWcE4OU4x6sH97oCmDPIck6CUQyqbuKXVv1n0XL\nne+MwRX3VvtDUT6i4ANimjgLVELJP5aK0c6FcQeUtDlVSVVJWZsgoZEfWkWsuQfO\nPUgol73nUQaaNEord3PEyZo0PWTjd8JifUFVkyCXwVcR4pIpg6Zmu231C4h8RPfl\nrJVRv6gchLMD11JfS97d0nHiy2OVoMECggEAZkbGeoOhrj/2FdadEsVqCpHgsien\nQSKZwlvMWWSCxuSZzaoxqXFkmvwKw4gTrd73kaITcH1PvazkQtMzBJ6bTbFjRbo5\nAZtz+P8lcEtxRA2j12eMU0M7+1Y2OPP+Ws2tAMDOJ+x5Mo4MQUj8JEoXQy/CVCYg\nyOtHY4DV/GCkCsQnwDZqKTd3aUuAemzsyLVVyNVuh+7ZdVYGf1JnHPWGoB7wUD07\nITmtlrARhS9X3jyYQvTo/bhFfSWlFsHvVlO6NML/y/rYScZFhfRU5ghIUhO6qOxi\nH+fZZFW1KPrEhVKKLaiYoZ9rsoJFo/Xm8+9oHzcurRJZdpYi2yf1deob1g==\n-----END RSA PRIVATE KEY-----\n"} 2024-09-21T03:45:35.419 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:35 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:45:36.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:36 smithi046 ceph-mon[30954]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:36.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:36 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:45:36.849 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-21T03:45:38.106 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-21T03:45:38.106 INFO:teuthology.orchestra.run.smithi046.stdout:Creating initial admin user... 2024-09-21T03:45:38.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:38 smithi046 ceph-mon[30954]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:38.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:38 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:45:39.504 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$O3dpFpQ52xsRBl6vMffEOOmynWNUDMRbj6ARnu9Q8dON3Aq1bBtJS", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726890338, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T03:45:39.504 INFO:teuthology.orchestra.run.smithi046.stdout:Fetching dashboard port number... 2024-09-21T03:45:39.639 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:39 smithi046 ceph-mon[30954]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:39.639 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:39 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:45:40.626 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T03:45:40.638 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T03:45:40.638 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout disabled 2024-09-21T03:45:40.645 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T03:45:40.645 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-09-21T03:45:40.646 INFO:teuthology.orchestra.run.smithi046.stdout:firewalld.service is not enabled 2024-09-21T03:45:40.646 INFO:teuthology.orchestra.run.smithi046.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T03:45:40.648 INFO:teuthology.orchestra.run.smithi046.stdout:Ceph Dashboard is now available at: 2024-09-21T03:45:40.649 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:45:40.649 INFO:teuthology.orchestra.run.smithi046.stdout: URL: https://smithi046.front.sepia.ceph.com:8443/ 2024-09-21T03:45:40.649 INFO:teuthology.orchestra.run.smithi046.stdout: User: admin 2024-09-21T03:45:40.649 INFO:teuthology.orchestra.run.smithi046.stdout: Password: e3sh04secx 2024-09-21T03:45:40.649 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:45:40.649 INFO:teuthology.orchestra.run.smithi046.stdout:Saving cluster configuration to /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config directory 2024-09-21T03:45:40.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:40 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3828938919' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-21T03:45:41.966 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T03:45:41.966 INFO:teuthology.orchestra.run.smithi046.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T03:45:41.967 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:45:41.967 INFO:teuthology.orchestra.run.smithi046.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T03:45:41.967 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:45:41.967 INFO:teuthology.orchestra.run.smithi046.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T03:45:41.967 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:45:41.967 INFO:teuthology.orchestra.run.smithi046.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-21T03:45:41.967 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:45:41.967 INFO:teuthology.orchestra.run.smithi046.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T03:45:41.967 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:45:41.967 INFO:teuthology.orchestra.run.smithi046.stdout: ceph telemetry on 2024-09-21T03:45:41.967 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:45:41.968 INFO:teuthology.orchestra.run.smithi046.stdout:For more information see: 2024-09-21T03:45:41.968 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:45:41.968 INFO:teuthology.orchestra.run.smithi046.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-21T03:45:41.968 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:45:41.968 INFO:teuthology.orchestra.run.smithi046.stdout:Bootstrap complete. 2024-09-21T03:45:42.011 INFO:tasks.cephadm:Fetching config... 2024-09-21T03:45:42.011 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T03:45:42.011 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T03:45:42.027 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T03:45:42.028 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T03:45:42.028 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T03:45:42.083 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T03:45:42.084 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T03:45:42.084 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/keyring of=/dev/stdout 2024-09-21T03:45:42.149 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T03:45:42.150 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T03:45:42.150 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T03:45:42.205 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T03:45:42.205 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4KdsECLO0ag6LihITAHIlPAIaEigwYW2dK+vDqM0W1/8tVwOgts7p1N+CQDnSU1KhcamaKJdnBUS9nQTStY9CldLV8PoRCRhPRwu0ZYX7T6jdWy15I6b2nc9yXJfexz/yHJ2uF9M3iAWdfkkqE0GB4iPuTg0jXMOAX1+WCEH0unxi91teIcyhrmqWBTFIzF3UKNapmsQfEEEyRKIe8vVD5i/jwJgMG6Kr6OMnPe80/zRb+AyM3jNcFo96erQpkCjxK6TNwxQYYffNSEJG0QCBjGcEUdH3Q2bKS6NF5IAUxIDo99AlojQ70wnX4lUXPcHtYXlaeElnV4H2YyRyf+Zc/+05ixVLx9F2FuqT+EsIrd851b2ixPJftg2N5z6953VVsT/s4o/BZIy0cbOGIpAgapxneeKLjIn8jEOhBgCDIlzRYABMK2zxwlA/8WTUOXBnaF+xWBsyUcWjPammeS5IRBk4oYHYwpmk+EHBOdRpKXMBxCQfcEMhWEyn4eDtVz8= ceph-a82de5ec-77cb-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T03:45:42.291 INFO:teuthology.orchestra.run.smithi046.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4KdsECLO0ag6LihITAHIlPAIaEigwYW2dK+vDqM0W1/8tVwOgts7p1N+CQDnSU1KhcamaKJdnBUS9nQTStY9CldLV8PoRCRhPRwu0ZYX7T6jdWy15I6b2nc9yXJfexz/yHJ2uF9M3iAWdfkkqE0GB4iPuTg0jXMOAX1+WCEH0unxi91teIcyhrmqWBTFIzF3UKNapmsQfEEEyRKIe8vVD5i/jwJgMG6Kr6OMnPe80/zRb+AyM3jNcFo96erQpkCjxK6TNwxQYYffNSEJG0QCBjGcEUdH3Q2bKS6NF5IAUxIDo99AlojQ70wnX4lUXPcHtYXlaeElnV4H2YyRyf+Zc/+05ixVLx9F2FuqT+EsIrd851b2ixPJftg2N5z6953VVsT/s4o/BZIy0cbOGIpAgapxneeKLjIn8jEOhBgCDIlzRYABMK2zxwlA/8WTUOXBnaF+xWBsyUcWjPammeS5IRBk4oYHYwpmk+EHBOdRpKXMBxCQfcEMhWEyn4eDtVz8= ceph-a82de5ec-77cb-11ef-baf5-efdc52797490 2024-09-21T03:45:42.303 DEBUG:teuthology.orchestra.run.smithi105:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4KdsECLO0ag6LihITAHIlPAIaEigwYW2dK+vDqM0W1/8tVwOgts7p1N+CQDnSU1KhcamaKJdnBUS9nQTStY9CldLV8PoRCRhPRwu0ZYX7T6jdWy15I6b2nc9yXJfexz/yHJ2uF9M3iAWdfkkqE0GB4iPuTg0jXMOAX1+WCEH0unxi91teIcyhrmqWBTFIzF3UKNapmsQfEEEyRKIe8vVD5i/jwJgMG6Kr6OMnPe80/zRb+AyM3jNcFo96erQpkCjxK6TNwxQYYffNSEJG0QCBjGcEUdH3Q2bKS6NF5IAUxIDo99AlojQ70wnX4lUXPcHtYXlaeElnV4H2YyRyf+Zc/+05ixVLx9F2FuqT+EsIrd851b2ixPJftg2N5z6953VVsT/s4o/BZIy0cbOGIpAgapxneeKLjIn8jEOhBgCDIlzRYABMK2zxwlA/8WTUOXBnaF+xWBsyUcWjPammeS5IRBk4oYHYwpmk+EHBOdRpKXMBxCQfcEMhWEyn4eDtVz8= ceph-a82de5ec-77cb-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T03:45:42.343 INFO:teuthology.orchestra.run.smithi105.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4KdsECLO0ag6LihITAHIlPAIaEigwYW2dK+vDqM0W1/8tVwOgts7p1N+CQDnSU1KhcamaKJdnBUS9nQTStY9CldLV8PoRCRhPRwu0ZYX7T6jdWy15I6b2nc9yXJfexz/yHJ2uF9M3iAWdfkkqE0GB4iPuTg0jXMOAX1+WCEH0unxi91teIcyhrmqWBTFIzF3UKNapmsQfEEEyRKIe8vVD5i/jwJgMG6Kr6OMnPe80/zRb+AyM3jNcFo96erQpkCjxK6TNwxQYYffNSEJG0QCBjGcEUdH3Q2bKS6NF5IAUxIDo99AlojQ70wnX4lUXPcHtYXlaeElnV4H2YyRyf+Zc/+05ixVLx9F2FuqT+EsIrd851b2ixPJftg2N5z6953VVsT/s4o/BZIy0cbOGIpAgapxneeKLjIn8jEOhBgCDIlzRYABMK2zxwlA/8WTUOXBnaF+xWBsyUcWjPammeS5IRBk4oYHYwpmk+EHBOdRpKXMBxCQfcEMhWEyn4eDtVz8= ceph-a82de5ec-77cb-11ef-baf5-efdc52797490 2024-09-21T03:45:42.356 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4KdsECLO0ag6LihITAHIlPAIaEigwYW2dK+vDqM0W1/8tVwOgts7p1N+CQDnSU1KhcamaKJdnBUS9nQTStY9CldLV8PoRCRhPRwu0ZYX7T6jdWy15I6b2nc9yXJfexz/yHJ2uF9M3iAWdfkkqE0GB4iPuTg0jXMOAX1+WCEH0unxi91teIcyhrmqWBTFIzF3UKNapmsQfEEEyRKIe8vVD5i/jwJgMG6Kr6OMnPe80/zRb+AyM3jNcFo96erQpkCjxK6TNwxQYYffNSEJG0QCBjGcEUdH3Q2bKS6NF5IAUxIDo99AlojQ70wnX4lUXPcHtYXlaeElnV4H2YyRyf+Zc/+05ixVLx9F2FuqT+EsIrd851b2ixPJftg2N5z6953VVsT/s4o/BZIy0cbOGIpAgapxneeKLjIn8jEOhBgCDIlzRYABMK2zxwlA/8WTUOXBnaF+xWBsyUcWjPammeS5IRBk4oYHYwpmk+EHBOdRpKXMBxCQfcEMhWEyn4eDtVz8= ceph-a82de5ec-77cb-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T03:45:42.398 INFO:teuthology.orchestra.run.smithi162.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4KdsECLO0ag6LihITAHIlPAIaEigwYW2dK+vDqM0W1/8tVwOgts7p1N+CQDnSU1KhcamaKJdnBUS9nQTStY9CldLV8PoRCRhPRwu0ZYX7T6jdWy15I6b2nc9yXJfexz/yHJ2uF9M3iAWdfkkqE0GB4iPuTg0jXMOAX1+WCEH0unxi91teIcyhrmqWBTFIzF3UKNapmsQfEEEyRKIe8vVD5i/jwJgMG6Kr6OMnPe80/zRb+AyM3jNcFo96erQpkCjxK6TNwxQYYffNSEJG0QCBjGcEUdH3Q2bKS6NF5IAUxIDo99AlojQ70wnX4lUXPcHtYXlaeElnV4H2YyRyf+Zc/+05ixVLx9F2FuqT+EsIrd851b2ixPJftg2N5z6953VVsT/s4o/BZIy0cbOGIpAgapxneeKLjIn8jEOhBgCDIlzRYABMK2zxwlA/8WTUOXBnaF+xWBsyUcWjPammeS5IRBk4oYHYwpmk+EHBOdRpKXMBxCQfcEMhWEyn4eDtVz8= ceph-a82de5ec-77cb-11ef-baf5-efdc52797490 2024-09-21T03:45:42.411 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T03:45:42.670 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:45:42.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:42 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/410723199' entity='client.admin' 2024-09-21T03:45:44.297 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T03:45:44.298 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T03:45:44.581 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:44 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/1376129587' entity='client.admin' 2024-09-21T03:45:44.581 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:44 smithi046 ceph-mon[30954]: mgrmap e13: x(active, since 12s) 2024-09-21T03:45:44.685 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:45:46.002 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi105 2024-09-21T03:45:46.002 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:45:46.003 DEBUG:teuthology.orchestra.run.smithi105:> dd of=/etc/ceph/ceph.conf 2024-09-21T03:45:46.021 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:45:46.022 DEBUG:teuthology.orchestra.run.smithi105:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:45:46.080 INFO:tasks.cephadm:Adding host smithi105 to orchestrator... 2024-09-21T03:45:46.080 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph orch host add smithi105 2024-09-21T03:45:46.398 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:45:46.688 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:46 smithi046 ceph-mon[30954]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:46.688 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:46 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:45:46.688 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:46 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:45:46.688 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:46 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:45:46.688 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:46 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi046", "name": "osd_memory_target"} : dispatch 2024-09-21T03:45:46.689 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:46 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:45:46.689 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:46 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:45:47.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:47 smithi046 ceph-mon[30954]: Updating smithi046:/etc/ceph/ceph.conf 2024-09-21T03:45:47.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:47 smithi046 ceph-mon[30954]: Updating smithi046:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:45:47.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:47 smithi046 ceph-mon[30954]: Updating smithi046:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:45:47.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:47 smithi046 ceph-mon[30954]: Updating smithi046:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:45:47.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:47 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:45:47.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:47 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:45:47.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:47 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:45:47.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:47 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:45:47.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:47 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:45:47.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:47 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:45:47.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:47 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:45:48.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:48 smithi046 ceph-mon[30954]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi105", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:49.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:49 smithi046 ceph-mon[30954]: Deploying cephadm binary to smithi105 2024-09-21T03:45:50.956 INFO:teuthology.orchestra.run.smithi046.stdout:Added host 'smithi105' with addr '172.21.15.105' 2024-09-21T03:45:51.579 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T03:45:51.830 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:45:52.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:51 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:45:52.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:51 smithi046 ceph-mon[30954]: Added host smithi105 2024-09-21T03:45:52.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:51 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:45:52.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:51 smithi046 ceph-mon[30954]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:45:52.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:51 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:45:52.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:51 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:45:52.472 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:45:52.473 INFO:teuthology.orchestra.run.smithi046.stdout:[{"addr": "172.21.15.46", "hostname": "smithi046", "labels": [], "status": ""}, {"addr": "172.21.15.105", "hostname": "smithi105", "labels": [], "status": ""}] 2024-09-21T03:45:52.992 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi162 2024-09-21T03:45:52.993 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:45:52.993 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/etc/ceph/ceph.conf 2024-09-21T03:45:53.012 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:45:53.013 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:45:53.071 INFO:tasks.cephadm:Adding host smithi162 to orchestrator... 2024-09-21T03:45:53.071 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph orch host add smithi162 2024-09-21T03:45:53.322 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:45:53.444 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:53 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:45:53.444 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:53 smithi046 ceph-mon[30954]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:45:54.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:54 smithi046 ceph-mon[30954]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:45:55.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:55 smithi046 ceph-mon[30954]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi162", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:45:55.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:55 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:45:55.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:55 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:45:55.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:55 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:45:55.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:55 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:45:55.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:55 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi105", "name": "osd_memory_target"} : dispatch 2024-09-21T03:45:55.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:55 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:45:55.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:55 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:45:57.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:56 smithi046 ceph-mon[30954]: Deploying cephadm binary to smithi162 2024-09-21T03:45:57.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:56 smithi046 ceph-mon[30954]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:45:57.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:56 smithi046 ceph-mon[30954]: Updating smithi105:/etc/ceph/ceph.conf 2024-09-21T03:45:57.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:56 smithi046 ceph-mon[30954]: Updating smithi105:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:45:57.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:56 smithi046 ceph-mon[30954]: Updating smithi105:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:45:57.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:56 smithi046 ceph-mon[30954]: Updating smithi105:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:45:57.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:56 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:45:57.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:56 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:45:57.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:56 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:45:57.799 INFO:teuthology.orchestra.run.smithi046.stdout:Added host 'smithi162' with addr '172.21.15.162' 2024-09-21T03:45:58.291 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T03:45:58.546 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:45:58.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:58 smithi046 ceph-mon[30954]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:45:58.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:58 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:45:58.983 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:58 smithi046 ceph-mon[30954]: Added host smithi162 2024-09-21T03:45:58.983 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:58 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:45:58.983 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:58 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:45:58.983 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:45:58 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:45:59.178 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:45:59.178 INFO:teuthology.orchestra.run.smithi046.stdout:[{"addr": "172.21.15.46", "hostname": "smithi046", "labels": [], "status": ""}, {"addr": "172.21.15.105", "hostname": "smithi105", "labels": [], "status": ""}, {"addr": "172.21.15.162", "hostname": "smithi162", "labels": [], "status": ""}] 2024-09-21T03:45:59.731 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T03:45:59.731 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph osd crush tunables default 2024-09-21T03:45:59.981 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:00.371 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:00 smithi046 ceph-mon[30954]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:00.371 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:00 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:00.371 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:00 smithi046 ceph-mon[30954]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:46:01.118 INFO:teuthology.orchestra.run.smithi046.stderr:adjusted tunables profile to default 2024-09-21T03:46:01.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:01 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/1338962706' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T03:46:01.825 INFO:tasks.cephadm:Adding mon.a on smithi046 2024-09-21T03:46:01.825 INFO:tasks.cephadm:Adding mon.b on smithi105 2024-09-21T03:46:01.825 INFO:tasks.cephadm:Adding mon.c on smithi162 2024-09-21T03:46:01.825 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph orch apply mon '3;smithi046:172.21.15.46=a;smithi105:172.21.15.105=b;smithi162:172.21.15.162=c' 2024-09-21T03:46:02.081 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T03:46:02.125 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T03:46:02.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:02 smithi046 ceph-mon[30954]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:02.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:02 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/1338962706' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T03:46:02.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:02 smithi046 ceph-mon[30954]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T03:46:02.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:02 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:02.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:02 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:02.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:02 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:02.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:02 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:02.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:02 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi162", "name": "osd_memory_target"} : dispatch 2024-09-21T03:46:02.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:02 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:02.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:02 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:46:02.794 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled mon update... 2024-09-21T03:46:03.422 DEBUG:teuthology.orchestra.run.smithi105:mon.b> sudo journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mon.b.service 2024-09-21T03:46:03.425 DEBUG:teuthology.orchestra.run.smithi162:mon.c> sudo journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mon.c.service 2024-09-21T03:46:03.427 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T03:46:03.427 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T03:46:03.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:03 smithi046 ceph-mon[30954]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-21T03:46:03.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:03 smithi046 ceph-mon[30954]: Updating smithi162:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:46:03.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:03 smithi046 ceph-mon[30954]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:46:03.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:03 smithi046 ceph-mon[30954]: Updating smithi162:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:46:03.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:03 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:03.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:03 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:03.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:03 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:03.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:03 smithi046 ceph-mon[30954]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi046:172.21.15.46=a;smithi105:172.21.15.105=b;smithi162:172.21.15.162=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:03.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:03 smithi046 ceph-mon[30954]: Saving service mon spec with placement smithi046:172.21.15.46=a;smithi105:172.21.15.105=b;smithi162:172.21.15.162=c;count:3 2024-09-21T03:46:03.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:03 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:03.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:03 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:46:03.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:03 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:03.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:03 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:46:03.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:03 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:03.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:03 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:46:03.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:03 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:03.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:03 smithi046 ceph-mon[30954]: Deploying daemon mon.c on smithi162 2024-09-21T03:46:05.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:04 smithi046 ceph-mon[30954]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:05.358 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:46:06.302 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:46:06.302 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":1,"fsid":"a82de5ec-77cb-11ef-baf5-efdc52797490","modified":"2024-09-21T03:44:28.574692Z","created":"2024-09-21T03:44:28.574692Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T03:46:06.302 INFO:teuthology.orchestra.run.smithi162.stderr:dumped monmap epoch 1 2024-09-21T03:46:06.610 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:06 smithi162 systemd[1]: Starting Ceph mon.c for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T03:46:07.053 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:06 smithi046 ceph-mon[30954]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:07.054 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:06 smithi046 ceph-mon[30954]: from='client.? 172.21.15.162:0/1973056356' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T03:46:07.424 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 podman[35051]: 2024-09-21 03:46:07.069348199 +0000 UTC m=+0.015560668 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:46:07.425 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 podman[35051]: 2024-09-21 03:46:07.182122445 +0000 UTC m=+0.128334946 container create 04f27d3f22a20fe22b228560b811934dcc4ef4100150a27cb4e02fdbd716d79c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mon-c, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-21T03:46:07.425 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 podman[35051]: 2024-09-21 03:46:07.387317166 +0000 UTC m=+0.333529625 container init 04f27d3f22a20fe22b228560b811934dcc4ef4100150a27cb4e02fdbd716d79c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mon-c, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-21T03:46:07.425 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 podman[35051]: 2024-09-21 03:46:07.390465189 +0000 UTC m=+0.336677651 container start 04f27d3f22a20fe22b228560b811934dcc4ef4100150a27cb4e02fdbd716d79c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mon-c, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-21T03:46:07.425 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T03:46:07.425 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T03:46:07.425 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: pidfile_write: ignore empty --pid-file 2024-09-21T03:46:07.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: load: jerasure load: lrc 2024-09-21T03:46:07.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: RocksDB version: 7.9.2 2024-09-21T03:46:07.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Git sha 0 2024-09-21T03:46:07.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T03:46:07.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: DB SUMMARY 2024-09-21T03:46:07.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: DB Session ID: VJUW60AQNNOTCEIBGKYB 2024-09-21T03:46:07.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: CURRENT file: CURRENT 2024-09-21T03:46:07.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T03:46:07.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-21T03:46:07.878 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-21T03:46:07.878 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-21T03:46:07.878 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.error_if_exists: 0 2024-09-21T03:46:07.878 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.create_if_missing: 0 2024-09-21T03:46:07.878 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.paranoid_checks: 1 2024-09-21T03:46:07.878 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T03:46:07.878 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T03:46:07.878 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T03:46:07.878 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.env: 0x55af21fced60 2024-09-21T03:46:07.878 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T03:46:07.879 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.info_log: 0x55af26efd360 2024-09-21T03:46:07.879 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T03:46:07.879 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.statistics: (nil) 2024-09-21T03:46:07.879 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.use_fsync: 0 2024-09-21T03:46:07.879 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.max_log_file_size: 0 2024-09-21T03:46:07.879 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T03:46:07.879 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T03:46:07.879 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T03:46:07.879 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T03:46:07.879 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.allow_fallocate: 1 2024-09-21T03:46:07.879 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T03:46:07.879 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T03:46:07.879 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.use_direct_reads: 0 2024-09-21T03:46:07.879 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T03:46:07.880 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T03:46:07.880 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.db_log_dir: 2024-09-21T03:46:07.880 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.wal_dir: 2024-09-21T03:46:07.880 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T03:46:07.880 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T03:46:07.880 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T03:46:07.880 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T03:46:07.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T03:46:07.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T03:46:07.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T03:46:07.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T03:46:07.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.write_buffer_manager: 0x55af26f01d60 2024-09-21T03:46:07.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T03:46:07.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T03:46:07.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T03:46:07.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T03:46:07.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T03:46:07.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T03:46:07.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T03:46:07.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T03:46:07.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.unordered_write: 0 2024-09-21T03:46:07.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T03:46:07.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T03:46:07.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T03:46:07.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T03:46:07.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.row_cache: None 2024-09-21T03:46:07.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.wal_filter: None 2024-09-21T03:46:07.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T03:46:07.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T03:46:07.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.two_write_queues: 0 2024-09-21T03:46:07.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T03:46:07.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.wal_compression: 0 2024-09-21T03:46:07.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.atomic_flush: 0 2024-09-21T03:46:07.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T03:46:07.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T03:46:07.884 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T03:46:07.884 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.log_readahead_size: 0 2024-09-21T03:46:07.884 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T03:46:07.884 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T03:46:07.884 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T03:46:07.884 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T03:46:07.884 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T03:46:07.884 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T03:46:07.884 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T03:46:07.884 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.max_background_jobs: 2 2024-09-21T03:46:07.884 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.max_background_compactions: -1 2024-09-21T03:46:07.884 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.max_subcompactions: 1 2024-09-21T03:46:07.884 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T03:46:07.885 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T03:46:07.885 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T03:46:07.885 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T03:46:07.885 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T03:46:07.885 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T03:46:07.885 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T03:46:07.885 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T03:46:07.885 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.max_open_files: -1 2024-09-21T03:46:07.885 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T03:46:07.885 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T03:46:07.885 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T03:46:07.885 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T03:46:07.886 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.max_background_flushes: -1 2024-09-21T03:46:07.886 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Compression algorithms supported: 2024-09-21T03:46:07.886 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: kZSTD supported: 0 2024-09-21T03:46:07.886 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: kXpressCompression supported: 0 2024-09-21T03:46:07.886 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: kBZip2Compression supported: 0 2024-09-21T03:46:07.886 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T03:46:07.886 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: kLZ4Compression supported: 1 2024-09-21T03:46:07.886 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: kZlibCompression supported: 1 2024-09-21T03:46:07.886 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T03:46:07.886 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: kSnappyCompression supported: 1 2024-09-21T03:46:07.886 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T03:46:07.886 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T03:46:07.887 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-21T03:46:07.887 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T03:46:07.887 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T03:46:07.887 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.merge_operator: 2024-09-21T03:46:07.887 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.compaction_filter: None 2024-09-21T03:46:07.887 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T03:46:07.887 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T03:46:07.887 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T03:46:07.887 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T03:46:07.887 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55af26efcfa0) 2024-09-21T03:46:07.888 INFO:journalctl@ceph.mon.c.smithi162.stdout: cache_index_and_filter_blocks: 1 2024-09-21T03:46:07.888 INFO:journalctl@ceph.mon.c.smithi162.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T03:46:07.888 INFO:journalctl@ceph.mon.c.smithi162.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T03:46:07.888 INFO:journalctl@ceph.mon.c.smithi162.stdout: pin_top_level_index_and_filter: 1 2024-09-21T03:46:07.888 INFO:journalctl@ceph.mon.c.smithi162.stdout: index_type: 0 2024-09-21T03:46:07.888 INFO:journalctl@ceph.mon.c.smithi162.stdout: data_block_index_type: 0 2024-09-21T03:46:07.888 INFO:journalctl@ceph.mon.c.smithi162.stdout: index_shortening: 1 2024-09-21T03:46:07.888 INFO:journalctl@ceph.mon.c.smithi162.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T03:46:07.888 INFO:journalctl@ceph.mon.c.smithi162.stdout: checksum: 4 2024-09-21T03:46:07.888 INFO:journalctl@ceph.mon.c.smithi162.stdout: no_block_cache: 0 2024-09-21T03:46:07.888 INFO:journalctl@ceph.mon.c.smithi162.stdout: block_cache: 0x55af22ec1610 2024-09-21T03:46:07.888 INFO:journalctl@ceph.mon.c.smithi162.stdout: block_cache_name: BinnedLRUCache 2024-09-21T03:46:07.888 INFO:journalctl@ceph.mon.c.smithi162.stdout: block_cache_options: 2024-09-21T03:46:07.889 INFO:journalctl@ceph.mon.c.smithi162.stdout: capacity : 536870912 2024-09-21T03:46:07.889 INFO:journalctl@ceph.mon.c.smithi162.stdout: num_shard_bits : 4 2024-09-21T03:46:07.889 INFO:journalctl@ceph.mon.c.smithi162.stdout: strict_capacity_limit : 0 2024-09-21T03:46:07.889 INFO:journalctl@ceph.mon.c.smithi162.stdout: high_pri_pool_ratio: 0.000 2024-09-21T03:46:07.889 INFO:journalctl@ceph.mon.c.smithi162.stdout: block_cache_compressed: (nil) 2024-09-21T03:46:07.889 INFO:journalctl@ceph.mon.c.smithi162.stdout: persistent_cache: (nil) 2024-09-21T03:46:07.889 INFO:journalctl@ceph.mon.c.smithi162.stdout: block_size: 4096 2024-09-21T03:46:07.889 INFO:journalctl@ceph.mon.c.smithi162.stdout: block_size_deviation: 10 2024-09-21T03:46:07.889 INFO:journalctl@ceph.mon.c.smithi162.stdout: block_restart_interval: 16 2024-09-21T03:46:07.889 INFO:journalctl@ceph.mon.c.smithi162.stdout: index_block_restart_interval: 1 2024-09-21T03:46:07.889 INFO:journalctl@ceph.mon.c.smithi162.stdout: metadata_block_size: 4096 2024-09-21T03:46:07.889 INFO:journalctl@ceph.mon.c.smithi162.stdout: partition_filters: 0 2024-09-21T03:46:07.890 INFO:journalctl@ceph.mon.c.smithi162.stdout: use_delta_encoding: 1 2024-09-21T03:46:07.890 INFO:journalctl@ceph.mon.c.smithi162.stdout: filter_policy: bloomfilter 2024-09-21T03:46:07.890 INFO:journalctl@ceph.mon.c.smithi162.stdout: whole_key_filtering: 1 2024-09-21T03:46:07.890 INFO:journalctl@ceph.mon.c.smithi162.stdout: verify_compression: 0 2024-09-21T03:46:07.890 INFO:journalctl@ceph.mon.c.smithi162.stdout: read_amp_bytes_per_bit: 0 2024-09-21T03:46:07.890 INFO:journalctl@ceph.mon.c.smithi162.stdout: format_version: 5 2024-09-21T03:46:07.890 INFO:journalctl@ceph.mon.c.smithi162.stdout: enable_index_compression: 1 2024-09-21T03:46:07.890 INFO:journalctl@ceph.mon.c.smithi162.stdout: block_align: 0 2024-09-21T03:46:07.890 INFO:journalctl@ceph.mon.c.smithi162.stdout: max_auto_readahead_size: 262144 2024-09-21T03:46:07.890 INFO:journalctl@ceph.mon.c.smithi162.stdout: prepopulate_block_cache: 0 2024-09-21T03:46:07.890 INFO:journalctl@ceph.mon.c.smithi162.stdout: initial_auto_readahead_size: 8192 2024-09-21T03:46:07.890 INFO:journalctl@ceph.mon.c.smithi162.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T03:46:07.890 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T03:46:07.891 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T03:46:07.891 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.compression: NoCompression 2024-09-21T03:46:07.891 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T03:46:07.891 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T03:46:07.891 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T03:46:07.891 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.num_levels: 7 2024-09-21T03:46:07.891 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T03:46:07.891 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T03:46:07.891 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T03:46:07.891 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T03:46:07.891 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T03:46:07.892 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T03:46:07.892 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T03:46:07.892 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T03:46:07.892 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T03:46:07.892 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T03:46:07.892 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T03:46:07.892 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T03:46:07.892 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T03:46:07.892 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T03:46:07.892 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T03:46:07.892 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T03:46:07.892 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T03:46:07.893 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T03:46:07.893 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T03:46:07.893 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T03:46:07.893 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T03:46:07.893 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T03:46:07.893 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T03:46:07.893 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T03:46:07.893 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T03:46:07.893 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T03:46:07.893 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T03:46:07.893 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T03:46:07.893 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T03:46:07.893 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T03:46:07.894 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T03:46:07.894 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T03:46:07.894 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T03:46:07.894 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T03:46:07.894 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T03:46:07.894 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T03:46:07.894 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T03:46:07.894 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T03:46:07.894 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T03:46:07.894 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T03:46:07.894 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T03:46:07.894 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T03:46:07.894 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T03:46:07.894 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T03:46:07.895 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T03:46:07.895 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T03:46:07.895 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T03:46:07.895 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T03:46:07.895 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T03:46:07.895 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T03:46:07.895 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T03:46:07.895 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T03:46:07.895 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T03:46:07.895 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T03:46:07.895 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.inplace_update_support: 0 2024-09-21T03:46:07.895 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T03:46:07.895 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T03:46:07.896 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T03:46:07.896 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T03:46:07.896 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.bloom_locality: 0 2024-09-21T03:46:07.896 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.max_successive_merges: 0 2024-09-21T03:46:07.896 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T03:46:07.896 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T03:46:07.896 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T03:46:07.896 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T03:46:07.896 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.ttl: 2592000 2024-09-21T03:46:07.896 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T03:46:07.896 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T03:46:07.896 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T03:46:07.896 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.enable_blob_files: false 2024-09-21T03:46:07.896 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.min_blob_size: 0 2024-09-21T03:46:07.897 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T03:46:07.897 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T03:46:07.897 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T03:46:07.897 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T03:46:07.897 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T03:46:07.897 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T03:46:07.897 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T03:46:07.897 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T03:46:07.897 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T03:46:07.897 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T03:46:07.897 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 63968333-b279-4720-8ade-a9a3de5e0add 2024-09-21T03:46:07.897 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726890367428308, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T03:46:07.897 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T03:46:07.897 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726890367428735, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726890367, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "63968333-b279-4720-8ade-a9a3de5e0add", "db_session_id": "VJUW60AQNNOTCEIBGKYB", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T03:46:07.898 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726890367428836, "job": 1, "event": "recovery_finished"} 2024-09-21T03:46:07.898 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T03:46:07.898 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T03:46:07.898 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55af26f20a80 2024-09-21T03:46:07.898 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: DB pointer 0x55af27cc6000 2024-09-21T03:46:07.898 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T03:46:07.898 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T03:46:07.898 INFO:journalctl@ceph.mon.c.smithi162.stdout: ** DB Stats ** 2024-09-21T03:46:07.898 INFO:journalctl@ceph.mon.c.smithi162.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T03:46:07.898 INFO:journalctl@ceph.mon.c.smithi162.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T03:46:07.898 INFO:journalctl@ceph.mon.c.smithi162.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T03:46:07.898 INFO:journalctl@ceph.mon.c.smithi162.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T03:46:07.898 INFO:journalctl@ceph.mon.c.smithi162.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T03:46:07.898 INFO:journalctl@ceph.mon.c.smithi162.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T03:46:07.899 INFO:journalctl@ceph.mon.c.smithi162.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T03:46:07.899 INFO:journalctl@ceph.mon.c.smithi162.stdout: 2024-09-21T03:46:07.899 INFO:journalctl@ceph.mon.c.smithi162.stdout: ** Compaction Stats [default] ** 2024-09-21T03:46:07.899 INFO:journalctl@ceph.mon.c.smithi162.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T03:46:07.899 INFO:journalctl@ceph.mon.c.smithi162.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T03:46:07.899 INFO:journalctl@ceph.mon.c.smithi162.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T03:46:07.899 INFO:journalctl@ceph.mon.c.smithi162.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T03:46:07.899 INFO:journalctl@ceph.mon.c.smithi162.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T03:46:07.899 INFO:journalctl@ceph.mon.c.smithi162.stdout: 2024-09-21T03:46:07.899 INFO:journalctl@ceph.mon.c.smithi162.stdout: ** Compaction Stats [default] ** 2024-09-21T03:46:07.899 INFO:journalctl@ceph.mon.c.smithi162.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T03:46:07.899 INFO:journalctl@ceph.mon.c.smithi162.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T03:46:07.899 INFO:journalctl@ceph.mon.c.smithi162.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T03:46:07.899 INFO:journalctl@ceph.mon.c.smithi162.stdout: 2024-09-21T03:46:07.900 INFO:journalctl@ceph.mon.c.smithi162.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T03:46:07.900 INFO:journalctl@ceph.mon.c.smithi162.stdout: 2024-09-21T03:46:07.900 INFO:journalctl@ceph.mon.c.smithi162.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T03:46:07.900 INFO:journalctl@ceph.mon.c.smithi162.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T03:46:07.900 INFO:journalctl@ceph.mon.c.smithi162.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T03:46:07.900 INFO:journalctl@ceph.mon.c.smithi162.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T03:46:07.900 INFO:journalctl@ceph.mon.c.smithi162.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T03:46:07.900 INFO:journalctl@ceph.mon.c.smithi162.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T03:46:07.900 INFO:journalctl@ceph.mon.c.smithi162.stdout: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T03:46:07.900 INFO:journalctl@ceph.mon.c.smithi162.stdout: Interval compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T03:46:07.900 INFO:journalctl@ceph.mon.c.smithi162.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T03:46:07.900 INFO:journalctl@ceph.mon.c.smithi162.stdout: Block cache BinnedLRUCache@0x55af22ec1610#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-21T03:46:07.900 INFO:journalctl@ceph.mon.c.smithi162.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T03:46:07.901 INFO:journalctl@ceph.mon.c.smithi162.stdout: 2024-09-21T03:46:07.901 INFO:journalctl@ceph.mon.c.smithi162.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T03:46:07.901 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-21T03:46:07.901 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: using public_addr v2:172.21.15.162:0/0 -> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-21T03:46:07.901 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: starting mon.c rank -1 at public addrs [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] at bind addrs [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid a82de5ec-77cb-11ef-baf5-efdc52797490 2024-09-21T03:46:07.901 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: mon.c@-1(???) e0 preinit fsid a82de5ec-77cb-11ef-baf5-efdc52797490 2024-09-21T03:46:07.901 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: mon.c@-1(synchronizing).mds e1 new map 2024-09-21T03:46:07.901 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-21T03:46:07.901 INFO:journalctl@ceph.mon.c.smithi162.stdout: e1 2024-09-21T03:46:07.901 INFO:journalctl@ceph.mon.c.smithi162.stdout: btime 2024-09-21T03:44:31:512068+0000 2024-09-21T03:46:07.901 INFO:journalctl@ceph.mon.c.smithi162.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T03:46:07.901 INFO:journalctl@ceph.mon.c.smithi162.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T03:46:07.901 INFO:journalctl@ceph.mon.c.smithi162.stdout: legacy client fscid: -1 2024-09-21T03:46:07.901 INFO:journalctl@ceph.mon.c.smithi162.stdout: 2024-09-21T03:46:07.902 INFO:journalctl@ceph.mon.c.smithi162.stdout: No filesystems configured 2024-09-21T03:46:07.902 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T03:46:07.902 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T03:46:07.902 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T03:46:07.902 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T03:46:07.902 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T03:46:07.902 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T03:46:07.902 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T03:46:07.902 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T03:46:07.902 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T03:46:07.902 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T03:46:07.902 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:07.903 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi162", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:07.903 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:07.903 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:07.903 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:07.903 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:07.903 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi105", "name": "osd_memory_target"} : dispatch 2024-09-21T03:46:07.903 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:07.903 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:46:07.903 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: Deploying cephadm binary to smithi162 2024-09-21T03:46:07.903 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:07.903 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: Updating smithi105:/etc/ceph/ceph.conf 2024-09-21T03:46:07.903 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: Updating smithi105:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:46:07.904 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: Updating smithi105:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:46:07.904 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: Updating smithi105:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:46:07.904 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:07.904 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:07.904 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:07.904 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:07.904 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:07.905 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: Added host smithi162 2024-09-21T03:46:07.905 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:46:07.905 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:07.905 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:07.905 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:07.905 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:07.905 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:46:07.905 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/1338962706' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T03:46:07.905 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:07.905 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/1338962706' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T03:46:07.905 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T03:46:07.905 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:07.906 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:07.906 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:07.906 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:07.906 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi162", "name": "osd_memory_target"} : dispatch 2024-09-21T03:46:07.906 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:07.906 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:46:07.906 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-21T03:46:07.906 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: Updating smithi162:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:46:07.906 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:46:07.906 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: Updating smithi162:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:46:07.906 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:07.906 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:07.907 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:07.907 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi046:172.21.15.46=a;smithi105:172.21.15.105=b;smithi162:172.21.15.162=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:46:07.907 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: Saving service mon spec with placement smithi046:172.21.15.46=a;smithi105:172.21.15.105=b;smithi162:172.21.15.162=c;count:3 2024-09-21T03:46:07.907 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:07.907 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:46:07.907 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:07.907 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:46:07.907 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:07.907 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:46:07.907 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:07.907 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: Deploying daemon mon.c on smithi162 2024-09-21T03:46:07.907 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:07.907 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:07.908 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: from='client.? 172.21.15.162:0/1973056356' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T03:46:07.908 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 ceph-mon[35071]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T03:46:07.908 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 bash[35051]: 04f27d3f22a20fe22b228560b811934dcc4ef4100150a27cb4e02fdbd716d79c 2024-09-21T03:46:07.908 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:07 smithi162 systemd[1]: Started Ceph mon.c for a82de5ec-77cb-11ef-baf5-efdc52797490. 2024-09-21T03:46:07.939 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T03:46:07.939 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T03:46:08.199 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:46:12.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:12 smithi162 ceph-mon[35071]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:12.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:12 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:46:12.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:12 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:46:12.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:12 smithi162 ceph-mon[35071]: mon.a calling monitor election 2024-09-21T03:46:12.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:12 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:46:12.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:12 smithi162 ceph-mon[35071]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:12.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:12 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:46:12.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:12 smithi162 ceph-mon[35071]: mon.c calling monitor election 2024-09-21T03:46:12.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:12 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:46:12.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:12 smithi162 ceph-mon[35071]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:12.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:12 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:46:12.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:12 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:46:12.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:12 smithi162 ceph-mon[35071]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T03:46:12.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:12 smithi162 ceph-mon[35071]: monmap epoch 2 2024-09-21T03:46:12.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:12 smithi162 ceph-mon[35071]: fsid a82de5ec-77cb-11ef-baf5-efdc52797490 2024-09-21T03:46:12.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:12 smithi162 ceph-mon[35071]: last_changed 2024-09-21T03:46:07.456200+0000 2024-09-21T03:46:12.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:12 smithi162 ceph-mon[35071]: created 2024-09-21T03:44:28.574692+0000 2024-09-21T03:46:12.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:12 smithi162 ceph-mon[35071]: min_mon_release 19 (squid) 2024-09-21T03:46:12.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:12 smithi162 ceph-mon[35071]: election_strategy: 1 2024-09-21T03:46:12.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:12 smithi162 ceph-mon[35071]: 0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-09-21T03:46:12.878 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:12 smithi162 ceph-mon[35071]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.c 2024-09-21T03:46:12.878 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:12 smithi162 ceph-mon[35071]: fsmap 2024-09-21T03:46:12.878 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:12 smithi162 ceph-mon[35071]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T03:46:12.878 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:12 smithi162 ceph-mon[35071]: mgrmap e13: x(active, since 41s) 2024-09-21T03:46:12.878 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:12 smithi162 ceph-mon[35071]: overall HEALTH_OK 2024-09-21T03:46:12.878 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:12 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:12.878 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:12 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:12.878 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:12 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:12.878 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:12 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:46:12.878 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:12 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:13.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:12 smithi046 ceph-mon[30954]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:13.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:12 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:46:13.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:12 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:46:13.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:12 smithi046 ceph-mon[30954]: mon.a calling monitor election 2024-09-21T03:46:13.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:12 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:46:13.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:12 smithi046 ceph-mon[30954]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:13.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:12 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:46:13.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:12 smithi046 ceph-mon[30954]: mon.c calling monitor election 2024-09-21T03:46:13.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:12 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:46:13.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:12 smithi046 ceph-mon[30954]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:13.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:12 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:46:13.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:12 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:46:13.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:12 smithi046 ceph-mon[30954]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T03:46:13.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:12 smithi046 ceph-mon[30954]: monmap epoch 2 2024-09-21T03:46:13.003 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:12 smithi046 ceph-mon[30954]: fsid a82de5ec-77cb-11ef-baf5-efdc52797490 2024-09-21T03:46:13.003 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:12 smithi046 ceph-mon[30954]: last_changed 2024-09-21T03:46:07.456200+0000 2024-09-21T03:46:13.003 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:12 smithi046 ceph-mon[30954]: created 2024-09-21T03:44:28.574692+0000 2024-09-21T03:46:13.003 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:12 smithi046 ceph-mon[30954]: min_mon_release 19 (squid) 2024-09-21T03:46:13.003 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:12 smithi046 ceph-mon[30954]: election_strategy: 1 2024-09-21T03:46:13.003 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:12 smithi046 ceph-mon[30954]: 0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-09-21T03:46:13.003 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:12 smithi046 ceph-mon[30954]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.c 2024-09-21T03:46:13.003 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:12 smithi046 ceph-mon[30954]: fsmap 2024-09-21T03:46:13.003 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:12 smithi046 ceph-mon[30954]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T03:46:13.003 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:12 smithi046 ceph-mon[30954]: mgrmap e13: x(active, since 41s) 2024-09-21T03:46:13.003 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:12 smithi046 ceph-mon[30954]: overall HEALTH_OK 2024-09-21T03:46:13.003 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:12 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:13.003 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:12 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:13.003 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:12 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:13.004 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:12 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:46:13.004 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:12 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:13.299 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:46:13.299 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":2,"fsid":"a82de5ec-77cb-11ef-baf5-efdc52797490","modified":"2024-09-21T03:46:07.456200Z","created":"2024-09-21T03:44:28.574692Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:3300","nonce":0},{"type":"v1","addr":"172.21.15.162:6789","nonce":0}]},"addr":"172.21.15.162:6789/0","public_addr":"172.21.15.162:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T03:46:13.300 INFO:teuthology.orchestra.run.smithi162.stderr:dumped monmap epoch 2 2024-09-21T03:46:13.619 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:13 smithi162 ceph-mon[35071]: Deploying daemon mon.b on smithi105 2024-09-21T03:46:13.619 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:13 smithi162 ceph-mon[35071]: from='client.? 172.21.15.162:0/1688469963' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T03:46:13.619 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:13 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:46:14.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:13 smithi046 ceph-mon[30954]: Deploying daemon mon.b on smithi105 2024-09-21T03:46:14.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:13 smithi046 ceph-mon[30954]: from='client.? 172.21.15.162:0/1688469963' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T03:46:14.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:13 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:46:14.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:14 smithi162 ceph-mon[35071]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:14.939 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T03:46:14.940 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T03:46:15.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:14 smithi046 ceph-mon[30954]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:15.193 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:46:15.869 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:46:15.869 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":2,"fsid":"a82de5ec-77cb-11ef-baf5-efdc52797490","modified":"2024-09-21T03:46:07.456200Z","created":"2024-09-21T03:44:28.574692Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:3300","nonce":0},{"type":"v1","addr":"172.21.15.162:6789","nonce":0}]},"addr":"172.21.15.162:6789/0","public_addr":"172.21.15.162:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T03:46:15.870 INFO:teuthology.orchestra.run.smithi162.stderr:dumped monmap epoch 2 2024-09-21T03:46:16.197 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:16 smithi105 ceph-mon[34773]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T03:46:16.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:16 smithi105 bash[34754]: ddde3b0c49f415457c427b0eee97f3b62ae9dd45b5017b8a622b03922f9f8c7b 2024-09-21T03:46:16.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:16 smithi105 systemd[1]: Started Ceph mon.b for a82de5ec-77cb-11ef-baf5-efdc52797490. 2024-09-21T03:46:17.485 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T03:46:17.485 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T03:46:17.736 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:46:21.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:21 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:46:21.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:21 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:46:21.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:21 smithi105 ceph-mon[34773]: mon.a calling monitor election 2024-09-21T03:46:21.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:21 smithi105 ceph-mon[34773]: mon.c calling monitor election 2024-09-21T03:46:21.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:21 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:46:21.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:21 smithi105 ceph-mon[34773]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:21.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:21 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:46:21.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:21 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:46:21.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:21 smithi105 ceph-mon[34773]: mon.b calling monitor election 2024-09-21T03:46:21.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:21 smithi105 ceph-mon[34773]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:21.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:21 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:46:21.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:21 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:46:21.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:21 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:46:21.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:21 smithi105 ceph-mon[34773]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T03:46:21.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:21 smithi105 ceph-mon[34773]: monmap epoch 3 2024-09-21T03:46:21.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:21 smithi105 ceph-mon[34773]: fsid a82de5ec-77cb-11ef-baf5-efdc52797490 2024-09-21T03:46:21.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:21 smithi105 ceph-mon[34773]: last_changed 2024-09-21T03:46:16.192665+0000 2024-09-21T03:46:21.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:21 smithi105 ceph-mon[34773]: created 2024-09-21T03:44:28.574692+0000 2024-09-21T03:46:21.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:21 smithi105 ceph-mon[34773]: min_mon_release 19 (squid) 2024-09-21T03:46:21.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:21 smithi105 ceph-mon[34773]: election_strategy: 1 2024-09-21T03:46:21.570 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:21 smithi105 ceph-mon[34773]: 0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-09-21T03:46:21.570 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:21 smithi105 ceph-mon[34773]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.c 2024-09-21T03:46:21.570 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:21 smithi105 ceph-mon[34773]: 2: [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] mon.b 2024-09-21T03:46:21.570 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:21 smithi105 ceph-mon[34773]: fsmap 2024-09-21T03:46:21.570 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:21 smithi105 ceph-mon[34773]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T03:46:21.570 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:21 smithi105 ceph-mon[34773]: mgrmap e13: x(active, since 50s) 2024-09-21T03:46:21.570 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:21 smithi105 ceph-mon[34773]: overall HEALTH_OK 2024-09-21T03:46:21.570 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:21 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:21.570 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:21 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:21.570 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:21 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:21.570 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:21 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:21.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:21 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:46:21.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:21 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:46:21.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:21 smithi162 ceph-mon[35071]: mon.a calling monitor election 2024-09-21T03:46:21.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:21 smithi162 ceph-mon[35071]: mon.c calling monitor election 2024-09-21T03:46:21.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:21 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:46:21.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:21 smithi162 ceph-mon[35071]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:21.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:21 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:46:21.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:21 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:46:21.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:21 smithi162 ceph-mon[35071]: mon.b calling monitor election 2024-09-21T03:46:21.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:21 smithi162 ceph-mon[35071]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:21.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:21 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:46:21.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:21 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:46:21.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:21 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:46:21.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:21 smithi162 ceph-mon[35071]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T03:46:21.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:21 smithi162 ceph-mon[35071]: monmap epoch 3 2024-09-21T03:46:21.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:21 smithi162 ceph-mon[35071]: fsid a82de5ec-77cb-11ef-baf5-efdc52797490 2024-09-21T03:46:21.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:21 smithi162 ceph-mon[35071]: last_changed 2024-09-21T03:46:16.192665+0000 2024-09-21T03:46:21.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:21 smithi162 ceph-mon[35071]: created 2024-09-21T03:44:28.574692+0000 2024-09-21T03:46:21.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:21 smithi162 ceph-mon[35071]: min_mon_release 19 (squid) 2024-09-21T03:46:21.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:21 smithi162 ceph-mon[35071]: election_strategy: 1 2024-09-21T03:46:21.628 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:21 smithi162 ceph-mon[35071]: 0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-09-21T03:46:21.628 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:21 smithi162 ceph-mon[35071]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.c 2024-09-21T03:46:21.628 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:21 smithi162 ceph-mon[35071]: 2: [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] mon.b 2024-09-21T03:46:21.628 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:21 smithi162 ceph-mon[35071]: fsmap 2024-09-21T03:46:21.628 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:21 smithi162 ceph-mon[35071]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T03:46:21.628 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:21 smithi162 ceph-mon[35071]: mgrmap e13: x(active, since 50s) 2024-09-21T03:46:21.628 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:21 smithi162 ceph-mon[35071]: overall HEALTH_OK 2024-09-21T03:46:21.628 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:21 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:21.628 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:21 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:21.628 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:21 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:21.628 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:21 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:21.660 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:46:21.660 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":3,"fsid":"a82de5ec-77cb-11ef-baf5-efdc52797490","modified":"2024-09-21T03:46:16.192665Z","created":"2024-09-21T03:44:28.574692Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:3300","nonce":0},{"type":"v1","addr":"172.21.15.162:6789","nonce":0}]},"addr":"172.21.15.162:6789/0","public_addr":"172.21.15.162:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-21T03:46:21.661 INFO:teuthology.orchestra.run.smithi162.stderr:dumped monmap epoch 3 2024-09-21T03:46:21.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:21 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:46:21.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:21 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:46:21.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:21 smithi046 ceph-mon[30954]: mon.a calling monitor election 2024-09-21T03:46:21.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:21 smithi046 ceph-mon[30954]: mon.c calling monitor election 2024-09-21T03:46:21.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:21 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:46:21.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:21 smithi046 ceph-mon[30954]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:21.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:21 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:46:21.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:21 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:46:21.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:21 smithi046 ceph-mon[30954]: mon.b calling monitor election 2024-09-21T03:46:21.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:21 smithi046 ceph-mon[30954]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:21.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:21 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:46:21.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:21 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:46:21.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:21 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:46:21.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:21 smithi046 ceph-mon[30954]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T03:46:21.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:21 smithi046 ceph-mon[30954]: monmap epoch 3 2024-09-21T03:46:21.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:21 smithi046 ceph-mon[30954]: fsid a82de5ec-77cb-11ef-baf5-efdc52797490 2024-09-21T03:46:21.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:21 smithi046 ceph-mon[30954]: last_changed 2024-09-21T03:46:16.192665+0000 2024-09-21T03:46:21.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:21 smithi046 ceph-mon[30954]: created 2024-09-21T03:44:28.574692+0000 2024-09-21T03:46:21.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:21 smithi046 ceph-mon[30954]: min_mon_release 19 (squid) 2024-09-21T03:46:21.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:21 smithi046 ceph-mon[30954]: election_strategy: 1 2024-09-21T03:46:21.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:21 smithi046 ceph-mon[30954]: 0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-09-21T03:46:21.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:21 smithi046 ceph-mon[30954]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.c 2024-09-21T03:46:21.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:21 smithi046 ceph-mon[30954]: 2: [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] mon.b 2024-09-21T03:46:21.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:21 smithi046 ceph-mon[30954]: fsmap 2024-09-21T03:46:21.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:21 smithi046 ceph-mon[30954]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T03:46:21.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:21 smithi046 ceph-mon[30954]: mgrmap e13: x(active, since 50s) 2024-09-21T03:46:21.754 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:21 smithi046 ceph-mon[30954]: overall HEALTH_OK 2024-09-21T03:46:21.754 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:21 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:21.754 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:21 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:21.754 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:21 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:21.754 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:21 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:22.567 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:22 smithi105 ceph-mon[34773]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:22.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:22 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:46:22.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:22 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:22.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:22 smithi105 ceph-mon[34773]: from='client.? 172.21.15.162:0/1011568701' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T03:46:22.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:22 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:46:22.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:22 smithi162 ceph-mon[35071]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:22.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:22 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:46:22.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:22 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:22.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:22 smithi162 ceph-mon[35071]: from='client.? 172.21.15.162:0/1011568701' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T03:46:22.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:22 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:46:22.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:22 smithi046 ceph-mon[30954]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:22.754 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:22 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:46:22.754 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:22 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:22.754 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:22 smithi046 ceph-mon[30954]: from='client.? 172.21.15.162:0/1011568701' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T03:46:22.754 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:22 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:46:22.923 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T03:46:22.923 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T03:46:23.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:23 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:23 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:23 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:23 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:23 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:23.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:23 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:46:23.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:23 smithi046 ceph-mon[30954]: Updating smithi046:/etc/ceph/ceph.conf 2024-09-21T03:46:23.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:23 smithi046 ceph-mon[30954]: Updating smithi105:/etc/ceph/ceph.conf 2024-09-21T03:46:23.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:23 smithi046 ceph-mon[30954]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-21T03:46:23.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:23 smithi046 ceph-mon[30954]: Updating smithi105:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:46:23.503 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:23 smithi046 ceph-mon[30954]: Updating smithi162:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:46:23.503 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:23 smithi046 ceph-mon[30954]: Updating smithi046:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:46:23.503 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:23 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.503 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:23 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.503 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:23 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.503 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:23 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.503 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:23 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.503 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:23 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.503 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:23 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.503 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:23 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.503 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:23 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.503 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:23 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.504 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:23 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.504 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:23 smithi046 ceph-mon[30954]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T03:46:23.504 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:23 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:46:23.504 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:23 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:46:23.504 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:23 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:23.504 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:23 smithi046 ceph-mon[30954]: Reconfiguring daemon mon.a on smithi046 2024-09-21T03:46:23.561 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:23 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.561 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:23 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.561 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:23 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.561 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:23 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.561 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:23 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:23.561 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:23 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:46:23.562 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:23 smithi105 ceph-mon[34773]: Updating smithi046:/etc/ceph/ceph.conf 2024-09-21T03:46:23.562 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:23 smithi105 ceph-mon[34773]: Updating smithi105:/etc/ceph/ceph.conf 2024-09-21T03:46:23.562 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:23 smithi105 ceph-mon[34773]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-21T03:46:23.562 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:23 smithi105 ceph-mon[34773]: Updating smithi105:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:46:23.562 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:23 smithi105 ceph-mon[34773]: Updating smithi162:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:46:23.562 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:23 smithi105 ceph-mon[34773]: Updating smithi046:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:46:23.562 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:23 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.562 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:23 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.562 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:23 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.562 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:23 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.562 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:23 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.563 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:23 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.563 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:23 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.563 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:23 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.563 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:23 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.563 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:23 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.563 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:23 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.563 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:23 smithi105 ceph-mon[34773]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T03:46:23.563 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:23 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:46:23.563 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:23 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:46:23.563 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:23 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:23.563 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:23 smithi105 ceph-mon[34773]: Reconfiguring daemon mon.a on smithi046 2024-09-21T03:46:23.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:23 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:23 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:23 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:23 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:23 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:23.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:23 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:46:23.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:23 smithi162 ceph-mon[35071]: Updating smithi046:/etc/ceph/ceph.conf 2024-09-21T03:46:23.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:23 smithi162 ceph-mon[35071]: Updating smithi105:/etc/ceph/ceph.conf 2024-09-21T03:46:23.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:23 smithi162 ceph-mon[35071]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-21T03:46:23.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:23 smithi162 ceph-mon[35071]: Updating smithi105:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:46:23.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:23 smithi162 ceph-mon[35071]: Updating smithi162:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:46:23.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:23 smithi162 ceph-mon[35071]: Updating smithi046:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:46:23.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:23 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:23 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:23 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:23 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:23 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:23 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:23 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:23 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.628 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:23 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.628 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:23 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.628 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:23 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:23.628 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:23 smithi162 ceph-mon[35071]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T03:46:23.628 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:23 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:46:23.628 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:23 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:46:23.628 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:23 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:23.628 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:23 smithi162 ceph-mon[35071]: Reconfiguring daemon mon.a on smithi046 2024-09-21T03:46:23.909 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:24.530 INFO:teuthology.orchestra.run.smithi046.stdout:# minimal ceph.conf for a82de5ec-77cb-11ef-baf5-efdc52797490 2024-09-21T03:46:24.530 INFO:teuthology.orchestra.run.smithi046.stdout:[global] 2024-09-21T03:46:24.530 INFO:teuthology.orchestra.run.smithi046.stdout: fsid = a82de5ec-77cb-11ef-baf5-efdc52797490 2024-09-21T03:46:24.530 INFO:teuthology.orchestra.run.smithi046.stdout: mon_host = [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-21T03:46:24.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:24 smithi105 ceph-mon[34773]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:24.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:24 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:24.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:24 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:24.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:24 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:46:24.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:24 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:46:24.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:24 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:24.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:24 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/1139420824' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:24.826 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:24 smithi046 ceph-mon[30954]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:24.826 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:24 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:24.826 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:24 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:24.826 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:24 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:46:24.826 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:24 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:46:24.827 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:24 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:24.827 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:24 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/1139420824' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:25.091 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T03:46:25.091 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T03:46:25.091 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T03:46:25.119 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T03:46:25.119 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:46:25.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:24 smithi162 ceph-mon[35071]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:25.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:24 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:25.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:24 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:25.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:24 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:46:25.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:24 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:46:25.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:24 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:25.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:24 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/1139420824' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:25.186 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:46:25.186 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T03:46:25.214 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:46:25.214 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:46:25.279 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:46:25.279 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T03:46:25.307 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:46:25.307 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:46:25.373 INFO:tasks.cephadm:enabling module snap_schedule 2024-09-21T03:46:25.373 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2024-09-21T03:46:25.621 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:25.838 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:25 smithi162 ceph-mon[35071]: Reconfiguring mon.b (monmap changed)... 2024-09-21T03:46:25.838 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:25 smithi162 ceph-mon[35071]: Reconfiguring daemon mon.b on smithi105 2024-09-21T03:46:25.839 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:25 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:25.839 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:25 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:25.839 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:25 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:46:25.839 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:25 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:46:25.839 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:25 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:25.957 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:25 smithi046 ceph-mon[30954]: Reconfiguring mon.b (monmap changed)... 2024-09-21T03:46:25.957 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:25 smithi046 ceph-mon[30954]: Reconfiguring daemon mon.b on smithi105 2024-09-21T03:46:25.957 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:25 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:25.957 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:25 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:25.957 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:25 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:46:25.957 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:25 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:46:25.957 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:25 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:26.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:25 smithi105 ceph-mon[34773]: Reconfiguring mon.b (monmap changed)... 2024-09-21T03:46:26.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:25 smithi105 ceph-mon[34773]: Reconfiguring daemon mon.b on smithi105 2024-09-21T03:46:26.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:25 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:26.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:25 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:26.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:25 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:46:26.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:25 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:46:26.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:25 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:26.739 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:26 smithi162 ceph-mon[35071]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:26.739 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:26 smithi162 ceph-mon[35071]: Reconfiguring mon.c (monmap changed)... 2024-09-21T03:46:26.739 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:26 smithi162 ceph-mon[35071]: Reconfiguring daemon mon.c on smithi162 2024-09-21T03:46:26.739 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:26 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3304488145' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T03:46:26.739 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:26 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:26.740 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:26 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:26.740 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:26 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:46:26.740 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:26 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:26.740 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:26 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:46:26.740 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:26 smithi162 ceph-mon[35071]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:27.002 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:46:26 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: ignoring --setuser ceph since I am not root 2024-09-21T03:46:27.002 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:46:26 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: ignoring --setgroup ceph since I am not root 2024-09-21T03:46:27.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:26 smithi046 ceph-mon[30954]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:27.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:26 smithi046 ceph-mon[30954]: Reconfiguring mon.c (monmap changed)... 2024-09-21T03:46:27.003 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:26 smithi046 ceph-mon[30954]: Reconfiguring daemon mon.c on smithi162 2024-09-21T03:46:27.003 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:26 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3304488145' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T03:46:27.003 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:26 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:27.003 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:26 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:27.003 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:26 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:46:27.003 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:26 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:27.004 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:26 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:46:27.004 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:26 smithi046 ceph-mon[30954]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:27.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:26 smithi105 ceph-mon[34773]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:27.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:26 smithi105 ceph-mon[34773]: Reconfiguring mon.c (monmap changed)... 2024-09-21T03:46:27.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:26 smithi105 ceph-mon[34773]: Reconfiguring daemon mon.c on smithi162 2024-09-21T03:46:27.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:26 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3304488145' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T03:46:27.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:26 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:27.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:26 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:27.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:26 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:46:27.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:26 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:27.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:26 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:46:27.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:26 smithi105 ceph-mon[34773]: from='mgr.14152 172.21.15.46:0/1826473578' entity='mgr.x' 2024-09-21T03:46:27.282 INFO:tasks.cephadm:Adding mgr.x on smithi046 2024-09-21T03:46:27.282 INFO:tasks.cephadm:Adding mgr.y on smithi105 2024-09-21T03:46:27.282 INFO:tasks.cephadm:Adding mgr.z on smithi162 2024-09-21T03:46:27.283 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph orch apply mgr '3;smithi046=x;smithi105=y;smithi162=z' 2024-09-21T03:46:27.524 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:46:27.928 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:27 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3304488145' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T03:46:27.928 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:27 smithi162 ceph-mon[35071]: mgrmap e14: x(active, since 55s) 2024-09-21T03:46:28.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:27 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3304488145' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T03:46:28.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:27 smithi046 ceph-mon[30954]: mgrmap e14: x(active, since 55s) 2024-09-21T03:46:28.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:27 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3304488145' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T03:46:28.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:27 smithi105 ceph-mon[34773]: mgrmap e14: x(active, since 55s) 2024-09-21T03:46:32.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:31 smithi046 ceph-mon[30954]: Active manager daemon x restarted 2024-09-21T03:46:32.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:31 smithi046 ceph-mon[30954]: Activating manager daemon x 2024-09-21T03:46:32.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:31 smithi046 ceph-mon[30954]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T03:46:32.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:31 smithi046 ceph-mon[30954]: mgrmap e15: x(active, starting, since 0.00502997s) 2024-09-21T03:46:32.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:31 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:46:32.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:31 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:46:32.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:31 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:46:32.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:31 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T03:46:32.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:31 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T03:46:32.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:31 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T03:46:32.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:31 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T03:46:32.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:31 smithi046 ceph-mon[30954]: Manager daemon x is now available 2024-09-21T03:46:32.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:31 smithi105 ceph-mon[34773]: Active manager daemon x restarted 2024-09-21T03:46:32.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:31 smithi105 ceph-mon[34773]: Activating manager daemon x 2024-09-21T03:46:32.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:31 smithi105 ceph-mon[34773]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T03:46:32.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:31 smithi105 ceph-mon[34773]: mgrmap e15: x(active, starting, since 0.00502997s) 2024-09-21T03:46:32.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:31 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:46:32.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:31 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:46:32.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:31 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:46:32.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:31 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T03:46:32.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:31 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T03:46:32.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:31 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T03:46:32.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:31 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T03:46:32.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:31 smithi105 ceph-mon[34773]: Manager daemon x is now available 2024-09-21T03:46:32.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:31 smithi162 ceph-mon[35071]: Active manager daemon x restarted 2024-09-21T03:46:32.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:31 smithi162 ceph-mon[35071]: Activating manager daemon x 2024-09-21T03:46:32.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:31 smithi162 ceph-mon[35071]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T03:46:32.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:31 smithi162 ceph-mon[35071]: mgrmap e15: x(active, starting, since 0.00502997s) 2024-09-21T03:46:32.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:31 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:46:32.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:31 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:46:32.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:31 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:46:32.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:31 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T03:46:32.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:31 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T03:46:32.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:31 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T03:46:32.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:31 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T03:46:32.377 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:31 smithi162 ceph-mon[35071]: Manager daemon x is now available 2024-09-21T03:46:33.004 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled mgr update... 2024-09-21T03:46:33.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:32 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:46:33.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:32 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T03:46:33.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:32 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T03:46:33.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:32 smithi046 ceph-mon[30954]: mgrmap e16: x(active, since 1.01023s) 2024-09-21T03:46:33.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:32 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:33.314 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:32 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:46:33.314 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:32 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T03:46:33.314 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:32 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T03:46:33.314 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:32 smithi162 ceph-mon[35071]: mgrmap e16: x(active, since 1.01023s) 2024-09-21T03:46:33.315 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:32 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:33.317 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:32 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:46:33.317 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:32 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T03:46:33.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:32 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T03:46:33.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:32 smithi105 ceph-mon[34773]: mgrmap e16: x(active, since 1.01023s) 2024-09-21T03:46:33.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:32 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:33.625 DEBUG:teuthology.orchestra.run.smithi105:mgr.y> sudo journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mgr.y.service 2024-09-21T03:46:33.628 DEBUG:teuthology.orchestra.run.smithi162:mgr.z> sudo journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mgr.z.service 2024-09-21T03:46:33.630 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-21T03:46:33.630 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph config set client client_mount_timeout 600 2024-09-21T03:46:33.632 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-21T03:46:33.632 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph config set client debug_client 20 2024-09-21T03:46:33.675 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-21T03:46:33.675 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph config set client debug_ms 1 2024-09-21T03:46:33.718 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-21T03:46:33.718 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph config set client rados_mon_op_timeout 900 2024-09-21T03:46:33.761 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-21T03:46:33.761 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph config set client rados_osd_op_timeout 900 2024-09-21T03:46:33.805 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-21T03:46:33.805 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds 20 2024-09-21T03:46:33.848 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-21T03:46:33.848 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds_balancer 20 2024-09-21T03:46:33.907 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-21T03:46:33.907 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph config set mds debug_ms 2 2024-09-21T03:46:33.958 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-21T03:46:33.958 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-21T03:46:34.008 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-21T03:46:34.009 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_merge_size 5 2024-09-21T03:46:34.009 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:34.056 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-21T03:46:34.056 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_bits 3 2024-09-21T03:46:34.099 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-21T03:46:34.099 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_size 100 2024-09-21T03:46:34.142 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-21T03:46:34.143 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_frag True 2024-09-21T03:46:34.196 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-21T03:46:34.196 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_scatterstat True 2024-09-21T03:46:34.247 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-21T03:46:34.247 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph config set mds mds_op_complaint_time 180 2024-09-21T03:46:34.299 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-21T03:46:34.299 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph config set mds mds_verify_scatter True 2024-09-21T03:46:34.352 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-21T03:46:34.352 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph config set mds osd_op_complaint_time 180 2024-09-21T03:46:34.397 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T03:46:34.397 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph config set mds rados_mon_op_timeout 900 2024-09-21T03:46:34.442 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T03:46:34.442 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph config set mds rados_osd_op_timeout 900 2024-09-21T03:46:34.444 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:46:34 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: 2024-09-21T03:46:34.333+0000 7f5007850640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:03:46:34] ENGINE Error in HTTPServer.serve 2024-09-21T03:46:34.444 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:46:34 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: Traceback (most recent call last): 2024-09-21T03:46:34.444 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:46:34 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T03:46:34.444 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:46:34 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: self._connections.run(self.expiration_interval) 2024-09-21T03:46:34.444 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:46:34 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T03:46:34.444 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:46:34 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: self._run(expiration_interval) 2024-09-21T03:46:34.444 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:46:34 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T03:46:34.444 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:46:34 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T03:46:34.445 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:46:34 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T03:46:34.445 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:46:34 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T03:46:34.445 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:46:34 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T03:46:34.445 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:46:34 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: s = self.context.wrap_socket( 2024-09-21T03:46:34.445 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:46:34 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T03:46:34.445 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:46:34 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: return self.sslsocket_class._create( 2024-09-21T03:46:34.445 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:46:34 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T03:46:34.445 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:46:34 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: self.do_handshake() 2024-09-21T03:46:34.445 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:46:34 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T03:46:34.445 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:46:34 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: self._sslobj.do_handshake() 2024-09-21T03:46:34.445 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:46:34 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T03:46:34.445 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:46:34 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: 2024-09-21T03:46:34.448 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2024-09-21T03:46:34.448 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph config set mgr client_mount_timeout 30 2024-09-21T03:46:34.497 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2024-09-21T03:46:34.497 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph config set mgr debug_cephsqlite 20 2024-09-21T03:46:34.544 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2024-09-21T03:46:34.544 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph config set mgr debug_client 20 2024-09-21T03:46:34.609 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2024-09-21T03:46:34.610 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph config set mgr debug_mgr 20 2024-09-21T03:46:34.673 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2024-09-21T03:46:34.673 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph config set mgr debug_ms 1 2024-09-21T03:46:34.747 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2024-09-21T03:46:34.748 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-09-21T03:46:34.784 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:34.808 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2024-09-21T03:46:34.808 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2024-09-21T03:46:34.893 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/log_level = debug 2024-09-21T03:46:34.893 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/snap_schedule/log_level debug 2024-09-21T03:46:34.952 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T03:46:34.952 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T03:46:35.004 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-21T03:46:35.004 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph config set mon mon_op_complaint_time 120 2024-09-21T03:46:35.005 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:34 smithi046 ceph-mon[30954]: Saving service mgr spec with placement smithi046=x;smithi105=y;smithi162=z;count:3 2024-09-21T03:46:35.005 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:34 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:35.005 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:34 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:35.005 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:34 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:35.005 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:34 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:35.005 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:34 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:35.005 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:34 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:35.005 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:34 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:35.005 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:34 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:35.005 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:34 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi105", "name": "osd_memory_target"} : dispatch 2024-09-21T03:46:35.064 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-21T03:46:35.064 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph config set osd osd_op_complaint_time 180 2024-09-21T03:46:35.065 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:35.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:34 smithi105 ceph-mon[34773]: Saving service mgr spec with placement smithi046=x;smithi105=y;smithi162=z;count:3 2024-09-21T03:46:35.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:34 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:35.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:34 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:35.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:34 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:35.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:34 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:35.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:34 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:35.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:34 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:35.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:34 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:35.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:34 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:35.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:34 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi105", "name": "osd_memory_target"} : dispatch 2024-09-21T03:46:35.069 DEBUG:tasks.cephadm:set 30 configs 2024-09-21T03:46:35.069 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a82de5ec-77cb-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi046') 2024-09-21T03:46:35.111 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:35.111 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:35.112 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:35.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:34 smithi162 ceph-mon[35071]: Saving service mgr spec with placement smithi046=x;smithi105=y;smithi162=z;count:3 2024-09-21T03:46:35.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:34 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:35.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:34 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:35.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:34 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:35.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:34 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:35.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:34 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:35.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:34 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:35.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:34 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:35.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:34 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:35.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:34 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi105", "name": "osd_memory_target"} : dispatch 2024-09-21T03:46:36.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:35 smithi046 ceph-mon[30954]: [21/Sep/2024:03:46:34] ENGINE Bus STARTING 2024-09-21T03:46:36.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:35 smithi046 ceph-mon[30954]: [21/Sep/2024:03:46:34] ENGINE Serving on http://172.21.15.46:8765 2024-09-21T03:46:36.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:35 smithi046 ceph-mon[30954]: [21/Sep/2024:03:46:34] ENGINE Serving on https://172.21.15.46:7150 2024-09-21T03:46:36.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:35 smithi046 ceph-mon[30954]: [21/Sep/2024:03:46:34] ENGINE Bus STARTED 2024-09-21T03:46:36.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:35 smithi046 ceph-mon[30954]: [21/Sep/2024:03:46:34] ENGINE Error in HTTPServer.serve 2024-09-21T03:46:36.001 INFO:journalctl@ceph.mon.a.smithi046.stdout: Traceback (most recent call last): 2024-09-21T03:46:36.001 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T03:46:36.001 INFO:journalctl@ceph.mon.a.smithi046.stdout: self._connections.run(self.expiration_interval) 2024-09-21T03:46:36.002 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T03:46:36.002 INFO:journalctl@ceph.mon.a.smithi046.stdout: self._run(expiration_interval) 2024-09-21T03:46:36.002 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T03:46:36.002 INFO:journalctl@ceph.mon.a.smithi046.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T03:46:36.002 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T03:46:36.002 INFO:journalctl@ceph.mon.a.smithi046.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T03:46:36.002 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T03:46:36.002 INFO:journalctl@ceph.mon.a.smithi046.stdout: s = self.context.wrap_socket( 2024-09-21T03:46:36.002 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T03:46:36.003 INFO:journalctl@ceph.mon.a.smithi046.stdout: return self.sslsocket_class._create( 2024-09-21T03:46:36.003 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T03:46:36.003 INFO:journalctl@ceph.mon.a.smithi046.stdout: self.do_handshake() 2024-09-21T03:46:36.003 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T03:46:36.003 INFO:journalctl@ceph.mon.a.smithi046.stdout: self._sslobj.do_handshake() 2024-09-21T03:46:36.003 INFO:journalctl@ceph.mon.a.smithi046.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T03:46:36.003 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:35 smithi046 ceph-mon[30954]: mgrmap e17: x(active, since 2s) 2024-09-21T03:46:36.003 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:35 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:36.003 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:35 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:36.003 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:35 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi162", "name": "osd_memory_target"} : dispatch 2024-09-21T03:46:36.003 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:35 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/1457021423' entity='client.admin' 2024-09-21T03:46:36.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:35 smithi105 ceph-mon[34773]: [21/Sep/2024:03:46:34] ENGINE Bus STARTING 2024-09-21T03:46:36.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:35 smithi105 ceph-mon[34773]: [21/Sep/2024:03:46:34] ENGINE Serving on http://172.21.15.46:8765 2024-09-21T03:46:36.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:35 smithi105 ceph-mon[34773]: [21/Sep/2024:03:46:34] ENGINE Serving on https://172.21.15.46:7150 2024-09-21T03:46:36.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:35 smithi105 ceph-mon[34773]: [21/Sep/2024:03:46:34] ENGINE Bus STARTED 2024-09-21T03:46:36.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:35 smithi105 ceph-mon[34773]: [21/Sep/2024:03:46:34] ENGINE Error in HTTPServer.serve 2024-09-21T03:46:36.068 INFO:journalctl@ceph.mon.b.smithi105.stdout: Traceback (most recent call last): 2024-09-21T03:46:36.069 INFO:journalctl@ceph.mon.b.smithi105.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T03:46:36.069 INFO:journalctl@ceph.mon.b.smithi105.stdout: self._connections.run(self.expiration_interval) 2024-09-21T03:46:36.069 INFO:journalctl@ceph.mon.b.smithi105.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T03:46:36.069 INFO:journalctl@ceph.mon.b.smithi105.stdout: self._run(expiration_interval) 2024-09-21T03:46:36.069 INFO:journalctl@ceph.mon.b.smithi105.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T03:46:36.069 INFO:journalctl@ceph.mon.b.smithi105.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T03:46:36.069 INFO:journalctl@ceph.mon.b.smithi105.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T03:46:36.069 INFO:journalctl@ceph.mon.b.smithi105.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T03:46:36.069 INFO:journalctl@ceph.mon.b.smithi105.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T03:46:36.069 INFO:journalctl@ceph.mon.b.smithi105.stdout: s = self.context.wrap_socket( 2024-09-21T03:46:36.069 INFO:journalctl@ceph.mon.b.smithi105.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T03:46:36.069 INFO:journalctl@ceph.mon.b.smithi105.stdout: return self.sslsocket_class._create( 2024-09-21T03:46:36.069 INFO:journalctl@ceph.mon.b.smithi105.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T03:46:36.069 INFO:journalctl@ceph.mon.b.smithi105.stdout: self.do_handshake() 2024-09-21T03:46:36.070 INFO:journalctl@ceph.mon.b.smithi105.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T03:46:36.070 INFO:journalctl@ceph.mon.b.smithi105.stdout: self._sslobj.do_handshake() 2024-09-21T03:46:36.070 INFO:journalctl@ceph.mon.b.smithi105.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T03:46:36.070 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:35 smithi105 ceph-mon[34773]: mgrmap e17: x(active, since 2s) 2024-09-21T03:46:36.070 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:35 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:36.070 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:35 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:36.070 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:35 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi162", "name": "osd_memory_target"} : dispatch 2024-09-21T03:46:36.070 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:35 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/1457021423' entity='client.admin' 2024-09-21T03:46:36.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:35 smithi162 ceph-mon[35071]: [21/Sep/2024:03:46:34] ENGINE Bus STARTING 2024-09-21T03:46:36.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:35 smithi162 ceph-mon[35071]: [21/Sep/2024:03:46:34] ENGINE Serving on http://172.21.15.46:8765 2024-09-21T03:46:36.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:35 smithi162 ceph-mon[35071]: [21/Sep/2024:03:46:34] ENGINE Serving on https://172.21.15.46:7150 2024-09-21T03:46:36.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:35 smithi162 ceph-mon[35071]: [21/Sep/2024:03:46:34] ENGINE Bus STARTED 2024-09-21T03:46:36.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:35 smithi162 ceph-mon[35071]: [21/Sep/2024:03:46:34] ENGINE Error in HTTPServer.serve 2024-09-21T03:46:36.126 INFO:journalctl@ceph.mon.c.smithi162.stdout: Traceback (most recent call last): 2024-09-21T03:46:36.126 INFO:journalctl@ceph.mon.c.smithi162.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T03:46:36.126 INFO:journalctl@ceph.mon.c.smithi162.stdout: self._connections.run(self.expiration_interval) 2024-09-21T03:46:36.126 INFO:journalctl@ceph.mon.c.smithi162.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T03:46:36.126 INFO:journalctl@ceph.mon.c.smithi162.stdout: self._run(expiration_interval) 2024-09-21T03:46:36.126 INFO:journalctl@ceph.mon.c.smithi162.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T03:46:36.127 INFO:journalctl@ceph.mon.c.smithi162.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T03:46:36.127 INFO:journalctl@ceph.mon.c.smithi162.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T03:46:36.127 INFO:journalctl@ceph.mon.c.smithi162.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T03:46:36.127 INFO:journalctl@ceph.mon.c.smithi162.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T03:46:36.127 INFO:journalctl@ceph.mon.c.smithi162.stdout: s = self.context.wrap_socket( 2024-09-21T03:46:36.127 INFO:journalctl@ceph.mon.c.smithi162.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T03:46:36.127 INFO:journalctl@ceph.mon.c.smithi162.stdout: return self.sslsocket_class._create( 2024-09-21T03:46:36.127 INFO:journalctl@ceph.mon.c.smithi162.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T03:46:36.127 INFO:journalctl@ceph.mon.c.smithi162.stdout: self.do_handshake() 2024-09-21T03:46:36.127 INFO:journalctl@ceph.mon.c.smithi162.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T03:46:36.127 INFO:journalctl@ceph.mon.c.smithi162.stdout: self._sslobj.do_handshake() 2024-09-21T03:46:36.127 INFO:journalctl@ceph.mon.c.smithi162.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T03:46:36.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:35 smithi162 ceph-mon[35071]: mgrmap e17: x(active, since 2s) 2024-09-21T03:46:36.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:35 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:36.128 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:35 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:36.128 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:35 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi162", "name": "osd_memory_target"} : dispatch 2024-09-21T03:46:36.128 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:35 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/1457021423' entity='client.admin' 2024-09-21T03:46:37.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:37 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/366586809' entity='client.admin' 2024-09-21T03:46:37.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:37 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/1808292739' entity='client.admin' 2024-09-21T03:46:37.432 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:37 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/366586809' entity='client.admin' 2024-09-21T03:46:37.432 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:37 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/1808292739' entity='client.admin' 2024-09-21T03:46:37.567 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:37 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/366586809' entity='client.admin' 2024-09-21T03:46:37.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:37 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/1808292739' entity='client.admin' 2024-09-21T03:46:37.584 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a82de5ec-77cb-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi046') 2024-09-21T03:46:38.334 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:38 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/2368541872' entity='client.admin' 2024-09-21T03:46:38.334 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:38 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:38.334 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:38 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:38.334 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:38 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi046", "name": "osd_memory_target"} : dispatch 2024-09-21T03:46:38.334 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:38 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:38.334 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:38 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:46:38.334 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:38 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/1271825824' entity='client.admin' 2024-09-21T03:46:38.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:38 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/2368541872' entity='client.admin' 2024-09-21T03:46:38.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:38 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:38.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:38 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:38.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:38 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi046", "name": "osd_memory_target"} : dispatch 2024-09-21T03:46:38.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:38 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:38.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:38 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:46:38.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:38 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/1271825824' entity='client.admin' 2024-09-21T03:46:38.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:38 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/2368541872' entity='client.admin' 2024-09-21T03:46:38.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:38 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:38.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:38 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:38.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:38 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi046", "name": "osd_memory_target"} : dispatch 2024-09-21T03:46:38.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:38 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:38.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:38 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:46:38.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:38 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/1271825824' entity='client.admin' 2024-09-21T03:46:39.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:39 smithi046 ceph-mon[30954]: Updating smithi046:/etc/ceph/ceph.conf 2024-09-21T03:46:39.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:39 smithi046 ceph-mon[30954]: Updating smithi105:/etc/ceph/ceph.conf 2024-09-21T03:46:39.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:39 smithi046 ceph-mon[30954]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-21T03:46:39.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:39 smithi046 ceph-mon[30954]: Updating smithi046:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:46:39.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:39 smithi046 ceph-mon[30954]: Updating smithi105:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:46:39.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:39 smithi046 ceph-mon[30954]: Updating smithi162:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:46:39.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:39 smithi046 ceph-mon[30954]: Updating smithi046:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:46:39.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:39 smithi046 ceph-mon[30954]: Updating smithi105:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:46:39.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:39 smithi046 ceph-mon[30954]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:46:39.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:39 smithi046 ceph-mon[30954]: Updating smithi046:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:46:39.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:39 smithi046 ceph-mon[30954]: Updating smithi162:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:46:39.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:39 smithi046 ceph-mon[30954]: Updating smithi105:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:46:39.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:39 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:39.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:39 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:39.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:39 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:39.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:39 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:39.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:39 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:39.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:39 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:39.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:39 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:39.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:39 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:46:39.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:39 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T03:46:39.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:39 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:46:39.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:39 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:39.754 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:39 smithi046 ceph-mon[30954]: Deploying daemon mgr.z on smithi162 2024-09-21T03:46:39.754 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:39 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/603193009' entity='client.admin' 2024-09-21T03:46:39.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:39 smithi162 ceph-mon[35071]: Updating smithi046:/etc/ceph/ceph.conf 2024-09-21T03:46:39.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:39 smithi162 ceph-mon[35071]: Updating smithi105:/etc/ceph/ceph.conf 2024-09-21T03:46:39.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:39 smithi162 ceph-mon[35071]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-21T03:46:39.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:39 smithi162 ceph-mon[35071]: Updating smithi046:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:46:39.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:39 smithi162 ceph-mon[35071]: Updating smithi105:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:46:39.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:39 smithi162 ceph-mon[35071]: Updating smithi162:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:46:39.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:39 smithi162 ceph-mon[35071]: Updating smithi046:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:46:39.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:39 smithi162 ceph-mon[35071]: Updating smithi105:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:46:39.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:39 smithi162 ceph-mon[35071]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:46:39.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:39 smithi162 ceph-mon[35071]: Updating smithi046:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:46:39.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:39 smithi162 ceph-mon[35071]: Updating smithi162:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:46:39.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:39 smithi162 ceph-mon[35071]: Updating smithi105:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:46:39.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:39 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:39.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:39 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:39.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:39 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:39.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:39 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:39.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:39 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:39.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:39 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:39.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:39 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:39.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:39 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:46:39.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:39 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T03:46:39.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:39 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:46:39.878 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:39 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:39.878 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:39 smithi162 ceph-mon[35071]: Deploying daemon mgr.z on smithi162 2024-09-21T03:46:39.878 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:39 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/603193009' entity='client.admin' 2024-09-21T03:46:40.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:39 smithi105 ceph-mon[34773]: Updating smithi046:/etc/ceph/ceph.conf 2024-09-21T03:46:40.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:39 smithi105 ceph-mon[34773]: Updating smithi105:/etc/ceph/ceph.conf 2024-09-21T03:46:40.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:39 smithi105 ceph-mon[34773]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-21T03:46:40.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:39 smithi105 ceph-mon[34773]: Updating smithi046:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:46:40.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:39 smithi105 ceph-mon[34773]: Updating smithi105:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:46:40.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:39 smithi105 ceph-mon[34773]: Updating smithi162:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:46:40.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:39 smithi105 ceph-mon[34773]: Updating smithi046:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:46:40.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:39 smithi105 ceph-mon[34773]: Updating smithi105:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:46:40.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:39 smithi105 ceph-mon[34773]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:46:40.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:39 smithi105 ceph-mon[34773]: Updating smithi046:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:46:40.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:39 smithi105 ceph-mon[34773]: Updating smithi162:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:46:40.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:39 smithi105 ceph-mon[34773]: Updating smithi105:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:46:40.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:39 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:40.070 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:39 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:40.070 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:39 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:40.070 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:39 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:40.070 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:39 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:40.070 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:39 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:40.070 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:39 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:40.070 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:39 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:46:40.070 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:39 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T03:46:40.070 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:39 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:46:40.070 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:39 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:40.070 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:39 smithi105 ceph-mon[34773]: Deploying daemon mgr.z on smithi162 2024-09-21T03:46:40.071 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:39 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/603193009' entity='client.admin' 2024-09-21T03:46:40.530 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 21 03:46:40 smithi162 systemd[1]: Starting Ceph mgr.z for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T03:46:40.672 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:40.672 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:40.783 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 21 03:46:40 smithi162 podman[37028]: 2024-09-21 03:46:40.430746357 +0000 UTC m=+0.015646446 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:46:40.783 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 21 03:46:40 smithi162 podman[37028]: 2024-09-21 03:46:40.54213793 +0000 UTC m=+0.127038013 container create 974d68a7ecd530cc59edada5895c92fea59eb7efb1c06b658db692a2ab1c1e86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:46:40.783 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 21 03:46:40 smithi162 podman[37028]: 2024-09-21 03:46:40.744375472 +0000 UTC m=+0.329275566 container init 974d68a7ecd530cc59edada5895c92fea59eb7efb1c06b658db692a2ab1c1e86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-z, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:46:40.783 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 21 03:46:40 smithi162 podman[37028]: 2024-09-21 03:46:40.747286056 +0000 UTC m=+0.332186136 container start 974d68a7ecd530cc59edada5895c92fea59eb7efb1c06b658db692a2ab1c1e86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-z, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:46:41.073 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a82de5ec-77cb-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi046') 2024-09-21T03:46:41.113 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:41.113 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:41.120 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:41.125 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 21 03:46:40 smithi162 ceph-mgr[37048]: -- 172.21.15.162:0/4290556140 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559860b9d0e0 con 0x559865940480 2024-09-21T03:46:41.125 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 21 03:46:40 smithi162 bash[37028]: 974d68a7ecd530cc59edada5895c92fea59eb7efb1c06b658db692a2ab1c1e86 2024-09-21T03:46:41.125 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 21 03:46:40 smithi162 systemd[1]: Started Ceph mgr.z for a82de5ec-77cb-11ef-baf5-efdc52797490. 2024-09-21T03:46:41.128 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:41.128 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:41.130 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:42.169 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:41 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:42.170 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:41 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:42.170 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:41 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:42.170 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:41 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:46:42.170 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:41 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T03:46:42.170 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:41 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:46:42.170 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:41 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:42.170 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:41 smithi046 ceph-mon[30954]: Deploying daemon mgr.y on smithi105 2024-09-21T03:46:42.175 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:41 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:42.175 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:41 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:42.175 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:41 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:42.175 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:41 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:46:42.175 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:41 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T03:46:42.175 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:41 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:46:42.175 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:41 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:42.175 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:41 smithi105 ceph-mon[34773]: Deploying daemon mgr.y on smithi105 2024-09-21T03:46:42.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:41 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:42.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:41 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:42.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:41 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:42.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:41 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:46:42.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:41 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T03:46:42.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:41 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:46:42.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:41 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:42.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:41 smithi162 ceph-mon[35071]: Deploying daemon mgr.y on smithi105 2024-09-21T03:46:42.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:42.396+0000 7fd4a8a50640 1 -- 172.21.15.46:0/2154634223 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fd48c03fb70 msgr2=0x7fd48c042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:42.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:42.396+0000 7fd4a8a50640 1 --2- 172.21.15.46:0/2154634223 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fd48c03fb70 0x7fd48c042080 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd494000c00 tx=0x7fd494005d50 comp rx=0 tx=0).stop 2024-09-21T03:46:42.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:42.396+0000 7fd4a8a50640 1 -- 172.21.15.46:0/2154634223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4a410de10 msgr2=0x7fd4a419fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:42.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:42.396+0000 7fd4a8a50640 1 --2- 172.21.15.46:0/2154634223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4a410de10 0x7fd4a419fc30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd49c00eb10 tx=0x7fd49c00c2d0 comp rx=0 tx=0).stop 2024-09-21T03:46:42.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:42.396+0000 7fd4a8a50640 1 -- 172.21.15.46:0/2154634223 shutdown_connections 2024-09-21T03:46:42.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:42.396+0000 7fd4a8a50640 1 --2- 172.21.15.46:0/2154634223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4a410de10 0x7fd4a419fc30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:42.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:42.396+0000 7fd4a8a50640 1 --2- 172.21.15.46:0/2154634223 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fd48c03fb70 0x7fd48c042080 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:42.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:42.396+0000 7fd4a8a50640 1 --2- 172.21.15.46:0/2154634223 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4a4105300 0x7fd4a419a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:42.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:42.396+0000 7fd4a8a50640 1 --2- 172.21.15.46:0/2154634223 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4a41049b0 0x7fd4a419a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:42.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:42.396+0000 7fd4a8a50640 1 -- 172.21.15.46:0/2154634223 >> 172.21.15.46:0/2154634223 conn(0x7fd4a4079730 msgr2=0x7fd4a4100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:42.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:42.396+0000 7fd4a8a50640 1 -- 172.21.15.46:0/2154634223 shutdown_connections 2024-09-21T03:46:42.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:42.396+0000 7fd4a8a50640 1 -- 172.21.15.46:0/2154634223 wait complete. 2024-09-21T03:46:42.818 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 21 03:46:42 smithi105 systemd[1]: Starting Ceph mgr.y for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T03:46:42.904 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a82de5ec-77cb-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi046') 2024-09-21T03:46:42.904 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a82de5ec-77cb-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi046') 2024-09-21T03:46:42.905 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a82de5ec-77cb-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi046') 2024-09-21T03:46:43.092 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 21 03:46:42 smithi105 podman[36291]: 2024-09-21 03:46:42.72102143 +0000 UTC m=+0.016357909 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:46:43.092 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 21 03:46:42 smithi105 podman[36291]: 2024-09-21 03:46:42.845725746 +0000 UTC m=+0.141062215 container create cd1ebcbf48aa29ec623d550838d39529a1d92c43108647c24ad091cfa7e95dc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-y, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:46:43.092 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 21 03:46:43 smithi105 podman[36291]: 2024-09-21 03:46:43.052962893 +0000 UTC m=+0.348299365 container init cd1ebcbf48aa29ec623d550838d39529a1d92c43108647c24ad091cfa7e95dc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-y, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T03:46:43.092 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 21 03:46:43 smithi105 podman[36291]: 2024-09-21 03:46:43.055890634 +0000 UTC m=+0.351227104 container start cd1ebcbf48aa29ec623d550838d39529a1d92c43108647c24ad091cfa7e95dc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-y, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T03:46:43.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:43 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/394670090' entity='client.admin' 2024-09-21T03:46:43.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:43 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/2154634223' entity='client.admin' 2024-09-21T03:46:43.285 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a82de5ec-77cb-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi046') 2024-09-21T03:46:43.286 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a82de5ec-77cb-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi046') 2024-09-21T03:46:43.414 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:43 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/394670090' entity='client.admin' 2024-09-21T03:46:43.414 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:43 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/2154634223' entity='client.admin' 2024-09-21T03:46:43.415 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 21 03:46:43 smithi105 ceph-mgr[36310]: -- 172.21.15.105:0/1379553383 <== mon.2 v2:172.21.15.105:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c448c310e0 con 0x55c44d9d4480 2024-09-21T03:46:43.415 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 21 03:46:43 smithi105 bash[36291]: cd1ebcbf48aa29ec623d550838d39529a1d92c43108647c24ad091cfa7e95dc6 2024-09-21T03:46:43.415 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 21 03:46:43 smithi105 systemd[1]: Started Ceph mgr.y for a82de5ec-77cb-11ef-baf5-efdc52797490. 2024-09-21T03:46:43.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:43 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/394670090' entity='client.admin' 2024-09-21T03:46:43.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:43 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/2154634223' entity='client.admin' 2024-09-21T03:46:44.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.017+0000 7f42f1dd2640 1 -- 172.21.15.46:0/3233257681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ec1094f0 msgr2=0x7f42ec109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:44.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.017+0000 7f42f1dd2640 1 --2- 172.21.15.46:0/3233257681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ec1094f0 0x7f42ec109900 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f42e0009900 tx=0x7f42e002a410 comp rx=0 tx=0).stop 2024-09-21T03:46:44.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.018+0000 7f42f1dd2640 1 -- 172.21.15.46:0/3233257681 shutdown_connections 2024-09-21T03:46:44.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.018+0000 7f42f1dd2640 1 --2- 172.21.15.46:0/3233257681 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42ec109e40 0x7f42ec110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:44.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.018+0000 7f42f1dd2640 1 --2- 172.21.15.46:0/3233257681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ec1094f0 0x7f42ec109900 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:44.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.018+0000 7f42f1dd2640 1 --2- 172.21.15.46:0/3233257681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42ec103bb0 0x7f42ec103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:44.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.018+0000 7f42f1dd2640 1 -- 172.21.15.46:0/3233257681 >> 172.21.15.46:0/3233257681 conn(0x7f42ec0ff600 msgr2=0x7f42ec101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:44.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.018+0000 7f42f1dd2640 1 -- 172.21.15.46:0/3233257681 shutdown_connections 2024-09-21T03:46:44.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.018+0000 7f42f1dd2640 1 -- 172.21.15.46:0/3233257681 wait complete. 2024-09-21T03:46:44.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.018+0000 7f42f1dd2640 1 Processor -- start 2024-09-21T03:46:44.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.018+0000 7f42f1dd2640 1 -- start start 2024-09-21T03:46:44.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.019+0000 7f42f1dd2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42ec103bb0 0x7f42ec19a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:44.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.019+0000 7f42f1dd2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ec1094f0 0x7f42ec19ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:44.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.019+0000 7f42f1dd2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42ec109e40 0x7f42ec19fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:44.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.019+0000 7f42f1dd2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f42ec113b00 con 0x7f42ec1094f0 2024-09-21T03:46:44.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.019+0000 7f42f1dd2640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f42ec113980 con 0x7f42ec109e40 2024-09-21T03:46:44.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.019+0000 7f42f1dd2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f42ec113c80 con 0x7f42ec103bb0 2024-09-21T03:46:44.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.019+0000 7f42eaffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ec1094f0 0x7f42ec19ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:44.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.019+0000 7f42eaffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ec1094f0 0x7f42ec19ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51316/0 (socket says 172.21.15.46:51316) 2024-09-21T03:46:44.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.019+0000 7f42eaffd640 1 -- 172.21.15.46:0/3654771950 learned_addr learned my addr 172.21.15.46:0/3654771950 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:46:44.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.019+0000 7f42eb7fe640 1 --2- 172.21.15.46:0/3654771950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42ec103bb0 0x7f42ec19a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:44.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.019+0000 7f42ebfff640 1 --2- 172.21.15.46:0/3654771950 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42ec109e40 0x7f42ec19fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:44.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.019+0000 7f42eaffd640 1 -- 172.21.15.46:0/3654771950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42ec103bb0 msgr2=0x7f42ec19a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:44.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.019+0000 7f42eaffd640 1 --2- 172.21.15.46:0/3654771950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42ec103bb0 0x7f42ec19a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:44.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.019+0000 7f42eaffd640 1 -- 172.21.15.46:0/3654771950 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42ec109e40 msgr2=0x7f42ec19fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:44.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.019+0000 7f42eaffd640 1 --2- 172.21.15.46:0/3654771950 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42ec109e40 0x7f42ec19fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:44.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.019+0000 7f42eaffd640 1 -- 172.21.15.46:0/3654771950 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42ec1a0420 con 0x7f42ec1094f0 2024-09-21T03:46:44.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.019+0000 7f42eaffd640 1 --2- 172.21.15.46:0/3654771950 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ec1094f0 0x7f42ec19ab10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f42e0006010 tx=0x7f42e0004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:44.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.020+0000 7f42e8ff9640 1 -- 172.21.15.46:0/3654771950 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e003f030 con 0x7f42ec1094f0 2024-09-21T03:46:44.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.020+0000 7f42e8ff9640 1 -- 172.21.15.46:0/3654771950 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42e0003aa0 con 0x7f42ec1094f0 2024-09-21T03:46:44.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.020+0000 7f42f1dd2640 1 -- 172.21.15.46:0/3654771950 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42ec1a06b0 con 0x7f42ec1094f0 2024-09-21T03:46:44.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.020+0000 7f42e8ff9640 1 -- 172.21.15.46:0/3654771950 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e0035070 con 0x7f42ec1094f0 2024-09-21T03:46:44.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.020+0000 7f42f1dd2640 1 -- 172.21.15.46:0/3654771950 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42ec1a0be0 con 0x7f42ec1094f0 2024-09-21T03:46:44.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.021+0000 7f42f1dd2640 1 -- 172.21.15.46:0/3654771950 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42ec103fc0 con 0x7f42ec1094f0 2024-09-21T03:46:44.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.021+0000 7f42e8ff9640 1 -- 172.21.15.46:0/3654771950 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 51915+0+0 (secure 0 0 0) 0x7f42e0042030 con 0x7f42ec1094f0 2024-09-21T03:46:44.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.021+0000 7f42e8ff9640 1 --2- 172.21.15.46:0/3654771950 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f42d403fba0 0x7f42d40420b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:44.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.021+0000 7f42e8ff9640 1 -- 172.21.15.46:0/3654771950 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f42e0074b50 con 0x7f42ec1094f0 2024-09-21T03:46:44.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.021+0000 7f42eb7fe640 1 --2- 172.21.15.46:0/3654771950 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f42d403fba0 0x7f42d40420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:44.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.022+0000 7f42eb7fe640 1 --2- 172.21.15.46:0/3654771950 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f42d403fba0 0x7f42d40420b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009bd0 tx=0x7f42dc005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:44.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.027+0000 7f42e8ff9640 1 -- 172.21.15.46:0/3654771950 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f42ec1a0be0 con 0x7f42ec1094f0 2024-09-21T03:46:44.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.216+0000 7eff2c0cb640 1 -- 172.21.15.46:0/3821754848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff24109e40 msgr2=0x7eff24110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:44.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.216+0000 7eff2c0cb640 1 --2- 172.21.15.46:0/3821754848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff24109e40 0x7eff24110670 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7eff1c009ca0 tx=0x7eff1c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:46:44.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.216+0000 7eff2c0cb640 1 -- 172.21.15.46:0/3821754848 shutdown_connections 2024-09-21T03:46:44.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.216+0000 7eff2c0cb640 1 --2- 172.21.15.46:0/3821754848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff24109e40 0x7eff24110670 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:44.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.216+0000 7eff2c0cb640 1 --2- 172.21.15.46:0/3821754848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff241094f0 0x7eff24109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:44.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.216+0000 7eff2c0cb640 1 --2- 172.21.15.46:0/3821754848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff24103bb0 0x7eff24103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:44.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.216+0000 7eff2c0cb640 1 -- 172.21.15.46:0/3821754848 >> 172.21.15.46:0/3821754848 conn(0x7eff240ff600 msgr2=0x7eff24101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:44.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.216+0000 7eff2c0cb640 1 -- 172.21.15.46:0/3821754848 shutdown_connections 2024-09-21T03:46:44.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.216+0000 7eff2c0cb640 1 -- 172.21.15.46:0/3821754848 wait complete. 2024-09-21T03:46:44.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.216+0000 7f42f1dd2640 1 -- 172.21.15.46:0/3654771950 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f42ec19b6a0 con 0x7f42ec1094f0 2024-09-21T03:46:44.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.217+0000 7eff2c0cb640 1 Processor -- start 2024-09-21T03:46:44.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.217+0000 7eff2c0cb640 1 -- start start 2024-09-21T03:46:44.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.217+0000 7eff2c0cb640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff24103bb0 0x7eff2419a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:44.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.217+0000 7eff2c0cb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff241094f0 0x7eff2419a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:44.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.217+0000 7eff2c0cb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff24109e40 0x7eff2419fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:44.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.217+0000 7eff2c0cb640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7eff24113b50 con 0x7eff241094f0 2024-09-21T03:46:44.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.217+0000 7eff2c0cb640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7eff241139d0 con 0x7eff24109e40 2024-09-21T03:46:44.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.217+0000 7eff2c0cb640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7eff24113cd0 con 0x7eff24103bb0 2024-09-21T03:46:44.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.217+0000 7eff29666640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff241094f0 0x7eff2419a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:44.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.217+0000 7eff29666640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff241094f0 0x7eff2419a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51332/0 (socket says 172.21.15.46:51332) 2024-09-21T03:46:44.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.217+0000 7eff29666640 1 -- 172.21.15.46:0/4164809186 learned_addr learned my addr 172.21.15.46:0/4164809186 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:46:44.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.217+0000 7eff29e67640 1 --2- 172.21.15.46:0/4164809186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff24103bb0 0x7eff2419a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:44.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.217+0000 7eff2a668640 1 --2- 172.21.15.46:0/4164809186 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff24109e40 0x7eff2419fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:44.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.218+0000 7eff29666640 1 -- 172.21.15.46:0/4164809186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff24103bb0 msgr2=0x7eff2419a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:44.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.218+0000 7eff29666640 1 --2- 172.21.15.46:0/4164809186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff24103bb0 0x7eff2419a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:44.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.218+0000 7eff29666640 1 -- 172.21.15.46:0/4164809186 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff24109e40 msgr2=0x7eff2419fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:44.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.218+0000 7eff29666640 1 --2- 172.21.15.46:0/4164809186 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff24109e40 0x7eff2419fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:44.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.218+0000 7eff29666640 1 -- 172.21.15.46:0/4164809186 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff241a03b0 con 0x7eff241094f0 2024-09-21T03:46:44.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.218+0000 7eff29666640 1 --2- 172.21.15.46:0/4164809186 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff241094f0 0x7eff2419a9e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7eff1400e9f0 tx=0x7eff1400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:44.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.218+0000 7eff1affd640 1 -- 172.21.15.46:0/4164809186 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1400ccc0 con 0x7eff241094f0 2024-09-21T03:46:44.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.218+0000 7eff1affd640 1 -- 172.21.15.46:0/4164809186 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff140108e0 con 0x7eff241094f0 2024-09-21T03:46:44.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.218+0000 7eff2c0cb640 1 -- 172.21.15.46:0/4164809186 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff241a06a0 con 0x7eff241094f0 2024-09-21T03:46:44.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.218+0000 7eff1affd640 1 -- 172.21.15.46:0/4164809186 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff14018860 con 0x7eff241094f0 2024-09-21T03:46:44.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.218+0000 7eff2c0cb640 1 -- 172.21.15.46:0/4164809186 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff240755f0 con 0x7eff241094f0 2024-09-21T03:46:44.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.219+0000 7eff2c0cb640 1 -- 172.21.15.46:0/4164809186 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff24103fc0 con 0x7eff241094f0 2024-09-21T03:46:44.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.219+0000 7eff1affd640 1 -- 172.21.15.46:0/4164809186 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 51915+0+0 (secure 0 0 0) 0x7eff14018a00 con 0x7eff241094f0 2024-09-21T03:46:44.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.220+0000 7eff1affd640 1 --2- 172.21.15.46:0/4164809186 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7eff1003fb70 0x7eff10042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:44.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.220+0000 7eff29e67640 1 --2- 172.21.15.46:0/4164809186 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7eff1003fb70 0x7eff10042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:44.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.220+0000 7eff29e67640 1 --2- 172.21.15.46:0/4164809186 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7eff1003fb70 0x7eff10042080 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7eff20009bd0 tx=0x7eff20005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:44.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.221+0000 7f42e8ff9640 1 -- 172.21.15.46:0/3654771950 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v18)=0 v18) ==== 115+0+0 (secure 0 0 0) 0x7f42e00303a0 con 0x7f42ec1094f0 2024-09-21T03:46:44.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.223+0000 7eff1affd640 1 -- 172.21.15.46:0/4164809186 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7eff14010d70 con 0x7eff241094f0 2024-09-21T03:46:44.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.224+0000 7f42f1dd2640 1 -- 172.21.15.46:0/3654771950 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f42d403fba0 msgr2=0x7f42d40420b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:44.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.224+0000 7f42f1dd2640 1 --2- 172.21.15.46:0/3654771950 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f42d403fba0 0x7f42d40420b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009bd0 tx=0x7f42dc005f90 comp rx=0 tx=0).stop 2024-09-21T03:46:44.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.224+0000 7f42f1dd2640 1 -- 172.21.15.46:0/3654771950 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ec1094f0 msgr2=0x7f42ec19ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:44.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.224+0000 7f42f1dd2640 1 --2- 172.21.15.46:0/3654771950 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ec1094f0 0x7f42ec19ab10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f42e0006010 tx=0x7f42e0004060 comp rx=0 tx=0).stop 2024-09-21T03:46:44.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.224+0000 7f42f1dd2640 1 -- 172.21.15.46:0/3654771950 shutdown_connections 2024-09-21T03:46:44.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.224+0000 7f42f1dd2640 1 --2- 172.21.15.46:0/3654771950 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42ec109e40 0x7f42ec19fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:44.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.224+0000 7f42f1dd2640 1 --2- 172.21.15.46:0/3654771950 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ec1094f0 0x7f42ec19ab10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:44.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.224+0000 7f42f1dd2640 1 --2- 172.21.15.46:0/3654771950 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f42d403fba0 0x7f42d40420b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:44.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.224+0000 7f42f1dd2640 1 --2- 172.21.15.46:0/3654771950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42ec103bb0 0x7f42ec19a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:44.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.224+0000 7f42f1dd2640 1 -- 172.21.15.46:0/3654771950 >> 172.21.15.46:0/3654771950 conn(0x7f42ec0ff600 msgr2=0x7f42ec101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:44.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.224+0000 7f42f1dd2640 1 -- 172.21.15.46:0/3654771950 shutdown_connections 2024-09-21T03:46:44.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.224+0000 7f42f1dd2640 1 -- 172.21.15.46:0/3654771950 wait complete. 2024-09-21T03:46:44.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.231+0000 7eff1affd640 1 -- 172.21.15.46:0/4164809186 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7eff140071c0 con 0x7eff241094f0 2024-09-21T03:46:44.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.438+0000 7eff2c0cb640 1 -- 172.21.15.46:0/4164809186 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7eff2402e640 con 0x7eff241094f0 2024-09-21T03:46:44.442 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:44 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:44.442 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:44 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:44.442 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:44 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:44.442 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:44 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:44.443 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:44 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:46:44.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.443+0000 7eff1affd640 1 -- 172.21.15.46:0/4164809186 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v19)=0 v19) ==== 116+0+0 (secure 0 0 0) 0x7eff14022db0 con 0x7eff241094f0 2024-09-21T03:46:44.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.447+0000 7eff2c0cb640 1 -- 172.21.15.46:0/4164809186 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7eff1003fb70 msgr2=0x7eff10042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:44.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.447+0000 7eff2c0cb640 1 --2- 172.21.15.46:0/4164809186 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7eff1003fb70 0x7eff10042080 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7eff20009bd0 tx=0x7eff20005f90 comp rx=0 tx=0).stop 2024-09-21T03:46:44.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.447+0000 7eff2c0cb640 1 -- 172.21.15.46:0/4164809186 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff241094f0 msgr2=0x7eff2419a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:44.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.447+0000 7eff2c0cb640 1 --2- 172.21.15.46:0/4164809186 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff241094f0 0x7eff2419a9e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7eff1400e9f0 tx=0x7eff1400eeb0 comp rx=0 tx=0).stop 2024-09-21T03:46:44.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.448+0000 7eff2c0cb640 1 -- 172.21.15.46:0/4164809186 shutdown_connections 2024-09-21T03:46:44.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.448+0000 7eff2c0cb640 1 --2- 172.21.15.46:0/4164809186 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff24109e40 0x7eff2419fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:44.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.448+0000 7eff2c0cb640 1 --2- 172.21.15.46:0/4164809186 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff241094f0 0x7eff2419a9e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:44.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.448+0000 7eff2c0cb640 1 --2- 172.21.15.46:0/4164809186 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7eff1003fb70 0x7eff10042080 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:44.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.448+0000 7eff2c0cb640 1 --2- 172.21.15.46:0/4164809186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff24103bb0 0x7eff2419a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:44.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.448+0000 7eff2c0cb640 1 -- 172.21.15.46:0/4164809186 >> 172.21.15.46:0/4164809186 conn(0x7eff240ff600 msgr2=0x7eff24106a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:44.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.448+0000 7eff2c0cb640 1 -- 172.21.15.46:0/4164809186 shutdown_connections 2024-09-21T03:46:44.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:44.448+0000 7eff2c0cb640 1 -- 172.21.15.46:0/4164809186 wait complete. 2024-09-21T03:46:44.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:44 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:44.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:44 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:44.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:44 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:44.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:44 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:44.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:44 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:46:44.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:44 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:44.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:44 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:44.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:44 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:44.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:44 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:44.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:44 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:46:45.029 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:45.030 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:45.030 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:45.036 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:45.036 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:45.037 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:45.037 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:45.041 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:45.041 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:45.041 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:45.041 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:45.046 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:45.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.072+0000 7f84effff640 1 -- 172.21.15.46:0/2090690522 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84f0109fc0 msgr2=0x7f84f010a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:45.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.072+0000 7f84effff640 1 --2- 172.21.15.46:0/2090690522 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84f0109fc0 0x7f84f010a3d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009900 tx=0x7f84e002a440 comp rx=0 tx=0).stop 2024-09-21T03:46:45.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.072+0000 7f84effff640 1 -- 172.21.15.46:0/2090690522 shutdown_connections 2024-09-21T03:46:45.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.072+0000 7f84effff640 1 --2- 172.21.15.46:0/2090690522 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f0110250 0x7f84f0116a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:45.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.073+0000 7f84effff640 1 --2- 172.21.15.46:0/2090690522 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84f010f900 0x7f84f010fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:45.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.073+0000 7f84effff640 1 --2- 172.21.15.46:0/2090690522 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84f0109fc0 0x7f84f010a3d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:45.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.073+0000 7f84effff640 1 -- 172.21.15.46:0/2090690522 >> 172.21.15.46:0/2090690522 conn(0x7f84f00795c0 msgr2=0x7f84f01081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:45.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.073+0000 7f84effff640 1 -- 172.21.15.46:0/2090690522 shutdown_connections 2024-09-21T03:46:45.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.073+0000 7f84effff640 1 -- 172.21.15.46:0/2090690522 wait complete. 2024-09-21T03:46:45.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.075+0000 7f84effff640 1 Processor -- start 2024-09-21T03:46:45.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.075+0000 7f84effff640 1 -- start start 2024-09-21T03:46:45.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.076+0000 7f84effff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84f0109fc0 0x7f84f0074fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:45.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.076+0000 7f84effff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f010f900 0x7f84f006f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:45.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.076+0000 7f84effff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84f0110250 0x7f84f006f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:45.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.076+0000 7f84effff640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f84f006d6e0 con 0x7f84f0109fc0 2024-09-21T03:46:45.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.076+0000 7f84effff640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f84f006d560 con 0x7f84f0110250 2024-09-21T03:46:45.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.076+0000 7f84effff640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f84f006d860 con 0x7f84f010f900 2024-09-21T03:46:45.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.079+0000 7f84eeffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84f0109fc0 0x7f84f0074fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:45.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.079+0000 7f84ee7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f010f900 0x7f84f006f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:45.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.079+0000 7f84ef7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84f0110250 0x7f84f006f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:45.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.079+0000 7f84ee7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f010f900 0x7f84f006f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:37732/0 (socket says 172.21.15.46:37732) 2024-09-21T03:46:45.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.079+0000 7f84ee7fc640 1 -- 172.21.15.46:0/422356249 learned_addr learned my addr 172.21.15.46:0/422356249 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:46:45.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.080+0000 7f84eeffd640 1 -- 172.21.15.46:0/422356249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f010f900 msgr2=0x7f84f006f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:45.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.080+0000 7f84eeffd640 1 --2- 172.21.15.46:0/422356249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f010f900 0x7f84f006f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:45.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.080+0000 7f84eeffd640 1 -- 172.21.15.46:0/422356249 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84f0110250 msgr2=0x7f84f006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:45.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.080+0000 7f84eeffd640 1 --2- 172.21.15.46:0/422356249 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84f0110250 0x7f84f006f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:45.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.080+0000 7f84eeffd640 1 -- 172.21.15.46:0/422356249 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84f01b5490 con 0x7f84f0109fc0 2024-09-21T03:46:45.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.080+0000 7f84eeffd640 1 --2- 172.21.15.46:0/422356249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84f0109fc0 0x7f84f0074fa0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f84e002aa30 tx=0x7f84e0003d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:45.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.081+0000 7f84ef7fe640 1 --2- 172.21.15.46:0/422356249 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84f0110250 0x7f84f006f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:46:45.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.081+0000 7f84d7fff640 1 -- 172.21.15.46:0/422356249 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e003f070 con 0x7f84f0109fc0 2024-09-21T03:46:45.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.081+0000 7f84d7fff640 1 -- 172.21.15.46:0/422356249 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84e0031d60 con 0x7f84f0109fc0 2024-09-21T03:46:45.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.081+0000 7f84d7fff640 1 -- 172.21.15.46:0/422356249 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e0035030 con 0x7f84f0109fc0 2024-09-21T03:46:45.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.084+0000 7f84effff640 1 -- 172.21.15.46:0/422356249 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84f01b5660 con 0x7f84f0109fc0 2024-09-21T03:46:45.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.084+0000 7f84effff640 1 -- 172.21.15.46:0/422356249 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84f01b5b40 con 0x7f84f0109fc0 2024-09-21T03:46:45.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.086+0000 7f84effff640 1 -- 172.21.15.46:0/422356249 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84f010a450 con 0x7f84f0109fc0 2024-09-21T03:46:45.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.092+0000 7f84d7fff640 1 -- 172.21.15.46:0/422356249 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 51915+0+0 (secure 0 0 0) 0x7f84e0042070 con 0x7f84f0109fc0 2024-09-21T03:46:45.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.092+0000 7f84d7fff640 1 --2- 172.21.15.46:0/422356249 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f84d803fbc0 0x7f84d80420d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:45.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.093+0000 7f84d7fff640 1 -- 172.21.15.46:0/422356249 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f84e0074d20 con 0x7f84f0109fc0 2024-09-21T03:46:45.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.094+0000 7f84ee7fc640 1 --2- 172.21.15.46:0/422356249 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f84d803fbc0 0x7f84d80420d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:45.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.096+0000 7f84ee7fc640 1 --2- 172.21.15.46:0/422356249 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f84d803fbc0 0x7f84d80420d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f84e4006fd0 tx=0x7f84e4008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:45.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.096+0000 7f84d7fff640 1 -- 172.21.15.46:0/422356249 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f84e007a020 con 0x7f84f0109fc0 2024-09-21T03:46:45.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.296+0000 7f84effff640 1 -- 172.21.15.46:0/422356249 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f84f0070560 con 0x7f84f0109fc0 2024-09-21T03:46:45.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.300+0000 7f84d7fff640 1 -- 172.21.15.46:0/422356249 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v20)=0 v20) ==== 122+0+0 (secure 0 0 0) 0x7f84e0049020 con 0x7f84f0109fc0 2024-09-21T03:46:45.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.302+0000 7f84effff640 1 -- 172.21.15.46:0/422356249 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f84d803fbc0 msgr2=0x7f84d80420d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:45.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.302+0000 7f84effff640 1 --2- 172.21.15.46:0/422356249 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f84d803fbc0 0x7f84d80420d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f84e4006fd0 tx=0x7f84e4008040 comp rx=0 tx=0).stop 2024-09-21T03:46:45.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.302+0000 7f84effff640 1 -- 172.21.15.46:0/422356249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84f0109fc0 msgr2=0x7f84f0074fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:45.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.302+0000 7f84effff640 1 --2- 172.21.15.46:0/422356249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84f0109fc0 0x7f84f0074fa0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f84e002aa30 tx=0x7f84e0003d70 comp rx=0 tx=0).stop 2024-09-21T03:46:45.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.302+0000 7f84effff640 1 -- 172.21.15.46:0/422356249 shutdown_connections 2024-09-21T03:46:45.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.302+0000 7f84effff640 1 --2- 172.21.15.46:0/422356249 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84f0110250 0x7f84f006f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:45.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.302+0000 7f84effff640 1 --2- 172.21.15.46:0/422356249 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f84d803fbc0 0x7f84d80420d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:45.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.302+0000 7f84effff640 1 --2- 172.21.15.46:0/422356249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f010f900 0x7f84f006f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:45.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.302+0000 7f84effff640 1 --2- 172.21.15.46:0/422356249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84f0109fc0 0x7f84f0074fa0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:45.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.302+0000 7f84effff640 1 -- 172.21.15.46:0/422356249 >> 172.21.15.46:0/422356249 conn(0x7f84f00795c0 msgr2=0x7f84f0108610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:45.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.302+0000 7f84effff640 1 -- 172.21.15.46:0/422356249 shutdown_connections 2024-09-21T03:46:45.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:45.302+0000 7f84effff640 1 -- 172.21.15.46:0/422356249 wait complete. 2024-09-21T03:46:45.353 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:45 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3654771950' entity='client.admin' 2024-09-21T03:46:45.353 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:45 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:45.353 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:45 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:45.353 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:45 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:45.353 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:45 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:45.353 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:45 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:45.353 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:45 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:46:45.353 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:45 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:45.353 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:45 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/4164809186' entity='client.admin' 2024-09-21T03:46:45.353 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:45 smithi046 ceph-mon[30954]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T03:46:45.353 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:45 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:46:45.354 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:45 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:46:45.354 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:45 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:45.354 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:45 smithi046 ceph-mon[30954]: Reconfiguring daemon mgr.x on smithi046 2024-09-21T03:46:45.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:45 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3654771950' entity='client.admin' 2024-09-21T03:46:45.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:45 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:45.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:45 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:45.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:45 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:45.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:45 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:45.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:45 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:45.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:45 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:46:45.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:45 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:45.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:45 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/4164809186' entity='client.admin' 2024-09-21T03:46:45.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:45 smithi105 ceph-mon[34773]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T03:46:45.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:45 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:46:45.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:45 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:46:45.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:45 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:45.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:45 smithi105 ceph-mon[34773]: Reconfiguring daemon mgr.x on smithi046 2024-09-21T03:46:45.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:45 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3654771950' entity='client.admin' 2024-09-21T03:46:45.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:45 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:45.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:45 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:45.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:45 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:45.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:45 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:45.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:45 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:45.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:45 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:46:45.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:45 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:45.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:45 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/4164809186' entity='client.admin' 2024-09-21T03:46:45.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:45 smithi162 ceph-mon[35071]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T03:46:45.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:45 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:46:45.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:45 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:46:45.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:45 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:45.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:45 smithi162 ceph-mon[35071]: Reconfiguring daemon mgr.x on smithi046 2024-09-21T03:46:46.562 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:46 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/422356249' entity='client.admin' 2024-09-21T03:46:46.562 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:46 smithi046 ceph-mon[30954]: Standby manager daemon z started 2024-09-21T03:46:46.562 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:46 smithi046 ceph-mon[30954]: from='mgr.? 172.21.15.162:0/2730183664' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T03:46:46.562 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:46 smithi046 ceph-mon[30954]: from='mgr.? 172.21.15.162:0/2730183664' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T03:46:46.562 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:46 smithi046 ceph-mon[30954]: from='mgr.? 172.21.15.162:0/2730183664' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T03:46:46.563 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:46 smithi046 ceph-mon[30954]: from='mgr.? 172.21.15.162:0/2730183664' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T03:46:46.567 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:46 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/422356249' entity='client.admin' 2024-09-21T03:46:46.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:46 smithi105 ceph-mon[34773]: Standby manager daemon z started 2024-09-21T03:46:46.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:46 smithi105 ceph-mon[34773]: from='mgr.? 172.21.15.162:0/2730183664' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T03:46:46.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:46 smithi105 ceph-mon[34773]: from='mgr.? 172.21.15.162:0/2730183664' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T03:46:46.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:46 smithi105 ceph-mon[34773]: from='mgr.? 172.21.15.162:0/2730183664' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T03:46:46.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:46 smithi105 ceph-mon[34773]: from='mgr.? 172.21.15.162:0/2730183664' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T03:46:46.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:46 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/422356249' entity='client.admin' 2024-09-21T03:46:46.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:46 smithi162 ceph-mon[35071]: Standby manager daemon z started 2024-09-21T03:46:46.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:46 smithi162 ceph-mon[35071]: from='mgr.? 172.21.15.162:0/2730183664' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T03:46:46.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:46 smithi162 ceph-mon[35071]: from='mgr.? 172.21.15.162:0/2730183664' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T03:46:46.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:46 smithi162 ceph-mon[35071]: from='mgr.? 172.21.15.162:0/2730183664' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T03:46:46.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:46 smithi162 ceph-mon[35071]: from='mgr.? 172.21.15.162:0/2730183664' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T03:46:46.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.823+0000 7f718b757640 1 -- 172.21.15.46:0/2527616736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7184110200 msgr2=0x7f7184112620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:46.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.823+0000 7f718b757640 1 --2- 172.21.15.46:0/2527616736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7184110200 0x7f7184112620 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f717c009900 tx=0x7f717c02a480 comp rx=0 tx=0).stop 2024-09-21T03:46:46.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.823+0000 7f718b757640 1 -- 172.21.15.46:0/2527616736 shutdown_connections 2024-09-21T03:46:46.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.823+0000 7f718b757640 1 --2- 172.21.15.46:0/2527616736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7184110200 0x7f7184112620 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:46.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.823+0000 7f718b757640 1 --2- 172.21.15.46:0/2527616736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7184102fa0 0x7f718410fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:46.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.823+0000 7f718b757640 1 --2- 172.21.15.46:0/2527616736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7184102650 0x7f7184102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:46.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.823+0000 7f718b757640 1 -- 172.21.15.46:0/2527616736 >> 172.21.15.46:0/2527616736 conn(0x7f7184079760 msgr2=0x7f7184079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:46.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.823+0000 7f718b757640 1 -- 172.21.15.46:0/2527616736 shutdown_connections 2024-09-21T03:46:46.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.823+0000 7f718b757640 1 -- 172.21.15.46:0/2527616736 wait complete. 2024-09-21T03:46:46.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.824+0000 7f718b757640 1 Processor -- start 2024-09-21T03:46:46.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.824+0000 7f718b757640 1 -- start start 2024-09-21T03:46:46.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.824+0000 7f718b757640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7184102650 0x7f718419c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:46.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.824+0000 7f718b757640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7184102fa0 0x7f718419cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:46.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.824+0000 7f718b757640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7184110200 0x7f71841a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:46.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.824+0000 7f718b757640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7184115cf0 con 0x7f7184102650 2024-09-21T03:46:46.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.825+0000 7f718b757640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7184115b70 con 0x7f7184102fa0 2024-09-21T03:46:46.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.825+0000 7f718b757640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7184115e70 con 0x7f7184110200 2024-09-21T03:46:46.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.825+0000 7f71894f3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7184102650 0x7f718419c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:46.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.825+0000 7f71894f3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7184102650 0x7f718419c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51364/0 (socket says 172.21.15.46:51364) 2024-09-21T03:46:46.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.825+0000 7f71894f3640 1 -- 172.21.15.46:0/1936173384 learned_addr learned my addr 172.21.15.46:0/1936173384 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:46:46.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.825+0000 7f7188cf2640 1 --2- 172.21.15.46:0/1936173384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7184102fa0 0x7f718419cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:46.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.825+0000 7f7189cf4640 1 --2- 172.21.15.46:0/1936173384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7184110200 0x7f71841a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:46.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.825+0000 7f71894f3640 1 -- 172.21.15.46:0/1936173384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7184110200 msgr2=0x7f71841a1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:46.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.825+0000 7f71894f3640 1 --2- 172.21.15.46:0/1936173384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7184110200 0x7f71841a1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:46.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.825+0000 7f71894f3640 1 -- 172.21.15.46:0/1936173384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7184102fa0 msgr2=0x7f718419cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:46.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.825+0000 7f71894f3640 1 --2- 172.21.15.46:0/1936173384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7184102fa0 0x7f718419cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:46.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.825+0000 7f71894f3640 1 -- 172.21.15.46:0/1936173384 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71841a25b0 con 0x7f7184102650 2024-09-21T03:46:46.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.825+0000 7f7188cf2640 1 --2- 172.21.15.46:0/1936173384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7184102fa0 0x7f718419cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:46:46.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.825+0000 7f71894f3640 1 --2- 172.21.15.46:0/1936173384 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7184102650 0x7f718419c640 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f718000ebc0 tx=0x7f718000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:46.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.825+0000 7f71767fc640 1 -- 172.21.15.46:0/1936173384 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7180010630 con 0x7f7184102650 2024-09-21T03:46:46.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.826+0000 7f71767fc640 1 -- 172.21.15.46:0/1936173384 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7180010c80 con 0x7f7184102650 2024-09-21T03:46:46.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.826+0000 7f71767fc640 1 -- 172.21.15.46:0/1936173384 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7180018b60 con 0x7f7184102650 2024-09-21T03:46:46.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.826+0000 7f718b757640 1 -- 172.21.15.46:0/1936173384 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71841a28a0 con 0x7f7184102650 2024-09-21T03:46:46.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.826+0000 7f718b757640 1 -- 172.21.15.46:0/1936173384 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71841a9000 con 0x7f7184102650 2024-09-21T03:46:46.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.827+0000 7f718b757640 1 -- 172.21.15.46:0/1936173384 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f718406c1f0 con 0x7f7184102650 2024-09-21T03:46:46.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.827+0000 7f71767fc640 1 -- 172.21.15.46:0/1936173384 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 103194+0+0 (secure 0 0 0) 0x7f7180018d00 con 0x7f7184102650 2024-09-21T03:46:46.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.828+0000 7f71767fc640 1 --2- 172.21.15.46:0/1936173384 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f717007b020 0x7f717007d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:46.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.828+0000 7f7188cf2640 1 --2- 172.21.15.46:0/1936173384 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f717007b020 0x7f717007d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:46.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.828+0000 7f71767fc640 1 -- 172.21.15.46:0/1936173384 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f718009d430 con 0x7f7184102650 2024-09-21T03:46:46.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.829+0000 7f7188cf2640 1 --2- 172.21.15.46:0/1936173384 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f717007b020 0x7f717007d530 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7184103f40 tx=0x7f717800b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:46.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:46.833+0000 7f71767fc640 1 -- 172.21.15.46:0/1936173384 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7180069e40 con 0x7f7184102650 2024-09-21T03:46:47.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.022+0000 7f718b757640 1 -- 172.21.15.46:0/1936173384 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f71841a9260 con 0x7f7184102650 2024-09-21T03:46:47.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.026+0000 7f71767fc640 1 -- 172.21.15.46:0/1936173384 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v21)=0 v21) ==== 119+0+0 (secure 0 0 0) 0x7f718006ecf0 con 0x7f7184102650 2024-09-21T03:46:47.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.028+0000 7f718b757640 1 -- 172.21.15.46:0/1936173384 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f717007b020 msgr2=0x7f717007d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:47.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.028+0000 7f718b757640 1 --2- 172.21.15.46:0/1936173384 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f717007b020 0x7f717007d530 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7184103f40 tx=0x7f717800b410 comp rx=0 tx=0).stop 2024-09-21T03:46:47.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.028+0000 7f718b757640 1 -- 172.21.15.46:0/1936173384 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7184102650 msgr2=0x7f718419c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:47.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.028+0000 7f718b757640 1 --2- 172.21.15.46:0/1936173384 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7184102650 0x7f718419c640 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f718000ebc0 tx=0x7f718000c6a0 comp rx=0 tx=0).stop 2024-09-21T03:46:47.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.029+0000 7f718b757640 1 -- 172.21.15.46:0/1936173384 shutdown_connections 2024-09-21T03:46:47.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.029+0000 7f718b757640 1 --2- 172.21.15.46:0/1936173384 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f717007b020 0x7f717007d530 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:47.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.029+0000 7f718b757640 1 --2- 172.21.15.46:0/1936173384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7184110200 0x7f71841a1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:47.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.029+0000 7f718b757640 1 --2- 172.21.15.46:0/1936173384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7184102fa0 0x7f718419cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:47.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.029+0000 7f718b757640 1 --2- 172.21.15.46:0/1936173384 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7184102650 0x7f718419c640 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:47.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.029+0000 7f718b757640 1 -- 172.21.15.46:0/1936173384 >> 172.21.15.46:0/1936173384 conn(0x7f7184079760 msgr2=0x7f7184108c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:47.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.029+0000 7f718b757640 1 -- 172.21.15.46:0/1936173384 shutdown_connections 2024-09-21T03:46:47.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.029+0000 7f718b757640 1 -- 172.21.15.46:0/1936173384 wait complete. 2024-09-21T03:46:47.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.030+0000 7f89b32f1640 1 -- 172.21.15.46:0/3278831817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89ac108d20 msgr2=0x7f89ac10f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:47.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.030+0000 7f89b32f1640 1 --2- 172.21.15.46:0/3278831817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89ac108d20 0x7f89ac10f550 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f89a4009ca0 tx=0x7f89a402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:46:47.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.030+0000 7f89b32f1640 1 -- 172.21.15.46:0/3278831817 shutdown_connections 2024-09-21T03:46:47.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.030+0000 7f89b32f1640 1 --2- 172.21.15.46:0/3278831817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89ac108d20 0x7f89ac10f550 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:47.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.030+0000 7f89b32f1640 1 --2- 172.21.15.46:0/3278831817 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89ac1083d0 0x7f89ac1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:47.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.030+0000 7f89b32f1640 1 --2- 172.21.15.46:0/3278831817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89ac102ae0 0x7f89ac102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:47.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.030+0000 7f89b32f1640 1 -- 172.21.15.46:0/3278831817 >> 172.21.15.46:0/3278831817 conn(0x7f89ac0797b0 msgr2=0x7f89ac079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:47.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.030+0000 7f89b32f1640 1 -- 172.21.15.46:0/3278831817 shutdown_connections 2024-09-21T03:46:47.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.031+0000 7f89b32f1640 1 -- 172.21.15.46:0/3278831817 wait complete. 2024-09-21T03:46:47.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.031+0000 7f89b32f1640 1 Processor -- start 2024-09-21T03:46:47.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.031+0000 7f89b32f1640 1 -- start start 2024-09-21T03:46:47.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.032+0000 7f89b32f1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89ac102ae0 0x7f89ac19c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:47.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.032+0000 7f89b32f1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89ac1083d0 0x7f89ac19cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:47.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.032+0000 7f89b32f1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89ac108d20 0x7f89ac1a1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:47.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.032+0000 7f89b32f1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f89ac1129e0 con 0x7f89ac108d20 2024-09-21T03:46:47.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.032+0000 7f89b32f1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f89ac112860 con 0x7f89ac102ae0 2024-09-21T03:46:47.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.032+0000 7f89b32f1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f89ac112b60 con 0x7f89ac1083d0 2024-09-21T03:46:47.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.032+0000 7f89b188e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89ac108d20 0x7f89ac1a1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:47.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.032+0000 7f89b108d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89ac102ae0 0x7f89ac19c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:47.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.032+0000 7f89b188e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89ac108d20 0x7f89ac1a1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51376/0 (socket says 172.21.15.46:51376) 2024-09-21T03:46:47.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.032+0000 7f89b108d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89ac102ae0 0x7f89ac19c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.46:47654/0 (socket says 172.21.15.46:47654) 2024-09-21T03:46:47.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.032+0000 7f89b188e640 1 -- 172.21.15.46:0/420805191 learned_addr learned my addr 172.21.15.46:0/420805191 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:46:47.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.032+0000 7f89b088c640 1 --2- 172.21.15.46:0/420805191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89ac1083d0 0x7f89ac19cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:47.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.033+0000 7f89b188e640 1 -- 172.21.15.46:0/420805191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89ac1083d0 msgr2=0x7f89ac19cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:47.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.033+0000 7f89b188e640 1 --2- 172.21.15.46:0/420805191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89ac1083d0 0x7f89ac19cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:47.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.033+0000 7f89b188e640 1 -- 172.21.15.46:0/420805191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89ac102ae0 msgr2=0x7f89ac19c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:47.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.033+0000 7f89b188e640 1 --2- 172.21.15.46:0/420805191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89ac102ae0 0x7f89ac19c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:47.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.033+0000 7f89b188e640 1 -- 172.21.15.46:0/420805191 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89ac1a25c0 con 0x7f89ac108d20 2024-09-21T03:46:47.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.033+0000 7f89b188e640 1 --2- 172.21.15.46:0/420805191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89ac108d20 0x7f89ac1a1e90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f89a4005cc0 tx=0x7f89a4031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:47.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.033+0000 7f89a27fc640 1 -- 172.21.15.46:0/420805191 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a4003b70 con 0x7f89ac108d20 2024-09-21T03:46:47.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.033+0000 7f89a27fc640 1 -- 172.21.15.46:0/420805191 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89a40318f0 con 0x7f89ac108d20 2024-09-21T03:46:47.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.033+0000 7f89a27fc640 1 -- 172.21.15.46:0/420805191 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a402f950 con 0x7f89ac108d20 2024-09-21T03:46:47.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.033+0000 7f89b32f1640 1 -- 172.21.15.46:0/420805191 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89ac1a2850 con 0x7f89ac108d20 2024-09-21T03:46:47.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.033+0000 7f89b32f1640 1 -- 172.21.15.46:0/420805191 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89ac1a2c80 con 0x7f89ac108d20 2024-09-21T03:46:47.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.035+0000 7f89b32f1640 1 -- 172.21.15.46:0/420805191 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89ac102ef0 con 0x7f89ac108d20 2024-09-21T03:46:47.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.036+0000 7f89a27fc640 1 -- 172.21.15.46:0/420805191 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 103194+0+0 (secure 0 0 0) 0x7f89a402fb50 con 0x7f89ac108d20 2024-09-21T03:46:47.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.036+0000 7f89a27fc640 1 --2- 172.21.15.46:0/420805191 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f899807b020 0x7f899807d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:47.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.036+0000 7f89a27fc640 1 -- 172.21.15.46:0/420805191 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f89a40bdea0 con 0x7f89ac108d20 2024-09-21T03:46:47.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.036+0000 7f89b108d640 1 --2- 172.21.15.46:0/420805191 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f899807b020 0x7f899807d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:47.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.037+0000 7f89b108d640 1 --2- 172.21.15.46:0/420805191 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f899807b020 0x7f899807d530 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f89a8009bd0 tx=0x7f89a8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:47.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.042+0000 7f89a27fc640 1 -- 172.21.15.46:0/420805191 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f89a408a9c0 con 0x7f89ac108d20 2024-09-21T03:46:47.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.233+0000 7f89b32f1640 1 -- 172.21.15.46:0/420805191 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f89ac02e640 con 0x7f89ac108d20 2024-09-21T03:46:47.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.237+0000 7f89a27fc640 1 -- 172.21.15.46:0/420805191 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v22)=0 v22) ==== 106+0+0 (secure 0 0 0) 0x7f89a408f870 con 0x7f89ac108d20 2024-09-21T03:46:47.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.240+0000 7f89b32f1640 1 -- 172.21.15.46:0/420805191 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f899807b020 msgr2=0x7f899807d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:48.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.240+0000 7f89b32f1640 1 --2- 172.21.15.46:0/420805191 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f899807b020 0x7f899807d530 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f89a8009bd0 tx=0x7f89a8005f90 comp rx=0 tx=0).stop 2024-09-21T03:46:48.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.240+0000 7f89b32f1640 1 -- 172.21.15.46:0/420805191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89ac108d20 msgr2=0x7f89ac1a1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:48.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.240+0000 7f89b32f1640 1 --2- 172.21.15.46:0/420805191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89ac108d20 0x7f89ac1a1e90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f89a4005cc0 tx=0x7f89a4031700 comp rx=0 tx=0).stop 2024-09-21T03:46:48.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.240+0000 7f89b32f1640 1 -- 172.21.15.46:0/420805191 shutdown_connections 2024-09-21T03:46:48.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.240+0000 7f89b32f1640 1 --2- 172.21.15.46:0/420805191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89ac108d20 0x7f89ac1a1e90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:48.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.240+0000 7f89b32f1640 1 --2- 172.21.15.46:0/420805191 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f899807b020 0x7f899807d530 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:48.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.240+0000 7f89b32f1640 1 --2- 172.21.15.46:0/420805191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89ac1083d0 0x7f89ac19cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:48.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.240+0000 7f89b32f1640 1 --2- 172.21.15.46:0/420805191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89ac102ae0 0x7f89ac19c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:48.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.240+0000 7f89b32f1640 1 -- 172.21.15.46:0/420805191 >> 172.21.15.46:0/420805191 conn(0x7f89ac0797b0 msgr2=0x7f89ac06b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:48.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.240+0000 7f89b32f1640 1 -- 172.21.15.46:0/420805191 shutdown_connections 2024-09-21T03:46:48.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:47.240+0000 7f89b32f1640 1 -- 172.21.15.46:0/420805191 wait complete. 2024-09-21T03:46:48.657 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:47 smithi162 ceph-mon[35071]: mgrmap e18: x(active, since 14s), standbys: z 2024-09-21T03:46:48.657 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:47 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T03:46:48.657 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:47 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/1936173384' entity='client.admin' 2024-09-21T03:46:48.658 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:47 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/420805191' entity='client.admin' 2024-09-21T03:46:48.658 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:47 smithi105 ceph-mon[34773]: mgrmap e18: x(active, since 14s), standbys: z 2024-09-21T03:46:48.658 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:47 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T03:46:48.658 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:47 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/1936173384' entity='client.admin' 2024-09-21T03:46:48.658 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:47 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/420805191' entity='client.admin' 2024-09-21T03:46:48.658 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:47 smithi046 ceph-mon[30954]: mgrmap e18: x(active, since 14s), standbys: z 2024-09-21T03:46:48.658 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:47 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T03:46:48.658 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:47 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/1936173384' entity='client.admin' 2024-09-21T03:46:48.658 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:47 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/420805191' entity='client.admin' 2024-09-21T03:46:48.659 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:48 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:48.659 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:48 smithi046 ceph-mon[30954]: Standby manager daemon y started 2024-09-21T03:46:48.659 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:48 smithi046 ceph-mon[30954]: from='mgr.? 172.21.15.105:0/2389898576' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T03:46:48.659 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:48 smithi046 ceph-mon[30954]: from='mgr.? 172.21.15.105:0/2389898576' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T03:46:48.659 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:48 smithi046 ceph-mon[30954]: from='mgr.? 172.21.15.105:0/2389898576' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T03:46:48.659 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:48 smithi046 ceph-mon[30954]: from='mgr.? 172.21.15.105:0/2389898576' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T03:46:48.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.704+0000 7ff9c8385640 1 -- 172.21.15.46:0/2075187353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9c01083a0 msgr2=0x7ff9c01087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:48.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.704+0000 7ff9c8385640 1 --2- 172.21.15.46:0/2075187353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9c01083a0 0x7ff9c01087b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0009900 tx=0x7ff9b002a410 comp rx=0 tx=0).stop 2024-09-21T03:46:48.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.704+0000 7ff9c8385640 1 -- 172.21.15.46:0/2075187353 shutdown_connections 2024-09-21T03:46:48.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.704+0000 7ff9c8385640 1 --2- 172.21.15.46:0/2075187353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9c0108cf0 0x7ff9c010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:48.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.704+0000 7ff9c8385640 1 --2- 172.21.15.46:0/2075187353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9c01083a0 0x7ff9c01087b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:48.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.704+0000 7ff9c8385640 1 --2- 172.21.15.46:0/2075187353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9c0102a60 0x7ff9c0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:48.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.704+0000 7ff9c8385640 1 -- 172.21.15.46:0/2075187353 >> 172.21.15.46:0/2075187353 conn(0x7ff9c0079730 msgr2=0x7ff9c0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:48.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.704+0000 7ff9c8385640 1 -- 172.21.15.46:0/2075187353 shutdown_connections 2024-09-21T03:46:48.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.704+0000 7ff9c8385640 1 -- 172.21.15.46:0/2075187353 wait complete. 2024-09-21T03:46:48.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.705+0000 7ff9c8385640 1 Processor -- start 2024-09-21T03:46:48.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.705+0000 7ff9c8385640 1 -- start start 2024-09-21T03:46:48.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.705+0000 7ff9c8385640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9c0102a60 0x7ff9c00ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:48.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.705+0000 7ff9c8385640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9c01083a0 0x7ff9c00ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:48.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.705+0000 7ff9c8385640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9c0108cf0 0x7ff9c01000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:48.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.705+0000 7ff9c8385640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c01129b0 con 0x7ff9c0108cf0 2024-09-21T03:46:48.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.705+0000 7ff9c8385640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c0112830 con 0x7ff9c0102a60 2024-09-21T03:46:48.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.705+0000 7ff9c8385640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c0112b30 con 0x7ff9c01083a0 2024-09-21T03:46:48.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.705+0000 7ff9c6922640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9c0108cf0 0x7ff9c01000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:48.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.705+0000 7ff9c6121640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9c0102a60 0x7ff9c00ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:48.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.705+0000 7ff9c6922640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9c0108cf0 0x7ff9c01000f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51392/0 (socket says 172.21.15.46:51392) 2024-09-21T03:46:48.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.705+0000 7ff9c6922640 1 -- 172.21.15.46:0/406703131 learned_addr learned my addr 172.21.15.46:0/406703131 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:46:48.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.705+0000 7ff9c5920640 1 --2- 172.21.15.46:0/406703131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9c01083a0 0x7ff9c00ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:48.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.705+0000 7ff9c6922640 1 -- 172.21.15.46:0/406703131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9c01083a0 msgr2=0x7ff9c00ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:48.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.705+0000 7ff9c6922640 1 --2- 172.21.15.46:0/406703131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9c01083a0 0x7ff9c00ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:48.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.705+0000 7ff9c6922640 1 -- 172.21.15.46:0/406703131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9c0102a60 msgr2=0x7ff9c00ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:48.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.705+0000 7ff9c6922640 1 --2- 172.21.15.46:0/406703131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9c0102a60 0x7ff9c00ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:48.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.705+0000 7ff9c6922640 1 -- 172.21.15.46:0/406703131 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c01a86a0 con 0x7ff9c0108cf0 2024-09-21T03:46:48.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.705+0000 7ff9c6121640 1 --2- 172.21.15.46:0/406703131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9c0102a60 0x7ff9c00ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:46:48.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.706+0000 7ff9c6922640 1 --2- 172.21.15.46:0/406703131 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9c0108cf0 0x7ff9c01000f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff9b800cce0 tx=0x7ff9b800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:48.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.706+0000 7ff9b77fe640 1 -- 172.21.15.46:0/406703131 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b800f450 con 0x7ff9c0108cf0 2024-09-21T03:46:48.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.706+0000 7ff9b77fe640 1 -- 172.21.15.46:0/406703131 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9b800faa0 con 0x7ff9c0108cf0 2024-09-21T03:46:48.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.706+0000 7ff9c8385640 1 -- 172.21.15.46:0/406703131 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9c01a8990 con 0x7ff9c0108cf0 2024-09-21T03:46:48.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.706+0000 7ff9b77fe640 1 -- 172.21.15.46:0/406703131 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b8018b70 con 0x7ff9c0108cf0 2024-09-21T03:46:48.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.706+0000 7ff9c8385640 1 -- 172.21.15.46:0/406703131 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9c01a8e50 con 0x7ff9c0108cf0 2024-09-21T03:46:48.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.707+0000 7ff9c8385640 1 -- 172.21.15.46:0/406703131 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9c0103ce0 con 0x7ff9c0108cf0 2024-09-21T03:46:48.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.709+0000 7ff9b77fe640 1 -- 172.21.15.46:0/406703131 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7ff9b8018d10 con 0x7ff9c0108cf0 2024-09-21T03:46:48.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.709+0000 7ff9b77fe640 1 --2- 172.21.15.46:0/406703131 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff9ac0b64d0 0x7ff9ac0b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:48.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.709+0000 7ff9c6121640 1 --2- 172.21.15.46:0/406703131 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff9ac0b64d0 0x7ff9ac0b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:48.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.710+0000 7ff9b77fe640 1 -- 172.21.15.46:0/406703131 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7ff9b80e5c20 con 0x7ff9c0108cf0 2024-09-21T03:46:48.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.710+0000 7ff9c6121640 1 --2- 172.21.15.46:0/406703131 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff9ac0b64d0 0x7ff9ac0b89e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff9c01010c0 tx=0x7ff9bc005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:48.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.713+0000 7ff9b77fe640 1 -- 172.21.15.46:0/406703131 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff9b8014030 con 0x7ff9c0108cf0 2024-09-21T03:46:48.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:48 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:48.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:48 smithi105 ceph-mon[34773]: Standby manager daemon y started 2024-09-21T03:46:48.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:48 smithi105 ceph-mon[34773]: from='mgr.? 172.21.15.105:0/2389898576' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T03:46:48.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:48 smithi105 ceph-mon[34773]: from='mgr.? 172.21.15.105:0/2389898576' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T03:46:48.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:48 smithi105 ceph-mon[34773]: from='mgr.? 172.21.15.105:0/2389898576' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T03:46:48.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:48 smithi105 ceph-mon[34773]: from='mgr.? 172.21.15.105:0/2389898576' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T03:46:48.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:48 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:46:48.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:48 smithi162 ceph-mon[35071]: Standby manager daemon y started 2024-09-21T03:46:48.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:48 smithi162 ceph-mon[35071]: from='mgr.? 172.21.15.105:0/2389898576' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T03:46:48.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:48 smithi162 ceph-mon[35071]: from='mgr.? 172.21.15.105:0/2389898576' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T03:46:48.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:48 smithi162 ceph-mon[35071]: from='mgr.? 172.21.15.105:0/2389898576' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T03:46:48.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:48 smithi162 ceph-mon[35071]: from='mgr.? 172.21.15.105:0/2389898576' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T03:46:48.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.905+0000 7ff9c8385640 1 -- 172.21.15.46:0/406703131 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7ff9c0100970 con 0x7ff9c0108cf0 2024-09-21T03:46:48.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.909+0000 7ff9b77fe640 1 -- 172.21.15.46:0/406703131 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v23)=0 v23) ==== 127+0+0 (secure 0 0 0) 0x7ff9b80ae140 con 0x7ff9c0108cf0 2024-09-21T03:46:48.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.912+0000 7ff9c8385640 1 -- 172.21.15.46:0/406703131 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff9ac0b64d0 msgr2=0x7ff9ac0b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:48.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.912+0000 7ff9c8385640 1 --2- 172.21.15.46:0/406703131 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff9ac0b64d0 0x7ff9ac0b89e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff9c01010c0 tx=0x7ff9bc005f90 comp rx=0 tx=0).stop 2024-09-21T03:46:48.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.912+0000 7ff9c8385640 1 -- 172.21.15.46:0/406703131 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9c0108cf0 msgr2=0x7ff9c01000f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:48.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.912+0000 7ff9c8385640 1 --2- 172.21.15.46:0/406703131 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9c0108cf0 0x7ff9c01000f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff9b800cce0 tx=0x7ff9b800a620 comp rx=0 tx=0).stop 2024-09-21T03:46:48.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.912+0000 7ff9c8385640 1 -- 172.21.15.46:0/406703131 shutdown_connections 2024-09-21T03:46:48.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.912+0000 7ff9c8385640 1 --2- 172.21.15.46:0/406703131 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9c0108cf0 0x7ff9c01000f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:48.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.912+0000 7ff9c8385640 1 --2- 172.21.15.46:0/406703131 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff9ac0b64d0 0x7ff9ac0b89e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:48.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.912+0000 7ff9c8385640 1 --2- 172.21.15.46:0/406703131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9c01083a0 0x7ff9c00ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:48.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.912+0000 7ff9c8385640 1 --2- 172.21.15.46:0/406703131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9c0102a60 0x7ff9c00ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:48.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.912+0000 7ff9c8385640 1 -- 172.21.15.46:0/406703131 >> 172.21.15.46:0/406703131 conn(0x7ff9c0079730 msgr2=0x7ff9c006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:48.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.912+0000 7ff9c8385640 1 -- 172.21.15.46:0/406703131 shutdown_connections 2024-09-21T03:46:48.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:48.912+0000 7ff9c8385640 1 -- 172.21.15.46:0/406703131 wait complete. 2024-09-21T03:46:49.554 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:49 smithi046 ceph-mon[30954]: mgrmap e19: x(active, since 16s), standbys: y, z 2024-09-21T03:46:49.554 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:49 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T03:46:49.554 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:49 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/406703131' entity='client.admin' 2024-09-21T03:46:49.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.578+0000 7f84d3851640 1 -- 172.21.15.46:0/3180646418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84cc105300 msgr2=0x7f84cc10d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:49.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.578+0000 7f84d3851640 1 --2- 172.21.15.46:0/3180646418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84cc105300 0x7f84cc10d850 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f84c0009900 tx=0x7f84c002a410 comp rx=0 tx=0).stop 2024-09-21T03:46:49.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.578+0000 7f84d3851640 1 -- 172.21.15.46:0/3180646418 shutdown_connections 2024-09-21T03:46:49.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.578+0000 7f84d3851640 1 --2- 172.21.15.46:0/3180646418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84cc10de10 0x7f84cc110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:49.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.578+0000 7f84d3851640 1 --2- 172.21.15.46:0/3180646418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84cc105300 0x7f84cc10d850 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:49.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.578+0000 7f84d3851640 1 --2- 172.21.15.46:0/3180646418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84cc1049b0 0x7f84cc104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:49.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.578+0000 7f84d3851640 1 -- 172.21.15.46:0/3180646418 >> 172.21.15.46:0/3180646418 conn(0x7f84cc079730 msgr2=0x7f84cc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:49.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.578+0000 7f84d3851640 1 -- 172.21.15.46:0/3180646418 shutdown_connections 2024-09-21T03:46:49.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.578+0000 7f84d3851640 1 -- 172.21.15.46:0/3180646418 wait complete. 2024-09-21T03:46:49.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.579+0000 7f84d3851640 1 Processor -- start 2024-09-21T03:46:49.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.579+0000 7f84d3851640 1 -- start start 2024-09-21T03:46:49.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.579+0000 7f84d3851640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84cc1049b0 0x7f84cc1026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:49.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.579+0000 7f84d3851640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84cc105300 0x7f84cc102c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:49.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.579+0000 7f84d3851640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84cc10de10 0x7f84cc103170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:49.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.579+0000 7f84d3851640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f84cc113a70 con 0x7f84cc1049b0 2024-09-21T03:46:49.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.579+0000 7f84d3851640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f84cc1138f0 con 0x7f84cc10de10 2024-09-21T03:46:49.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.579+0000 7f84d3851640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f84cc113bf0 con 0x7f84cc105300 2024-09-21T03:46:49.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.579+0000 7f84d15ed640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84cc1049b0 0x7f84cc1026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:49.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.579+0000 7f84d15ed640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84cc1049b0 0x7f84cc1026f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51416/0 (socket says 172.21.15.46:51416) 2024-09-21T03:46:49.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.579+0000 7f84d15ed640 1 -- 172.21.15.46:0/949900766 learned_addr learned my addr 172.21.15.46:0/949900766 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:46:49.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.579+0000 7f84d1dee640 1 --2- 172.21.15.46:0/949900766 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84cc10de10 0x7f84cc103170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:49.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.580+0000 7f84d0dec640 1 --2- 172.21.15.46:0/949900766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84cc105300 0x7f84cc102c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:49.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.580+0000 7f84d15ed640 1 -- 172.21.15.46:0/949900766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84cc105300 msgr2=0x7f84cc102c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:49.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.580+0000 7f84d15ed640 1 --2- 172.21.15.46:0/949900766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84cc105300 0x7f84cc102c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:49.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.580+0000 7f84d15ed640 1 -- 172.21.15.46:0/949900766 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84cc10de10 msgr2=0x7f84cc103170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:49.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.580+0000 7f84d15ed640 1 --2- 172.21.15.46:0/949900766 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84cc10de10 0x7f84cc103170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:49.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.580+0000 7f84d15ed640 1 -- 172.21.15.46:0/949900766 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84cc1a87c0 con 0x7f84cc1049b0 2024-09-21T03:46:49.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.580+0000 7f84d15ed640 1 --2- 172.21.15.46:0/949900766 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84cc1049b0 0x7f84cc1026f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f84c400d770 tx=0x7f84c400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:49.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.580+0000 7f84ca7fc640 1 -- 172.21.15.46:0/949900766 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c4017070 con 0x7f84cc1049b0 2024-09-21T03:46:49.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.580+0000 7f84ca7fc640 1 -- 172.21.15.46:0/949900766 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84c4009c30 con 0x7f84cc1049b0 2024-09-21T03:46:49.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.580+0000 7f84d3851640 1 -- 172.21.15.46:0/949900766 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84cc1a8ab0 con 0x7f84cc1049b0 2024-09-21T03:46:49.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.580+0000 7f84ca7fc640 1 -- 172.21.15.46:0/949900766 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c4003cc0 con 0x7f84cc1049b0 2024-09-21T03:46:49.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.580+0000 7f84d3851640 1 -- 172.21.15.46:0/949900766 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84cc1a9010 con 0x7f84cc1049b0 2024-09-21T03:46:49.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.582+0000 7f84d3851640 1 -- 172.21.15.46:0/949900766 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84cc104dc0 con 0x7f84cc1049b0 2024-09-21T03:46:49.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.584+0000 7f84ca7fc640 1 -- 172.21.15.46:0/949900766 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f84c4003e60 con 0x7f84cc1049b0 2024-09-21T03:46:49.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.585+0000 7f84ca7fc640 1 --2- 172.21.15.46:0/949900766 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f84b40b6550 0x7f84b40b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:49.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.585+0000 7f84d0dec640 1 --2- 172.21.15.46:0/949900766 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f84b40b6550 0x7f84b40b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:49.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.585+0000 7f84ca7fc640 1 -- 172.21.15.46:0/949900766 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f84c40e5050 con 0x7f84cc1049b0 2024-09-21T03:46:49.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.586+0000 7f84d0dec640 1 --2- 172.21.15.46:0/949900766 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f84b40b6550 0x7f84b40b8a60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f84c0009230 tx=0x7f84c0031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:49.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.590+0000 7f84ca7fc640 1 -- 172.21.15.46:0/949900766 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f84c4009de0 con 0x7f84cc1049b0 2024-09-21T03:46:49.706 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a82de5ec-77cb-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi046') 2024-09-21T03:46:49.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.784+0000 7f84d3851640 1 -- 172.21.15.46:0/949900766 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f84cc02e640 con 0x7f84cc1049b0 2024-09-21T03:46:49.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.788+0000 7f84ca7fc640 1 -- 172.21.15.46:0/949900766 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v25)=0 v25) ==== 111+0+0 (secure 0 0 0) 0x7f84c40b1820 con 0x7f84cc1049b0 2024-09-21T03:46:49.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.791+0000 7f84d3851640 1 -- 172.21.15.46:0/949900766 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f84b40b6550 msgr2=0x7f84b40b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:49.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.791+0000 7f84d3851640 1 --2- 172.21.15.46:0/949900766 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f84b40b6550 0x7f84b40b8a60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f84c0009230 tx=0x7f84c0031400 comp rx=0 tx=0).stop 2024-09-21T03:46:49.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.791+0000 7f84d3851640 1 -- 172.21.15.46:0/949900766 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84cc1049b0 msgr2=0x7f84cc1026f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:49.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.791+0000 7f84d3851640 1 --2- 172.21.15.46:0/949900766 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84cc1049b0 0x7f84cc1026f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f84c400d770 tx=0x7f84c400dc30 comp rx=0 tx=0).stop 2024-09-21T03:46:49.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.791+0000 7f84d3851640 1 -- 172.21.15.46:0/949900766 shutdown_connections 2024-09-21T03:46:49.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.791+0000 7f84d3851640 1 --2- 172.21.15.46:0/949900766 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84cc10de10 0x7f84cc103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:49.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.791+0000 7f84d3851640 1 --2- 172.21.15.46:0/949900766 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f84b40b6550 0x7f84b40b8a60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:49.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.791+0000 7f84d3851640 1 --2- 172.21.15.46:0/949900766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84cc105300 0x7f84cc102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:49.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.791+0000 7f84d3851640 1 --2- 172.21.15.46:0/949900766 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84cc1049b0 0x7f84cc1026f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:49.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.791+0000 7f84d3851640 1 -- 172.21.15.46:0/949900766 >> 172.21.15.46:0/949900766 conn(0x7f84cc079730 msgr2=0x7f84cc0ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:49.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.791+0000 7f84d3851640 1 -- 172.21.15.46:0/949900766 shutdown_connections 2024-09-21T03:46:49.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.791+0000 7f84d3851640 1 -- 172.21.15.46:0/949900766 wait complete. 2024-09-21T03:46:49.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:49 smithi105 ceph-mon[34773]: mgrmap e19: x(active, since 16s), standbys: y, z 2024-09-21T03:46:49.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:49 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T03:46:49.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:49 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/406703131' entity='client.admin' 2024-09-21T03:46:49.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:49 smithi162 ceph-mon[35071]: mgrmap e19: x(active, since 16s), standbys: y, z 2024-09-21T03:46:49.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:49 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T03:46:49.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:49 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/406703131' entity='client.admin' 2024-09-21T03:46:50.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:50 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/1075191494' entity='client.admin' 2024-09-21T03:46:50.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:50 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/949900766' entity='client.admin' 2024-09-21T03:46:51.067 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:50 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/1075191494' entity='client.admin' 2024-09-21T03:46:51.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:50 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/949900766' entity='client.admin' 2024-09-21T03:46:51.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:50 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/1075191494' entity='client.admin' 2024-09-21T03:46:51.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:50 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/949900766' entity='client.admin' 2024-09-21T03:46:51.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.434+0000 7f22b14a3640 1 -- 172.21.15.46:0/1790923756 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22ac108d20 msgr2=0x7f22ac10f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:51.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.434+0000 7f22b14a3640 1 --2- 172.21.15.46:0/1790923756 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22ac108d20 0x7f22ac10f550 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f22a4009ca0 tx=0x7f22a402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:46:51.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.434+0000 7f22b14a3640 1 -- 172.21.15.46:0/1790923756 shutdown_connections 2024-09-21T03:46:51.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.434+0000 7f22b14a3640 1 --2- 172.21.15.46:0/1790923756 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22ac108d20 0x7f22ac10f550 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:51.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.434+0000 7f22b14a3640 1 --2- 172.21.15.46:0/1790923756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22ac1083d0 0x7f22ac1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:51.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.434+0000 7f22b14a3640 1 --2- 172.21.15.46:0/1790923756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22ac102ae0 0x7f22ac102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:51.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.434+0000 7f22b14a3640 1 -- 172.21.15.46:0/1790923756 >> 172.21.15.46:0/1790923756 conn(0x7f22ac079760 msgr2=0x7f22ac079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:51.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.434+0000 7f22b14a3640 1 -- 172.21.15.46:0/1790923756 shutdown_connections 2024-09-21T03:46:51.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.434+0000 7f22b14a3640 1 -- 172.21.15.46:0/1790923756 wait complete. 2024-09-21T03:46:51.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.435+0000 7f22b14a3640 1 Processor -- start 2024-09-21T03:46:51.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.435+0000 7f22b14a3640 1 -- start start 2024-09-21T03:46:51.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.436+0000 7f22b14a3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22ac102ae0 0x7f22ac19a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:51.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.436+0000 7f22b14a3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22ac1083d0 0x7f22ac19a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:51.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.436+0000 7f22b14a3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22ac108d20 0x7f22ac19fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:51.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.436+0000 7f22b14a3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f22ac112990 con 0x7f22ac108d20 2024-09-21T03:46:51.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.436+0000 7f22b14a3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f22ac112810 con 0x7f22ac102ae0 2024-09-21T03:46:51.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.436+0000 7f22b14a3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f22ac112b10 con 0x7f22ac1083d0 2024-09-21T03:46:51.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.436+0000 7f22ab7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22ac108d20 0x7f22ac19fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:51.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.436+0000 7f22ab7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22ac108d20 0x7f22ac19fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51422/0 (socket says 172.21.15.46:51422) 2024-09-21T03:46:51.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.436+0000 7f22ab7fe640 1 -- 172.21.15.46:0/264281909 learned_addr learned my addr 172.21.15.46:0/264281909 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:46:51.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.436+0000 7f22aaffd640 1 --2- 172.21.15.46:0/264281909 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22ac102ae0 0x7f22ac19a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:51.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.436+0000 7f22aa7fc640 1 --2- 172.21.15.46:0/264281909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22ac1083d0 0x7f22ac19a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:51.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.436+0000 7f22ab7fe640 1 -- 172.21.15.46:0/264281909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22ac1083d0 msgr2=0x7f22ac19a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:51.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.436+0000 7f22ab7fe640 1 --2- 172.21.15.46:0/264281909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22ac1083d0 0x7f22ac19a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:51.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.436+0000 7f22ab7fe640 1 -- 172.21.15.46:0/264281909 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22ac102ae0 msgr2=0x7f22ac19a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:51.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.436+0000 7f22ab7fe640 1 --2- 172.21.15.46:0/264281909 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22ac102ae0 0x7f22ac19a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:51.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.436+0000 7f22ab7fe640 1 -- 172.21.15.46:0/264281909 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22ac1a0380 con 0x7f22ac108d20 2024-09-21T03:46:51.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.436+0000 7f22ab7fe640 1 --2- 172.21.15.46:0/264281909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22ac108d20 0x7f22ac19fc50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f22a40098d0 tx=0x7f22a40317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:51.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.437+0000 7f2293fff640 1 -- 172.21.15.46:0/264281909 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a4003b70 con 0x7f22ac108d20 2024-09-21T03:46:51.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.437+0000 7f2293fff640 1 -- 172.21.15.46:0/264281909 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22a4003d10 con 0x7f22ac108d20 2024-09-21T03:46:51.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.437+0000 7f2293fff640 1 -- 172.21.15.46:0/264281909 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a402fa20 con 0x7f22ac108d20 2024-09-21T03:46:51.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.437+0000 7f22b14a3640 1 -- 172.21.15.46:0/264281909 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22ac1a0610 con 0x7f22ac108d20 2024-09-21T03:46:51.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.437+0000 7f22b14a3640 1 -- 172.21.15.46:0/264281909 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22ac0ff550 con 0x7f22ac108d20 2024-09-21T03:46:51.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.438+0000 7f22b14a3640 1 -- 172.21.15.46:0/264281909 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22ac103d10 con 0x7f22ac108d20 2024-09-21T03:46:51.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.439+0000 7f2293fff640 1 -- 172.21.15.46:0/264281909 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f22a402fbe0 con 0x7f22ac108d20 2024-09-21T03:46:51.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.440+0000 7f2293fff640 1 --2- 172.21.15.46:0/264281909 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f22940b6550 0x7f22940b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:51.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.440+0000 7f22aaffd640 1 --2- 172.21.15.46:0/264281909 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f22940b6550 0x7f22940b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:51.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.440+0000 7f2293fff640 1 -- 172.21.15.46:0/264281909 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f22a4106ad0 con 0x7f22ac108d20 2024-09-21T03:46:51.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.441+0000 7f22aaffd640 1 --2- 172.21.15.46:0/264281909 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f22940b6550 0x7f22940b8a60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f229c005fd0 tx=0x7f229c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:51.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.443+0000 7f2293fff640 1 -- 172.21.15.46:0/264281909 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f22a40cef60 con 0x7f22ac108d20 2024-09-21T03:46:51.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.635+0000 7f22b14a3640 1 -- 172.21.15.46:0/264281909 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) -- 0x7f22ac102ef0 con 0x7f22ac108d20 2024-09-21T03:46:51.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.639+0000 7f2293fff640 1 -- 172.21.15.46:0/264281909 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v26)=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7f22ac102ef0 con 0x7f22ac108d20 2024-09-21T03:46:51.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.642+0000 7f22b14a3640 1 -- 172.21.15.46:0/264281909 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f22940b6550 msgr2=0x7f22940b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:51.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.642+0000 7f22b14a3640 1 --2- 172.21.15.46:0/264281909 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f22940b6550 0x7f22940b8a60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f229c005fd0 tx=0x7f229c00b390 comp rx=0 tx=0).stop 2024-09-21T03:46:51.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.642+0000 7f22b14a3640 1 -- 172.21.15.46:0/264281909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22ac108d20 msgr2=0x7f22ac19fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:51.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.642+0000 7f22b14a3640 1 --2- 172.21.15.46:0/264281909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22ac108d20 0x7f22ac19fc50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f22a40098d0 tx=0x7f22a40317b0 comp rx=0 tx=0).stop 2024-09-21T03:46:51.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.642+0000 7f22b14a3640 1 -- 172.21.15.46:0/264281909 shutdown_connections 2024-09-21T03:46:51.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.642+0000 7f22b14a3640 1 --2- 172.21.15.46:0/264281909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22ac108d20 0x7f22ac19fc50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:51.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.642+0000 7f22b14a3640 1 --2- 172.21.15.46:0/264281909 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f22940b6550 0x7f22940b8a60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:51.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.642+0000 7f22b14a3640 1 --2- 172.21.15.46:0/264281909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22ac1083d0 0x7f22ac19a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:51.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.642+0000 7f22b14a3640 1 --2- 172.21.15.46:0/264281909 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22ac102ae0 0x7f22ac19a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:51.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.642+0000 7f22b14a3640 1 -- 172.21.15.46:0/264281909 >> 172.21.15.46:0/264281909 conn(0x7f22ac079760 msgr2=0x7f22ac101a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:51.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.642+0000 7f22b14a3640 1 -- 172.21.15.46:0/264281909 shutdown_connections 2024-09-21T03:46:51.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.642+0000 7f22b14a3640 1 -- 172.21.15.46:0/264281909 wait complete. 2024-09-21T03:46:52.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.219+0000 7fe768bd8640 1 -- 172.21.15.46:0/2606151748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7641052a0 msgr2=0x7fe76410d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:52.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.219+0000 7fe768bd8640 1 --2- 172.21.15.46:0/2606151748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7641052a0 0x7fe76410d8e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe758009900 tx=0x7fe75802a410 comp rx=0 tx=0).stop 2024-09-21T03:46:52.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.219+0000 7fe768bd8640 1 -- 172.21.15.46:0/2606151748 shutdown_connections 2024-09-21T03:46:52.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.219+0000 7fe768bd8640 1 --2- 172.21.15.46:0/2606151748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe76410de20 0x7fe764110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:52.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.219+0000 7fe768bd8640 1 --2- 172.21.15.46:0/2606151748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7641052a0 0x7fe76410d8e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:52.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.219+0000 7fe768bd8640 1 --2- 172.21.15.46:0/2606151748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe764104870 0x7fe764104c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:52.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.219+0000 7fe768bd8640 1 -- 172.21.15.46:0/2606151748 >> 172.21.15.46:0/2606151748 conn(0x7fe764079730 msgr2=0x7fe764079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:52.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.219+0000 7fe768bd8640 1 -- 172.21.15.46:0/2606151748 shutdown_connections 2024-09-21T03:46:52.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.219+0000 7fe768bd8640 1 -- 172.21.15.46:0/2606151748 wait complete. 2024-09-21T03:46:52.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.220+0000 7fe768bd8640 1 Processor -- start 2024-09-21T03:46:52.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.220+0000 7fe768bd8640 1 -- start start 2024-09-21T03:46:52.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.220+0000 7fe768bd8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe764104870 0x7fe764102780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:52.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.220+0000 7fe768bd8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7641052a0 0x7fe764102cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:52.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.220+0000 7fe768bd8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe76410de20 0x7fe764103200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:52.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.220+0000 7fe768bd8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe764113a30 con 0x7fe7641052a0 2024-09-21T03:46:52.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.220+0000 7fe768bd8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe7641138b0 con 0x7fe764104870 2024-09-21T03:46:52.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.220+0000 7fe768bd8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe764113bb0 con 0x7fe76410de20 2024-09-21T03:46:52.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.220+0000 7fe761d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7641052a0 0x7fe764102cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:52.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.220+0000 7fe76259c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe764104870 0x7fe764102780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:52.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.220+0000 7fe76259c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe764104870 0x7fe764102780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.46:39610/0 (socket says 172.21.15.46:39610) 2024-09-21T03:46:52.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.220+0000 7fe761d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7641052a0 0x7fe764102cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42926/0 (socket says 172.21.15.46:42926) 2024-09-21T03:46:52.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.220+0000 7fe76259c640 1 -- 172.21.15.46:0/2411081974 learned_addr learned my addr 172.21.15.46:0/2411081974 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:46:52.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.220+0000 7fe762d9d640 1 --2- 172.21.15.46:0/2411081974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe76410de20 0x7fe764103200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:52.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.221+0000 7fe76259c640 1 -- 172.21.15.46:0/2411081974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe76410de20 msgr2=0x7fe764103200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:52.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.221+0000 7fe76259c640 1 --2- 172.21.15.46:0/2411081974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe76410de20 0x7fe764103200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:52.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.221+0000 7fe76259c640 1 -- 172.21.15.46:0/2411081974 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7641052a0 msgr2=0x7fe764102cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:52.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.221+0000 7fe76259c640 1 --2- 172.21.15.46:0/2411081974 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7641052a0 0x7fe764102cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:52.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.221+0000 7fe76259c640 1 -- 172.21.15.46:0/2411081974 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7641a87a0 con 0x7fe764104870 2024-09-21T03:46:52.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.221+0000 7fe761d9b640 1 --2- 172.21.15.46:0/2411081974 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7641052a0 0x7fe764102cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:46:52.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.221+0000 7fe762d9d640 1 --2- 172.21.15.46:0/2411081974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe76410de20 0x7fe764103200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:46:52.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.221+0000 7fe76259c640 1 --2- 172.21.15.46:0/2411081974 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe764104870 0x7fe764102780 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe75400d950 tx=0x7fe75400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:52.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.221+0000 7fe7537fe640 1 -- 172.21.15.46:0/2411081974 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe754017070 con 0x7fe764104870 2024-09-21T03:46:52.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.221+0000 7fe7537fe640 1 -- 172.21.15.46:0/2411081974 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe754009c30 con 0x7fe764104870 2024-09-21T03:46:52.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.221+0000 7fe7537fe640 1 -- 172.21.15.46:0/2411081974 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75400f620 con 0x7fe764104870 2024-09-21T03:46:52.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.221+0000 7fe768bd8640 1 -- 172.21.15.46:0/2411081974 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7641a8a90 con 0x7fe764104870 2024-09-21T03:46:52.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.221+0000 7fe768bd8640 1 -- 172.21.15.46:0/2411081974 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7641a8fa0 con 0x7fe764104870 2024-09-21T03:46:52.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.222+0000 7fe768bd8640 1 -- 172.21.15.46:0/2411081974 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe76406c160 con 0x7fe764104870 2024-09-21T03:46:52.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.224+0000 7fe7537fe640 1 -- 172.21.15.46:0/2411081974 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7fe754005030 con 0x7fe764104870 2024-09-21T03:46:52.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.225+0000 7fe7537fe640 1 --2- 172.21.15.46:0/2411081974 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe74c0b64d0 0x7fe74c0b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:52.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.225+0000 7fe761d9b640 1 --2- 172.21.15.46:0/2411081974 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe74c0b64d0 0x7fe74c0b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:52.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.225+0000 7fe7537fe640 1 -- 172.21.15.46:0/2411081974 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fe7540e53d0 con 0x7fe764104870 2024-09-21T03:46:52.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.225+0000 7fe761d9b640 1 --2- 172.21.15.46:0/2411081974 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe74c0b64d0 0x7fe74c0b89e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe758009230 tx=0x7fe758031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:52.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.228+0000 7fe7537fe640 1 -- 172.21.15.46:0/2411081974 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe7540ad7c0 con 0x7fe764104870 2024-09-21T03:46:52.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.479+0000 7f9a7e053640 1 -- 172.21.15.46:0/1862274093 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a78104a30 msgr2=0x7f9a78104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:52.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.479+0000 7f9a7e053640 1 --2- 172.21.15.46:0/1862274093 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a78104a30 0x7f9a78104e40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9a68009900 tx=0x7f9a6802a410 comp rx=0 tx=0).stop 2024-09-21T03:46:52.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.479+0000 7f9a7e053640 1 -- 172.21.15.46:0/1862274093 shutdown_connections 2024-09-21T03:46:52.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.479+0000 7f9a7e053640 1 --2- 172.21.15.46:0/1862274093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a7810de60 0x7f9a78110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:52.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.479+0000 7f9a7e053640 1 --2- 172.21.15.46:0/1862274093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a78105380 0x7f9a7810d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:52.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.479+0000 7f9a7e053640 1 --2- 172.21.15.46:0/1862274093 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a78104a30 0x7f9a78104e40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:52.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.479+0000 7f9a7e053640 1 -- 172.21.15.46:0/1862274093 >> 172.21.15.46:0/1862274093 conn(0x7f9a780797b0 msgr2=0x7f9a78079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:52.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.479+0000 7f9a7e053640 1 -- 172.21.15.46:0/1862274093 shutdown_connections 2024-09-21T03:46:52.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.479+0000 7f9a7e053640 1 -- 172.21.15.46:0/1862274093 wait complete. 2024-09-21T03:46:52.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.480+0000 7f9a7e053640 1 Processor -- start 2024-09-21T03:46:52.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.481+0000 7f9a7e053640 1 -- start start 2024-09-21T03:46:52.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.481+0000 7f9a7e053640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a78104a30 0x7f9a7819a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:52.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.481+0000 7f9a7e053640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a78105380 0x7f9a7819aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:52.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.481+0000 7f9a7e053640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a7810de60 0x7f9a7819fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:52.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.481+0000 7f9a7e053640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9a78113ac0 con 0x7f9a78104a30 2024-09-21T03:46:52.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.481+0000 7f9a7e053640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9a78113940 con 0x7f9a78105380 2024-09-21T03:46:52.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.481+0000 7f9a7e053640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9a78113c40 con 0x7f9a7810de60 2024-09-21T03:46:52.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.481+0000 7f9a777fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a78104a30 0x7f9a7819a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:52.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.481+0000 7f9a777fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a78104a30 0x7f9a7819a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51400/0 (socket says 172.21.15.46:51400) 2024-09-21T03:46:52.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.481+0000 7f9a777fe640 1 -- 172.21.15.46:0/1075191494 learned_addr learned my addr 172.21.15.46:0/1075191494 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:46:52.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.481+0000 7f9a76ffd640 1 --2- 172.21.15.46:0/1075191494 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a78105380 0x7f9a7819aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:52.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.481+0000 7f9a77fff640 1 --2- 172.21.15.46:0/1075191494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a7810de60 0x7f9a7819fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:52.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.481+0000 7f9a777fe640 1 -- 172.21.15.46:0/1075191494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a7810de60 msgr2=0x7f9a7819fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:52.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.481+0000 7f9a777fe640 1 --2- 172.21.15.46:0/1075191494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a7810de60 0x7f9a7819fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:52.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.481+0000 7f9a777fe640 1 -- 172.21.15.46:0/1075191494 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a78105380 msgr2=0x7f9a7819aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:52.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.481+0000 7f9a777fe640 1 --2- 172.21.15.46:0/1075191494 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a78105380 0x7f9a7819aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:52.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.481+0000 7f9a777fe640 1 -- 172.21.15.46:0/1075191494 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a781a04c0 con 0x7f9a78104a30 2024-09-21T03:46:52.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.482+0000 7f9a777fe640 1 --2- 172.21.15.46:0/1075191494 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a78104a30 0x7f9a7819a550 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9a68005940 tx=0x7f9a680040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:52.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.482+0000 7f9a74ff9640 1 -- 172.21.15.46:0/1075191494 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6803f030 con 0x7f9a78104a30 2024-09-21T03:46:52.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.482+0000 7f9a7e053640 1 -- 172.21.15.46:0/1075191494 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a781a0750 con 0x7f9a78104a30 2024-09-21T03:46:52.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.482+0000 7f9a74ff9640 1 -- 172.21.15.46:0/1075191494 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a680044c0 con 0x7f9a78104a30 2024-09-21T03:46:52.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.482+0000 7f9a74ff9640 1 -- 172.21.15.46:0/1075191494 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a68035070 con 0x7f9a78104a30 2024-09-21T03:46:52.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.482+0000 7f9a7e053640 1 -- 172.21.15.46:0/1075191494 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a781a6f10 con 0x7f9a78104a30 2024-09-21T03:46:52.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.483+0000 7f9a7e053640 1 -- 172.21.15.46:0/1075191494 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a7806bed0 con 0x7f9a78104a30 2024-09-21T03:46:52.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.485+0000 7f9a74ff9640 1 -- 172.21.15.46:0/1075191494 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f9a68042030 con 0x7f9a78104a30 2024-09-21T03:46:52.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.485+0000 7f9a74ff9640 1 --2- 172.21.15.46:0/1075191494 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f9a600b64d0 0x7f9a600b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:52.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.485+0000 7f9a76ffd640 1 --2- 172.21.15.46:0/1075191494 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f9a600b64d0 0x7f9a600b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:52.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.486+0000 7f9a74ff9640 1 -- 172.21.15.46:0/1075191494 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f9a68105bc0 con 0x7f9a78104a30 2024-09-21T03:46:52.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.486+0000 7f9a76ffd640 1 --2- 172.21.15.46:0/1075191494 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f9a600b64d0 0x7f9a600b89e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9a7807a020 tx=0x7f9a6c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:52.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.490+0000 7f9a74ff9640 1 -- 172.21.15.46:0/1075191494 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9a680ce050 con 0x7f9a78104a30 2024-09-21T03:46:52.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.713+0000 7f9a7e053640 1 -- 172.21.15.46:0/1075191494 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f9a78108f40 con 0x7f9a78104a30 2024-09-21T03:46:52.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.717+0000 7f9a74ff9640 1 -- 172.21.15.46:0/1075191494 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v24)=0 v24) ==== 138+0+0 (secure 0 0 0) 0x7f9a680d2430 con 0x7f9a78104a30 2024-09-21T03:46:52.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.720+0000 7f9a7e053640 1 -- 172.21.15.46:0/1075191494 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f9a600b64d0 msgr2=0x7f9a600b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:52.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.720+0000 7f9a7e053640 1 --2- 172.21.15.46:0/1075191494 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f9a600b64d0 0x7f9a600b89e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9a7807a020 tx=0x7f9a6c005f90 comp rx=0 tx=0).stop 2024-09-21T03:46:52.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.720+0000 7f9a7e053640 1 -- 172.21.15.46:0/1075191494 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a78104a30 msgr2=0x7f9a7819a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:52.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.720+0000 7f9a7e053640 1 --2- 172.21.15.46:0/1075191494 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a78104a30 0x7f9a7819a550 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9a68005940 tx=0x7f9a680040c0 comp rx=0 tx=0).stop 2024-09-21T03:46:52.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.720+0000 7f9a7e053640 1 -- 172.21.15.46:0/1075191494 shutdown_connections 2024-09-21T03:46:52.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.720+0000 7f9a7e053640 1 --2- 172.21.15.46:0/1075191494 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f9a600b64d0 0x7f9a600b89e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:52.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.720+0000 7f9a7e053640 1 --2- 172.21.15.46:0/1075191494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a7810de60 0x7f9a7819fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:52.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.720+0000 7f9a7e053640 1 --2- 172.21.15.46:0/1075191494 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a78105380 0x7f9a7819aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:52.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.720+0000 7f9a7e053640 1 --2- 172.21.15.46:0/1075191494 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a78104a30 0x7f9a7819a550 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:52.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.720+0000 7f9a7e053640 1 -- 172.21.15.46:0/1075191494 >> 172.21.15.46:0/1075191494 conn(0x7f9a780797b0 msgr2=0x7f9a780ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:52.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.720+0000 7f9a7e053640 1 -- 172.21.15.46:0/1075191494 shutdown_connections 2024-09-21T03:46:52.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:49.720+0000 7f9a7e053640 1 -- 172.21.15.46:0/1075191494 wait complete. 2024-09-21T03:46:52.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.417+0000 7fe768bd8640 1 -- 172.21.15.46:0/2411081974 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7fe764103a80 con 0x7fe764104870 2024-09-21T03:46:52.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.418+0000 7fe7537fe640 1 -- 172.21.15.46:0/2411081974 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v26)=0 v26) ==== 108+0+0 (secure 0 0 0) 0x7fe754009de0 con 0x7fe764104870 2024-09-21T03:46:52.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.420+0000 7fe768bd8640 1 -- 172.21.15.46:0/2411081974 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe74c0b64d0 msgr2=0x7fe74c0b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:52.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.420+0000 7fe768bd8640 1 --2- 172.21.15.46:0/2411081974 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe74c0b64d0 0x7fe74c0b89e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe758009230 tx=0x7fe758031400 comp rx=0 tx=0).stop 2024-09-21T03:46:52.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.420+0000 7fe768bd8640 1 -- 172.21.15.46:0/2411081974 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe764104870 msgr2=0x7fe764102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:52.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.420+0000 7fe768bd8640 1 --2- 172.21.15.46:0/2411081974 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe764104870 0x7fe764102780 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe75400d950 tx=0x7fe75400de10 comp rx=0 tx=0).stop 2024-09-21T03:46:52.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.420+0000 7fe768bd8640 1 -- 172.21.15.46:0/2411081974 shutdown_connections 2024-09-21T03:46:52.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.420+0000 7fe768bd8640 1 --2- 172.21.15.46:0/2411081974 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe74c0b64d0 0x7fe74c0b89e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:52.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.420+0000 7fe768bd8640 1 --2- 172.21.15.46:0/2411081974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe76410de20 0x7fe764103200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:52.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.420+0000 7fe768bd8640 1 --2- 172.21.15.46:0/2411081974 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7641052a0 0x7fe764102cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:52.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.420+0000 7fe768bd8640 1 --2- 172.21.15.46:0/2411081974 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe764104870 0x7fe764102780 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:52.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.420+0000 7fe768bd8640 1 -- 172.21.15.46:0/2411081974 >> 172.21.15.46:0/2411081974 conn(0x7fe764079730 msgr2=0x7fe7640ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:52.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.421+0000 7fe768bd8640 1 -- 172.21.15.46:0/2411081974 shutdown_connections 2024-09-21T03:46:52.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.421+0000 7fe768bd8640 1 -- 172.21.15.46:0/2411081974 wait complete. 2024-09-21T03:46:52.459 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:52.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:52 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/264281909' entity='client.admin' 2024-09-21T03:46:52.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.949+0000 7fdcc30e4640 1 -- 172.21.15.46:0/3855245552 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcbc103b90 msgr2=0x7fdcbc103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:52.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.949+0000 7fdcc30e4640 1 --2- 172.21.15.46:0/3855245552 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcbc103b90 0x7fdcbc103fa0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0009900 tx=0x7fdcb002a410 comp rx=0 tx=0).stop 2024-09-21T03:46:52.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.949+0000 7fdcc30e4640 1 -- 172.21.15.46:0/3855245552 shutdown_connections 2024-09-21T03:46:52.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.949+0000 7fdcc30e4640 1 --2- 172.21.15.46:0/3855245552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdcbc109e20 0x7fdcbc110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:52.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.949+0000 7fdcc30e4640 1 --2- 172.21.15.46:0/3855245552 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdcbc1094d0 0x7fdcbc1098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:52.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.949+0000 7fdcc30e4640 1 --2- 172.21.15.46:0/3855245552 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcbc103b90 0x7fdcbc103fa0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:52.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.949+0000 7fdcc30e4640 1 -- 172.21.15.46:0/3855245552 >> 172.21.15.46:0/3855245552 conn(0x7fdcbc0ff600 msgr2=0x7fdcbc101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:52.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.949+0000 7fdcc30e4640 1 -- 172.21.15.46:0/3855245552 shutdown_connections 2024-09-21T03:46:52.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.949+0000 7fdcc30e4640 1 -- 172.21.15.46:0/3855245552 wait complete. 2024-09-21T03:46:52.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.950+0000 7fdcc30e4640 1 Processor -- start 2024-09-21T03:46:52.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.950+0000 7fdcc30e4640 1 -- start start 2024-09-21T03:46:52.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.950+0000 7fdcc30e4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdcbc103b90 0x7fdcbc19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:52.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.950+0000 7fdcc30e4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcbc1094d0 0x7fdcbc19aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:52.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.950+0000 7fdcc30e4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdcbc109e20 0x7fdcbc19fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:52.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.950+0000 7fdcc30e4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdcbc113ae0 con 0x7fdcbc1094d0 2024-09-21T03:46:52.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.950+0000 7fdcc30e4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdcbc113960 con 0x7fdcbc103b90 2024-09-21T03:46:52.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.950+0000 7fdcc30e4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdcbc113c60 con 0x7fdcbc109e20 2024-09-21T03:46:52.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.950+0000 7fdcbbfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcbc1094d0 0x7fdcbc19aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:52.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.950+0000 7fdcbbfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcbc1094d0 0x7fdcbc19aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42950/0 (socket says 172.21.15.46:42950) 2024-09-21T03:46:52.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.950+0000 7fdcbbfff640 1 -- 172.21.15.46:0/2562190149 learned_addr learned my addr 172.21.15.46:0/2562190149 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:46:52.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.950+0000 7fdcc1681640 1 --2- 172.21.15.46:0/2562190149 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdcbc109e20 0x7fdcbc19fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:52.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.950+0000 7fdcc0e80640 1 --2- 172.21.15.46:0/2562190149 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdcbc103b90 0x7fdcbc19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:52.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.951+0000 7fdcbbfff640 1 -- 172.21.15.46:0/2562190149 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdcbc109e20 msgr2=0x7fdcbc19fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:52.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.951+0000 7fdcbbfff640 1 --2- 172.21.15.46:0/2562190149 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdcbc109e20 0x7fdcbc19fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:52.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.951+0000 7fdcbbfff640 1 -- 172.21.15.46:0/2562190149 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdcbc103b90 msgr2=0x7fdcbc19a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:52.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.951+0000 7fdcbbfff640 1 --2- 172.21.15.46:0/2562190149 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdcbc103b90 0x7fdcbc19a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:52.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.951+0000 7fdcbbfff640 1 -- 172.21.15.46:0/2562190149 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcbc1a0360 con 0x7fdcbc1094d0 2024-09-21T03:46:52.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.951+0000 7fdcbbfff640 1 --2- 172.21.15.46:0/2562190149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcbc1094d0 0x7fdcbc19aa50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdca800c8c0 tx=0x7fdca800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:52.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.951+0000 7fdcb9ffb640 1 -- 172.21.15.46:0/2562190149 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca8007bb0 con 0x7fdcbc1094d0 2024-09-21T03:46:52.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.951+0000 7fdcb9ffb640 1 -- 172.21.15.46:0/2562190149 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdca8007d50 con 0x7fdcbc1094d0 2024-09-21T03:46:52.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.951+0000 7fdcc30e4640 1 -- 172.21.15.46:0/2562190149 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcbc1a0650 con 0x7fdcbc1094d0 2024-09-21T03:46:52.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.951+0000 7fdcb9ffb640 1 -- 172.21.15.46:0/2562190149 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca80187c0 con 0x7fdcbc1094d0 2024-09-21T03:46:52.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.951+0000 7fdcc30e4640 1 -- 172.21.15.46:0/2562190149 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcbc1a6e70 con 0x7fdcbc1094d0 2024-09-21T03:46:52.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.953+0000 7fdcc30e4640 1 -- 172.21.15.46:0/2562190149 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcbc103fa0 con 0x7fdcbc1094d0 2024-09-21T03:46:52.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.954+0000 7fdcb9ffb640 1 -- 172.21.15.46:0/2562190149 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7fdca800fa20 con 0x7fdcbc1094d0 2024-09-21T03:46:52.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.955+0000 7fdcb9ffb640 1 --2- 172.21.15.46:0/2562190149 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fdcac0b6580 0x7fdcac0b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:52.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.955+0000 7fdcc0e80640 1 --2- 172.21.15.46:0/2562190149 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fdcac0b6580 0x7fdcac0b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:52.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.955+0000 7fdcb9ffb640 1 -- 172.21.15.46:0/2562190149 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fdca80e5770 con 0x7fdcbc1094d0 2024-09-21T03:46:52.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.955+0000 7fdcc0e80640 1 --2- 172.21.15.46:0/2562190149 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fdcac0b6580 0x7fdcac0b8a90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0031440 tx=0x7fdcb0005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:52.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:52.959+0000 7fdcb9ffb640 1 -- 172.21.15.46:0/2562190149 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdca8014030 con 0x7fdcbc1094d0 2024-09-21T03:46:53.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:52 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/264281909' entity='client.admin' 2024-09-21T03:46:53.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:52 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/264281909' entity='client.admin' 2024-09-21T03:46:53.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.149+0000 7fdcc30e4640 1 -- 172.21.15.46:0/2562190149 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7fdcbc10bbf0 con 0x7fdcbc1094d0 2024-09-21T03:46:53.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.153+0000 7fdcb9ffb640 1 -- 172.21.15.46:0/2562190149 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v27)=0 v27) ==== 125+0+0 (secure 0 0 0) 0x7fdca80adb60 con 0x7fdcbc1094d0 2024-09-21T03:46:53.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.156+0000 7fdcc30e4640 1 -- 172.21.15.46:0/2562190149 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fdcac0b6580 msgr2=0x7fdcac0b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:53.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.156+0000 7fdcc30e4640 1 --2- 172.21.15.46:0/2562190149 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fdcac0b6580 0x7fdcac0b8a90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0031440 tx=0x7fdcb0005e80 comp rx=0 tx=0).stop 2024-09-21T03:46:53.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.156+0000 7fdcc30e4640 1 -- 172.21.15.46:0/2562190149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcbc1094d0 msgr2=0x7fdcbc19aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:53.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.156+0000 7fdcc30e4640 1 --2- 172.21.15.46:0/2562190149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcbc1094d0 0x7fdcbc19aa50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdca800c8c0 tx=0x7fdca800cd80 comp rx=0 tx=0).stop 2024-09-21T03:46:53.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.156+0000 7fdcc30e4640 1 -- 172.21.15.46:0/2562190149 shutdown_connections 2024-09-21T03:46:53.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.156+0000 7fdcc30e4640 1 --2- 172.21.15.46:0/2562190149 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fdcac0b6580 0x7fdcac0b8a90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:53.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.156+0000 7fdcc30e4640 1 --2- 172.21.15.46:0/2562190149 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdcbc109e20 0x7fdcbc19fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:53.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.156+0000 7fdcc30e4640 1 --2- 172.21.15.46:0/2562190149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdcbc1094d0 0x7fdcbc19aa50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:53.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.156+0000 7fdcc30e4640 1 --2- 172.21.15.46:0/2562190149 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdcbc103b90 0x7fdcbc19a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:53.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.156+0000 7fdcc30e4640 1 -- 172.21.15.46:0/2562190149 >> 172.21.15.46:0/2562190149 conn(0x7fdcbc0ff600 msgr2=0x7fdcbc101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:53.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.156+0000 7fdcc30e4640 1 -- 172.21.15.46:0/2562190149 shutdown_connections 2024-09-21T03:46:53.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.156+0000 7fdcc30e4640 1 -- 172.21.15.46:0/2562190149 wait complete. 2024-09-21T03:46:53.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:53 smithi046 ceph-mon[30954]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:53.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:53 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/2562190149' entity='client.admin' 2024-09-21T03:46:53.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:53 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/967133885' entity='client.admin' 2024-09-21T03:46:53.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:53 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/2200189133' entity='client.admin' 2024-09-21T03:46:53.905 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:53 smithi105 ceph-mon[34773]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:53.905 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:53 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/2562190149' entity='client.admin' 2024-09-21T03:46:53.905 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:53 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/967133885' entity='client.admin' 2024-09-21T03:46:53.905 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:53 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/2200189133' entity='client.admin' 2024-09-21T03:46:54.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:53 smithi162 ceph-mon[35071]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:54.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:53 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/2562190149' entity='client.admin' 2024-09-21T03:46:54.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:53 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/967133885' entity='client.admin' 2024-09-21T03:46:54.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:53 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/2200189133' entity='client.admin' 2024-09-21T03:46:54.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.308+0000 7f72ee68c640 1 -- 172.21.15.46:0/526672619 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72e8102ae0 msgr2=0x7f72e8102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:54.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.308+0000 7f72ee68c640 1 --2- 172.21.15.46:0/526672619 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72e8102ae0 0x7f72e8102ef0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f72d8009900 tx=0x7f72d802a410 comp rx=0 tx=0).stop 2024-09-21T03:46:54.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.308+0000 7f72ee68c640 1 -- 172.21.15.46:0/526672619 shutdown_connections 2024-09-21T03:46:54.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.308+0000 7f72ee68c640 1 --2- 172.21.15.46:0/526672619 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72e8108d20 0x7f72e810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:54.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.308+0000 7f72ee68c640 1 --2- 172.21.15.46:0/526672619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72e81083d0 0x7f72e81087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:54.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.308+0000 7f72ee68c640 1 --2- 172.21.15.46:0/526672619 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72e8102ae0 0x7f72e8102ef0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:54.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.308+0000 7f72ee68c640 1 -- 172.21.15.46:0/526672619 >> 172.21.15.46:0/526672619 conn(0x7f72e80797b0 msgr2=0x7f72e8079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:54.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.308+0000 7f72ee68c640 1 -- 172.21.15.46:0/526672619 shutdown_connections 2024-09-21T03:46:54.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.308+0000 7f72ee68c640 1 -- 172.21.15.46:0/526672619 wait complete. 2024-09-21T03:46:54.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.309+0000 7f72ee68c640 1 Processor -- start 2024-09-21T03:46:54.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.309+0000 7f72ee68c640 1 -- start start 2024-09-21T03:46:54.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.310+0000 7f72ee68c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72e8102ae0 0x7f72e819a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:54.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.310+0000 7f72ee68c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72e81083d0 0x7f72e819aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:54.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.310+0000 7f72ee68c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72e8108d20 0x7f72e819fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:54.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.310+0000 7f72ee68c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f72e81129e0 con 0x7f72e8108d20 2024-09-21T03:46:54.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.310+0000 7f72ee68c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f72e8112860 con 0x7f72e8102ae0 2024-09-21T03:46:54.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.310+0000 7f72ee68c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f72e8112b60 con 0x7f72e81083d0 2024-09-21T03:46:54.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.310+0000 7f72ecc29640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72e8108d20 0x7f72e819fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:54.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.310+0000 7f72e77fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72e81083d0 0x7f72e819aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:54.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.310+0000 7f72ecc29640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72e8108d20 0x7f72e819fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42966/0 (socket says 172.21.15.46:42966) 2024-09-21T03:46:54.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.310+0000 7f72ecc29640 1 -- 172.21.15.46:0/967133885 learned_addr learned my addr 172.21.15.46:0/967133885 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:46:54.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.310+0000 7f72e7fff640 1 --2- 172.21.15.46:0/967133885 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72e8102ae0 0x7f72e819a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:54.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.310+0000 7f72ecc29640 1 -- 172.21.15.46:0/967133885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72e81083d0 msgr2=0x7f72e819aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:54.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.310+0000 7f72ecc29640 1 --2- 172.21.15.46:0/967133885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72e81083d0 0x7f72e819aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:54.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.310+0000 7f72ecc29640 1 -- 172.21.15.46:0/967133885 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72e8102ae0 msgr2=0x7f72e819a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:54.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.310+0000 7f72ecc29640 1 --2- 172.21.15.46:0/967133885 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72e8102ae0 0x7f72e819a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:54.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.310+0000 7f72ecc29640 1 -- 172.21.15.46:0/967133885 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72e81a04b0 con 0x7f72e8108d20 2024-09-21T03:46:54.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.310+0000 7f72e7fff640 1 --2- 172.21.15.46:0/967133885 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72e8102ae0 0x7f72e819a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:46:54.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.310+0000 7f72ecc29640 1 --2- 172.21.15.46:0/967133885 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72e8108d20 0x7f72e819fd80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f72e000eaa0 tx=0x7f72e000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:54.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.311+0000 7f72e57fa640 1 -- 172.21.15.46:0/967133885 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e000cdb0 con 0x7f72e8108d20 2024-09-21T03:46:54.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.311+0000 7f72e57fa640 1 -- 172.21.15.46:0/967133885 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72e0005020 con 0x7f72e8108d20 2024-09-21T03:46:54.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.311+0000 7f72e57fa640 1 -- 172.21.15.46:0/967133885 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e00116d0 con 0x7f72e8108d20 2024-09-21T03:46:54.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.311+0000 7f72ee68c640 1 -- 172.21.15.46:0/967133885 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72e81a07a0 con 0x7f72e8108d20 2024-09-21T03:46:54.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.311+0000 7f72ee68c640 1 -- 172.21.15.46:0/967133885 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72e80ff550 con 0x7f72e8108d20 2024-09-21T03:46:54.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.312+0000 7f72ee68c640 1 -- 172.21.15.46:0/967133885 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72e8103d10 con 0x7f72e8108d20 2024-09-21T03:46:54.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.315+0000 7f72e57fa640 1 -- 172.21.15.46:0/967133885 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f72e00051d0 con 0x7f72e8108d20 2024-09-21T03:46:54.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.316+0000 7f72e57fa640 1 --2- 172.21.15.46:0/967133885 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f72d00b6550 0x7f72d00b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:54.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.316+0000 7f72e7fff640 1 --2- 172.21.15.46:0/967133885 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f72d00b6550 0x7f72d00b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:54.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.316+0000 7f72e57fa640 1 -- 172.21.15.46:0/967133885 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f72e00e5af0 con 0x7f72e8108d20 2024-09-21T03:46:54.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.316+0000 7f72e7fff640 1 --2- 172.21.15.46:0/967133885 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f72d00b6550 0x7f72d00b8a60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f72d8031440 tx=0x7f72d8032ed0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:54.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.319+0000 7f72e57fa640 1 -- 172.21.15.46:0/967133885 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f72e0016030 con 0x7f72e8108d20 2024-09-21T03:46:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.512+0000 7f72ee68c640 1 -- 172.21.15.46:0/967133885 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f72e810bb60 con 0x7f72e8108d20 2024-09-21T03:46:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.516+0000 7f72e57fa640 1 -- 172.21.15.46:0/967133885 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v28)=0 v28) ==== 121+0+0 (secure 0 0 0) 0x7f72e00b23e0 con 0x7f72e8108d20 2024-09-21T03:46:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.519+0000 7f72ee68c640 1 -- 172.21.15.46:0/967133885 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f72d00b6550 msgr2=0x7f72d00b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.519+0000 7f72ee68c640 1 --2- 172.21.15.46:0/967133885 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f72d00b6550 0x7f72d00b8a60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f72d8031440 tx=0x7f72d8032ed0 comp rx=0 tx=0).stop 2024-09-21T03:46:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.519+0000 7f72ee68c640 1 -- 172.21.15.46:0/967133885 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72e8108d20 msgr2=0x7f72e819fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.519+0000 7f72ee68c640 1 --2- 172.21.15.46:0/967133885 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72e8108d20 0x7f72e819fd80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f72e000eaa0 tx=0x7f72e000ef60 comp rx=0 tx=0).stop 2024-09-21T03:46:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.519+0000 7f72ee68c640 1 -- 172.21.15.46:0/967133885 shutdown_connections 2024-09-21T03:46:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.519+0000 7f72ee68c640 1 --2- 172.21.15.46:0/967133885 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72e8108d20 0x7f72e819fd80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.519+0000 7f72ee68c640 1 --2- 172.21.15.46:0/967133885 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f72d00b6550 0x7f72d00b8a60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.519+0000 7f72ee68c640 1 --2- 172.21.15.46:0/967133885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72e81083d0 0x7f72e819aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.519+0000 7f72ee68c640 1 --2- 172.21.15.46:0/967133885 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72e8102ae0 0x7f72e819a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.519+0000 7f72ee68c640 1 -- 172.21.15.46:0/967133885 >> 172.21.15.46:0/967133885 conn(0x7f72e80797b0 msgr2=0x7f72e8101b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.519+0000 7f72ee68c640 1 -- 172.21.15.46:0/967133885 shutdown_connections 2024-09-21T03:46:54.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.519+0000 7f72ee68c640 1 -- 172.21.15.46:0/967133885 wait complete. 2024-09-21T03:46:54.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.393+0000 7f004cdaa640 1 -- 172.21.15.46:0/988252885 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0048108cf0 msgr2=0x7f004810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:54.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.393+0000 7f004cdaa640 1 --2- 172.21.15.46:0/988252885 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0048108cf0 0x7f004810f520 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0038009900 tx=0x7f003802a410 comp rx=0 tx=0).stop 2024-09-21T03:46:54.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.393+0000 7f004cdaa640 1 -- 172.21.15.46:0/988252885 shutdown_connections 2024-09-21T03:46:54.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.393+0000 7f004cdaa640 1 --2- 172.21.15.46:0/988252885 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0048108cf0 0x7f004810f520 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:54.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.393+0000 7f004cdaa640 1 --2- 172.21.15.46:0/988252885 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00481083a0 0x7f00481087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:54.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.393+0000 7f004cdaa640 1 --2- 172.21.15.46:0/988252885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0048102a60 0x7f0048102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:54.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.393+0000 7f004cdaa640 1 -- 172.21.15.46:0/988252885 >> 172.21.15.46:0/988252885 conn(0x7f0048079730 msgr2=0x7f0048079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:54.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.394+0000 7f004cdaa640 1 -- 172.21.15.46:0/988252885 shutdown_connections 2024-09-21T03:46:54.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.394+0000 7f004cdaa640 1 -- 172.21.15.46:0/988252885 wait complete. 2024-09-21T03:46:54.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.394+0000 7f004cdaa640 1 Processor -- start 2024-09-21T03:46:54.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.394+0000 7f004cdaa640 1 -- start start 2024-09-21T03:46:54.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.395+0000 7f004cdaa640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0048102a60 0x7f004819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:54.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.395+0000 7f004cdaa640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00481083a0 0x7f004819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:54.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.395+0000 7f004cdaa640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0048108cf0 0x7f004819fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:54.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.395+0000 7f004cdaa640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f00481129c0 con 0x7f0048108cf0 2024-09-21T03:46:54.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.395+0000 7f004cdaa640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0048112840 con 0x7f00481083a0 2024-09-21T03:46:54.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.395+0000 7f004cdaa640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0048112b40 con 0x7f0048102a60 2024-09-21T03:46:54.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.395+0000 7f0046d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0048108cf0 0x7f004819fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:54.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.395+0000 7f0046d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0048108cf0 0x7f004819fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42990/0 (socket says 172.21.15.46:42990) 2024-09-21T03:46:54.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.395+0000 7f0046d9d640 1 -- 172.21.15.46:0/2200189133 learned_addr learned my addr 172.21.15.46:0/2200189133 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:46:54.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.395+0000 7f004659c640 1 --2- 172.21.15.46:0/2200189133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0048102a60 0x7f004819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:54.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.395+0000 7f0045d9b640 1 --2- 172.21.15.46:0/2200189133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00481083a0 0x7f004819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:54.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.395+0000 7f0046d9d640 1 -- 172.21.15.46:0/2200189133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0048102a60 msgr2=0x7f004819a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:54.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.395+0000 7f0046d9d640 1 --2- 172.21.15.46:0/2200189133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0048102a60 0x7f004819a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:54.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.395+0000 7f0046d9d640 1 -- 172.21.15.46:0/2200189133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00481083a0 msgr2=0x7f004819aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:54.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.395+0000 7f0046d9d640 1 --2- 172.21.15.46:0/2200189133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00481083a0 0x7f004819aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:54.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.395+0000 7f0046d9d640 1 -- 172.21.15.46:0/2200189133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00481a0330 con 0x7f0048108cf0 2024-09-21T03:46:54.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.396+0000 7f0046d9d640 1 --2- 172.21.15.46:0/2200189133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0048108cf0 0x7f004819fcc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0038009a20 tx=0x7f0038004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:54.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.396+0000 7f003f7fe640 1 -- 172.21.15.46:0/2200189133 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f003803f030 con 0x7f0048108cf0 2024-09-21T03:46:54.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.396+0000 7f004cdaa640 1 -- 172.21.15.46:0/2200189133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00481a05c0 con 0x7f0048108cf0 2024-09-21T03:46:54.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.396+0000 7f003f7fe640 1 -- 172.21.15.46:0/2200189133 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0038003aa0 con 0x7f0048108cf0 2024-09-21T03:46:54.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.396+0000 7f004cdaa640 1 -- 172.21.15.46:0/2200189133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00481a6e40 con 0x7f0048108cf0 2024-09-21T03:46:54.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.396+0000 7f003f7fe640 1 -- 172.21.15.46:0/2200189133 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0038035070 con 0x7f0048108cf0 2024-09-21T03:46:54.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.397+0000 7f004cdaa640 1 -- 172.21.15.46:0/2200189133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0048102e70 con 0x7f0048108cf0 2024-09-21T03:46:54.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.399+0000 7f003f7fe640 1 -- 172.21.15.46:0/2200189133 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f0038042030 con 0x7f0048108cf0 2024-09-21T03:46:54.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.399+0000 7f003f7fe640 1 --2- 172.21.15.46:0/2200189133 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f00340b6500 0x7f00340b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:54.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.400+0000 7f004659c640 1 --2- 172.21.15.46:0/2200189133 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f00340b6500 0x7f00340b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:54.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.400+0000 7f003f7fe640 1 -- 172.21.15.46:0/2200189133 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f0038105910 con 0x7f0048108cf0 2024-09-21T03:46:54.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.400+0000 7f004659c640 1 --2- 172.21.15.46:0/2200189133 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f00340b6500 0x7f00340b8a10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f004000a400 tx=0x7f004000d040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:54.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.404+0000 7f003f7fe640 1 -- 172.21.15.46:0/2200189133 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f00380cdda0 con 0x7f0048108cf0 2024-09-21T03:46:54.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.595+0000 7f004cdaa640 1 -- 172.21.15.46:0/2200189133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f004810baf0 con 0x7f0048108cf0 2024-09-21T03:46:54.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.599+0000 7f003f7fe640 1 -- 172.21.15.46:0/2200189133 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v29)=0 v29) ==== 120+0+0 (secure 0 0 0) 0x7f00380d2180 con 0x7f0048108cf0 2024-09-21T03:46:54.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.601+0000 7f004cdaa640 1 -- 172.21.15.46:0/2200189133 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f00340b6500 msgr2=0x7f00340b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:54.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.601+0000 7f004cdaa640 1 --2- 172.21.15.46:0/2200189133 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f00340b6500 0x7f00340b8a10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f004000a400 tx=0x7f004000d040 comp rx=0 tx=0).stop 2024-09-21T03:46:54.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.601+0000 7f004cdaa640 1 -- 172.21.15.46:0/2200189133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0048108cf0 msgr2=0x7f004819fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:54.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.601+0000 7f004cdaa640 1 --2- 172.21.15.46:0/2200189133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0048108cf0 0x7f004819fcc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0038009a20 tx=0x7f0038004270 comp rx=0 tx=0).stop 2024-09-21T03:46:54.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.601+0000 7f004cdaa640 1 -- 172.21.15.46:0/2200189133 shutdown_connections 2024-09-21T03:46:54.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.601+0000 7f004cdaa640 1 --2- 172.21.15.46:0/2200189133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0048108cf0 0x7f004819fcc0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:54.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.601+0000 7f004cdaa640 1 --2- 172.21.15.46:0/2200189133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00481083a0 0x7f004819aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:54.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.601+0000 7f004cdaa640 1 --2- 172.21.15.46:0/2200189133 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f00340b6500 0x7f00340b8a10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:54.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.601+0000 7f004cdaa640 1 --2- 172.21.15.46:0/2200189133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0048102a60 0x7f004819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:54.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.601+0000 7f004cdaa640 1 -- 172.21.15.46:0/2200189133 >> 172.21.15.46:0/2200189133 conn(0x7f0048079730 msgr2=0x7f004806b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:54.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.601+0000 7f004cdaa640 1 -- 172.21.15.46:0/2200189133 shutdown_connections 2024-09-21T03:46:54.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:53.601+0000 7f004cdaa640 1 -- 172.21.15.46:0/2200189133 wait complete. 2024-09-21T03:46:55.165 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:55.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:55 smithi046 ceph-mon[30954]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:56.067 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:55 smithi105 ceph-mon[34773]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:55 smithi162 ceph-mon[35071]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:56.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.488+0000 7efff5e44640 1 -- 172.21.15.46:0/140683478 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efff01048b0 msgr2=0x7efff0104cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:56.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.488+0000 7efff5e44640 1 --2- 172.21.15.46:0/140683478 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efff01048b0 0x7efff0104cc0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7effe0009900 tx=0x7effe002a410 comp rx=0 tx=0).stop 2024-09-21T03:46:56.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.488+0000 7efff5e44640 1 -- 172.21.15.46:0/140683478 shutdown_connections 2024-09-21T03:46:56.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.488+0000 7efff5e44640 1 --2- 172.21.15.46:0/140683478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efff010de60 0x7efff0110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:56.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.488+0000 7efff5e44640 1 --2- 172.21.15.46:0/140683478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efff01052e0 0x7efff010d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:56.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.488+0000 7efff5e44640 1 --2- 172.21.15.46:0/140683478 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efff01048b0 0x7efff0104cc0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:56.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.488+0000 7efff5e44640 1 -- 172.21.15.46:0/140683478 >> 172.21.15.46:0/140683478 conn(0x7efff0079730 msgr2=0x7efff0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:56.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.488+0000 7efff5e44640 1 -- 172.21.15.46:0/140683478 shutdown_connections 2024-09-21T03:46:56.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.488+0000 7efff5e44640 1 -- 172.21.15.46:0/140683478 wait complete. 2024-09-21T03:46:56.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.489+0000 7efff5e44640 1 Processor -- start 2024-09-21T03:46:56.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.489+0000 7efff5e44640 1 -- start start 2024-09-21T03:46:56.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.489+0000 7efff5e44640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efff01048b0 0x7efff019a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:56.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.489+0000 7efff5e44640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efff01052e0 0x7efff019aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:56.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.489+0000 7efff5e44640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efff010de60 0x7efff019fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:56.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.489+0000 7efff5e44640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7efff0113a70 con 0x7efff01052e0 2024-09-21T03:46:56.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.489+0000 7efff5e44640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efff01138f0 con 0x7efff01048b0 2024-09-21T03:46:56.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.489+0000 7efff5e44640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efff0113bf0 con 0x7efff010de60 2024-09-21T03:46:56.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.490+0000 7effe6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efff01052e0 0x7efff019aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:56.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.490+0000 7effe6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efff01052e0 0x7efff019aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43016/0 (socket says 172.21.15.46:43016) 2024-09-21T03:46:56.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.490+0000 7effe6ffd640 1 -- 172.21.15.46:0/1930241378 learned_addr learned my addr 172.21.15.46:0/1930241378 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:46:56.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.490+0000 7effef7fe640 1 --2- 172.21.15.46:0/1930241378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efff01048b0 0x7efff019a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:56.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.490+0000 7effeffff640 1 --2- 172.21.15.46:0/1930241378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efff010de60 0x7efff019fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:56.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.490+0000 7effe6ffd640 1 -- 172.21.15.46:0/1930241378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efff010de60 msgr2=0x7efff019fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:56.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.490+0000 7effe6ffd640 1 --2- 172.21.15.46:0/1930241378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efff010de60 0x7efff019fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:56.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.490+0000 7effe6ffd640 1 -- 172.21.15.46:0/1930241378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efff01048b0 msgr2=0x7efff019a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:56.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.490+0000 7effe6ffd640 1 --2- 172.21.15.46:0/1930241378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efff01048b0 0x7efff019a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:56.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.490+0000 7effe6ffd640 1 -- 172.21.15.46:0/1930241378 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efff01a0490 con 0x7efff01052e0 2024-09-21T03:46:56.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.490+0000 7effef7fe640 1 --2- 172.21.15.46:0/1930241378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efff01048b0 0x7efff019a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:46:56.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.490+0000 7effe6ffd640 1 --2- 172.21.15.46:0/1930241378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efff01052e0 0x7efff019aac0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7effd800d740 tx=0x7effd800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:56.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.490+0000 7effed7fa640 1 -- 172.21.15.46:0/1930241378 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd8017070 con 0x7efff01052e0 2024-09-21T03:46:56.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.491+0000 7efff5e44640 1 -- 172.21.15.46:0/1930241378 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efff01a0780 con 0x7efff01052e0 2024-09-21T03:46:56.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.491+0000 7effed7fa640 1 -- 172.21.15.46:0/1930241378 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effd800de50 con 0x7efff01052e0 2024-09-21T03:46:56.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.491+0000 7effed7fa640 1 -- 172.21.15.46:0/1930241378 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd8004ce0 con 0x7efff01052e0 2024-09-21T03:46:56.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.491+0000 7efff5e44640 1 -- 172.21.15.46:0/1930241378 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efff01026a0 con 0x7efff01052e0 2024-09-21T03:46:56.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.492+0000 7efff5e44640 1 -- 172.21.15.46:0/1930241378 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efff006c120 con 0x7efff01052e0 2024-09-21T03:46:56.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.494+0000 7effed7fa640 1 -- 172.21.15.46:0/1930241378 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7effd8004e80 con 0x7efff01052e0 2024-09-21T03:46:56.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.495+0000 7effed7fa640 1 --2- 172.21.15.46:0/1930241378 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7effdc0b64d0 0x7effdc0b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:56.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.495+0000 7effef7fe640 1 --2- 172.21.15.46:0/1930241378 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7effdc0b64d0 0x7effdc0b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:56.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.495+0000 7effed7fa640 1 -- 172.21.15.46:0/1930241378 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7effd80e54f0 con 0x7efff01052e0 2024-09-21T03:46:56.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.496+0000 7effef7fe640 1 --2- 172.21.15.46:0/1930241378 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7effdc0b64d0 0x7effdc0b89e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7effe0000c00 tx=0x7effe0031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:56.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.499+0000 7effed7fa640 1 -- 172.21.15.46:0/1930241378 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7effd80b1cc0 con 0x7efff01052e0 2024-09-21T03:46:56.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.147+0000 7f576eda4640 1 -- 172.21.15.46:0/3452037995 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5768103bc0 msgr2=0x7f5768103fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:56.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.147+0000 7f576eda4640 1 --2- 172.21.15.46:0/3452037995 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5768103bc0 0x7f5768103fd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f575c009900 tx=0x7f575c02a410 comp rx=0 tx=0).stop 2024-09-21T03:46:56.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.147+0000 7f576eda4640 1 -- 172.21.15.46:0/3452037995 shutdown_connections 2024-09-21T03:46:56.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.147+0000 7f576eda4640 1 --2- 172.21.15.46:0/3452037995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5768109e00 0x7f5768110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:56.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.147+0000 7f576eda4640 1 --2- 172.21.15.46:0/3452037995 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57681094b0 0x7f57681098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:56.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.147+0000 7f576eda4640 1 --2- 172.21.15.46:0/3452037995 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5768103bc0 0x7f5768103fd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:56.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.147+0000 7f576eda4640 1 -- 172.21.15.46:0/3452037995 >> 172.21.15.46:0/3452037995 conn(0x7f576807b910 msgr2=0x7f576807bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:56.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.147+0000 7f576eda4640 1 -- 172.21.15.46:0/3452037995 shutdown_connections 2024-09-21T03:46:56.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.147+0000 7f576eda4640 1 -- 172.21.15.46:0/3452037995 wait complete. 2024-09-21T03:46:56.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.148+0000 7f576eda4640 1 Processor -- start 2024-09-21T03:46:56.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.148+0000 7f576eda4640 1 -- start start 2024-09-21T03:46:56.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.148+0000 7f576eda4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5768103bc0 0x7f5768075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:56.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.148+0000 7f576eda4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57681094b0 0x7f5768075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:56.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.148+0000 7f576eda4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5768109e00 0x7f5768076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:56.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.148+0000 7f576eda4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5768113ac0 con 0x7f57681094b0 2024-09-21T03:46:56.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.148+0000 7f576eda4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5768113940 con 0x7f5768103bc0 2024-09-21T03:46:56.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.148+0000 7f576eda4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5768113c40 con 0x7f5768109e00 2024-09-21T03:46:56.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.148+0000 7f5767fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57681094b0 0x7f5768075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:56.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.149+0000 7f5767fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57681094b0 0x7f5768075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42998/0 (socket says 172.21.15.46:42998) 2024-09-21T03:46:56.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.149+0000 7f5767fff640 1 -- 172.21.15.46:0/2951088424 learned_addr learned my addr 172.21.15.46:0/2951088424 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:46:56.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.149+0000 7f576cb40640 1 --2- 172.21.15.46:0/2951088424 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5768103bc0 0x7f5768075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:56.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.149+0000 7f576d341640 1 --2- 172.21.15.46:0/2951088424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5768109e00 0x7f5768076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:56.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.149+0000 7f5767fff640 1 -- 172.21.15.46:0/2951088424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5768109e00 msgr2=0x7f5768076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:56.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.149+0000 7f5767fff640 1 --2- 172.21.15.46:0/2951088424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5768109e00 0x7f5768076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:56.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.149+0000 7f5767fff640 1 -- 172.21.15.46:0/2951088424 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5768103bc0 msgr2=0x7f5768075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:56.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.149+0000 7f5767fff640 1 --2- 172.21.15.46:0/2951088424 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5768103bc0 0x7f5768075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:56.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.149+0000 7f5767fff640 1 -- 172.21.15.46:0/2951088424 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57681a8730 con 0x7f57681094b0 2024-09-21T03:46:56.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.149+0000 7f5767fff640 1 --2- 172.21.15.46:0/2951088424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57681094b0 0x7f5768075c50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f575400e9f0 tx=0x7f575400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:56.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.149+0000 7f5765ffb640 1 -- 172.21.15.46:0/2951088424 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f575400ccc0 con 0x7f57681094b0 2024-09-21T03:46:56.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.149+0000 7f5765ffb640 1 -- 172.21.15.46:0/2951088424 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57540108e0 con 0x7f57681094b0 2024-09-21T03:46:56.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.149+0000 7f576eda4640 1 -- 172.21.15.46:0/2951088424 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57681a8a20 con 0x7f57681094b0 2024-09-21T03:46:56.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.149+0000 7f5765ffb640 1 -- 172.21.15.46:0/2951088424 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5754018860 con 0x7f57681094b0 2024-09-21T03:46:56.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.150+0000 7f576eda4640 1 -- 172.21.15.46:0/2951088424 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57681a8f60 con 0x7f57681094b0 2024-09-21T03:46:56.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.150+0000 7f576eda4640 1 -- 172.21.15.46:0/2951088424 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5768103fd0 con 0x7f57681094b0 2024-09-21T03:46:56.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.152+0000 7f5765ffb640 1 -- 172.21.15.46:0/2951088424 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f5754010430 con 0x7f57681094b0 2024-09-21T03:46:56.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.153+0000 7f5765ffb640 1 --2- 172.21.15.46:0/2951088424 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f57580b64d0 0x7f57580b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:56.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.153+0000 7f576cb40640 1 --2- 172.21.15.46:0/2951088424 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f57580b64d0 0x7f57580b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:56.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.153+0000 7f5765ffb640 1 -- 172.21.15.46:0/2951088424 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f57540e5fe0 con 0x7f57681094b0 2024-09-21T03:46:56.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.154+0000 7f576cb40640 1 --2- 172.21.15.46:0/2951088424 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f57580b64d0 0x7f57580b89e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f575c000c00 tx=0x7f575c031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:56.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.156+0000 7f5765ffb640 1 -- 172.21.15.46:0/2951088424 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f57540ae3d0 con 0x7f57681094b0 2024-09-21T03:46:56.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.344+0000 7f576eda4640 1 -- 172.21.15.46:0/2951088424 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f576802e640 con 0x7f57681094b0 2024-09-21T03:46:56.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.348+0000 7f5765ffb640 1 -- 172.21.15.46:0/2951088424 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v30)=0 v30) ==== 119+0+0 (secure 0 0 0) 0x7f57540b27b0 con 0x7f57681094b0 2024-09-21T03:46:56.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.350+0000 7f576eda4640 1 -- 172.21.15.46:0/2951088424 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f57580b64d0 msgr2=0x7f57580b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:56.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.350+0000 7f576eda4640 1 --2- 172.21.15.46:0/2951088424 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f57580b64d0 0x7f57580b89e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f575c000c00 tx=0x7f575c031400 comp rx=0 tx=0).stop 2024-09-21T03:46:56.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.350+0000 7f576eda4640 1 -- 172.21.15.46:0/2951088424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57681094b0 msgr2=0x7f5768075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:56.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.350+0000 7f576eda4640 1 --2- 172.21.15.46:0/2951088424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57681094b0 0x7f5768075c50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f575400e9f0 tx=0x7f575400eeb0 comp rx=0 tx=0).stop 2024-09-21T03:46:56.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.351+0000 7f576eda4640 1 -- 172.21.15.46:0/2951088424 shutdown_connections 2024-09-21T03:46:56.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.351+0000 7f576eda4640 1 --2- 172.21.15.46:0/2951088424 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f57580b64d0 0x7f57580b89e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:56.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.351+0000 7f576eda4640 1 --2- 172.21.15.46:0/2951088424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5768109e00 0x7f5768076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:56.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.351+0000 7f576eda4640 1 --2- 172.21.15.46:0/2951088424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57681094b0 0x7f5768075c50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:56.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.351+0000 7f576eda4640 1 --2- 172.21.15.46:0/2951088424 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5768103bc0 0x7f5768075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:56.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.351+0000 7f576eda4640 1 -- 172.21.15.46:0/2951088424 >> 172.21.15.46:0/2951088424 conn(0x7f576807b910 msgr2=0x7f5768107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:56.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.351+0000 7f576eda4640 1 -- 172.21.15.46:0/2951088424 shutdown_connections 2024-09-21T03:46:56.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.351+0000 7f576eda4640 1 -- 172.21.15.46:0/2951088424 wait complete. 2024-09-21T03:46:56.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.689+0000 7efff5e44640 1 -- 172.21.15.46:0/1930241378 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7efff019b6e0 con 0x7efff01052e0 2024-09-21T03:46:56.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.693+0000 7effed7fa640 1 -- 172.21.15.46:0/1930241378 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v31)=0 v31) ==== 129+0+0 (secure 0 0 0) 0x7efff019b6e0 con 0x7efff01052e0 2024-09-21T03:46:56.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.696+0000 7efff5e44640 1 -- 172.21.15.46:0/1930241378 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7effdc0b64d0 msgr2=0x7effdc0b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:56.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.696+0000 7efff5e44640 1 --2- 172.21.15.46:0/1930241378 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7effdc0b64d0 0x7effdc0b89e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7effe0000c00 tx=0x7effe0031400 comp rx=0 tx=0).stop 2024-09-21T03:46:56.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.696+0000 7efff5e44640 1 -- 172.21.15.46:0/1930241378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efff01052e0 msgr2=0x7efff019aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:56.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.696+0000 7efff5e44640 1 --2- 172.21.15.46:0/1930241378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efff01052e0 0x7efff019aac0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7effd800d740 tx=0x7effd800dc00 comp rx=0 tx=0).stop 2024-09-21T03:46:56.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.696+0000 7efff5e44640 1 -- 172.21.15.46:0/1930241378 shutdown_connections 2024-09-21T03:46:56.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.696+0000 7efff5e44640 1 --2- 172.21.15.46:0/1930241378 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7effdc0b64d0 0x7effdc0b89e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:56.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.696+0000 7efff5e44640 1 --2- 172.21.15.46:0/1930241378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efff010de60 0x7efff019fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:56.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.696+0000 7efff5e44640 1 --2- 172.21.15.46:0/1930241378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efff01052e0 0x7efff019aac0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:56.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.696+0000 7efff5e44640 1 --2- 172.21.15.46:0/1930241378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efff01048b0 0x7efff019a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:56.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.696+0000 7efff5e44640 1 -- 172.21.15.46:0/1930241378 >> 172.21.15.46:0/1930241378 conn(0x7efff0079730 msgr2=0x7efff00ff750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:56.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.696+0000 7efff5e44640 1 -- 172.21.15.46:0/1930241378 shutdown_connections 2024-09-21T03:46:56.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:56.696+0000 7efff5e44640 1 -- 172.21.15.46:0/1930241378 wait complete. 2024-09-21T03:46:57.383 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a82de5ec-77cb-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi046') 2024-09-21T03:46:57.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:57 smithi162 ceph-mon[35071]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:57.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:57 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/2951088424' entity='client.admin' 2024-09-21T03:46:57.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:57 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/1930241378' entity='client.admin' 2024-09-21T03:46:57.693 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:57 smithi046 ceph-mon[30954]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:57.693 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:57 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/2951088424' entity='client.admin' 2024-09-21T03:46:57.693 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:57 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/1930241378' entity='client.admin' 2024-09-21T03:46:57.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.800+0000 7fb96712d640 1 -- 172.21.15.46:0/126000649 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9601094f0 msgr2=0x7fb960109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:57.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.800+0000 7fb96712d640 1 --2- 172.21.15.46:0/126000649 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9601094f0 0x7fb960109900 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb950009900 tx=0x7fb95002a410 comp rx=0 tx=0).stop 2024-09-21T03:46:57.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.800+0000 7fb96712d640 1 -- 172.21.15.46:0/126000649 shutdown_connections 2024-09-21T03:46:57.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.800+0000 7fb96712d640 1 --2- 172.21.15.46:0/126000649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb960109e40 0x7fb960110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:57.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.800+0000 7fb96712d640 1 --2- 172.21.15.46:0/126000649 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9601094f0 0x7fb960109900 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:57.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.800+0000 7fb96712d640 1 --2- 172.21.15.46:0/126000649 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb960103bb0 0x7fb960103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:57.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.800+0000 7fb96712d640 1 -- 172.21.15.46:0/126000649 >> 172.21.15.46:0/126000649 conn(0x7fb9600ff600 msgr2=0x7fb960101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:57.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.800+0000 7fb96712d640 1 -- 172.21.15.46:0/126000649 shutdown_connections 2024-09-21T03:46:57.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.800+0000 7fb96712d640 1 -- 172.21.15.46:0/126000649 wait complete. 2024-09-21T03:46:57.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.801+0000 7fb96712d640 1 Processor -- start 2024-09-21T03:46:57.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.801+0000 7fb96712d640 1 -- start start 2024-09-21T03:46:57.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.801+0000 7fb96712d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb960103bb0 0x7fb960075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:57.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.801+0000 7fb96712d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9601094f0 0x7fb960075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:57.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.801+0000 7fb96712d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb960109e40 0x7fb960076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:57.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.801+0000 7fb96712d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb960113b00 con 0x7fb9601094f0 2024-09-21T03:46:57.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.801+0000 7fb96712d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb960113980 con 0x7fb960109e40 2024-09-21T03:46:57.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.801+0000 7fb96712d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb960113c80 con 0x7fb960103bb0 2024-09-21T03:46:57.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.801+0000 7fb957fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9601094f0 0x7fb960075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:57.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.801+0000 7fb957fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9601094f0 0x7fb960075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43040/0 (socket says 172.21.15.46:43040) 2024-09-21T03:46:57.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.801+0000 7fb957fff640 1 -- 172.21.15.46:0/443244246 learned_addr learned my addr 172.21.15.46:0/443244246 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:46:57.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.802+0000 7fb9656ca640 1 --2- 172.21.15.46:0/443244246 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb960109e40 0x7fb960076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:57.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.802+0000 7fb964ec9640 1 --2- 172.21.15.46:0/443244246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb960103bb0 0x7fb960075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:57.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.802+0000 7fb957fff640 1 -- 172.21.15.46:0/443244246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb960103bb0 msgr2=0x7fb960075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:57.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.802+0000 7fb957fff640 1 --2- 172.21.15.46:0/443244246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb960103bb0 0x7fb960075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:57.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.802+0000 7fb957fff640 1 -- 172.21.15.46:0/443244246 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb960109e40 msgr2=0x7fb960076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:57.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.802+0000 7fb957fff640 1 --2- 172.21.15.46:0/443244246 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb960109e40 0x7fb960076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:57.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.802+0000 7fb957fff640 1 -- 172.21.15.46:0/443244246 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9601a8790 con 0x7fb9601094f0 2024-09-21T03:46:57.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.802+0000 7fb9656ca640 1 --2- 172.21.15.46:0/443244246 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb960109e40 0x7fb960076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:46:57.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.802+0000 7fb957fff640 1 --2- 172.21.15.46:0/443244246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9601094f0 0x7fb960075c50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb95002a930 tx=0x7fb950004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:57.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.802+0000 7fb955ffb640 1 -- 172.21.15.46:0/443244246 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95003f030 con 0x7fb9601094f0 2024-09-21T03:46:57.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.802+0000 7fb955ffb640 1 -- 172.21.15.46:0/443244246 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb950003aa0 con 0x7fb9601094f0 2024-09-21T03:46:57.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.802+0000 7fb96712d640 1 -- 172.21.15.46:0/443244246 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9601a8a20 con 0x7fb9601094f0 2024-09-21T03:46:57.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.802+0000 7fb955ffb640 1 -- 172.21.15.46:0/443244246 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb950035070 con 0x7fb9601094f0 2024-09-21T03:46:57.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.803+0000 7fb96712d640 1 -- 172.21.15.46:0/443244246 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9601a8f50 con 0x7fb9601094f0 2024-09-21T03:46:57.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.804+0000 7fb96712d640 1 -- 172.21.15.46:0/443244246 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb960103fc0 con 0x7fb9601094f0 2024-09-21T03:46:57.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.806+0000 7fb955ffb640 1 -- 172.21.15.46:0/443244246 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7fb950042030 con 0x7fb9601094f0 2024-09-21T03:46:57.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.806+0000 7fb955ffb640 1 --2- 172.21.15.46:0/443244246 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb9480b6550 0x7fb9480b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:57.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.806+0000 7fb955ffb640 1 -- 172.21.15.46:0/443244246 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fb950106280 con 0x7fb9601094f0 2024-09-21T03:46:57.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.806+0000 7fb964ec9640 1 --2- 172.21.15.46:0/443244246 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb9480b6550 0x7fb9480b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:57.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.807+0000 7fb964ec9640 1 --2- 172.21.15.46:0/443244246 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb9480b6550 0x7fb9480b8a60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb95c005fd0 tx=0x7fb95c005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:57.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:57.810+0000 7fb955ffb640 1 -- 172.21.15.46:0/443244246 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb9500ce710 con 0x7fb9601094f0 2024-09-21T03:46:57.817 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:57 smithi105 ceph-mon[34773]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:57.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:57 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/2951088424' entity='client.admin' 2024-09-21T03:46:57.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:57 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/1930241378' entity='client.admin' 2024-09-21T03:46:58.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:58.004+0000 7fb96712d640 1 -- 172.21.15.46:0/443244246 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7fb960076a10 con 0x7fb9601094f0 2024-09-21T03:46:58.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:58.008+0000 7fb955ffb640 1 -- 172.21.15.46:0/443244246 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v32)=0 v32) ==== 116+0+0 (secure 0 0 0) 0x7fb9500d2af0 con 0x7fb9601094f0 2024-09-21T03:46:58.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:58.011+0000 7fb96712d640 1 -- 172.21.15.46:0/443244246 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb9480b6550 msgr2=0x7fb9480b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:58.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:58.011+0000 7fb96712d640 1 --2- 172.21.15.46:0/443244246 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb9480b6550 0x7fb9480b8a60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb95c005fd0 tx=0x7fb95c005850 comp rx=0 tx=0).stop 2024-09-21T03:46:58.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:58.011+0000 7fb96712d640 1 -- 172.21.15.46:0/443244246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9601094f0 msgr2=0x7fb960075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:58.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:58.011+0000 7fb96712d640 1 --2- 172.21.15.46:0/443244246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9601094f0 0x7fb960075c50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb95002a930 tx=0x7fb950004270 comp rx=0 tx=0).stop 2024-09-21T03:46:58.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:58.011+0000 7fb96712d640 1 -- 172.21.15.46:0/443244246 shutdown_connections 2024-09-21T03:46:58.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:58.011+0000 7fb96712d640 1 --2- 172.21.15.46:0/443244246 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb960109e40 0x7fb960076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:58.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:58.011+0000 7fb96712d640 1 --2- 172.21.15.46:0/443244246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9601094f0 0x7fb960075c50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:58.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:58.011+0000 7fb96712d640 1 --2- 172.21.15.46:0/443244246 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb9480b6550 0x7fb9480b8a60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:58.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:58.011+0000 7fb96712d640 1 --2- 172.21.15.46:0/443244246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb960103bb0 0x7fb960075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:58.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:58.011+0000 7fb96712d640 1 -- 172.21.15.46:0/443244246 >> 172.21.15.46:0/443244246 conn(0x7fb9600ff600 msgr2=0x7fb960101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:58.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:58.011+0000 7fb96712d640 1 -- 172.21.15.46:0/443244246 shutdown_connections 2024-09-21T03:46:58.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:58.011+0000 7fb96712d640 1 -- 172.21.15.46:0/443244246 wait complete. 2024-09-21T03:46:58.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.658+0000 7f7bd2374640 1 -- 172.21.15.46:0/1528858172 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bcc102a60 msgr2=0x7f7bcc102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:58.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.658+0000 7f7bd2374640 1 --2- 172.21.15.46:0/1528858172 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bcc102a60 0x7f7bcc102e70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc009900 tx=0x7f7bbc02a410 comp rx=0 tx=0).stop 2024-09-21T03:46:58.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.658+0000 7f7bd2374640 1 -- 172.21.15.46:0/1528858172 shutdown_connections 2024-09-21T03:46:58.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.658+0000 7f7bd2374640 1 --2- 172.21.15.46:0/1528858172 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bcc108cf0 0x7f7bcc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:58.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.658+0000 7f7bd2374640 1 --2- 172.21.15.46:0/1528858172 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bcc1083a0 0x7f7bcc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:58.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.658+0000 7f7bd2374640 1 --2- 172.21.15.46:0/1528858172 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bcc102a60 0x7f7bcc102e70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:58.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.659+0000 7f7bd2374640 1 -- 172.21.15.46:0/1528858172 >> 172.21.15.46:0/1528858172 conn(0x7f7bcc079730 msgr2=0x7f7bcc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:58.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.659+0000 7f7bd2374640 1 -- 172.21.15.46:0/1528858172 shutdown_connections 2024-09-21T03:46:58.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.659+0000 7f7bd2374640 1 -- 172.21.15.46:0/1528858172 wait complete. 2024-09-21T03:46:58.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.659+0000 7f7bd2374640 1 Processor -- start 2024-09-21T03:46:58.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.659+0000 7f7bd2374640 1 -- start start 2024-09-21T03:46:58.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.660+0000 7f7bd2374640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bcc102a60 0x7f7bcc104250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:58.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.660+0000 7f7bd2374640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bcc1083a0 0x7f7bcc104790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:58.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.660+0000 7f7bd2374640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bcc108cf0 0x7f7bcc104cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:58.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.660+0000 7f7bd2374640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7bcc112960 con 0x7f7bcc108cf0 2024-09-21T03:46:58.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.660+0000 7f7bd2374640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7bcc1127e0 con 0x7f7bcc1083a0 2024-09-21T03:46:58.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.660+0000 7f7bd2374640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7bcc112ae0 con 0x7f7bcc102a60 2024-09-21T03:46:58.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.660+0000 7f7bd0911640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bcc108cf0 0x7f7bcc104cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:58.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.660+0000 7f7bd0911640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bcc108cf0 0x7f7bcc104cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51442/0 (socket says 172.21.15.46:51442) 2024-09-21T03:46:58.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.660+0000 7f7bd0911640 1 -- 172.21.15.46:0/2910553898 learned_addr learned my addr 172.21.15.46:0/2910553898 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:46:58.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.660+0000 7f7bcb7fe640 1 --2- 172.21.15.46:0/2910553898 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bcc1083a0 0x7f7bcc104790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:58.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.660+0000 7f7bcbfff640 1 --2- 172.21.15.46:0/2910553898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bcc102a60 0x7f7bcc104250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:58.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.661+0000 7f7bd0911640 1 -- 172.21.15.46:0/2910553898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bcc102a60 msgr2=0x7f7bcc104250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:58.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.661+0000 7f7bd0911640 1 --2- 172.21.15.46:0/2910553898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bcc102a60 0x7f7bcc104250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:58.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.661+0000 7f7bd0911640 1 -- 172.21.15.46:0/2910553898 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bcc1083a0 msgr2=0x7f7bcc104790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:58.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.661+0000 7f7bd0911640 1 --2- 172.21.15.46:0/2910553898 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bcc1083a0 0x7f7bcc104790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:58.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.661+0000 7f7bd0911640 1 -- 172.21.15.46:0/2910553898 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bcc1a8650 con 0x7f7bcc108cf0 2024-09-21T03:46:58.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.661+0000 7f7bcb7fe640 1 --2- 172.21.15.46:0/2910553898 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bcc1083a0 0x7f7bcc104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:46:58.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.661+0000 7f7bd0911640 1 --2- 172.21.15.46:0/2910553898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bcc108cf0 0x7f7bcc104cd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7bc400cce0 tx=0x7f7bc400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:58.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.661+0000 7f7bc97fa640 1 -- 172.21.15.46:0/2910553898 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc400f450 con 0x7f7bcc108cf0 2024-09-21T03:46:58.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.661+0000 7f7bd2374640 1 -- 172.21.15.46:0/2910553898 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bcc1a8940 con 0x7f7bcc108cf0 2024-09-21T03:46:58.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.661+0000 7f7bc97fa640 1 -- 172.21.15.46:0/2910553898 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7bc400faa0 con 0x7f7bcc108cf0 2024-09-21T03:46:58.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.661+0000 7f7bc97fa640 1 -- 172.21.15.46:0/2910553898 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4018b70 con 0x7f7bcc108cf0 2024-09-21T03:46:58.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.661+0000 7f7bd2374640 1 -- 172.21.15.46:0/2910553898 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bcc1a8e80 con 0x7f7bcc108cf0 2024-09-21T03:46:58.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.662+0000 7f7bd2374640 1 -- 172.21.15.46:0/2910553898 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bcc102e70 con 0x7f7bcc108cf0 2024-09-21T03:46:58.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.665+0000 7f7bc97fa640 1 -- 172.21.15.46:0/2910553898 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f7bc4018d10 con 0x7f7bcc108cf0 2024-09-21T03:46:58.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.666+0000 7f7bc97fa640 1 --2- 172.21.15.46:0/2910553898 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7bb40b64d0 0x7f7bb40b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:58.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.667+0000 7f7bcbfff640 1 --2- 172.21.15.46:0/2910553898 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7bb40b64d0 0x7f7bb40b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:58.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.667+0000 7f7bc97fa640 1 -- 172.21.15.46:0/2910553898 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f7bc40e5b50 con 0x7f7bcc108cf0 2024-09-21T03:46:58.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.667+0000 7f7bcbfff640 1 --2- 172.21.15.46:0/2910553898 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7bb40b64d0 0x7f7bb40b89e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc000c00 tx=0x7f7bbc031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:58.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.672+0000 7f7bc97fa640 1 -- 172.21.15.46:0/2910553898 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7bc4014030 con 0x7f7bcc108cf0 2024-09-21T03:46:58.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.882+0000 7f7bd2374640 1 -- 172.21.15.46:0/2910553898 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f7bcc1a92b0 con 0x7f7bcc108cf0 2024-09-21T03:46:58.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.882+0000 7f7bc97fa640 1 -- 172.21.15.46:0/2910553898 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v26)=0 v26) ==== 106+0+0 (secure 0 0 0) 0x7f7bc40adfc0 con 0x7f7bcc108cf0 2024-09-21T03:46:58.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.885+0000 7f7bd2374640 1 -- 172.21.15.46:0/2910553898 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7bb40b64d0 msgr2=0x7f7bb40b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:58.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.885+0000 7f7bd2374640 1 --2- 172.21.15.46:0/2910553898 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7bb40b64d0 0x7f7bb40b89e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc000c00 tx=0x7f7bbc031400 comp rx=0 tx=0).stop 2024-09-21T03:46:58.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.885+0000 7f7bd2374640 1 -- 172.21.15.46:0/2910553898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bcc108cf0 msgr2=0x7f7bcc104cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:58.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.885+0000 7f7bd2374640 1 --2- 172.21.15.46:0/2910553898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bcc108cf0 0x7f7bcc104cd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7bc400cce0 tx=0x7f7bc400a620 comp rx=0 tx=0).stop 2024-09-21T03:46:58.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.885+0000 7f7bd2374640 1 -- 172.21.15.46:0/2910553898 shutdown_connections 2024-09-21T03:46:58.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.885+0000 7f7bd2374640 1 --2- 172.21.15.46:0/2910553898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bcc108cf0 0x7f7bcc104cd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:58.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.885+0000 7f7bd2374640 1 --2- 172.21.15.46:0/2910553898 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bcc1083a0 0x7f7bcc104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:58.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.885+0000 7f7bd2374640 1 --2- 172.21.15.46:0/2910553898 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7bb40b64d0 0x7f7bb40b89e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:58.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.885+0000 7f7bd2374640 1 --2- 172.21.15.46:0/2910553898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bcc102a60 0x7f7bcc104250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:58.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.885+0000 7f7bd2374640 1 -- 172.21.15.46:0/2910553898 >> 172.21.15.46:0/2910553898 conn(0x7f7bcc079730 msgr2=0x7f7bcc101b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:58.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.885+0000 7f7bd2374640 1 -- 172.21.15.46:0/2910553898 shutdown_connections 2024-09-21T03:46:58.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:46:51.885+0000 7f7bd2374640 1 -- 172.21.15.46:0/2910553898 wait complete. 2024-09-21T03:46:59.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:59 smithi046 ceph-mon[30954]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:59.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:46:59 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/443244246' entity='client.admin' 2024-09-21T03:46:59.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:59 smithi105 ceph-mon[34773]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:59.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:46:59 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/443244246' entity='client.admin' 2024-09-21T03:46:59.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:59 smithi162 ceph-mon[35071]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:46:59.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:46:59 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/443244246' entity='client.admin' 2024-09-21T03:46:59.391 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:47:00.396 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a82de5ec-77cb-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi046') 2024-09-21T03:47:00.397 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a82de5ec-77cb-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi046') 2024-09-21T03:47:00.397 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a82de5ec-77cb-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi046') 2024-09-21T03:47:00.397 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a82de5ec-77cb-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi046') 2024-09-21T03:47:00.398 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a82de5ec-77cb-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi046') 2024-09-21T03:47:00.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.799+0000 7f26f91c8640 1 -- 172.21.15.46:0/1622264388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26f4108cf0 msgr2=0x7f26f410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:00.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.799+0000 7f26f91c8640 1 --2- 172.21.15.46:0/1622264388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26f4108cf0 0x7f26f410f520 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f26ec009ca0 tx=0x7f26ec02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.799+0000 7f26f91c8640 1 -- 172.21.15.46:0/1622264388 shutdown_connections 2024-09-21T03:47:00.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.799+0000 7f26f91c8640 1 --2- 172.21.15.46:0/1622264388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26f4108cf0 0x7f26f410f520 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.799+0000 7f26f91c8640 1 --2- 172.21.15.46:0/1622264388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26f41083a0 0x7f26f41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.799+0000 7f26f91c8640 1 --2- 172.21.15.46:0/1622264388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26f4102a60 0x7f26f4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.799+0000 7f26f91c8640 1 -- 172.21.15.46:0/1622264388 >> 172.21.15.46:0/1622264388 conn(0x7f26f4079730 msgr2=0x7f26f4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:00.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.799+0000 7f26f91c8640 1 -- 172.21.15.46:0/1622264388 shutdown_connections 2024-09-21T03:47:00.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.799+0000 7f26f91c8640 1 -- 172.21.15.46:0/1622264388 wait complete. 2024-09-21T03:47:00.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.800+0000 7f26f91c8640 1 Processor -- start 2024-09-21T03:47:00.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.800+0000 7f26f91c8640 1 -- start start 2024-09-21T03:47:00.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.801+0000 7f26f91c8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26f4102a60 0x7f26f419b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:00.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.801+0000 7f26f91c8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26f41083a0 0x7f26f419b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:00.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.801+0000 7f26f91c8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26f4108cf0 0x7f26f419beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:00.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.801+0000 7f26f91c8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f26f4112a40 con 0x7f26f4108cf0 2024-09-21T03:47:00.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.801+0000 7f26f91c8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f26f41128c0 con 0x7f26f4102a60 2024-09-21T03:47:00.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.801+0000 7f26f91c8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f26f4112bc0 con 0x7f26f41083a0 2024-09-21T03:47:00.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.801+0000 7f26f359e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26f4108cf0 0x7f26f419beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:00.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.801+0000 7f26f359e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26f4108cf0 0x7f26f419beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43048/0 (socket says 172.21.15.46:43048) 2024-09-21T03:47:00.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.801+0000 7f26f359e640 1 -- 172.21.15.46:0/528685913 learned_addr learned my addr 172.21.15.46:0/528685913 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:47:00.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.801+0000 7f26f2d9d640 1 --2- 172.21.15.46:0/528685913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26f4102a60 0x7f26f419b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:00.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.801+0000 7f26f259c640 1 --2- 172.21.15.46:0/528685913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26f41083a0 0x7f26f419b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:00.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.801+0000 7f26f359e640 1 -- 172.21.15.46:0/528685913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26f41083a0 msgr2=0x7f26f419b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:00.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.801+0000 7f26f359e640 1 --2- 172.21.15.46:0/528685913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26f41083a0 0x7f26f419b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.801+0000 7f26f359e640 1 -- 172.21.15.46:0/528685913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26f4102a60 msgr2=0x7f26f419b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:00.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.801+0000 7f26f359e640 1 --2- 172.21.15.46:0/528685913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26f4102a60 0x7f26f419b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.801+0000 7f26f359e640 1 -- 172.21.15.46:0/528685913 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f41a66c0 con 0x7f26f4108cf0 2024-09-21T03:47:00.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.801+0000 7f26f2d9d640 1 --2- 172.21.15.46:0/528685913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26f4102a60 0x7f26f419b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:47:00.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.802+0000 7f26f359e640 1 --2- 172.21.15.46:0/528685913 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26f4108cf0 0x7f26f419beb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f26ec005cc0 tx=0x7f26ec02f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:00.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.802+0000 7f26dbfff640 1 -- 172.21.15.46:0/528685913 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ec003cf0 con 0x7f26f4108cf0 2024-09-21T03:47:00.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.802+0000 7f26dbfff640 1 -- 172.21.15.46:0/528685913 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26ec0044f0 con 0x7f26f4108cf0 2024-09-21T03:47:00.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.802+0000 7f26f91c8640 1 -- 172.21.15.46:0/528685913 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26f4199220 con 0x7f26f4108cf0 2024-09-21T03:47:00.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.802+0000 7f26dbfff640 1 -- 172.21.15.46:0/528685913 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ec02fc30 con 0x7f26f4108cf0 2024-09-21T03:47:00.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.802+0000 7f26f91c8640 1 -- 172.21.15.46:0/528685913 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26f4199760 con 0x7f26f4108cf0 2024-09-21T03:47:00.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.803+0000 7f26f91c8640 1 -- 172.21.15.46:0/528685913 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26f4102ef0 con 0x7f26f4108cf0 2024-09-21T03:47:00.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.805+0000 7f26dbfff640 1 -- 172.21.15.46:0/528685913 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f26ec0046a0 con 0x7f26f4108cf0 2024-09-21T03:47:00.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.805+0000 7f26dbfff640 1 --2- 172.21.15.46:0/528685913 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f26dc0b6500 0x7f26dc0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:00.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.806+0000 7f26f2d9d640 1 --2- 172.21.15.46:0/528685913 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f26dc0b6500 0x7f26dc0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:00.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.806+0000 7f26dbfff640 1 -- 172.21.15.46:0/528685913 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f26ec106cd0 con 0x7f26f4108cf0 2024-09-21T03:47:00.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.806+0000 7f26f2d9d640 1 --2- 172.21.15.46:0/528685913 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f26dc0b6500 0x7f26dc0b8a10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f26f406b9c0 tx=0x7f26e4009110 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:00.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:00.809+0000 7f26dbfff640 1 -- 172.21.15.46:0/528685913 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f26ec0cf160 con 0x7f26f4108cf0 2024-09-21T03:47:01.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.000+0000 7f26f91c8640 1 -- 172.21.15.46:0/528685913 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f26f406b270 con 0x7f26f4108cf0 2024-09-21T03:47:01.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.004+0000 7f26dbfff640 1 -- 172.21.15.46:0/528685913 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v33)=0 v33) ==== 121+0+0 (secure 0 0 0) 0x7f26f406b270 con 0x7f26f4108cf0 2024-09-21T03:47:01.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.007+0000 7f26f91c8640 1 -- 172.21.15.46:0/528685913 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f26dc0b6500 msgr2=0x7f26dc0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:01.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.007+0000 7f26f91c8640 1 --2- 172.21.15.46:0/528685913 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f26dc0b6500 0x7f26dc0b8a10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f26f406b9c0 tx=0x7f26e4009110 comp rx=0 tx=0).stop 2024-09-21T03:47:01.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.007+0000 7f26f91c8640 1 -- 172.21.15.46:0/528685913 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26f4108cf0 msgr2=0x7f26f419beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:01.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.007+0000 7f26f91c8640 1 --2- 172.21.15.46:0/528685913 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26f4108cf0 0x7f26f419beb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f26ec005cc0 tx=0x7f26ec02f470 comp rx=0 tx=0).stop 2024-09-21T03:47:01.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.007+0000 7f26f91c8640 1 -- 172.21.15.46:0/528685913 shutdown_connections 2024-09-21T03:47:01.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.007+0000 7f26f91c8640 1 --2- 172.21.15.46:0/528685913 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26f4108cf0 0x7f26f419beb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:01.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.007+0000 7f26f91c8640 1 --2- 172.21.15.46:0/528685913 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f26dc0b6500 0x7f26dc0b8a10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:01.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.007+0000 7f26f91c8640 1 --2- 172.21.15.46:0/528685913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26f41083a0 0x7f26f419b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:01.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.007+0000 7f26f91c8640 1 --2- 172.21.15.46:0/528685913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26f4102a60 0x7f26f419b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:01.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.007+0000 7f26f91c8640 1 -- 172.21.15.46:0/528685913 >> 172.21.15.46:0/528685913 conn(0x7f26f4079730 msgr2=0x7f26f4105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:01.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.007+0000 7f26f91c8640 1 -- 172.21.15.46:0/528685913 shutdown_connections 2024-09-21T03:47:01.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.007+0000 7f26f91c8640 1 -- 172.21.15.46:0/528685913 wait complete. 2024-09-21T03:47:01.258 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:01 smithi046 ceph-mon[30954]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:01.258 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:01 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/528685913' entity='client.admin' 2024-09-21T03:47:01.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:01 smithi105 ceph-mon[34773]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:01.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:01 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/528685913' entity='client.admin' 2024-09-21T03:47:01.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.349+0000 7f408a5e4640 1 -- 172.21.15.46:0/3363992387 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40841083c0 msgr2=0x7f40841087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:01.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.349+0000 7f408a5e4640 1 --2- 172.21.15.46:0/3363992387 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40841083c0 0x7f40841087d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4078009900 tx=0x7f407802a410 comp rx=0 tx=0).stop 2024-09-21T03:47:01.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.349+0000 7f408a5e4640 1 -- 172.21.15.46:0/3363992387 shutdown_connections 2024-09-21T03:47:01.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.349+0000 7f408a5e4640 1 --2- 172.21.15.46:0/3363992387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4084108d10 0x7f408410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:01.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.349+0000 7f408a5e4640 1 --2- 172.21.15.46:0/3363992387 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40841083c0 0x7f40841087d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:01.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.349+0000 7f408a5e4640 1 --2- 172.21.15.46:0/3363992387 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4084102a80 0x7f4084102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:01.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.349+0000 7f408a5e4640 1 -- 172.21.15.46:0/3363992387 >> 172.21.15.46:0/3363992387 conn(0x7f4084079740 msgr2=0x7f4084079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:01.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.349+0000 7f408a5e4640 1 -- 172.21.15.46:0/3363992387 shutdown_connections 2024-09-21T03:47:01.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.349+0000 7f408a5e4640 1 -- 172.21.15.46:0/3363992387 wait complete. 2024-09-21T03:47:01.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.350+0000 7f408a5e4640 1 Processor -- start 2024-09-21T03:47:01.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.350+0000 7f408a5e4640 1 -- start start 2024-09-21T03:47:01.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.351+0000 7f408a5e4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4084102a80 0x7f408419a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:01.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.351+0000 7f408a5e4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40841083c0 0x7f408419aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:01.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.351+0000 7f408a5e4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4084108d10 0x7f408419fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:01.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.351+0000 7f408a5e4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f40841129c0 con 0x7f4084102a80 2024-09-21T03:47:01.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.351+0000 7f408a5e4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4084112840 con 0x7f4084108d10 2024-09-21T03:47:01.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.351+0000 7f408a5e4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4084112b40 con 0x7f40841083c0 2024-09-21T03:47:01.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.351+0000 7f4083fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4084102a80 0x7f408419a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:01.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.351+0000 7f4083fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4084102a80 0x7f408419a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43064/0 (socket says 172.21.15.46:43064) 2024-09-21T03:47:01.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.351+0000 7f4083fff640 1 -- 172.21.15.46:0/325422492 learned_addr learned my addr 172.21.15.46:0/325422492 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:47:01.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.351+0000 7f40837fe640 1 --2- 172.21.15.46:0/325422492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40841083c0 0x7f408419aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:01.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.351+0000 7f4088b81640 1 --2- 172.21.15.46:0/325422492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4084108d10 0x7f408419fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:01.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.351+0000 7f4083fff640 1 -- 172.21.15.46:0/325422492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40841083c0 msgr2=0x7f408419aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:01.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.351+0000 7f4083fff640 1 --2- 172.21.15.46:0/325422492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40841083c0 0x7f408419aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:01.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.351+0000 7f4083fff640 1 -- 172.21.15.46:0/325422492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4084108d10 msgr2=0x7f408419fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:01.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.351+0000 7f4083fff640 1 --2- 172.21.15.46:0/325422492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4084108d10 0x7f408419fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:01.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.351+0000 7f4083fff640 1 -- 172.21.15.46:0/325422492 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40841a0470 con 0x7f4084102a80 2024-09-21T03:47:01.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.351+0000 7f4088b81640 1 --2- 172.21.15.46:0/325422492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4084108d10 0x7f408419fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:47:01.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.351+0000 7f4083fff640 1 --2- 172.21.15.46:0/325422492 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4084102a80 0x7f408419a500 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f407400c890 tx=0x7f407400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:01.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.351+0000 7f40817fa640 1 -- 172.21.15.46:0/325422492 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4074004220 con 0x7f4084102a80 2024-09-21T03:47:01.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.351+0000 7f40817fa640 1 -- 172.21.15.46:0/325422492 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40740043c0 con 0x7f4084102a80 2024-09-21T03:47:01.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.351+0000 7f408a5e4640 1 -- 172.21.15.46:0/325422492 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40841a0760 con 0x7f4084102a80 2024-09-21T03:47:01.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.351+0000 7f40817fa640 1 -- 172.21.15.46:0/325422492 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4074004a00 con 0x7f4084102a80 2024-09-21T03:47:01.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.352+0000 7f408a5e4640 1 -- 172.21.15.46:0/325422492 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40841a6ec0 con 0x7f4084102a80 2024-09-21T03:47:01.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.352+0000 7f408a5e4640 1 -- 172.21.15.46:0/325422492 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4084103d00 con 0x7f4084102a80 2024-09-21T03:47:01.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.354+0000 7f40817fa640 1 -- 172.21.15.46:0/325422492 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f40740079b0 con 0x7f4084102a80 2024-09-21T03:47:01.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.355+0000 7f40817fa640 1 --2- 172.21.15.46:0/325422492 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f406c0b6550 0x7f406c0b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:01.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.355+0000 7f40837fe640 1 --2- 172.21.15.46:0/325422492 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f406c0b6550 0x7f406c0b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:01.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.355+0000 7f40817fa640 1 -- 172.21.15.46:0/325422492 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f40740e58f0 con 0x7f4084102a80 2024-09-21T03:47:01.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.356+0000 7f40837fe640 1 --2- 172.21.15.46:0/325422492 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f406c0b6550 0x7f406c0b8a60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4078000c00 tx=0x7f4078031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:01.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.359+0000 7f40817fa640 1 -- 172.21.15.46:0/325422492 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4074014030 con 0x7f4084102a80 2024-09-21T03:47:01.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:01 smithi162 ceph-mon[35071]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:01.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:01 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/528685913' entity='client.admin' 2024-09-21T03:47:01.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.553+0000 7f408a5e4640 1 -- 172.21.15.46:0/325422492 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f408419b630 con 0x7f4084102a80 2024-09-21T03:47:01.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.557+0000 7f40817fa640 1 -- 172.21.15.46:0/325422492 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v34)=0 v34) ==== 121+0+0 (secure 0 0 0) 0x7f40740adde0 con 0x7f4084102a80 2024-09-21T03:47:01.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.560+0000 7f408a5e4640 1 -- 172.21.15.46:0/325422492 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f406c0b6550 msgr2=0x7f406c0b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:01.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.560+0000 7f408a5e4640 1 --2- 172.21.15.46:0/325422492 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f406c0b6550 0x7f406c0b8a60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4078000c00 tx=0x7f4078031400 comp rx=0 tx=0).stop 2024-09-21T03:47:01.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.560+0000 7f408a5e4640 1 -- 172.21.15.46:0/325422492 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4084102a80 msgr2=0x7f408419a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:01.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.560+0000 7f408a5e4640 1 --2- 172.21.15.46:0/325422492 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4084102a80 0x7f408419a500 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f407400c890 tx=0x7f407400cd50 comp rx=0 tx=0).stop 2024-09-21T03:47:01.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.560+0000 7f408a5e4640 1 -- 172.21.15.46:0/325422492 shutdown_connections 2024-09-21T03:47:01.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.560+0000 7f408a5e4640 1 --2- 172.21.15.46:0/325422492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4084108d10 0x7f408419fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:01.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.560+0000 7f408a5e4640 1 --2- 172.21.15.46:0/325422492 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f406c0b6550 0x7f406c0b8a60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:01.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.560+0000 7f408a5e4640 1 --2- 172.21.15.46:0/325422492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40841083c0 0x7f408419aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:01.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.560+0000 7f408a5e4640 1 --2- 172.21.15.46:0/325422492 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4084102a80 0x7f408419a500 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:01.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.560+0000 7f408a5e4640 1 -- 172.21.15.46:0/325422492 >> 172.21.15.46:0/325422492 conn(0x7f4084079740 msgr2=0x7f408406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:01.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.560+0000 7f408a5e4640 1 -- 172.21.15.46:0/325422492 shutdown_connections 2024-09-21T03:47:01.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.560+0000 7f408a5e4640 1 -- 172.21.15.46:0/325422492 wait complete. 2024-09-21T03:47:02.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.997+0000 7fe77f7f0640 1 -- 172.21.15.46:0/3894084718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe778102aa0 msgr2=0x7fe778102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:02.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.997+0000 7fe77f7f0640 1 --2- 172.21.15.46:0/3894084718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe778102aa0 0x7fe778102eb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe774009900 tx=0x7fe77402a410 comp rx=0 tx=0).stop 2024-09-21T03:47:02.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.997+0000 7fe77f7f0640 1 -- 172.21.15.46:0/3894084718 shutdown_connections 2024-09-21T03:47:02.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.997+0000 7fe77f7f0640 1 --2- 172.21.15.46:0/3894084718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe778108d30 0x7fe77810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:02.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.997+0000 7fe77f7f0640 1 --2- 172.21.15.46:0/3894084718 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7781083e0 0x7fe7781087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:02.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.997+0000 7fe77f7f0640 1 --2- 172.21.15.46:0/3894084718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe778102aa0 0x7fe778102eb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:02.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.997+0000 7fe77f7f0640 1 -- 172.21.15.46:0/3894084718 >> 172.21.15.46:0/3894084718 conn(0x7fe778079750 msgr2=0x7fe778079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:02.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.997+0000 7fe77f7f0640 1 -- 172.21.15.46:0/3894084718 shutdown_connections 2024-09-21T03:47:02.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.997+0000 7fe77f7f0640 1 -- 172.21.15.46:0/3894084718 wait complete. 2024-09-21T03:47:02.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.998+0000 7fe77f7f0640 1 Processor -- start 2024-09-21T03:47:02.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.998+0000 7fe77f7f0640 1 -- start start 2024-09-21T03:47:02.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.998+0000 7fe77f7f0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe778102aa0 0x7fe7780ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:02.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.998+0000 7fe77f7f0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7781083e0 0x7fe7780ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:02.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.998+0000 7fe77f7f0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe778108d30 0x7fe7781000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:02.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.998+0000 7fe77f7f0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe7781129f0 con 0x7fe7781083e0 2024-09-21T03:47:02.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.998+0000 7fe77f7f0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe778112870 con 0x7fe778108d30 2024-09-21T03:47:02.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.998+0000 7fe77f7f0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe778112b70 con 0x7fe778102aa0 2024-09-21T03:47:02.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.998+0000 7fe77cd8b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7781083e0 0x7fe7780ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:02.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.998+0000 7fe77cd8b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7781083e0 0x7fe7780ffbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43082/0 (socket says 172.21.15.46:43082) 2024-09-21T03:47:02.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.998+0000 7fe77cd8b640 1 -- 172.21.15.46:0/441528298 learned_addr learned my addr 172.21.15.46:0/441528298 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:47:02.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.998+0000 7fe77d58c640 1 --2- 172.21.15.46:0/441528298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe778102aa0 0x7fe7780ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:02.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.998+0000 7fe77dd8d640 1 --2- 172.21.15.46:0/441528298 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe778108d30 0x7fe7781000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:02.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.998+0000 7fe77cd8b640 1 -- 172.21.15.46:0/441528298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe778102aa0 msgr2=0x7fe7780ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:02.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.998+0000 7fe77cd8b640 1 --2- 172.21.15.46:0/441528298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe778102aa0 0x7fe7780ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:02.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.998+0000 7fe77cd8b640 1 -- 172.21.15.46:0/441528298 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe778108d30 msgr2=0x7fe7781000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:02.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.998+0000 7fe77cd8b640 1 --2- 172.21.15.46:0/441528298 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe778108d30 0x7fe7781000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:02.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.998+0000 7fe77cd8b640 1 -- 172.21.15.46:0/441528298 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7781a8830 con 0x7fe7781083e0 2024-09-21T03:47:02.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.999+0000 7fe77cd8b640 1 --2- 172.21.15.46:0/441528298 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7781083e0 0x7fe7780ffbb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe76800d740 tx=0x7fe76800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:02.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.999+0000 7fe76e7fc640 1 -- 172.21.15.46:0/441528298 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe768017070 con 0x7fe7781083e0 2024-09-21T03:47:02.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.999+0000 7fe76e7fc640 1 -- 172.21.15.46:0/441528298 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe76800de50 con 0x7fe7781083e0 2024-09-21T03:47:02.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.999+0000 7fe77f7f0640 1 -- 172.21.15.46:0/441528298 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7781a8b20 con 0x7fe7781083e0 2024-09-21T03:47:02.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.999+0000 7fe76e7fc640 1 -- 172.21.15.46:0/441528298 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76800f620 con 0x7fe7781083e0 2024-09-21T03:47:02.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:01.999+0000 7fe77f7f0640 1 -- 172.21.15.46:0/441528298 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7781a90b0 con 0x7fe7781083e0 2024-09-21T03:47:02.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:02.000+0000 7fe77f7f0640 1 -- 172.21.15.46:0/441528298 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe778102eb0 con 0x7fe7781083e0 2024-09-21T03:47:02.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:02.001+0000 7fe76e7fc640 1 -- 172.21.15.46:0/441528298 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7fe76801a070 con 0x7fe7781083e0 2024-09-21T03:47:02.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:02.002+0000 7fe76e7fc640 1 --2- 172.21.15.46:0/441528298 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe7640b6550 0x7fe7640b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:02.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:02.003+0000 7fe77d58c640 1 --2- 172.21.15.46:0/441528298 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe7640b6550 0x7fe7640b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:02.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:02.003+0000 7fe76e7fc640 1 -- 172.21.15.46:0/441528298 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fe7680e50e0 con 0x7fe7781083e0 2024-09-21T03:47:02.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:02.003+0000 7fe77d58c640 1 --2- 172.21.15.46:0/441528298 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe7640b6550 0x7fe7640b8a60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe774000c00 tx=0x7fe774031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:02.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:02.006+0000 7fe76e7fc640 1 -- 172.21.15.46:0/441528298 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe7680ad5d0 con 0x7fe7781083e0 2024-09-21T03:47:02.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:02.195+0000 7fe77f7f0640 1 -- 172.21.15.46:0/441528298 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fe778100970 con 0x7fe7781083e0 2024-09-21T03:47:02.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:02.204+0000 7fe76e7fc640 1 -- 172.21.15.46:0/441528298 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v35)=0 v35) ==== 120+0+0 (secure 0 0 0) 0x7fe778100970 con 0x7fe7781083e0 2024-09-21T03:47:02.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:02.206+0000 7fe77f7f0640 1 -- 172.21.15.46:0/441528298 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe7640b6550 msgr2=0x7fe7640b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:02.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:02.206+0000 7fe77f7f0640 1 --2- 172.21.15.46:0/441528298 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe7640b6550 0x7fe7640b8a60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe774000c00 tx=0x7fe774031400 comp rx=0 tx=0).stop 2024-09-21T03:47:02.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:02.206+0000 7fe77f7f0640 1 -- 172.21.15.46:0/441528298 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7781083e0 msgr2=0x7fe7780ffbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:02.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:02.206+0000 7fe77f7f0640 1 --2- 172.21.15.46:0/441528298 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7781083e0 0x7fe7780ffbb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe76800d740 tx=0x7fe76800dc00 comp rx=0 tx=0).stop 2024-09-21T03:47:02.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:02.206+0000 7fe77f7f0640 1 -- 172.21.15.46:0/441528298 shutdown_connections 2024-09-21T03:47:02.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:02.206+0000 7fe77f7f0640 1 --2- 172.21.15.46:0/441528298 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe778108d30 0x7fe7781000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:02.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:02.206+0000 7fe77f7f0640 1 --2- 172.21.15.46:0/441528298 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7781083e0 0x7fe7780ffbb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:02.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:02.206+0000 7fe77f7f0640 1 --2- 172.21.15.46:0/441528298 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe7640b6550 0x7fe7640b8a60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:02.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:02.206+0000 7fe77f7f0640 1 --2- 172.21.15.46:0/441528298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe778102aa0 0x7fe7780ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:02.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:02.206+0000 7fe77f7f0640 1 -- 172.21.15.46:0/441528298 >> 172.21.15.46:0/441528298 conn(0x7fe778079750 msgr2=0x7fe778101ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:02.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:02.207+0000 7fe77f7f0640 1 -- 172.21.15.46:0/441528298 shutdown_connections 2024-09-21T03:47:02.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:02.207+0000 7fe77f7f0640 1 -- 172.21.15.46:0/441528298 wait complete. 2024-09-21T03:47:02.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:02 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:02.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:02 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:02.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:02 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:47:02.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:02 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:47:02.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:02 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:47:02.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:02 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:02.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:02 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/325422492' entity='client.admin' 2024-09-21T03:47:02.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:02 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:02.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:02 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:02.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:02 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:47:02.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:02 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:47:02.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:02 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:47:02.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:02 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:02.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:02 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/325422492' entity='client.admin' 2024-09-21T03:47:02.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:02 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:02.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:02 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:02.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:02 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:47:02.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:02 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:47:02.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:02 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:47:02.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:02 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:02.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:02 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/325422492' entity='client.admin' 2024-09-21T03:47:03.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.415+0000 7f4a08307640 1 -- 172.21.15.46:0/2424027340 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a001083a0 msgr2=0x7f4a001087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:03.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.415+0000 7f4a08307640 1 --2- 172.21.15.46:0/2424027340 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a001083a0 0x7f4a001087b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f49f0009900 tx=0x7f49f002a410 comp rx=0 tx=0).stop 2024-09-21T03:47:03.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.415+0000 7f4a08307640 1 -- 172.21.15.46:0/2424027340 shutdown_connections 2024-09-21T03:47:03.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.415+0000 7f4a08307640 1 --2- 172.21.15.46:0/2424027340 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a00108cf0 0x7f4a0010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:03.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.415+0000 7f4a08307640 1 --2- 172.21.15.46:0/2424027340 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a001083a0 0x7f4a001087b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:03.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.415+0000 7f4a08307640 1 --2- 172.21.15.46:0/2424027340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a00102a60 0x7f4a00102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:03.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.415+0000 7f4a08307640 1 -- 172.21.15.46:0/2424027340 >> 172.21.15.46:0/2424027340 conn(0x7f4a00079730 msgr2=0x7f4a00079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:03.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.415+0000 7f4a08307640 1 -- 172.21.15.46:0/2424027340 shutdown_connections 2024-09-21T03:47:03.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.415+0000 7f4a08307640 1 -- 172.21.15.46:0/2424027340 wait complete. 2024-09-21T03:47:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.416+0000 7f4a08307640 1 Processor -- start 2024-09-21T03:47:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.416+0000 7f4a08307640 1 -- start start 2024-09-21T03:47:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.416+0000 7f4a08307640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a00102a60 0x7f4a0010ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:03.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.417+0000 7f4a08307640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a001083a0 0x7f4a001104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:03.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.417+0000 7f4a08307640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a00108cf0 0x7f4a00110a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:03.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.417+0000 7f4a08307640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4a00113a80 con 0x7f4a001083a0 2024-09-21T03:47:03.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.417+0000 7f4a08307640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4a00113900 con 0x7f4a00102a60 2024-09-21T03:47:03.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.417+0000 7f4a08307640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4a00113c00 con 0x7f4a00108cf0 2024-09-21T03:47:03.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.417+0000 7f4a058a2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a001083a0 0x7f4a001104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:03.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.417+0000 7f4a058a2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a001083a0 0x7f4a001104f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56256/0 (socket says 172.21.15.46:56256) 2024-09-21T03:47:03.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.417+0000 7f4a058a2640 1 -- 172.21.15.46:0/4163135021 learned_addr learned my addr 172.21.15.46:0/4163135021 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:47:03.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.417+0000 7f4a060a3640 1 --2- 172.21.15.46:0/4163135021 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a00102a60 0x7f4a0010ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:03.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.417+0000 7f4a068a4640 1 --2- 172.21.15.46:0/4163135021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a00108cf0 0x7f4a00110a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:03.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.417+0000 7f4a058a2640 1 -- 172.21.15.46:0/4163135021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a00108cf0 msgr2=0x7f4a00110a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:03.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.417+0000 7f4a058a2640 1 --2- 172.21.15.46:0/4163135021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a00108cf0 0x7f4a00110a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:03.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.417+0000 7f4a058a2640 1 -- 172.21.15.46:0/4163135021 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a00102a60 msgr2=0x7f4a0010ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:03.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.417+0000 7f4a058a2640 1 --2- 172.21.15.46:0/4163135021 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a00102a60 0x7f4a0010ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:03.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.417+0000 7f4a058a2640 1 -- 172.21.15.46:0/4163135021 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a001a8770 con 0x7f4a001083a0 2024-09-21T03:47:03.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.417+0000 7f4a058a2640 1 --2- 172.21.15.46:0/4163135021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a001083a0 0x7f4a001104f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f49f0006010 tx=0x7f49f0004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:03.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.418+0000 7f49f77fe640 1 -- 172.21.15.46:0/4163135021 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f003f030 con 0x7f4a001083a0 2024-09-21T03:47:03.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.418+0000 7f4a08307640 1 -- 172.21.15.46:0/4163135021 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a001a8a00 con 0x7f4a001083a0 2024-09-21T03:47:03.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.418+0000 7f49f77fe640 1 -- 172.21.15.46:0/4163135021 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49f0003aa0 con 0x7f4a001083a0 2024-09-21T03:47:03.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.418+0000 7f49f77fe640 1 -- 172.21.15.46:0/4163135021 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f0035070 con 0x7f4a001083a0 2024-09-21T03:47:03.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.418+0000 7f4a08307640 1 -- 172.21.15.46:0/4163135021 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a001a8ee0 con 0x7f4a001083a0 2024-09-21T03:47:03.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.419+0000 7f4a08307640 1 -- 172.21.15.46:0/4163135021 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a00102e70 con 0x7f4a001083a0 2024-09-21T03:47:03.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.420+0000 7f49f77fe640 1 -- 172.21.15.46:0/4163135021 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f49f0042030 con 0x7f4a001083a0 2024-09-21T03:47:03.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.421+0000 7f49f77fe640 1 --2- 172.21.15.46:0/4163135021 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f49ec0b64d0 0x7f49ec0b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:03.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.421+0000 7f4a060a3640 1 --2- 172.21.15.46:0/4163135021 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f49ec0b64d0 0x7f49ec0b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:03.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.421+0000 7f49f77fe640 1 -- 172.21.15.46:0/4163135021 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f49f0105fb0 con 0x7f4a001083a0 2024-09-21T03:47:03.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.422+0000 7f4a060a3640 1 --2- 172.21.15.46:0/4163135021 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f49ec0b64d0 0x7f49ec0b89e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4a00111a00 tx=0x7f49fc00b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:03.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.424+0000 7f49f77fe640 1 -- 172.21.15.46:0/4163135021 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f49f00d2780 con 0x7f4a001083a0 2024-09-21T03:47:03.452 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:03 smithi046 ceph-mon[30954]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:03.453 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:03 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/441528298' entity='client.admin' 2024-09-21T03:47:03.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:03 smithi105 ceph-mon[34773]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:03.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:03 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/441528298' entity='client.admin' 2024-09-21T03:47:03.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.614+0000 7f4a08307640 1 -- 172.21.15.46:0/4163135021 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f4a001112b0 con 0x7f4a001083a0 2024-09-21T03:47:03.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.618+0000 7f49f77fe640 1 -- 172.21.15.46:0/4163135021 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v36)=0 v36) ==== 133+0+0 (secure 0 0 0) 0x7f49f00d76c0 con 0x7f4a001083a0 2024-09-21T03:47:03.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.620+0000 7f4a08307640 1 -- 172.21.15.46:0/4163135021 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f49ec0b64d0 msgr2=0x7f49ec0b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:03.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.620+0000 7f4a08307640 1 --2- 172.21.15.46:0/4163135021 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f49ec0b64d0 0x7f49ec0b89e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4a00111a00 tx=0x7f49fc00b410 comp rx=0 tx=0).stop 2024-09-21T03:47:03.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.620+0000 7f4a08307640 1 -- 172.21.15.46:0/4163135021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a001083a0 msgr2=0x7f4a001104f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:03.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.620+0000 7f4a08307640 1 --2- 172.21.15.46:0/4163135021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a001083a0 0x7f4a001104f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f49f0006010 tx=0x7f49f0004060 comp rx=0 tx=0).stop 2024-09-21T03:47:03.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.620+0000 7f4a08307640 1 -- 172.21.15.46:0/4163135021 shutdown_connections 2024-09-21T03:47:03.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.620+0000 7f4a08307640 1 --2- 172.21.15.46:0/4163135021 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f49ec0b64d0 0x7f49ec0b89e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:03.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.620+0000 7f4a08307640 1 --2- 172.21.15.46:0/4163135021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a00108cf0 0x7f4a00110a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:03.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.620+0000 7f4a08307640 1 --2- 172.21.15.46:0/4163135021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a001083a0 0x7f4a001104f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:03.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.620+0000 7f4a08307640 1 --2- 172.21.15.46:0/4163135021 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a00102a60 0x7f4a0010ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:03.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.620+0000 7f4a08307640 1 -- 172.21.15.46:0/4163135021 >> 172.21.15.46:0/4163135021 conn(0x7f4a00079730 msgr2=0x7f4a00105240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:03.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.621+0000 7f4a08307640 1 -- 172.21.15.46:0/4163135021 shutdown_connections 2024-09-21T03:47:03.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:03.621+0000 7f4a08307640 1 -- 172.21.15.46:0/4163135021 wait complete. 2024-09-21T03:47:03.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:03 smithi162 ceph-mon[35071]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:03.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:03 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/441528298' entity='client.admin' 2024-09-21T03:47:04.771 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:47:04.773 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a82de5ec-77cb-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi046') 2024-09-21T03:47:04.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:04 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/4163135021' entity='client.admin' 2024-09-21T03:47:04.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:04 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:47:04.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:04 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:47:04.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:04 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:47:04.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:04 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:04.878 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:04 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/4163135021' entity='client.admin' 2024-09-21T03:47:04.878 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:04 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:47:04.878 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:04 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:47:04.878 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:04 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:47:04.878 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:04 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:05.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:04 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/4163135021' entity='client.admin' 2024-09-21T03:47:05.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:04 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:47:05.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:04 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:47:05.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:04 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:47:05.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:04 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:05.161 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a82de5ec-77cb-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi046') 2024-09-21T03:47:05.161 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a82de5ec-77cb-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi046') 2024-09-21T03:47:05.161 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a82de5ec-77cb-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi046') 2024-09-21T03:47:05.162 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a82de5ec-77cb-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi046') 2024-09-21T03:47:05.162 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a82de5ec-77cb-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='smithi046') 2024-09-21T03:47:05.162 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a82de5ec-77cb-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi046') 2024-09-21T03:47:05.162 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a82de5ec-77cb-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi046') 2024-09-21T03:47:05.162 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a82de5ec-77cb-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi046') 2024-09-21T03:47:05.162 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a82de5ec-77cb-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='smithi046') 2024-09-21T03:47:05.162 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a82de5ec-77cb-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='smithi046') 2024-09-21T03:47:05.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.544+0000 7f62e1783640 1 -- 172.21.15.46:0/1377294956 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62dc105340 msgr2=0x7f62dc10d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:05.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.544+0000 7f62e1783640 1 --2- 172.21.15.46:0/1377294956 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62dc105340 0x7f62dc10d890 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f62d0009900 tx=0x7f62d002a410 comp rx=0 tx=0).stop 2024-09-21T03:47:05.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.544+0000 7f62e1783640 1 -- 172.21.15.46:0/1377294956 shutdown_connections 2024-09-21T03:47:05.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.544+0000 7f62e1783640 1 --2- 172.21.15.46:0/1377294956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62dc10de50 0x7f62dc110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:05.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.544+0000 7f62e1783640 1 --2- 172.21.15.46:0/1377294956 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62dc105340 0x7f62dc10d890 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:05.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.544+0000 7f62e1783640 1 --2- 172.21.15.46:0/1377294956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62dc1049f0 0x7f62dc104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:05.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.544+0000 7f62e1783640 1 -- 172.21.15.46:0/1377294956 >> 172.21.15.46:0/1377294956 conn(0x7f62dc079750 msgr2=0x7f62dc079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:05.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.544+0000 7f62e1783640 1 -- 172.21.15.46:0/1377294956 shutdown_connections 2024-09-21T03:47:05.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.544+0000 7f62e1783640 1 -- 172.21.15.46:0/1377294956 wait complete. 2024-09-21T03:47:05.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.545+0000 7f62e1783640 1 Processor -- start 2024-09-21T03:47:05.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.545+0000 7f62e1783640 1 -- start start 2024-09-21T03:47:05.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.545+0000 7f62e1783640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62dc1049f0 0x7f62dc102730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:05.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.545+0000 7f62e1783640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62dc105340 0x7f62dc102c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:05.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.545+0000 7f62e1783640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62dc10de50 0x7f62dc1031b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:05.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.545+0000 7f62e1783640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f62dc113ab0 con 0x7f62dc105340 2024-09-21T03:47:05.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.545+0000 7f62e1783640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f62dc113930 con 0x7f62dc10de50 2024-09-21T03:47:05.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.545+0000 7f62e1783640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f62dc113c30 con 0x7f62dc1049f0 2024-09-21T03:47:05.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.545+0000 7f62da7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62dc105340 0x7f62dc102c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:05.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.545+0000 7f62da7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62dc105340 0x7f62dc102c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56274/0 (socket says 172.21.15.46:56274) 2024-09-21T03:47:05.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.545+0000 7f62da7fc640 1 -- 172.21.15.46:0/3022582385 learned_addr learned my addr 172.21.15.46:0/3022582385 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:47:05.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.545+0000 7f62db7fe640 1 --2- 172.21.15.46:0/3022582385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62dc10de50 0x7f62dc1031b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:05.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.546+0000 7f62daffd640 1 --2- 172.21.15.46:0/3022582385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62dc1049f0 0x7f62dc102730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:05.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.546+0000 7f62da7fc640 1 -- 172.21.15.46:0/3022582385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62dc1049f0 msgr2=0x7f62dc102730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:05.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.546+0000 7f62da7fc640 1 --2- 172.21.15.46:0/3022582385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62dc1049f0 0x7f62dc102730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:05.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.546+0000 7f62da7fc640 1 -- 172.21.15.46:0/3022582385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62dc10de50 msgr2=0x7f62dc1031b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:05.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.546+0000 7f62da7fc640 1 --2- 172.21.15.46:0/3022582385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62dc10de50 0x7f62dc1031b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:05.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.546+0000 7f62da7fc640 1 -- 172.21.15.46:0/3022582385 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62dc1a8740 con 0x7f62dc105340 2024-09-21T03:47:05.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.546+0000 7f62da7fc640 1 --2- 172.21.15.46:0/3022582385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62dc105340 0x7f62dc102c70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f62d002a930 tx=0x7f62d0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:05.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.546+0000 7f62c3fff640 1 -- 172.21.15.46:0/3022582385 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d003f030 con 0x7f62dc105340 2024-09-21T03:47:05.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.546+0000 7f62c3fff640 1 -- 172.21.15.46:0/3022582385 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62d0003aa0 con 0x7f62dc105340 2024-09-21T03:47:05.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.546+0000 7f62c3fff640 1 -- 172.21.15.46:0/3022582385 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d0035070 con 0x7f62dc105340 2024-09-21T03:47:05.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.546+0000 7f62e1783640 1 -- 172.21.15.46:0/3022582385 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62dc1a89d0 con 0x7f62dc105340 2024-09-21T03:47:05.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.546+0000 7f62e1783640 1 -- 172.21.15.46:0/3022582385 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62dc1a8e60 con 0x7f62dc105340 2024-09-21T03:47:05.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.547+0000 7f62e1783640 1 -- 172.21.15.46:0/3022582385 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62dc104e00 con 0x7f62dc105340 2024-09-21T03:47:05.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.549+0000 7f62c3fff640 1 -- 172.21.15.46:0/3022582385 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f62d0042030 con 0x7f62dc105340 2024-09-21T03:47:05.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.550+0000 7f62c3fff640 1 --2- 172.21.15.46:0/3022582385 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f62c40b6550 0x7f62c40b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:05.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.550+0000 7f62daffd640 1 --2- 172.21.15.46:0/3022582385 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f62c40b6550 0x7f62c40b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:05.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.550+0000 7f62c3fff640 1 -- 172.21.15.46:0/3022582385 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f62d01061e0 con 0x7f62dc105340 2024-09-21T03:47:05.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.551+0000 7f62daffd640 1 --2- 172.21.15.46:0/3022582385 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f62c40b6550 0x7f62c40b8a60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f62cc005fd0 tx=0x7f62cc005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:05.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.553+0000 7f62c3fff640 1 -- 172.21.15.46:0/3022582385 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f62d00ce670 con 0x7f62dc105340 2024-09-21T03:47:05.699 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:05 smithi046 ceph-mon[30954]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:05.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.744+0000 7f62e1783640 1 -- 172.21.15.46:0/3022582385 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f62dc103a30 con 0x7f62dc105340 2024-09-21T03:47:05.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.748+0000 7f62c3fff640 1 -- 172.21.15.46:0/3022582385 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v37)=0 v37) ==== 121+0+0 (secure 0 0 0) 0x7f62dc103a30 con 0x7f62dc105340 2024-09-21T03:47:05.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.750+0000 7f62e1783640 1 -- 172.21.15.46:0/3022582385 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f62c40b6550 msgr2=0x7f62c40b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:05.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.750+0000 7f62e1783640 1 --2- 172.21.15.46:0/3022582385 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f62c40b6550 0x7f62c40b8a60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f62cc005fd0 tx=0x7f62cc005850 comp rx=0 tx=0).stop 2024-09-21T03:47:05.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.750+0000 7f62e1783640 1 -- 172.21.15.46:0/3022582385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62dc105340 msgr2=0x7f62dc102c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:05.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.750+0000 7f62e1783640 1 --2- 172.21.15.46:0/3022582385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62dc105340 0x7f62dc102c70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f62d002a930 tx=0x7f62d0004270 comp rx=0 tx=0).stop 2024-09-21T03:47:05.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.750+0000 7f62e1783640 1 -- 172.21.15.46:0/3022582385 shutdown_connections 2024-09-21T03:47:05.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.750+0000 7f62e1783640 1 --2- 172.21.15.46:0/3022582385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62dc10de50 0x7f62dc1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:05.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.750+0000 7f62e1783640 1 --2- 172.21.15.46:0/3022582385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62dc105340 0x7f62dc102c70 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:05.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.751+0000 7f62e1783640 1 --2- 172.21.15.46:0/3022582385 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f62c40b6550 0x7f62c40b8a60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:05.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.751+0000 7f62e1783640 1 --2- 172.21.15.46:0/3022582385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62dc1049f0 0x7f62dc102730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:05.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.751+0000 7f62e1783640 1 -- 172.21.15.46:0/3022582385 >> 172.21.15.46:0/3022582385 conn(0x7f62dc079750 msgr2=0x7f62dc100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:05.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.751+0000 7f62e1783640 1 -- 172.21.15.46:0/3022582385 shutdown_connections 2024-09-21T03:47:05.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:05.751+0000 7f62e1783640 1 -- 172.21.15.46:0/3022582385 wait complete. 2024-09-21T03:47:06.052 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a82de5ec-77cb-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/log_level', 'debug'], check_status=True, hostname='smithi046') 2024-09-21T03:47:06.052 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a82de5ec-77cb-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi046') 2024-09-21T03:47:06.052 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a82de5ec-77cb-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi046') 2024-09-21T03:47:06.053 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a82de5ec-77cb-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi046') 2024-09-21T03:47:06.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:05 smithi105 ceph-mon[34773]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:06.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:05 smithi162 ceph-mon[35071]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:06.699 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph config dump 2024-09-21T03:47:06.950 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:47:07.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:06 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3022582385' entity='client.admin' 2024-09-21T03:47:07.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:06 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3022582385' entity='client.admin' 2024-09-21T03:47:07.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:06 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3022582385' entity='client.admin' 2024-09-21T03:47:07.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.439+0000 7f4cd8173640 1 -- 172.21.15.46:0/3104495367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cd01094b0 msgr2=0x7f4cd01098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:07.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.439+0000 7f4cd8173640 1 --2- 172.21.15.46:0/3104495367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cd01094b0 0x7f4cd01098c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0009900 tx=0x7f4cc002a410 comp rx=0 tx=0).stop 2024-09-21T03:47:07.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.439+0000 7f4cd8173640 1 -- 172.21.15.46:0/3104495367 shutdown_connections 2024-09-21T03:47:07.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.439+0000 7f4cd8173640 1 --2- 172.21.15.46:0/3104495367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cd0109e00 0x7f4cd0110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.439+0000 7f4cd8173640 1 --2- 172.21.15.46:0/3104495367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cd01094b0 0x7f4cd01098c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.439+0000 7f4cd8173640 1 --2- 172.21.15.46:0/3104495367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cd0103bc0 0x7f4cd0103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.439+0000 7f4cd8173640 1 -- 172.21.15.46:0/3104495367 >> 172.21.15.46:0/3104495367 conn(0x7f4cd007b910 msgr2=0x7f4cd007bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:07.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.440+0000 7f4cd8173640 1 -- 172.21.15.46:0/3104495367 shutdown_connections 2024-09-21T03:47:07.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.440+0000 7f4cd8173640 1 -- 172.21.15.46:0/3104495367 wait complete. 2024-09-21T03:47:07.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.440+0000 7f4cd8173640 1 Processor -- start 2024-09-21T03:47:07.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.440+0000 7f4cd8173640 1 -- start start 2024-09-21T03:47:07.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.440+0000 7f4cd8173640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cd0103bc0 0x7f4cd019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:07.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.440+0000 7f4cd8173640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cd01094b0 0x7f4cd019aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:07.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.441+0000 7f4cd8173640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cd0109e00 0x7f4cd019fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:07.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.441+0000 7f4cd8173640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd0113ac0 con 0x7f4cd0103bc0 2024-09-21T03:47:07.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.441+0000 7f4cd8173640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd0113940 con 0x7f4cd01094b0 2024-09-21T03:47:07.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.441+0000 7f4cd8173640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd0113c40 con 0x7f4cd0109e00 2024-09-21T03:47:07.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.441+0000 7f4cd5f0f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cd0103bc0 0x7f4cd019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:07.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.441+0000 7f4cd5f0f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cd0103bc0 0x7f4cd019a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56298/0 (socket says 172.21.15.46:56298) 2024-09-21T03:47:07.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.441+0000 7f4cd5f0f640 1 -- 172.21.15.46:0/3272361966 learned_addr learned my addr 172.21.15.46:0/3272361966 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:47:07.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.441+0000 7f4cd570e640 1 --2- 172.21.15.46:0/3272361966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cd01094b0 0x7f4cd019aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:07.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.441+0000 7f4cd6710640 1 --2- 172.21.15.46:0/3272361966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cd0109e00 0x7f4cd019fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:07.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.441+0000 7f4cd5f0f640 1 -- 172.21.15.46:0/3272361966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cd0109e00 msgr2=0x7f4cd019fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:07.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.441+0000 7f4cd5f0f640 1 --2- 172.21.15.46:0/3272361966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cd0109e00 0x7f4cd019fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.441+0000 7f4cd5f0f640 1 -- 172.21.15.46:0/3272361966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cd01094b0 msgr2=0x7f4cd019aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:07.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.441+0000 7f4cd5f0f640 1 --2- 172.21.15.46:0/3272361966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cd01094b0 0x7f4cd019aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.441+0000 7f4cd5f0f640 1 -- 172.21.15.46:0/3272361966 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd01a03e0 con 0x7f4cd0103bc0 2024-09-21T03:47:07.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.441+0000 7f4cd5f0f640 1 --2- 172.21.15.46:0/3272361966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cd0103bc0 0x7f4cd019a470 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00d770 tx=0x7f4ccc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:07.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.441+0000 7f4cc6ffd640 1 -- 172.21.15.46:0/3272361966 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc017070 con 0x7f4cd0103bc0 2024-09-21T03:47:07.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.441+0000 7f4cc6ffd640 1 -- 172.21.15.46:0/3272361966 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ccc0054d0 con 0x7f4cd0103bc0 2024-09-21T03:47:07.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.441+0000 7f4cc6ffd640 1 -- 172.21.15.46:0/3272361966 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc004c30 con 0x7f4cd0103bc0 2024-09-21T03:47:07.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.442+0000 7f4cd8173640 1 -- 172.21.15.46:0/3272361966 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cd01a06d0 con 0x7f4cd0103bc0 2024-09-21T03:47:07.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.442+0000 7f4cd8173640 1 -- 172.21.15.46:0/3272361966 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cd01a6e30 con 0x7f4cd0103bc0 2024-09-21T03:47:07.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.443+0000 7f4cd8173640 1 -- 172.21.15.46:0/3272361966 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cd0103fd0 con 0x7f4cd0103bc0 2024-09-21T03:47:07.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.444+0000 7f4cc6ffd640 1 -- 172.21.15.46:0/3272361966 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f4ccc004e10 con 0x7f4cd0103bc0 2024-09-21T03:47:07.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.445+0000 7f4cc6ffd640 1 --2- 172.21.15.46:0/3272361966 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4cbc0b6550 0x7f4cbc0b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:07.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.445+0000 7f4cd570e640 1 --2- 172.21.15.46:0/3272361966 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4cbc0b6550 0x7f4cbc0b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:07.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.445+0000 7f4cc6ffd640 1 -- 172.21.15.46:0/3272361966 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f4ccc0e51a0 con 0x7f4cd0103bc0 2024-09-21T03:47:07.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.445+0000 7f4cd570e640 1 --2- 172.21.15.46:0/3272361966 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4cbc0b6550 0x7f4cbc0b8a60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0009230 tx=0x7f4cc0031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:07.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.449+0000 7f4cc6ffd640 1 -- 172.21.15.46:0/3272361966 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4ccc0b1970 con 0x7f4cd0103bc0 2024-09-21T03:47:07.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.639+0000 7f4cd8173640 1 -- 172.21.15.46:0/3272361966 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f4cd002e640 con 0x7f4cd0103bc0 2024-09-21T03:47:07.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.640+0000 7f4cc6ffd640 1 -- 172.21.15.46:0/3272361966 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v37) ==== 59+0+21924 (secure 0 0 0) 0x7f4ccc0b68b0 con 0x7f4cd0103bc0 2024-09-21T03:47:07.643 INFO:teuthology.orchestra.run.smithi046.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T03:47:07.643 INFO:teuthology.orchestra.run.smithi046.stdout:global dev auth_debug true 2024-09-21T03:47:07.643 INFO:teuthology.orchestra.run.smithi046.stdout:global basic container_image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 * 2024-09-21T03:47:07.643 INFO:teuthology.orchestra.run.smithi046.stdout:global dev debug_asserts_on_shutdown true 2024-09-21T03:47:07.643 INFO:teuthology.orchestra.run.smithi046.stdout:global basic log_to_file true 2024-09-21T03:47:07.643 INFO:teuthology.orchestra.run.smithi046.stdout:global basic log_to_journald false 2024-09-21T03:47:07.643 INFO:teuthology.orchestra.run.smithi046.stdout:global basic log_to_stderr false 2024-09-21T03:47:07.643 INFO:teuthology.orchestra.run.smithi046.stdout:global advanced mon_allow_pool_delete true 2024-09-21T03:47:07.643 INFO:teuthology.orchestra.run.smithi046.stdout:global advanced mon_clock_drift_allowed 1.000000 2024-09-21T03:47:07.643 INFO:teuthology.orchestra.run.smithi046.stdout:global advanced mon_cluster_log_to_file true 2024-09-21T03:47:07.643 INFO:teuthology.orchestra.run.smithi046.stdout:global advanced mon_max_pg_per_osd 10000 2024-09-21T03:47:07.644 INFO:teuthology.orchestra.run.smithi046.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2024-09-21T03:47:07.644 INFO:teuthology.orchestra.run.smithi046.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2024-09-21T03:47:07.644 INFO:teuthology.orchestra.run.smithi046.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2024-09-21T03:47:07.644 INFO:teuthology.orchestra.run.smithi046.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2024-09-21T03:47:07.644 INFO:teuthology.orchestra.run.smithi046.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2024-09-21T03:47:07.644 INFO:teuthology.orchestra.run.smithi046.stdout:global advanced mon_warn_on_too_few_osds false 2024-09-21T03:47:07.644 INFO:teuthology.orchestra.run.smithi046.stdout:global dev ms_die_on_bug true 2024-09-21T03:47:07.644 INFO:teuthology.orchestra.run.smithi046.stdout:global dev ms_die_on_old_message true 2024-09-21T03:47:07.644 INFO:teuthology.orchestra.run.smithi046.stdout:global dev ms_die_on_skipped_message false 2024-09-21T03:47:07.644 INFO:teuthology.orchestra.run.smithi046.stdout:global advanced osd_pool_default_erasure_code_profile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T03:47:07.644 INFO:teuthology.orchestra.run.smithi046.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2024-09-21T03:47:07.644 INFO:teuthology.orchestra.run.smithi046.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2024-09-21T03:47:07.644 INFO:teuthology.orchestra.run.smithi046.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2024-09-21T03:47:07.645 INFO:teuthology.orchestra.run.smithi046.stdout:mon advanced auth_service_ticket_ttl 240.000000 2024-09-21T03:47:07.645 INFO:teuthology.orchestra.run.smithi046.stdout:mon advanced debug_mon 20/20 2024-09-21T03:47:07.645 INFO:teuthology.orchestra.run.smithi046.stdout:mon advanced debug_ms 1/1 2024-09-21T03:47:07.645 INFO:teuthology.orchestra.run.smithi046.stdout:mon advanced debug_paxos 20/20 2024-09-21T03:47:07.645 INFO:teuthology.orchestra.run.smithi046.stdout:mon advanced mon_data_avail_warn 5 2024-09-21T03:47:07.645 INFO:teuthology.orchestra.run.smithi046.stdout:mon advanced mon_down_mkfs_grace 300 2024-09-21T03:47:07.645 INFO:teuthology.orchestra.run.smithi046.stdout:mon advanced mon_mgr_mkfs_grace 240 2024-09-21T03:47:07.645 INFO:teuthology.orchestra.run.smithi046.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T03:47:07.645 INFO:teuthology.orchestra.run.smithi046.stdout:mon dev mon_osd_prime_pg_temp true 2024-09-21T03:47:07.645 INFO:teuthology.orchestra.run.smithi046.stdout:mon advanced mon_osd_reporter_subtree_level osd 2024-09-21T03:47:07.645 INFO:teuthology.orchestra.run.smithi046.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T03:47:07.645 INFO:teuthology.orchestra.run.smithi046.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T03:47:07.645 INFO:teuthology.orchestra.run.smithi046.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2024-09-21T03:47:07.645 INFO:teuthology.orchestra.run.smithi046.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2024-09-21T03:47:07.646 INFO:teuthology.orchestra.run.smithi046.stdout:mon advanced public_network 172.21.0.0/20 * 2024-09-21T03:47:07.646 INFO:teuthology.orchestra.run.smithi046.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2024-09-21T03:47:07.646 INFO:teuthology.orchestra.run.smithi046.stdout:mgr advanced client_mount_timeout 30 2024-09-21T03:47:07.646 INFO:teuthology.orchestra.run.smithi046.stdout:mgr advanced debug_cephsqlite 20/20 2024-09-21T03:47:07.646 INFO:teuthology.orchestra.run.smithi046.stdout:mgr advanced debug_client 20/20 2024-09-21T03:47:07.646 INFO:teuthology.orchestra.run.smithi046.stdout:mgr advanced debug_mgr 20/20 2024-09-21T03:47:07.646 INFO:teuthology.orchestra.run.smithi046.stdout:mgr advanced debug_ms 1/1 2024-09-21T03:47:07.646 INFO:teuthology.orchestra.run.smithi046.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2024-09-21T03:47:07.646 INFO:teuthology.orchestra.run.smithi046.stdout:mgr advanced mgr/cephadm/container_init True * 2024-09-21T03:47:07.646 INFO:teuthology.orchestra.run.smithi046.stdout:mgr advanced mgr/cephadm/migration_current 7 * 2024-09-21T03:47:07.646 INFO:teuthology.orchestra.run.smithi046.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2024-09-21T03:47:07.646 INFO:teuthology.orchestra.run.smithi046.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2024-09-21T03:47:07.646 INFO:teuthology.orchestra.run.smithi046.stdout:mgr advanced mgr/snap_schedule/allow_m_granularity true 2024-09-21T03:47:07.647 INFO:teuthology.orchestra.run.smithi046.stdout:mgr advanced mgr/snap_schedule/dump_on_update true 2024-09-21T03:47:07.647 INFO:teuthology.orchestra.run.smithi046.stdout:mgr advanced mgr/snap_schedule/log_level debug 2024-09-21T03:47:07.647 INFO:teuthology.orchestra.run.smithi046.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T03:47:07.647 INFO:teuthology.orchestra.run.smithi046.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T03:47:07.647 INFO:teuthology.orchestra.run.smithi046.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T03:47:07.647 INFO:teuthology.orchestra.run.smithi046.stdout:osd dev bdev_debug_aio true 2024-09-21T03:47:07.647 INFO:teuthology.orchestra.run.smithi046.stdout:osd dev bluestore_block_size 96636764160 * 2024-09-21T03:47:07.647 INFO:teuthology.orchestra.run.smithi046.stdout:osd advanced bluestore_compression_mode aggressive 2024-09-21T03:47:07.647 INFO:teuthology.orchestra.run.smithi046.stdout:osd dev bluestore_fsck_on_mount true 2024-09-21T03:47:07.647 INFO:teuthology.orchestra.run.smithi046.stdout:osd advanced debug_bluefs 20/20 2024-09-21T03:47:07.647 INFO:teuthology.orchestra.run.smithi046.stdout:osd advanced debug_bluestore 20/20 2024-09-21T03:47:07.647 INFO:teuthology.orchestra.run.smithi046.stdout:osd advanced debug_ms 1/1 2024-09-21T03:47:07.647 INFO:teuthology.orchestra.run.smithi046.stdout:osd advanced debug_osd 20/20 2024-09-21T03:47:07.648 INFO:teuthology.orchestra.run.smithi046.stdout:osd advanced debug_rocksdb 10/10 2024-09-21T03:47:07.648 INFO:teuthology.orchestra.run.smithi046.stdout:osd dev osd_debug_misdirected_ops true 2024-09-21T03:47:07.648 INFO:teuthology.orchestra.run.smithi046.stdout:osd dev osd_debug_op_order true 2024-09-21T03:47:07.648 INFO:teuthology.orchestra.run.smithi046.stdout:osd dev osd_debug_pg_log_writeout true 2024-09-21T03:47:07.648 INFO:teuthology.orchestra.run.smithi046.stdout:osd dev osd_debug_shutdown true 2024-09-21T03:47:07.648 INFO:teuthology.orchestra.run.smithi046.stdout:osd dev osd_debug_verify_cached_snaps true 2024-09-21T03:47:07.648 INFO:teuthology.orchestra.run.smithi046.stdout:osd dev osd_debug_verify_missing_on_start true 2024-09-21T03:47:07.648 INFO:teuthology.orchestra.run.smithi046.stdout:osd dev osd_debug_verify_stray_on_activate true 2024-09-21T03:47:07.648 INFO:teuthology.orchestra.run.smithi046.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2024-09-21T03:47:07.648 INFO:teuthology.orchestra.run.smithi046.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2024-09-21T03:47:07.648 INFO:teuthology.orchestra.run.smithi046.stdout:osd advanced osd_max_omap_entries_per_request 10 2024-09-21T03:47:07.648 INFO:teuthology.orchestra.run.smithi046.stdout:osd advanced osd_mclock_profile high_recovery_ops 2024-09-21T03:47:07.648 INFO:teuthology.orchestra.run.smithi046.stdout:osd advanced osd_memory_target_autotune true 2024-09-21T03:47:07.649 INFO:teuthology.orchestra.run.smithi046.stdout:osd advanced osd_objectstore bluestore * 2024-09-21T03:47:07.649 INFO:teuthology.orchestra.run.smithi046.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T03:47:07.649 INFO:teuthology.orchestra.run.smithi046.stdout:osd advanced osd_op_queue debug_random * 2024-09-21T03:47:07.649 INFO:teuthology.orchestra.run.smithi046.stdout:osd advanced osd_op_queue_cut_off debug_random * 2024-09-21T03:47:07.649 INFO:teuthology.orchestra.run.smithi046.stdout:osd advanced osd_recover_clone_overlap true 2024-09-21T03:47:07.649 INFO:teuthology.orchestra.run.smithi046.stdout:osd advanced osd_recovery_max_chunk 1048576 2024-09-21T03:47:07.649 INFO:teuthology.orchestra.run.smithi046.stdout:osd advanced osd_scrub_load_threshold 5.000000 2024-09-21T03:47:07.649 INFO:teuthology.orchestra.run.smithi046.stdout:osd advanced osd_scrub_max_interval 600.000000 2024-09-21T03:47:07.649 INFO:teuthology.orchestra.run.smithi046.stdout:osd advanced osd_shutdown_pgref_assert true 2024-09-21T03:47:07.650 INFO:teuthology.orchestra.run.smithi046.stdout:mds advanced debug_mds 20/20 2024-09-21T03:47:07.650 INFO:teuthology.orchestra.run.smithi046.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T03:47:07.650 INFO:teuthology.orchestra.run.smithi046.stdout:mds advanced debug_ms 2/2 2024-09-21T03:47:07.650 INFO:teuthology.orchestra.run.smithi046.stdout:mds advanced mds_bal_fragment_size_max 10000 2024-09-21T03:47:07.650 INFO:teuthology.orchestra.run.smithi046.stdout:mds advanced mds_bal_merge_size 5 2024-09-21T03:47:07.650 INFO:teuthology.orchestra.run.smithi046.stdout:mds advanced mds_bal_split_bits 3 2024-09-21T03:47:07.650 INFO:teuthology.orchestra.run.smithi046.stdout:mds advanced mds_bal_split_size 100 2024-09-21T03:47:07.650 INFO:teuthology.orchestra.run.smithi046.stdout:mds dev mds_debug_frag true 2024-09-21T03:47:07.650 INFO:teuthology.orchestra.run.smithi046.stdout:mds dev mds_debug_scatterstat true 2024-09-21T03:47:07.650 INFO:teuthology.orchestra.run.smithi046.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T03:47:07.650 INFO:teuthology.orchestra.run.smithi046.stdout:mds dev mds_verify_scatter true 2024-09-21T03:47:07.650 INFO:teuthology.orchestra.run.smithi046.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T03:47:07.650 INFO:teuthology.orchestra.run.smithi046.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T03:47:07.650 INFO:teuthology.orchestra.run.smithi046.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T03:47:07.651 INFO:teuthology.orchestra.run.smithi046.stdout:client advanced client_mount_timeout 600 2024-09-21T03:47:07.651 INFO:teuthology.orchestra.run.smithi046.stdout:client advanced debug_client 20/20 2024-09-21T03:47:07.651 INFO:teuthology.orchestra.run.smithi046.stdout:client advanced debug_ms 1/1 2024-09-21T03:47:07.651 INFO:teuthology.orchestra.run.smithi046.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T03:47:07.651 INFO:teuthology.orchestra.run.smithi046.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T03:47:07.651 INFO:teuthology.orchestra.run.smithi046.stdout:client.rgw advanced rgw_cache_enabled true 2024-09-21T03:47:07.651 INFO:teuthology.orchestra.run.smithi046.stdout:client.rgw advanced rgw_enable_ops_log true 2024-09-21T03:47:07.651 INFO:teuthology.orchestra.run.smithi046.stdout:client.rgw advanced rgw_enable_usage_log true 2024-09-21T03:47:07.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.642+0000 7f4cd8173640 1 -- 172.21.15.46:0/3272361966 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4cbc0b6550 msgr2=0x7f4cbc0b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:07.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.642+0000 7f4cd8173640 1 --2- 172.21.15.46:0/3272361966 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4cbc0b6550 0x7f4cbc0b8a60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0009230 tx=0x7f4cc0031400 comp rx=0 tx=0).stop 2024-09-21T03:47:07.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.642+0000 7f4cd8173640 1 -- 172.21.15.46:0/3272361966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cd0103bc0 msgr2=0x7f4cd019a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:07.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.642+0000 7f4cd8173640 1 --2- 172.21.15.46:0/3272361966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cd0103bc0 0x7f4cd019a470 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00d770 tx=0x7f4ccc00dc30 comp rx=0 tx=0).stop 2024-09-21T03:47:07.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.642+0000 7f4cd8173640 1 -- 172.21.15.46:0/3272361966 shutdown_connections 2024-09-21T03:47:07.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.642+0000 7f4cd8173640 1 --2- 172.21.15.46:0/3272361966 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4cbc0b6550 0x7f4cbc0b8a60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.642+0000 7f4cd8173640 1 --2- 172.21.15.46:0/3272361966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cd0109e00 0x7f4cd019fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.642+0000 7f4cd8173640 1 --2- 172.21.15.46:0/3272361966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cd01094b0 0x7f4cd019aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.642+0000 7f4cd8173640 1 --2- 172.21.15.46:0/3272361966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cd0103bc0 0x7f4cd019a470 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.642+0000 7f4cd8173640 1 -- 172.21.15.46:0/3272361966 >> 172.21.15.46:0/3272361966 conn(0x7f4cd007b910 msgr2=0x7f4cd0105520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:07.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.643+0000 7f4cd8173640 1 -- 172.21.15.46:0/3272361966 shutdown_connections 2024-09-21T03:47:07.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:07.643+0000 7f4cd8173640 1 -- 172.21.15.46:0/3272361966 wait complete. 2024-09-21T03:47:07.968 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:07 smithi046 ceph-mon[30954]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:07.968 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:07 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3272361966' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T03:47:08.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:07 smithi105 ceph-mon[34773]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:08.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:07 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3272361966' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T03:47:08.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:07 smithi162 ceph-mon[35071]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:08.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:07 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3272361966' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T03:47:08.273 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T03:47:08.273 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T03:47:08.273 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T03:47:08.289 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T03:47:08.290 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_1 2024-09-21T03:47:08.346 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T03:47:08.346 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:47:08.346 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-21T03:47:08.346 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:47:08.346 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:47:08.346 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-09-21 03:45:45.035548774 +0000 2024-09-21T03:47:08.346 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-09-21 03:41:06.135558024 +0000 2024-09-21T03:47:08.346 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-09-21 03:41:06.135558024 +0000 2024-09-21T03:47:08.346 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-09-21 03:41:06.135558024 +0000 2024-09-21T03:47:08.346 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T03:47:08.411 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-09-21T03:47:08.411 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-09-21T03:47:08.411 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000108647 s, 4.7 MB/s 2024-09-21T03:47:08.413 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T03:47:08.470 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_2 2024-09-21T03:47:08.526 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T03:47:08.526 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:47:08.526 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-21T03:47:08.526 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:47:08.526 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:47:08.526 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-09-21 03:45:45.065548452 +0000 2024-09-21T03:47:08.526 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-09-21 03:41:06.445554883 +0000 2024-09-21T03:47:08.526 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-09-21 03:41:06.445554883 +0000 2024-09-21T03:47:08.526 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-09-21 03:41:06.445554883 +0000 2024-09-21T03:47:08.527 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T03:47:08.590 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-09-21T03:47:08.590 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-09-21T03:47:08.590 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.00010909 s, 4.7 MB/s 2024-09-21T03:47:08.591 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T03:47:08.648 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_3 2024-09-21T03:47:08.704 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T03:47:08.705 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:47:08.705 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-21T03:47:08.705 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:47:08.705 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:47:08.705 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-09-21 03:45:45.095548129 +0000 2024-09-21T03:47:08.705 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-09-21 03:41:06.772551571 +0000 2024-09-21T03:47:08.705 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-09-21 03:41:06.772551571 +0000 2024-09-21T03:47:08.705 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-09-21 03:41:06.772551571 +0000 2024-09-21T03:47:08.705 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T03:47:08.769 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-09-21T03:47:08.769 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-09-21T03:47:08.770 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000103468 s, 4.9 MB/s 2024-09-21T03:47:08.771 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T03:47:08.828 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_4 2024-09-21T03:47:08.883 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T03:47:08.884 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:47:08.884 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-21T03:47:08.884 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:47:08.884 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:47:08.884 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-09-21 03:45:45.128547775 +0000 2024-09-21T03:47:08.884 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-09-21 03:41:07.093548319 +0000 2024-09-21T03:47:08.884 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-09-21 03:41:07.093548319 +0000 2024-09-21T03:47:08.884 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-09-21 03:41:07.093548319 +0000 2024-09-21T03:47:08.884 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T03:47:08.948 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-09-21T03:47:08.948 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-09-21T03:47:08.948 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 9.2525e-05 s, 5.5 MB/s 2024-09-21T03:47:08.949 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T03:47:09.006 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:47:09.006 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T03:47:09.026 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T03:47:09.026 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_1 2024-09-21T03:47:09.085 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T03:47:09.085 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:47:09.086 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-21T03:47:09.086 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:47:09.086 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:47:09.086 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2024-09-21 03:46:42.550654634 +0000 2024-09-21T03:47:09.086 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2024-09-21 03:41:15.677284274 +0000 2024-09-21T03:47:09.086 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2024-09-21 03:41:15.677284274 +0000 2024-09-21T03:47:09.086 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: 2024-09-21 03:41:15.677284274 +0000 2024-09-21T03:47:09.086 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T03:47:09.156 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2024-09-21T03:47:09.156 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2024-09-21T03:47:09.156 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000238066 s, 2.2 MB/s 2024-09-21T03:47:09.158 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T03:47:09.217 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_2 2024-09-21T03:47:09.275 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T03:47:09.275 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:47:09.275 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-21T03:47:09.275 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:47:09.275 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:47:09.275 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2024-09-21 03:46:42.551654614 +0000 2024-09-21T03:47:09.275 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2024-09-21 03:41:15.999277728 +0000 2024-09-21T03:47:09.275 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2024-09-21 03:41:15.999277728 +0000 2024-09-21T03:47:09.275 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: 2024-09-21 03:41:15.999277728 +0000 2024-09-21T03:47:09.275 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T03:47:09.341 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2024-09-21T03:47:09.341 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2024-09-21T03:47:09.341 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000196356 s, 2.6 MB/s 2024-09-21T03:47:09.342 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T03:47:09.399 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_3 2024-09-21T03:47:09.455 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T03:47:09.455 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:47:09.455 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-21T03:47:09.456 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:47:09.456 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:47:09.456 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2024-09-21 03:46:42.551654614 +0000 2024-09-21T03:47:09.456 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2024-09-21 03:41:16.317271264 +0000 2024-09-21T03:47:09.456 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2024-09-21 03:41:16.317271264 +0000 2024-09-21T03:47:09.456 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: 2024-09-21 03:41:16.317271264 +0000 2024-09-21T03:47:09.456 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T03:47:09.520 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2024-09-21T03:47:09.521 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2024-09-21T03:47:09.521 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000210981 s, 2.4 MB/s 2024-09-21T03:47:09.522 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T03:47:09.579 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_4 2024-09-21T03:47:09.635 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T03:47:09.635 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:47:09.635 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-21T03:47:09.635 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:47:09.635 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:47:09.635 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2024-09-21 03:46:42.551654614 +0000 2024-09-21T03:47:09.636 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2024-09-21 03:41:16.639264718 +0000 2024-09-21T03:47:09.636 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2024-09-21 03:41:16.639264718 +0000 2024-09-21T03:47:09.636 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: 2024-09-21 03:41:16.639264718 +0000 2024-09-21T03:47:09.636 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T03:47:09.699 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2024-09-21T03:47:09.699 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2024-09-21T03:47:09.699 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000222629 s, 2.3 MB/s 2024-09-21T03:47:09.700 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T03:47:09.759 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:47:09.759 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T03:47:09.778 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T03:47:09.778 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_1 2024-09-21T03:47:09.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:09 smithi105 ceph-mon[34773]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:09.839 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T03:47:09.839 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:47:09.840 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-21T03:47:09.840 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:47:09.840 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:47:09.840 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-21 03:46:40.259892147 +0000 2024-09-21T03:47:09.840 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-21 03:41:17.201273262 +0000 2024-09-21T03:47:09.840 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-21 03:41:17.201273262 +0000 2024-09-21T03:47:09.840 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-21 03:41:17.201273262 +0000 2024-09-21T03:47:09.840 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T03:47:09.911 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-21T03:47:09.911 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-21T03:47:09.911 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000269739 s, 1.9 MB/s 2024-09-21T03:47:09.913 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T03:47:09.972 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_2 2024-09-21T03:47:10.030 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T03:47:10.031 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:47:10.031 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-21T03:47:10.031 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:47:10.031 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:47:10.031 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-21 03:46:40.259892147 +0000 2024-09-21T03:47:10.031 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-21 03:41:17.530266550 +0000 2024-09-21T03:47:10.031 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-21 03:41:17.530266550 +0000 2024-09-21T03:47:10.031 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-21 03:41:17.530266550 +0000 2024-09-21T03:47:10.032 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T03:47:10.097 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:09 smithi162 ceph-mon[35071]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:10.099 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-21T03:47:10.099 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-21T03:47:10.100 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000217965 s, 2.3 MB/s 2024-09-21T03:47:10.101 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T03:47:10.159 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_3 2024-09-21T03:47:10.216 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T03:47:10.216 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:47:10.216 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-21T03:47:10.216 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:47:10.216 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:47:10.216 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-21 03:46:40.260892127 +0000 2024-09-21T03:47:10.216 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-21 03:41:17.855259920 +0000 2024-09-21T03:47:10.216 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-21 03:41:17.855259920 +0000 2024-09-21T03:47:10.216 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-21 03:41:17.855259920 +0000 2024-09-21T03:47:10.216 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T03:47:10.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:09 smithi046 ceph-mon[30954]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:10.281 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-21T03:47:10.281 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-21T03:47:10.281 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000186147 s, 2.8 MB/s 2024-09-21T03:47:10.282 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T03:47:10.339 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_4 2024-09-21T03:47:10.397 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T03:47:10.397 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:47:10.397 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-21T03:47:10.397 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:47:10.397 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:47:10.398 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-21 03:46:40.260892127 +0000 2024-09-21T03:47:10.398 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-21 03:41:18.179253309 +0000 2024-09-21T03:47:10.398 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-21 03:41:18.179253309 +0000 2024-09-21T03:47:10.398 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-21 03:41:18.179253309 +0000 2024-09-21T03:47:10.398 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T03:47:10.462 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-21T03:47:10.463 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-21T03:47:10.463 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000197397 s, 2.6 MB/s 2024-09-21T03:47:10.464 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T03:47:10.521 INFO:tasks.cephadm:Deploying osd.0 on smithi046 with /dev/vg_nvme/lv_4... 2024-09-21T03:47:10.521 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T03:47:10.785 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:47:12.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:11 smithi105 ceph-mon[34773]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:12.073 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:11 smithi046 ceph-mon[30954]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:12.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:11 smithi162 ceph-mon[35071]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:13.202 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:47:13.234 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi046:vg_nvme/lv_4 2024-09-21T03:47:13.494 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:47:13.943 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:13 smithi046 ceph-mon[30954]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:13.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.954+0000 7f7bf1a76640 1 -- 172.21.15.46:0/1974832913 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bec1049e0 msgr2=0x7f7bec104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:13.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.954+0000 7f7bf1a76640 1 --2- 172.21.15.46:0/1974832913 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bec1049e0 0x7f7bec104df0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc009900 tx=0x7f7bdc02a410 comp rx=0 tx=0).stop 2024-09-21T03:47:13.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.954+0000 7f7bf1a76640 1 -- 172.21.15.46:0/1974832913 shutdown_connections 2024-09-21T03:47:13.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.954+0000 7f7bf1a76640 1 --2- 172.21.15.46:0/1974832913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bec10de40 0x7f7bec110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:13.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.954+0000 7f7bf1a76640 1 --2- 172.21.15.46:0/1974832913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bec105330 0x7f7bec10d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:13.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.954+0000 7f7bf1a76640 1 --2- 172.21.15.46:0/1974832913 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bec1049e0 0x7f7bec104df0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:13.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.954+0000 7f7bf1a76640 1 -- 172.21.15.46:0/1974832913 >> 172.21.15.46:0/1974832913 conn(0x7f7bec079750 msgr2=0x7f7bec079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:13.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.954+0000 7f7bf1a76640 1 -- 172.21.15.46:0/1974832913 shutdown_connections 2024-09-21T03:47:13.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.954+0000 7f7bf1a76640 1 -- 172.21.15.46:0/1974832913 wait complete. 2024-09-21T03:47:13.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.954+0000 7f7bf1a76640 1 Processor -- start 2024-09-21T03:47:13.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.955+0000 7f7bf1a76640 1 -- start start 2024-09-21T03:47:13.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.955+0000 7f7bf1a76640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bec1049e0 0x7f7bec19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:13.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.955+0000 7f7bf1a76640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bec105330 0x7f7bec19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:13.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.955+0000 7f7bf1a76640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bec10de40 0x7f7bec19fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:13.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.955+0000 7f7bf1a76640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7bec113b70 con 0x7f7bec1049e0 2024-09-21T03:47:13.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.955+0000 7f7bf1a76640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7bec1139f0 con 0x7f7bec10de40 2024-09-21T03:47:13.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.955+0000 7f7bf1a76640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7bec113cf0 con 0x7f7bec105330 2024-09-21T03:47:13.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.955+0000 7f7beb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bec1049e0 0x7f7bec19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:13.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.955+0000 7f7beb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bec1049e0 0x7f7bec19a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53180/0 (socket says 172.21.15.46:53180) 2024-09-21T03:47:13.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.955+0000 7f7beb7fe640 1 -- 172.21.15.46:0/423188455 learned_addr learned my addr 172.21.15.46:0/423188455 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:47:13.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.955+0000 7f7beaffd640 1 --2- 172.21.15.46:0/423188455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bec105330 0x7f7bec19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:13.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.955+0000 7f7beb7fe640 1 -- 172.21.15.46:0/423188455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bec105330 msgr2=0x7f7bec19ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:13.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.955+0000 7f7beb7fe640 1 --2- 172.21.15.46:0/423188455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bec105330 0x7f7bec19ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:13.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.955+0000 7f7beb7fe640 1 -- 172.21.15.46:0/423188455 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bec10de40 msgr2=0x7f7bec19fe20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:47:13.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.956+0000 7f7beb7fe640 1 --2- 172.21.15.46:0/423188455 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bec10de40 0x7f7bec19fe20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:13.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.956+0000 7f7beb7fe640 1 -- 172.21.15.46:0/423188455 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bec1a0550 con 0x7f7bec1049e0 2024-09-21T03:47:13.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.956+0000 7f7beb7fe640 1 --2- 172.21.15.46:0/423188455 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bec1049e0 0x7f7bec19a5e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc005ab0 tx=0x7f7bdc003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:13.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.956+0000 7f7be8ff9640 1 -- 172.21.15.46:0/423188455 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc03f070 con 0x7f7bec1049e0 2024-09-21T03:47:13.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.956+0000 7f7bf1a76640 1 -- 172.21.15.46:0/423188455 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bec1a07e0 con 0x7f7bec1049e0 2024-09-21T03:47:13.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.956+0000 7f7be8ff9640 1 -- 172.21.15.46:0/423188455 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7bdc031b50 con 0x7f7bec1049e0 2024-09-21T03:47:13.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.956+0000 7f7be8ff9640 1 -- 172.21.15.46:0/423188455 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc035030 con 0x7f7bec1049e0 2024-09-21T03:47:13.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.956+0000 7f7bf1a76640 1 -- 172.21.15.46:0/423188455 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bec1a6fa0 con 0x7f7bec1049e0 2024-09-21T03:47:13.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.957+0000 7f7bf1a76640 1 -- 172.21.15.46:0/423188455 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bec06c280 con 0x7f7bec1049e0 2024-09-21T03:47:13.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.959+0000 7f7be8ff9640 1 -- 172.21.15.46:0/423188455 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f7bdc042070 con 0x7f7bec1049e0 2024-09-21T03:47:13.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.959+0000 7f7be8ff9640 1 --2- 172.21.15.46:0/423188455 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7bd80b64d0 0x7f7bd80b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:13.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.960+0000 7f7beaffd640 1 --2- 172.21.15.46:0/423188455 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7bd80b64d0 0x7f7bd80b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:13.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.960+0000 7f7be8ff9640 1 -- 172.21.15.46:0/423188455 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f7bdc1065f0 con 0x7f7bec1049e0 2024-09-21T03:47:13.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.960+0000 7f7beaffd640 1 --2- 172.21.15.46:0/423188455 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7bd80b64d0 0x7f7bd80b89e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7bec10fae0 tx=0x7f7bd4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:13.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:13.963+0000 7f7be8ff9640 1 -- 172.21.15.46:0/423188455 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7bdc0cea80 con 0x7f7bec1049e0 2024-09-21T03:47:14.067 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:13 smithi105 ceph-mon[34773]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:14.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:13 smithi162 ceph-mon[35071]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:14.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:14.164+0000 7f7bf1a76640 1 -- 172.21.15.46:0/423188455 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f7bec108070 con 0x7f7bd80b64d0 2024-09-21T03:47:14.829 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:14 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:47:14.829 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:14 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:47:14.829 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:14 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:47:15.067 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:14 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:47:15.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:14 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:47:15.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:14 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:47:15.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:14 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:47:15.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:14 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:47:15.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:14 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:47:16.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:15 smithi046 ceph-mon[30954]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:16.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:15 smithi046 ceph-mon[30954]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:16.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:15 smithi105 ceph-mon[34773]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:16.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:15 smithi105 ceph-mon[34773]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:16.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:15 smithi162 ceph-mon[35071]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:16.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:15 smithi162 ceph-mon[35071]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:17.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:16 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3686464029' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6ff9e1a8-fec7-422c-b594-880efe4684f3"} : dispatch 2024-09-21T03:47:17.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:16 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3686464029' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6ff9e1a8-fec7-422c-b594-880efe4684f3"}]': finished 2024-09-21T03:47:17.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:16 smithi046 ceph-mon[30954]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T03:47:17.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:16 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:47:17.067 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:16 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3686464029' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6ff9e1a8-fec7-422c-b594-880efe4684f3"} : dispatch 2024-09-21T03:47:17.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:16 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3686464029' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6ff9e1a8-fec7-422c-b594-880efe4684f3"}]': finished 2024-09-21T03:47:17.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:16 smithi105 ceph-mon[34773]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T03:47:17.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:16 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:47:17.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:16 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3686464029' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6ff9e1a8-fec7-422c-b594-880efe4684f3"} : dispatch 2024-09-21T03:47:17.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:16 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3686464029' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6ff9e1a8-fec7-422c-b594-880efe4684f3"}]': finished 2024-09-21T03:47:17.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:16 smithi162 ceph-mon[35071]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T03:47:17.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:16 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:47:18.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:17 smithi105 ceph-mon[34773]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:18.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:17 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/668833773' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:47:18.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:17 smithi162 ceph-mon[35071]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:18.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:17 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/668833773' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:47:18.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:17 smithi046 ceph-mon[30954]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:18.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:17 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/668833773' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:47:20.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:19 smithi105 ceph-mon[34773]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:20.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:19 smithi162 ceph-mon[35071]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:20.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:19 smithi046 ceph-mon[30954]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:21.973 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:21 smithi046 ceph-mon[30954]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:22.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:21 smithi105 ceph-mon[34773]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:22.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:21 smithi162 ceph-mon[35071]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:23.884 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:23 smithi046 ceph-mon[30954]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:24.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:23 smithi105 ceph-mon[34773]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:24.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:23 smithi162 ceph-mon[35071]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:26.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:25 smithi105 ceph-mon[34773]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:26.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:25 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T03:47:26.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:25 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:47:26.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:25 smithi162 ceph-mon[35071]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:26.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:25 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T03:47:26.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:25 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:47:26.127 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:25 smithi046 ceph-mon[30954]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:26.128 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:25 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T03:47:26.128 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:25 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:47:27.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:26 smithi046 ceph-mon[30954]: Deploying daemon osd.0 on smithi046 2024-09-21T03:47:27.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:26 smithi105 ceph-mon[34773]: Deploying daemon osd.0 on smithi046 2024-09-21T03:47:27.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:26 smithi162 ceph-mon[35071]: Deploying daemon osd.0 on smithi046 2024-09-21T03:47:28.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:27 smithi046 ceph-mon[30954]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:28.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:27 smithi105 ceph-mon[34773]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:28.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:27 smithi162 ceph-mon[35071]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:30.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:29 smithi105 ceph-mon[34773]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:30.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:29 smithi162 ceph-mon[35071]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:30.130 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:29 smithi046 ceph-mon[30954]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:31.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:30 smithi046 ceph-mon[30954]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:31.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:30 smithi162 ceph-mon[35071]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:31.317 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:30 smithi105 ceph-mon[34773]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:31.999 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:31 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:47:31.999 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:31 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:31.999 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:31 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:32.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:31 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:47:32.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:31 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:32.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:31 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:32.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:31 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:47:32.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:31 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:32.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:31 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:33.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:32 smithi162 ceph-mon[35071]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:33.238 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:32 smithi046 ceph-mon[30954]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:33.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:32 smithi105 ceph-mon[34773]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:34.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:33 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:34.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:33 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:34.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:33 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:47:34.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:33 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:47:34.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:33 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:34.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:33 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:34.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:33 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:34.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:33 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:47:34.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:33 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:47:34.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:33 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:34.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:33 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:34.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:33 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:34.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:33 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:47:34.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:33 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:47:34.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:33 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:35.153 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:34 smithi046 ceph-mon[30954]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:35.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:34 smithi105 ceph-mon[34773]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:35.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:34 smithi162 ceph-mon[35071]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:35.429 INFO:teuthology.orchestra.run.smithi046.stdout:Created osd(s) 0 on host 'smithi046' 2024-09-21T03:47:35.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:35.426+0000 7f7be8ff9640 1 -- 172.21.15.46:0/423188455 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7bec108070 con 0x7f7bd80b64d0 2024-09-21T03:47:35.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:35.429+0000 7f7bf1a76640 1 -- 172.21.15.46:0/423188455 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7bd80b64d0 msgr2=0x7f7bd80b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:35.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:35.429+0000 7f7bf1a76640 1 --2- 172.21.15.46:0/423188455 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7bd80b64d0 0x7f7bd80b89e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7bec10fae0 tx=0x7f7bd4005f90 comp rx=0 tx=0).stop 2024-09-21T03:47:35.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:35.429+0000 7f7bf1a76640 1 -- 172.21.15.46:0/423188455 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bec1049e0 msgr2=0x7f7bec19a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:35.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:35.429+0000 7f7bf1a76640 1 --2- 172.21.15.46:0/423188455 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bec1049e0 0x7f7bec19a5e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc005ab0 tx=0x7f7bdc003b90 comp rx=0 tx=0).stop 2024-09-21T03:47:35.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:35.429+0000 7f7bf1a76640 1 -- 172.21.15.46:0/423188455 shutdown_connections 2024-09-21T03:47:35.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:35.429+0000 7f7bf1a76640 1 --2- 172.21.15.46:0/423188455 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bec10de40 0x7f7bec19fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:35.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:35.429+0000 7f7bf1a76640 1 --2- 172.21.15.46:0/423188455 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7bd80b64d0 0x7f7bd80b89e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:35.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:35.429+0000 7f7bf1a76640 1 --2- 172.21.15.46:0/423188455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bec105330 0x7f7bec19ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:35.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:35.429+0000 7f7bf1a76640 1 --2- 172.21.15.46:0/423188455 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bec1049e0 0x7f7bec19a5e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:35.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:35.429+0000 7f7bf1a76640 1 -- 172.21.15.46:0/423188455 >> 172.21.15.46:0/423188455 conn(0x7f7bec079750 msgr2=0x7f7bec107960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:35.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:35.429+0000 7f7bf1a76640 1 -- 172.21.15.46:0/423188455 shutdown_connections 2024-09-21T03:47:35.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:47:35.429+0000 7f7bf1a76640 1 -- 172.21.15.46:0/423188455 wait complete. 2024-09-21T03:47:36.065 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:35 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:47:36.065 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:35 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:36.065 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:35 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:36.099 DEBUG:teuthology.orchestra.run.smithi046:osd.0> sudo journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.0.service 2024-09-21T03:47:36.101 INFO:tasks.cephadm:Deploying osd.1 on smithi105 with /dev/vg_nvme/lv_4... 2024-09-21T03:47:36.101 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T03:47:36.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:35 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:47:36.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:35 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:36.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:35 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:36.341 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:47:36.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:35 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:47:36.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:35 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:36.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:35 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:37.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:36 smithi105 ceph-mon[34773]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:37.172 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:36 smithi046 ceph-mon[30954]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:37.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:36 smithi162 ceph-mon[35071]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:37.752 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 03:47:37 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-0[47599]: 2024-09-21T03:47:37.644+0000 7eff5dee5640 -1 osd.0 0 log_to_monitors true 2024-09-21T03:47:38.167 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:37 smithi046 ceph-mon[30954]: from='osd.0 [v2:172.21.15.46:6802/791989880,v1:172.21.15.46:6803/791989880]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T03:47:38.167 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:37 smithi046 ceph-mon[30954]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T03:47:38.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:37 smithi105 ceph-mon[34773]: from='osd.0 [v2:172.21.15.46:6802/791989880,v1:172.21.15.46:6803/791989880]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T03:47:38.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:37 smithi105 ceph-mon[34773]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T03:47:38.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:37 smithi162 ceph-mon[35071]: from='osd.0 [v2:172.21.15.46:6802/791989880,v1:172.21.15.46:6803/791989880]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T03:47:38.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:37 smithi162 ceph-mon[35071]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T03:47:38.589 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:47:38.619 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi105:vg_nvme/lv_4 2024-09-21T03:47:38.879 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:47:39.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:38 smithi046 ceph-mon[30954]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T03:47:39.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:38 smithi046 ceph-mon[30954]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T03:47:39.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:38 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:47:39.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:38 smithi046 ceph-mon[30954]: from='osd.0 [v2:172.21.15.46:6802/791989880,v1:172.21.15.46:6803/791989880]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]} : dispatch 2024-09-21T03:47:39.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:38 smithi046 ceph-mon[30954]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]} : dispatch 2024-09-21T03:47:39.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:38 smithi046 ceph-mon[30954]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:39.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:38 smithi046 ceph-mon[30954]: Detected new or changed devices on smithi046 2024-09-21T03:47:39.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:38 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:39.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:38 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:39.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:38 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:47:39.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:38 smithi046 ceph-mon[30954]: Adjusting osd_memory_target on smithi046 to 17092M 2024-09-21T03:47:39.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:38 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:39.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:38 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:47:39.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:38 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:47:39.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:38 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:39.155 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:38 smithi105 ceph-mon[34773]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T03:47:39.155 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:38 smithi105 ceph-mon[34773]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T03:47:39.155 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:38 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:47:39.155 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:38 smithi105 ceph-mon[34773]: from='osd.0 [v2:172.21.15.46:6802/791989880,v1:172.21.15.46:6803/791989880]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]} : dispatch 2024-09-21T03:47:39.155 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:38 smithi105 ceph-mon[34773]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]} : dispatch 2024-09-21T03:47:39.156 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:38 smithi105 ceph-mon[34773]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:39.156 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:38 smithi105 ceph-mon[34773]: Detected new or changed devices on smithi046 2024-09-21T03:47:39.156 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:38 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:39.156 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:38 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:39.156 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:38 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:47:39.156 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:38 smithi105 ceph-mon[34773]: Adjusting osd_memory_target on smithi046 to 17092M 2024-09-21T03:47:39.156 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:38 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:39.156 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:38 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:47:39.156 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:38 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:47:39.156 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:38 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:39.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.356+0000 7ffa60469640 1 -- 172.21.15.105:0/312388233 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa581049b0 msgr2=0x7ffa58104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:39.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.356+0000 7ffa60469640 1 --2- 172.21.15.105:0/312388233 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa581049b0 0x7ffa58104dc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ffa54009900 tx=0x7ffa5402a410 comp rx=0 tx=0).stop 2024-09-21T03:47:39.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.356+0000 7ffa60469640 1 -- 172.21.15.105:0/312388233 shutdown_connections 2024-09-21T03:47:39.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.356+0000 7ffa60469640 1 --2- 172.21.15.105:0/312388233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa5810de10 0x7ffa58110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:39.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.356+0000 7ffa60469640 1 --2- 172.21.15.105:0/312388233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa58105300 0x7ffa5810d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:39.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.356+0000 7ffa60469640 1 --2- 172.21.15.105:0/312388233 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa581049b0 0x7ffa58104dc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:39.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.356+0000 7ffa60469640 1 -- 172.21.15.105:0/312388233 >> 172.21.15.105:0/312388233 conn(0x7ffa58079730 msgr2=0x7ffa58079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:39.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.356+0000 7ffa60469640 1 -- 172.21.15.105:0/312388233 shutdown_connections 2024-09-21T03:47:39.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.356+0000 7ffa60469640 1 -- 172.21.15.105:0/312388233 wait complete. 2024-09-21T03:47:39.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.357+0000 7ffa60469640 1 Processor -- start 2024-09-21T03:47:39.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.357+0000 7ffa60469640 1 -- start start 2024-09-21T03:47:39.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.357+0000 7ffa60469640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa581049b0 0x7ffa5819a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:39.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.357+0000 7ffa60469640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa58105300 0x7ffa5819aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:39.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.357+0000 7ffa60469640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa5810de10 0x7ffa5819fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:39.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.357+0000 7ffa60469640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ffa58113a90 con 0x7ffa581049b0 2024-09-21T03:47:39.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.357+0000 7ffa60469640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ffa58113910 con 0x7ffa5810de10 2024-09-21T03:47:39.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.357+0000 7ffa60469640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffa58113c10 con 0x7ffa58105300 2024-09-21T03:47:39.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.357+0000 7ffa5e205640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa581049b0 0x7ffa5819a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:39.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.357+0000 7ffa5ea06640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa5810de10 0x7ffa5819fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:39.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.357+0000 7ffa5ea06640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa5810de10 0x7ffa5819fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:57332/0 (socket says 172.21.15.105:57332) 2024-09-21T03:47:39.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.357+0000 7ffa5e205640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa581049b0 0x7ffa5819a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.105:57098/0 (socket says 172.21.15.105:57098) 2024-09-21T03:47:39.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.357+0000 7ffa5ea06640 1 -- 172.21.15.105:0/4010270242 learned_addr learned my addr 172.21.15.105:0/4010270242 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:47:39.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.357+0000 7ffa5da04640 1 --2- 172.21.15.105:0/4010270242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa58105300 0x7ffa5819aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:39.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.358+0000 7ffa5ea06640 1 -- 172.21.15.105:0/4010270242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa58105300 msgr2=0x7ffa5819aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:39.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.358+0000 7ffa5ea06640 1 --2- 172.21.15.105:0/4010270242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa58105300 0x7ffa5819aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:39.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.358+0000 7ffa5ea06640 1 -- 172.21.15.105:0/4010270242 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa581049b0 msgr2=0x7ffa5819a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:39.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.358+0000 7ffa5ea06640 1 --2- 172.21.15.105:0/4010270242 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa581049b0 0x7ffa5819a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:39.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.358+0000 7ffa5ea06640 1 -- 172.21.15.105:0/4010270242 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa581a0470 con 0x7ffa5810de10 2024-09-21T03:47:39.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.358+0000 7ffa5ea06640 1 --2- 172.21.15.105:0/4010270242 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa5810de10 0x7ffa5819fd40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ffa5000eaa0 tx=0x7ffa5000ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:39.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.358+0000 7ffa4f7fe640 1 -- 172.21.15.105:0/4010270242 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5000cdb0 con 0x7ffa5810de10 2024-09-21T03:47:39.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.358+0000 7ffa4f7fe640 1 -- 172.21.15.105:0/4010270242 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa50005020 con 0x7ffa5810de10 2024-09-21T03:47:39.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.358+0000 7ffa60469640 1 -- 172.21.15.105:0/4010270242 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa581a0760 con 0x7ffa5810de10 2024-09-21T03:47:39.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.358+0000 7ffa4f7fe640 1 -- 172.21.15.105:0/4010270242 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa500116d0 con 0x7ffa5810de10 2024-09-21T03:47:39.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.358+0000 7ffa60469640 1 -- 172.21.15.105:0/4010270242 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa581a6ec0 con 0x7ffa5810de10 2024-09-21T03:47:39.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.360+0000 7ffa60469640 1 -- 172.21.15.105:0/4010270242 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa58104dc0 con 0x7ffa5810de10 2024-09-21T03:47:39.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.361+0000 7ffa4f7fe640 1 -- 172.21.15.105:0/4010270242 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7ffa500051d0 con 0x7ffa5810de10 2024-09-21T03:47:39.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.362+0000 7ffa4f7fe640 1 --2- 172.21.15.105:0/4010270242 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ffa440b6550 0x7ffa440b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:39.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.362+0000 7ffa5e205640 1 --2- 172.21.15.105:0/4010270242 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ffa440b6550 0x7ffa440b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:39.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.362+0000 7ffa4f7fe640 1 -- 172.21.15.105:0/4010270242 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1702+0+0 (secure 0 0 0) 0x7ffa500e58e0 con 0x7ffa5810de10 2024-09-21T03:47:39.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.363+0000 7ffa5e205640 1 --2- 172.21.15.105:0/4010270242 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ffa440b6550 0x7ffa440b8a60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ffa54000c00 tx=0x7ffa54031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:39.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.367+0000 7ffa4f7fe640 1 -- 172.21.15.105:0/4010270242 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ffa50016030 con 0x7ffa5810de10 2024-09-21T03:47:39.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:38 smithi162 ceph-mon[35071]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T03:47:39.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:38 smithi162 ceph-mon[35071]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T03:47:39.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:38 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:47:39.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:38 smithi162 ceph-mon[35071]: from='osd.0 [v2:172.21.15.46:6802/791989880,v1:172.21.15.46:6803/791989880]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]} : dispatch 2024-09-21T03:47:39.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:38 smithi162 ceph-mon[35071]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]} : dispatch 2024-09-21T03:47:39.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:38 smithi162 ceph-mon[35071]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:39.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:38 smithi162 ceph-mon[35071]: Detected new or changed devices on smithi046 2024-09-21T03:47:39.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:38 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:39.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:38 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:39.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:38 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:47:39.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:38 smithi162 ceph-mon[35071]: Adjusting osd_memory_target on smithi046 to 17092M 2024-09-21T03:47:39.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:38 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:39.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:38 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:47:39.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:38 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:47:39.377 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:38 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:39.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:47:39.573+0000 7ffa60469640 1 -- 172.21.15.105:0/4010270242 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7ffa58108f70 con 0x7ffa440b6550 2024-09-21T03:47:39.751 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 03:47:39 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-0[47599]: 2024-09-21T03:47:39.418+0000 7eff59e67640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T03:47:39.752 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 03:47:39 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-0[47599]: 2024-09-21T03:47:39.421+0000 7eff51c5d640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:47:40.233 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:39 smithi105 ceph-mon[34773]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-21T03:47:40.234 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:39 smithi105 ceph-mon[34773]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T03:47:40.234 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:39 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:47:40.234 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:39 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:47:40.234 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:39 smithi105 ceph-mon[34773]: from='osd.0 ' entity='osd.0' 2024-09-21T03:47:40.234 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:39 smithi105 ceph-mon[34773]: from='client.24308 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:40.234 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:39 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:47:40.234 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:39 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:47:40.234 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:39 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:47:40.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:39 smithi046 ceph-mon[30954]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-21T03:47:40.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:39 smithi046 ceph-mon[30954]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T03:47:40.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:39 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:47:40.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:39 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:47:40.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:39 smithi046 ceph-mon[30954]: from='osd.0 ' entity='osd.0' 2024-09-21T03:47:40.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:39 smithi046 ceph-mon[30954]: from='client.24308 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:40.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:39 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:47:40.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:39 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:47:40.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:39 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:47:40.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:39 smithi162 ceph-mon[35071]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-21T03:47:40.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:39 smithi162 ceph-mon[35071]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T03:47:40.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:39 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:47:40.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:39 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:47:40.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:39 smithi162 ceph-mon[35071]: from='osd.0 ' entity='osd.0' 2024-09-21T03:47:40.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:39 smithi162 ceph-mon[35071]: from='client.24308 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:47:40.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:39 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:47:40.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:39 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:47:40.377 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:39 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:47:41.146 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:40 smithi105 ceph-mon[34773]: purged_snaps scrub starts 2024-09-21T03:47:41.146 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:40 smithi105 ceph-mon[34773]: purged_snaps scrub ok 2024-09-21T03:47:41.146 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:40 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:47:41.147 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:40 smithi105 ceph-mon[34773]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:41.147 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:40 smithi105 ceph-mon[34773]: osd.0 [v2:172.21.15.46:6802/791989880,v1:172.21.15.46:6803/791989880] boot 2024-09-21T03:47:41.147 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:40 smithi105 ceph-mon[34773]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T03:47:41.147 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:40 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:47:41.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:40 smithi046 ceph-mon[30954]: purged_snaps scrub starts 2024-09-21T03:47:41.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:40 smithi046 ceph-mon[30954]: purged_snaps scrub ok 2024-09-21T03:47:41.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:40 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:47:41.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:40 smithi046 ceph-mon[30954]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:41.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:40 smithi046 ceph-mon[30954]: osd.0 [v2:172.21.15.46:6802/791989880,v1:172.21.15.46:6803/791989880] boot 2024-09-21T03:47:41.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:40 smithi046 ceph-mon[30954]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T03:47:41.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:40 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:47:41.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:40 smithi162 ceph-mon[35071]: purged_snaps scrub starts 2024-09-21T03:47:41.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:40 smithi162 ceph-mon[35071]: purged_snaps scrub ok 2024-09-21T03:47:41.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:40 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:47:41.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:40 smithi162 ceph-mon[35071]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:47:41.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:40 smithi162 ceph-mon[35071]: osd.0 [v2:172.21.15.46:6802/791989880,v1:172.21.15.46:6803/791989880] boot 2024-09-21T03:47:41.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:40 smithi162 ceph-mon[35071]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T03:47:41.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:40 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:47:42.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:42 smithi046 ceph-mon[30954]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T03:47:42.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:42 smithi046 ceph-mon[30954]: from='client.? 172.21.15.105:0/386685546' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3df1bee7-615e-44d0-bd43-2370db6cd06d"} : dispatch 2024-09-21T03:47:42.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:42 smithi046 ceph-mon[30954]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3df1bee7-615e-44d0-bd43-2370db6cd06d"} : dispatch 2024-09-21T03:47:42.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:42 smithi046 ceph-mon[30954]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3df1bee7-615e-44d0-bd43-2370db6cd06d"}]': finished 2024-09-21T03:47:42.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:42 smithi046 ceph-mon[30954]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T03:47:42.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:42 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:47:42.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:42 smithi105 ceph-mon[34773]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T03:47:42.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:42 smithi105 ceph-mon[34773]: from='client.? 172.21.15.105:0/386685546' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3df1bee7-615e-44d0-bd43-2370db6cd06d"} : dispatch 2024-09-21T03:47:42.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:42 smithi105 ceph-mon[34773]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3df1bee7-615e-44d0-bd43-2370db6cd06d"} : dispatch 2024-09-21T03:47:42.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:42 smithi105 ceph-mon[34773]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3df1bee7-615e-44d0-bd43-2370db6cd06d"}]': finished 2024-09-21T03:47:42.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:42 smithi105 ceph-mon[34773]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T03:47:42.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:42 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:47:42.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:42 smithi162 ceph-mon[35071]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T03:47:42.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:42 smithi162 ceph-mon[35071]: from='client.? 172.21.15.105:0/386685546' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3df1bee7-615e-44d0-bd43-2370db6cd06d"} : dispatch 2024-09-21T03:47:42.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:42 smithi162 ceph-mon[35071]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3df1bee7-615e-44d0-bd43-2370db6cd06d"} : dispatch 2024-09-21T03:47:42.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:42 smithi162 ceph-mon[35071]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3df1bee7-615e-44d0-bd43-2370db6cd06d"}]': finished 2024-09-21T03:47:42.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:42 smithi162 ceph-mon[35071]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T03:47:42.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:42 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:47:43.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:43 smithi046 ceph-mon[30954]: pgmap v34: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:47:43.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:43 smithi046 ceph-mon[30954]: from='client.? 172.21.15.105:0/607819509' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:47:43.777 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:43 smithi162 ceph-mon[35071]: pgmap v34: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:47:43.777 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:43 smithi162 ceph-mon[35071]: from='client.? 172.21.15.105:0/607819509' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:47:43.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:43 smithi105 ceph-mon[34773]: pgmap v34: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:47:43.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:43 smithi105 ceph-mon[34773]: from='client.? 172.21.15.105:0/607819509' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:47:45.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:45 smithi046 ceph-mon[30954]: pgmap v35: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:47:45.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:45 smithi105 ceph-mon[34773]: pgmap v35: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:47:45.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:45 smithi162 ceph-mon[35071]: pgmap v35: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:47:47.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:47 smithi046 ceph-mon[30954]: pgmap v36: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:47:47.817 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:47 smithi105 ceph-mon[34773]: pgmap v36: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:47:47.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:47 smithi162 ceph-mon[35071]: pgmap v36: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:47:49.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:49 smithi105 ceph-mon[34773]: pgmap v37: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:47:49.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:49 smithi046 ceph-mon[30954]: pgmap v37: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:47:49.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:49 smithi162 ceph-mon[35071]: pgmap v37: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:47:50.705 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:50 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T03:47:50.705 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:50 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:47:50.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:50 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T03:47:50.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:50 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:47:50.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:50 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T03:47:50.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:50 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:47:51.663 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:51 smithi105 ceph-mon[34773]: pgmap v38: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:47:51.663 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:51 smithi105 ceph-mon[34773]: Deploying daemon osd.1 on smithi105 2024-09-21T03:47:51.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:51 smithi046 ceph-mon[30954]: pgmap v38: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:47:51.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:51 smithi046 ceph-mon[30954]: Deploying daemon osd.1 on smithi105 2024-09-21T03:47:51.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:51 smithi162 ceph-mon[35071]: pgmap v38: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:47:51.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:51 smithi162 ceph-mon[35071]: Deploying daemon osd.1 on smithi105 2024-09-21T03:47:53.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:53 smithi046 ceph-mon[30954]: pgmap v39: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:47:53.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:53 smithi105 ceph-mon[34773]: pgmap v39: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:47:53.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:53 smithi162 ceph-mon[35071]: pgmap v39: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:47:55.721 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:55 smithi105 ceph-mon[34773]: pgmap v40: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:47:55.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:55 smithi046 ceph-mon[30954]: pgmap v40: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:47:55.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:55 smithi162 ceph-mon[35071]: pgmap v40: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:47:56.750 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:56 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:47:56.751 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:56 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:56.751 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:56 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:56.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:56 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:47:56.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:56 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:56.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:56 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:56.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:56 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:47:56.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:56 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:56.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:56 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:47:57.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:57 smithi046 ceph-mon[30954]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:47:57.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:57 smithi105 ceph-mon[34773]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:47:57.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:57 smithi162 ceph-mon[35071]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:48:00.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:59 smithi105 ceph-mon[34773]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:48:00.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:59 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:00.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:59 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:00.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:59 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:00.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:59 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:48:00.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:47:59 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:00.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:59 smithi162 ceph-mon[35071]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:48:00.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:59 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:00.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:59 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:00.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:59 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:00.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:59 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:48:00.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:47:59 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:00.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:59 smithi046 ceph-mon[30954]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:48:00.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:59 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:00.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:59 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:00.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:59 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:00.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:59 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:48:00.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:47:59 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:00.467 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:00.464+0000 7ffa4f7fe640 1 -- 172.21.15.105:0/4010270242 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ffa58108f70 con 0x7ffa440b6550 2024-09-21T03:48:00.467 INFO:teuthology.orchestra.run.smithi105.stdout:Created osd(s) 1 on host 'smithi105' 2024-09-21T03:48:00.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:00.467+0000 7ffa60469640 1 -- 172.21.15.105:0/4010270242 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ffa440b6550 msgr2=0x7ffa440b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:00.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:00.467+0000 7ffa60469640 1 --2- 172.21.15.105:0/4010270242 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ffa440b6550 0x7ffa440b8a60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ffa54000c00 tx=0x7ffa54031400 comp rx=0 tx=0).stop 2024-09-21T03:48:00.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:00.467+0000 7ffa60469640 1 -- 172.21.15.105:0/4010270242 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa5810de10 msgr2=0x7ffa5819fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:00.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:00.467+0000 7ffa60469640 1 --2- 172.21.15.105:0/4010270242 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa5810de10 0x7ffa5819fd40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ffa5000eaa0 tx=0x7ffa5000ef60 comp rx=0 tx=0).stop 2024-09-21T03:48:00.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:00.467+0000 7ffa60469640 1 -- 172.21.15.105:0/4010270242 shutdown_connections 2024-09-21T03:48:00.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:00.467+0000 7ffa60469640 1 --2- 172.21.15.105:0/4010270242 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa5810de10 0x7ffa5819fd40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:00.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:00.467+0000 7ffa60469640 1 --2- 172.21.15.105:0/4010270242 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ffa440b6550 0x7ffa440b8a60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:00.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:00.467+0000 7ffa60469640 1 --2- 172.21.15.105:0/4010270242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa58105300 0x7ffa5819aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:00.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:00.467+0000 7ffa60469640 1 --2- 172.21.15.105:0/4010270242 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa581049b0 0x7ffa5819a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:00.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:00.467+0000 7ffa60469640 1 -- 172.21.15.105:0/4010270242 >> 172.21.15.105:0/4010270242 conn(0x7ffa58079730 msgr2=0x7ffa580ff730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:00.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:00.467+0000 7ffa60469640 1 -- 172.21.15.105:0/4010270242 shutdown_connections 2024-09-21T03:48:00.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:00.467+0000 7ffa60469640 1 -- 172.21.15.105:0/4010270242 wait complete. 2024-09-21T03:48:01.018 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:00 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:48:01.018 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:00 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:01.019 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:00 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:01.020 DEBUG:teuthology.orchestra.run.smithi105:osd.1> sudo journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.1.service 2024-09-21T03:48:01.022 INFO:tasks.cephadm:Deploying osd.2 on smithi162 with /dev/vg_nvme/lv_4... 2024-09-21T03:48:01.022 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T03:48:01.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:00 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:48:01.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:00 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:01.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:00 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:01.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:00 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:48:01.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:00 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:01.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:00 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:01.274 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:48:02.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:01 smithi105 ceph-mon[34773]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:48:02.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:01 smithi162 ceph-mon[35071]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:48:02.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:01 smithi046 ceph-mon[30954]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:48:02.812 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 21 03:48:02 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-1[39410]: 2024-09-21T03:48:02.414+0000 7fc94e996640 -1 osd.1 0 log_to_monitors true 2024-09-21T03:48:02.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:02 smithi162 ceph-mon[35071]: from='osd.1 [v2:172.21.15.105:6800/1123652172,v1:172.21.15.105:6801/1123652172]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T03:48:02.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:02 smithi162 ceph-mon[35071]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T03:48:03.067 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:02 smithi105 ceph-mon[34773]: from='osd.1 [v2:172.21.15.105:6800/1123652172,v1:172.21.15.105:6801/1123652172]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T03:48:03.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:02 smithi105 ceph-mon[34773]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T03:48:03.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:02 smithi046 ceph-mon[30954]: from='osd.1 [v2:172.21.15.105:6800/1123652172,v1:172.21.15.105:6801/1123652172]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T03:48:03.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:02 smithi046 ceph-mon[30954]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T03:48:03.614 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:48:03.641 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi162:vg_nvme/lv_4 2024-09-21T03:48:03.906 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:48:04.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:03 smithi105 ceph-mon[34773]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:48:04.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:03 smithi105 ceph-mon[34773]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T03:48:04.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:03 smithi105 ceph-mon[34773]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T03:48:04.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:03 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:48:04.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:03 smithi105 ceph-mon[34773]: from='osd.1 [v2:172.21.15.105:6800/1123652172,v1:172.21.15.105:6801/1123652172]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi105", "root=default"]} : dispatch 2024-09-21T03:48:04.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:03 smithi105 ceph-mon[34773]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi105", "root=default"]} : dispatch 2024-09-21T03:48:04.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:03 smithi105 ceph-mon[34773]: Detected new or changed devices on smithi105 2024-09-21T03:48:04.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:03 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:04.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:03 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:04.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:03 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:48:04.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:03 smithi105 ceph-mon[34773]: Adjusting osd_memory_target on smithi105 to 17088M 2024-09-21T03:48:04.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:03 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:04.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:03 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:04.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:03 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:48:04.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:03 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:04.114 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:03 smithi162 ceph-mon[35071]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:48:04.115 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:03 smithi162 ceph-mon[35071]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T03:48:04.115 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:03 smithi162 ceph-mon[35071]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T03:48:04.115 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:03 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:48:04.115 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:03 smithi162 ceph-mon[35071]: from='osd.1 [v2:172.21.15.105:6800/1123652172,v1:172.21.15.105:6801/1123652172]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi105", "root=default"]} : dispatch 2024-09-21T03:48:04.115 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:03 smithi162 ceph-mon[35071]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi105", "root=default"]} : dispatch 2024-09-21T03:48:04.115 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:03 smithi162 ceph-mon[35071]: Detected new or changed devices on smithi105 2024-09-21T03:48:04.115 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:03 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:04.115 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:03 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:04.115 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:03 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:48:04.115 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:03 smithi162 ceph-mon[35071]: Adjusting osd_memory_target on smithi105 to 17088M 2024-09-21T03:48:04.115 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:03 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:04.115 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:03 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:04.115 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:03 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:48:04.115 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:03 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:04.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:03 smithi046 ceph-mon[30954]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:48:04.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:03 smithi046 ceph-mon[30954]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T03:48:04.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:03 smithi046 ceph-mon[30954]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T03:48:04.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:03 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:48:04.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:03 smithi046 ceph-mon[30954]: from='osd.1 [v2:172.21.15.105:6800/1123652172,v1:172.21.15.105:6801/1123652172]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi105", "root=default"]} : dispatch 2024-09-21T03:48:04.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:03 smithi046 ceph-mon[30954]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi105", "root=default"]} : dispatch 2024-09-21T03:48:04.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:03 smithi046 ceph-mon[30954]: Detected new or changed devices on smithi105 2024-09-21T03:48:04.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:03 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:04.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:03 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:04.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:03 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:48:04.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:03 smithi046 ceph-mon[30954]: Adjusting osd_memory_target on smithi105 to 17088M 2024-09-21T03:48:04.253 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:03 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:04.253 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:03 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:04.253 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:03 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:48:04.253 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:03 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:04.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.348+0000 7fe017194640 1 -- 172.21.15.162:0/2660287285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0101083a0 msgr2=0x7fe0101087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:04.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.348+0000 7fe017194640 1 --2- 172.21.15.162:0/2660287285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0101083a0 0x7fe0101087b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdffc009900 tx=0x7fdffc02a410 comp rx=0 tx=0).stop 2024-09-21T03:48:04.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.348+0000 7fe017194640 1 -- 172.21.15.162:0/2660287285 shutdown_connections 2024-09-21T03:48:04.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.348+0000 7fe017194640 1 --2- 172.21.15.162:0/2660287285 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe010108cf0 0x7fe01010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:04.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.348+0000 7fe017194640 1 --2- 172.21.15.162:0/2660287285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0101083a0 0x7fe0101087b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:04.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.348+0000 7fe017194640 1 --2- 172.21.15.162:0/2660287285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe010102a60 0x7fe010102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:04.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.348+0000 7fe017194640 1 -- 172.21.15.162:0/2660287285 >> 172.21.15.162:0/2660287285 conn(0x7fe010079730 msgr2=0x7fe010079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:04.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.348+0000 7fe017194640 1 -- 172.21.15.162:0/2660287285 shutdown_connections 2024-09-21T03:48:04.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.348+0000 7fe017194640 1 -- 172.21.15.162:0/2660287285 wait complete. 2024-09-21T03:48:04.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.349+0000 7fe017194640 1 Processor -- start 2024-09-21T03:48:04.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.349+0000 7fe017194640 1 -- start start 2024-09-21T03:48:04.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.349+0000 7fe017194640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe010102a60 0x7fe01019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:04.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.349+0000 7fe017194640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0101083a0 0x7fe01019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:04.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.349+0000 7fe017194640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe010108cf0 0x7fe01019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:04.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.349+0000 7fe017194640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe010112960 con 0x7fe0101083a0 2024-09-21T03:48:04.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.349+0000 7fe017194640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe0101127e0 con 0x7fe010102a60 2024-09-21T03:48:04.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.349+0000 7fe017194640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe010112ae0 con 0x7fe010108cf0 2024-09-21T03:48:04.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.349+0000 7fe015731640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe010108cf0 0x7fe01019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:04.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.350+0000 7fe015731640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe010108cf0 0x7fe01019fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57528/0 (socket says 172.21.15.162:57528) 2024-09-21T03:48:04.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.350+0000 7fe015731640 1 -- 172.21.15.162:0/2295515303 learned_addr learned my addr 172.21.15.162:0/2295515303 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T03:48:04.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.350+0000 7fe014f30640 1 --2- 172.21.15.162:0/2295515303 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe010102a60 0x7fe01019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:04.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.350+0000 7fe015731640 1 -- 172.21.15.162:0/2295515303 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe010102a60 msgr2=0x7fe01019a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:04.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.350+0000 7fe015731640 1 --2- 172.21.15.162:0/2295515303 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe010102a60 0x7fe01019a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:04.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.350+0000 7fe015731640 1 -- 172.21.15.162:0/2295515303 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0101083a0 msgr2=0x7fe01019aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:04.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.350+0000 7fe015731640 1 --2- 172.21.15.162:0/2295515303 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0101083a0 0x7fe01019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:04.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.350+0000 7fe015731640 1 -- 172.21.15.162:0/2295515303 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0101a0410 con 0x7fe010108cf0 2024-09-21T03:48:04.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.350+0000 7fe014f30640 1 --2- 172.21.15.162:0/2295515303 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe010102a60 0x7fe01019a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:48:04.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.350+0000 7fe015731640 1 --2- 172.21.15.162:0/2295515303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe010108cf0 0x7fe01019fce0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe00800cad0 tx=0x7fe00800cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:04.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.350+0000 7fe00dffb640 1 -- 172.21.15.162:0/2295515303 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00800ae20 con 0x7fe010108cf0 2024-09-21T03:48:04.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.350+0000 7fe017194640 1 -- 172.21.15.162:0/2295515303 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0101a0700 con 0x7fe010108cf0 2024-09-21T03:48:04.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.350+0000 7fe00dffb640 1 -- 172.21.15.162:0/2295515303 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe008005020 con 0x7fe010108cf0 2024-09-21T03:48:04.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.350+0000 7fe00dffb640 1 -- 172.21.15.162:0/2295515303 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00800f6b0 con 0x7fe010108cf0 2024-09-21T03:48:04.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.351+0000 7fe017194640 1 -- 172.21.15.162:0/2295515303 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0101a6e60 con 0x7fe010108cf0 2024-09-21T03:48:04.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.352+0000 7fe017194640 1 -- 172.21.15.162:0/2295515303 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe010102e70 con 0x7fe010108cf0 2024-09-21T03:48:04.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.354+0000 7fe00dffb640 1 -- 172.21.15.162:0/2295515303 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7fe0080051d0 con 0x7fe010108cf0 2024-09-21T03:48:04.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.355+0000 7fe00dffb640 1 --2- 172.21.15.162:0/2295515303 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe0000b64d0 0x7fe0000b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:04.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.355+0000 7fe00dffb640 1 -- 172.21.15.162:0/2295515303 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2244+0+0 (secure 0 0 0) 0x7fe0080e5f80 con 0x7fe010108cf0 2024-09-21T03:48:04.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.355+0000 7fe014f30640 1 --2- 172.21.15.162:0/2295515303 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe0000b64d0 0x7fe0000b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:04.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.356+0000 7fe014f30640 1 --2- 172.21.15.162:0/2295515303 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe0000b64d0 0x7fe0000b89e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe0040058c0 tx=0x7fe004005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:04.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.357+0000 7fe00dffb640 1 -- 172.21.15.162:0/2295515303 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe008014030 con 0x7fe010108cf0 2024-09-21T03:48:04.551 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:04.548+0000 7fe017194640 1 -- 172.21.15.162:0/2295515303 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fe010063800 con 0x7fe0000b64d0 2024-09-21T03:48:04.568 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 21 03:48:04 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-1[39410]: 2024-09-21T03:48:04.235+0000 7fc94a918640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T03:48:04.568 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 21 03:48:04 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-1[39410]: 2024-09-21T03:48:04.238+0000 7fc94270e640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:48:05.089 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:04 smithi162 ceph-mon[35071]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2024-09-21T03:48:05.089 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:04 smithi162 ceph-mon[35071]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T03:48:05.089 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:04 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:48:05.089 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:04 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:48:05.089 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:04 smithi162 ceph-mon[35071]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:48:05.089 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:04 smithi162 ceph-mon[35071]: from='osd.1 ' entity='osd.1' 2024-09-21T03:48:05.089 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:04 smithi162 ceph-mon[35071]: from='client.24334 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:05.090 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:04 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:48:05.090 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:04 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:48:05.090 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:04 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:05.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:04 smithi046 ceph-mon[30954]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2024-09-21T03:48:05.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:04 smithi046 ceph-mon[30954]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T03:48:05.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:04 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:48:05.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:04 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:48:05.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:04 smithi046 ceph-mon[30954]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:48:05.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:04 smithi046 ceph-mon[30954]: from='osd.1 ' entity='osd.1' 2024-09-21T03:48:05.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:04 smithi046 ceph-mon[30954]: from='client.24334 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:05.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:04 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:48:05.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:04 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:48:05.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:04 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:05.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:04 smithi105 ceph-mon[34773]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2024-09-21T03:48:05.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:04 smithi105 ceph-mon[34773]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T03:48:05.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:04 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:48:05.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:04 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:48:05.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:04 smithi105 ceph-mon[34773]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:48:05.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:04 smithi105 ceph-mon[34773]: from='osd.1 ' entity='osd.1' 2024-09-21T03:48:05.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:04 smithi105 ceph-mon[34773]: from='client.24334 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:05.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:04 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:48:05.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:04 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:48:05.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:04 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:06.080 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:05 smithi162 ceph-mon[35071]: purged_snaps scrub starts 2024-09-21T03:48:06.080 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:05 smithi162 ceph-mon[35071]: purged_snaps scrub ok 2024-09-21T03:48:06.081 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:05 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:48:06.081 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:05 smithi162 ceph-mon[35071]: osd.1 [v2:172.21.15.105:6800/1123652172,v1:172.21.15.105:6801/1123652172] boot 2024-09-21T03:48:06.081 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:05 smithi162 ceph-mon[35071]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T03:48:06.081 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:05 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:48:06.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:05 smithi046 ceph-mon[30954]: purged_snaps scrub starts 2024-09-21T03:48:06.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:05 smithi046 ceph-mon[30954]: purged_snaps scrub ok 2024-09-21T03:48:06.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:05 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:48:06.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:05 smithi046 ceph-mon[30954]: osd.1 [v2:172.21.15.105:6800/1123652172,v1:172.21.15.105:6801/1123652172] boot 2024-09-21T03:48:06.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:05 smithi046 ceph-mon[30954]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T03:48:06.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:05 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:48:06.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:05 smithi105 ceph-mon[34773]: purged_snaps scrub starts 2024-09-21T03:48:06.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:05 smithi105 ceph-mon[34773]: purged_snaps scrub ok 2024-09-21T03:48:06.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:05 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:48:06.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:05 smithi105 ceph-mon[34773]: osd.1 [v2:172.21.15.105:6800/1123652172,v1:172.21.15.105:6801/1123652172] boot 2024-09-21T03:48:06.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:05 smithi105 ceph-mon[34773]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T03:48:06.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:05 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:48:07.371 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:07 smithi162 ceph-mon[35071]: pgmap v49: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:07.372 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:07 smithi162 ceph-mon[35071]: osdmap e15: 2 total, 2 up, 2 in 2024-09-21T03:48:07.372 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:07 smithi162 ceph-mon[35071]: from='client.? 172.21.15.162:0/1335820516' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "52d0e57f-cfca-447a-8a57-b1d5364cb4d4"} : dispatch 2024-09-21T03:48:07.372 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:07 smithi162 ceph-mon[35071]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "52d0e57f-cfca-447a-8a57-b1d5364cb4d4"} : dispatch 2024-09-21T03:48:07.372 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:07 smithi162 ceph-mon[35071]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "52d0e57f-cfca-447a-8a57-b1d5364cb4d4"}]': finished 2024-09-21T03:48:07.372 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:07 smithi162 ceph-mon[35071]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T03:48:07.372 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:07 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:48:07.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:07 smithi046 ceph-mon[30954]: pgmap v49: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:07.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:07 smithi046 ceph-mon[30954]: osdmap e15: 2 total, 2 up, 2 in 2024-09-21T03:48:07.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:07 smithi046 ceph-mon[30954]: from='client.? 172.21.15.162:0/1335820516' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "52d0e57f-cfca-447a-8a57-b1d5364cb4d4"} : dispatch 2024-09-21T03:48:07.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:07 smithi046 ceph-mon[30954]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "52d0e57f-cfca-447a-8a57-b1d5364cb4d4"} : dispatch 2024-09-21T03:48:07.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:07 smithi046 ceph-mon[30954]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "52d0e57f-cfca-447a-8a57-b1d5364cb4d4"}]': finished 2024-09-21T03:48:07.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:07 smithi046 ceph-mon[30954]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T03:48:07.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:07 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:48:07.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:07 smithi105 ceph-mon[34773]: pgmap v49: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:07.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:07 smithi105 ceph-mon[34773]: osdmap e15: 2 total, 2 up, 2 in 2024-09-21T03:48:07.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:07 smithi105 ceph-mon[34773]: from='client.? 172.21.15.162:0/1335820516' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "52d0e57f-cfca-447a-8a57-b1d5364cb4d4"} : dispatch 2024-09-21T03:48:07.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:07 smithi105 ceph-mon[34773]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "52d0e57f-cfca-447a-8a57-b1d5364cb4d4"} : dispatch 2024-09-21T03:48:07.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:07 smithi105 ceph-mon[34773]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "52d0e57f-cfca-447a-8a57-b1d5364cb4d4"}]': finished 2024-09-21T03:48:07.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:07 smithi105 ceph-mon[34773]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T03:48:07.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:07 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:48:08.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:08 smithi046 ceph-mon[30954]: from='client.? 172.21.15.162:0/3744730994' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:48:08.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:08 smithi105 ceph-mon[34773]: from='client.? 172.21.15.162:0/3744730994' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:48:08.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:08 smithi162 ceph-mon[35071]: from='client.? 172.21.15.162:0/3744730994' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:48:09.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:09 smithi105 ceph-mon[34773]: pgmap v52: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:09.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:09 smithi162 ceph-mon[35071]: pgmap v52: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:09.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:09 smithi046 ceph-mon[30954]: pgmap v52: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:11.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:11 smithi105 ceph-mon[34773]: pgmap v53: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:11.618 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:11 smithi162 ceph-mon[35071]: pgmap v53: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:11.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:11 smithi046 ceph-mon[30954]: pgmap v53: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:13.337 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:13 smithi162 ceph-mon[35071]: pgmap v54: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:13.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:13 smithi105 ceph-mon[34773]: pgmap v54: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:13.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:13 smithi046 ceph-mon[30954]: pgmap v54: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:15.420 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:15 smithi162 ceph-mon[35071]: pgmap v55: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:15.420 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:15 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T03:48:15.420 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:15 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:15.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:15 smithi105 ceph-mon[34773]: pgmap v55: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:15.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:15 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T03:48:15.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:15 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:15.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:15 smithi046 ceph-mon[30954]: pgmap v55: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:15.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:15 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T03:48:15.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:15 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:16.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:16 smithi105 ceph-mon[34773]: Deploying daemon osd.2 on smithi162 2024-09-21T03:48:16.584 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:16 smithi162 ceph-mon[35071]: Deploying daemon osd.2 on smithi162 2024-09-21T03:48:16.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:16 smithi046 ceph-mon[30954]: Deploying daemon osd.2 on smithi162 2024-09-21T03:48:17.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:17 smithi105 ceph-mon[34773]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:17.595 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:17 smithi162 ceph-mon[35071]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:17.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:17 smithi046 ceph-mon[30954]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:19.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:19 smithi105 ceph-mon[34773]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:19.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:19 smithi162 ceph-mon[35071]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:19.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:19 smithi046 ceph-mon[30954]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:21.422 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:21 smithi162 ceph-mon[35071]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:21.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:21 smithi105 ceph-mon[34773]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:21.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:21 smithi046 ceph-mon[30954]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:22.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:22 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:48:22.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:22 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:22.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:22 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:22.594 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:22 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:48:22.595 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:22 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:22.595 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:22 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:22.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:22 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:48:22.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:22 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:22.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:22 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:23.814 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:23 smithi162 ceph-mon[35071]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:23.817 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:23 smithi105 ceph-mon[34773]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:24.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:23 smithi046 ceph-mon[30954]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:25.038 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 2 on host 'smithi162' 2024-09-21T03:48:25.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:25.036+0000 7fe00dffb640 1 -- 172.21.15.162:0/2295515303 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe010063800 con 0x7fe0000b64d0 2024-09-21T03:48:25.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:25.038+0000 7fe017194640 1 -- 172.21.15.162:0/2295515303 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe0000b64d0 msgr2=0x7fe0000b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:25.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:25.038+0000 7fe017194640 1 --2- 172.21.15.162:0/2295515303 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe0000b64d0 0x7fe0000b89e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe0040058c0 tx=0x7fe004005850 comp rx=0 tx=0).stop 2024-09-21T03:48:25.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:25.039+0000 7fe017194640 1 -- 172.21.15.162:0/2295515303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe010108cf0 msgr2=0x7fe01019fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:25.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:25.039+0000 7fe017194640 1 --2- 172.21.15.162:0/2295515303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe010108cf0 0x7fe01019fce0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe00800cad0 tx=0x7fe00800cf90 comp rx=0 tx=0).stop 2024-09-21T03:48:25.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:25.039+0000 7fe017194640 1 -- 172.21.15.162:0/2295515303 shutdown_connections 2024-09-21T03:48:25.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:25.039+0000 7fe017194640 1 --2- 172.21.15.162:0/2295515303 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe0000b64d0 0x7fe0000b89e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:25.039+0000 7fe017194640 1 --2- 172.21.15.162:0/2295515303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe010108cf0 0x7fe01019fce0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:25.039+0000 7fe017194640 1 --2- 172.21.15.162:0/2295515303 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0101083a0 0x7fe01019aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:25.039+0000 7fe017194640 1 --2- 172.21.15.162:0/2295515303 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe010102a60 0x7fe01019a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:25.039+0000 7fe017194640 1 -- 172.21.15.162:0/2295515303 >> 172.21.15.162:0/2295515303 conn(0x7fe010079730 msgr2=0x7fe01006b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:25.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:25.039+0000 7fe017194640 1 -- 172.21.15.162:0/2295515303 shutdown_connections 2024-09-21T03:48:25.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:48:25.039+0000 7fe017194640 1 -- 172.21.15.162:0/2295515303 wait complete. 2024-09-21T03:48:25.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:25 smithi162 ceph-mon[35071]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:25.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:25 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:25.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:25 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:25.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:25 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:25.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:25 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:48:25.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:25 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:25.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:25 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:48:25.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:25 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:25.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:25 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:25.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:25 smithi046 ceph-mon[30954]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:25.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:25 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:25.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:25 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:25.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:25 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:25.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:25 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:48:25.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:25 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:25.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:25 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:48:25.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:25 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:25.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:25 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:25.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:25 smithi105 ceph-mon[34773]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:25.570 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:25 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:25.570 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:25 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:25.570 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:25 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:25.570 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:25 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:48:25.570 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:25 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:25.570 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:25 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:48:25.570 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:25 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:25.570 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:25 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:25.701 DEBUG:teuthology.orchestra.run.smithi162:osd.2> sudo journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.2.service 2024-09-21T03:48:25.704 INFO:tasks.cephadm:Deploying osd.3 on smithi046 with /dev/vg_nvme/lv_3... 2024-09-21T03:48:25.704 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T03:48:25.973 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:48:27.144 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:27 smithi162 ceph-mon[35071]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:27.336 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:27 smithi046 ceph-mon[30954]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:27.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:27 smithi105 ceph-mon[34773]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:28.126 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 21 03:48:27 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-2[40211]: 2024-09-21T03:48:27.643+0000 7f09a8b0c640 -1 osd.2 0 log_to_monitors true 2024-09-21T03:48:28.426 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:28 smithi046 ceph-mon[30954]: from='osd.2 [v2:172.21.15.162:6800/34930776,v1:172.21.15.162:6801/34930776]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T03:48:28.426 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:28 smithi046 ceph-mon[30954]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T03:48:28.429 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:48:28.455 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi046:vg_nvme/lv_3 2024-09-21T03:48:28.470 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:28 smithi162 ceph-mon[35071]: from='osd.2 [v2:172.21.15.162:6800/34930776,v1:172.21.15.162:6801/34930776]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T03:48:28.470 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:28 smithi162 ceph-mon[35071]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T03:48:28.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:28 smithi105 ceph-mon[34773]: from='osd.2 [v2:172.21.15.162:6800/34930776,v1:172.21.15.162:6801/34930776]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T03:48:28.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:28 smithi105 ceph-mon[34773]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T03:48:28.726 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:48:29.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.225+0000 7fc919c65640 1 -- 172.21.15.46:0/683951542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9141083a0 msgr2=0x7fc9141087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:29.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.225+0000 7fc919c65640 1 --2- 172.21.15.46:0/683951542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9141083a0 0x7fc9141087b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc904009900 tx=0x7fc90402a410 comp rx=0 tx=0).stop 2024-09-21T03:48:29.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.225+0000 7fc919c65640 1 -- 172.21.15.46:0/683951542 shutdown_connections 2024-09-21T03:48:29.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.225+0000 7fc919c65640 1 --2- 172.21.15.46:0/683951542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc914108cf0 0x7fc91410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.225+0000 7fc919c65640 1 --2- 172.21.15.46:0/683951542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9141083a0 0x7fc9141087b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.225+0000 7fc919c65640 1 --2- 172.21.15.46:0/683951542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc914102a60 0x7fc914102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.225+0000 7fc919c65640 1 -- 172.21.15.46:0/683951542 >> 172.21.15.46:0/683951542 conn(0x7fc914079730 msgr2=0x7fc914079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:29.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.226+0000 7fc919c65640 1 -- 172.21.15.46:0/683951542 shutdown_connections 2024-09-21T03:48:29.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.226+0000 7fc919c65640 1 -- 172.21.15.46:0/683951542 wait complete. 2024-09-21T03:48:29.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.226+0000 7fc919c65640 1 Processor -- start 2024-09-21T03:48:29.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.226+0000 7fc919c65640 1 -- start start 2024-09-21T03:48:29.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.227+0000 7fc919c65640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc914102a60 0x7fc91419c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:29.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.227+0000 7fc919c65640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9141083a0 0x7fc91419cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:29.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.227+0000 7fc919c65640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc914108cf0 0x7fc9141a1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:29.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.227+0000 7fc919c65640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc9141129c0 con 0x7fc914102a60 2024-09-21T03:48:29.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.227+0000 7fc919c65640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc914112840 con 0x7fc9141083a0 2024-09-21T03:48:29.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.227+0000 7fc919c65640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc914112b40 con 0x7fc914108cf0 2024-09-21T03:48:29.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.227+0000 7fc9137fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc914102a60 0x7fc91419c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:29.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.227+0000 7fc9137fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc914102a60 0x7fc91419c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50644/0 (socket says 172.21.15.46:50644) 2024-09-21T03:48:29.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.227+0000 7fc9137fe640 1 -- 172.21.15.46:0/1508922040 learned_addr learned my addr 172.21.15.46:0/1508922040 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:48:29.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.227+0000 7fc912ffd640 1 --2- 172.21.15.46:0/1508922040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9141083a0 0x7fc91419cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:29.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.227+0000 7fc9137fe640 1 -- 172.21.15.46:0/1508922040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc914108cf0 msgr2=0x7fc9141a1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:29.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.227+0000 7fc913fff640 1 --2- 172.21.15.46:0/1508922040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc914108cf0 0x7fc9141a1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:29.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.227+0000 7fc9137fe640 1 --2- 172.21.15.46:0/1508922040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc914108cf0 0x7fc9141a1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.227+0000 7fc9137fe640 1 -- 172.21.15.46:0/1508922040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9141083a0 msgr2=0x7fc91419cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:29.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.227+0000 7fc9137fe640 1 --2- 172.21.15.46:0/1508922040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9141083a0 0x7fc91419cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.227+0000 7fc9137fe640 1 -- 172.21.15.46:0/1508922040 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9141a2660 con 0x7fc914102a60 2024-09-21T03:48:29.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.227+0000 7fc912ffd640 1 --2- 172.21.15.46:0/1508922040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9141083a0 0x7fc91419cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:48:29.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.228+0000 7fc9137fe640 1 --2- 172.21.15.46:0/1508922040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc914102a60 0x7fc91419c6f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc00b450 tx=0x7fc8fc00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:29.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.228+0000 7fc910ff9640 1 -- 172.21.15.46:0/1508922040 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc015020 con 0x7fc914102a60 2024-09-21T03:48:29.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.228+0000 7fc919c65640 1 -- 172.21.15.46:0/1508922040 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9141a2950 con 0x7fc914102a60 2024-09-21T03:48:29.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.228+0000 7fc910ff9640 1 -- 172.21.15.46:0/1508922040 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8fc011d40 con 0x7fc914102a60 2024-09-21T03:48:29.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.228+0000 7fc910ff9640 1 -- 172.21.15.46:0/1508922040 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc00f340 con 0x7fc914102a60 2024-09-21T03:48:29.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.228+0000 7fc919c65640 1 -- 172.21.15.46:0/1508922040 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9141a90b0 con 0x7fc914102a60 2024-09-21T03:48:29.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.229+0000 7fc919c65640 1 -- 172.21.15.46:0/1508922040 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc914102e70 con 0x7fc914102a60 2024-09-21T03:48:29.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.231+0000 7fc910ff9640 1 -- 172.21.15.46:0/1508922040 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7fc8fc018020 con 0x7fc914102a60 2024-09-21T03:48:29.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.231+0000 7fc910ff9640 1 --2- 172.21.15.46:0/1508922040 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc9000b64d0 0x7fc9000b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:29.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.231+0000 7fc912ffd640 1 --2- 172.21.15.46:0/1508922040 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc9000b64d0 0x7fc9000b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:29.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.231+0000 7fc910ff9640 1 -- 172.21.15.46:0/1508922040 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2786+0+0 (secure 0 0 0) 0x7fc8fc0e5b10 con 0x7fc914102a60 2024-09-21T03:48:29.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.232+0000 7fc912ffd640 1 --2- 172.21.15.46:0/1508922040 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc9000b64d0 0x7fc9000b89e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc904000c00 tx=0x7fc904032d80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:29.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.235+0000 7fc910ff9640 1 -- 172.21.15.46:0/1508922040 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc8fc01f020 con 0x7fc914102a60 2024-09-21T03:48:29.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:29 smithi046 ceph-mon[30954]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:29.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:29 smithi046 ceph-mon[30954]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T03:48:29.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:29 smithi046 ceph-mon[30954]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T03:48:29.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:29 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:48:29.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:29 smithi046 ceph-mon[30954]: from='osd.2 [v2:172.21.15.162:6800/34930776,v1:172.21.15.162:6801/34930776]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T03:48:29.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:29 smithi046 ceph-mon[30954]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T03:48:29.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:29 smithi046 ceph-mon[30954]: Detected new or changed devices on smithi162 2024-09-21T03:48:29.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:29 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:29.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:29 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:29.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:29 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:48:29.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:29 smithi046 ceph-mon[30954]: Adjusting osd_memory_target on smithi162 to 17088M 2024-09-21T03:48:29.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:29 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:29.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:29 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:29.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:29 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:48:29.253 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:29 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:29.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:29.433+0000 7fc919c65640 1 -- 172.21.15.46:0/1508922040 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fc91406b6b0 con 0x7fc9000b64d0 2024-09-21T03:48:29.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:29 smithi105 ceph-mon[34773]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:29.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:29 smithi105 ceph-mon[34773]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T03:48:29.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:29 smithi105 ceph-mon[34773]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T03:48:29.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:29 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:48:29.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:29 smithi105 ceph-mon[34773]: from='osd.2 [v2:172.21.15.162:6800/34930776,v1:172.21.15.162:6801/34930776]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T03:48:29.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:29 smithi105 ceph-mon[34773]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T03:48:29.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:29 smithi105 ceph-mon[34773]: Detected new or changed devices on smithi162 2024-09-21T03:48:29.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:29 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:29.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:29 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:29.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:29 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:48:29.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:29 smithi105 ceph-mon[34773]: Adjusting osd_memory_target on smithi162 to 17088M 2024-09-21T03:48:29.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:29 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:29.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:29 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:29.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:29 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:48:29.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:29 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:29.626 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 21 03:48:29 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-2[40211]: 2024-09-21T03:48:29.135+0000 7f09a4a8e640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T03:48:29.626 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 21 03:48:29 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-2[40211]: 2024-09-21T03:48:29.143+0000 7f09a088c640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:48:29.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:29 smithi162 ceph-mon[35071]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:29.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:29 smithi162 ceph-mon[35071]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T03:48:29.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:29 smithi162 ceph-mon[35071]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T03:48:29.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:29 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:48:29.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:29 smithi162 ceph-mon[35071]: from='osd.2 [v2:172.21.15.162:6800/34930776,v1:172.21.15.162:6801/34930776]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T03:48:29.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:29 smithi162 ceph-mon[35071]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T03:48:29.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:29 smithi162 ceph-mon[35071]: Detected new or changed devices on smithi162 2024-09-21T03:48:29.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:29 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:29.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:29 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:29.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:29 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:48:29.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:29 smithi162 ceph-mon[35071]: Adjusting osd_memory_target on smithi162 to 17088M 2024-09-21T03:48:29.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:29 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:29.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:29 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:29.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:29 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:48:29.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:29 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:30.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:30 smithi046 ceph-mon[30954]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T03:48:30.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:30 smithi046 ceph-mon[30954]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T03:48:30.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:30 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:48:30.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:30 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:48:30.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:30 smithi046 ceph-mon[30954]: from='client.14505 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:30.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:30 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:48:30.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:30 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:48:30.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:30 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:30.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:30 smithi105 ceph-mon[34773]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T03:48:30.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:30 smithi105 ceph-mon[34773]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T03:48:30.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:30 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:48:30.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:30 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:48:30.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:30 smithi105 ceph-mon[34773]: from='client.14505 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:30.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:30 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:48:30.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:30 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:48:30.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:30 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:30.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:30 smithi162 ceph-mon[35071]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T03:48:30.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:30 smithi162 ceph-mon[35071]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T03:48:30.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:30 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:48:30.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:30 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:48:30.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:30 smithi162 ceph-mon[35071]: from='client.14505 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:30.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:30 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:48:30.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:30 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:48:30.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:30 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:31.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:31 smithi046 ceph-mon[30954]: purged_snaps scrub starts 2024-09-21T03:48:31.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:31 smithi046 ceph-mon[30954]: purged_snaps scrub ok 2024-09-21T03:48:31.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:31 smithi046 ceph-mon[30954]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:31.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:31 smithi046 ceph-mon[30954]: osd.2 [v2:172.21.15.162:6800/34930776,v1:172.21.15.162:6801/34930776] boot 2024-09-21T03:48:31.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:31 smithi046 ceph-mon[30954]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T03:48:31.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:31 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:48:31.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:31 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T03:48:31.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:31 smithi105 ceph-mon[34773]: purged_snaps scrub starts 2024-09-21T03:48:31.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:31 smithi105 ceph-mon[34773]: purged_snaps scrub ok 2024-09-21T03:48:31.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:31 smithi105 ceph-mon[34773]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:31.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:31 smithi105 ceph-mon[34773]: osd.2 [v2:172.21.15.162:6800/34930776,v1:172.21.15.162:6801/34930776] boot 2024-09-21T03:48:31.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:31 smithi105 ceph-mon[34773]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T03:48:31.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:31 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:48:31.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:31 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T03:48:31.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:31 smithi162 ceph-mon[35071]: purged_snaps scrub starts 2024-09-21T03:48:31.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:31 smithi162 ceph-mon[35071]: purged_snaps scrub ok 2024-09-21T03:48:31.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:31 smithi162 ceph-mon[35071]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:48:31.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:31 smithi162 ceph-mon[35071]: osd.2 [v2:172.21.15.162:6800/34930776,v1:172.21.15.162:6801/34930776] boot 2024-09-21T03:48:31.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:31 smithi162 ceph-mon[35071]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T03:48:31.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:31 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:48:31.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:31 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T03:48:32.417 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:32 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T03:48:32.417 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:32 smithi046 ceph-mon[30954]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T03:48:32.418 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:32 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T03:48:32.418 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:32 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/2363584263' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6f25f721-fc50-4b80-944b-d3df28e7a2a5"} : dispatch 2024-09-21T03:48:32.418 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:32 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T03:48:32.418 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:32 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/2363584263' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6f25f721-fc50-4b80-944b-d3df28e7a2a5"}]': finished 2024-09-21T03:48:32.418 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:32 smithi046 ceph-mon[30954]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T03:48:32.418 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:32 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:48:32.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:32 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T03:48:32.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:32 smithi105 ceph-mon[34773]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T03:48:32.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:32 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T03:48:32.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:32 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/2363584263' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6f25f721-fc50-4b80-944b-d3df28e7a2a5"} : dispatch 2024-09-21T03:48:32.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:32 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T03:48:32.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:32 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/2363584263' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6f25f721-fc50-4b80-944b-d3df28e7a2a5"}]': finished 2024-09-21T03:48:32.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:32 smithi105 ceph-mon[34773]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T03:48:32.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:32 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:48:32.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:32 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T03:48:32.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:32 smithi162 ceph-mon[35071]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T03:48:32.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:32 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T03:48:32.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:32 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/2363584263' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6f25f721-fc50-4b80-944b-d3df28e7a2a5"} : dispatch 2024-09-21T03:48:32.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:32 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T03:48:32.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:32 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/2363584263' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6f25f721-fc50-4b80-944b-d3df28e7a2a5"}]': finished 2024-09-21T03:48:32.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:32 smithi162 ceph-mon[35071]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T03:48:32.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:32 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:48:32.972 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 03:48:32 smithi046 sudo[52080]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T03:48:32.972 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 03:48:32 smithi046 sudo[52080]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:48:32.972 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 03:48:32 smithi046 sudo[52080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:48:32.972 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 03:48:32 smithi046 sudo[52080]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:48:32.973 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 03:48:32 smithi046 sudo[52097]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T03:48:32.973 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 03:48:32 smithi046 sudo[52097]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:48:32.973 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 03:48:32 smithi046 sudo[52097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:48:32.973 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 03:48:32 smithi046 sudo[52097]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:48:33.154 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:33 smithi105 sudo[43402]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T03:48:33.154 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:33 smithi105 sudo[43402]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:48:33.154 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:33 smithi105 sudo[43402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:48:33.154 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:33 smithi105 sudo[43402]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:48:33.154 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:33 smithi105 sudo[43405]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T03:48:33.154 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:33 smithi105 sudo[43405]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:48:33.155 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:33 smithi105 sudo[43405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:48:33.155 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:33 smithi105 sudo[43405]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:48:33.155 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 21 03:48:32 smithi105 sudo[43396]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T03:48:33.155 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 21 03:48:32 smithi105 sudo[43396]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:48:33.155 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 21 03:48:32 smithi105 sudo[43396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:48:33.155 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 21 03:48:32 smithi105 sudo[43396]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:48:33.155 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 21 03:48:32 smithi105 sudo[43399]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T03:48:33.155 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 21 03:48:32 smithi105 sudo[43399]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:48:33.155 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 21 03:48:32 smithi105 sudo[43399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:48:33.155 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 21 03:48:32 smithi105 sudo[43399]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:48:33.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:32 smithi046 sudo[52100]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T03:48:33.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:32 smithi046 sudo[52100]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:48:33.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:32 smithi046 sudo[52100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:48:33.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:32 smithi046 sudo[52100]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:48:33.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:32 smithi046 sudo[52103]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T03:48:33.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:32 smithi046 sudo[52103]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:48:33.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:32 smithi046 sudo[52103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:48:33.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:32 smithi046 sudo[52103]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:48:33.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:33 smithi046 ceph-mon[30954]: pgmap v68: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:33.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:33 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/776450238' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:48:33.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:33 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:33.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:33 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:33.253 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:33 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:33.253 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:33 smithi046 ceph-mon[30954]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:48:33.253 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:33 smithi046 ceph-mon[30954]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:48:33.253 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:33 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:48:33.253 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:33 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:48:33.253 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:33 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:48:33.253 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:33 smithi046 ceph-mon[30954]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:48:33.253 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:33 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:48:33.253 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:33 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:48:33.253 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:33 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:48:33.253 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:33 smithi046 ceph-mon[30954]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:48:33.253 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:33 smithi046 ceph-mon[30954]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:48:33.253 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:33 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:48:33.253 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:33 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:48:33.254 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:33 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:48:33.254 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:33 smithi046 ceph-mon[30954]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:48:33.376 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 21 03:48:32 smithi162 sudo[43720]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T03:48:33.376 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 21 03:48:32 smithi162 sudo[43720]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:48:33.376 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 21 03:48:32 smithi162 sudo[43720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:48:33.376 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 21 03:48:32 smithi162 sudo[43720]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:48:33.376 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 21 03:48:32 smithi162 sudo[43723]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T03:48:33.376 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 21 03:48:32 smithi162 sudo[43723]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:48:33.376 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 21 03:48:32 smithi162 sudo[43723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:48:33.376 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 21 03:48:32 smithi162 sudo[43723]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:48:33.377 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:33 smithi162 sudo[43726]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T03:48:33.377 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:33 smithi162 sudo[43726]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:48:33.377 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:33 smithi162 sudo[43726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:48:33.377 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:33 smithi162 sudo[43726]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:48:33.377 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:33 smithi162 sudo[43729]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T03:48:33.377 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:33 smithi162 sudo[43729]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:48:33.377 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:33 smithi162 sudo[43729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:48:33.377 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:33 smithi162 sudo[43729]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:48:33.377 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:33 smithi162 ceph-mon[35071]: pgmap v68: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:33.377 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:33 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/776450238' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:48:33.377 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:33 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:33.378 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:33 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:33.378 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:33 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:33.378 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:33 smithi162 ceph-mon[35071]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:48:33.378 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:33 smithi162 ceph-mon[35071]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:48:33.378 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:33 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:48:33.378 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:33 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:48:33.378 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:33 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:48:33.378 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:33 smithi162 ceph-mon[35071]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:48:33.378 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:33 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:48:33.378 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:33 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:48:33.378 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:33 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:48:33.378 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:33 smithi162 ceph-mon[35071]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:48:33.378 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:33 smithi162 ceph-mon[35071]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:48:33.378 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:33 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:48:33.379 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:33 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:48:33.379 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:33 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:48:33.379 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:33 smithi162 ceph-mon[35071]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:48:33.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:33 smithi105 ceph-mon[34773]: pgmap v68: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:33.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:33 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/776450238' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:48:33.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:33 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:33.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:33 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:33.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:33 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:33.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:33 smithi105 ceph-mon[34773]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:48:33.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:33 smithi105 ceph-mon[34773]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:48:33.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:33 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:48:33.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:33 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:48:33.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:33 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:48:33.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:33 smithi105 ceph-mon[34773]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:48:33.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:33 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:48:33.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:33 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:48:33.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:33 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:48:33.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:33 smithi105 ceph-mon[34773]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:48:33.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:33 smithi105 ceph-mon[34773]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:48:33.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:33 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:48:33.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:33 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:48:33.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:33 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:48:33.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:33 smithi105 ceph-mon[34773]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:48:34.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:34.173+0000 7fc910ff9640 1 -- 172.21.15.46:0/1508922040 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fc8fc00f050 con 0x7fc914102a60 2024-09-21T03:48:34.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:34 smithi046 ceph-mon[30954]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T03:48:34.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:34 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:48:34.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:34 smithi105 ceph-mon[34773]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T03:48:34.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:34 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:48:34.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:34 smithi162 ceph-mon[35071]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T03:48:34.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:34 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:48:35.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:35 smithi046 ceph-mon[30954]: pgmap v71: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:35.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:35 smithi046 ceph-mon[30954]: mgrmap e20: x(active, since 2m), standbys: y, z 2024-09-21T03:48:35.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:35 smithi105 ceph-mon[34773]: pgmap v71: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:35.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:35 smithi105 ceph-mon[34773]: mgrmap e20: x(active, since 2m), standbys: y, z 2024-09-21T03:48:35.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:35 smithi162 ceph-mon[35071]: pgmap v71: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:35.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:35 smithi162 ceph-mon[35071]: mgrmap e20: x(active, since 2m), standbys: y, z 2024-09-21T03:48:37.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:37 smithi046 ceph-mon[30954]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:37.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:37 smithi105 ceph-mon[34773]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:37.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:37 smithi162 ceph-mon[35071]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:39.352 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:39 smithi046 ceph-mon[30954]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:39.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:39 smithi105 ceph-mon[34773]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:39.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:39 smithi162 ceph-mon[35071]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:41.387 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:41 smithi046 ceph-mon[30954]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:41.387 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:41 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T03:48:41.387 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:41 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:41.387 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:41 smithi046 ceph-mon[30954]: Deploying daemon osd.3 on smithi046 2024-09-21T03:48:41.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:41 smithi105 ceph-mon[34773]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:41.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:41 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T03:48:41.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:41 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:41.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:41 smithi105 ceph-mon[34773]: Deploying daemon osd.3 on smithi046 2024-09-21T03:48:41.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:41 smithi162 ceph-mon[35071]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:41.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:41 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T03:48:41.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:41 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:41.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:41 smithi162 ceph-mon[35071]: Deploying daemon osd.3 on smithi046 2024-09-21T03:48:43.439 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:43 smithi162 ceph-mon[35071]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:43.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:43 smithi046 ceph-mon[30954]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:43.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:43 smithi105 ceph-mon[34773]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:45.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:45 smithi046 ceph-mon[30954]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:45.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:45 smithi105 ceph-mon[34773]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:45.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:45 smithi162 ceph-mon[35071]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:47.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:47 smithi046 ceph-mon[30954]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:47.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:47 smithi105 ceph-mon[34773]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:47.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:47 smithi162 ceph-mon[35071]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:48.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:48 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:48:48.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:48 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:48.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:48 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:48.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:48 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:48:48.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:48 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:48.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:48 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:48.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:48 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:48:48.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:48 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:48.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:48 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:49.489 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:49 smithi046 ceph-mon[30954]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:49.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:49 smithi105 ceph-mon[34773]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:49.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:49 smithi162 ceph-mon[35071]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:50.674 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:50 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:50.674 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:50 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:50.674 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:50 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:50.674 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:50 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:48:50.674 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:50 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:50.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:50 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:50.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:50 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:50.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:50 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:50.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:50 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:48:50.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:50 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:50.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:50 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:50.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:50 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:50.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:50 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:50.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:50 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:48:50.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:50 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:51.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:51.305+0000 7fc910ff9640 1 -- 172.21.15.46:0/1508922040 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc91406b6b0 con 0x7fc9000b64d0 2024-09-21T03:48:51.308 INFO:teuthology.orchestra.run.smithi046.stdout:Created osd(s) 3 on host 'smithi046' 2024-09-21T03:48:51.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:51.308+0000 7fc919c65640 1 -- 172.21.15.46:0/1508922040 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc9000b64d0 msgr2=0x7fc9000b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:51.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:51.308+0000 7fc919c65640 1 --2- 172.21.15.46:0/1508922040 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc9000b64d0 0x7fc9000b89e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc904000c00 tx=0x7fc904032d80 comp rx=0 tx=0).stop 2024-09-21T03:48:51.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:51.308+0000 7fc919c65640 1 -- 172.21.15.46:0/1508922040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc914102a60 msgr2=0x7fc91419c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:51.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:51.308+0000 7fc919c65640 1 --2- 172.21.15.46:0/1508922040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc914102a60 0x7fc91419c6f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc00b450 tx=0x7fc8fc00b910 comp rx=0 tx=0).stop 2024-09-21T03:48:51.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:51.308+0000 7fc919c65640 1 -- 172.21.15.46:0/1508922040 shutdown_connections 2024-09-21T03:48:51.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:51.308+0000 7fc919c65640 1 --2- 172.21.15.46:0/1508922040 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc9000b64d0 0x7fc9000b89e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:51.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:51.308+0000 7fc919c65640 1 --2- 172.21.15.46:0/1508922040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc914108cf0 0x7fc9141a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:51.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:51.308+0000 7fc919c65640 1 --2- 172.21.15.46:0/1508922040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9141083a0 0x7fc91419cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:51.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:51.308+0000 7fc919c65640 1 --2- 172.21.15.46:0/1508922040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc914102a60 0x7fc91419c6f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:51.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:51.308+0000 7fc919c65640 1 -- 172.21.15.46:0/1508922040 >> 172.21.15.46:0/1508922040 conn(0x7fc914079730 msgr2=0x7fc91406afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:51.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:51.308+0000 7fc919c65640 1 -- 172.21.15.46:0/1508922040 shutdown_connections 2024-09-21T03:48:51.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:48:51.308+0000 7fc919c65640 1 -- 172.21.15.46:0/1508922040 wait complete. 2024-09-21T03:48:52.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:51 smithi046 ceph-mon[30954]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:52.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:51 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:48:52.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:51 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:52.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:51 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:52.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:51 smithi105 ceph-mon[34773]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:52.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:51 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:48:52.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:51 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:52.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:51 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:52.102 DEBUG:teuthology.orchestra.run.smithi046:osd.3> sudo journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.3.service 2024-09-21T03:48:52.104 INFO:tasks.cephadm:Deploying osd.4 on smithi105 with /dev/vg_nvme/lv_3... 2024-09-21T03:48:52.104 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T03:48:52.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:51 smithi162 ceph-mon[35071]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:52.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:51 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:48:52.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:51 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:52.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:51 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:52.358 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:48:53.608 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 21 03:48:53 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-3[54007]: 2024-09-21T03:48:53.290+0000 7f76b71bd640 -1 osd.3 0 log_to_monitors true 2024-09-21T03:48:53.877 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:53 smithi105 ceph-mon[34773]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:53.877 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:53 smithi105 ceph-mon[34773]: from='osd.3 [v2:172.21.15.46:6810/1355580104,v1:172.21.15.46:6811/1355580104]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T03:48:54.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:53 smithi046 ceph-mon[30954]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:54.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:53 smithi046 ceph-mon[30954]: from='osd.3 [v2:172.21.15.46:6810/1355580104,v1:172.21.15.46:6811/1355580104]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T03:48:54.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:53 smithi162 ceph-mon[35071]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:54.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:53 smithi162 ceph-mon[35071]: from='osd.3 [v2:172.21.15.46:6810/1355580104,v1:172.21.15.46:6811/1355580104]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T03:48:54.960 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:54 smithi105 ceph-mon[34773]: from='osd.3 [v2:172.21.15.46:6810/1355580104,v1:172.21.15.46:6811/1355580104]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T03:48:54.960 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:54 smithi105 ceph-mon[34773]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T03:48:54.960 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:54 smithi105 ceph-mon[34773]: from='osd.3 [v2:172.21.15.46:6810/1355580104,v1:172.21.15.46:6811/1355580104]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi046", "root=default"]} : dispatch 2024-09-21T03:48:54.960 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:54 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:48:54.960 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:54 smithi105 ceph-mon[34773]: from='osd.3 [v2:172.21.15.46:6810/1355580104,v1:172.21.15.46:6811/1355580104]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-21T03:48:54.963 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:48:54.988 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi105:vg_nvme/lv_3 2024-09-21T03:48:55.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:54 smithi046 ceph-mon[30954]: from='osd.3 [v2:172.21.15.46:6810/1355580104,v1:172.21.15.46:6811/1355580104]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T03:48:55.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:54 smithi046 ceph-mon[30954]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T03:48:55.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:54 smithi046 ceph-mon[30954]: from='osd.3 [v2:172.21.15.46:6810/1355580104,v1:172.21.15.46:6811/1355580104]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi046", "root=default"]} : dispatch 2024-09-21T03:48:55.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:54 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:48:55.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:54 smithi046 ceph-mon[30954]: from='osd.3 [v2:172.21.15.46:6810/1355580104,v1:172.21.15.46:6811/1355580104]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-21T03:48:55.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:54 smithi162 ceph-mon[35071]: from='osd.3 [v2:172.21.15.46:6810/1355580104,v1:172.21.15.46:6811/1355580104]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T03:48:55.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:54 smithi162 ceph-mon[35071]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T03:48:55.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:54 smithi162 ceph-mon[35071]: from='osd.3 [v2:172.21.15.46:6810/1355580104,v1:172.21.15.46:6811/1355580104]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi046", "root=default"]} : dispatch 2024-09-21T03:48:55.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:54 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:48:55.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:54 smithi162 ceph-mon[35071]: from='osd.3 [v2:172.21.15.46:6810/1355580104,v1:172.21.15.46:6811/1355580104]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-21T03:48:55.236 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:48:55.501 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 21 03:48:55 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-3[54007]: 2024-09-21T03:48:55.234+0000 7f76b3954640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T03:48:55.501 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 21 03:48:55 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-3[54007]: 2024-09-21T03:48:55.239+0000 7f76aaf35640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:48:55.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.720+0000 7fde089e5640 1 -- 172.21.15.105:0/4225083397 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde041083a0 msgr2=0x7fde041087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:55.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.720+0000 7fde089e5640 1 --2- 172.21.15.105:0/4225083397 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde041083a0 0x7fde041087b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fddf8009900 tx=0x7fddf802a410 comp rx=0 tx=0).stop 2024-09-21T03:48:55.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.720+0000 7fde089e5640 1 -- 172.21.15.105:0/4225083397 shutdown_connections 2024-09-21T03:48:55.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.720+0000 7fde089e5640 1 --2- 172.21.15.105:0/4225083397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde04108cf0 0x7fde0410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:55.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.720+0000 7fde089e5640 1 --2- 172.21.15.105:0/4225083397 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde041083a0 0x7fde041087b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:55.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.720+0000 7fde089e5640 1 --2- 172.21.15.105:0/4225083397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde04102a60 0x7fde04102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:55.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.720+0000 7fde089e5640 1 -- 172.21.15.105:0/4225083397 >> 172.21.15.105:0/4225083397 conn(0x7fde04079730 msgr2=0x7fde04079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:55.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.720+0000 7fde089e5640 1 -- 172.21.15.105:0/4225083397 shutdown_connections 2024-09-21T03:48:55.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.720+0000 7fde089e5640 1 -- 172.21.15.105:0/4225083397 wait complete. 2024-09-21T03:48:55.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.721+0000 7fde089e5640 1 Processor -- start 2024-09-21T03:48:55.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.721+0000 7fde089e5640 1 -- start start 2024-09-21T03:48:55.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.722+0000 7fde089e5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde04102a60 0x7fde0419a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:55.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.722+0000 7fde089e5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde041083a0 0x7fde0419a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:55.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.722+0000 7fde089e5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde04108cf0 0x7fde0419fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:55.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.722+0000 7fde089e5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fde04113a80 con 0x7fde04102a60 2024-09-21T03:48:55.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.722+0000 7fde089e5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fde04113900 con 0x7fde04108cf0 2024-09-21T03:48:55.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.722+0000 7fde089e5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fde04113c00 con 0x7fde041083a0 2024-09-21T03:48:55.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.722+0000 7fde02d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde04108cf0 0x7fde0419fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:55.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.722+0000 7fde02d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde04108cf0 0x7fde0419fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:46146/0 (socket says 172.21.15.105:46146) 2024-09-21T03:48:55.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.722+0000 7fde02d9d640 1 -- 172.21.15.105:0/3999702405 learned_addr learned my addr 172.21.15.105:0/3999702405 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:48:55.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.722+0000 7fde01d9b640 1 --2- 172.21.15.105:0/3999702405 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde041083a0 0x7fde0419a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:55.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.722+0000 7fde0259c640 1 --2- 172.21.15.105:0/3999702405 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde04102a60 0x7fde0419a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:55.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.722+0000 7fde02d9d640 1 -- 172.21.15.105:0/3999702405 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde041083a0 msgr2=0x7fde0419a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:55.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.722+0000 7fde02d9d640 1 --2- 172.21.15.105:0/3999702405 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde041083a0 0x7fde0419a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:55.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.722+0000 7fde02d9d640 1 -- 172.21.15.105:0/3999702405 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde04102a60 msgr2=0x7fde0419a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:55.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.722+0000 7fde02d9d640 1 --2- 172.21.15.105:0/3999702405 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde04102a60 0x7fde0419a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:55.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.722+0000 7fde02d9d640 1 -- 172.21.15.105:0/3999702405 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde041a03c0 con 0x7fde04108cf0 2024-09-21T03:48:55.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.722+0000 7fde01d9b640 1 --2- 172.21.15.105:0/3999702405 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde041083a0 0x7fde0419a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:48:55.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.722+0000 7fde02d9d640 1 --2- 172.21.15.105:0/3999702405 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde04108cf0 0x7fde0419fc90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fddfc00eaa0 tx=0x7fddfc00ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:55.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.722+0000 7fddf37fe640 1 -- 172.21.15.105:0/3999702405 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddfc00cdb0 con 0x7fde04108cf0 2024-09-21T03:48:55.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.722+0000 7fddf37fe640 1 -- 172.21.15.105:0/3999702405 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddfc005020 con 0x7fde04108cf0 2024-09-21T03:48:55.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.722+0000 7fde089e5640 1 -- 172.21.15.105:0/3999702405 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde041a06b0 con 0x7fde04108cf0 2024-09-21T03:48:55.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.722+0000 7fddf37fe640 1 -- 172.21.15.105:0/3999702405 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddfc0116d0 con 0x7fde04108cf0 2024-09-21T03:48:55.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.723+0000 7fde089e5640 1 -- 172.21.15.105:0/3999702405 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde041a6e10 con 0x7fde04108cf0 2024-09-21T03:48:55.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.723+0000 7fde089e5640 1 -- 172.21.15.105:0/3999702405 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde04102e70 con 0x7fde04108cf0 2024-09-21T03:48:55.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.725+0000 7fddf37fe640 1 -- 172.21.15.105:0/3999702405 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fddfc0051d0 con 0x7fde04108cf0 2024-09-21T03:48:55.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.725+0000 7fddf37fe640 1 --2- 172.21.15.105:0/3999702405 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fddec0b65e0 0x7fddec0b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:55.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.726+0000 7fddf37fe640 1 -- 172.21.15.105:0/3999702405 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3604+0+0 (secure 0 0 0) 0x7fddfc0e62e0 con 0x7fde04108cf0 2024-09-21T03:48:55.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.726+0000 7fde0259c640 1 --2- 172.21.15.105:0/3999702405 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fddec0b65e0 0x7fddec0b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:55.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.726+0000 7fde0259c640 1 --2- 172.21.15.105:0/3999702405 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fddec0b65e0 0x7fddec0b8af0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fddf4009b60 tx=0x7fddf4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:55.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.730+0000 7fddf37fe640 1 -- 172.21.15.105:0/3999702405 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fddfc016030 con 0x7fde04108cf0 2024-09-21T03:48:55.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:48:55.924+0000 7fde089e5640 1 -- 172.21.15.105:0/3999702405 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fde04063800 con 0x7fddec0b65e0 2024-09-21T03:48:55.927 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:55 smithi105 ceph-mon[34773]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:55.927 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:55 smithi105 ceph-mon[34773]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T03:48:55.927 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:55 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:48:55.927 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:55 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:48:55.927 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:55 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:55.927 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:55 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:55.927 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:55 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:48:55.928 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:55 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:48:55.928 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:55 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:55.928 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:55 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:55.928 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:55 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:48:55.928 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:55 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:55.928 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:55 smithi105 ceph-mon[34773]: from='osd.3 [v2:172.21.15.46:6810/1355580104,v1:172.21.15.46:6811/1355580104]' entity='osd.3' 2024-09-21T03:48:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:55 smithi162 ceph-mon[35071]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:55 smithi162 ceph-mon[35071]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T03:48:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:55 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:48:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:55 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:48:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:55 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:55 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:55 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:48:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:55 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:48:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:55 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:55 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:56.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:55 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:48:56.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:55 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:56.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:55 smithi162 ceph-mon[35071]: from='osd.3 [v2:172.21.15.46:6810/1355580104,v1:172.21.15.46:6811/1355580104]' entity='osd.3' 2024-09-21T03:48:56.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:55 smithi046 ceph-mon[30954]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:56.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:55 smithi046 ceph-mon[30954]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T03:48:56.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:55 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:48:56.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:55 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:48:56.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:55 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:56.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:55 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:56.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:55 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:48:56.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:55 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:48:56.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:55 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:56.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:55 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:56.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:55 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:48:56.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:55 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:48:56.253 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:55 smithi046 ceph-mon[30954]: from='osd.3 [v2:172.21.15.46:6810/1355580104,v1:172.21.15.46:6811/1355580104]' entity='osd.3' 2024-09-21T03:48:57.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:56 smithi105 ceph-mon[34773]: purged_snaps scrub starts 2024-09-21T03:48:57.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:56 smithi105 ceph-mon[34773]: purged_snaps scrub ok 2024-09-21T03:48:57.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:56 smithi105 ceph-mon[34773]: Detected new or changed devices on smithi046 2024-09-21T03:48:57.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:56 smithi105 ceph-mon[34773]: Adjusting osd_memory_target on smithi046 to 8546M 2024-09-21T03:48:57.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:56 smithi105 ceph-mon[34773]: osd.3 [v2:172.21.15.46:6810/1355580104,v1:172.21.15.46:6811/1355580104] boot 2024-09-21T03:48:57.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:56 smithi105 ceph-mon[34773]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T03:48:57.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:56 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:48:57.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:56 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:48:57.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:56 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:48:57.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:56 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:57.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:56 smithi162 ceph-mon[35071]: purged_snaps scrub starts 2024-09-21T03:48:57.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:56 smithi162 ceph-mon[35071]: purged_snaps scrub ok 2024-09-21T03:48:57.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:56 smithi162 ceph-mon[35071]: Detected new or changed devices on smithi046 2024-09-21T03:48:57.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:56 smithi162 ceph-mon[35071]: Adjusting osd_memory_target on smithi046 to 8546M 2024-09-21T03:48:57.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:56 smithi162 ceph-mon[35071]: osd.3 [v2:172.21.15.46:6810/1355580104,v1:172.21.15.46:6811/1355580104] boot 2024-09-21T03:48:57.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:56 smithi162 ceph-mon[35071]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T03:48:57.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:56 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:48:57.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:56 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:48:57.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:56 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:48:57.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:56 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:57.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:56 smithi046 ceph-mon[30954]: purged_snaps scrub starts 2024-09-21T03:48:57.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:56 smithi046 ceph-mon[30954]: purged_snaps scrub ok 2024-09-21T03:48:57.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:56 smithi046 ceph-mon[30954]: Detected new or changed devices on smithi046 2024-09-21T03:48:57.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:56 smithi046 ceph-mon[30954]: Adjusting osd_memory_target on smithi046 to 8546M 2024-09-21T03:48:57.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:56 smithi046 ceph-mon[30954]: osd.3 [v2:172.21.15.46:6810/1355580104,v1:172.21.15.46:6811/1355580104] boot 2024-09-21T03:48:57.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:56 smithi046 ceph-mon[30954]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T03:48:57.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:56 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:48:57.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:56 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:48:57.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:56 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:48:57.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:56 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:58.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:57 smithi105 ceph-mon[34773]: from='client.24386 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:58.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:57 smithi105 ceph-mon[34773]: pgmap v85: 1 pgs: 1 remapped+peering; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:58.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:57 smithi105 ceph-mon[34773]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T03:48:58.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:57 smithi162 ceph-mon[35071]: from='client.24386 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:58.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:57 smithi162 ceph-mon[35071]: pgmap v85: 1 pgs: 1 remapped+peering; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:58.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:57 smithi162 ceph-mon[35071]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T03:48:58.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:57 smithi046 ceph-mon[30954]: from='client.24386 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:48:58.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:57 smithi046 ceph-mon[30954]: pgmap v85: 1 pgs: 1 remapped+peering; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:48:58.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:57 smithi046 ceph-mon[30954]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T03:48:59.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:58 smithi105 ceph-mon[34773]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T03:48:59.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:58 smithi105 ceph-mon[34773]: from='client.? 172.21.15.105:0/3568933781' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c2f41084-e5a1-4b5f-b799-a84b38da63a4"} : dispatch 2024-09-21T03:48:59.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:58 smithi105 ceph-mon[34773]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c2f41084-e5a1-4b5f-b799-a84b38da63a4"} : dispatch 2024-09-21T03:48:59.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:58 smithi105 ceph-mon[34773]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c2f41084-e5a1-4b5f-b799-a84b38da63a4"}]': finished 2024-09-21T03:48:59.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:58 smithi105 ceph-mon[34773]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T03:48:59.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:58 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:48:59.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:58 smithi162 ceph-mon[35071]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T03:48:59.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:58 smithi162 ceph-mon[35071]: from='client.? 172.21.15.105:0/3568933781' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c2f41084-e5a1-4b5f-b799-a84b38da63a4"} : dispatch 2024-09-21T03:48:59.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:58 smithi162 ceph-mon[35071]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c2f41084-e5a1-4b5f-b799-a84b38da63a4"} : dispatch 2024-09-21T03:48:59.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:58 smithi162 ceph-mon[35071]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c2f41084-e5a1-4b5f-b799-a84b38da63a4"}]': finished 2024-09-21T03:48:59.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:58 smithi162 ceph-mon[35071]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T03:48:59.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:58 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:48:59.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:58 smithi046 ceph-mon[30954]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T03:48:59.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:58 smithi046 ceph-mon[30954]: from='client.? 172.21.15.105:0/3568933781' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c2f41084-e5a1-4b5f-b799-a84b38da63a4"} : dispatch 2024-09-21T03:48:59.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:58 smithi046 ceph-mon[30954]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c2f41084-e5a1-4b5f-b799-a84b38da63a4"} : dispatch 2024-09-21T03:48:59.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:58 smithi046 ceph-mon[30954]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c2f41084-e5a1-4b5f-b799-a84b38da63a4"}]': finished 2024-09-21T03:48:59.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:58 smithi046 ceph-mon[30954]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T03:48:59.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:58 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:49:00.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:59 smithi105 ceph-mon[34773]: pgmap v88: 1 pgs: 1 remapped+peering; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:49:00.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:48:59 smithi105 ceph-mon[34773]: from='client.? 172.21.15.105:0/409230976' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:49:00.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:59 smithi162 ceph-mon[35071]: pgmap v88: 1 pgs: 1 remapped+peering; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:49:00.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:48:59 smithi162 ceph-mon[35071]: from='client.? 172.21.15.105:0/409230976' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:49:00.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:59 smithi046 ceph-mon[30954]: pgmap v88: 1 pgs: 1 remapped+peering; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:49:00.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:48:59 smithi046 ceph-mon[30954]: from='client.? 172.21.15.105:0/409230976' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:49:02.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:01 smithi105 ceph-mon[34773]: pgmap v90: 1 pgs: 1 remapped+peering; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:49:02.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:01 smithi162 ceph-mon[35071]: pgmap v90: 1 pgs: 1 remapped+peering; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:49:02.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:01 smithi046 ceph-mon[30954]: pgmap v90: 1 pgs: 1 remapped+peering; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:49:04.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:03 smithi105 ceph-mon[34773]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T03:49:04.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:03 smithi162 ceph-mon[35071]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T03:49:04.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:03 smithi046 ceph-mon[30954]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T03:49:05.001 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:04 smithi105 ceph-mon[34773]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-21T03:49:05.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:04 smithi162 ceph-mon[35071]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-21T03:49:05.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:04 smithi046 ceph-mon[30954]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-21T03:49:07.269 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:07 smithi105 ceph-mon[34773]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T03:49:07.269 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:07 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T03:49:07.269 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:07 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:49:07.269 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:07 smithi105 ceph-mon[34773]: Deploying daemon osd.4 on smithi105 2024-09-21T03:49:07.343 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:07 smithi046 ceph-mon[30954]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T03:49:07.343 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:07 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T03:49:07.343 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:07 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:49:07.343 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:07 smithi046 ceph-mon[30954]: Deploying daemon osd.4 on smithi105 2024-09-21T03:49:07.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:07 smithi162 ceph-mon[35071]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T03:49:07.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:07 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T03:49:07.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:07 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:49:07.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:07 smithi162 ceph-mon[35071]: Deploying daemon osd.4 on smithi105 2024-09-21T03:49:09.179 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:09 smithi105 ceph-mon[34773]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T03:49:09.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:09 smithi162 ceph-mon[35071]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T03:49:09.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:09 smithi046 ceph-mon[30954]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T03:49:11.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:11 smithi105 ceph-mon[34773]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T03:49:11.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:11 smithi162 ceph-mon[35071]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T03:49:11.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:11 smithi046 ceph-mon[30954]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T03:49:13.317 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:13 smithi105 ceph-mon[34773]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:49:13.317 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:13 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:49:13.317 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:13 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:13.317 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:13 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:13.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:13 smithi162 ceph-mon[35071]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:49:13.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:13 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:49:13.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:13 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:13.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:13 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:13.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:13 smithi046 ceph-mon[30954]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:49:13.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:13 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:49:13.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:13 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:13.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:13 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:15.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:15 smithi105 ceph-mon[34773]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:49:15.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:15 smithi162 ceph-mon[35071]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:49:15.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:15 smithi046 ceph-mon[30954]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:49:16.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:16 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:16.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:16 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:16.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:16 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:49:16.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:16 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:49:16.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:16 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:16.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:16 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:16.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:16 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:16.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:16 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:49:16.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:16 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:49:16.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:16 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:16.950 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:49:16.948+0000 7fddf37fe640 1 -- 172.21.15.105:0/3999702405 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fde04063800 con 0x7fddec0b65e0 2024-09-21T03:49:16.951 INFO:teuthology.orchestra.run.smithi105.stdout:Created osd(s) 4 on host 'smithi105' 2024-09-21T03:49:16.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:49:16.950+0000 7fde089e5640 1 -- 172.21.15.105:0/3999702405 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fddec0b65e0 msgr2=0x7fddec0b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:16.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:49:16.950+0000 7fde089e5640 1 --2- 172.21.15.105:0/3999702405 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fddec0b65e0 0x7fddec0b8af0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fddf4009b60 tx=0x7fddf4005f90 comp rx=0 tx=0).stop 2024-09-21T03:49:16.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:49:16.950+0000 7fde089e5640 1 -- 172.21.15.105:0/3999702405 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde04108cf0 msgr2=0x7fde0419fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:16.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:49:16.950+0000 7fde089e5640 1 --2- 172.21.15.105:0/3999702405 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde04108cf0 0x7fde0419fc90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fddfc00eaa0 tx=0x7fddfc00ef60 comp rx=0 tx=0).stop 2024-09-21T03:49:16.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:49:16.951+0000 7fde089e5640 1 -- 172.21.15.105:0/3999702405 shutdown_connections 2024-09-21T03:49:16.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:49:16.951+0000 7fde089e5640 1 --2- 172.21.15.105:0/3999702405 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde04108cf0 0x7fde0419fc90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:16.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:49:16.951+0000 7fde089e5640 1 --2- 172.21.15.105:0/3999702405 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fddec0b65e0 0x7fddec0b8af0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:16.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:49:16.951+0000 7fde089e5640 1 --2- 172.21.15.105:0/3999702405 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde041083a0 0x7fde0419a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:16.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:49:16.951+0000 7fde089e5640 1 --2- 172.21.15.105:0/3999702405 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde04102a60 0x7fde0419a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:16.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:49:16.951+0000 7fde089e5640 1 -- 172.21.15.105:0/3999702405 >> 172.21.15.105:0/3999702405 conn(0x7fde04079730 msgr2=0x7fde04105260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:16.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:49:16.951+0000 7fde089e5640 1 -- 172.21.15.105:0/3999702405 shutdown_connections 2024-09-21T03:49:16.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:49:16.951+0000 7fde089e5640 1 -- 172.21.15.105:0/3999702405 wait complete. 2024-09-21T03:49:17.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:16 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:17.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:16 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:17.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:16 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:49:17.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:16 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:49:17.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:16 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:17.597 DEBUG:teuthology.orchestra.run.smithi105:osd.4> sudo journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.4.service 2024-09-21T03:49:17.599 INFO:tasks.cephadm:Deploying osd.5 on smithi162 with /dev/vg_nvme/lv_3... 2024-09-21T03:49:17.599 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T03:49:17.797 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:17 smithi105 ceph-mon[34773]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:49:17.797 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:17 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:49:17.797 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:17 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:17.797 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:17 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:17.834 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:17 smithi046 ceph-mon[30954]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:49:17.834 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:17 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:49:17.834 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:17 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:17.834 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:17 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:17.852 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:49:17.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:17 smithi162 ceph-mon[35071]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:49:17.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:17 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:49:17.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:17 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:17.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:17 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:19.050 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 21 03:49:18 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-4[46008]: 2024-09-21T03:49:18.744+0000 7f0721554640 -1 osd.4 0 log_to_monitors true 2024-09-21T03:49:19.797 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:19 smithi105 ceph-mon[34773]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:49:19.797 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:19 smithi105 ceph-mon[34773]: from='osd.4 [v2:172.21.15.105:6808/3566174660,v1:172.21.15.105:6809/3566174660]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T03:49:19.797 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:19 smithi105 ceph-mon[34773]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T03:49:19.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:19 smithi162 ceph-mon[35071]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:49:19.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:19 smithi162 ceph-mon[35071]: from='osd.4 [v2:172.21.15.105:6808/3566174660,v1:172.21.15.105:6809/3566174660]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T03:49:19.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:19 smithi162 ceph-mon[35071]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T03:49:20.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:19 smithi046 ceph-mon[30954]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:49:20.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:19 smithi046 ceph-mon[30954]: from='osd.4 [v2:172.21.15.105:6808/3566174660,v1:172.21.15.105:6809/3566174660]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T03:49:20.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:19 smithi046 ceph-mon[30954]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T03:49:20.397 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:49:20.427 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi162:vg_nvme/lv_3 2024-09-21T03:49:20.693 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:49:20.703 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:20 smithi162 ceph-mon[35071]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T03:49:20.703 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:20 smithi162 ceph-mon[35071]: from='osd.4 [v2:172.21.15.105:6808/3566174660,v1:172.21.15.105:6809/3566174660]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi105", "root=default"]} : dispatch 2024-09-21T03:49:20.703 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:20 smithi162 ceph-mon[35071]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T03:49:20.704 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:20 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:49:20.704 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:20 smithi162 ceph-mon[35071]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi105", "root=default"]} : dispatch 2024-09-21T03:49:20.704 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:20 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:20.704 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:20 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:20.704 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:20 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:20.704 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:20 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:20.704 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:20 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:20.704 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:20 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:49:20.704 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:20 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:49:20.704 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:20 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:20.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:20 smithi105 ceph-mon[34773]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T03:49:20.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:20 smithi105 ceph-mon[34773]: from='osd.4 [v2:172.21.15.105:6808/3566174660,v1:172.21.15.105:6809/3566174660]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi105", "root=default"]} : dispatch 2024-09-21T03:49:20.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:20 smithi105 ceph-mon[34773]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T03:49:20.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:20 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:49:20.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:20 smithi105 ceph-mon[34773]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi105", "root=default"]} : dispatch 2024-09-21T03:49:20.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:20 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:20.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:20 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:20.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:20 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:20.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:20 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:20.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:20 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:20.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:20 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:49:20.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:20 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:49:20.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:20 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:21.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:20 smithi046 ceph-mon[30954]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T03:49:21.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:20 smithi046 ceph-mon[30954]: from='osd.4 [v2:172.21.15.105:6808/3566174660,v1:172.21.15.105:6809/3566174660]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi105", "root=default"]} : dispatch 2024-09-21T03:49:21.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:20 smithi046 ceph-mon[30954]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T03:49:21.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:20 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:49:21.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:20 smithi046 ceph-mon[30954]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi105", "root=default"]} : dispatch 2024-09-21T03:49:21.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:20 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:21.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:20 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:21.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:20 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:21.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:20 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:21.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:20 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:21.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:20 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:49:21.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:20 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:49:21.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:20 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:21.221 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.192+0000 7f027db71640 1 -- 172.21.15.162:0/2528574859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0278102a60 msgr2=0x7f0278102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:21.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.192+0000 7f027db71640 1 --2- 172.21.15.162:0/2528574859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0278102a60 0x7f0278102e70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0268009900 tx=0x7f026802a410 comp rx=0 tx=0).stop 2024-09-21T03:49:21.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.192+0000 7f027db71640 1 -- 172.21.15.162:0/2528574859 shutdown_connections 2024-09-21T03:49:21.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.192+0000 7f027db71640 1 --2- 172.21.15.162:0/2528574859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0278108cf0 0x7f027810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:21.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.192+0000 7f027db71640 1 --2- 172.21.15.162:0/2528574859 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02781083a0 0x7f02781087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:21.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.192+0000 7f027db71640 1 --2- 172.21.15.162:0/2528574859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0278102a60 0x7f0278102e70 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:21.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.192+0000 7f027db71640 1 -- 172.21.15.162:0/2528574859 >> 172.21.15.162:0/2528574859 conn(0x7f0278079730 msgr2=0x7f0278079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:21.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.192+0000 7f027db71640 1 -- 172.21.15.162:0/2528574859 shutdown_connections 2024-09-21T03:49:21.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.192+0000 7f027db71640 1 -- 172.21.15.162:0/2528574859 wait complete. 2024-09-21T03:49:21.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.192+0000 7f027db71640 1 Processor -- start 2024-09-21T03:49:21.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.193+0000 7f027db71640 1 -- start start 2024-09-21T03:49:21.223 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.193+0000 7f027db71640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0278102a60 0x7f027819a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:21.223 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.193+0000 7f027db71640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02781083a0 0x7f027819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:21.223 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.193+0000 7f027db71640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0278108cf0 0x7f027819fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:21.223 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.193+0000 7f027db71640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0278112960 con 0x7f02781083a0 2024-09-21T03:49:21.223 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.193+0000 7f027db71640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f02781127e0 con 0x7f0278102a60 2024-09-21T03:49:21.223 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.193+0000 7f027db71640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0278112ae0 con 0x7f0278108cf0 2024-09-21T03:49:21.223 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.193+0000 7f0277fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0278108cf0 0x7f027819fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:21.223 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.193+0000 7f0277fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0278108cf0 0x7f027819fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:39634/0 (socket says 172.21.15.162:39634) 2024-09-21T03:49:21.223 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.193+0000 7f0277fff640 1 -- 172.21.15.162:0/967401022 learned_addr learned my addr 172.21.15.162:0/967401022 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T03:49:21.223 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.193+0000 7f02777fe640 1 --2- 172.21.15.162:0/967401022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0278102a60 0x7f027819a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:21.223 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.193+0000 7f0276ffd640 1 --2- 172.21.15.162:0/967401022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02781083a0 0x7f027819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:21.223 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.194+0000 7f0277fff640 1 -- 172.21.15.162:0/967401022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0278102a60 msgr2=0x7f027819a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:21.223 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.194+0000 7f0277fff640 1 --2- 172.21.15.162:0/967401022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0278102a60 0x7f027819a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:21.224 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.194+0000 7f0277fff640 1 -- 172.21.15.162:0/967401022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02781083a0 msgr2=0x7f027819aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:21.224 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.194+0000 7f0277fff640 1 --2- 172.21.15.162:0/967401022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02781083a0 0x7f027819aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:21.224 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.194+0000 7f0277fff640 1 -- 172.21.15.162:0/967401022 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02781a03d0 con 0x7f0278108cf0 2024-09-21T03:49:21.224 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.194+0000 7f0276ffd640 1 --2- 172.21.15.162:0/967401022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02781083a0 0x7f027819aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:49:21.224 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.194+0000 7f0277fff640 1 --2- 172.21.15.162:0/967401022 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0278108cf0 0x7f027819fca0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f027000cad0 tx=0x7f027000cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:21.224 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.194+0000 7f0274ff9640 1 -- 172.21.15.162:0/967401022 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f027000ae20 con 0x7f0278108cf0 2024-09-21T03:49:21.224 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.194+0000 7f0274ff9640 1 -- 172.21.15.162:0/967401022 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0270005020 con 0x7f0278108cf0 2024-09-21T03:49:21.224 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.194+0000 7f027db71640 1 -- 172.21.15.162:0/967401022 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02781a06c0 con 0x7f0278108cf0 2024-09-21T03:49:21.224 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.194+0000 7f0274ff9640 1 -- 172.21.15.162:0/967401022 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f027000f6b0 con 0x7f0278108cf0 2024-09-21T03:49:21.224 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.194+0000 7f027db71640 1 -- 172.21.15.162:0/967401022 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02781a6e20 con 0x7f0278108cf0 2024-09-21T03:49:21.224 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.195+0000 7f027db71640 1 -- 172.21.15.162:0/967401022 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0278102e70 con 0x7f0278108cf0 2024-09-21T03:49:21.224 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.198+0000 7f0274ff9640 1 -- 172.21.15.162:0/967401022 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f02700051d0 con 0x7f0278108cf0 2024-09-21T03:49:21.224 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.198+0000 7f0274ff9640 1 --2- 172.21.15.162:0/967401022 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f02600b6560 0x7f02600b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:21.225 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.199+0000 7f0274ff9640 1 -- 172.21.15.162:0/967401022 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4036+0+0 (secure 0 0 0) 0x7f02700e66f0 con 0x7f0278108cf0 2024-09-21T03:49:21.225 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.199+0000 7f02777fe640 1 --2- 172.21.15.162:0/967401022 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f02600b6560 0x7f02600b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:21.225 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.199+0000 7f02777fe640 1 --2- 172.21.15.162:0/967401022 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f02600b6560 0x7f02600b8a70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0268031440 tx=0x7f0268009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:21.225 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.201+0000 7f0274ff9640 1 -- 172.21.15.162:0/967401022 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0270014030 con 0x7f0278108cf0 2024-09-21T03:49:21.318 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 21 03:49:20 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-4[46008]: 2024-09-21T03:49:20.978+0000 7f071d4d6640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T03:49:21.318 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 21 03:49:20 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-4[46008]: 2024-09-21T03:49:20.984+0000 7f07152cc640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:49:21.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:21.397+0000 7f027db71640 1 -- 172.21.15.162:0/967401022 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f027806aeb0 con 0x7f02600b6560 2024-09-21T03:49:21.692 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:21 smithi162 ceph-mon[35071]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:49:21.692 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:21 smithi162 ceph-mon[35071]: Detected new or changed devices on smithi105 2024-09-21T03:49:21.692 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:21 smithi162 ceph-mon[35071]: Adjusting osd_memory_target on smithi105 to 8544M 2024-09-21T03:49:21.692 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:21 smithi162 ceph-mon[35071]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2024-09-21T03:49:21.692 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:21 smithi162 ceph-mon[35071]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T03:49:21.692 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:21 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:49:21.692 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:21 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:49:21.692 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:21 smithi162 ceph-mon[35071]: from='osd.4 ' entity='osd.4' 2024-09-21T03:49:21.692 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:21 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:49:21.692 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:21 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:49:21.692 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:21 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:49:21.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:21 smithi105 ceph-mon[34773]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:49:21.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:21 smithi105 ceph-mon[34773]: Detected new or changed devices on smithi105 2024-09-21T03:49:21.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:21 smithi105 ceph-mon[34773]: Adjusting osd_memory_target on smithi105 to 8544M 2024-09-21T03:49:21.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:21 smithi105 ceph-mon[34773]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2024-09-21T03:49:21.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:21 smithi105 ceph-mon[34773]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T03:49:21.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:21 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:49:21.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:21 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:49:21.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:21 smithi105 ceph-mon[34773]: from='osd.4 ' entity='osd.4' 2024-09-21T03:49:21.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:21 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:49:21.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:21 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:49:21.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:21 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:49:22.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:21 smithi046 ceph-mon[30954]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:49:22.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:21 smithi046 ceph-mon[30954]: Detected new or changed devices on smithi105 2024-09-21T03:49:22.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:21 smithi046 ceph-mon[30954]: Adjusting osd_memory_target on smithi105 to 8544M 2024-09-21T03:49:22.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:21 smithi046 ceph-mon[30954]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2024-09-21T03:49:22.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:21 smithi046 ceph-mon[30954]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T03:49:22.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:21 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:49:22.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:21 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:49:22.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:21 smithi046 ceph-mon[30954]: from='osd.4 ' entity='osd.4' 2024-09-21T03:49:22.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:21 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:49:22.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:21 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:49:22.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:21 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:49:22.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:22 smithi162 ceph-mon[35071]: purged_snaps scrub starts 2024-09-21T03:49:22.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:22 smithi162 ceph-mon[35071]: purged_snaps scrub ok 2024-09-21T03:49:22.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:22 smithi162 ceph-mon[35071]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:22.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:22 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:49:22.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:22 smithi162 ceph-mon[35071]: osd.4 [v2:172.21.15.105:6808/3566174660,v1:172.21.15.105:6809/3566174660] boot 2024-09-21T03:49:22.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:22 smithi162 ceph-mon[35071]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T03:49:22.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:22 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:49:23.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:22 smithi046 ceph-mon[30954]: purged_snaps scrub starts 2024-09-21T03:49:23.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:22 smithi046 ceph-mon[30954]: purged_snaps scrub ok 2024-09-21T03:49:23.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:22 smithi046 ceph-mon[30954]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:23.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:22 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:49:23.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:22 smithi046 ceph-mon[30954]: osd.4 [v2:172.21.15.105:6808/3566174660,v1:172.21.15.105:6809/3566174660] boot 2024-09-21T03:49:23.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:22 smithi046 ceph-mon[30954]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T03:49:23.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:22 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:49:23.070 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:22 smithi105 ceph-mon[34773]: purged_snaps scrub starts 2024-09-21T03:49:23.070 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:22 smithi105 ceph-mon[34773]: purged_snaps scrub ok 2024-09-21T03:49:23.070 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:22 smithi105 ceph-mon[34773]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:23.070 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:22 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:49:23.070 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:22 smithi105 ceph-mon[34773]: osd.4 [v2:172.21.15.105:6808/3566174660,v1:172.21.15.105:6809/3566174660] boot 2024-09-21T03:49:23.070 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:22 smithi105 ceph-mon[34773]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T03:49:23.070 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:22 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:49:23.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:23 smithi162 ceph-mon[35071]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:49:24.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:23 smithi046 ceph-mon[30954]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:49:24.062 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:23 smithi105 ceph-mon[34773]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:49:24.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:24 smithi162 ceph-mon[35071]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T03:49:24.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:24 smithi162 ceph-mon[35071]: from='client.? 172.21.15.162:0/1757538773' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b433d03b-fae8-4ece-b967-a8af91bc3ab6"} : dispatch 2024-09-21T03:49:24.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:24 smithi162 ceph-mon[35071]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b433d03b-fae8-4ece-b967-a8af91bc3ab6"} : dispatch 2024-09-21T03:49:24.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:24 smithi162 ceph-mon[35071]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b433d03b-fae8-4ece-b967-a8af91bc3ab6"}]': finished 2024-09-21T03:49:24.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:24 smithi162 ceph-mon[35071]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T03:49:24.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:24 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:49:24.877 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:24 smithi162 ceph-mon[35071]: from='client.? 172.21.15.162:0/1493541342' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:49:25.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:24 smithi046 ceph-mon[30954]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T03:49:25.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:24 smithi046 ceph-mon[30954]: from='client.? 172.21.15.162:0/1757538773' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b433d03b-fae8-4ece-b967-a8af91bc3ab6"} : dispatch 2024-09-21T03:49:25.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:24 smithi046 ceph-mon[30954]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b433d03b-fae8-4ece-b967-a8af91bc3ab6"} : dispatch 2024-09-21T03:49:25.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:24 smithi046 ceph-mon[30954]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b433d03b-fae8-4ece-b967-a8af91bc3ab6"}]': finished 2024-09-21T03:49:25.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:24 smithi046 ceph-mon[30954]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T03:49:25.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:24 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:49:25.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:24 smithi046 ceph-mon[30954]: from='client.? 172.21.15.162:0/1493541342' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:49:25.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:24 smithi105 ceph-mon[34773]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T03:49:25.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:24 smithi105 ceph-mon[34773]: from='client.? 172.21.15.162:0/1757538773' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b433d03b-fae8-4ece-b967-a8af91bc3ab6"} : dispatch 2024-09-21T03:49:25.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:24 smithi105 ceph-mon[34773]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b433d03b-fae8-4ece-b967-a8af91bc3ab6"} : dispatch 2024-09-21T03:49:25.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:24 smithi105 ceph-mon[34773]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b433d03b-fae8-4ece-b967-a8af91bc3ab6"}]': finished 2024-09-21T03:49:25.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:24 smithi105 ceph-mon[34773]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T03:49:25.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:24 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:49:25.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:24 smithi105 ceph-mon[34773]: from='client.? 172.21.15.162:0/1493541342' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:49:25.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:25 smithi162 ceph-mon[35071]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:26.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:25 smithi046 ceph-mon[30954]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:26.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:25 smithi105 ceph-mon[34773]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:27.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:27 smithi162 ceph-mon[35071]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:28.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:27 smithi046 ceph-mon[30954]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:28.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:27 smithi105 ceph-mon[34773]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:29.619 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:29 smithi162 ceph-mon[35071]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:30.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:29 smithi046 ceph-mon[30954]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:30.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:29 smithi105 ceph-mon[34773]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:31.878 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:31 smithi162 ceph-mon[35071]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:32.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:31 smithi046 ceph-mon[30954]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:32.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:31 smithi105 ceph-mon[34773]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:32.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:32 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T03:49:32.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:32 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:49:33.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:32 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T03:49:33.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:32 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:49:33.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:32 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T03:49:33.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:32 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:49:33.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:33 smithi162 ceph-mon[35071]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:33.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:33 smithi162 ceph-mon[35071]: Deploying daemon osd.5 on smithi162 2024-09-21T03:49:34.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:33 smithi046 ceph-mon[30954]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:34.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:33 smithi046 ceph-mon[30954]: Deploying daemon osd.5 on smithi162 2024-09-21T03:49:34.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:33 smithi105 ceph-mon[34773]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:34.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:33 smithi105 ceph-mon[34773]: Deploying daemon osd.5 on smithi162 2024-09-21T03:49:35.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:35 smithi162 ceph-mon[35071]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:36.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:35 smithi046 ceph-mon[30954]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:36.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:35 smithi105 ceph-mon[34773]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:37.836 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:37 smithi162 ceph-mon[35071]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:38.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:37 smithi046 ceph-mon[30954]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:38.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:37 smithi105 ceph-mon[34773]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:39.846 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:39 smithi162 ceph-mon[35071]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:39.846 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:39 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:49:39.846 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:39 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:39.846 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:39 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:40.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:39 smithi046 ceph-mon[30954]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:40.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:39 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:49:40.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:39 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:40.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:39 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:40.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:39 smithi105 ceph-mon[34773]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:40.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:39 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:49:40.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:39 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:40.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:39 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:41.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:41 smithi162 ceph-mon[35071]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:41.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:41 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:41.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:41 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:41.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:41 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:49:41.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:41 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:49:41.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:41 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:42.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:41 smithi046 ceph-mon[30954]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:42.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:41 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:42.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:41 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:42.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:41 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:49:42.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:41 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:49:42.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:41 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:42.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:41 smithi105 ceph-mon[34773]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:42.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:41 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:42.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:41 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:42.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:41 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:49:42.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:41 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:49:42.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:41 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:42.557 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:42.555+0000 7f0274ff9640 1 -- 172.21.15.162:0/967401022 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f027806aeb0 con 0x7f02600b6560 2024-09-21T03:49:42.557 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 5 on host 'smithi162' 2024-09-21T03:49:42.559 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:42.557+0000 7f027db71640 1 -- 172.21.15.162:0/967401022 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f02600b6560 msgr2=0x7f02600b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:42.560 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:42.557+0000 7f027db71640 1 --2- 172.21.15.162:0/967401022 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f02600b6560 0x7f02600b8a70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0268031440 tx=0x7f0268009560 comp rx=0 tx=0).stop 2024-09-21T03:49:42.560 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:42.557+0000 7f027db71640 1 -- 172.21.15.162:0/967401022 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0278108cf0 msgr2=0x7f027819fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:42.560 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:42.557+0000 7f027db71640 1 --2- 172.21.15.162:0/967401022 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0278108cf0 0x7f027819fca0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f027000cad0 tx=0x7f027000cf90 comp rx=0 tx=0).stop 2024-09-21T03:49:42.560 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:42.557+0000 7f027db71640 1 -- 172.21.15.162:0/967401022 shutdown_connections 2024-09-21T03:49:42.560 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:42.557+0000 7f027db71640 1 --2- 172.21.15.162:0/967401022 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f02600b6560 0x7f02600b8a70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:42.560 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:42.557+0000 7f027db71640 1 --2- 172.21.15.162:0/967401022 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0278108cf0 0x7f027819fca0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:42.560 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:42.557+0000 7f027db71640 1 --2- 172.21.15.162:0/967401022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02781083a0 0x7f027819aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:42.560 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:42.557+0000 7f027db71640 1 --2- 172.21.15.162:0/967401022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0278102a60 0x7f027819a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:42.560 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:42.557+0000 7f027db71640 1 -- 172.21.15.162:0/967401022 >> 172.21.15.162:0/967401022 conn(0x7f0278079730 msgr2=0x7f0278101ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:42.560 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:42.557+0000 7f027db71640 1 -- 172.21.15.162:0/967401022 shutdown_connections 2024-09-21T03:49:42.560 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:49:42.557+0000 7f027db71640 1 -- 172.21.15.162:0/967401022 wait complete. 2024-09-21T03:49:42.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:42 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:49:42.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:42 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:42.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:42 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:43.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:42 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:49:43.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:42 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:43.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:42 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:43.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:42 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:49:43.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:42 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:43.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:42 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:43.196 DEBUG:teuthology.orchestra.run.smithi162:osd.5> sudo journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.5.service 2024-09-21T03:49:43.198 INFO:tasks.cephadm:Deploying osd.6 on smithi046 with /dev/vg_nvme/lv_2... 2024-09-21T03:49:43.198 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T03:49:43.469 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:49:43.847 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:43 smithi046 ceph-mon[30954]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:43.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:43 smithi162 ceph-mon[35071]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:43.969 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:43 smithi105 ceph-mon[34773]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:44.612 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 03:49:44 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5[46374]: 2024-09-21T03:49:44.308+0000 7ff1d6a15640 -1 osd.5 0 log_to_monitors true 2024-09-21T03:49:44.867 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:44 smithi162 ceph-mon[35071]: from='osd.5 [v2:172.21.15.162:6808/3043419818,v1:172.21.15.162:6809/3043419818]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T03:49:44.867 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:44 smithi162 ceph-mon[35071]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T03:49:44.949 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:44 smithi046 ceph-mon[30954]: from='osd.5 [v2:172.21.15.162:6808/3043419818,v1:172.21.15.162:6809/3043419818]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T03:49:44.949 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:44 smithi046 ceph-mon[30954]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T03:49:45.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:44 smithi105 ceph-mon[34773]: from='osd.5 [v2:172.21.15.162:6808/3043419818,v1:172.21.15.162:6809/3043419818]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T03:49:45.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:44 smithi105 ceph-mon[34773]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T03:49:45.867 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 03:49:45 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5[46374]: 2024-09-21T03:49:45.628+0000 7ff1d2997640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T03:49:45.867 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 03:49:45 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5[46374]: 2024-09-21T03:49:45.634+0000 7ff1ce795640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:49:45.867 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:45 smithi162 ceph-mon[35071]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:45.867 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:45 smithi162 ceph-mon[35071]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T03:49:45.867 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:45 smithi162 ceph-mon[35071]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T03:49:45.867 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:45 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:49:45.867 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:45 smithi162 ceph-mon[35071]: from='osd.5 [v2:172.21.15.162:6808/3043419818,v1:172.21.15.162:6809/3043419818]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T03:49:45.867 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:45 smithi162 ceph-mon[35071]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T03:49:46.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:45 smithi046 ceph-mon[30954]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:46.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:45 smithi046 ceph-mon[30954]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T03:49:46.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:45 smithi046 ceph-mon[30954]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T03:49:46.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:45 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:49:46.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:45 smithi046 ceph-mon[30954]: from='osd.5 [v2:172.21.15.162:6808/3043419818,v1:172.21.15.162:6809/3043419818]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T03:49:46.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:45 smithi046 ceph-mon[30954]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T03:49:46.067 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:45 smithi105 ceph-mon[34773]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:46.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:45 smithi105 ceph-mon[34773]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T03:49:46.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:45 smithi105 ceph-mon[34773]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T03:49:46.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:45 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:49:46.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:45 smithi105 ceph-mon[34773]: from='osd.5 [v2:172.21.15.162:6808/3043419818,v1:172.21.15.162:6809/3043419818]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T03:49:46.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:45 smithi105 ceph-mon[34773]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T03:49:46.131 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:49:46.162 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi046:vg_nvme/lv_2 2024-09-21T03:49:46.428 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:49:46.831 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:46 smithi046 ceph-mon[30954]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T03:49:46.832 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:46 smithi046 ceph-mon[30954]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T03:49:46.832 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:46 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:49:46.832 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:46 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:49:46.832 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:46 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:46.832 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:46 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:46.832 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:46 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:46.832 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:46 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:46.832 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:46 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:46.832 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:46 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:49:46.832 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:46 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:49:46.832 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:46 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:46.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.924+0000 7f2448cb8640 1 -- 172.21.15.46:0/3268282833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2444107630 msgr2=0x7f2444107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:46.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.924+0000 7f2448cb8640 1 --2- 172.21.15.46:0/3268282833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2444107630 0x7f2444107a40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2434009ca0 tx=0x7f243402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:49:46.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.924+0000 7f2448cb8640 1 -- 172.21.15.46:0/3268282833 shutdown_connections 2024-09-21T03:49:46.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.924+0000 7f2448cb8640 1 --2- 172.21.15.46:0/3268282833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24441038f0 0x7f244410f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:46.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.924+0000 7f2448cb8640 1 --2- 172.21.15.46:0/3268282833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2444102fa0 0x7f24441033b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:46.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.924+0000 7f2448cb8640 1 --2- 172.21.15.46:0/3268282833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2444107630 0x7f2444107a40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:46.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.924+0000 7f2448cb8640 1 -- 172.21.15.46:0/3268282833 >> 172.21.15.46:0/3268282833 conn(0x7f2444079e40 msgr2=0x7f244407a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:46.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.924+0000 7f2448cb8640 1 -- 172.21.15.46:0/3268282833 shutdown_connections 2024-09-21T03:49:46.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.924+0000 7f2448cb8640 1 -- 172.21.15.46:0/3268282833 wait complete. 2024-09-21T03:49:46.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.925+0000 7f2448cb8640 1 Processor -- start 2024-09-21T03:49:46.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.925+0000 7f2448cb8640 1 -- start start 2024-09-21T03:49:46.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.925+0000 7f2448cb8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2444102fa0 0x7f24441990a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:46.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.925+0000 7f2448cb8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24441038f0 0x7f24441995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:46.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.925+0000 7f2448cb8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2444107630 0x7f2444199b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:46.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.925+0000 7f2448cb8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f24441129e0 con 0x7f24441038f0 2024-09-21T03:49:46.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.925+0000 7f2448cb8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2444112860 con 0x7f2444102fa0 2024-09-21T03:49:46.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.925+0000 7f2448cb8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2444112b60 con 0x7f2444107630 2024-09-21T03:49:46.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.925+0000 7f2441d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24441038f0 0x7f24441995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:46.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.925+0000 7f2441d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24441038f0 0x7f24441995e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40200/0 (socket says 172.21.15.46:40200) 2024-09-21T03:49:46.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.925+0000 7f2441d9b640 1 -- 172.21.15.46:0/1164473722 learned_addr learned my addr 172.21.15.46:0/1164473722 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:49:46.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.925+0000 7f2442d9d640 1 --2- 172.21.15.46:0/1164473722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2444107630 0x7f2444199b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:46.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.926+0000 7f244259c640 1 --2- 172.21.15.46:0/1164473722 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2444102fa0 0x7f24441990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:46.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.926+0000 7f2441d9b640 1 -- 172.21.15.46:0/1164473722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2444107630 msgr2=0x7f2444199b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:46.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.926+0000 7f2441d9b640 1 --2- 172.21.15.46:0/1164473722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2444107630 0x7f2444199b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:46.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.926+0000 7f2441d9b640 1 -- 172.21.15.46:0/1164473722 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2444102fa0 msgr2=0x7f24441990a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:46.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.926+0000 7f2441d9b640 1 --2- 172.21.15.46:0/1164473722 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2444102fa0 0x7f24441990a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:46.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.926+0000 7f2441d9b640 1 -- 172.21.15.46:0/1164473722 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24441a8750 con 0x7f24441038f0 2024-09-21T03:49:46.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.926+0000 7f244259c640 1 --2- 172.21.15.46:0/1164473722 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2444102fa0 0x7f24441990a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:49:46.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.926+0000 7f2441d9b640 1 --2- 172.21.15.46:0/1164473722 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24441038f0 0x7f24441995e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f243800d740 tx=0x7f243800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:46.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.926+0000 7f24337fe640 1 -- 172.21.15.46:0/1164473722 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2438017070 con 0x7f24441038f0 2024-09-21T03:49:46.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.926+0000 7f24337fe640 1 -- 172.21.15.46:0/1164473722 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f243800de50 con 0x7f24441038f0 2024-09-21T03:49:46.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.926+0000 7f2448cb8640 1 -- 172.21.15.46:0/1164473722 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24441a8a40 con 0x7f24441038f0 2024-09-21T03:49:46.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.926+0000 7f24337fe640 1 -- 172.21.15.46:0/1164473722 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2438003c20 con 0x7f24441038f0 2024-09-21T03:49:46.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.926+0000 7f2448cb8640 1 -- 172.21.15.46:0/1164473722 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24441a8f80 con 0x7f24441038f0 2024-09-21T03:49:46.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.927+0000 7f2448cb8640 1 -- 172.21.15.46:0/1164473722 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24441033b0 con 0x7f24441038f0 2024-09-21T03:49:46.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.929+0000 7f24337fe640 1 -- 172.21.15.46:0/1164473722 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f2438003dc0 con 0x7f24441038f0 2024-09-21T03:49:46.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.930+0000 7f24337fe640 1 --2- 172.21.15.46:0/1164473722 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f242c0b6560 0x7f242c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:46.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.930+0000 7f244259c640 1 --2- 172.21.15.46:0/1164473722 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f242c0b6560 0x7f242c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:46.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.930+0000 7f24337fe640 1 -- 172.21.15.46:0/1164473722 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4781+0+0 (secure 0 0 0) 0x7f24380e6400 con 0x7f24441038f0 2024-09-21T03:49:46.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.931+0000 7f244259c640 1 --2- 172.21.15.46:0/1164473722 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f242c0b6560 0x7f242c0b8a70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f24340094e0 tx=0x7f24340093f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:46.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:46.934+0000 7f24337fe640 1 -- 172.21.15.46:0/1164473722 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f24380ada40 con 0x7f24441038f0 2024-09-21T03:49:47.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:46 smithi105 ceph-mon[34773]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T03:49:47.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:46 smithi105 ceph-mon[34773]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T03:49:47.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:46 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:49:47.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:46 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:49:47.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:46 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:47.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:46 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:47.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:46 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:47.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:46 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:47.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:46 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:47.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:46 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:49:47.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:46 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:49:47.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:46 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:47.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:46 smithi162 ceph-mon[35071]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T03:49:47.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:46 smithi162 ceph-mon[35071]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T03:49:47.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:46 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:49:47.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:46 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:49:47.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:46 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:47.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:46 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:47.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:46 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:47.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:46 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:47.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:46 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:47.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:46 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:49:47.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:46 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:49:47.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:46 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:49:47.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:49:47.131+0000 7f2448cb8640 1 -- 172.21.15.46:0/1164473722 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f2444063800 con 0x7f242c0b6560 2024-09-21T03:49:47.843 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:47 smithi046 ceph-mon[30954]: purged_snaps scrub starts 2024-09-21T03:49:47.843 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:47 smithi046 ceph-mon[30954]: purged_snaps scrub ok 2024-09-21T03:49:47.843 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:47 smithi046 ceph-mon[30954]: pgmap v120: 1 pgs: 1 peering; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:47.843 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:47 smithi046 ceph-mon[30954]: Detected new or changed devices on smithi162 2024-09-21T03:49:47.843 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:47 smithi046 ceph-mon[30954]: Adjusting osd_memory_target on smithi162 to 8544M 2024-09-21T03:49:47.843 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:47 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:49:47.843 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:47 smithi046 ceph-mon[30954]: osd.5 [v2:172.21.15.162:6808/3043419818,v1:172.21.15.162:6809/3043419818] boot 2024-09-21T03:49:47.843 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:47 smithi046 ceph-mon[30954]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T03:49:47.843 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:47 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:49:47.843 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:47 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:49:47.844 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:47 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:49:47.844 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:47 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:49:47.844 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:47 smithi046 ceph-mon[30954]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T03:49:48.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:47 smithi105 ceph-mon[34773]: purged_snaps scrub starts 2024-09-21T03:49:48.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:47 smithi105 ceph-mon[34773]: purged_snaps scrub ok 2024-09-21T03:49:48.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:47 smithi105 ceph-mon[34773]: pgmap v120: 1 pgs: 1 peering; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:48.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:47 smithi105 ceph-mon[34773]: Detected new or changed devices on smithi162 2024-09-21T03:49:48.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:47 smithi105 ceph-mon[34773]: Adjusting osd_memory_target on smithi162 to 8544M 2024-09-21T03:49:48.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:47 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:49:48.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:47 smithi105 ceph-mon[34773]: osd.5 [v2:172.21.15.162:6808/3043419818,v1:172.21.15.162:6809/3043419818] boot 2024-09-21T03:49:48.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:47 smithi105 ceph-mon[34773]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T03:49:48.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:47 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:49:48.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:47 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:49:48.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:47 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:49:48.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:47 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:49:48.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:47 smithi105 ceph-mon[34773]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T03:49:48.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:47 smithi162 ceph-mon[35071]: purged_snaps scrub starts 2024-09-21T03:49:48.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:47 smithi162 ceph-mon[35071]: purged_snaps scrub ok 2024-09-21T03:49:48.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:47 smithi162 ceph-mon[35071]: pgmap v120: 1 pgs: 1 peering; 577 KiB data, 158 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:49:48.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:47 smithi162 ceph-mon[35071]: Detected new or changed devices on smithi162 2024-09-21T03:49:48.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:47 smithi162 ceph-mon[35071]: Adjusting osd_memory_target on smithi162 to 8544M 2024-09-21T03:49:48.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:47 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:49:48.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:47 smithi162 ceph-mon[35071]: osd.5 [v2:172.21.15.162:6808/3043419818,v1:172.21.15.162:6809/3043419818] boot 2024-09-21T03:49:48.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:47 smithi162 ceph-mon[35071]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T03:49:48.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:47 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:49:48.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:47 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:49:48.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:47 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:49:48.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:47 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:49:48.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:47 smithi162 ceph-mon[35071]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T03:49:48.881 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:48 smithi046 ceph-mon[30954]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:48.881 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:48 smithi046 ceph-mon[30954]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T03:49:49.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:48 smithi105 ceph-mon[34773]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:49.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:48 smithi105 ceph-mon[34773]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T03:49:49.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:48 smithi162 ceph-mon[35071]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:49:49.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:48 smithi162 ceph-mon[35071]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T03:49:49.945 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:49 smithi046 ceph-mon[30954]: pgmap v123: 1 pgs: 1 peering; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:49:49.945 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:49 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/4179887907' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e6b5ce54-69aa-4811-9ca3-cab50525a175"} : dispatch 2024-09-21T03:49:49.946 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:49 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/4179887907' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6b5ce54-69aa-4811-9ca3-cab50525a175"}]': finished 2024-09-21T03:49:49.946 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:49 smithi046 ceph-mon[30954]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T03:49:49.946 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:49 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:49:50.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:49 smithi105 ceph-mon[34773]: pgmap v123: 1 pgs: 1 peering; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:49:50.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:49 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/4179887907' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e6b5ce54-69aa-4811-9ca3-cab50525a175"} : dispatch 2024-09-21T03:49:50.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:49 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/4179887907' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6b5ce54-69aa-4811-9ca3-cab50525a175"}]': finished 2024-09-21T03:49:50.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:49 smithi105 ceph-mon[34773]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T03:49:50.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:49 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:49:50.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:49 smithi162 ceph-mon[35071]: pgmap v123: 1 pgs: 1 peering; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:49:50.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:49 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/4179887907' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e6b5ce54-69aa-4811-9ca3-cab50525a175"} : dispatch 2024-09-21T03:49:50.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:49 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/4179887907' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6b5ce54-69aa-4811-9ca3-cab50525a175"}]': finished 2024-09-21T03:49:50.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:49 smithi162 ceph-mon[35071]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T03:49:50.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:49 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:49:51.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:50 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/2845451864' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:49:51.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:50 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/2845451864' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:49:51.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:50 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/2845451864' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:49:52.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:51 smithi046 ceph-mon[30954]: pgmap v126: 1 pgs: 1 peering; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:49:52.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:51 smithi105 ceph-mon[34773]: pgmap v126: 1 pgs: 1 peering; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:49:52.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:51 smithi162 ceph-mon[35071]: pgmap v126: 1 pgs: 1 peering; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:49:54.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:53 smithi046 ceph-mon[30954]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-21T03:49:54.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:53 smithi105 ceph-mon[34773]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-21T03:49:54.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:53 smithi162 ceph-mon[35071]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-21T03:49:55.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:55 smithi046 ceph-mon[30954]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-21T03:49:55.945 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:55 smithi162 ceph-mon[35071]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-21T03:49:56.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:55 smithi105 ceph-mon[34773]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-21T03:49:58.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:57 smithi046 ceph-mon[30954]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T03:49:58.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:57 smithi105 ceph-mon[34773]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T03:49:58.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:57 smithi162 ceph-mon[35071]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T03:49:58.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:58 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T03:49:58.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:58 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:49:59.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:58 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T03:49:59.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:58 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:49:59.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:58 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T03:49:59.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:58 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:50:00.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:59 smithi046 ceph-mon[30954]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T03:50:00.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:49:59 smithi046 ceph-mon[30954]: Deploying daemon osd.6 on smithi046 2024-09-21T03:50:00.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:59 smithi105 ceph-mon[34773]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T03:50:00.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:49:59 smithi105 ceph-mon[34773]: Deploying daemon osd.6 on smithi046 2024-09-21T03:50:00.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:59 smithi162 ceph-mon[35071]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T03:50:00.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:49:59 smithi162 ceph-mon[35071]: Deploying daemon osd.6 on smithi046 2024-09-21T03:50:01.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:00 smithi046 ceph-mon[30954]: overall HEALTH_OK 2024-09-21T03:50:01.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:00 smithi105 ceph-mon[34773]: overall HEALTH_OK 2024-09-21T03:50:01.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:00 smithi162 ceph-mon[35071]: overall HEALTH_OK 2024-09-21T03:50:01.943 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:01 smithi046 ceph-mon[30954]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T03:50:02.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:01 smithi105 ceph-mon[34773]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T03:50:02.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:01 smithi162 ceph-mon[35071]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T03:50:03.906 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:03 smithi046 ceph-mon[30954]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:50:04.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:03 smithi105 ceph-mon[34773]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:50:04.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:03 smithi162 ceph-mon[35071]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:50:06.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:05 smithi046 ceph-mon[30954]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:50:06.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:05 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:50:06.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:05 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:06.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:05 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:06.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:05 smithi105 ceph-mon[34773]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:50:06.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:05 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:50:06.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:05 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:06.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:05 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:06.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:05 smithi162 ceph-mon[35071]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:50:06.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:05 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:50:06.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:05 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:06.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:05 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:07.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:07 smithi046 ceph-mon[30954]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:50:08.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:07 smithi105 ceph-mon[34773]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:50:08.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:07 smithi162 ceph-mon[35071]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:50:09.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:09 smithi046 ceph-mon[30954]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:50:09.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:09 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:09.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:09 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:09.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:09 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:50:09.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:09 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:50:09.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:09 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:09.317 INFO:teuthology.orchestra.run.smithi046.stdout:Created osd(s) 6 on host 'smithi046' 2024-09-21T03:50:09.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:50:09.314+0000 7f24337fe640 1 -- 172.21.15.46:0/1164473722 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2444063800 con 0x7f242c0b6560 2024-09-21T03:50:09.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:50:09.316+0000 7f2448cb8640 1 -- 172.21.15.46:0/1164473722 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f242c0b6560 msgr2=0x7f242c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:09.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:50:09.316+0000 7f2448cb8640 1 --2- 172.21.15.46:0/1164473722 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f242c0b6560 0x7f242c0b8a70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f24340094e0 tx=0x7f24340093f0 comp rx=0 tx=0).stop 2024-09-21T03:50:09.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:50:09.317+0000 7f2448cb8640 1 -- 172.21.15.46:0/1164473722 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24441038f0 msgr2=0x7f24441995e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:09.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:50:09.317+0000 7f2448cb8640 1 --2- 172.21.15.46:0/1164473722 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24441038f0 0x7f24441995e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f243800d740 tx=0x7f243800dc00 comp rx=0 tx=0).stop 2024-09-21T03:50:09.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:50:09.317+0000 7f2448cb8640 1 -- 172.21.15.46:0/1164473722 shutdown_connections 2024-09-21T03:50:09.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:50:09.317+0000 7f2448cb8640 1 --2- 172.21.15.46:0/1164473722 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f242c0b6560 0x7f242c0b8a70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:09.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:50:09.317+0000 7f2448cb8640 1 --2- 172.21.15.46:0/1164473722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2444107630 0x7f2444199b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:09.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:50:09.317+0000 7f2448cb8640 1 --2- 172.21.15.46:0/1164473722 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24441038f0 0x7f24441995e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:09.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:50:09.317+0000 7f2448cb8640 1 --2- 172.21.15.46:0/1164473722 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2444102fa0 0x7f24441990a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:09.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:50:09.317+0000 7f2448cb8640 1 -- 172.21.15.46:0/1164473722 >> 172.21.15.46:0/1164473722 conn(0x7f2444079e40 msgr2=0x7f24441063f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:09.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:50:09.317+0000 7f2448cb8640 1 -- 172.21.15.46:0/1164473722 shutdown_connections 2024-09-21T03:50:09.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:50:09.317+0000 7f2448cb8640 1 -- 172.21.15.46:0/1164473722 wait complete. 2024-09-21T03:50:09.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:09 smithi162 ceph-mon[35071]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:50:09.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:09 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:09.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:09 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:09.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:09 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:50:09.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:09 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:50:09.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:09 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:09.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:09 smithi105 ceph-mon[34773]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:50:09.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:09 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:09.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:09 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:09.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:09 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:50:09.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:09 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:50:09.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:09 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:10.088 DEBUG:teuthology.orchestra.run.smithi046:osd.6> sudo journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.6.service 2024-09-21T03:50:10.091 INFO:tasks.cephadm:Deploying osd.7 on smithi105 with /dev/vg_nvme/lv_2... 2024-09-21T03:50:10.091 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T03:50:10.351 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:50:10.371 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:10 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:50:10.371 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:10 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:10.371 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:10 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:10.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:10 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:50:10.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:10 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:10.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:10 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:10.471 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:10 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:50:10.471 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:10 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:10.472 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:10 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:11.251 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 03:50:11 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T03:50:11.132+0000 7f52f956e640 -1 osd.6 0 log_to_monitors true 2024-09-21T03:50:11.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:11 smithi105 ceph-mon[34773]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:50:11.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:11 smithi105 ceph-mon[34773]: from='osd.6 [v2:172.21.15.46:6818/1615361645,v1:172.21.15.46:6819/1615361645]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T03:50:11.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:11 smithi162 ceph-mon[35071]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:50:11.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:11 smithi162 ceph-mon[35071]: from='osd.6 [v2:172.21.15.46:6818/1615361645,v1:172.21.15.46:6819/1615361645]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T03:50:11.659 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:11 smithi046 ceph-mon[30954]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:50:11.659 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:11 smithi046 ceph-mon[30954]: from='osd.6 [v2:172.21.15.46:6818/1615361645,v1:172.21.15.46:6819/1615361645]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T03:50:12.519 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:12 smithi105 ceph-mon[34773]: from='osd.6 [v2:172.21.15.46:6818/1615361645,v1:172.21.15.46:6819/1615361645]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T03:50:12.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:12 smithi105 ceph-mon[34773]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T03:50:12.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:12 smithi105 ceph-mon[34773]: from='osd.6 [v2:172.21.15.46:6818/1615361645,v1:172.21.15.46:6819/1615361645]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi046", "root=default"]} : dispatch 2024-09-21T03:50:12.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:12 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:50:12.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:12 smithi105 ceph-mon[34773]: from='osd.6 [v2:172.21.15.46:6818/1615361645,v1:172.21.15.46:6819/1615361645]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-21T03:50:12.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:12 smithi105 ceph-mon[34773]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T03:50:12.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:12 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:50:12.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:12 smithi162 ceph-mon[35071]: from='osd.6 [v2:172.21.15.46:6818/1615361645,v1:172.21.15.46:6819/1615361645]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T03:50:12.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:12 smithi162 ceph-mon[35071]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T03:50:12.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:12 smithi162 ceph-mon[35071]: from='osd.6 [v2:172.21.15.46:6818/1615361645,v1:172.21.15.46:6819/1615361645]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi046", "root=default"]} : dispatch 2024-09-21T03:50:12.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:12 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:50:12.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:12 smithi162 ceph-mon[35071]: from='osd.6 [v2:172.21.15.46:6818/1615361645,v1:172.21.15.46:6819/1615361645]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-21T03:50:12.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:12 smithi162 ceph-mon[35071]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T03:50:12.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:12 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:50:12.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:12 smithi046 ceph-mon[30954]: from='osd.6 [v2:172.21.15.46:6818/1615361645,v1:172.21.15.46:6819/1615361645]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T03:50:12.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:12 smithi046 ceph-mon[30954]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T03:50:12.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:12 smithi046 ceph-mon[30954]: from='osd.6 [v2:172.21.15.46:6818/1615361645,v1:172.21.15.46:6819/1615361645]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi046", "root=default"]} : dispatch 2024-09-21T03:50:12.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:12 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:50:12.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:12 smithi046 ceph-mon[30954]: from='osd.6 [v2:172.21.15.46:6818/1615361645,v1:172.21.15.46:6819/1615361645]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-21T03:50:12.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:12 smithi046 ceph-mon[30954]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T03:50:12.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:12 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:50:12.960 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:50:12.986 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi105:vg_nvme/lv_2 2024-09-21T03:50:13.165 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 03:50:12 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T03:50:12.782+0000 7f52f54f0640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T03:50:13.166 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 03:50:12 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T03:50:12.791+0000 7f52ed2e6640 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:50:13.242 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:50:13.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:13 smithi046 ceph-mon[30954]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:50:13.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:13 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:50:13.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:13 smithi046 ceph-mon[30954]: from='osd.6 [v2:172.21.15.46:6818/1615361645,v1:172.21.15.46:6819/1615361645]' entity='osd.6' 2024-09-21T03:50:13.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:13 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:13.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:13 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:13.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:13 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:50:13.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:13 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:50:13.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:13 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T03:50:13.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:13 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:13.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:13 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:50:13.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:13 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:50:13.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:13 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:13.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:13 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:50:13.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:13 smithi162 ceph-mon[35071]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:50:13.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:13 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:50:13.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:13 smithi162 ceph-mon[35071]: from='osd.6 [v2:172.21.15.46:6818/1615361645,v1:172.21.15.46:6819/1615361645]' entity='osd.6' 2024-09-21T03:50:13.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:13 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:13.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:13 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:13.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:13 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:50:13.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:13 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:50:13.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:13 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T03:50:13.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:13 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:13.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:13 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:50:13.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:13 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:50:13.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:13 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:13.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:13 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:50:13.636 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:13 smithi105 ceph-mon[34773]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:50:13.636 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:13 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:50:13.636 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:13 smithi105 ceph-mon[34773]: from='osd.6 [v2:172.21.15.46:6818/1615361645,v1:172.21.15.46:6819/1615361645]' entity='osd.6' 2024-09-21T03:50:13.636 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:13 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:13.636 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:13 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:13.636 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:13 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:50:13.636 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:13 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:50:13.636 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:13 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T03:50:13.636 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:13 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:13.636 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:13 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:50:13.637 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:13 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:50:13.637 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:13 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:13.637 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:13 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:50:13.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.727+0000 7f1c51c7c640 1 -- 172.21.15.105:0/2389387095 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1c4c103b60 msgr2=0x7f1c4c103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:13.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.727+0000 7f1c51c7c640 1 --2- 172.21.15.105:0/2389387095 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1c4c103b60 0x7f1c4c103f70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c009ca0 tx=0x7f1c3c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:50:13.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.727+0000 7f1c51c7c640 1 -- 172.21.15.105:0/2389387095 shutdown_connections 2024-09-21T03:50:13.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.727+0000 7f1c51c7c640 1 --2- 172.21.15.105:0/2389387095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c4c109df0 0x7f1c4c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:13.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.727+0000 7f1c51c7c640 1 --2- 172.21.15.105:0/2389387095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c4c1094a0 0x7f1c4c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:13.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.727+0000 7f1c51c7c640 1 --2- 172.21.15.105:0/2389387095 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1c4c103b60 0x7f1c4c103f70 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:13.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.727+0000 7f1c51c7c640 1 -- 172.21.15.105:0/2389387095 >> 172.21.15.105:0/2389387095 conn(0x7f1c4c07b850 msgr2=0x7f1c4c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:13.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.727+0000 7f1c51c7c640 1 -- 172.21.15.105:0/2389387095 shutdown_connections 2024-09-21T03:50:13.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.727+0000 7f1c51c7c640 1 -- 172.21.15.105:0/2389387095 wait complete. 2024-09-21T03:50:13.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.727+0000 7f1c51c7c640 1 Processor -- start 2024-09-21T03:50:13.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.728+0000 7f1c51c7c640 1 -- start start 2024-09-21T03:50:13.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.728+0000 7f1c51c7c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c4c103b60 0x7f1c4c19a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:13.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.728+0000 7f1c51c7c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c4c1094a0 0x7f1c4c19a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:13.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.728+0000 7f1c51c7c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1c4c109df0 0x7f1c4c19fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:13.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.728+0000 7f1c51c7c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4c113ab0 con 0x7f1c4c1094a0 2024-09-21T03:50:13.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.728+0000 7f1c51c7c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4c113930 con 0x7f1c4c109df0 2024-09-21T03:50:13.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.728+0000 7f1c51c7c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4c113c30 con 0x7f1c4c103b60 2024-09-21T03:50:13.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.728+0000 7f1c4bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1c4c109df0 0x7f1c4c19fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:13.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.728+0000 7f1c4bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1c4c109df0 0x7f1c4c19fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:49964/0 (socket says 172.21.15.105:49964) 2024-09-21T03:50:13.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.728+0000 7f1c4bfff640 1 -- 172.21.15.105:0/1072267589 learned_addr learned my addr 172.21.15.105:0/1072267589 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:50:13.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.728+0000 7f1c4b7fe640 1 --2- 172.21.15.105:0/1072267589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c4c103b60 0x7f1c4c19a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:13.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.728+0000 7f1c4affd640 1 --2- 172.21.15.105:0/1072267589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c4c1094a0 0x7f1c4c19a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:13.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.728+0000 7f1c4bfff640 1 -- 172.21.15.105:0/1072267589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c4c103b60 msgr2=0x7f1c4c19a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:13.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.728+0000 7f1c4bfff640 1 --2- 172.21.15.105:0/1072267589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c4c103b60 0x7f1c4c19a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:13.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.728+0000 7f1c4bfff640 1 -- 172.21.15.105:0/1072267589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c4c1094a0 msgr2=0x7f1c4c19a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:13.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.728+0000 7f1c4bfff640 1 --2- 172.21.15.105:0/1072267589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c4c1094a0 0x7f1c4c19a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:13.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.728+0000 7f1c4bfff640 1 -- 172.21.15.105:0/1072267589 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c4c1a02f0 con 0x7f1c4c109df0 2024-09-21T03:50:13.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.729+0000 7f1c4bfff640 1 --2- 172.21.15.105:0/1072267589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1c4c109df0 0x7f1c4c19fc80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1c4400d750 tx=0x7f1c4400dc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:13.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.729+0000 7f1c48ff9640 1 -- 172.21.15.105:0/1072267589 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c44017070 con 0x7f1c4c109df0 2024-09-21T03:50:13.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.729+0000 7f1c48ff9640 1 -- 172.21.15.105:0/1072267589 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c440054d0 con 0x7f1c4c109df0 2024-09-21T03:50:13.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.729+0000 7f1c51c7c640 1 -- 172.21.15.105:0/1072267589 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c4c1a05e0 con 0x7f1c4c109df0 2024-09-21T03:50:13.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.729+0000 7f1c48ff9640 1 -- 172.21.15.105:0/1072267589 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c44004c60 con 0x7f1c4c109df0 2024-09-21T03:50:13.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.729+0000 7f1c51c7c640 1 -- 172.21.15.105:0/1072267589 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c4c1a6e00 con 0x7f1c4c109df0 2024-09-21T03:50:13.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.730+0000 7f1c51c7c640 1 -- 172.21.15.105:0/1072267589 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c4c103f70 con 0x7f1c4c109df0 2024-09-21T03:50:13.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.731+0000 7f1c48ff9640 1 -- 172.21.15.105:0/1072267589 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f1c44009bd0 con 0x7f1c4c109df0 2024-09-21T03:50:13.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.732+0000 7f1c48ff9640 1 --2- 172.21.15.105:0/1072267589 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f1c340b6590 0x7f1c340b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:13.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.732+0000 7f1c48ff9640 1 -- 172.21.15.105:0/1072267589 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4900+0+0 (secure 0 0 0) 0x7f1c440e5f90 con 0x7f1c4c109df0 2024-09-21T03:50:13.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.732+0000 7f1c4b7fe640 1 --2- 172.21.15.105:0/1072267589 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f1c340b6590 0x7f1c340b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:13.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.733+0000 7f1c4b7fe640 1 --2- 172.21.15.105:0/1072267589 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f1c340b6590 0x7f1c340b8aa0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c005e30 tx=0x7f1c3c009360 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:13.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.736+0000 7f1c48ff9640 1 -- 172.21.15.105:0/1072267589 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1c440ad570 con 0x7f1c4c109df0 2024-09-21T03:50:13.930 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:13.928+0000 7f1c51c7c640 1 -- 172.21.15.105:0/1072267589 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f1c4c063800 con 0x7f1c340b6590 2024-09-21T03:50:15.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:14 smithi105 ceph-mon[34773]: purged_snaps scrub starts 2024-09-21T03:50:15.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:14 smithi105 ceph-mon[34773]: purged_snaps scrub ok 2024-09-21T03:50:15.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:14 smithi105 ceph-mon[34773]: Detected new or changed devices on smithi046 2024-09-21T03:50:15.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:14 smithi105 ceph-mon[34773]: Adjusting osd_memory_target on smithi046 to 5697M 2024-09-21T03:50:15.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:14 smithi105 ceph-mon[34773]: osd.6 [v2:172.21.15.46:6818/1615361645,v1:172.21.15.46:6819/1615361645] boot 2024-09-21T03:50:15.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:14 smithi105 ceph-mon[34773]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T03:50:15.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:14 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:50:15.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:14 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:50:15.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:14 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:50:15.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:14 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:50:15.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:14 smithi162 ceph-mon[35071]: purged_snaps scrub starts 2024-09-21T03:50:15.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:14 smithi162 ceph-mon[35071]: purged_snaps scrub ok 2024-09-21T03:50:15.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:14 smithi162 ceph-mon[35071]: Detected new or changed devices on smithi046 2024-09-21T03:50:15.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:14 smithi162 ceph-mon[35071]: Adjusting osd_memory_target on smithi046 to 5697M 2024-09-21T03:50:15.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:14 smithi162 ceph-mon[35071]: osd.6 [v2:172.21.15.46:6818/1615361645,v1:172.21.15.46:6819/1615361645] boot 2024-09-21T03:50:15.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:14 smithi162 ceph-mon[35071]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T03:50:15.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:14 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:50:15.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:14 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:50:15.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:14 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:50:15.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:14 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:50:15.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:14 smithi046 ceph-mon[30954]: purged_snaps scrub starts 2024-09-21T03:50:15.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:14 smithi046 ceph-mon[30954]: purged_snaps scrub ok 2024-09-21T03:50:15.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:14 smithi046 ceph-mon[30954]: Detected new or changed devices on smithi046 2024-09-21T03:50:15.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:14 smithi046 ceph-mon[30954]: Adjusting osd_memory_target on smithi046 to 5697M 2024-09-21T03:50:15.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:14 smithi046 ceph-mon[30954]: osd.6 [v2:172.21.15.46:6818/1615361645,v1:172.21.15.46:6819/1615361645] boot 2024-09-21T03:50:15.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:14 smithi046 ceph-mon[30954]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T03:50:15.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:14 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:50:15.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:14 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:50:15.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:14 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:50:15.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:14 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:50:15.986 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:15 smithi105 ceph-mon[34773]: from='client.24452 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:15.986 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:15 smithi105 ceph-mon[34773]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:50:15.987 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:15 smithi105 ceph-mon[34773]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T03:50:16.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:15 smithi162 ceph-mon[35071]: from='client.24452 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:16.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:15 smithi162 ceph-mon[35071]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:50:16.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:15 smithi162 ceph-mon[35071]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T03:50:16.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:15 smithi046 ceph-mon[30954]: from='client.24452 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:16.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:15 smithi046 ceph-mon[30954]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:50:16.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:15 smithi046 ceph-mon[30954]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T03:50:16.954 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:16 smithi105 ceph-mon[34773]: from='client.? 172.21.15.105:0/3930708530' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a6e89d5d-ce31-4e0c-9019-5eb13b134feb"} : dispatch 2024-09-21T03:50:16.954 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:16 smithi105 ceph-mon[34773]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a6e89d5d-ce31-4e0c-9019-5eb13b134feb"} : dispatch 2024-09-21T03:50:16.954 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:16 smithi105 ceph-mon[34773]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a6e89d5d-ce31-4e0c-9019-5eb13b134feb"}]': finished 2024-09-21T03:50:16.954 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:16 smithi105 ceph-mon[34773]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T03:50:16.954 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:16 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:50:17.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:16 smithi162 ceph-mon[35071]: from='client.? 172.21.15.105:0/3930708530' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a6e89d5d-ce31-4e0c-9019-5eb13b134feb"} : dispatch 2024-09-21T03:50:17.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:16 smithi162 ceph-mon[35071]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a6e89d5d-ce31-4e0c-9019-5eb13b134feb"} : dispatch 2024-09-21T03:50:17.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:16 smithi162 ceph-mon[35071]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a6e89d5d-ce31-4e0c-9019-5eb13b134feb"}]': finished 2024-09-21T03:50:17.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:16 smithi162 ceph-mon[35071]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T03:50:17.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:16 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:50:17.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:16 smithi046 ceph-mon[30954]: from='client.? 172.21.15.105:0/3930708530' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a6e89d5d-ce31-4e0c-9019-5eb13b134feb"} : dispatch 2024-09-21T03:50:17.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:16 smithi046 ceph-mon[30954]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a6e89d5d-ce31-4e0c-9019-5eb13b134feb"} : dispatch 2024-09-21T03:50:17.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:16 smithi046 ceph-mon[30954]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a6e89d5d-ce31-4e0c-9019-5eb13b134feb"}]': finished 2024-09-21T03:50:17.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:16 smithi046 ceph-mon[30954]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T03:50:17.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:16 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:50:18.067 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:17 smithi105 ceph-mon[34773]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:18.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:17 smithi105 ceph-mon[34773]: from='client.? 172.21.15.105:0/722456743' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:50:18.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:17 smithi162 ceph-mon[35071]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:18.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:17 smithi162 ceph-mon[35071]: from='client.? 172.21.15.105:0/722456743' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:50:18.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:17 smithi046 ceph-mon[30954]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:18.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:17 smithi046 ceph-mon[30954]: from='client.? 172.21.15.105:0/722456743' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:50:20.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:19 smithi105 ceph-mon[34773]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:20.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:19 smithi162 ceph-mon[35071]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:20.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:19 smithi046 ceph-mon[30954]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:22.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:21 smithi105 ceph-mon[34773]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:22.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:21 smithi162 ceph-mon[35071]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:22.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:21 smithi046 ceph-mon[30954]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:24.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:23 smithi105 ceph-mon[34773]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:24.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:23 smithi162 ceph-mon[35071]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:24.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:23 smithi046 ceph-mon[30954]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:25.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:24 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T03:50:25.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:24 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:50:25.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:24 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T03:50:25.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:24 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:50:25.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:24 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T03:50:25.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:24 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:50:26.116 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:25 smithi105 ceph-mon[34773]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:26.116 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:25 smithi105 ceph-mon[34773]: Deploying daemon osd.7 on smithi105 2024-09-21T03:50:26.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:25 smithi162 ceph-mon[35071]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:26.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:25 smithi162 ceph-mon[35071]: Deploying daemon osd.7 on smithi105 2024-09-21T03:50:26.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:25 smithi046 ceph-mon[30954]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:26.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:25 smithi046 ceph-mon[30954]: Deploying daemon osd.7 on smithi105 2024-09-21T03:50:28.114 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:27 smithi105 ceph-mon[34773]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:28.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:27 smithi162 ceph-mon[35071]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:28.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:27 smithi046 ceph-mon[30954]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:30.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:29 smithi105 ceph-mon[34773]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:30.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:29 smithi162 ceph-mon[35071]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:30.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:29 smithi046 ceph-mon[30954]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:32.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:31 smithi105 ceph-mon[34773]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:32.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:31 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:50:32.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:31 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:32.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:31 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:32.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:31 smithi162 ceph-mon[35071]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:32.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:31 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:50:32.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:31 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:32.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:31 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:32.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:31 smithi046 ceph-mon[30954]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:32.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:31 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:50:32.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:31 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:32.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:31 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:34.067 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:33 smithi105 ceph-mon[34773]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:34.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:33 smithi162 ceph-mon[35071]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:34.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:33 smithi046 ceph-mon[30954]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:34.992 INFO:teuthology.orchestra.run.smithi105.stdout:Created osd(s) 7 on host 'smithi105' 2024-09-21T03:50:34.993 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:34.990+0000 7f1c48ff9640 1 -- 172.21.15.105:0/1072267589 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1c4c063800 con 0x7f1c340b6590 2024-09-21T03:50:34.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:34.992+0000 7f1c51c7c640 1 -- 172.21.15.105:0/1072267589 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f1c340b6590 msgr2=0x7f1c340b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:34.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:34.992+0000 7f1c51c7c640 1 --2- 172.21.15.105:0/1072267589 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f1c340b6590 0x7f1c340b8aa0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c005e30 tx=0x7f1c3c009360 comp rx=0 tx=0).stop 2024-09-21T03:50:34.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:34.993+0000 7f1c51c7c640 1 -- 172.21.15.105:0/1072267589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1c4c109df0 msgr2=0x7f1c4c19fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:34.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:34.993+0000 7f1c51c7c640 1 --2- 172.21.15.105:0/1072267589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1c4c109df0 0x7f1c4c19fc80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1c4400d750 tx=0x7f1c4400dc10 comp rx=0 tx=0).stop 2024-09-21T03:50:34.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:34.993+0000 7f1c51c7c640 1 -- 172.21.15.105:0/1072267589 shutdown_connections 2024-09-21T03:50:34.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:34.993+0000 7f1c51c7c640 1 --2- 172.21.15.105:0/1072267589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1c4c109df0 0x7f1c4c19fc80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:34.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:34.993+0000 7f1c51c7c640 1 --2- 172.21.15.105:0/1072267589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c4c1094a0 0x7f1c4c19a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:34.996 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:34.993+0000 7f1c51c7c640 1 --2- 172.21.15.105:0/1072267589 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f1c340b6590 0x7f1c340b8aa0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:34.996 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:34.993+0000 7f1c51c7c640 1 --2- 172.21.15.105:0/1072267589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c4c103b60 0x7f1c4c19a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:34.996 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:34.993+0000 7f1c51c7c640 1 -- 172.21.15.105:0/1072267589 >> 172.21.15.105:0/1072267589 conn(0x7f1c4c07b850 msgr2=0x7f1c4c1074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:34.996 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:34.993+0000 7f1c51c7c640 1 -- 172.21.15.105:0/1072267589 shutdown_connections 2024-09-21T03:50:34.996 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:50:34.993+0000 7f1c51c7c640 1 -- 172.21.15.105:0/1072267589 wait complete. 2024-09-21T03:50:35.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:34 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:35.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:34 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:35.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:34 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:50:35.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:34 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:50:35.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:34 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:35.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:34 smithi046 ceph-mon[30954]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:35.294 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:34 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:35.294 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:34 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:35.294 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:34 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:50:35.294 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:34 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:50:35.294 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:34 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:35.294 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:34 smithi105 ceph-mon[34773]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:35.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:34 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:35.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:34 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:35.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:34 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:50:35.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:34 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:50:35.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:34 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:35.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:34 smithi162 ceph-mon[35071]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:35.588 DEBUG:teuthology.orchestra.run.smithi105:osd.7> sudo journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.7.service 2024-09-21T03:50:35.590 INFO:tasks.cephadm:Deploying osd.8 on smithi162 with /dev/vg_nvme/lv_2... 2024-09-21T03:50:35.590 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T03:50:35.845 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:50:36.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:35 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:50:36.084 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:35 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:36.085 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:35 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:36.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:35 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:50:36.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:35 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:36.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:35 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:36.288 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:35 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:50:36.288 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:35 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:36.288 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:35 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:37.055 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:36 smithi105 ceph-mon[34773]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:37.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:36 smithi162 ceph-mon[35071]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:37.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:36 smithi046 ceph-mon[30954]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:37.318 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 03:50:37 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T03:50:37.050+0000 7f69fd7df640 -1 osd.7 0 log_to_monitors true 2024-09-21T03:50:38.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:37 smithi105 ceph-mon[34773]: from='osd.7 [v2:172.21.15.105:6816/1015687379,v1:172.21.15.105:6817/1015687379]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T03:50:38.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:37 smithi105 ceph-mon[34773]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T03:50:38.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:37 smithi046 ceph-mon[30954]: from='osd.7 [v2:172.21.15.105:6816/1015687379,v1:172.21.15.105:6817/1015687379]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T03:50:38.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:37 smithi046 ceph-mon[30954]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T03:50:38.283 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:37 smithi162 ceph-mon[35071]: from='osd.7 [v2:172.21.15.105:6816/1015687379,v1:172.21.15.105:6817/1015687379]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T03:50:38.283 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:37 smithi162 ceph-mon[35071]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T03:50:38.286 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:50:38.313 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi162:vg_nvme/lv_2 2024-09-21T03:50:38.566 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:50:39.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.032+0000 7f78e37fd640 1 -- 172.21.15.162:0/1524759256 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78dc102650 msgr2=0x7f78dc102a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:39.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.032+0000 7f78e37fd640 1 --2- 172.21.15.162:0/1524759256 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78dc102650 0x7f78dc102a60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f78d8009900 tx=0x7f78d802a480 comp rx=0 tx=0).stop 2024-09-21T03:50:39.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.032+0000 7f78e37fd640 1 -- 172.21.15.162:0/1524759256 shutdown_connections 2024-09-21T03:50:39.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.032+0000 7f78e37fd640 1 --2- 172.21.15.162:0/1524759256 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78dc110200 0x7f78dc112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.032+0000 7f78e37fd640 1 --2- 172.21.15.162:0/1524759256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78dc102fa0 0x7f78dc10fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.032+0000 7f78e37fd640 1 --2- 172.21.15.162:0/1524759256 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78dc102650 0x7f78dc102a60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.032+0000 7f78e37fd640 1 -- 172.21.15.162:0/1524759256 >> 172.21.15.162:0/1524759256 conn(0x7f78dc079790 msgr2=0x7f78dc079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:39.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.032+0000 7f78e37fd640 1 -- 172.21.15.162:0/1524759256 shutdown_connections 2024-09-21T03:50:39.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.032+0000 7f78e37fd640 1 -- 172.21.15.162:0/1524759256 wait complete. 2024-09-21T03:50:39.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.032+0000 7f78e37fd640 1 Processor -- start 2024-09-21T03:50:39.047 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.032+0000 7f78e37fd640 1 -- start start 2024-09-21T03:50:39.047 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.033+0000 7f78e37fd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78dc102650 0x7f78dc19c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:39.047 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.033+0000 7f78e37fd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78dc102fa0 0x7f78dc19cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:39.047 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.033+0000 7f78e37fd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78dc110200 0x7f78dc1a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:39.047 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.033+0000 7f78e37fd640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f78dc115ca0 con 0x7f78dc102650 2024-09-21T03:50:39.047 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.033+0000 7f78e37fd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f78dc115b20 con 0x7f78dc110200 2024-09-21T03:50:39.047 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.033+0000 7f78e37fd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f78dc115e20 con 0x7f78dc102fa0 2024-09-21T03:50:39.047 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.033+0000 7f78e0d98640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78dc102fa0 0x7f78dc19cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:39.047 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.033+0000 7f78e0d98640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78dc102fa0 0x7f78dc19cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:58632/0 (socket says 172.21.15.162:58632) 2024-09-21T03:50:39.047 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.033+0000 7f78e0d98640 1 -- 172.21.15.162:0/834358616 learned_addr learned my addr 172.21.15.162:0/834358616 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T03:50:39.047 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.033+0000 7f78e1d9a640 1 --2- 172.21.15.162:0/834358616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78dc110200 0x7f78dc1a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:39.047 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.033+0000 7f78e1599640 1 --2- 172.21.15.162:0/834358616 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78dc102650 0x7f78dc19c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:39.048 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.033+0000 7f78e0d98640 1 -- 172.21.15.162:0/834358616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78dc110200 msgr2=0x7f78dc1a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:39.048 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.033+0000 7f78e0d98640 1 --2- 172.21.15.162:0/834358616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78dc110200 0x7f78dc1a1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.048 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.033+0000 7f78e0d98640 1 -- 172.21.15.162:0/834358616 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78dc102650 msgr2=0x7f78dc19c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:39.048 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.033+0000 7f78e0d98640 1 --2- 172.21.15.162:0/834358616 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78dc102650 0x7f78dc19c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.048 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.033+0000 7f78e0d98640 1 -- 172.21.15.162:0/834358616 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78dc1a2580 con 0x7f78dc102fa0 2024-09-21T03:50:39.048 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.033+0000 7f78e0d98640 1 --2- 172.21.15.162:0/834358616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78dc102fa0 0x7f78dc19cbb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00c890 tx=0x7f78cc00cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:39.048 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.033+0000 7f78d27fc640 1 -- 172.21.15.162:0/834358616 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc004220 con 0x7f78dc102fa0 2024-09-21T03:50:39.048 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.034+0000 7f78e37fd640 1 -- 172.21.15.162:0/834358616 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78dc1a2870 con 0x7f78dc102fa0 2024-09-21T03:50:39.048 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.034+0000 7f78e37fd640 1 -- 172.21.15.162:0/834358616 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78dc1a8fd0 con 0x7f78dc102fa0 2024-09-21T03:50:39.048 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.034+0000 7f78d27fc640 1 -- 172.21.15.162:0/834358616 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78cc0043c0 con 0x7f78dc102fa0 2024-09-21T03:50:39.048 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.034+0000 7f78d27fc640 1 -- 172.21.15.162:0/834358616 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc01d060 con 0x7f78dc102fa0 2024-09-21T03:50:39.048 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.035+0000 7f78e37fd640 1 -- 172.21.15.162:0/834358616 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78dc102a60 con 0x7f78dc102fa0 2024-09-21T03:50:39.048 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.036+0000 7f78d27fc640 1 -- 172.21.15.162:0/834358616 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f78cc005020 con 0x7f78dc102fa0 2024-09-21T03:50:39.048 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.037+0000 7f78d27fc640 1 --2- 172.21.15.162:0/834358616 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f78c80b6560 0x7f78c80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:39.048 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.038+0000 7f78d27fc640 1 -- 172.21.15.162:0/834358616 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5332+0+0 (secure 0 0 0) 0x7f78cc0e68b0 con 0x7f78dc102fa0 2024-09-21T03:50:39.049 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.038+0000 7f78e1599640 1 --2- 172.21.15.162:0/834358616 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f78c80b6560 0x7f78c80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:39.049 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.038+0000 7f78e1599640 1 --2- 172.21.15.162:0/834358616 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f78c80b6560 0x7f78c80b8a70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f78d8031440 tx=0x7f78d8009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:39.049 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.041+0000 7f78d27fc640 1 -- 172.21.15.162:0/834358616 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f78cc014030 con 0x7f78dc102fa0 2024-09-21T03:50:39.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:50:39.233+0000 7f78e37fd640 1 -- 172.21.15.162:0/834358616 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f78dc10a4b0 con 0x7f78c80b6560 2024-09-21T03:50:39.235 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:38 smithi162 ceph-mon[35071]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T03:50:39.235 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:38 smithi162 ceph-mon[35071]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T03:50:39.235 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:38 smithi162 ceph-mon[35071]: from='osd.7 [v2:172.21.15.105:6816/1015687379,v1:172.21.15.105:6817/1015687379]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi105", "root=default"]} : dispatch 2024-09-21T03:50:39.235 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:38 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:50:39.235 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:38 smithi162 ceph-mon[35071]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi105", "root=default"]} : dispatch 2024-09-21T03:50:39.236 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:38 smithi162 ceph-mon[35071]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:39.236 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:38 smithi162 ceph-mon[35071]: Detected new or changed devices on smithi105 2024-09-21T03:50:39.236 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:38 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:39.236 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:38 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:39.236 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:38 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:50:39.236 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:38 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:50:39.236 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:38 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T03:50:39.236 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:38 smithi162 ceph-mon[35071]: Adjusting osd_memory_target on smithi105 to 5696M 2024-09-21T03:50:39.236 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:38 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:39.236 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:38 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:50:39.236 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:38 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:50:39.236 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:38 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:39.236 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:38 smithi162 ceph-mon[35071]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2024-09-21T03:50:39.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:38 smithi046 ceph-mon[30954]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T03:50:39.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:38 smithi046 ceph-mon[30954]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T03:50:39.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:38 smithi046 ceph-mon[30954]: from='osd.7 [v2:172.21.15.105:6816/1015687379,v1:172.21.15.105:6817/1015687379]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi105", "root=default"]} : dispatch 2024-09-21T03:50:39.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:38 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:50:39.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:38 smithi046 ceph-mon[30954]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi105", "root=default"]} : dispatch 2024-09-21T03:50:39.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:38 smithi046 ceph-mon[30954]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:39.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:38 smithi046 ceph-mon[30954]: Detected new or changed devices on smithi105 2024-09-21T03:50:39.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:38 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:39.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:38 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:39.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:38 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:50:39.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:38 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:50:39.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:38 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T03:50:39.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:38 smithi046 ceph-mon[30954]: Adjusting osd_memory_target on smithi105 to 5696M 2024-09-21T03:50:39.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:38 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:39.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:38 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:50:39.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:38 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:50:39.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:38 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:39.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:38 smithi046 ceph-mon[30954]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2024-09-21T03:50:39.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:38 smithi105 ceph-mon[34773]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T03:50:39.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:38 smithi105 ceph-mon[34773]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T03:50:39.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:38 smithi105 ceph-mon[34773]: from='osd.7 [v2:172.21.15.105:6816/1015687379,v1:172.21.15.105:6817/1015687379]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi105", "root=default"]} : dispatch 2024-09-21T03:50:39.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:38 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:50:39.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:38 smithi105 ceph-mon[34773]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi105", "root=default"]} : dispatch 2024-09-21T03:50:39.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:38 smithi105 ceph-mon[34773]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:39.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:38 smithi105 ceph-mon[34773]: Detected new or changed devices on smithi105 2024-09-21T03:50:39.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:38 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:39.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:38 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:39.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:38 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:50:39.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:38 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:50:39.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:38 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T03:50:39.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:38 smithi105 ceph-mon[34773]: Adjusting osd_memory_target on smithi105 to 5696M 2024-09-21T03:50:39.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:38 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:39.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:38 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:50:39.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:38 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:50:39.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:38 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:39.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:38 smithi105 ceph-mon[34773]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2024-09-21T03:50:39.818 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 03:50:39 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T03:50:39.430+0000 7f69f9761640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T03:50:39.818 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 03:50:39 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T03:50:39.442+0000 7f69f1557640 -1 osd.7 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:50:40.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:39 smithi046 ceph-mon[30954]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T03:50:40.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:39 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:50:40.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:39 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:50:40.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:39 smithi046 ceph-mon[30954]: from='client.24484 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:40.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:39 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:50:40.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:39 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:50:40.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:39 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:50:40.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:39 smithi046 ceph-mon[30954]: from='osd.7 ' entity='osd.7' 2024-09-21T03:50:40.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:39 smithi105 ceph-mon[34773]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T03:50:40.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:39 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:50:40.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:39 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:50:40.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:39 smithi105 ceph-mon[34773]: from='client.24484 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:40.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:39 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:50:40.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:39 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:50:40.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:39 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:50:40.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:39 smithi105 ceph-mon[34773]: from='osd.7 ' entity='osd.7' 2024-09-21T03:50:40.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:39 smithi162 ceph-mon[35071]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T03:50:40.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:39 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:50:40.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:39 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:50:40.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:39 smithi162 ceph-mon[35071]: from='client.24484 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:50:40.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:39 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:50:40.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:39 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:50:40.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:39 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:50:40.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:39 smithi162 ceph-mon[35071]: from='osd.7 ' entity='osd.7' 2024-09-21T03:50:41.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:41 smithi105 ceph-mon[34773]: purged_snaps scrub starts 2024-09-21T03:50:41.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:41 smithi105 ceph-mon[34773]: purged_snaps scrub ok 2024-09-21T03:50:41.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:41 smithi105 ceph-mon[34773]: osd.7 [v2:172.21.15.105:6816/1015687379,v1:172.21.15.105:6817/1015687379] boot 2024-09-21T03:50:41.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:41 smithi105 ceph-mon[34773]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T03:50:41.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:41 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:50:41.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:41 smithi105 ceph-mon[34773]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:41.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:41 smithi162 ceph-mon[35071]: purged_snaps scrub starts 2024-09-21T03:50:41.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:41 smithi162 ceph-mon[35071]: purged_snaps scrub ok 2024-09-21T03:50:41.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:41 smithi162 ceph-mon[35071]: osd.7 [v2:172.21.15.105:6816/1015687379,v1:172.21.15.105:6817/1015687379] boot 2024-09-21T03:50:41.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:41 smithi162 ceph-mon[35071]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T03:50:41.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:41 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:50:41.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:41 smithi162 ceph-mon[35071]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:41.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:41 smithi046 ceph-mon[30954]: purged_snaps scrub starts 2024-09-21T03:50:41.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:41 smithi046 ceph-mon[30954]: purged_snaps scrub ok 2024-09-21T03:50:41.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:41 smithi046 ceph-mon[30954]: osd.7 [v2:172.21.15.105:6816/1015687379,v1:172.21.15.105:6817/1015687379] boot 2024-09-21T03:50:41.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:41 smithi046 ceph-mon[30954]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T03:50:41.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:41 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:50:41.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:41 smithi046 ceph-mon[30954]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:50:42.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:42 smithi105 ceph-mon[34773]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T03:50:42.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:42 smithi105 ceph-mon[34773]: from='client.? 172.21.15.162:0/3188310788' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "27b2ccec-65be-47b3-a924-c5939ba1cb5d"} : dispatch 2024-09-21T03:50:42.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:42 smithi105 ceph-mon[34773]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "27b2ccec-65be-47b3-a924-c5939ba1cb5d"} : dispatch 2024-09-21T03:50:42.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:42 smithi105 ceph-mon[34773]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "27b2ccec-65be-47b3-a924-c5939ba1cb5d"}]': finished 2024-09-21T03:50:42.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:42 smithi105 ceph-mon[34773]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T03:50:42.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:42 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:50:42.341 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:42 smithi162 ceph-mon[35071]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T03:50:42.341 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:42 smithi162 ceph-mon[35071]: from='client.? 172.21.15.162:0/3188310788' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "27b2ccec-65be-47b3-a924-c5939ba1cb5d"} : dispatch 2024-09-21T03:50:42.341 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:42 smithi162 ceph-mon[35071]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "27b2ccec-65be-47b3-a924-c5939ba1cb5d"} : dispatch 2024-09-21T03:50:42.341 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:42 smithi162 ceph-mon[35071]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "27b2ccec-65be-47b3-a924-c5939ba1cb5d"}]': finished 2024-09-21T03:50:42.341 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:42 smithi162 ceph-mon[35071]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T03:50:42.341 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:42 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:50:42.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:42 smithi046 ceph-mon[30954]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T03:50:42.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:42 smithi046 ceph-mon[30954]: from='client.? 172.21.15.162:0/3188310788' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "27b2ccec-65be-47b3-a924-c5939ba1cb5d"} : dispatch 2024-09-21T03:50:42.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:42 smithi046 ceph-mon[30954]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "27b2ccec-65be-47b3-a924-c5939ba1cb5d"} : dispatch 2024-09-21T03:50:42.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:42 smithi046 ceph-mon[30954]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "27b2ccec-65be-47b3-a924-c5939ba1cb5d"}]': finished 2024-09-21T03:50:42.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:42 smithi046 ceph-mon[30954]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T03:50:42.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:42 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:50:43.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:43 smithi105 ceph-mon[34773]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:50:43.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:43 smithi105 ceph-mon[34773]: from='client.? 172.21.15.162:0/3287644608' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:50:43.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:43 smithi162 ceph-mon[35071]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:50:43.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:43 smithi162 ceph-mon[35071]: from='client.? 172.21.15.162:0/3287644608' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:50:43.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:43 smithi046 ceph-mon[30954]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:50:43.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:43 smithi046 ceph-mon[30954]: from='client.? 172.21.15.162:0/3287644608' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:50:45.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:45 smithi105 ceph-mon[34773]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:50:45.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:45 smithi162 ceph-mon[35071]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:50:45.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:45 smithi046 ceph-mon[30954]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:50:47.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:47 smithi105 ceph-mon[34773]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T03:50:47.343 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:47 smithi162 ceph-mon[35071]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T03:50:47.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:47 smithi046 ceph-mon[30954]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T03:50:49.097 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:49 smithi162 ceph-mon[35071]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T03:50:49.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:49 smithi105 ceph-mon[34773]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T03:50:49.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:49 smithi046 ceph-mon[30954]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T03:50:51.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:51 smithi162 ceph-mon[35071]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-21T03:50:51.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:51 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T03:50:51.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:51 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:50:51.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:51 smithi162 ceph-mon[35071]: Deploying daemon osd.8 on smithi162 2024-09-21T03:50:51.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:51 smithi105 ceph-mon[34773]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-21T03:50:51.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:51 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T03:50:51.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:51 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:50:51.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:51 smithi105 ceph-mon[34773]: Deploying daemon osd.8 on smithi162 2024-09-21T03:50:51.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:51 smithi046 ceph-mon[30954]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-21T03:50:51.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:51 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T03:50:51.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:51 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:50:51.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:51 smithi046 ceph-mon[30954]: Deploying daemon osd.8 on smithi162 2024-09-21T03:50:53.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:53 smithi105 ceph-mon[34773]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T03:50:53.327 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:53 smithi162 ceph-mon[35071]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T03:50:53.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:53 smithi046 ceph-mon[30954]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T03:50:55.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:55 smithi105 ceph-mon[34773]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:50:55.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:55 smithi162 ceph-mon[35071]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:50:55.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:55 smithi046 ceph-mon[30954]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:50:57.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:57 smithi162 ceph-mon[35071]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:50:57.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:57 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:50:57.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:57 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:57.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:57 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:57.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:57 smithi105 ceph-mon[34773]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:50:57.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:57 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:50:57.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:57 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:57.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:57 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:57.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:57 smithi046 ceph-mon[30954]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:50:57.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:57 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:50:57.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:57 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:57.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:57 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:50:59.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:50:59 smithi105 ceph-mon[34773]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:50:59.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:50:59 smithi162 ceph-mon[35071]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:50:59.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:50:59 smithi046 ceph-mon[30954]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:51:00.320 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:00 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:00.320 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:00 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:00.321 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:00 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:00.321 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:00 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:51:00.321 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:00 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:00.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:00.362+0000 7f78d27fc640 1 -- 172.21.15.162:0/834358616 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f78dc10a4b0 con 0x7f78c80b6560 2024-09-21T03:51:00.364 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 8 on host 'smithi162' 2024-09-21T03:51:00.366 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:00.364+0000 7f78e37fd640 1 -- 172.21.15.162:0/834358616 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f78c80b6560 msgr2=0x7f78c80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:00.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:00.364+0000 7f78e37fd640 1 --2- 172.21.15.162:0/834358616 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f78c80b6560 0x7f78c80b8a70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f78d8031440 tx=0x7f78d8009560 comp rx=0 tx=0).stop 2024-09-21T03:51:00.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:00.364+0000 7f78e37fd640 1 -- 172.21.15.162:0/834358616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78dc102fa0 msgr2=0x7f78dc19cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:00.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:00.364+0000 7f78e37fd640 1 --2- 172.21.15.162:0/834358616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78dc102fa0 0x7f78dc19cbb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00c890 tx=0x7f78cc00cd50 comp rx=0 tx=0).stop 2024-09-21T03:51:00.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:00.364+0000 7f78e37fd640 1 -- 172.21.15.162:0/834358616 shutdown_connections 2024-09-21T03:51:00.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:00.364+0000 7f78e37fd640 1 --2- 172.21.15.162:0/834358616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78dc110200 0x7f78dc1a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:00.364+0000 7f78e37fd640 1 --2- 172.21.15.162:0/834358616 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f78c80b6560 0x7f78c80b8a70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:00.364+0000 7f78e37fd640 1 --2- 172.21.15.162:0/834358616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78dc102fa0 0x7f78dc19cbb0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:00.364+0000 7f78e37fd640 1 --2- 172.21.15.162:0/834358616 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78dc102650 0x7f78dc19c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:00.364+0000 7f78e37fd640 1 -- 172.21.15.162:0/834358616 >> 172.21.15.162:0/834358616 conn(0x7f78dc079790 msgr2=0x7f78dc109da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:00.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:00.365+0000 7f78e37fd640 1 -- 172.21.15.162:0/834358616 shutdown_connections 2024-09-21T03:51:00.368 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:00.365+0000 7f78e37fd640 1 -- 172.21.15.162:0/834358616 wait complete. 2024-09-21T03:51:00.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:00 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:00.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:00 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:00.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:00 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:00.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:00 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:51:00.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:00 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:00.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:00 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:00.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:00 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:00.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:00 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:00.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:00 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:51:00.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:00 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:01.160 DEBUG:teuthology.orchestra.run.smithi162:osd.8> sudo journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.8.service 2024-09-21T03:51:01.163 INFO:tasks.cephadm:Deploying osd.9 on smithi046 with /dev/vg_nvme/lv_1... 2024-09-21T03:51:01.163 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T03:51:01.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:01 smithi162 ceph-mon[35071]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:51:01.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:01 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:51:01.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:01 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:01.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:01 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:01.433 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:51:01.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:01 smithi046 ceph-mon[30954]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:51:01.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:01 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:51:01.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:01 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:01.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:01 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:01.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:01 smithi105 ceph-mon[34773]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:51:01.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:01 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:51:01.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:01 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:01.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:01 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:03.126 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 03:51:02 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T03:51:02.779+0000 7f586d46b640 -1 osd.8 0 log_to_monitors true 2024-09-21T03:51:03.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:03 smithi046 ceph-mon[30954]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:51:03.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:03 smithi046 ceph-mon[30954]: from='osd.8 [v2:172.21.15.162:6816/3441747512,v1:172.21.15.162:6817/3441747512]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T03:51:03.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:03 smithi046 ceph-mon[30954]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T03:51:03.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:03 smithi162 ceph-mon[35071]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:51:03.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:03 smithi162 ceph-mon[35071]: from='osd.8 [v2:172.21.15.162:6816/3441747512,v1:172.21.15.162:6817/3441747512]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T03:51:03.417 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:03 smithi162 ceph-mon[35071]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T03:51:03.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:03 smithi105 ceph-mon[34773]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:51:03.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:03 smithi105 ceph-mon[34773]: from='osd.8 [v2:172.21.15.162:6816/3441747512,v1:172.21.15.162:6817/3441747512]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T03:51:03.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:03 smithi105 ceph-mon[34773]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T03:51:04.150 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:51:04.181 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi046:vg_nvme/lv_1 2024-09-21T03:51:04.445 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:51:04.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:04 smithi046 ceph-mon[30954]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T03:51:04.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:04 smithi046 ceph-mon[30954]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T03:51:04.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:04 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:51:04.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:04 smithi046 ceph-mon[30954]: from='osd.8 [v2:172.21.15.162:6816/3441747512,v1:172.21.15.162:6817/3441747512]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T03:51:04.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:04 smithi046 ceph-mon[30954]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T03:51:04.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:04 smithi105 ceph-mon[34773]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T03:51:04.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:04 smithi105 ceph-mon[34773]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T03:51:04.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:04 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:51:04.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:04 smithi105 ceph-mon[34773]: from='osd.8 [v2:172.21.15.162:6816/3441747512,v1:172.21.15.162:6817/3441747512]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T03:51:04.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:04 smithi105 ceph-mon[34773]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T03:51:04.608 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:04 smithi162 ceph-mon[35071]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T03:51:04.608 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:04 smithi162 ceph-mon[35071]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T03:51:04.608 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:04 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:51:04.609 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:04 smithi162 ceph-mon[35071]: from='osd.8 [v2:172.21.15.162:6816/3441747512,v1:172.21.15.162:6817/3441747512]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T03:51:04.609 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:04 smithi162 ceph-mon[35071]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T03:51:04.875 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 03:51:04 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T03:51:04.605+0000 7f5869c02640 -1 osd.8 0 waiting for initial osdmap 2024-09-21T03:51:04.876 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 03:51:04 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T03:51:04.619+0000 7f58611e3640 -1 osd.8 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:51:04.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.944+0000 7f3510d67640 1 -- 172.21.15.46:0/3839384596 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f350c107bd0 msgr2=0x7f350c107fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:04.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.944+0000 7f3510d67640 1 --2- 172.21.15.46:0/3839384596 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f350c107bd0 0x7f350c107fe0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f34f400aa10 tx=0x7f34f402b720 comp rx=0 tx=0).stop 2024-09-21T03:51:04.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.945+0000 7f3510d67640 1 -- 172.21.15.46:0/3839384596 shutdown_connections 2024-09-21T03:51:04.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.945+0000 7f3510d67640 1 --2- 172.21.15.46:0/3839384596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f350c108520 0x7f350c10ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:04.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.945+0000 7f3510d67640 1 --2- 172.21.15.46:0/3839384596 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f350c107bd0 0x7f350c107fe0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:04.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.945+0000 7f3510d67640 1 --2- 172.21.15.46:0/3839384596 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f350c102290 0x7f350c1026a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:04.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.945+0000 7f3510d67640 1 -- 172.21.15.46:0/3839384596 >> 172.21.15.46:0/3839384596 conn(0x7f350c079ea0 msgr2=0x7f350c07a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:04.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.945+0000 7f3510d67640 1 -- 172.21.15.46:0/3839384596 shutdown_connections 2024-09-21T03:51:04.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.945+0000 7f3510d67640 1 -- 172.21.15.46:0/3839384596 wait complete. 2024-09-21T03:51:04.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.945+0000 7f3510d67640 1 Processor -- start 2024-09-21T03:51:04.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.945+0000 7f3510d67640 1 -- start start 2024-09-21T03:51:04.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.946+0000 7f3510d67640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f350c102290 0x7f350c19a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:04.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.946+0000 7f3510d67640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f350c107bd0 0x7f350c19ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:04.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.946+0000 7f3510d67640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f350c108520 0x7f350c19fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:04.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.946+0000 7f3510d67640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f350c111960 con 0x7f350c107bd0 2024-09-21T03:51:04.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.946+0000 7f3510d67640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f350c1117e0 con 0x7f350c108520 2024-09-21T03:51:04.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.946+0000 7f3510d67640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f350c111ae0 con 0x7f350c102290 2024-09-21T03:51:04.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.946+0000 7f3509d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f350c107bd0 0x7f350c19ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:04.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.946+0000 7f3509d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f350c107bd0 0x7f350c19ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57998/0 (socket says 172.21.15.46:57998) 2024-09-21T03:51:04.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.946+0000 7f3509d9b640 1 -- 172.21.15.46:0/242135164 learned_addr learned my addr 172.21.15.46:0/242135164 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:51:04.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.946+0000 7f350a59c640 1 --2- 172.21.15.46:0/242135164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f350c102290 0x7f350c19a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:04.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.946+0000 7f350ad9d640 1 --2- 172.21.15.46:0/242135164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f350c108520 0x7f350c19fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:04.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.946+0000 7f3509d9b640 1 -- 172.21.15.46:0/242135164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f350c102290 msgr2=0x7f350c19a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:04.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.946+0000 7f3509d9b640 1 --2- 172.21.15.46:0/242135164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f350c102290 0x7f350c19a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:04.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.946+0000 7f3509d9b640 1 -- 172.21.15.46:0/242135164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f350c108520 msgr2=0x7f350c19fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:04.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.946+0000 7f3509d9b640 1 --2- 172.21.15.46:0/242135164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f350c108520 0x7f350c19fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:04.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.946+0000 7f3509d9b640 1 -- 172.21.15.46:0/242135164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f350c1a0420 con 0x7f350c107bd0 2024-09-21T03:51:04.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.946+0000 7f3509d9b640 1 --2- 172.21.15.46:0/242135164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f350c107bd0 0x7f350c19ab10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f34f402bc40 tx=0x7f34f4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:04.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.947+0000 7f35037fe640 1 -- 172.21.15.46:0/242135164 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f403f070 con 0x7f350c107bd0 2024-09-21T03:51:04.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.947+0000 7f35037fe640 1 -- 172.21.15.46:0/242135164 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34f4004490 con 0x7f350c107bd0 2024-09-21T03:51:04.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.947+0000 7f3510d67640 1 -- 172.21.15.46:0/242135164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f350c1a06b0 con 0x7f350c107bd0 2024-09-21T03:51:04.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.947+0000 7f35037fe640 1 -- 172.21.15.46:0/242135164 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f4036040 con 0x7f350c107bd0 2024-09-21T03:51:04.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.947+0000 7f3510d67640 1 -- 172.21.15.46:0/242135164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f350c1a0be0 con 0x7f350c107bd0 2024-09-21T03:51:04.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.948+0000 7f3510d67640 1 -- 172.21.15.46:0/242135164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f350c1026a0 con 0x7f350c107bd0 2024-09-21T03:51:04.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.949+0000 7f35037fe640 1 -- 172.21.15.46:0/242135164 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f34f4042070 con 0x7f350c107bd0 2024-09-21T03:51:04.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.950+0000 7f35037fe640 1 --2- 172.21.15.46:0/242135164 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f34f80b6610 0x7f34f80b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:04.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.950+0000 7f350a59c640 1 --2- 172.21.15.46:0/242135164 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f34f80b6610 0x7f34f80b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:04.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.950+0000 7f35037fe640 1 -- 172.21.15.46:0/242135164 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5764+0+0 (secure 0 0 0) 0x7f34f41072d0 con 0x7f350c107bd0 2024-09-21T03:51:04.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.951+0000 7f350a59c640 1 --2- 172.21.15.46:0/242135164 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f34f80b6610 0x7f34f80b8b20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f34fc00abe0 tx=0x7f34fc00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:04.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:04.953+0000 7f35037fe640 1 -- 172.21.15.46:0/242135164 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f350c1a0be0 con 0x7f350c107bd0 2024-09-21T03:51:05.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:05.154+0000 7f3510d67640 1 -- 172.21.15.46:0/242135164 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f350c063800 con 0x7f34f80b6610 2024-09-21T03:51:05.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:05 smithi046 ceph-mon[30954]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:51:05.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:05 smithi046 ceph-mon[30954]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T03:51:05.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:05 smithi046 ceph-mon[30954]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T03:51:05.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:05 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:51:05.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:05 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:51:05.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:05 smithi046 ceph-mon[30954]: Detected new or changed devices on smithi162 2024-09-21T03:51:05.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:05 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:05.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:05 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:05.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:05 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:51:05.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:05 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:51:05.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:05 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T03:51:05.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:05 smithi046 ceph-mon[30954]: Adjusting osd_memory_target on smithi162 to 5696M 2024-09-21T03:51:05.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:05 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:05.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:05 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:05.503 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:05 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:51:05.503 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:05 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:05.503 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:05 smithi046 ceph-mon[30954]: from='osd.8 ' entity='osd.8' 2024-09-21T03:51:05.503 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:05 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:51:05.503 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:05 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:51:05.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:05 smithi105 ceph-mon[34773]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:51:05.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:05 smithi105 ceph-mon[34773]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T03:51:05.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:05 smithi105 ceph-mon[34773]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T03:51:05.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:05 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:51:05.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:05 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:51:05.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:05 smithi105 ceph-mon[34773]: Detected new or changed devices on smithi162 2024-09-21T03:51:05.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:05 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:05.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:05 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:05.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:05 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:51:05.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:05 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:51:05.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:05 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T03:51:05.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:05 smithi105 ceph-mon[34773]: Adjusting osd_memory_target on smithi162 to 5696M 2024-09-21T03:51:05.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:05 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:05.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:05 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:05.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:05 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:51:05.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:05 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:05.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:05 smithi105 ceph-mon[34773]: from='osd.8 ' entity='osd.8' 2024-09-21T03:51:05.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:05 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:51:05.570 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:05 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:51:05.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:05 smithi162 ceph-mon[35071]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:51:05.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:05 smithi162 ceph-mon[35071]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T03:51:05.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:05 smithi162 ceph-mon[35071]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T03:51:05.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:05 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:51:05.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:05 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:51:05.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:05 smithi162 ceph-mon[35071]: Detected new or changed devices on smithi162 2024-09-21T03:51:05.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:05 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:05.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:05 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:05.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:05 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:51:05.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:05 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:51:05.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:05 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T03:51:05.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:05 smithi162 ceph-mon[35071]: Adjusting osd_memory_target on smithi162 to 5696M 2024-09-21T03:51:05.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:05 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:05.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:05 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:05.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:05 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:51:05.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:05 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:05.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:05 smithi162 ceph-mon[35071]: from='osd.8 ' entity='osd.8' 2024-09-21T03:51:05.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:05 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:51:05.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:05 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:51:06.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:06 smithi046 ceph-mon[30954]: purged_snaps scrub starts 2024-09-21T03:51:06.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:06 smithi046 ceph-mon[30954]: purged_snaps scrub ok 2024-09-21T03:51:06.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:06 smithi046 ceph-mon[30954]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:06.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:06 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:06.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:06 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:51:06.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:06 smithi046 ceph-mon[30954]: osd.8 [v2:172.21.15.162:6816/3441747512,v1:172.21.15.162:6817/3441747512] boot 2024-09-21T03:51:06.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:06 smithi046 ceph-mon[30954]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T03:51:06.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:06 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:51:06.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:06 smithi105 ceph-mon[34773]: purged_snaps scrub starts 2024-09-21T03:51:06.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:06 smithi105 ceph-mon[34773]: purged_snaps scrub ok 2024-09-21T03:51:06.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:06 smithi105 ceph-mon[34773]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:06.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:06 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:06.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:06 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:51:06.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:06 smithi105 ceph-mon[34773]: osd.8 [v2:172.21.15.162:6816/3441747512,v1:172.21.15.162:6817/3441747512] boot 2024-09-21T03:51:06.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:06 smithi105 ceph-mon[34773]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T03:51:06.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:06 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:51:06.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:06 smithi162 ceph-mon[35071]: purged_snaps scrub starts 2024-09-21T03:51:06.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:06 smithi162 ceph-mon[35071]: purged_snaps scrub ok 2024-09-21T03:51:06.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:06 smithi162 ceph-mon[35071]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:06.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:06 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:06.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:06 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:51:06.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:06 smithi162 ceph-mon[35071]: osd.8 [v2:172.21.15.162:6816/3441747512,v1:172.21.15.162:6817/3441747512] boot 2024-09-21T03:51:06.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:06 smithi162 ceph-mon[35071]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T03:51:06.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:06 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:51:07.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:07 smithi046 ceph-mon[30954]: pgmap v177: 1 pgs: 1 remapped+peering; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:51:07.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:07 smithi046 ceph-mon[30954]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T03:51:07.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:07 smithi105 ceph-mon[34773]: pgmap v177: 1 pgs: 1 remapped+peering; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:51:07.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:07 smithi105 ceph-mon[34773]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T03:51:07.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:07 smithi162 ceph-mon[35071]: pgmap v177: 1 pgs: 1 remapped+peering; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:51:07.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:07 smithi162 ceph-mon[35071]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T03:51:08.378 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:08 smithi046 ceph-mon[30954]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T03:51:08.379 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:08 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3603349098' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3f7cb70c-73c7-48e8-a32b-7445eda2126d"} : dispatch 2024-09-21T03:51:08.379 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:08 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3603349098' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3f7cb70c-73c7-48e8-a32b-7445eda2126d"}]': finished 2024-09-21T03:51:08.379 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:08 smithi046 ceph-mon[30954]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T03:51:08.379 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:08 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:51:08.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:08 smithi105 ceph-mon[34773]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T03:51:08.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:08 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3603349098' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3f7cb70c-73c7-48e8-a32b-7445eda2126d"} : dispatch 2024-09-21T03:51:08.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:08 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3603349098' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3f7cb70c-73c7-48e8-a32b-7445eda2126d"}]': finished 2024-09-21T03:51:08.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:08 smithi105 ceph-mon[34773]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T03:51:08.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:08 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:51:08.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:08 smithi162 ceph-mon[35071]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T03:51:08.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:08 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3603349098' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3f7cb70c-73c7-48e8-a32b-7445eda2126d"} : dispatch 2024-09-21T03:51:08.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:08 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3603349098' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3f7cb70c-73c7-48e8-a32b-7445eda2126d"}]': finished 2024-09-21T03:51:08.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:08 smithi162 ceph-mon[35071]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T03:51:08.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:08 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:51:09.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:09 smithi046 ceph-mon[30954]: pgmap v181: 1 pgs: 1 remapped+peering; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:51:09.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:09 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/2109165697' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:51:09.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:09 smithi105 ceph-mon[34773]: pgmap v181: 1 pgs: 1 remapped+peering; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:51:09.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:09 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/2109165697' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:51:09.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:09 smithi162 ceph-mon[35071]: pgmap v181: 1 pgs: 1 remapped+peering; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:51:09.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:09 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/2109165697' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:51:11.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:11 smithi046 ceph-mon[30954]: pgmap v182: 1 pgs: 1 remapped+peering; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:51:11.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:11 smithi105 ceph-mon[34773]: pgmap v182: 1 pgs: 1 remapped+peering; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:51:11.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:11 smithi162 ceph-mon[35071]: pgmap v182: 1 pgs: 1 remapped+peering; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:51:13.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:13 smithi046 ceph-mon[30954]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T03:51:13.446 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:13 smithi162 ceph-mon[35071]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T03:51:13.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:13 smithi105 ceph-mon[34773]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T03:51:15.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:15 smithi046 ceph-mon[30954]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-21T03:51:15.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:15 smithi105 ceph-mon[34773]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-21T03:51:15.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:15 smithi162 ceph-mon[35071]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-21T03:51:17.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:17 smithi046 ceph-mon[30954]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T03:51:17.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:17 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T03:51:17.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:17 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:17.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:17 smithi046 ceph-mon[30954]: Deploying daemon osd.9 on smithi046 2024-09-21T03:51:17.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:17 smithi105 ceph-mon[34773]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T03:51:17.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:17 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T03:51:17.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:17 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:17.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:17 smithi105 ceph-mon[34773]: Deploying daemon osd.9 on smithi046 2024-09-21T03:51:17.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:17 smithi162 ceph-mon[35071]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T03:51:17.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:17 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T03:51:17.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:17 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:17.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:17 smithi162 ceph-mon[35071]: Deploying daemon osd.9 on smithi046 2024-09-21T03:51:19.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:19 smithi046 ceph-mon[30954]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T03:51:19.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:19 smithi105 ceph-mon[34773]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T03:51:19.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:19 smithi162 ceph-mon[35071]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T03:51:21.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:21 smithi046 ceph-mon[30954]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:51:21.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:21 smithi105 ceph-mon[34773]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:51:21.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:21 smithi162 ceph-mon[35071]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:51:23.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:23 smithi046 ceph-mon[30954]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:51:23.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:23 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:51:23.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:23 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:23.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:23 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:23.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:23 smithi105 ceph-mon[34773]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:51:23.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:23 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:51:23.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:23 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:23.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:23 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:23.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:23 smithi162 ceph-mon[35071]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:51:23.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:23 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:51:23.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:23 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:23.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:23 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:25.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:25 smithi046 ceph-mon[30954]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:51:25.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:25 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:25.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:25 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:25.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:25 smithi105 ceph-mon[34773]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:51:25.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:25 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:25.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:25 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:25.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:25 smithi162 ceph-mon[35071]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:51:25.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:25 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:25.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:25 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:26.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:26.033+0000 7f35037fe640 1 -- 172.21.15.46:0/242135164 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f350c063800 con 0x7f34f80b6610 2024-09-21T03:51:26.035 INFO:teuthology.orchestra.run.smithi046.stdout:Created osd(s) 9 on host 'smithi046' 2024-09-21T03:51:26.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:26.035+0000 7f3510d67640 1 -- 172.21.15.46:0/242135164 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f34f80b6610 msgr2=0x7f34f80b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:26.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:26.035+0000 7f3510d67640 1 --2- 172.21.15.46:0/242135164 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f34f80b6610 0x7f34f80b8b20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f34fc00abe0 tx=0x7f34fc00a2d0 comp rx=0 tx=0).stop 2024-09-21T03:51:26.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:26.035+0000 7f3510d67640 1 -- 172.21.15.46:0/242135164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f350c107bd0 msgr2=0x7f350c19ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:26.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:26.035+0000 7f3510d67640 1 --2- 172.21.15.46:0/242135164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f350c107bd0 0x7f350c19ab10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f34f402bc40 tx=0x7f34f4004270 comp rx=0 tx=0).stop 2024-09-21T03:51:26.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:26.035+0000 7f3510d67640 1 -- 172.21.15.46:0/242135164 shutdown_connections 2024-09-21T03:51:26.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:26.035+0000 7f3510d67640 1 --2- 172.21.15.46:0/242135164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f350c108520 0x7f350c19fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:26.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:26.035+0000 7f3510d67640 1 --2- 172.21.15.46:0/242135164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f350c107bd0 0x7f350c19ab10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:26.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:26.035+0000 7f3510d67640 1 --2- 172.21.15.46:0/242135164 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f34f80b6610 0x7f34f80b8b20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:26.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:26.035+0000 7f3510d67640 1 --2- 172.21.15.46:0/242135164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f350c102290 0x7f350c19a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:26.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:26.035+0000 7f3510d67640 1 -- 172.21.15.46:0/242135164 >> 172.21.15.46:0/242135164 conn(0x7f350c079ea0 msgr2=0x7f350c1012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:26.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:26.035+0000 7f3510d67640 1 -- 172.21.15.46:0/242135164 shutdown_connections 2024-09-21T03:51:26.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:51:26.035+0000 7f3510d67640 1 -- 172.21.15.46:0/242135164 wait complete. 2024-09-21T03:51:26.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:26 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:26.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:26 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:51:26.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:26 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:26.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:26 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:51:26.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:26 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:26.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:26 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:26.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:26 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:26.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:26 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:51:26.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:26 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:26.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:26 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:51:26.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:26 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:26.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:26 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:26.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:26 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:26.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:26 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:51:26.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:26 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:26.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:26 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:51:26.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:26 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:26.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:26 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:26.882 DEBUG:teuthology.orchestra.run.smithi046:osd.9> sudo journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.9.service 2024-09-21T03:51:26.885 INFO:tasks.cephadm:Deploying osd.10 on smithi105 with /dev/vg_nvme/lv_1... 2024-09-21T03:51:26.885 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T03:51:27.143 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:51:27.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:27 smithi105 ceph-mon[34773]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:51:27.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:27 smithi162 ceph-mon[35071]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:51:28.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:27 smithi046 ceph-mon[30954]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:51:28.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:28 smithi046 ceph-mon[30954]: from='osd.9 [v2:172.21.15.46:6826/382230768,v1:172.21.15.46:6827/382230768]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T03:51:28.751 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 03:51:28 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T03:51:28.422+0000 7f8f3bf43640 -1 osd.9 0 log_to_monitors true 2024-09-21T03:51:28.871 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:28 smithi105 ceph-mon[34773]: from='osd.9 [v2:172.21.15.46:6826/382230768,v1:172.21.15.46:6827/382230768]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T03:51:28.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:28 smithi162 ceph-mon[35071]: from='osd.9 [v2:172.21.15.46:6826/382230768,v1:172.21.15.46:6827/382230768]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T03:51:29.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:29 smithi105 ceph-mon[34773]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:51:29.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:29 smithi105 ceph-mon[34773]: from='osd.9 [v2:172.21.15.46:6826/382230768,v1:172.21.15.46:6827/382230768]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T03:51:29.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:29 smithi105 ceph-mon[34773]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T03:51:29.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:29 smithi105 ceph-mon[34773]: from='osd.9 [v2:172.21.15.46:6826/382230768,v1:172.21.15.46:6827/382230768]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi046", "root=default"]} : dispatch 2024-09-21T03:51:29.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:29 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:51:29.848 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:51:29.874 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi105:vg_nvme/lv_1 2024-09-21T03:51:29.880 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 03:51:29 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T03:51:29.626+0000 7f8f37ec5640 -1 osd.9 0 waiting for initial osdmap 2024-09-21T03:51:29.880 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 03:51:29 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T03:51:29.638+0000 7f8f33cc3640 -1 osd.9 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:51:29.881 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:29 smithi046 ceph-mon[30954]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:51:29.881 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:29 smithi046 ceph-mon[30954]: from='osd.9 [v2:172.21.15.46:6826/382230768,v1:172.21.15.46:6827/382230768]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T03:51:29.881 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:29 smithi046 ceph-mon[30954]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T03:51:29.881 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:29 smithi046 ceph-mon[30954]: from='osd.9 [v2:172.21.15.46:6826/382230768,v1:172.21.15.46:6827/382230768]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi046", "root=default"]} : dispatch 2024-09-21T03:51:29.881 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:29 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:51:30.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:29 smithi162 ceph-mon[35071]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:51:30.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:29 smithi162 ceph-mon[35071]: from='osd.9 [v2:172.21.15.46:6826/382230768,v1:172.21.15.46:6827/382230768]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T03:51:30.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:29 smithi162 ceph-mon[35071]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T03:51:30.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:29 smithi162 ceph-mon[35071]: from='osd.9 [v2:172.21.15.46:6826/382230768,v1:172.21.15.46:6827/382230768]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi046", "root=default"]} : dispatch 2024-09-21T03:51:30.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:29 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:51:30.138 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:51:30.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.619+0000 7f72ba5c1640 1 -- 172.21.15.105:0/1691101831 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72b410deb0 msgr2=0x7f72b4110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:30.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.619+0000 7f72ba5c1640 1 --2- 172.21.15.105:0/1691101831 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72b410deb0 0x7f72b4110330 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f72ac009ca0 tx=0x7f72ac02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:51:30.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.619+0000 7f72ba5c1640 1 -- 172.21.15.105:0/1691101831 shutdown_connections 2024-09-21T03:51:30.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.619+0000 7f72ba5c1640 1 --2- 172.21.15.105:0/1691101831 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72b410deb0 0x7f72b4110330 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:30.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.619+0000 7f72ba5c1640 1 --2- 172.21.15.105:0/1691101831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72b4105250 0x7f72b410d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:30.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.619+0000 7f72ba5c1640 1 --2- 172.21.15.105:0/1691101831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72b4104900 0x7f72b4104d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:30.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.619+0000 7f72ba5c1640 1 -- 172.21.15.105:0/1691101831 >> 172.21.15.105:0/1691101831 conn(0x7f72b4079760 msgr2=0x7f72b4079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:30.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.619+0000 7f72ba5c1640 1 -- 172.21.15.105:0/1691101831 shutdown_connections 2024-09-21T03:51:30.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.619+0000 7f72ba5c1640 1 -- 172.21.15.105:0/1691101831 wait complete. 2024-09-21T03:51:30.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.620+0000 7f72ba5c1640 1 Processor -- start 2024-09-21T03:51:30.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.620+0000 7f72ba5c1640 1 -- start start 2024-09-21T03:51:30.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.620+0000 7f72ba5c1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72b4104900 0x7f72b419a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:30.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.620+0000 7f72ba5c1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72b4105250 0x7f72b419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:30.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.620+0000 7f72ba5c1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72b410deb0 0x7f72b419fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:30.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.620+0000 7f72ba5c1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f72b4113aa0 con 0x7f72b4105250 2024-09-21T03:51:30.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.620+0000 7f72ba5c1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f72b4113920 con 0x7f72b4104900 2024-09-21T03:51:30.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.620+0000 7f72ba5c1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f72b4113c20 con 0x7f72b410deb0 2024-09-21T03:51:30.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.620+0000 7f72b3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72b4104900 0x7f72b419a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:30.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.620+0000 7f72b3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72b4104900 0x7f72b419a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56632/0 (socket says 172.21.15.105:56632) 2024-09-21T03:51:30.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.620+0000 7f72b3fff640 1 -- 172.21.15.105:0/738162497 learned_addr learned my addr 172.21.15.105:0/738162497 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:51:30.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.620+0000 7f72b37fe640 1 --2- 172.21.15.105:0/738162497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72b4105250 0x7f72b419a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:30.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.620+0000 7f72b8b5e640 1 --2- 172.21.15.105:0/738162497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72b410deb0 0x7f72b419fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:30.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.620+0000 7f72b3fff640 1 -- 172.21.15.105:0/738162497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72b410deb0 msgr2=0x7f72b419fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:30.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.620+0000 7f72b3fff640 1 --2- 172.21.15.105:0/738162497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72b410deb0 0x7f72b419fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:30.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.620+0000 7f72b3fff640 1 -- 172.21.15.105:0/738162497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72b4105250 msgr2=0x7f72b419a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:30.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.620+0000 7f72b3fff640 1 --2- 172.21.15.105:0/738162497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72b4105250 0x7f72b419a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:30.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.620+0000 7f72b3fff640 1 -- 172.21.15.105:0/738162497 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b41a03a0 con 0x7f72b4104900 2024-09-21T03:51:30.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.621+0000 7f72b37fe640 1 --2- 172.21.15.105:0/738162497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72b4105250 0x7f72b419a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:51:30.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.621+0000 7f72b3fff640 1 --2- 172.21.15.105:0/738162497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72b4104900 0x7f72b419a430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f72a400c970 tx=0x7f72a400ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:30.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.621+0000 7f72b17fa640 1 -- 172.21.15.105:0/738162497 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a4004220 con 0x7f72b4104900 2024-09-21T03:51:30.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.621+0000 7f72b17fa640 1 -- 172.21.15.105:0/738162497 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72a40043c0 con 0x7f72b4104900 2024-09-21T03:51:30.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.621+0000 7f72b17fa640 1 -- 172.21.15.105:0/738162497 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a400f450 con 0x7f72b4104900 2024-09-21T03:51:30.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.621+0000 7f72ba5c1640 1 -- 172.21.15.105:0/738162497 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72b41a0690 con 0x7f72b4104900 2024-09-21T03:51:30.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.621+0000 7f72ba5c1640 1 -- 172.21.15.105:0/738162497 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72b41a6df0 con 0x7f72b4104900 2024-09-21T03:51:30.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.622+0000 7f72ba5c1640 1 -- 172.21.15.105:0/738162497 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72b406c150 con 0x7f72b4104900 2024-09-21T03:51:30.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.623+0000 7f72b17fa640 1 -- 172.21.15.105:0/738162497 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f72a4003610 con 0x7f72b4104900 2024-09-21T03:51:30.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.624+0000 7f72b17fa640 1 --2- 172.21.15.105:0/738162497 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f729c0b6560 0x7f729c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:30.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.624+0000 7f72b17fa640 1 -- 172.21.15.105:0/738162497 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6196+0+0 (secure 0 0 0) 0x7f72a40e6d50 con 0x7f72b4104900 2024-09-21T03:51:30.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.624+0000 7f72b37fe640 1 --2- 172.21.15.105:0/738162497 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f729c0b6560 0x7f729c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:30.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.625+0000 7f72b37fe640 1 --2- 172.21.15.105:0/738162497 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f729c0b6560 0x7f729c0b8a70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f72a80058c0 tx=0x7f72a8005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:30.634 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.628+0000 7f72b17fa640 1 -- 172.21.15.105:0/738162497 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f72a4014030 con 0x7f72b4104900 2024-09-21T03:51:30.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:30 smithi105 ceph-mon[34773]: from='osd.9 [v2:172.21.15.46:6826/382230768,v1:172.21.15.46:6827/382230768]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-21T03:51:30.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:30 smithi105 ceph-mon[34773]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T03:51:30.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:30 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:51:30.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:30 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:51:30.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:30 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:30.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:30 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:30.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:30 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:51:30.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:30 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:51:30.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:30 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T03:51:30.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:30 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T03:51:30.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:30 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:30.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:30 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:30.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:30 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:51:30.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:30 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:30.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:30.816+0000 7f72ba5c1640 1 -- 172.21.15.105:0/738162497 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f72b4063800 con 0x7f729c0b6560 2024-09-21T03:51:31.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:30 smithi046 ceph-mon[30954]: from='osd.9 [v2:172.21.15.46:6826/382230768,v1:172.21.15.46:6827/382230768]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-21T03:51:31.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:30 smithi046 ceph-mon[30954]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T03:51:31.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:30 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:51:31.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:30 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:51:31.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:30 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:31.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:30 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:31.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:30 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:51:31.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:30 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:51:31.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:30 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T03:51:31.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:30 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T03:51:31.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:30 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:31.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:30 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:31.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:30 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:51:31.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:30 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:31.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:30 smithi162 ceph-mon[35071]: from='osd.9 [v2:172.21.15.46:6826/382230768,v1:172.21.15.46:6827/382230768]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-21T03:51:31.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:30 smithi162 ceph-mon[35071]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T03:51:31.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:30 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:51:31.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:30 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:51:31.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:30 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:31.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:30 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:31.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:30 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:51:31.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:30 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:51:31.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:30 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T03:51:31.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:30 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T03:51:31.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:30 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:31.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:30 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:31.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:30 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:51:31.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:30 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:31.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:31 smithi105 ceph-mon[34773]: purged_snaps scrub starts 2024-09-21T03:51:31.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:31 smithi105 ceph-mon[34773]: purged_snaps scrub ok 2024-09-21T03:51:31.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:31 smithi105 ceph-mon[34773]: Detected new or changed devices on smithi046 2024-09-21T03:51:31.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:31 smithi105 ceph-mon[34773]: Adjusting osd_memory_target on smithi046 to 4273M 2024-09-21T03:51:31.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:31 smithi105 ceph-mon[34773]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:51:31.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:31 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:51:31.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:31 smithi105 ceph-mon[34773]: osd.9 [v2:172.21.15.46:6826/382230768,v1:172.21.15.46:6827/382230768] boot 2024-09-21T03:51:31.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:31 smithi105 ceph-mon[34773]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T03:51:31.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:31 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:51:31.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:31 smithi105 ceph-mon[34773]: from='client.24512 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:31.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:31 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:51:31.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:31 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:51:31.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:31 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:32.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:31 smithi046 ceph-mon[30954]: purged_snaps scrub starts 2024-09-21T03:51:32.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:31 smithi046 ceph-mon[30954]: purged_snaps scrub ok 2024-09-21T03:51:32.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:31 smithi046 ceph-mon[30954]: Detected new or changed devices on smithi046 2024-09-21T03:51:32.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:31 smithi046 ceph-mon[30954]: Adjusting osd_memory_target on smithi046 to 4273M 2024-09-21T03:51:32.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:31 smithi046 ceph-mon[30954]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:51:32.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:31 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:51:32.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:31 smithi046 ceph-mon[30954]: osd.9 [v2:172.21.15.46:6826/382230768,v1:172.21.15.46:6827/382230768] boot 2024-09-21T03:51:32.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:31 smithi046 ceph-mon[30954]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T03:51:32.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:31 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:51:32.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:31 smithi046 ceph-mon[30954]: from='client.24512 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:32.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:31 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:51:32.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:31 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:51:32.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:31 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:32.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:31 smithi162 ceph-mon[35071]: purged_snaps scrub starts 2024-09-21T03:51:32.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:31 smithi162 ceph-mon[35071]: purged_snaps scrub ok 2024-09-21T03:51:32.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:31 smithi162 ceph-mon[35071]: Detected new or changed devices on smithi046 2024-09-21T03:51:32.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:31 smithi162 ceph-mon[35071]: Adjusting osd_memory_target on smithi046 to 4273M 2024-09-21T03:51:32.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:31 smithi162 ceph-mon[35071]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:51:32.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:31 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:51:32.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:31 smithi162 ceph-mon[35071]: osd.9 [v2:172.21.15.46:6826/382230768,v1:172.21.15.46:6827/382230768] boot 2024-09-21T03:51:32.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:31 smithi162 ceph-mon[35071]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T03:51:32.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:31 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:51:32.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:31 smithi162 ceph-mon[35071]: from='client.24512 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:32.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:31 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:51:32.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:31 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:51:32.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:31 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:33.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:32 smithi046 ceph-mon[30954]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T03:51:33.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:32 smithi046 ceph-mon[30954]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:33.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:32 smithi105 ceph-mon[34773]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T03:51:33.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:32 smithi105 ceph-mon[34773]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:33.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:32 smithi162 ceph-mon[35071]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T03:51:33.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:32 smithi162 ceph-mon[35071]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:34.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:33 smithi046 ceph-mon[30954]: from='client.? 172.21.15.105:0/940787476' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "76c3da87-f3c5-4985-87fd-647717b6af85"} : dispatch 2024-09-21T03:51:34.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:33 smithi046 ceph-mon[30954]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "76c3da87-f3c5-4985-87fd-647717b6af85"} : dispatch 2024-09-21T03:51:34.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:33 smithi046 ceph-mon[30954]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "76c3da87-f3c5-4985-87fd-647717b6af85"}]': finished 2024-09-21T03:51:34.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:33 smithi046 ceph-mon[30954]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T03:51:34.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:33 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:51:34.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:33 smithi046 ceph-mon[30954]: from='client.? 172.21.15.105:0/2929729582' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:51:34.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:33 smithi105 ceph-mon[34773]: from='client.? 172.21.15.105:0/940787476' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "76c3da87-f3c5-4985-87fd-647717b6af85"} : dispatch 2024-09-21T03:51:34.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:33 smithi105 ceph-mon[34773]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "76c3da87-f3c5-4985-87fd-647717b6af85"} : dispatch 2024-09-21T03:51:34.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:33 smithi105 ceph-mon[34773]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "76c3da87-f3c5-4985-87fd-647717b6af85"}]': finished 2024-09-21T03:51:34.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:33 smithi105 ceph-mon[34773]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T03:51:34.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:33 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:51:34.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:33 smithi105 ceph-mon[34773]: from='client.? 172.21.15.105:0/2929729582' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:51:34.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:33 smithi162 ceph-mon[35071]: from='client.? 172.21.15.105:0/940787476' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "76c3da87-f3c5-4985-87fd-647717b6af85"} : dispatch 2024-09-21T03:51:34.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:33 smithi162 ceph-mon[35071]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "76c3da87-f3c5-4985-87fd-647717b6af85"} : dispatch 2024-09-21T03:51:34.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:33 smithi162 ceph-mon[35071]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "76c3da87-f3c5-4985-87fd-647717b6af85"}]': finished 2024-09-21T03:51:34.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:33 smithi162 ceph-mon[35071]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T03:51:34.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:33 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:51:34.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:33 smithi162 ceph-mon[35071]: from='client.? 172.21.15.105:0/2929729582' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:51:35.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:34 smithi046 ceph-mon[30954]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:35.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:34 smithi105 ceph-mon[34773]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:35.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:34 smithi162 ceph-mon[35071]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:37.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:37 smithi105 ceph-mon[34773]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:37.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:37 smithi162 ceph-mon[35071]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:37.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:37 smithi046 ceph-mon[30954]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:39.122 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:39 smithi105 ceph-mon[34773]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:39.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:39 smithi162 ceph-mon[35071]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:39.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:39 smithi046 ceph-mon[30954]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:41.203 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:41 smithi105 ceph-mon[34773]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:41.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:41 smithi162 ceph-mon[35071]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:41.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:41 smithi046 ceph-mon[30954]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:42.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:42 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T03:51:42.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:42 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:42.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:42 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T03:51:42.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:42 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:42.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:42 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T03:51:42.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:42 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:43.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:43 smithi162 ceph-mon[35071]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:43.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:43 smithi162 ceph-mon[35071]: Deploying daemon osd.10 on smithi105 2024-09-21T03:51:43.437 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:43 smithi105 ceph-mon[34773]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:43.437 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:43 smithi105 ceph-mon[34773]: Deploying daemon osd.10 on smithi105 2024-09-21T03:51:43.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:43 smithi046 ceph-mon[30954]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:43.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:43 smithi046 ceph-mon[30954]: Deploying daemon osd.10 on smithi105 2024-09-21T03:51:45.303 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:45 smithi105 ceph-mon[34773]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:45.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:45 smithi162 ceph-mon[35071]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:45.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:45 smithi046 ceph-mon[30954]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:47.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:47 smithi162 ceph-mon[35071]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:47.431 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:47 smithi105 ceph-mon[34773]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:47.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:47 smithi046 ceph-mon[30954]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:48.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:48 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:51:48.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:48 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:48.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:48 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:48.442 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:48 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:51:48.442 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:48 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:48.442 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:48 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:48.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:48 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:51:48.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:48 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:48.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:48 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:49.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:49 smithi046 ceph-mon[30954]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:49.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:49 smithi162 ceph-mon[35071]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:49.384 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:49 smithi105 ceph-mon[34773]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:51.547 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:51.545+0000 7f72b17fa640 1 -- 172.21.15.105:0/738162497 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f72b4063800 con 0x7f729c0b6560 2024-09-21T03:51:51.548 INFO:teuthology.orchestra.run.smithi105.stdout:Created osd(s) 10 on host 'smithi105' 2024-09-21T03:51:51.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:51.548+0000 7f72ba5c1640 1 -- 172.21.15.105:0/738162497 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f729c0b6560 msgr2=0x7f729c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:51.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:51.548+0000 7f72ba5c1640 1 --2- 172.21.15.105:0/738162497 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f729c0b6560 0x7f729c0b8a70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f72a80058c0 tx=0x7f72a8005850 comp rx=0 tx=0).stop 2024-09-21T03:51:51.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:51.548+0000 7f72ba5c1640 1 -- 172.21.15.105:0/738162497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72b4104900 msgr2=0x7f72b419a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:51.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:51.548+0000 7f72ba5c1640 1 --2- 172.21.15.105:0/738162497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72b4104900 0x7f72b419a430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f72a400c970 tx=0x7f72a400ce30 comp rx=0 tx=0).stop 2024-09-21T03:51:51.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:51.548+0000 7f72ba5c1640 1 -- 172.21.15.105:0/738162497 shutdown_connections 2024-09-21T03:51:51.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:51.548+0000 7f72ba5c1640 1 --2- 172.21.15.105:0/738162497 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f729c0b6560 0x7f729c0b8a70 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:51.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:51.548+0000 7f72ba5c1640 1 --2- 172.21.15.105:0/738162497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72b410deb0 0x7f72b419fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:51.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:51.548+0000 7f72ba5c1640 1 --2- 172.21.15.105:0/738162497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72b4105250 0x7f72b419a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:51.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:51.548+0000 7f72ba5c1640 1 --2- 172.21.15.105:0/738162497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72b4104900 0x7f72b419a430 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:51.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:51.548+0000 7f72ba5c1640 1 -- 172.21.15.105:0/738162497 >> 172.21.15.105:0/738162497 conn(0x7f72b4079760 msgr2=0x7f72b41008c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:51.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:51.548+0000 7f72ba5c1640 1 -- 172.21.15.105:0/738162497 shutdown_connections 2024-09-21T03:51:51.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:51:51.548+0000 7f72ba5c1640 1 -- 172.21.15.105:0/738162497 wait complete. 2024-09-21T03:51:51.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:51 smithi105 ceph-mon[34773]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:51.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:51 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:51.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:51 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:51.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:51 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:51.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:51 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:51:51.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:51 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:51.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:51 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:51:51.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:51 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:51.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:51 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:52.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:51 smithi162 ceph-mon[35071]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:52.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:51 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:52.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:51 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:52.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:51 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:52.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:51 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:51:52.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:51 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:52.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:51 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:51:52.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:51 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:52.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:51 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:52.245 DEBUG:teuthology.orchestra.run.smithi105:osd.10> sudo journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.10.service 2024-09-21T03:51:52.247 INFO:tasks.cephadm:Deploying osd.11 on smithi162 with /dev/vg_nvme/lv_1... 2024-09-21T03:51:52.247 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T03:51:52.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:51 smithi046 ceph-mon[30954]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:52.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:51 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:52.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:51 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:52.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:51 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:52.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:51 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:51:52.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:51 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:52.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:51 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:51:52.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:51 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:52.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:51 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:52.506 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:51:53.918 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:53 smithi162 ceph-mon[35071]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:54.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:53 smithi105 ceph-mon[34773]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:54.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:53 smithi046 ceph-mon[30954]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:54.757 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 03:51:54 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T03:51:54.372+0000 7fb779741640 -1 osd.10 0 log_to_monitors true 2024-09-21T03:51:55.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:54 smithi105 ceph-mon[34773]: from='osd.10 [v2:172.21.15.105:6824/1664619099,v1:172.21.15.105:6825/1664619099]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T03:51:55.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:54 smithi105 ceph-mon[34773]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T03:51:55.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:54 smithi162 ceph-mon[35071]: from='osd.10 [v2:172.21.15.105:6824/1664619099,v1:172.21.15.105:6825/1664619099]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T03:51:55.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:54 smithi162 ceph-mon[35071]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T03:51:55.212 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:51:55.241 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi162:vg_nvme/lv_1 2024-09-21T03:51:55.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:54 smithi046 ceph-mon[30954]: from='osd.10 [v2:172.21.15.105:6824/1664619099,v1:172.21.15.105:6825/1664619099]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T03:51:55.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:54 smithi046 ceph-mon[30954]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T03:51:55.486 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:51:55.990 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.987+0000 7fecaa1e6640 1 -- 172.21.15.162:0/1071264850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feca41083c0 msgr2=0x7feca41087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:55.990 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.987+0000 7fecaa1e6640 1 --2- 172.21.15.162:0/1071264850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feca41083c0 0x7feca41087d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fec98009900 tx=0x7fec9802a410 comp rx=0 tx=0).stop 2024-09-21T03:51:55.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.987+0000 7fecaa1e6640 1 -- 172.21.15.162:0/1071264850 shutdown_connections 2024-09-21T03:51:55.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.987+0000 7fecaa1e6640 1 --2- 172.21.15.162:0/1071264850 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feca4108d10 0x7feca410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:55.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.987+0000 7fecaa1e6640 1 --2- 172.21.15.162:0/1071264850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feca41083c0 0x7feca41087d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:55.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.987+0000 7fecaa1e6640 1 --2- 172.21.15.162:0/1071264850 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feca4102a80 0x7feca4102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:55.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.987+0000 7fecaa1e6640 1 -- 172.21.15.162:0/1071264850 >> 172.21.15.162:0/1071264850 conn(0x7feca4079740 msgr2=0x7feca4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:55.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.987+0000 7fecaa1e6640 1 -- 172.21.15.162:0/1071264850 shutdown_connections 2024-09-21T03:51:55.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.987+0000 7fecaa1e6640 1 -- 172.21.15.162:0/1071264850 wait complete. 2024-09-21T03:51:55.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.988+0000 7fecaa1e6640 1 Processor -- start 2024-09-21T03:51:55.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.988+0000 7fecaa1e6640 1 -- start start 2024-09-21T03:51:55.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.989+0000 7fecaa1e6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feca4102a80 0x7feca419a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:55.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.989+0000 7fecaa1e6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feca41083c0 0x7feca419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:55.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.989+0000 7fecaa1e6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feca4108d10 0x7feca419fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:55.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.989+0000 7fecaa1e6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7feca4113ad0 con 0x7feca4102a80 2024-09-21T03:51:55.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.989+0000 7fecaa1e6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7feca4113950 con 0x7feca4108d10 2024-09-21T03:51:55.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.989+0000 7fecaa1e6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feca4113c50 con 0x7feca41083c0 2024-09-21T03:51:55.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.989+0000 7feca2ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feca41083c0 0x7feca419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:55.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.989+0000 7feca2ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feca41083c0 0x7feca419ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:56760/0 (socket says 172.21.15.162:56760) 2024-09-21T03:51:55.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.989+0000 7feca2ffd640 1 -- 172.21.15.162:0/1779846047 learned_addr learned my addr 172.21.15.162:0/1779846047 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T03:51:55.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.989+0000 7feca3fff640 1 --2- 172.21.15.162:0/1779846047 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feca4108d10 0x7feca419fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:55.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.989+0000 7feca37fe640 1 --2- 172.21.15.162:0/1779846047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feca4102a80 0x7feca419a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:55.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.989+0000 7feca2ffd640 1 -- 172.21.15.162:0/1779846047 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feca4108d10 msgr2=0x7feca419fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:55.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.989+0000 7feca2ffd640 1 --2- 172.21.15.162:0/1779846047 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feca4108d10 0x7feca419fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:55.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.989+0000 7feca2ffd640 1 -- 172.21.15.162:0/1779846047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feca4102a80 msgr2=0x7feca419a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:55.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.989+0000 7feca2ffd640 1 --2- 172.21.15.162:0/1779846047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feca4102a80 0x7feca419a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:55.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.989+0000 7feca2ffd640 1 -- 172.21.15.162:0/1779846047 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feca41a04f0 con 0x7feca41083c0 2024-09-21T03:51:55.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.989+0000 7feca2ffd640 1 --2- 172.21.15.162:0/1779846047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feca41083c0 0x7feca419ab20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fec98005ab0 tx=0x7fec98003cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:55.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.989+0000 7feca0ff9640 1 -- 172.21.15.162:0/1779846047 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9803f070 con 0x7feca41083c0 2024-09-21T03:51:55.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.989+0000 7fecaa1e6640 1 -- 172.21.15.162:0/1779846047 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feca41a0780 con 0x7feca41083c0 2024-09-21T03:51:55.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.989+0000 7feca0ff9640 1 -- 172.21.15.162:0/1779846047 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec98031d60 con 0x7feca41083c0 2024-09-21T03:51:55.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.989+0000 7feca0ff9640 1 -- 172.21.15.162:0/1779846047 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec98035030 con 0x7feca41083c0 2024-09-21T03:51:55.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.990+0000 7fecaa1e6640 1 -- 172.21.15.162:0/1779846047 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feca41a6f40 con 0x7feca41083c0 2024-09-21T03:51:55.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.991+0000 7fecaa1e6640 1 -- 172.21.15.162:0/1779846047 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feca4103d00 con 0x7feca41083c0 2024-09-21T03:51:55.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.992+0000 7feca0ff9640 1 -- 172.21.15.162:0/1779846047 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fec98042070 con 0x7feca41083c0 2024-09-21T03:51:55.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.993+0000 7feca0ff9640 1 --2- 172.21.15.162:0/1779846047 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fec8c0b6560 0x7fec8c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:55.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.993+0000 7feca37fe640 1 --2- 172.21.15.162:0/1779846047 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fec8c0b6560 0x7fec8c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:55.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.993+0000 7feca0ff9640 1 -- 172.21.15.162:0/1779846047 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6629+0+0 (secure 0 0 0) 0x7fec98107bd0 con 0x7feca41083c0 2024-09-21T03:51:55.997 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.994+0000 7feca37fe640 1 --2- 172.21.15.162:0/1779846047 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fec8c0b6560 0x7fec8c0b8a70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fec94005fd0 tx=0x7fec94005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:55.999 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:55.997+0000 7feca0ff9640 1 -- 172.21.15.162:0/1779846047 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fec980cead0 con 0x7feca41083c0 2024-09-21T03:51:56.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 03:51:55 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T03:51:55.811+0000 7fb7756c3640 -1 osd.10 0 waiting for initial osdmap 2024-09-21T03:51:56.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 03:51:55 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T03:51:55.826+0000 7fb7714c1640 -1 osd.10 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:51:56.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:55 smithi105 ceph-mon[34773]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:56.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:55 smithi105 ceph-mon[34773]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T03:51:56.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:55 smithi105 ceph-mon[34773]: from='osd.10 [v2:172.21.15.105:6824/1664619099,v1:172.21.15.105:6825/1664619099]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi105", "root=default"]} : dispatch 2024-09-21T03:51:56.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:55 smithi105 ceph-mon[34773]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T03:51:56.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:55 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:51:56.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:55 smithi105 ceph-mon[34773]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi105", "root=default"]} : dispatch 2024-09-21T03:51:56.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:55 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:56.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:55 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:56.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:55 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:51:56.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:55 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:51:56.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:55 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T03:51:56.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:55 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T03:51:56.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:55 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:56.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:55 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:56.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:55 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:51:56.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:55 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:55 smithi162 ceph-mon[35071]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:55 smithi162 ceph-mon[35071]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T03:51:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:55 smithi162 ceph-mon[35071]: from='osd.10 [v2:172.21.15.105:6824/1664619099,v1:172.21.15.105:6825/1664619099]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi105", "root=default"]} : dispatch 2024-09-21T03:51:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:55 smithi162 ceph-mon[35071]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T03:51:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:55 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:51:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:55 smithi162 ceph-mon[35071]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi105", "root=default"]} : dispatch 2024-09-21T03:51:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:55 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:55 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:55 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:51:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:55 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:51:56.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:55 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T03:51:56.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:55 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T03:51:56.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:55 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:56.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:55 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:56.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:55 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:51:56.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:55 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:56.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:51:56.185+0000 7fecaa1e6640 1 -- 172.21.15.162:0/1779846047 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7feca4063800 con 0x7fec8c0b6560 2024-09-21T03:51:56.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:55 smithi046 ceph-mon[30954]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:56.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:55 smithi046 ceph-mon[30954]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T03:51:56.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:55 smithi046 ceph-mon[30954]: from='osd.10 [v2:172.21.15.105:6824/1664619099,v1:172.21.15.105:6825/1664619099]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi105", "root=default"]} : dispatch 2024-09-21T03:51:56.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:55 smithi046 ceph-mon[30954]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T03:51:56.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:55 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:51:56.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:55 smithi046 ceph-mon[30954]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi105", "root=default"]} : dispatch 2024-09-21T03:51:56.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:55 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:56.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:55 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:56.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:55 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:51:56.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:55 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:51:56.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:55 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T03:51:56.253 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:55 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T03:51:56.253 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:55 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:56.253 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:55 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:56.253 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:55 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:51:56.253 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:55 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:51:57.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:56 smithi162 ceph-mon[35071]: Detected new or changed devices on smithi105 2024-09-21T03:51:57.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:56 smithi162 ceph-mon[35071]: Adjusting osd_memory_target on smithi105 to 4272M 2024-09-21T03:51:57.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:56 smithi162 ceph-mon[35071]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2024-09-21T03:51:57.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:56 smithi162 ceph-mon[35071]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T03:51:57.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:56 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:51:57.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:56 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:51:57.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:56 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:51:57.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:56 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:51:57.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:56 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:57.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:56 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:51:57.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:56 smithi046 ceph-mon[30954]: Detected new or changed devices on smithi105 2024-09-21T03:51:57.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:56 smithi046 ceph-mon[30954]: Adjusting osd_memory_target on smithi105 to 4272M 2024-09-21T03:51:57.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:56 smithi046 ceph-mon[30954]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2024-09-21T03:51:57.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:56 smithi046 ceph-mon[30954]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T03:51:57.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:56 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:51:57.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:56 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:51:57.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:56 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:51:57.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:56 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:51:57.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:56 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:57.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:56 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:51:57.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:56 smithi105 ceph-mon[34773]: Detected new or changed devices on smithi105 2024-09-21T03:51:57.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:56 smithi105 ceph-mon[34773]: Adjusting osd_memory_target on smithi105 to 4272M 2024-09-21T03:51:57.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:56 smithi105 ceph-mon[34773]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2024-09-21T03:51:57.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:56 smithi105 ceph-mon[34773]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T03:51:57.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:56 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:51:57.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:56 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:51:57.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:56 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:51:57.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:56 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:51:57.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:56 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:57.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:56 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:51:58.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:57 smithi105 ceph-mon[34773]: purged_snaps scrub starts 2024-09-21T03:51:58.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:57 smithi105 ceph-mon[34773]: purged_snaps scrub ok 2024-09-21T03:51:58.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:57 smithi105 ceph-mon[34773]: pgmap v212: 1 pgs: 1 peering; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:58.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:57 smithi105 ceph-mon[34773]: from='client.24547 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:58.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:57 smithi105 ceph-mon[34773]: osd.10 [v2:172.21.15.105:6824/1664619099,v1:172.21.15.105:6825/1664619099] boot 2024-09-21T03:51:58.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:57 smithi105 ceph-mon[34773]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T03:51:58.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:57 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:51:58.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:57 smithi105 ceph-mon[34773]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T03:51:58.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:57 smithi162 ceph-mon[35071]: purged_snaps scrub starts 2024-09-21T03:51:58.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:57 smithi162 ceph-mon[35071]: purged_snaps scrub ok 2024-09-21T03:51:58.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:57 smithi162 ceph-mon[35071]: pgmap v212: 1 pgs: 1 peering; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:58.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:57 smithi162 ceph-mon[35071]: from='client.24547 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:58.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:57 smithi162 ceph-mon[35071]: osd.10 [v2:172.21.15.105:6824/1664619099,v1:172.21.15.105:6825/1664619099] boot 2024-09-21T03:51:58.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:57 smithi162 ceph-mon[35071]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T03:51:58.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:57 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:51:58.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:57 smithi162 ceph-mon[35071]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T03:51:58.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:57 smithi046 ceph-mon[30954]: purged_snaps scrub starts 2024-09-21T03:51:58.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:57 smithi046 ceph-mon[30954]: purged_snaps scrub ok 2024-09-21T03:51:58.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:57 smithi046 ceph-mon[30954]: pgmap v212: 1 pgs: 1 peering; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:51:58.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:57 smithi046 ceph-mon[30954]: from='client.24547 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:51:58.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:57 smithi046 ceph-mon[30954]: osd.10 [v2:172.21.15.105:6824/1664619099,v1:172.21.15.105:6825/1664619099] boot 2024-09-21T03:51:58.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:57 smithi046 ceph-mon[30954]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T03:51:58.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:57 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:51:58.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:57 smithi046 ceph-mon[30954]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T03:51:59.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:59 smithi162 ceph-mon[35071]: pgmap v215: 1 pgs: 1 peering; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:51:59.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:59 smithi162 ceph-mon[35071]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T03:51:59.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:59 smithi162 ceph-mon[35071]: from='client.? 172.21.15.162:0/3624971983' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "13269da8-5f05-4ce2-9c7a-6dd9c1041cc3"} : dispatch 2024-09-21T03:51:59.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:59 smithi162 ceph-mon[35071]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "13269da8-5f05-4ce2-9c7a-6dd9c1041cc3"} : dispatch 2024-09-21T03:51:59.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:59 smithi162 ceph-mon[35071]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "13269da8-5f05-4ce2-9c7a-6dd9c1041cc3"}]': finished 2024-09-21T03:51:59.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:59 smithi162 ceph-mon[35071]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T03:51:59.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:59 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:51:59.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:51:59 smithi162 ceph-mon[35071]: from='client.? 172.21.15.162:0/4294108878' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:52:00.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:59 smithi046 ceph-mon[30954]: pgmap v215: 1 pgs: 1 peering; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:52:00.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:59 smithi046 ceph-mon[30954]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T03:52:00.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:59 smithi046 ceph-mon[30954]: from='client.? 172.21.15.162:0/3624971983' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "13269da8-5f05-4ce2-9c7a-6dd9c1041cc3"} : dispatch 2024-09-21T03:52:00.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:59 smithi046 ceph-mon[30954]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "13269da8-5f05-4ce2-9c7a-6dd9c1041cc3"} : dispatch 2024-09-21T03:52:00.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:59 smithi046 ceph-mon[30954]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "13269da8-5f05-4ce2-9c7a-6dd9c1041cc3"}]': finished 2024-09-21T03:52:00.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:59 smithi046 ceph-mon[30954]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T03:52:00.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:59 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:52:00.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:51:59 smithi046 ceph-mon[30954]: from='client.? 172.21.15.162:0/4294108878' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:52:00.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:59 smithi105 ceph-mon[34773]: pgmap v215: 1 pgs: 1 peering; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:52:00.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:59 smithi105 ceph-mon[34773]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T03:52:00.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:59 smithi105 ceph-mon[34773]: from='client.? 172.21.15.162:0/3624971983' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "13269da8-5f05-4ce2-9c7a-6dd9c1041cc3"} : dispatch 2024-09-21T03:52:00.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:59 smithi105 ceph-mon[34773]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "13269da8-5f05-4ce2-9c7a-6dd9c1041cc3"} : dispatch 2024-09-21T03:52:00.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:59 smithi105 ceph-mon[34773]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "13269da8-5f05-4ce2-9c7a-6dd9c1041cc3"}]': finished 2024-09-21T03:52:00.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:59 smithi105 ceph-mon[34773]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T03:52:00.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:59 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:52:00.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:51:59 smithi105 ceph-mon[34773]: from='client.? 172.21.15.162:0/4294108878' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:52:02.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:01 smithi046 ceph-mon[30954]: pgmap v218: 1 pgs: 1 peering; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:52:02.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:01 smithi105 ceph-mon[34773]: pgmap v218: 1 pgs: 1 peering; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:52:02.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:01 smithi162 ceph-mon[35071]: pgmap v218: 1 pgs: 1 peering; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:52:03.757 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:03 smithi162 ceph-mon[35071]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-09-21T03:52:04.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:03 smithi046 ceph-mon[30954]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-09-21T03:52:04.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:03 smithi105 ceph-mon[34773]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-09-21T03:52:05.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:05 smithi162 ceph-mon[35071]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-21T03:52:06.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:05 smithi046 ceph-mon[30954]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-21T03:52:06.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:05 smithi105 ceph-mon[34773]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-21T03:52:07.930 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:07 smithi162 ceph-mon[35071]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T03:52:07.930 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:07 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T03:52:07.930 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:07 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:08.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:07 smithi046 ceph-mon[30954]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T03:52:08.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:07 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T03:52:08.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:07 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:08.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:07 smithi105 ceph-mon[34773]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T03:52:08.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:07 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T03:52:08.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:07 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:08.936 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:08 smithi162 ceph-mon[35071]: Deploying daemon osd.11 on smithi162 2024-09-21T03:52:09.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:08 smithi046 ceph-mon[30954]: Deploying daemon osd.11 on smithi162 2024-09-21T03:52:09.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:08 smithi105 ceph-mon[34773]: Deploying daemon osd.11 on smithi162 2024-09-21T03:52:09.958 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:09 smithi162 ceph-mon[35071]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T03:52:10.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:09 smithi046 ceph-mon[30954]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T03:52:10.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:09 smithi105 ceph-mon[34773]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T03:52:12.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:11 smithi046 ceph-mon[30954]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T03:52:12.001 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:11 smithi162 ceph-mon[35071]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T03:52:12.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:11 smithi105 ceph-mon[34773]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T03:52:14.000 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:13 smithi162 ceph-mon[35071]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:52:14.000 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:13 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:52:14.000 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:13 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:14.000 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:13 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:14.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:13 smithi046 ceph-mon[30954]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:52:14.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:13 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:52:14.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:13 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:14.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:13 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:14.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:13 smithi105 ceph-mon[34773]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:52:14.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:13 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:52:14.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:13 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:14.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:13 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:15.945 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:15 smithi162 ceph-mon[35071]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:52:16.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:15 smithi046 ceph-mon[30954]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:52:16.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:15 smithi105 ceph-mon[34773]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:52:16.986 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 11 on host 'smithi162' 2024-09-21T03:52:16.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:16.983+0000 7feca0ff9640 1 -- 172.21.15.162:0/1779846047 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7feca4063800 con 0x7fec8c0b6560 2024-09-21T03:52:16.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:16.986+0000 7fecaa1e6640 1 -- 172.21.15.162:0/1779846047 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fec8c0b6560 msgr2=0x7fec8c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:16.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:16.986+0000 7fecaa1e6640 1 --2- 172.21.15.162:0/1779846047 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fec8c0b6560 0x7fec8c0b8a70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fec94005fd0 tx=0x7fec94005850 comp rx=0 tx=0).stop 2024-09-21T03:52:16.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:16.986+0000 7fecaa1e6640 1 -- 172.21.15.162:0/1779846047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feca41083c0 msgr2=0x7feca419ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:16.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:16.986+0000 7fecaa1e6640 1 --2- 172.21.15.162:0/1779846047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feca41083c0 0x7feca419ab20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fec98005ab0 tx=0x7fec98003cd0 comp rx=0 tx=0).stop 2024-09-21T03:52:16.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:16.986+0000 7fecaa1e6640 1 -- 172.21.15.162:0/1779846047 shutdown_connections 2024-09-21T03:52:16.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:16.986+0000 7fecaa1e6640 1 --2- 172.21.15.162:0/1779846047 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feca4108d10 0x7feca419fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:16.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:16.986+0000 7fecaa1e6640 1 --2- 172.21.15.162:0/1779846047 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fec8c0b6560 0x7fec8c0b8a70 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:16.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:16.986+0000 7fecaa1e6640 1 --2- 172.21.15.162:0/1779846047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feca41083c0 0x7feca419ab20 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:16.989 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:16.986+0000 7fecaa1e6640 1 --2- 172.21.15.162:0/1779846047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feca4102a80 0x7feca419a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:16.989 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:16.986+0000 7fecaa1e6640 1 -- 172.21.15.162:0/1779846047 >> 172.21.15.162:0/1779846047 conn(0x7feca4079740 msgr2=0x7feca4104530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:16.989 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:16.986+0000 7fecaa1e6640 1 -- 172.21.15.162:0/1779846047 shutdown_connections 2024-09-21T03:52:16.989 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:16.986+0000 7fecaa1e6640 1 -- 172.21.15.162:0/1779846047 wait complete. 2024-09-21T03:52:17.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:17 smithi162 ceph-mon[35071]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:52:17.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:17 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:17.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:17 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:17.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:17 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:17.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:17 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:52:17.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:17 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:17.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:17 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:52:17.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:17 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:17.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:17 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:17.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:17 smithi046 ceph-mon[30954]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:52:17.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:17 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:17.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:17 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:17.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:17 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:17.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:17 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:52:17.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:17 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:17.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:17 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:52:17.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:17 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:17.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:17 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:17.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:17 smithi105 ceph-mon[34773]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:52:17.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:17 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:17.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:17 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:17.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:17 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:17.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:17 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:52:17.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:17 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:17.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:17 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:52:17.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:17 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:17.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:17 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:17.720 DEBUG:teuthology.orchestra.run.smithi162:osd.11> sudo journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.11.service 2024-09-21T03:52:17.722 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-21T03:52:17.722 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T03:52:18.016 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:52:18.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.519+0000 7f81eb6cf640 1 -- 172.21.15.46:0/2188412141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81e4105380 msgr2=0x7f81e410d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:18.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.519+0000 7f81eb6cf640 1 --2- 172.21.15.46:0/2188412141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81e4105380 0x7f81e410d8d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f81d4009900 tx=0x7f81d402a3f0 comp rx=0 tx=0).stop 2024-09-21T03:52:18.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.519+0000 7f81eb6cf640 1 -- 172.21.15.46:0/2188412141 shutdown_connections 2024-09-21T03:52:18.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.519+0000 7f81eb6cf640 1 --2- 172.21.15.46:0/2188412141 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81e410de60 0x7f81e4110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:18.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.519+0000 7f81eb6cf640 1 --2- 172.21.15.46:0/2188412141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81e4105380 0x7f81e410d8d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:18.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.519+0000 7f81eb6cf640 1 --2- 172.21.15.46:0/2188412141 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81e4104a30 0x7f81e4104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:18.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.519+0000 7f81eb6cf640 1 -- 172.21.15.46:0/2188412141 >> 172.21.15.46:0/2188412141 conn(0x7f81e40797b0 msgr2=0x7f81e4079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:18.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.520+0000 7f81eb6cf640 1 -- 172.21.15.46:0/2188412141 shutdown_connections 2024-09-21T03:52:18.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.520+0000 7f81eb6cf640 1 -- 172.21.15.46:0/2188412141 wait complete. 2024-09-21T03:52:18.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.520+0000 7f81eb6cf640 1 Processor -- start 2024-09-21T03:52:18.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.520+0000 7f81eb6cf640 1 -- start start 2024-09-21T03:52:18.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.520+0000 7f81eb6cf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81e4104a30 0x7f81e419c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:18.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.521+0000 7f81eb6cf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81e4105380 0x7f81e419cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:18.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.521+0000 7f81eb6cf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81e410de60 0x7f81e41a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:18.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.521+0000 7f81eb6cf640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f81e4113aa0 con 0x7f81e410de60 2024-09-21T03:52:18.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.521+0000 7f81eb6cf640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f81e4113920 con 0x7f81e4105380 2024-09-21T03:52:18.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.521+0000 7f81eb6cf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f81e4113c20 con 0x7f81e4104a30 2024-09-21T03:52:18.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.521+0000 7f81e9c6c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81e410de60 0x7f81e41a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:18.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.521+0000 7f81e946b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81e4104a30 0x7f81e419c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:18.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.521+0000 7f81e9c6c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81e410de60 0x7f81e41a1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46386/0 (socket says 172.21.15.46:46386) 2024-09-21T03:52:18.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.521+0000 7f81e9c6c640 1 -- 172.21.15.46:0/777809034 learned_addr learned my addr 172.21.15.46:0/777809034 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:52:18.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.521+0000 7f81e8c6a640 1 --2- 172.21.15.46:0/777809034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81e4105380 0x7f81e419cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:18.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.521+0000 7f81e9c6c640 1 -- 172.21.15.46:0/777809034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81e4104a30 msgr2=0x7f81e419c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:18.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.521+0000 7f81e9c6c640 1 --2- 172.21.15.46:0/777809034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81e4104a30 0x7f81e419c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:18.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.521+0000 7f81e9c6c640 1 -- 172.21.15.46:0/777809034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81e4105380 msgr2=0x7f81e419cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:18.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.521+0000 7f81e9c6c640 1 --2- 172.21.15.46:0/777809034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81e4105380 0x7f81e419cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:18.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.521+0000 7f81e9c6c640 1 -- 172.21.15.46:0/777809034 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81e41a24e0 con 0x7f81e410de60 2024-09-21T03:52:18.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.521+0000 7f81e946b640 1 --2- 172.21.15.46:0/777809034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81e4104a30 0x7f81e419c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:52:18.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.521+0000 7f81e9c6c640 1 --2- 172.21.15.46:0/777809034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81e410de60 0x7f81e41a1e70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f81dc00cce0 tx=0x7f81dc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:18.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.522+0000 7f81da7fc640 1 -- 172.21.15.46:0/777809034 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc00f450 con 0x7f81e410de60 2024-09-21T03:52:18.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.522+0000 7f81eb6cf640 1 -- 172.21.15.46:0/777809034 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81e41a27d0 con 0x7f81e410de60 2024-09-21T03:52:18.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.522+0000 7f81da7fc640 1 -- 172.21.15.46:0/777809034 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81dc00faa0 con 0x7f81e410de60 2024-09-21T03:52:18.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.522+0000 7f81da7fc640 1 -- 172.21.15.46:0/777809034 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc018a80 con 0x7f81e410de60 2024-09-21T03:52:18.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.522+0000 7f81eb6cf640 1 -- 172.21.15.46:0/777809034 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81e41a8ff0 con 0x7f81e410de60 2024-09-21T03:52:18.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.523+0000 7f81eb6cf640 1 -- 172.21.15.46:0/777809034 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81e4104e40 con 0x7f81e410de60 2024-09-21T03:52:18.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.524+0000 7f81da7fc640 1 -- 172.21.15.46:0/777809034 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f81dc00fc50 con 0x7f81e410de60 2024-09-21T03:52:18.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.525+0000 7f81da7fc640 1 --2- 172.21.15.46:0/777809034 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f81d00b6590 0x7f81d00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:18.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.526+0000 7f81e946b640 1 --2- 172.21.15.46:0/777809034 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f81d00b6590 0x7f81d00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:18.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.526+0000 7f81da7fc640 1 -- 172.21.15.46:0/777809034 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 7024+0+0 (secure 0 0 0) 0x7f81dc0e7290 con 0x7f81e410de60 2024-09-21T03:52:18.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.526+0000 7f81e946b640 1 --2- 172.21.15.46:0/777809034 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f81d00b6590 0x7f81d00b8aa0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f81e000afb0 tx=0x7f81e000a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:18.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.530+0000 7f81da7fc640 1 -- 172.21.15.46:0/777809034 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f81dc014030 con 0x7f81e410de60 2024-09-21T03:52:18.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.721+0000 7f81eb6cf640 1 -- 172.21.15.46:0/777809034 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f81e41a91c0 con 0x7f81e410de60 2024-09-21T03:52:18.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.722+0000 7f81da7fc640 1 -- 172.21.15.46:0/777809034 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v66) ==== 74+0+133 (secure 0 0 0) 0x7f81dc0adfb0 con 0x7f81e410de60 2024-09-21T03:52:18.725 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:52:18.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.724+0000 7f81eb6cf640 1 -- 172.21.15.46:0/777809034 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f81d00b6590 msgr2=0x7f81d00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:18.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.724+0000 7f81eb6cf640 1 --2- 172.21.15.46:0/777809034 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f81d00b6590 0x7f81d00b8aa0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f81e000afb0 tx=0x7f81e000a2d0 comp rx=0 tx=0).stop 2024-09-21T03:52:18.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.724+0000 7f81eb6cf640 1 -- 172.21.15.46:0/777809034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81e410de60 msgr2=0x7f81e41a1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:18.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.724+0000 7f81eb6cf640 1 --2- 172.21.15.46:0/777809034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81e410de60 0x7f81e41a1e70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f81dc00cce0 tx=0x7f81dc00a620 comp rx=0 tx=0).stop 2024-09-21T03:52:18.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.724+0000 7f81eb6cf640 1 -- 172.21.15.46:0/777809034 shutdown_connections 2024-09-21T03:52:18.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.724+0000 7f81eb6cf640 1 --2- 172.21.15.46:0/777809034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81e410de60 0x7f81e41a1e70 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:18.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.724+0000 7f81eb6cf640 1 --2- 172.21.15.46:0/777809034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81e4105380 0x7f81e419cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:18.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.724+0000 7f81eb6cf640 1 --2- 172.21.15.46:0/777809034 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f81d00b6590 0x7f81d00b8aa0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:18.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.724+0000 7f81eb6cf640 1 --2- 172.21.15.46:0/777809034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81e4104a30 0x7f81e419c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:18.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.724+0000 7f81eb6cf640 1 -- 172.21.15.46:0/777809034 >> 172.21.15.46:0/777809034 conn(0x7f81e40797b0 msgr2=0x7f81e4100580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:18.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.725+0000 7f81eb6cf640 1 -- 172.21.15.46:0/777809034 shutdown_connections 2024-09-21T03:52:18.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:18.725+0000 7f81eb6cf640 1 -- 172.21.15.46:0/777809034 wait complete. 2024-09-21T03:52:19.405 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:19 smithi162 ceph-mon[35071]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:52:19.406 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:19 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/777809034' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:52:19.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:19 smithi046 ceph-mon[30954]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:52:19.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:19 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/777809034' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:52:19.561 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":66,"num_osds":12,"num_up_osds":11,"osd_up_since":1726890716,"num_in_osds":12,"osd_in_since":1726890718,"num_remapped_pgs":0} 2024-09-21T03:52:19.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:19 smithi105 ceph-mon[34773]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:52:19.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:19 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/777809034' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:52:19.865 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 03:52:19 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T03:52:19.403+0000 7f7443ce4640 -1 osd.11 0 log_to_monitors true 2024-09-21T03:52:20.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:20 smithi046 ceph-mon[30954]: from='osd.11 [v2:172.21.15.162:6824/1014820476,v1:172.21.15.162:6825/1014820476]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T03:52:20.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:20 smithi046 ceph-mon[30954]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T03:52:20.518 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:20 smithi162 ceph-mon[35071]: from='osd.11 [v2:172.21.15.162:6824/1014820476,v1:172.21.15.162:6825/1014820476]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T03:52:20.519 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:20 smithi162 ceph-mon[35071]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T03:52:20.562 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T03:52:20.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:20 smithi105 ceph-mon[34773]: from='osd.11 [v2:172.21.15.162:6824/1014820476,v1:172.21.15.162:6825/1014820476]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T03:52:20.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:20 smithi105 ceph-mon[34773]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T03:52:20.837 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:52:21.228 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:21 smithi046 ceph-mon[30954]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:52:21.228 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:21 smithi046 ceph-mon[30954]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T03:52:21.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:21 smithi046 ceph-mon[30954]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T03:52:21.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:21 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:52:21.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:21 smithi046 ceph-mon[30954]: from='osd.11 [v2:172.21.15.162:6824/1014820476,v1:172.21.15.162:6825/1014820476]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T03:52:21.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:21 smithi046 ceph-mon[30954]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T03:52:21.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:21 smithi046 ceph-mon[30954]: Detected new or changed devices on smithi162 2024-09-21T03:52:21.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:21 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:21.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:21 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:21.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:21 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:52:21.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:21 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:52:21.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:21 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T03:52:21.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:21 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T03:52:21.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:21 smithi046 ceph-mon[30954]: Adjusting osd_memory_target on smithi162 to 4272M 2024-09-21T03:52:21.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:21 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:21.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:21 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:21.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:21 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:52:21.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:21 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:21.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.319+0000 7f4b96235640 1 -- 172.21.15.46:0/1625889351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b90103b60 msgr2=0x7f4b90103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:21.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.319+0000 7f4b96235640 1 --2- 172.21.15.46:0/1625889351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b90103b60 0x7f4b90103f70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009900 tx=0x7f4b8002a410 comp rx=0 tx=0).stop 2024-09-21T03:52:21.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.319+0000 7f4b96235640 1 -- 172.21.15.46:0/1625889351 shutdown_connections 2024-09-21T03:52:21.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.319+0000 7f4b96235640 1 --2- 172.21.15.46:0/1625889351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b90109df0 0x7f4b90110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:21.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.319+0000 7f4b96235640 1 --2- 172.21.15.46:0/1625889351 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b901094a0 0x7f4b901098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:21.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.319+0000 7f4b96235640 1 --2- 172.21.15.46:0/1625889351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b90103b60 0x7f4b90103f70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:21.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.319+0000 7f4b96235640 1 -- 172.21.15.46:0/1625889351 >> 172.21.15.46:0/1625889351 conn(0x7f4b9007b850 msgr2=0x7f4b9007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:21.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.320+0000 7f4b96235640 1 -- 172.21.15.46:0/1625889351 shutdown_connections 2024-09-21T03:52:21.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.320+0000 7f4b96235640 1 -- 172.21.15.46:0/1625889351 wait complete. 2024-09-21T03:52:21.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.320+0000 7f4b96235640 1 Processor -- start 2024-09-21T03:52:21.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.320+0000 7f4b96235640 1 -- start start 2024-09-21T03:52:21.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.321+0000 7f4b96235640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b90103b60 0x7f4b9019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:21.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.321+0000 7f4b96235640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b901094a0 0x7f4b9019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:21.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.321+0000 7f4b96235640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b90109df0 0x7f4b9019fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:21.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.321+0000 7f4b96235640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4b90113b10 con 0x7f4b90103b60 2024-09-21T03:52:21.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.321+0000 7f4b96235640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4b90113990 con 0x7f4b901094a0 2024-09-21T03:52:21.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.321+0000 7f4b96235640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4b90113c90 con 0x7f4b90109df0 2024-09-21T03:52:21.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.321+0000 7f4b8f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b90103b60 0x7f4b9019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:21.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.321+0000 7f4b8f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b90103b60 0x7f4b9019a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46408/0 (socket says 172.21.15.46:46408) 2024-09-21T03:52:21.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.321+0000 7f4b8f7fe640 1 -- 172.21.15.46:0/2920095121 learned_addr learned my addr 172.21.15.46:0/2920095121 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:52:21.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.321+0000 7f4b8ffff640 1 --2- 172.21.15.46:0/2920095121 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b90109df0 0x7f4b9019fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:21.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.321+0000 7f4b8effd640 1 --2- 172.21.15.46:0/2920095121 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b901094a0 0x7f4b9019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:21.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.321+0000 7f4b8f7fe640 1 -- 172.21.15.46:0/2920095121 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b90109df0 msgr2=0x7f4b9019fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:21.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.321+0000 7f4b8f7fe640 1 --2- 172.21.15.46:0/2920095121 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b90109df0 0x7f4b9019fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:21.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.321+0000 7f4b8f7fe640 1 -- 172.21.15.46:0/2920095121 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b901094a0 msgr2=0x7f4b9019ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:21.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.321+0000 7f4b8f7fe640 1 --2- 172.21.15.46:0/2920095121 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b901094a0 0x7f4b9019ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:21.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.321+0000 7f4b8f7fe640 1 -- 172.21.15.46:0/2920095121 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b901a0550 con 0x7f4b90103b60 2024-09-21T03:52:21.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.321+0000 7f4b8effd640 1 --2- 172.21.15.46:0/2920095121 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b901094a0 0x7f4b9019ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:52:21.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.321+0000 7f4b8f7fe640 1 --2- 172.21.15.46:0/2920095121 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b90103b60 0x7f4b9019a5e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4b80005940 tx=0x7f4b800042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:21.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.322+0000 7f4b8cff9640 1 -- 172.21.15.46:0/2920095121 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8003f030 con 0x7f4b90103b60 2024-09-21T03:52:21.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.322+0000 7f4b96235640 1 -- 172.21.15.46:0/2920095121 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b901a07e0 con 0x7f4b90103b60 2024-09-21T03:52:21.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.322+0000 7f4b8cff9640 1 -- 172.21.15.46:0/2920095121 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b80005d10 con 0x7f4b90103b60 2024-09-21T03:52:21.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.322+0000 7f4b8cff9640 1 -- 172.21.15.46:0/2920095121 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b80035070 con 0x7f4b90103b60 2024-09-21T03:52:21.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.322+0000 7f4b96235640 1 -- 172.21.15.46:0/2920095121 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b901a6fa0 con 0x7f4b90103b60 2024-09-21T03:52:21.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.323+0000 7f4b96235640 1 -- 172.21.15.46:0/2920095121 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b90104de0 con 0x7f4b90103b60 2024-09-21T03:52:21.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.324+0000 7f4b8cff9640 1 -- 172.21.15.46:0/2920095121 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f4b80042030 con 0x7f4b90103b60 2024-09-21T03:52:21.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.325+0000 7f4b8cff9640 1 --2- 172.21.15.46:0/2920095121 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4b780b6560 0x7f4b780b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:21.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.325+0000 7f4b8effd640 1 --2- 172.21.15.46:0/2920095121 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4b780b6560 0x7f4b780b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:21.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.325+0000 7f4b8cff9640 1 -- 172.21.15.46:0/2920095121 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7062+0+0 (secure 0 0 0) 0x7f4b801073c0 con 0x7f4b90103b60 2024-09-21T03:52:21.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.325+0000 7f4b8effd640 1 --2- 172.21.15.46:0/2920095121 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4b780b6560 0x7f4b780b8a70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4b90109200 tx=0x7f4b84008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:21.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.330+0000 7f4b8cff9640 1 -- 172.21.15.46:0/2920095121 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4b800ce130 con 0x7f4b90103b60 2024-09-21T03:52:21.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.521+0000 7f4b96235640 1 -- 172.21.15.46:0/2920095121 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f4b9010bbf0 con 0x7f4b90103b60 2024-09-21T03:52:21.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.521+0000 7f4b8cff9640 1 -- 172.21.15.46:0/2920095121 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) ==== 74+0+133 (secure 0 0 0) 0x7f4b800d2510 con 0x7f4b90103b60 2024-09-21T03:52:21.524 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:52:21.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.523+0000 7f4b96235640 1 -- 172.21.15.46:0/2920095121 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4b780b6560 msgr2=0x7f4b780b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:21.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.523+0000 7f4b96235640 1 --2- 172.21.15.46:0/2920095121 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4b780b6560 0x7f4b780b8a70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4b90109200 tx=0x7f4b84008040 comp rx=0 tx=0).stop 2024-09-21T03:52:21.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.523+0000 7f4b96235640 1 -- 172.21.15.46:0/2920095121 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b90103b60 msgr2=0x7f4b9019a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:21.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.523+0000 7f4b96235640 1 --2- 172.21.15.46:0/2920095121 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b90103b60 0x7f4b9019a5e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4b80005940 tx=0x7f4b800042f0 comp rx=0 tx=0).stop 2024-09-21T03:52:21.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.524+0000 7f4b96235640 1 -- 172.21.15.46:0/2920095121 shutdown_connections 2024-09-21T03:52:21.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.524+0000 7f4b96235640 1 --2- 172.21.15.46:0/2920095121 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4b780b6560 0x7f4b780b8a70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:21.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.524+0000 7f4b96235640 1 --2- 172.21.15.46:0/2920095121 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b90109df0 0x7f4b9019fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:21.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.524+0000 7f4b96235640 1 --2- 172.21.15.46:0/2920095121 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b901094a0 0x7f4b9019ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:21.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.524+0000 7f4b96235640 1 --2- 172.21.15.46:0/2920095121 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b90103b60 0x7f4b9019a5e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:21.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.524+0000 7f4b96235640 1 -- 172.21.15.46:0/2920095121 >> 172.21.15.46:0/2920095121 conn(0x7f4b9007b850 msgr2=0x7f4b90107640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:21.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.524+0000 7f4b96235640 1 -- 172.21.15.46:0/2920095121 shutdown_connections 2024-09-21T03:52:21.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:21.524+0000 7f4b96235640 1 -- 172.21.15.46:0/2920095121 wait complete. 2024-09-21T03:52:21.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:21 smithi105 ceph-mon[34773]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:52:21.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:21 smithi105 ceph-mon[34773]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T03:52:21.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:21 smithi105 ceph-mon[34773]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T03:52:21.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:21 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:52:21.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:21 smithi105 ceph-mon[34773]: from='osd.11 [v2:172.21.15.162:6824/1014820476,v1:172.21.15.162:6825/1014820476]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T03:52:21.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:21 smithi105 ceph-mon[34773]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T03:52:21.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:21 smithi105 ceph-mon[34773]: Detected new or changed devices on smithi162 2024-09-21T03:52:21.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:21 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:21.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:21 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:21.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:21 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:52:21.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:21 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:52:21.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:21 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T03:52:21.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:21 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T03:52:21.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:21 smithi105 ceph-mon[34773]: Adjusting osd_memory_target on smithi162 to 4272M 2024-09-21T03:52:21.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:21 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:21.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:21 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:21.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:21 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:52:21.570 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:21 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:21.609 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:21 smithi162 ceph-mon[35071]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:52:21.610 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:21 smithi162 ceph-mon[35071]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T03:52:21.610 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:21 smithi162 ceph-mon[35071]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T03:52:21.610 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:21 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:52:21.610 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:21 smithi162 ceph-mon[35071]: from='osd.11 [v2:172.21.15.162:6824/1014820476,v1:172.21.15.162:6825/1014820476]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T03:52:21.610 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:21 smithi162 ceph-mon[35071]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]} : dispatch 2024-09-21T03:52:21.610 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:21 smithi162 ceph-mon[35071]: Detected new or changed devices on smithi162 2024-09-21T03:52:21.610 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:21 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:21.610 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:21 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:21.610 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:21 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:52:21.610 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:21 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:52:21.610 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:21 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T03:52:21.611 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:21 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T03:52:21.611 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:21 smithi162 ceph-mon[35071]: Adjusting osd_memory_target on smithi162 to 4272M 2024-09-21T03:52:21.611 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:21 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:21.611 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:21 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:21.611 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:21 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:52:21.611 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:21 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:21.875 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 03:52:21 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T03:52:21.606+0000 7f743fc66640 -1 osd.11 0 waiting for initial osdmap 2024-09-21T03:52:21.875 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 03:52:21 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T03:52:21.619+0000 7f7437a5c640 -1 osd.11 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:52:22.242 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:22 smithi046 ceph-mon[30954]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T03:52:22.243 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:22 smithi046 ceph-mon[30954]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T03:52:22.243 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:22 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:52:22.243 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:22 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:52:22.243 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:22 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/2920095121' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:52:22.243 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:22 smithi046 ceph-mon[30954]: from='osd.11 ' entity='osd.11' 2024-09-21T03:52:22.272 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":68,"num_osds":12,"num_up_osds":11,"osd_up_since":1726890716,"num_in_osds":12,"osd_in_since":1726890718,"num_remapped_pgs":0} 2024-09-21T03:52:22.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:22 smithi105 ceph-mon[34773]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T03:52:22.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:22 smithi105 ceph-mon[34773]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T03:52:22.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:22 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:52:22.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:22 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:52:22.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:22 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/2920095121' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:52:22.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:22 smithi105 ceph-mon[34773]: from='osd.11 ' entity='osd.11' 2024-09-21T03:52:22.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:22 smithi162 ceph-mon[35071]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-21T03:52:22.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:22 smithi162 ceph-mon[35071]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T03:52:22.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:22 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:52:22.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:22 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:52:22.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:22 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/2920095121' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:52:22.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:22 smithi162 ceph-mon[35071]: from='osd.11 ' entity='osd.11' 2024-09-21T03:52:23.273 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T03:52:23.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:23 smithi046 ceph-mon[30954]: purged_snaps scrub starts 2024-09-21T03:52:23.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:23 smithi046 ceph-mon[30954]: purged_snaps scrub ok 2024-09-21T03:52:23.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:23 smithi046 ceph-mon[30954]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:52:23.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:23 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:52:23.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:23 smithi046 ceph-mon[30954]: osd.11 [v2:172.21.15.162:6824/1014820476,v1:172.21.15.162:6825/1014820476] boot 2024-09-21T03:52:23.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:23 smithi046 ceph-mon[30954]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T03:52:23.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:23 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:52:23.541 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:52:23.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:23 smithi105 ceph-mon[34773]: purged_snaps scrub starts 2024-09-21T03:52:23.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:23 smithi105 ceph-mon[34773]: purged_snaps scrub ok 2024-09-21T03:52:23.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:23 smithi105 ceph-mon[34773]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:52:23.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:23 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:52:23.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:23 smithi105 ceph-mon[34773]: osd.11 [v2:172.21.15.162:6824/1014820476,v1:172.21.15.162:6825/1014820476] boot 2024-09-21T03:52:23.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:23 smithi105 ceph-mon[34773]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T03:52:23.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:23 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:52:23.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:23 smithi162 ceph-mon[35071]: purged_snaps scrub starts 2024-09-21T03:52:23.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:23 smithi162 ceph-mon[35071]: purged_snaps scrub ok 2024-09-21T03:52:23.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:23 smithi162 ceph-mon[35071]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:52:23.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:23 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:52:23.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:23 smithi162 ceph-mon[35071]: osd.11 [v2:172.21.15.162:6824/1014820476,v1:172.21.15.162:6825/1014820476] boot 2024-09-21T03:52:23.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:23 smithi162 ceph-mon[35071]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T03:52:23.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:23 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:52:24.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.002+0000 7feee965d640 1 -- 172.21.15.46:0/4007618635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feee4103b60 msgr2=0x7feee4103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:24.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.002+0000 7feee965d640 1 --2- 172.21.15.46:0/4007618635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feee4103b60 0x7feee4103f70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7feed4009900 tx=0x7feed402a410 comp rx=0 tx=0).stop 2024-09-21T03:52:24.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.002+0000 7feee965d640 1 -- 172.21.15.46:0/4007618635 shutdown_connections 2024-09-21T03:52:24.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.002+0000 7feee965d640 1 --2- 172.21.15.46:0/4007618635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feee4109df0 0x7feee4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:24.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.002+0000 7feee965d640 1 --2- 172.21.15.46:0/4007618635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feee41094a0 0x7feee41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:24.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.002+0000 7feee965d640 1 --2- 172.21.15.46:0/4007618635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feee4103b60 0x7feee4103f70 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:24.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.002+0000 7feee965d640 1 -- 172.21.15.46:0/4007618635 >> 172.21.15.46:0/4007618635 conn(0x7feee407b850 msgr2=0x7feee407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:24.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.002+0000 7feee965d640 1 -- 172.21.15.46:0/4007618635 shutdown_connections 2024-09-21T03:52:24.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.002+0000 7feee965d640 1 -- 172.21.15.46:0/4007618635 wait complete. 2024-09-21T03:52:24.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.003+0000 7feee965d640 1 Processor -- start 2024-09-21T03:52:24.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.003+0000 7feee965d640 1 -- start start 2024-09-21T03:52:24.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.003+0000 7feee965d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feee4103b60 0x7feee419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:24.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.003+0000 7feee965d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feee41094a0 0x7feee419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:24.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.003+0000 7feee965d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feee4109df0 0x7feee419fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:24.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.003+0000 7feee965d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7feee4113ab0 con 0x7feee4103b60 2024-09-21T03:52:24.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.003+0000 7feee965d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7feee4113930 con 0x7feee4109df0 2024-09-21T03:52:24.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.003+0000 7feee965d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feee4113c30 con 0x7feee41094a0 2024-09-21T03:52:24.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.003+0000 7feee2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feee4103b60 0x7feee419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:24.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.003+0000 7feee2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feee4103b60 0x7feee419a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33568/0 (socket says 172.21.15.46:33568) 2024-09-21T03:52:24.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.003+0000 7feee2ffd640 1 -- 172.21.15.46:0/1909438724 learned_addr learned my addr 172.21.15.46:0/1909438724 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:52:24.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.004+0000 7feee27fc640 1 --2- 172.21.15.46:0/1909438724 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feee41094a0 0x7feee419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:24.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.004+0000 7feee37fe640 1 --2- 172.21.15.46:0/1909438724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feee4109df0 0x7feee419fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:24.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.004+0000 7feee2ffd640 1 -- 172.21.15.46:0/1909438724 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feee41094a0 msgr2=0x7feee419aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:24.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.004+0000 7feee2ffd640 1 --2- 172.21.15.46:0/1909438724 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feee41094a0 0x7feee419aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:24.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.004+0000 7feee2ffd640 1 -- 172.21.15.46:0/1909438724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feee4109df0 msgr2=0x7feee419fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:24.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.004+0000 7feee2ffd640 1 --2- 172.21.15.46:0/1909438724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feee4109df0 0x7feee419fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:24.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.004+0000 7feee2ffd640 1 -- 172.21.15.46:0/1909438724 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee41a03d0 con 0x7feee4103b60 2024-09-21T03:52:24.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.004+0000 7feee2ffd640 1 --2- 172.21.15.46:0/1909438724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feee4103b60 0x7feee419a460 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7feed4005940 tx=0x7feed40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:24.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.004+0000 7feecbfff640 1 -- 172.21.15.46:0/1909438724 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed403f030 con 0x7feee4103b60 2024-09-21T03:52:24.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.004+0000 7feee965d640 1 -- 172.21.15.46:0/1909438724 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feee41a0660 con 0x7feee4103b60 2024-09-21T03:52:24.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.004+0000 7feecbfff640 1 -- 172.21.15.46:0/1909438724 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feed4003cb0 con 0x7feee4103b60 2024-09-21T03:52:24.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.004+0000 7feecbfff640 1 -- 172.21.15.46:0/1909438724 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed4035070 con 0x7feee4103b60 2024-09-21T03:52:24.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.004+0000 7feee965d640 1 -- 172.21.15.46:0/1909438724 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feee41a6e20 con 0x7feee4103b60 2024-09-21T03:52:24.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.005+0000 7feee965d640 1 -- 172.21.15.46:0/1909438724 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feee4103f70 con 0x7feee4103b60 2024-09-21T03:52:24.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.007+0000 7feecbfff640 1 -- 172.21.15.46:0/1909438724 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7feed4042030 con 0x7feee4103b60 2024-09-21T03:52:24.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.008+0000 7feecbfff640 1 --2- 172.21.15.46:0/1909438724 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7feecc0b6560 0x7feecc0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:24.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.008+0000 7feee27fc640 1 --2- 172.21.15.46:0/1909438724 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7feecc0b6560 0x7feecc0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:24.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.008+0000 7feecbfff640 1 -- 172.21.15.46:0/1909438724 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7feed4107b60 con 0x7feee4103b60 2024-09-21T03:52:24.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.008+0000 7feee27fc640 1 --2- 172.21.15.46:0/1909438724 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7feecc0b6560 0x7feecc0b8a70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7feed8005fd0 tx=0x7feed8005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:24.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.012+0000 7feecbfff640 1 -- 172.21.15.46:0/1909438724 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feed40ce7c0 con 0x7feee4103b60 2024-09-21T03:52:24.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.202+0000 7feee965d640 1 -- 172.21.15.46:0/1909438724 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7feee410bc20 con 0x7feee4103b60 2024-09-21T03:52:24.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.202+0000 7feecbfff640 1 -- 172.21.15.46:0/1909438724 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v70) ==== 74+0+133 (secure 0 0 0) 0x7feed40d2ba0 con 0x7feee4103b60 2024-09-21T03:52:24.205 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:52:24.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.205+0000 7feee965d640 1 -- 172.21.15.46:0/1909438724 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7feecc0b6560 msgr2=0x7feecc0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:24.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.205+0000 7feee965d640 1 --2- 172.21.15.46:0/1909438724 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7feecc0b6560 0x7feecc0b8a70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7feed8005fd0 tx=0x7feed8005850 comp rx=0 tx=0).stop 2024-09-21T03:52:24.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.205+0000 7feee965d640 1 -- 172.21.15.46:0/1909438724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feee4103b60 msgr2=0x7feee419a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:24.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.205+0000 7feee965d640 1 --2- 172.21.15.46:0/1909438724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feee4103b60 0x7feee419a460 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7feed4005940 tx=0x7feed40042f0 comp rx=0 tx=0).stop 2024-09-21T03:52:24.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.205+0000 7feee965d640 1 -- 172.21.15.46:0/1909438724 shutdown_connections 2024-09-21T03:52:24.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.205+0000 7feee965d640 1 --2- 172.21.15.46:0/1909438724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feee4109df0 0x7feee419fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:24.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.205+0000 7feee965d640 1 --2- 172.21.15.46:0/1909438724 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7feecc0b6560 0x7feecc0b8a70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:24.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.205+0000 7feee965d640 1 --2- 172.21.15.46:0/1909438724 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feee41094a0 0x7feee419aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:24.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.205+0000 7feee965d640 1 --2- 172.21.15.46:0/1909438724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feee4103b60 0x7feee419a460 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:24.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.205+0000 7feee965d640 1 -- 172.21.15.46:0/1909438724 >> 172.21.15.46:0/1909438724 conn(0x7feee407b850 msgr2=0x7feee4107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:24.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.205+0000 7feee965d640 1 -- 172.21.15.46:0/1909438724 shutdown_connections 2024-09-21T03:52:24.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:24.205+0000 7feee965d640 1 -- 172.21.15.46:0/1909438724 wait complete. 2024-09-21T03:52:24.951 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":70,"num_osds":12,"num_up_osds":12,"osd_up_since":1726890742,"num_in_osds":12,"osd_in_since":1726890718,"num_remapped_pgs":0} 2024-09-21T03:52:24.952 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T03:52:25.209 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:52:25.461 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:25 smithi046 ceph-mon[30954]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:25.461 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:25 smithi046 ceph-mon[30954]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T03:52:25.461 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:25 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/1909438724' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:52:25.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:25 smithi105 ceph-mon[34773]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:25.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:25 smithi105 ceph-mon[34773]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T03:52:25.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:25 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/1909438724' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:52:25.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:25 smithi162 ceph-mon[35071]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:25.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:25 smithi162 ceph-mon[35071]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T03:52:25.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:25 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/1909438724' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:52:25.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.796+0000 7f161d2f7640 1 -- 172.21.15.46:0/1224543314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1618105b70 msgr2=0x7f161810f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:25.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.796+0000 7f161d2f7640 1 --2- 172.21.15.46:0/1224543314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1618105b70 0x7f161810f5e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1610009900 tx=0x7f161002a3f0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.796+0000 7f161d2f7640 1 -- 172.21.15.46:0/1224543314 shutdown_connections 2024-09-21T03:52:25.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.796+0000 7f161d2f7640 1 --2- 172.21.15.46:0/1224543314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1618105b70 0x7f161810f5e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.796+0000 7f161d2f7640 1 --2- 172.21.15.46:0/1224543314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1618105220 0x7f1618105630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.796+0000 7f161d2f7640 1 --2- 172.21.15.46:0/1224543314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1618103210 0x7f1618103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.796+0000 7f161d2f7640 1 -- 172.21.15.46:0/1224543314 >> 172.21.15.46:0/1224543314 conn(0x7f1618079ec0 msgr2=0x7f161807a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:25.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.796+0000 7f161d2f7640 1 -- 172.21.15.46:0/1224543314 shutdown_connections 2024-09-21T03:52:25.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.796+0000 7f161d2f7640 1 -- 172.21.15.46:0/1224543314 wait complete. 2024-09-21T03:52:25.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.797+0000 7f161d2f7640 1 Processor -- start 2024-09-21T03:52:25.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.797+0000 7f161d2f7640 1 -- start start 2024-09-21T03:52:25.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.797+0000 7f161d2f7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1618103210 0x7f161819a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:25.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.797+0000 7f161d2f7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1618105220 0x7f161819aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:25.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.797+0000 7f161d2f7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1618105b70 0x7f161819fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:25.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.797+0000 7f161d2f7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1618112a70 con 0x7f1618103210 2024-09-21T03:52:25.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.797+0000 7f161d2f7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f16181128f0 con 0x7f1618105220 2024-09-21T03:52:25.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.797+0000 7f161d2f7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1618112bf0 con 0x7f1618105b70 2024-09-21T03:52:25.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.797+0000 7f1616ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1618103210 0x7f161819a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:25.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.797+0000 7f1616ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1618103210 0x7f161819a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33586/0 (socket says 172.21.15.46:33586) 2024-09-21T03:52:25.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.798+0000 7f1616ffd640 1 -- 172.21.15.46:0/2110254691 learned_addr learned my addr 172.21.15.46:0/2110254691 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:52:25.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.798+0000 7f16167fc640 1 --2- 172.21.15.46:0/2110254691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1618105220 0x7f161819aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:25.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.798+0000 7f16177fe640 1 --2- 172.21.15.46:0/2110254691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1618105b70 0x7f161819fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:25.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.798+0000 7f1616ffd640 1 -- 172.21.15.46:0/2110254691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1618105b70 msgr2=0x7f161819fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:25.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.798+0000 7f1616ffd640 1 --2- 172.21.15.46:0/2110254691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1618105b70 0x7f161819fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.798+0000 7f1616ffd640 1 -- 172.21.15.46:0/2110254691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1618105220 msgr2=0x7f161819aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:25.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.798+0000 7f1616ffd640 1 --2- 172.21.15.46:0/2110254691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1618105220 0x7f161819aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.798+0000 7f1616ffd640 1 -- 172.21.15.46:0/2110254691 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16181a0360 con 0x7f1618103210 2024-09-21T03:52:25.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.798+0000 7f1616ffd640 1 --2- 172.21.15.46:0/2110254691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1618103210 0x7f161819a4b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f160800cce0 tx=0x7f160800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:25.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.798+0000 7f15fffff640 1 -- 172.21.15.46:0/2110254691 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160800f450 con 0x7f1618103210 2024-09-21T03:52:25.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.798+0000 7f161d2f7640 1 -- 172.21.15.46:0/2110254691 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16181a0650 con 0x7f1618103210 2024-09-21T03:52:25.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.798+0000 7f15fffff640 1 -- 172.21.15.46:0/2110254691 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f160800faa0 con 0x7f1618103210 2024-09-21T03:52:25.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.798+0000 7f15fffff640 1 -- 172.21.15.46:0/2110254691 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1608018aa0 con 0x7f1618103210 2024-09-21T03:52:25.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.798+0000 7f161d2f7640 1 -- 172.21.15.46:0/2110254691 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16181a6e70 con 0x7f1618103210 2024-09-21T03:52:25.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.799+0000 7f161d2f7640 1 -- 172.21.15.46:0/2110254691 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1618103620 con 0x7f1618103210 2024-09-21T03:52:25.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.801+0000 7f15fffff640 1 -- 172.21.15.46:0/2110254691 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f1608018c40 con 0x7f1618103210 2024-09-21T03:52:25.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.802+0000 7f15fffff640 1 --2- 172.21.15.46:0/2110254691 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f16000b6590 0x7f16000b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:25.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.802+0000 7f16167fc640 1 --2- 172.21.15.46:0/2110254691 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f16000b6590 0x7f16000b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:25.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.802+0000 7f15fffff640 1 -- 172.21.15.46:0/2110254691 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f16080e7750 con 0x7f1618103210 2024-09-21T03:52:25.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.802+0000 7f16167fc640 1 --2- 172.21.15.46:0/2110254691 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f16000b6590 0x7f16000b8aa0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f16181091f0 tx=0x7f160c00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:25.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.805+0000 7f15fffff640 1 -- 172.21.15.46:0/2110254691 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1608014030 con 0x7f1618103210 2024-09-21T03:52:25.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.994+0000 7f161d2f7640 1 -- 172.21.15.46:0/2110254691 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f161819b5e0 con 0x7f1618103210 2024-09-21T03:52:25.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.995+0000 7f15fffff640 1 -- 172.21.15.46:0/2110254691 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+18783 (secure 0 0 0) 0x7f16080ae440 con 0x7f1618103210 2024-09-21T03:52:25.998 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:52:25.998 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":70,"fsid":"a82de5ec-77cb-11ef-baf5-efdc52797490","created":"2024-09-21T03:44:31.512271+0000","modified":"2024-09-21T03:52:24.161487+0000","last_up_change":"2024-09-21T03:52:22.609789+0000","last_in_change":"2024-09-21T03:51:58.812316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:48:30.407205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ff9e1a8-fec7-422c-b594-880efe4684f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6803","nonce":791989880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6805","nonce":791989880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6809","nonce":791989880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6807","nonce":791989880}]},"public_addr":"172.21.15.46:6803/791989880","cluster_addr":"172.21.15.46:6805/791989880","heartbeat_back_addr":"172.21.15.46:6809/791989880","heartbeat_front_addr":"172.21.15.46:6807/791989880","state":["exists","up"]},{"osd":1,"uuid":"3df1bee7-615e-44d0-bd43-2370db6cd06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6801","nonce":1123652172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6803","nonce":1123652172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6807","nonce":1123652172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6805","nonce":1123652172}]},"public_addr":"172.21.15.105:6801/1123652172","cluster_addr":"172.21.15.105:6803/1123652172","heartbeat_back_addr":"172.21.15.105:6807/1123652172","heartbeat_front_addr":"172.21.15.105:6805/1123652172","state":["exists","up"]},{"osd":2,"uuid":"52d0e57f-cfca-447a-8a57-b1d5364cb4d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6801","nonce":34930776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6803","nonce":34930776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6807","nonce":34930776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6805","nonce":34930776}]},"public_addr":"172.21.15.162:6801/34930776","cluster_addr":"172.21.15.162:6803/34930776","heartbeat_back_addr":"172.21.15.162:6807/34930776","heartbeat_front_addr":"172.21.15.162:6805/34930776","state":["exists","up"]},{"osd":3,"uuid":"6f25f721-fc50-4b80-944b-d3df28e7a2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6811","nonce":1355580104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6813","nonce":1355580104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6817","nonce":1355580104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6815","nonce":1355580104}]},"public_addr":"172.21.15.46:6811/1355580104","cluster_addr":"172.21.15.46:6813/1355580104","heartbeat_back_addr":"172.21.15.46:6817/1355580104","heartbeat_front_addr":"172.21.15.46:6815/1355580104","state":["exists","up"]},{"osd":4,"uuid":"c2f41084-e5a1-4b5f-b799-a84b38da63a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6809","nonce":3566174660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6811","nonce":3566174660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6815","nonce":3566174660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6813","nonce":3566174660}]},"public_addr":"172.21.15.105:6809/3566174660","cluster_addr":"172.21.15.105:6811/3566174660","heartbeat_back_addr":"172.21.15.105:6815/3566174660","heartbeat_front_addr":"172.21.15.105:6813/3566174660","state":["exists","up"]},{"osd":5,"uuid":"b433d03b-fae8-4ece-b967-a8af91bc3ab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6809","nonce":3043419818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6811","nonce":3043419818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6815","nonce":3043419818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6813","nonce":3043419818}]},"public_addr":"172.21.15.162:6809/3043419818","cluster_addr":"172.21.15.162:6811/3043419818","heartbeat_back_addr":"172.21.15.162:6815/3043419818","heartbeat_front_addr":"172.21.15.162:6813/3043419818","state":["exists","up"]},{"osd":6,"uuid":"e6b5ce54-69aa-4811-9ca3-cab50525a175","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6819","nonce":1615361645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6821","nonce":1615361645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6825","nonce":1615361645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6823","nonce":1615361645}]},"public_addr":"172.21.15.46:6819/1615361645","cluster_addr":"172.21.15.46:6821/1615361645","heartbeat_back_addr":"172.21.15.46:6825/1615361645","heartbeat_front_addr":"172.21.15.46:6823/1615361645","state":["exists","up"]},{"osd":7,"uuid":"a6e89d5d-ce31-4e0c-9019-5eb13b134feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6817","nonce":1015687379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6819","nonce":1015687379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6823","nonce":1015687379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6821","nonce":1015687379}]},"public_addr":"172.21.15.105:6817/1015687379","cluster_addr":"172.21.15.105:6819/1015687379","heartbeat_back_addr":"172.21.15.105:6823/1015687379","heartbeat_front_addr":"172.21.15.105:6821/1015687379","state":["exists","up"]},{"osd":8,"uuid":"27b2ccec-65be-47b3-a924-c5939ba1cb5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6817","nonce":3441747512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6819","nonce":3441747512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6823","nonce":3441747512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6821","nonce":3441747512}]},"public_addr":"172.21.15.162:6817/3441747512","cluster_addr":"172.21.15.162:6819/3441747512","heartbeat_back_addr":"172.21.15.162:6823/3441747512","heartbeat_front_addr":"172.21.15.162:6821/3441747512","state":["exists","up"]},{"osd":9,"uuid":"3f7cb70c-73c7-48e8-a32b-7445eda2126d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6827","nonce":382230768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6829","nonce":382230768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6833","nonce":382230768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6831","nonce":382230768}]},"public_addr":"172.21.15.46:6827/382230768","cluster_addr":"172.21.15.46:6829/382230768","heartbeat_back_addr":"172.21.15.46:6833/382230768","heartbeat_front_addr":"172.21.15.46:6831/382230768","state":["exists","up"]},{"osd":10,"uuid":"76c3da87-f3c5-4985-87fd-647717b6af85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6825","nonce":1664619099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6827","nonce":1664619099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6831","nonce":1664619099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6829","nonce":1664619099}]},"public_addr":"172.21.15.105:6825/1664619099","cluster_addr":"172.21.15.105:6827/1664619099","heartbeat_back_addr":"172.21.15.105:6831/1664619099","heartbeat_front_addr":"172.21.15.105:6829/1664619099","state":["exists","up"]},{"osd":11,"uuid":"13269da8-5f05-4ce2-9c7a-6dd9c1041cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6825","nonce":1014820476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6827","nonce":1014820476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6831","nonce":1014820476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6829","nonce":1014820476}]},"public_addr":"172.21.15.162:6825/1014820476","cluster_addr":"172.21.15.162:6827/1014820476","heartbeat_back_addr":"172.21.15.162:6831/1014820476","heartbeat_front_addr":"172.21.15.162:6829/1014820476","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:47:38.630436+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:03.441596+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:28.647341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:54.270316+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:49:19.783873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:49:45.344485+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:50:12.165326+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:50:38.095996+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:03.814612+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:29.469718+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:55.407340+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:52:20.360243+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:6801/878116252":"2024-09-22T03:46:31.942086+0000","172.21.15.46:6800/878116252":"2024-09-22T03:46:31.942086+0000","172.21.15.46:0/3574041742":"2024-09-22T03:45:05.097136+0000","172.21.15.46:6801/1185001582":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/2839831446":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/3423884605":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/2761976928":"2024-09-22T03:46:31.942086+0000","172.21.15.46:0/1149961133":"2024-09-22T03:45:05.097136+0000","172.21.15.46:6800/1185001582":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/641493295":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/4033661287":"2024-09-22T03:45:31.101657+0000","172.21.15.46:6800/2733048710":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/3972416280":"2024-09-22T03:46:31.942086+0000","172.21.15.46:6801/2733048710":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/1662975018":"2024-09-22T03:46:31.942086+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:52:26.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.997+0000 7f161d2f7640 1 -- 172.21.15.46:0/2110254691 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f16000b6590 msgr2=0x7f16000b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:26.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.997+0000 7f161d2f7640 1 --2- 172.21.15.46:0/2110254691 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f16000b6590 0x7f16000b8aa0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f16181091f0 tx=0x7f160c00a2d0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.997+0000 7f161d2f7640 1 -- 172.21.15.46:0/2110254691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1618103210 msgr2=0x7f161819a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:26.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.997+0000 7f161d2f7640 1 --2- 172.21.15.46:0/2110254691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1618103210 0x7f161819a4b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f160800cce0 tx=0x7f160800a620 comp rx=0 tx=0).stop 2024-09-21T03:52:26.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.997+0000 7f161d2f7640 1 -- 172.21.15.46:0/2110254691 shutdown_connections 2024-09-21T03:52:26.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.998+0000 7f161d2f7640 1 --2- 172.21.15.46:0/2110254691 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f16000b6590 0x7f16000b8aa0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.998+0000 7f161d2f7640 1 --2- 172.21.15.46:0/2110254691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1618105b70 0x7f161819fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.998+0000 7f161d2f7640 1 --2- 172.21.15.46:0/2110254691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1618105220 0x7f161819aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.998+0000 7f161d2f7640 1 --2- 172.21.15.46:0/2110254691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1618103210 0x7f161819a4b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.998+0000 7f161d2f7640 1 -- 172.21.15.46:0/2110254691 >> 172.21.15.46:0/2110254691 conn(0x7f1618079ec0 msgr2=0x7f1618106470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:26.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.998+0000 7f161d2f7640 1 -- 172.21.15.46:0/2110254691 shutdown_connections 2024-09-21T03:52:26.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:25.998+0000 7f161d2f7640 1 -- 172.21.15.46:0/2110254691 wait complete. 2024-09-21T03:52:26.464 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:26 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/2110254691' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:52:26.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:26 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/2110254691' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:52:26.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:26 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/2110254691' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:52:26.738 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T03:48:30.407205+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T03:52:26.738 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T03:52:26.998 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:52:27.382 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:27 smithi046 ceph-mon[30954]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:27.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.474+0000 7f1a35c3a640 1 -- 172.21.15.46:0/3625838039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a30109df0 msgr2=0x7f1a30110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:27.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.474+0000 7f1a35c3a640 1 --2- 172.21.15.46:0/3625838039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a30109df0 0x7f1a30110620 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1a28009ca0 tx=0x7f1a2802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:52:27.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.474+0000 7f1a35c3a640 1 -- 172.21.15.46:0/3625838039 shutdown_connections 2024-09-21T03:52:27.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.474+0000 7f1a35c3a640 1 --2- 172.21.15.46:0/3625838039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a30109df0 0x7f1a30110620 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:27.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.474+0000 7f1a35c3a640 1 --2- 172.21.15.46:0/3625838039 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a301094a0 0x7f1a301098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:27.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.474+0000 7f1a35c3a640 1 --2- 172.21.15.46:0/3625838039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a30103b60 0x7f1a30103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:27.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.475+0000 7f1a35c3a640 1 -- 172.21.15.46:0/3625838039 >> 172.21.15.46:0/3625838039 conn(0x7f1a3007b850 msgr2=0x7f1a3007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:27.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.475+0000 7f1a35c3a640 1 -- 172.21.15.46:0/3625838039 shutdown_connections 2024-09-21T03:52:27.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.475+0000 7f1a35c3a640 1 -- 172.21.15.46:0/3625838039 wait complete. 2024-09-21T03:52:27.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.475+0000 7f1a35c3a640 1 Processor -- start 2024-09-21T03:52:27.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.475+0000 7f1a35c3a640 1 -- start start 2024-09-21T03:52:27.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.476+0000 7f1a35c3a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a30103b60 0x7f1a30075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:27.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.476+0000 7f1a35c3a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a301094a0 0x7f1a30075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:27.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.476+0000 7f1a35c3a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a30109df0 0x7f1a30076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:27.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.476+0000 7f1a35c3a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1a30113b10 con 0x7f1a30103b60 2024-09-21T03:52:27.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.476+0000 7f1a35c3a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1a30113990 con 0x7f1a30109df0 2024-09-21T03:52:27.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.476+0000 7f1a35c3a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1a30113c90 con 0x7f1a301094a0 2024-09-21T03:52:27.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.476+0000 7f1a2f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a30103b60 0x7f1a30075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:27.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.476+0000 7f1a2f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a30103b60 0x7f1a30075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33610/0 (socket says 172.21.15.46:33610) 2024-09-21T03:52:27.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.476+0000 7f1a2f7fe640 1 -- 172.21.15.46:0/326354217 learned_addr learned my addr 172.21.15.46:0/326354217 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:52:27.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.476+0000 7f1a2effd640 1 --2- 172.21.15.46:0/326354217 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a301094a0 0x7f1a30075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:27.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.476+0000 7f1a2ffff640 1 --2- 172.21.15.46:0/326354217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a30109df0 0x7f1a30076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:27.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.476+0000 7f1a2f7fe640 1 -- 172.21.15.46:0/326354217 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a301094a0 msgr2=0x7f1a30075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:27.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.476+0000 7f1a2f7fe640 1 --2- 172.21.15.46:0/326354217 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a301094a0 0x7f1a30075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:27.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.476+0000 7f1a2f7fe640 1 -- 172.21.15.46:0/326354217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a30109df0 msgr2=0x7f1a30076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:27.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.476+0000 7f1a2f7fe640 1 --2- 172.21.15.46:0/326354217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a30109df0 0x7f1a30076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:27.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.476+0000 7f1a2f7fe640 1 -- 172.21.15.46:0/326354217 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a301a86f0 con 0x7f1a30103b60 2024-09-21T03:52:27.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.476+0000 7f1a2effd640 1 --2- 172.21.15.46:0/326354217 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a301094a0 0x7f1a30075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:52:27.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.476+0000 7f1a2ffff640 1 --2- 172.21.15.46:0/326354217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a30109df0 0x7f1a30076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:52:27.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.476+0000 7f1a2f7fe640 1 --2- 172.21.15.46:0/326354217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a30103b60 0x7f1a30075710 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1a2000b4a0 tx=0x7f1a2000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:27.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.476+0000 7f1a2cff9640 1 -- 172.21.15.46:0/326354217 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a20014070 con 0x7f1a30103b60 2024-09-21T03:52:27.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.477+0000 7f1a35c3a640 1 -- 172.21.15.46:0/326354217 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a301a89e0 con 0x7f1a30103b60 2024-09-21T03:52:27.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.477+0000 7f1a2cff9640 1 -- 172.21.15.46:0/326354217 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a20010ac0 con 0x7f1a30103b60 2024-09-21T03:52:27.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.477+0000 7f1a2cff9640 1 -- 172.21.15.46:0/326354217 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a20017c30 con 0x7f1a30103b60 2024-09-21T03:52:27.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.477+0000 7f1a35c3a640 1 -- 172.21.15.46:0/326354217 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a301a8ff0 con 0x7f1a30103b60 2024-09-21T03:52:27.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.478+0000 7f1a35c3a640 1 -- 172.21.15.46:0/326354217 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a30103f70 con 0x7f1a30103b60 2024-09-21T03:52:27.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.479+0000 7f1a2cff9640 1 -- 172.21.15.46:0/326354217 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f1a20017070 con 0x7f1a30103b60 2024-09-21T03:52:27.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.480+0000 7f1a2cff9640 1 --2- 172.21.15.46:0/326354217 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f1a180b6560 0x7f1a180b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:27.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.481+0000 7f1a2cff9640 1 -- 172.21.15.46:0/326354217 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f1a200e65f0 con 0x7f1a30103b60 2024-09-21T03:52:27.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.481+0000 7f1a2effd640 1 --2- 172.21.15.46:0/326354217 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f1a180b6560 0x7f1a180b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:27.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.481+0000 7f1a2effd640 1 --2- 172.21.15.46:0/326354217 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f1a180b6560 0x7f1a180b8a70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1a30108fc0 tx=0x7f1a24005d90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:27.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.484+0000 7f1a2cff9640 1 -- 172.21.15.46:0/326354217 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1a200ad250 con 0x7f1a30103b60 2024-09-21T03:52:27.567 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:27 smithi105 ceph-mon[34773]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:27.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:27 smithi162 ceph-mon[35071]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:27.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.671+0000 7f1a35c3a640 1 -- 172.21.15.46:0/326354217 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1a3002e640 con 0x7f1a30103b60 2024-09-21T03:52:27.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.671+0000 7f1a2cff9640 1 -- 172.21.15.46:0/326354217 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) ==== 93+0+10 (secure 0 0 0) 0x7f1a200b1630 con 0x7f1a30103b60 2024-09-21T03:52:27.674 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-09-21T03:52:27.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.674+0000 7f1a35c3a640 1 -- 172.21.15.46:0/326354217 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f1a180b6560 msgr2=0x7f1a180b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:27.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.674+0000 7f1a35c3a640 1 --2- 172.21.15.46:0/326354217 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f1a180b6560 0x7f1a180b8a70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1a30108fc0 tx=0x7f1a24005d90 comp rx=0 tx=0).stop 2024-09-21T03:52:27.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.674+0000 7f1a35c3a640 1 -- 172.21.15.46:0/326354217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a30103b60 msgr2=0x7f1a30075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:27.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.674+0000 7f1a35c3a640 1 --2- 172.21.15.46:0/326354217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a30103b60 0x7f1a30075710 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1a2000b4a0 tx=0x7f1a2000b960 comp rx=0 tx=0).stop 2024-09-21T03:52:27.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.674+0000 7f1a35c3a640 1 -- 172.21.15.46:0/326354217 shutdown_connections 2024-09-21T03:52:27.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.674+0000 7f1a35c3a640 1 --2- 172.21.15.46:0/326354217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a30109df0 0x7f1a30076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:27.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.674+0000 7f1a35c3a640 1 --2- 172.21.15.46:0/326354217 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f1a180b6560 0x7f1a180b8a70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:27.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.674+0000 7f1a35c3a640 1 --2- 172.21.15.46:0/326354217 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a301094a0 0x7f1a30075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:27.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.674+0000 7f1a35c3a640 1 --2- 172.21.15.46:0/326354217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a30103b60 0x7f1a30075710 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:27.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.674+0000 7f1a35c3a640 1 -- 172.21.15.46:0/326354217 >> 172.21.15.46:0/326354217 conn(0x7f1a3007b850 msgr2=0x7f1a301074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:27.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.674+0000 7f1a35c3a640 1 -- 172.21.15.46:0/326354217 shutdown_connections 2024-09-21T03:52:27.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:27.674+0000 7f1a35c3a640 1 -- 172.21.15.46:0/326354217 wait complete. 2024-09-21T03:52:28.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:28 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/326354217' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T03:52:28.322 INFO:tasks.cephadm:Adding mds.a on smithi046 2024-09-21T03:52:28.322 INFO:tasks.cephadm:Adding mds.d on smithi046 2024-09-21T03:52:28.322 INFO:tasks.cephadm:Adding mds.g on smithi046 2024-09-21T03:52:28.322 INFO:tasks.cephadm:Adding mds.j on smithi046 2024-09-21T03:52:28.322 INFO:tasks.cephadm:Adding mds.b on smithi105 2024-09-21T03:52:28.323 INFO:tasks.cephadm:Adding mds.e on smithi105 2024-09-21T03:52:28.323 INFO:tasks.cephadm:Adding mds.h on smithi105 2024-09-21T03:52:28.323 INFO:tasks.cephadm:Adding mds.k on smithi105 2024-09-21T03:52:28.323 INFO:tasks.cephadm:Adding mds.c on smithi162 2024-09-21T03:52:28.323 INFO:tasks.cephadm:Adding mds.f on smithi162 2024-09-21T03:52:28.323 INFO:tasks.cephadm:Adding mds.i on smithi162 2024-09-21T03:52:28.323 INFO:tasks.cephadm:Adding mds.l on smithi162 2024-09-21T03:52:28.323 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph orch apply mds all '12;smithi046=a;smithi046=d;smithi046=g;smithi046=j;smithi105=b;smithi105=e;smithi105=h;smithi105=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l' 2024-09-21T03:52:28.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:28 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/326354217' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T03:52:28.583 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:52:28.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:28 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/326354217' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T03:52:29.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.074+0000 7f703b6c6640 1 -- 172.21.15.162:0/1799475781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7034109e00 msgr2=0x7f7034110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:29.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.074+0000 7f703b6c6640 1 --2- 172.21.15.162:0/1799475781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7034109e00 0x7f7034110630 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f702c009ca0 tx=0x7f702c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.074+0000 7f703b6c6640 1 -- 172.21.15.162:0/1799475781 shutdown_connections 2024-09-21T03:52:29.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.074+0000 7f703b6c6640 1 --2- 172.21.15.162:0/1799475781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7034109e00 0x7f7034110630 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.074+0000 7f703b6c6640 1 --2- 172.21.15.162:0/1799475781 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70341094b0 0x7f70341098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.074+0000 7f703b6c6640 1 --2- 172.21.15.162:0/1799475781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7034103bc0 0x7f7034103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.074+0000 7f703b6c6640 1 -- 172.21.15.162:0/1799475781 >> 172.21.15.162:0/1799475781 conn(0x7f703407b910 msgr2=0x7f703407bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:29.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.075+0000 7f703b6c6640 1 -- 172.21.15.162:0/1799475781 shutdown_connections 2024-09-21T03:52:29.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.075+0000 7f703b6c6640 1 -- 172.21.15.162:0/1799475781 wait complete. 2024-09-21T03:52:29.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.075+0000 7f703b6c6640 1 Processor -- start 2024-09-21T03:52:29.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.075+0000 7f703b6c6640 1 -- start start 2024-09-21T03:52:29.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.075+0000 7f703b6c6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7034103bc0 0x7f703419a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:29.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.076+0000 7f703b6c6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70341094b0 0x7f703419aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:29.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.076+0000 7f703b6c6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7034109e00 0x7f703419fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:29.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.076+0000 7f703b6c6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7034113ac0 con 0x7f7034109e00 2024-09-21T03:52:29.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.076+0000 7f703b6c6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7034113940 con 0x7f7034103bc0 2024-09-21T03:52:29.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.076+0000 7f703b6c6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7034113c40 con 0x7f70341094b0 2024-09-21T03:52:29.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.076+0000 7f7038c61640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70341094b0 0x7f703419aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:29.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.076+0000 7f7038c61640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70341094b0 0x7f703419aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:42388/0 (socket says 172.21.15.162:42388) 2024-09-21T03:52:29.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.076+0000 7f7038c61640 1 -- 172.21.15.162:0/1087995624 learned_addr learned my addr 172.21.15.162:0/1087995624 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T03:52:29.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.076+0000 7f7039462640 1 --2- 172.21.15.162:0/1087995624 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7034103bc0 0x7f703419a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:29.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.076+0000 7f7039c63640 1 --2- 172.21.15.162:0/1087995624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7034109e00 0x7f703419fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:29.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.076+0000 7f7038c61640 1 -- 172.21.15.162:0/1087995624 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7034103bc0 msgr2=0x7f703419a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:29.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.076+0000 7f7038c61640 1 --2- 172.21.15.162:0/1087995624 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7034103bc0 0x7f703419a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.076+0000 7f7038c61640 1 -- 172.21.15.162:0/1087995624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7034109e00 msgr2=0x7f703419fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:29.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.076+0000 7f7038c61640 1 --2- 172.21.15.162:0/1087995624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7034109e00 0x7f703419fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.076+0000 7f7038c61640 1 -- 172.21.15.162:0/1087995624 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70341a03e0 con 0x7f70341094b0 2024-09-21T03:52:29.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.076+0000 7f7039462640 1 --2- 172.21.15.162:0/1087995624 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7034103bc0 0x7f703419a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:52:29.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.076+0000 7f7038c61640 1 --2- 172.21.15.162:0/1087995624 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70341094b0 0x7f703419aa10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f702400d740 tx=0x7f702400dc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:29.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.076+0000 7f702a7fc640 1 -- 172.21.15.162:0/1087995624 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7024017070 con 0x7f70341094b0 2024-09-21T03:52:29.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.076+0000 7f703b6c6640 1 -- 172.21.15.162:0/1087995624 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70341a06d0 con 0x7f70341094b0 2024-09-21T03:52:29.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.076+0000 7f702a7fc640 1 -- 172.21.15.162:0/1087995624 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f702400de50 con 0x7f70341094b0 2024-09-21T03:52:29.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.076+0000 7f702a7fc640 1 -- 172.21.15.162:0/1087995624 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702400f620 con 0x7f70341094b0 2024-09-21T03:52:29.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.076+0000 7f703b6c6640 1 -- 172.21.15.162:0/1087995624 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70341a6e30 con 0x7f70341094b0 2024-09-21T03:52:29.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.078+0000 7f703b6c6640 1 -- 172.21.15.162:0/1087995624 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7034103fd0 con 0x7f70341094b0 2024-09-21T03:52:29.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.080+0000 7f702a7fc640 1 -- 172.21.15.162:0/1087995624 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f702401a070 con 0x7f70341094b0 2024-09-21T03:52:29.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.081+0000 7f702a7fc640 1 --2- 172.21.15.162:0/1087995624 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f70200b6560 0x7f70200b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:29.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.082+0000 7f702a7fc640 1 -- 172.21.15.162:0/1087995624 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f70240e6990 con 0x7f70341094b0 2024-09-21T03:52:29.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.082+0000 7f7039462640 1 --2- 172.21.15.162:0/1087995624 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f70200b6560 0x7f70200b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:29.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.082+0000 7f7039462640 1 --2- 172.21.15.162:0/1087995624 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f70200b6560 0x7f70200b8a70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7030005fd0 tx=0x7f703000b5f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:29.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.084+0000 7f702a7fc640 1 -- 172.21.15.162:0/1087995624 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f70240ad5f0 con 0x7f70341094b0 2024-09-21T03:52:29.256 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:29 smithi162 ceph-mon[35071]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:29.285 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.282+0000 7f703b6c6640 1 -- 172.21.15.162:0/1087995624 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi046=a;smithi046=d;smithi046=g;smithi046=j;smithi105=b;smithi105=e;smithi105=h;smithi105=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l", "target": ["mon-mgr", ""]}) -- 0x7f7034063800 con 0x7f70200b6560 2024-09-21T03:52:29.293 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.291+0000 7f702a7fc640 1 -- 172.21.15.162:0/1087995624 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f7034063800 con 0x7f70200b6560 2024-09-21T03:52:29.294 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled mds.all update... 2024-09-21T03:52:29.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.293+0000 7f703b6c6640 1 -- 172.21.15.162:0/1087995624 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f70200b6560 msgr2=0x7f70200b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:29.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.293+0000 7f703b6c6640 1 --2- 172.21.15.162:0/1087995624 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f70200b6560 0x7f70200b8a70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7030005fd0 tx=0x7f703000b5f0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.293+0000 7f703b6c6640 1 -- 172.21.15.162:0/1087995624 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70341094b0 msgr2=0x7f703419aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:29.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.293+0000 7f703b6c6640 1 --2- 172.21.15.162:0/1087995624 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70341094b0 0x7f703419aa10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f702400d740 tx=0x7f702400dc00 comp rx=0 tx=0).stop 2024-09-21T03:52:29.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.293+0000 7f703b6c6640 1 -- 172.21.15.162:0/1087995624 shutdown_connections 2024-09-21T03:52:29.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.293+0000 7f703b6c6640 1 --2- 172.21.15.162:0/1087995624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7034109e00 0x7f703419fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.293+0000 7f703b6c6640 1 --2- 172.21.15.162:0/1087995624 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f70200b6560 0x7f70200b8a70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.293+0000 7f703b6c6640 1 --2- 172.21.15.162:0/1087995624 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70341094b0 0x7f703419aa10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.293+0000 7f703b6c6640 1 --2- 172.21.15.162:0/1087995624 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7034103bc0 0x7f703419a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.293+0000 7f703b6c6640 1 -- 172.21.15.162:0/1087995624 >> 172.21.15.162:0/1087995624 conn(0x7f703407b910 msgr2=0x7f7034107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:29.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.294+0000 7f703b6c6640 1 -- 172.21.15.162:0/1087995624 shutdown_connections 2024-09-21T03:52:29.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:52:29.294+0000 7f703b6c6640 1 -- 172.21.15.162:0/1087995624 wait complete. 2024-09-21T03:52:29.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:29 smithi046 ceph-mon[30954]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:29.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:29 smithi105 ceph-mon[34773]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:29.934 DEBUG:teuthology.orchestra.run.smithi046:mds.a> sudo journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.a.service 2024-09-21T03:52:29.936 DEBUG:teuthology.orchestra.run.smithi046:mds.d> sudo journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.d.service 2024-09-21T03:52:29.979 DEBUG:teuthology.orchestra.run.smithi046:mds.g> sudo journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.g.service 2024-09-21T03:52:30.022 DEBUG:teuthology.orchestra.run.smithi046:mds.j> sudo journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.j.service 2024-09-21T03:52:30.065 DEBUG:teuthology.orchestra.run.smithi105:mds.b> sudo journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.b.service 2024-09-21T03:52:30.067 DEBUG:teuthology.orchestra.run.smithi105:mds.e> sudo journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.e.service 2024-09-21T03:52:30.110 DEBUG:teuthology.orchestra.run.smithi105:mds.h> sudo journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.h.service 2024-09-21T03:52:30.154 DEBUG:teuthology.orchestra.run.smithi105:mds.k> sudo journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.k.service 2024-09-21T03:52:30.197 DEBUG:teuthology.orchestra.run.smithi162:mds.c> sudo journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.c.service 2024-09-21T03:52:30.199 DEBUG:teuthology.orchestra.run.smithi162:mds.f> sudo journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.f.service 2024-09-21T03:52:30.242 DEBUG:teuthology.orchestra.run.smithi162:mds.i> sudo journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.i.service 2024-09-21T03:52:30.285 DEBUG:teuthology.orchestra.run.smithi162:mds.l> sudo journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.l.service 2024-09-21T03:52:30.328 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-21T03:52:30.328 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:52:30.403 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:30 smithi162 ceph-mon[35071]: from='client.24592 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi046=a;smithi046=d;smithi046=g;smithi046=j;smithi105=b;smithi105=e;smithi105=h;smithi105=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:30.403 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:30 smithi162 ceph-mon[35071]: Saving service mds.all spec with placement smithi046=a;smithi046=d;smithi046=g;smithi046=j;smithi105=b;smithi105=e;smithi105=h;smithi105=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l;count:12 2024-09-21T03:52:30.403 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:30 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:30.403 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:30 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:52:30.403 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:30 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:30.403 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:30 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:52:30.403 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:30 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:30.403 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:30 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:52:30.403 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:30 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:52:30.403 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:30 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:30.403 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:30 smithi162 ceph-mon[35071]: Deploying daemon mds.l on smithi162 2024-09-21T03:52:30.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:30 smithi105 ceph-mon[34773]: from='client.24592 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi046=a;smithi046=d;smithi046=g;smithi046=j;smithi105=b;smithi105=e;smithi105=h;smithi105=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:30.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:30 smithi105 ceph-mon[34773]: Saving service mds.all spec with placement smithi046=a;smithi046=d;smithi046=g;smithi046=j;smithi105=b;smithi105=e;smithi105=h;smithi105=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l;count:12 2024-09-21T03:52:30.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:30 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:30.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:30 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:52:30.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:30 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:30.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:30 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:52:30.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:30 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:30.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:30 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:52:30.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:30 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:52:30.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:30 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:30.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:30 smithi105 ceph-mon[34773]: Deploying daemon mds.l on smithi162 2024-09-21T03:52:30.580 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:52:30.701 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:30 smithi046 ceph-mon[30954]: from='client.24592 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi046=a;smithi046=d;smithi046=g;smithi046=j;smithi105=b;smithi105=e;smithi105=h;smithi105=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:30.701 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:30 smithi046 ceph-mon[30954]: Saving service mds.all spec with placement smithi046=a;smithi046=d;smithi046=g;smithi046=j;smithi105=b;smithi105=e;smithi105=h;smithi105=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l;count:12 2024-09-21T03:52:30.702 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:30 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:30.702 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:30 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:52:30.702 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:30 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:30.702 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:30 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:52:30.702 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:30 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:30.702 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:30 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:52:30.702 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:30 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:52:30.702 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:30 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:30.702 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:30 smithi046 ceph-mon[30954]: Deploying daemon mds.l on smithi162 2024-09-21T03:52:31.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.101+0000 7f3f39eca640 1 -- 172.21.15.46:0/165399812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f34103b60 msgr2=0x7f3f34103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:31.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.101+0000 7f3f39eca640 1 --2- 172.21.15.46:0/165399812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f34103b60 0x7f3f34103f70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3f24009900 tx=0x7f3f2402a410 comp rx=0 tx=0).stop 2024-09-21T03:52:31.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.101+0000 7f3f39eca640 1 -- 172.21.15.46:0/165399812 shutdown_connections 2024-09-21T03:52:31.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.101+0000 7f3f39eca640 1 --2- 172.21.15.46:0/165399812 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f34109df0 0x7f3f34110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:31.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.101+0000 7f3f39eca640 1 --2- 172.21.15.46:0/165399812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f341094a0 0x7f3f341098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:31.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.101+0000 7f3f39eca640 1 --2- 172.21.15.46:0/165399812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f34103b60 0x7f3f34103f70 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:31.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.101+0000 7f3f39eca640 1 -- 172.21.15.46:0/165399812 >> 172.21.15.46:0/165399812 conn(0x7f3f3407b850 msgr2=0x7f3f3407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:31.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.101+0000 7f3f39eca640 1 -- 172.21.15.46:0/165399812 shutdown_connections 2024-09-21T03:52:31.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.101+0000 7f3f39eca640 1 -- 172.21.15.46:0/165399812 wait complete. 2024-09-21T03:52:31.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.101+0000 7f3f39eca640 1 Processor -- start 2024-09-21T03:52:31.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.102+0000 7f3f39eca640 1 -- start start 2024-09-21T03:52:31.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.102+0000 7f3f39eca640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f34103b60 0x7f3f3419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:31.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.102+0000 7f3f39eca640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f341094a0 0x7f3f3419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:31.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.102+0000 7f3f39eca640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f34109df0 0x7f3f3419fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:31.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.102+0000 7f3f39eca640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3f34113ab0 con 0x7f3f34109df0 2024-09-21T03:52:31.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.102+0000 7f3f39eca640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3f34113930 con 0x7f3f34103b60 2024-09-21T03:52:31.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.102+0000 7f3f39eca640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3f34113c30 con 0x7f3f341094a0 2024-09-21T03:52:31.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.102+0000 7f3f33fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f34109df0 0x7f3f3419fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:31.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.102+0000 7f3f33fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f34109df0 0x7f3f3419fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33636/0 (socket says 172.21.15.46:33636) 2024-09-21T03:52:31.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.102+0000 7f3f33fff640 1 -- 172.21.15.46:0/1808605761 learned_addr learned my addr 172.21.15.46:0/1808605761 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:52:31.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.102+0000 7f3f32ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f341094a0 0x7f3f3419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:31.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.102+0000 7f3f337fe640 1 --2- 172.21.15.46:0/1808605761 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f34103b60 0x7f3f3419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:31.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.102+0000 7f3f33fff640 1 -- 172.21.15.46:0/1808605761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f341094a0 msgr2=0x7f3f3419aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:31.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.102+0000 7f3f33fff640 1 --2- 172.21.15.46:0/1808605761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f341094a0 0x7f3f3419aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:31.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.102+0000 7f3f33fff640 1 -- 172.21.15.46:0/1808605761 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f34103b60 msgr2=0x7f3f3419a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:31.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.102+0000 7f3f33fff640 1 --2- 172.21.15.46:0/1808605761 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f34103b60 0x7f3f3419a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:31.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.102+0000 7f3f33fff640 1 -- 172.21.15.46:0/1808605761 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f341a03d0 con 0x7f3f34109df0 2024-09-21T03:52:31.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.102+0000 7f3f32ffd640 1 --2- 172.21.15.46:0/1808605761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f341094a0 0x7f3f3419aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:52:31.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.103+0000 7f3f33fff640 1 --2- 172.21.15.46:0/1808605761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f34109df0 0x7f3f3419fca0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c00cad0 tx=0x7f3f2c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:31.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.103+0000 7f3f30ff9640 1 -- 172.21.15.46:0/1808605761 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c00ae20 con 0x7f3f34109df0 2024-09-21T03:52:31.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.103+0000 7f3f30ff9640 1 -- 172.21.15.46:0/1808605761 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f2c005020 con 0x7f3f34109df0 2024-09-21T03:52:31.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.103+0000 7f3f39eca640 1 -- 172.21.15.46:0/1808605761 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f341a06c0 con 0x7f3f34109df0 2024-09-21T03:52:31.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.103+0000 7f3f30ff9640 1 -- 172.21.15.46:0/1808605761 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c00f6b0 con 0x7f3f34109df0 2024-09-21T03:52:31.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.103+0000 7f3f39eca640 1 -- 172.21.15.46:0/1808605761 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f341a6e20 con 0x7f3f34109df0 2024-09-21T03:52:31.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.104+0000 7f3f39eca640 1 -- 172.21.15.46:0/1808605761 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f34103f70 con 0x7f3f34109df0 2024-09-21T03:52:31.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.105+0000 7f3f30ff9640 1 -- 172.21.15.46:0/1808605761 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f3f2c0051d0 con 0x7f3f34109df0 2024-09-21T03:52:31.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.106+0000 7f3f30ff9640 1 --2- 172.21.15.46:0/1808605761 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f3f1c0b65e0 0x7f3f1c0b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:31.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.107+0000 7f3f337fe640 1 --2- 172.21.15.46:0/1808605761 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f3f1c0b65e0 0x7f3f1c0b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:31.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.107+0000 7f3f30ff9640 1 -- 172.21.15.46:0/1808605761 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f3f2c0e6f80 con 0x7f3f34109df0 2024-09-21T03:52:31.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.107+0000 7f3f337fe640 1 --2- 172.21.15.46:0/1808605761 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f3f1c0b65e0 0x7f3f1c0b8af0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3f24031440 tx=0x7f3f24009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:31.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.111+0000 7f3f30ff9640 1 -- 172.21.15.46:0/1808605761 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3f2c014030 con 0x7f3f34109df0 2024-09-21T03:52:31.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.338+0000 7f3f39eca640 1 -- 172.21.15.46:0/1808605761 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f3402e640 con 0x7f3f34109df0 2024-09-21T03:52:31.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.338+0000 7f3f30ff9640 1 -- 172.21.15.46:0/1808605761 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f3f2c0b1f20 con 0x7f3f34109df0 2024-09-21T03:52:31.340 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:52:31.341 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":1,"btime":"2024-09-21T03:44:31:512068+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-21T03:52:31.341 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 1 2024-09-21T03:52:31.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.340+0000 7f3f39eca640 1 -- 172.21.15.46:0/1808605761 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f3f1c0b65e0 msgr2=0x7f3f1c0b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:31.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.340+0000 7f3f39eca640 1 --2- 172.21.15.46:0/1808605761 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f3f1c0b65e0 0x7f3f1c0b8af0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3f24031440 tx=0x7f3f24009560 comp rx=0 tx=0).stop 2024-09-21T03:52:31.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.340+0000 7f3f39eca640 1 -- 172.21.15.46:0/1808605761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f34109df0 msgr2=0x7f3f3419fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:31.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.340+0000 7f3f39eca640 1 --2- 172.21.15.46:0/1808605761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f34109df0 0x7f3f3419fca0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c00cad0 tx=0x7f3f2c00cf90 comp rx=0 tx=0).stop 2024-09-21T03:52:31.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.340+0000 7f3f39eca640 1 -- 172.21.15.46:0/1808605761 shutdown_connections 2024-09-21T03:52:31.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.340+0000 7f3f39eca640 1 --2- 172.21.15.46:0/1808605761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f34109df0 0x7f3f3419fca0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:31.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.340+0000 7f3f39eca640 1 --2- 172.21.15.46:0/1808605761 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f3f1c0b65e0 0x7f3f1c0b8af0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:31.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.340+0000 7f3f39eca640 1 --2- 172.21.15.46:0/1808605761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f341094a0 0x7f3f3419aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:31.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.340+0000 7f3f39eca640 1 --2- 172.21.15.46:0/1808605761 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f34103b60 0x7f3f3419a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:31.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.340+0000 7f3f39eca640 1 -- 172.21.15.46:0/1808605761 >> 172.21.15.46:0/1808605761 conn(0x7f3f3407b850 msgr2=0x7f3f34107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:31.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.341+0000 7f3f39eca640 1 -- 172.21.15.46:0/1808605761 shutdown_connections 2024-09-21T03:52:31.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:31.341+0000 7f3f39eca640 1 -- 172.21.15.46:0/1808605761 wait complete. 2024-09-21T03:52:31.871 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:31 smithi162 ceph-mon[35071]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:31.872 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:31 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/1808605761' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:52:32.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:31 smithi046 ceph-mon[30954]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:32.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:31 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/1808605761' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:52:32.067 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:31 smithi105 ceph-mon[34773]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:32.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:31 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/1808605761' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:52:32.625 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 21 03:52:32 smithi162 systemd[1]: Started Ceph mds.l for a82de5ec-77cb-11ef-baf5-efdc52797490. 2024-09-21T03:52:33.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:33 smithi046 ceph-mon[30954]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:33.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:33 smithi046 ceph-mon[30954]: mds.? [v2:172.21.15.162:6832/1270522354,v1:172.21.15.162:6833/1270522354] up:boot 2024-09-21T03:52:33.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:33 smithi046 ceph-mon[30954]: fsmap 1 up:standby 2024-09-21T03:52:33.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:33 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T03:52:33.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:33 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:33.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:33 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:33.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:33 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:33.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:33 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:52:33.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:33 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:52:33.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:33 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:33.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:33 smithi046 ceph-mon[30954]: Deploying daemon mds.k on smithi105 2024-09-21T03:52:33.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:33 smithi105 ceph-mon[34773]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:33.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:33 smithi105 ceph-mon[34773]: mds.? [v2:172.21.15.162:6832/1270522354,v1:172.21.15.162:6833/1270522354] up:boot 2024-09-21T03:52:33.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:33 smithi105 ceph-mon[34773]: fsmap 1 up:standby 2024-09-21T03:52:33.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:33 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T03:52:33.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:33 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:33.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:33 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:33.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:33 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:33.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:33 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:52:33.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:33 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:52:33.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:33 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:33.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:33 smithi105 ceph-mon[34773]: Deploying daemon mds.k on smithi105 2024-09-21T03:52:33.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:33 smithi162 ceph-mon[35071]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:33.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:33 smithi162 ceph-mon[35071]: mds.? [v2:172.21.15.162:6832/1270522354,v1:172.21.15.162:6833/1270522354] up:boot 2024-09-21T03:52:33.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:33 smithi162 ceph-mon[35071]: fsmap 1 up:standby 2024-09-21T03:52:33.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:33 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T03:52:33.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:33 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:33.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:33 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:33.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:33 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:33.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:33 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:52:33.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:33 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:52:33.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:33 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:33.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:33 smithi162 ceph-mon[35071]: Deploying daemon mds.k on smithi105 2024-09-21T03:52:34.042 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:52:34.311 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:52:34.318 INFO:journalctl@ceph.mds.k.smithi105.stdout:Sep 21 03:52:34 smithi105 systemd[1]: Starting Ceph mds.k for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T03:52:34.714 INFO:journalctl@ceph.mds.k.smithi105.stdout:Sep 21 03:52:34 smithi105 podman[62900]: 2024-09-21 03:52:34.338361909 +0000 UTC m=+0.016061382 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:52:34.714 INFO:journalctl@ceph.mds.k.smithi105.stdout:Sep 21 03:52:34 smithi105 podman[62900]: 2024-09-21 03:52:34.449487754 +0000 UTC m=+0.127187212 container create 0c584c8e6fd6068fae6c76a5be074dbba8c8c1440ad5c619ed42d277a1488bb0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-k, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-21T03:52:34.714 INFO:journalctl@ceph.mds.k.smithi105.stdout:Sep 21 03:52:34 smithi105 podman[62900]: 2024-09-21 03:52:34.677043612 +0000 UTC m=+0.354743071 container init 0c584c8e6fd6068fae6c76a5be074dbba8c8c1440ad5c619ed42d277a1488bb0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-k, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T03:52:34.715 INFO:journalctl@ceph.mds.k.smithi105.stdout:Sep 21 03:52:34 smithi105 podman[62900]: 2024-09-21 03:52:34.679955162 +0000 UTC m=+0.357654623 container start 0c584c8e6fd6068fae6c76a5be074dbba8c8c1440ad5c619ed42d277a1488bb0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-k, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:52:34.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.838+0000 7f7ebc18d640 1 -- 172.21.15.46:0/2231616194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7eb4108cf0 msgr2=0x7f7eb410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:34.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.838+0000 7f7ebc18d640 1 --2- 172.21.15.46:0/2231616194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7eb4108cf0 0x7f7eb410f520 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7eac009ca0 tx=0x7f7eac02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.838+0000 7f7ebc18d640 1 -- 172.21.15.46:0/2231616194 shutdown_connections 2024-09-21T03:52:34.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.838+0000 7f7ebc18d640 1 --2- 172.21.15.46:0/2231616194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7eb4108cf0 0x7f7eb410f520 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.838+0000 7f7ebc18d640 1 --2- 172.21.15.46:0/2231616194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7eb41083a0 0x7f7eb41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.838+0000 7f7ebc18d640 1 --2- 172.21.15.46:0/2231616194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7eb4102a60 0x7f7eb4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.838+0000 7f7ebc18d640 1 -- 172.21.15.46:0/2231616194 >> 172.21.15.46:0/2231616194 conn(0x7f7eb4079730 msgr2=0x7f7eb4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:34.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.838+0000 7f7ebc18d640 1 -- 172.21.15.46:0/2231616194 shutdown_connections 2024-09-21T03:52:34.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.838+0000 7f7ebc18d640 1 -- 172.21.15.46:0/2231616194 wait complete. 2024-09-21T03:52:34.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.839+0000 7f7ebc18d640 1 Processor -- start 2024-09-21T03:52:34.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.839+0000 7f7ebc18d640 1 -- start start 2024-09-21T03:52:34.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.839+0000 7f7ebc18d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7eb4102a60 0x7f7eb41990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:34.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.839+0000 7f7ebc18d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7eb41083a0 0x7f7eb4199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:34.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.839+0000 7f7ebc18d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7eb4108cf0 0x7f7eb4199b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:34.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.839+0000 7f7ebc18d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb41129c0 con 0x7f7eb4102a60 2024-09-21T03:52:34.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.839+0000 7f7ebc18d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb4112840 con 0x7f7eb41083a0 2024-09-21T03:52:34.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.839+0000 7f7ebc18d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb4112b40 con 0x7f7eb4108cf0 2024-09-21T03:52:34.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.839+0000 7f7eb9f29640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7eb4102a60 0x7f7eb41990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:34.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.839+0000 7f7eb9f29640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7eb4102a60 0x7f7eb41990c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40838/0 (socket says 172.21.15.46:40838) 2024-09-21T03:52:34.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.839+0000 7f7eb9f29640 1 -- 172.21.15.46:0/3708641028 learned_addr learned my addr 172.21.15.46:0/3708641028 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:52:34.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.840+0000 7f7eb9728640 1 --2- 172.21.15.46:0/3708641028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7eb41083a0 0x7f7eb4199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:34.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.840+0000 7f7eba72a640 1 --2- 172.21.15.46:0/3708641028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7eb4108cf0 0x7f7eb4199b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:34.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.840+0000 7f7eb9f29640 1 -- 172.21.15.46:0/3708641028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7eb4108cf0 msgr2=0x7f7eb4199b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:34.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.840+0000 7f7eb9f29640 1 --2- 172.21.15.46:0/3708641028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7eb4108cf0 0x7f7eb4199b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.840+0000 7f7eb9f29640 1 -- 172.21.15.46:0/3708641028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7eb41083a0 msgr2=0x7f7eb4199600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:34.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.840+0000 7f7eb9f29640 1 --2- 172.21.15.46:0/3708641028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7eb41083a0 0x7f7eb4199600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.840+0000 7f7eb9f29640 1 -- 172.21.15.46:0/3708641028 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eb419e3a0 con 0x7f7eb4102a60 2024-09-21T03:52:34.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.840+0000 7f7eb9f29640 1 --2- 172.21.15.46:0/3708641028 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7eb4102a60 0x7f7eb41990c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7eb000d950 tx=0x7f7eb000dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:34.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.843+0000 7f7eaaffd640 1 -- 172.21.15.46:0/3708641028 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0017070 con 0x7f7eb4102a60 2024-09-21T03:52:34.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.843+0000 7f7eaaffd640 1 -- 172.21.15.46:0/3708641028 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7eb000de80 con 0x7f7eb4102a60 2024-09-21T03:52:34.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.843+0000 7f7ebc18d640 1 -- 172.21.15.46:0/3708641028 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7eb419e690 con 0x7f7eb4102a60 2024-09-21T03:52:34.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.843+0000 7f7eaaffd640 1 -- 172.21.15.46:0/3708641028 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb000f620 con 0x7f7eb4102a60 2024-09-21T03:52:34.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.843+0000 7f7ebc18d640 1 -- 172.21.15.46:0/3708641028 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7eb419ec20 con 0x7f7eb4102a60 2024-09-21T03:52:34.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.844+0000 7f7ebc18d640 1 -- 172.21.15.46:0/3708641028 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7eb4102e70 con 0x7f7eb4102a60 2024-09-21T03:52:34.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.846+0000 7f7eaaffd640 1 -- 172.21.15.46:0/3708641028 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f7eb0009c30 con 0x7f7eb4102a60 2024-09-21T03:52:34.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.846+0000 7f7eaaffd640 1 --2- 172.21.15.46:0/3708641028 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7ea00b65e0 0x7f7ea00b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:34.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.847+0000 7f7eb9728640 1 --2- 172.21.15.46:0/3708641028 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7ea00b65e0 0x7f7ea00b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:34.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.847+0000 7f7eaaffd640 1 -- 172.21.15.46:0/3708641028 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f7eb00e6b50 con 0x7f7eb4102a60 2024-09-21T03:52:34.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.847+0000 7f7eb9728640 1 --2- 172.21.15.46:0/3708641028 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7ea00b65e0 0x7f7ea00b8af0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4079d30 tx=0x7f7ea4009110 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:34.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:34.850+0000 7f7eaaffd640 1 -- 172.21.15.46:0/3708641028 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7eb00ad830 con 0x7f7eb4102a60 2024-09-21T03:52:35.068 INFO:journalctl@ceph.mds.k.smithi105.stdout:Sep 21 03:52:34 smithi105 ceph-mds[62920]: -- 172.21.15.105:0/3132668010 <== mon.2 v2:172.21.15.105:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5644f6da7860 con 0x5644faf4fa80 2024-09-21T03:52:35.068 INFO:journalctl@ceph.mds.k.smithi105.stdout:Sep 21 03:52:34 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-k[62916]: starting mds.k at 2024-09-21T03:52:35.068 INFO:journalctl@ceph.mds.k.smithi105.stdout:Sep 21 03:52:34 smithi105 bash[62900]: 0c584c8e6fd6068fae6c76a5be074dbba8c8c1440ad5c619ed42d277a1488bb0 2024-09-21T03:52:35.068 INFO:journalctl@ceph.mds.k.smithi105.stdout:Sep 21 03:52:34 smithi105 systemd[1]: Started Ceph mds.k for a82de5ec-77cb-11ef-baf5-efdc52797490. 2024-09-21T03:52:35.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:35.079+0000 7f7ebc18d640 1 -- 172.21.15.46:0/3708641028 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7eb410a670 con 0x7f7eb4102a60 2024-09-21T03:52:35.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:35.080+0000 7f7eaaffd640 1 -- 172.21.15.46:0/3708641028 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7f7eb00b1c10 con 0x7f7eb4102a60 2024-09-21T03:52:35.082 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:52:35.082 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":2,"btime":"2024-09-21T03:52:32:213371+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T03:52:35.083 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 2 2024-09-21T03:52:35.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:35.082+0000 7f7ebc18d640 1 -- 172.21.15.46:0/3708641028 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7ea00b65e0 msgr2=0x7f7ea00b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:35.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:35.082+0000 7f7ebc18d640 1 --2- 172.21.15.46:0/3708641028 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7ea00b65e0 0x7f7ea00b8af0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4079d30 tx=0x7f7ea4009110 comp rx=0 tx=0).stop 2024-09-21T03:52:35.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:35.082+0000 7f7ebc18d640 1 -- 172.21.15.46:0/3708641028 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7eb4102a60 msgr2=0x7f7eb41990c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:35.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:35.082+0000 7f7ebc18d640 1 --2- 172.21.15.46:0/3708641028 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7eb4102a60 0x7f7eb41990c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7eb000d950 tx=0x7f7eb000dd50 comp rx=0 tx=0).stop 2024-09-21T03:52:35.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:35.082+0000 7f7ebc18d640 1 -- 172.21.15.46:0/3708641028 shutdown_connections 2024-09-21T03:52:35.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:35.082+0000 7f7ebc18d640 1 --2- 172.21.15.46:0/3708641028 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7ea00b65e0 0x7f7ea00b8af0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:35.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:35.082+0000 7f7ebc18d640 1 --2- 172.21.15.46:0/3708641028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7eb4108cf0 0x7f7eb4199b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:35.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:35.082+0000 7f7ebc18d640 1 --2- 172.21.15.46:0/3708641028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7eb41083a0 0x7f7eb4199600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:35.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:35.082+0000 7f7ebc18d640 1 --2- 172.21.15.46:0/3708641028 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7eb4102a60 0x7f7eb41990c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:35.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:35.082+0000 7f7ebc18d640 1 -- 172.21.15.46:0/3708641028 >> 172.21.15.46:0/3708641028 conn(0x7f7eb4079730 msgr2=0x7f7eb41052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:35.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:35.082+0000 7f7ebc18d640 1 -- 172.21.15.46:0/3708641028 shutdown_connections 2024-09-21T03:52:35.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:35.082+0000 7f7ebc18d640 1 -- 172.21.15.46:0/3708641028 wait complete. 2024-09-21T03:52:36.087 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:35 smithi046 ceph-mon[30954]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:36.087 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:35 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:36.087 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:35 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:36.087 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:35 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:36.087 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:35 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:52:36.087 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:35 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:52:36.087 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:35 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:36.087 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:35 smithi046 ceph-mon[30954]: Deploying daemon mds.j on smithi046 2024-09-21T03:52:36.087 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:35 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3708641028' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:52:36.087 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:35 smithi046 ceph-mon[30954]: mds.? [v2:172.21.15.105:6832/3633636261,v1:172.21.15.105:6833/3633636261] up:boot 2024-09-21T03:52:36.087 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:35 smithi046 ceph-mon[30954]: fsmap 2 up:standby 2024-09-21T03:52:36.087 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:35 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T03:52:36.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:35 smithi162 ceph-mon[35071]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:36.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:35 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:36.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:35 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:36.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:35 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:36.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:35 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:52:36.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:35 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:52:36.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:35 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:36.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:35 smithi162 ceph-mon[35071]: Deploying daemon mds.j on smithi046 2024-09-21T03:52:36.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:35 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3708641028' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:52:36.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:35 smithi162 ceph-mon[35071]: mds.? [v2:172.21.15.105:6832/3633636261,v1:172.21.15.105:6833/3633636261] up:boot 2024-09-21T03:52:36.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:35 smithi162 ceph-mon[35071]: fsmap 2 up:standby 2024-09-21T03:52:36.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:35 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T03:52:36.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:35 smithi105 ceph-mon[34773]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:36.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:35 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:36.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:35 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:36.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:35 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:36.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:35 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:52:36.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:35 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:52:36.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:35 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:36.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:35 smithi105 ceph-mon[34773]: Deploying daemon mds.j on smithi046 2024-09-21T03:52:36.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:35 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3708641028' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:52:36.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:35 smithi105 ceph-mon[34773]: mds.? [v2:172.21.15.105:6832/3633636261,v1:172.21.15.105:6833/3633636261] up:boot 2024-09-21T03:52:36.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:35 smithi105 ceph-mon[34773]: fsmap 2 up:standby 2024-09-21T03:52:36.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:35 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T03:52:37.553 INFO:journalctl@ceph.mds.j.smithi046.stdout:Sep 21 03:52:37 smithi046 systemd[1]: Starting Ceph mds.j for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T03:52:37.830 INFO:journalctl@ceph.mds.j.smithi046.stdout:Sep 21 03:52:37 smithi046 podman[72348]: 2024-09-21 03:52:37.678898244 +0000 UTC m=+0.016985606 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:52:37.830 INFO:journalctl@ceph.mds.j.smithi046.stdout:Sep 21 03:52:37 smithi046 podman[72348]: 2024-09-21 03:52:37.777704881 +0000 UTC m=+0.115792278 container create 81f7489c3115c7425173fa3feedd29e23497715ee6a6a801c26e92b91ed39031 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-j, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T03:52:37.856 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:52:38.115 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:37 smithi046 ceph-mon[30954]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:38.116 INFO:journalctl@ceph.mds.j.smithi046.stdout:Sep 21 03:52:38 smithi046 podman[72348]: 2024-09-21 03:52:38.013957037 +0000 UTC m=+0.352044399 container init 81f7489c3115c7425173fa3feedd29e23497715ee6a6a801c26e92b91ed39031 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-21T03:52:38.116 INFO:journalctl@ceph.mds.j.smithi046.stdout:Sep 21 03:52:38 smithi046 podman[72348]: 2024-09-21 03:52:38.01706446 +0000 UTC m=+0.355151813 container start 81f7489c3115c7425173fa3feedd29e23497715ee6a6a801c26e92b91ed39031 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-j, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T03:52:38.116 INFO:journalctl@ceph.mds.j.smithi046.stdout:Sep 21 03:52:38 smithi046 ceph-mds[72385]: -- 172.21.15.46:0/2654708624 <== mon.2 v2:172.21.15.105:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f84d299860 con 0x55f851441a80 2024-09-21T03:52:38.116 INFO:journalctl@ceph.mds.j.smithi046.stdout:Sep 21 03:52:38 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-j[72381]: starting mds.j at 2024-09-21T03:52:38.116 INFO:journalctl@ceph.mds.j.smithi046.stdout:Sep 21 03:52:38 smithi046 bash[72348]: 81f7489c3115c7425173fa3feedd29e23497715ee6a6a801c26e92b91ed39031 2024-09-21T03:52:38.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:37 smithi162 ceph-mon[35071]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:38.207 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:52:38.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:37 smithi105 ceph-mon[34773]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:38.427 INFO:journalctl@ceph.mds.j.smithi046.stdout:Sep 21 03:52:38 smithi046 systemd[1]: Started Ceph mds.j for a82de5ec-77cb-11ef-baf5-efdc52797490. 2024-09-21T03:52:38.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.749+0000 7f046f895640 1 -- 172.21.15.46:0/959698870 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0468109e10 msgr2=0x7f0468110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:38.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.749+0000 7f046f895640 1 --2- 172.21.15.46:0/959698870 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0468109e10 0x7f0468110640 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0460009ca0 tx=0x7f046002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:52:38.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.749+0000 7f046f895640 1 -- 172.21.15.46:0/959698870 shutdown_connections 2024-09-21T03:52:38.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.749+0000 7f046f895640 1 --2- 172.21.15.46:0/959698870 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0468109e10 0x7f0468110640 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:38.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.749+0000 7f046f895640 1 --2- 172.21.15.46:0/959698870 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04681094c0 0x7f04681098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:38.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.749+0000 7f046f895640 1 --2- 172.21.15.46:0/959698870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0468103b80 0x7f0468103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:38.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.749+0000 7f046f895640 1 -- 172.21.15.46:0/959698870 >> 172.21.15.46:0/959698870 conn(0x7f04680ff610 msgr2=0x7f0468101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:38.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.749+0000 7f046f895640 1 -- 172.21.15.46:0/959698870 shutdown_connections 2024-09-21T03:52:38.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.749+0000 7f046f895640 1 -- 172.21.15.46:0/959698870 wait complete. 2024-09-21T03:52:38.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.750+0000 7f046f895640 1 Processor -- start 2024-09-21T03:52:38.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.750+0000 7f046f895640 1 -- start start 2024-09-21T03:52:38.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.750+0000 7f046f895640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0468103b80 0x7f0468075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:38.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.750+0000 7f046f895640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04681094c0 0x7f0468075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:38.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.750+0000 7f046f895640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0468109e10 0x7f0468076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:38.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.750+0000 7f046f895640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0468113ad0 con 0x7f04681094c0 2024-09-21T03:52:38.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.750+0000 7f046f895640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0468113950 con 0x7f0468109e10 2024-09-21T03:52:38.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.750+0000 7f046f895640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0468113c50 con 0x7f0468103b80 2024-09-21T03:52:38.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.751+0000 7f046ce30640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04681094c0 0x7f0468075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:38.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.751+0000 7f046ce30640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04681094c0 0x7f0468075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40890/0 (socket says 172.21.15.46:40890) 2024-09-21T03:52:38.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.751+0000 7f046ce30640 1 -- 172.21.15.46:0/1261264508 learned_addr learned my addr 172.21.15.46:0/1261264508 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:52:38.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.751+0000 7f046de32640 1 --2- 172.21.15.46:0/1261264508 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0468109e10 0x7f0468076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:38.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.751+0000 7f046d631640 1 --2- 172.21.15.46:0/1261264508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0468103b80 0x7f0468075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:38.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.751+0000 7f046ce30640 1 -- 172.21.15.46:0/1261264508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0468103b80 msgr2=0x7f0468075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:38.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.751+0000 7f046ce30640 1 --2- 172.21.15.46:0/1261264508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0468103b80 0x7f0468075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:38.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.751+0000 7f046ce30640 1 -- 172.21.15.46:0/1261264508 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0468109e10 msgr2=0x7f0468076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:38.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.751+0000 7f046ce30640 1 --2- 172.21.15.46:0/1261264508 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0468109e10 0x7f0468076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:38.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.751+0000 7f046ce30640 1 -- 172.21.15.46:0/1261264508 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04681a86e0 con 0x7f04681094c0 2024-09-21T03:52:38.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.751+0000 7f046ce30640 1 --2- 172.21.15.46:0/1261264508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04681094c0 0x7f0468075c50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f046400e9f0 tx=0x7f046400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:38.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.751+0000 7f045a7fc640 1 -- 172.21.15.46:0/1261264508 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046400ccc0 con 0x7f04681094c0 2024-09-21T03:52:38.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.751+0000 7f046f895640 1 -- 172.21.15.46:0/1261264508 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04681a89d0 con 0x7f04681094c0 2024-09-21T03:52:38.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.751+0000 7f045a7fc640 1 -- 172.21.15.46:0/1261264508 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04640108e0 con 0x7f04681094c0 2024-09-21T03:52:38.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.752+0000 7f045a7fc640 1 -- 172.21.15.46:0/1261264508 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0464018860 con 0x7f04681094c0 2024-09-21T03:52:38.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.752+0000 7f046f895640 1 -- 172.21.15.46:0/1261264508 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04681a8f60 con 0x7f04681094c0 2024-09-21T03:52:38.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.753+0000 7f046f895640 1 -- 172.21.15.46:0/1261264508 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0468104e00 con 0x7f04681094c0 2024-09-21T03:52:38.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.754+0000 7f045a7fc640 1 -- 172.21.15.46:0/1261264508 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f0464010430 con 0x7f04681094c0 2024-09-21T03:52:38.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.755+0000 7f045a7fc640 1 --2- 172.21.15.46:0/1261264508 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f04540b64b0 0x7f04540b89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:38.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.756+0000 7f046d631640 1 --2- 172.21.15.46:0/1261264508 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f04540b64b0 0x7f04540b89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:38.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.756+0000 7f045a7fc640 1 -- 172.21.15.46:0/1261264508 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f04640e7290 con 0x7f04681094c0 2024-09-21T03:52:38.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.756+0000 7f046d631640 1 --2- 172.21.15.46:0/1261264508 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f04540b64b0 0x7f04540b89c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0468077160 tx=0x7f045c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:38.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.760+0000 7f045a7fc640 1 -- 172.21.15.46:0/1261264508 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f04640ade50 con 0x7f04681094c0 2024-09-21T03:52:38.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.991+0000 7f046f895640 1 -- 172.21.15.46:0/1261264508 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0468076a10 con 0x7f04681094c0 2024-09-21T03:52:38.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.992+0000 7f045a7fc640 1 -- 172.21.15.46:0/1261264508 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3091 (secure 0 0 0) 0x7f04640b2230 con 0x7f04681094c0 2024-09-21T03:52:38.995 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:52:38.995 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":4,"btime":"2024-09-21T03:52:38:828681+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T03:52:38.995 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 4 2024-09-21T03:52:38.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.994+0000 7f046f895640 1 -- 172.21.15.46:0/1261264508 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f04540b64b0 msgr2=0x7f04540b89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:38.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.994+0000 7f046f895640 1 --2- 172.21.15.46:0/1261264508 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f04540b64b0 0x7f04540b89c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0468077160 tx=0x7f045c005f90 comp rx=0 tx=0).stop 2024-09-21T03:52:38.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.994+0000 7f046f895640 1 -- 172.21.15.46:0/1261264508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04681094c0 msgr2=0x7f0468075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:38.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.994+0000 7f046f895640 1 --2- 172.21.15.46:0/1261264508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04681094c0 0x7f0468075c50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f046400e9f0 tx=0x7f046400eeb0 comp rx=0 tx=0).stop 2024-09-21T03:52:38.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.994+0000 7f046f895640 1 -- 172.21.15.46:0/1261264508 shutdown_connections 2024-09-21T03:52:38.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.994+0000 7f046f895640 1 --2- 172.21.15.46:0/1261264508 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0468109e10 0x7f0468076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:38.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.994+0000 7f046f895640 1 --2- 172.21.15.46:0/1261264508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04681094c0 0x7f0468075c50 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:38.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.994+0000 7f046f895640 1 --2- 172.21.15.46:0/1261264508 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f04540b64b0 0x7f04540b89c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:38.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.994+0000 7f046f895640 1 --2- 172.21.15.46:0/1261264508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0468103b80 0x7f0468075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:38.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.994+0000 7f046f895640 1 -- 172.21.15.46:0/1261264508 >> 172.21.15.46:0/1261264508 conn(0x7f04680ff610 msgr2=0x7f0468106a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:38.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.994+0000 7f046f895640 1 -- 172.21.15.46:0/1261264508 shutdown_connections 2024-09-21T03:52:38.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:38.994+0000 7f046f895640 1 -- 172.21.15.46:0/1261264508 wait complete. 2024-09-21T03:52:39.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:39 smithi046 ceph-mon[30954]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:39.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:39 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:39.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:39 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:39.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:39 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:39.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:39 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:52:39.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:39 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:52:39.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:39 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:39.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:39 smithi046 ceph-mon[30954]: Deploying daemon mds.d on smithi046 2024-09-21T03:52:39.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:39 smithi046 ceph-mon[30954]: mds.? [v2:172.21.15.46:6834/3565344000,v1:172.21.15.46:6835/3565344000] up:boot 2024-09-21T03:52:39.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:39 smithi046 ceph-mon[30954]: fsmap 3 up:standby 2024-09-21T03:52:39.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:39 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T03:52:39.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:39 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/1261264508' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:52:39.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:39 smithi105 ceph-mon[34773]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:39.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:39 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:39.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:39 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:39.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:39 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:39.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:39 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:52:39.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:39 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:52:39.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:39 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:39.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:39 smithi105 ceph-mon[34773]: Deploying daemon mds.d on smithi046 2024-09-21T03:52:39.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:39 smithi105 ceph-mon[34773]: mds.? [v2:172.21.15.46:6834/3565344000,v1:172.21.15.46:6835/3565344000] up:boot 2024-09-21T03:52:39.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:39 smithi105 ceph-mon[34773]: fsmap 3 up:standby 2024-09-21T03:52:39.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:39 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T03:52:39.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:39 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/1261264508' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:52:39.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:39 smithi162 ceph-mon[35071]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:39.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:39 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:39.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:39 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:39.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:39 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:39.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:39 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:52:39.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:39 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:52:39.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:39 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:39.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:39 smithi162 ceph-mon[35071]: Deploying daemon mds.d on smithi046 2024-09-21T03:52:39.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:39 smithi162 ceph-mon[35071]: mds.? [v2:172.21.15.46:6834/3565344000,v1:172.21.15.46:6835/3565344000] up:boot 2024-09-21T03:52:39.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:39 smithi162 ceph-mon[35071]: fsmap 3 up:standby 2024-09-21T03:52:39.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:39 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T03:52:39.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:39 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/1261264508' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:52:41.195 INFO:journalctl@ceph.mds.d.smithi046.stdout:Sep 21 03:52:41 smithi046 systemd[1]: Starting Ceph mds.d for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T03:52:41.459 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:41 smithi046 ceph-mon[30954]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:41.460 INFO:journalctl@ceph.mds.d.smithi046.stdout:Sep 21 03:52:41 smithi046 podman[72743]: 2024-09-21 03:52:41.235156711 +0000 UTC m=+0.016558868 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:52:41.460 INFO:journalctl@ceph.mds.d.smithi046.stdout:Sep 21 03:52:41 smithi046 podman[72743]: 2024-09-21 03:52:41.343792631 +0000 UTC m=+0.125194776 container create 4bd777eda35d9d4f3f29e009087d22bc5267c7f2dbc1f68838b761ea6efd0166 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-d, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True) 2024-09-21T03:52:41.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:41 smithi105 ceph-mon[34773]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:41.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:41 smithi162 ceph-mon[35071]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:41.751 INFO:journalctl@ceph.mds.d.smithi046.stdout:Sep 21 03:52:41 smithi046 podman[72743]: 2024-09-21 03:52:41.579889471 +0000 UTC m=+0.361291624 container init 4bd777eda35d9d4f3f29e009087d22bc5267c7f2dbc1f68838b761ea6efd0166 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:52:41.751 INFO:journalctl@ceph.mds.d.smithi046.stdout:Sep 21 03:52:41 smithi046 podman[72743]: 2024-09-21 03:52:41.582892999 +0000 UTC m=+0.364295156 container start 4bd777eda35d9d4f3f29e009087d22bc5267c7f2dbc1f68838b761ea6efd0166 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-d, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T03:52:41.751 INFO:journalctl@ceph.mds.d.smithi046.stdout:Sep 21 03:52:41 smithi046 ceph-mds[72762]: -- 172.21.15.46:0/830461165 <== mon.0 v2:172.21.15.46:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557b32759c20 con 0x557b36901180 2024-09-21T03:52:41.751 INFO:journalctl@ceph.mds.d.smithi046.stdout:Sep 21 03:52:41 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-d[72758]: starting mds.d at 2024-09-21T03:52:41.752 INFO:journalctl@ceph.mds.d.smithi046.stdout:Sep 21 03:52:41 smithi046 bash[72743]: 4bd777eda35d9d4f3f29e009087d22bc5267c7f2dbc1f68838b761ea6efd0166 2024-09-21T03:52:41.752 INFO:journalctl@ceph.mds.d.smithi046.stdout:Sep 21 03:52:41 smithi046 systemd[1]: Started Ceph mds.d for a82de5ec-77cb-11ef-baf5-efdc52797490. 2024-09-21T03:52:41.803 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:52:42.063 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:52:42.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.577+0000 7f4d2fe33640 1 -- 172.21.15.46:0/3687165044 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d28108cf0 msgr2=0x7f4d2810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:42.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.577+0000 7f4d2fe33640 1 --2- 172.21.15.46:0/3687165044 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d28108cf0 0x7f4d2810f520 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4d20009ca0 tx=0x7f4d2002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:52:42.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.577+0000 7f4d2fe33640 1 -- 172.21.15.46:0/3687165044 shutdown_connections 2024-09-21T03:52:42.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.577+0000 7f4d2fe33640 1 --2- 172.21.15.46:0/3687165044 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d28108cf0 0x7f4d2810f520 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:42.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.577+0000 7f4d2fe33640 1 --2- 172.21.15.46:0/3687165044 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d281083a0 0x7f4d281087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:42.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.577+0000 7f4d2fe33640 1 --2- 172.21.15.46:0/3687165044 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d28102a60 0x7f4d28102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:42.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.577+0000 7f4d2fe33640 1 -- 172.21.15.46:0/3687165044 >> 172.21.15.46:0/3687165044 conn(0x7f4d28079730 msgr2=0x7f4d28079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:42.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.577+0000 7f4d2fe33640 1 -- 172.21.15.46:0/3687165044 shutdown_connections 2024-09-21T03:52:42.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.577+0000 7f4d2fe33640 1 -- 172.21.15.46:0/3687165044 wait complete. 2024-09-21T03:52:42.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.578+0000 7f4d2fe33640 1 Processor -- start 2024-09-21T03:52:42.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.578+0000 7f4d2fe33640 1 -- start start 2024-09-21T03:52:42.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.578+0000 7f4d2fe33640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d28102a60 0x7f4d2819b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:42.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.578+0000 7f4d2fe33640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d281083a0 0x7f4d2819b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:42.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.578+0000 7f4d2fe33640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d28108cf0 0x7f4d2819bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:42.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.578+0000 7f4d2fe33640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4d28112960 con 0x7f4d28102a60 2024-09-21T03:52:42.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.578+0000 7f4d2fe33640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4d281127e0 con 0x7f4d281083a0 2024-09-21T03:52:42.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.578+0000 7f4d2fe33640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4d28112ae0 con 0x7f4d28108cf0 2024-09-21T03:52:42.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.579+0000 7f4d2dbcf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d28102a60 0x7f4d2819b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:42.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.579+0000 7f4d2dbcf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d28102a60 0x7f4d2819b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36058/0 (socket says 172.21.15.46:36058) 2024-09-21T03:52:42.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.579+0000 7f4d2dbcf640 1 -- 172.21.15.46:0/1602506681 learned_addr learned my addr 172.21.15.46:0/1602506681 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:52:42.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.579+0000 7f4d2e3d0640 1 --2- 172.21.15.46:0/1602506681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d28108cf0 0x7f4d2819bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:42.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.579+0000 7f4d2d3ce640 1 --2- 172.21.15.46:0/1602506681 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d281083a0 0x7f4d2819b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:42.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.579+0000 7f4d2dbcf640 1 -- 172.21.15.46:0/1602506681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d28108cf0 msgr2=0x7f4d2819bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:42.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.579+0000 7f4d2dbcf640 1 --2- 172.21.15.46:0/1602506681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d28108cf0 0x7f4d2819bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:42.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.579+0000 7f4d2dbcf640 1 -- 172.21.15.46:0/1602506681 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d281083a0 msgr2=0x7f4d2819b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:42.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.579+0000 7f4d2dbcf640 1 --2- 172.21.15.46:0/1602506681 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d281083a0 0x7f4d2819b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:42.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.579+0000 7f4d2dbcf640 1 -- 172.21.15.46:0/1602506681 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d281a65a0 con 0x7f4d28102a60 2024-09-21T03:52:42.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.579+0000 7f4d2dbcf640 1 --2- 172.21.15.46:0/1602506681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d28102a60 0x7f4d2819b310 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4d2400d950 tx=0x7f4d2400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:42.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.579+0000 7f4d1effd640 1 -- 172.21.15.46:0/1602506681 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d24017070 con 0x7f4d28102a60 2024-09-21T03:52:42.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.579+0000 7f4d2fe33640 1 -- 172.21.15.46:0/1602506681 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d281a6890 con 0x7f4d28102a60 2024-09-21T03:52:42.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.579+0000 7f4d1effd640 1 -- 172.21.15.46:0/1602506681 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d24009c30 con 0x7f4d28102a60 2024-09-21T03:52:42.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.579+0000 7f4d1effd640 1 -- 172.21.15.46:0/1602506681 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2400f620 con 0x7f4d28102a60 2024-09-21T03:52:42.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.579+0000 7f4d2fe33640 1 -- 172.21.15.46:0/1602506681 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d281a6dd0 con 0x7f4d28102a60 2024-09-21T03:52:42.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.580+0000 7f4d2fe33640 1 -- 172.21.15.46:0/1602506681 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d28102e70 con 0x7f4d28102a60 2024-09-21T03:52:42.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.583+0000 7f4d1effd640 1 -- 172.21.15.46:0/1602506681 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f4d24005030 con 0x7f4d28102a60 2024-09-21T03:52:42.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.584+0000 7f4d1effd640 1 --2- 172.21.15.46:0/1602506681 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4d140b6590 0x7f4d140b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:42.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.584+0000 7f4d2d3ce640 1 --2- 172.21.15.46:0/1602506681 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4d140b6590 0x7f4d140b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:42.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.584+0000 7f4d1effd640 1 -- 172.21.15.46:0/1602506681 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f4d240e6ce0 con 0x7f4d28102a60 2024-09-21T03:52:42.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.584+0000 7f4d2d3ce640 1 --2- 172.21.15.46:0/1602506681 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4d140b6590 0x7f4d140b8aa0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4d18005d90 tx=0x7f4d18005d20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:42.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.587+0000 7f4d1effd640 1 -- 172.21.15.46:0/1602506681 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4d240ad8a0 con 0x7f4d28102a60 2024-09-21T03:52:42.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:42 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:42.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:42 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:42.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:42 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:42.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:42 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:52:42.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:42 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:52:42.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:42 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:42.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:42 smithi046 ceph-mon[30954]: Deploying daemon mds.e on smithi105 2024-09-21T03:52:42.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:42 smithi046 ceph-mon[30954]: mds.? [v2:172.21.15.46:6836/1276108734,v1:172.21.15.46:6837/1276108734] up:boot 2024-09-21T03:52:42.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:42 smithi046 ceph-mon[30954]: fsmap 4 up:standby 2024-09-21T03:52:42.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:42 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T03:52:42.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.814+0000 7f4d2fe33640 1 -- 172.21.15.46:0/1602506681 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d2806b270 con 0x7f4d28102a60 2024-09-21T03:52:42.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.814+0000 7f4d1effd640 1 -- 172.21.15.46:0/1602506681 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3916 (secure 0 0 0) 0x7f4d240d0020 con 0x7f4d28102a60 2024-09-21T03:52:42.817 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:52:42.817 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":5,"btime":"2024-09-21T03:52:42:193326+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T03:52:42.817 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 5 2024-09-21T03:52:42.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.816+0000 7f4d2fe33640 1 -- 172.21.15.46:0/1602506681 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4d140b6590 msgr2=0x7f4d140b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:42.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.816+0000 7f4d2fe33640 1 --2- 172.21.15.46:0/1602506681 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4d140b6590 0x7f4d140b8aa0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4d18005d90 tx=0x7f4d18005d20 comp rx=0 tx=0).stop 2024-09-21T03:52:42.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.816+0000 7f4d2fe33640 1 -- 172.21.15.46:0/1602506681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d28102a60 msgr2=0x7f4d2819b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:42.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.816+0000 7f4d2fe33640 1 --2- 172.21.15.46:0/1602506681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d28102a60 0x7f4d2819b310 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4d2400d950 tx=0x7f4d2400de10 comp rx=0 tx=0).stop 2024-09-21T03:52:42.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.817+0000 7f4d2fe33640 1 -- 172.21.15.46:0/1602506681 shutdown_connections 2024-09-21T03:52:42.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.817+0000 7f4d2fe33640 1 --2- 172.21.15.46:0/1602506681 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4d140b6590 0x7f4d140b8aa0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:42.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.817+0000 7f4d2fe33640 1 --2- 172.21.15.46:0/1602506681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d28108cf0 0x7f4d2819bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:42.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.817+0000 7f4d2fe33640 1 --2- 172.21.15.46:0/1602506681 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d281083a0 0x7f4d2819b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:42.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.817+0000 7f4d2fe33640 1 --2- 172.21.15.46:0/1602506681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d28102a60 0x7f4d2819b310 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:42.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.817+0000 7f4d2fe33640 1 -- 172.21.15.46:0/1602506681 >> 172.21.15.46:0/1602506681 conn(0x7f4d28079730 msgr2=0x7f4d28104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:42.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.817+0000 7f4d2fe33640 1 -- 172.21.15.46:0/1602506681 shutdown_connections 2024-09-21T03:52:42.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:42.817+0000 7f4d2fe33640 1 -- 172.21.15.46:0/1602506681 wait complete. 2024-09-21T03:52:43.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:42 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:43.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:42 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:43.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:42 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:43.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:42 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:52:43.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:42 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:52:43.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:42 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:43.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:42 smithi105 ceph-mon[34773]: Deploying daemon mds.e on smithi105 2024-09-21T03:52:43.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:42 smithi105 ceph-mon[34773]: mds.? [v2:172.21.15.46:6836/1276108734,v1:172.21.15.46:6837/1276108734] up:boot 2024-09-21T03:52:43.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:42 smithi105 ceph-mon[34773]: fsmap 4 up:standby 2024-09-21T03:52:43.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:42 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T03:52:43.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:42 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:43.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:42 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:43.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:42 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:43.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:42 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:52:43.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:42 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:52:43.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:42 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:43.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:42 smithi162 ceph-mon[35071]: Deploying daemon mds.e on smithi105 2024-09-21T03:52:43.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:42 smithi162 ceph-mon[35071]: mds.? [v2:172.21.15.46:6836/1276108734,v1:172.21.15.46:6837/1276108734] up:boot 2024-09-21T03:52:43.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:42 smithi162 ceph-mon[35071]: fsmap 4 up:standby 2024-09-21T03:52:43.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:42 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T03:52:43.989 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:43 smithi105 ceph-mon[34773]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:43.989 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:43 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/1602506681' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:52:43.989 INFO:journalctl@ceph.mds.e.smithi105.stdout:Sep 21 03:52:43 smithi105 systemd[1]: Starting Ceph mds.e for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T03:52:44.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:43 smithi046 ceph-mon[30954]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:44.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:43 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/1602506681' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:52:44.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:43 smithi162 ceph-mon[35071]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:44.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:43 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/1602506681' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:52:44.269 INFO:journalctl@ceph.mds.e.smithi105.stdout:Sep 21 03:52:43 smithi105 podman[63185]: 2024-09-21 03:52:43.890453063 +0000 UTC m=+0.028675976 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:52:44.269 INFO:journalctl@ceph.mds.e.smithi105.stdout:Sep 21 03:52:44 smithi105 podman[63185]: 2024-09-21 03:52:44.013570223 +0000 UTC m=+0.151793127 container create b46c8015761794af4ff000a5c63390113df4f55089312e27fa1d14a30d433342 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:52:44.269 INFO:journalctl@ceph.mds.e.smithi105.stdout:Sep 21 03:52:44 smithi105 podman[63185]: 2024-09-21 03:52:44.231614873 +0000 UTC m=+0.369837777 container init b46c8015761794af4ff000a5c63390113df4f55089312e27fa1d14a30d433342 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-e, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T03:52:44.269 INFO:journalctl@ceph.mds.e.smithi105.stdout:Sep 21 03:52:44 smithi105 podman[63185]: 2024-09-21 03:52:44.234354124 +0000 UTC m=+0.372577029 container start b46c8015761794af4ff000a5c63390113df4f55089312e27fa1d14a30d433342 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-e, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T03:52:44.269 INFO:journalctl@ceph.mds.e.smithi105.stdout:Sep 21 03:52:44 smithi105 ceph-mds[63203]: -- 172.21.15.105:0/2953308068 <== mon.2 v2:172.21.15.105:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563215fad860 con 0x56321a155600 2024-09-21T03:52:44.568 INFO:journalctl@ceph.mds.e.smithi105.stdout:Sep 21 03:52:44 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-e[63199]: starting mds.e at 2024-09-21T03:52:44.568 INFO:journalctl@ceph.mds.e.smithi105.stdout:Sep 21 03:52:44 smithi105 bash[63185]: b46c8015761794af4ff000a5c63390113df4f55089312e27fa1d14a30d433342 2024-09-21T03:52:44.568 INFO:journalctl@ceph.mds.e.smithi105.stdout:Sep 21 03:52:44 smithi105 systemd[1]: Started Ceph mds.e for a82de5ec-77cb-11ef-baf5-efdc52797490. 2024-09-21T03:52:45.482 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:52:45.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:45 smithi162 ceph-mon[35071]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:45.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:45 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:45.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:45 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:45.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:45 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:45.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:45 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:52:45.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:45 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:52:45.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:45 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:45.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:45 smithi162 ceph-mon[35071]: Deploying daemon mds.f on smithi162 2024-09-21T03:52:45.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:45 smithi162 ceph-mon[35071]: mds.? [v2:172.21.15.105:6834/1564869545,v1:172.21.15.105:6835/1564869545] up:boot 2024-09-21T03:52:45.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:45 smithi162 ceph-mon[35071]: fsmap 5 up:standby 2024-09-21T03:52:45.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:45 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T03:52:45.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:45 smithi046 ceph-mon[30954]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:45.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:45 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:45.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:45 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:45.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:45 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:45.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:45 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:52:45.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:45 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:52:45.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:45 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:45.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:45 smithi046 ceph-mon[30954]: Deploying daemon mds.f on smithi162 2024-09-21T03:52:45.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:45 smithi046 ceph-mon[30954]: mds.? [v2:172.21.15.105:6834/1564869545,v1:172.21.15.105:6835/1564869545] up:boot 2024-09-21T03:52:45.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:45 smithi046 ceph-mon[30954]: fsmap 5 up:standby 2024-09-21T03:52:45.753 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:45 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T03:52:45.754 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:52:45.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:45 smithi105 ceph-mon[34773]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:45.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:45 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:45.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:45 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:45.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:45 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:45.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:45 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:52:45.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:45 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:52:45.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:45 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:45.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:45 smithi105 ceph-mon[34773]: Deploying daemon mds.f on smithi162 2024-09-21T03:52:45.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:45 smithi105 ceph-mon[34773]: mds.? [v2:172.21.15.105:6834/1564869545,v1:172.21.15.105:6835/1564869545] up:boot 2024-09-21T03:52:45.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:45 smithi105 ceph-mon[34773]: fsmap 5 up:standby 2024-09-21T03:52:45.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:45 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T03:52:46.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.286+0000 7fca752ee640 1 -- 172.21.15.46:0/353480916 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca701083b0 msgr2=0x7fca701087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:46.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.286+0000 7fca752ee640 1 --2- 172.21.15.46:0/353480916 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca701083b0 0x7fca701087c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fca64009900 tx=0x7fca6402a410 comp rx=0 tx=0).stop 2024-09-21T03:52:46.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.286+0000 7fca752ee640 1 -- 172.21.15.46:0/353480916 shutdown_connections 2024-09-21T03:52:46.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.286+0000 7fca752ee640 1 --2- 172.21.15.46:0/353480916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca70108d00 0x7fca7010f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:46.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.286+0000 7fca752ee640 1 --2- 172.21.15.46:0/353480916 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca701083b0 0x7fca701087c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:46.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.286+0000 7fca752ee640 1 --2- 172.21.15.46:0/353480916 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca70102a70 0x7fca70102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:46.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.286+0000 7fca752ee640 1 -- 172.21.15.46:0/353480916 >> 172.21.15.46:0/353480916 conn(0x7fca70079730 msgr2=0x7fca70079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:46.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.286+0000 7fca752ee640 1 -- 172.21.15.46:0/353480916 shutdown_connections 2024-09-21T03:52:46.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.286+0000 7fca752ee640 1 -- 172.21.15.46:0/353480916 wait complete. 2024-09-21T03:52:46.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.287+0000 7fca752ee640 1 Processor -- start 2024-09-21T03:52:46.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.287+0000 7fca752ee640 1 -- start start 2024-09-21T03:52:46.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.287+0000 7fca752ee640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca70102a70 0x7fca7019b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:46.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.287+0000 7fca752ee640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca701083b0 0x7fca7019b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:46.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.287+0000 7fca752ee640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca70108d00 0x7fca7019bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:46.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.287+0000 7fca752ee640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fca70112970 con 0x7fca70108d00 2024-09-21T03:52:46.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.287+0000 7fca752ee640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fca701127f0 con 0x7fca70102a70 2024-09-21T03:52:46.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.287+0000 7fca752ee640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fca70112af0 con 0x7fca701083b0 2024-09-21T03:52:46.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.287+0000 7fca6f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca70108d00 0x7fca7019bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:46.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.287+0000 7fca6f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca70108d00 0x7fca7019bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36080/0 (socket says 172.21.15.46:36080) 2024-09-21T03:52:46.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.287+0000 7fca6f7fe640 1 -- 172.21.15.46:0/241198788 learned_addr learned my addr 172.21.15.46:0/241198788 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:52:46.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.288+0000 7fca6e7fc640 1 --2- 172.21.15.46:0/241198788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca701083b0 0x7fca7019b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:46.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.288+0000 7fca6effd640 1 --2- 172.21.15.46:0/241198788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca70102a70 0x7fca7019b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:46.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.288+0000 7fca6f7fe640 1 -- 172.21.15.46:0/241198788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca701083b0 msgr2=0x7fca7019b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:46.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.288+0000 7fca6f7fe640 1 --2- 172.21.15.46:0/241198788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca701083b0 0x7fca7019b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:46.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.288+0000 7fca6f7fe640 1 -- 172.21.15.46:0/241198788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca70102a70 msgr2=0x7fca7019b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:46.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.288+0000 7fca6f7fe640 1 --2- 172.21.15.46:0/241198788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca70102a70 0x7fca7019b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:46.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.288+0000 7fca6f7fe640 1 -- 172.21.15.46:0/241198788 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca701a6580 con 0x7fca70108d00 2024-09-21T03:52:46.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.288+0000 7fca6effd640 1 --2- 172.21.15.46:0/241198788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca70102a70 0x7fca7019b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:52:46.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.288+0000 7fca6f7fe640 1 --2- 172.21.15.46:0/241198788 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca70108d00 0x7fca7019bd40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fca6800d950 tx=0x7fca6800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:46.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.288+0000 7fca57fff640 1 -- 172.21.15.46:0/241198788 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca68017030 con 0x7fca70108d00 2024-09-21T03:52:46.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.288+0000 7fca57fff640 1 -- 172.21.15.46:0/241198788 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca68004020 con 0x7fca70108d00 2024-09-21T03:52:46.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.288+0000 7fca752ee640 1 -- 172.21.15.46:0/241198788 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca701a6870 con 0x7fca70108d00 2024-09-21T03:52:46.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.288+0000 7fca57fff640 1 -- 172.21.15.46:0/241198788 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca68003b50 con 0x7fca70108d00 2024-09-21T03:52:46.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.288+0000 7fca752ee640 1 -- 172.21.15.46:0/241198788 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca701a6d30 con 0x7fca70108d00 2024-09-21T03:52:46.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.289+0000 7fca752ee640 1 -- 172.21.15.46:0/241198788 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca70103cf0 con 0x7fca70108d00 2024-09-21T03:52:46.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.291+0000 7fca57fff640 1 -- 172.21.15.46:0/241198788 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fca6801a070 con 0x7fca70108d00 2024-09-21T03:52:46.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.291+0000 7fca57fff640 1 --2- 172.21.15.46:0/241198788 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fca580b6560 0x7fca580b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:46.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.292+0000 7fca6effd640 1 --2- 172.21.15.46:0/241198788 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fca580b6560 0x7fca580b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:46.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.292+0000 7fca57fff640 1 -- 172.21.15.46:0/241198788 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fca680e6af0 con 0x7fca70108d00 2024-09-21T03:52:46.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.292+0000 7fca6effd640 1 --2- 172.21.15.46:0/241198788 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fca580b6560 0x7fca580b8a70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fca7006c660 tx=0x7fca60009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:46.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.294+0000 7fca57fff640 1 -- 172.21.15.46:0/241198788 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fca68021070 con 0x7fca70108d00 2024-09-21T03:52:46.376 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 21 03:52:46 smithi162 systemd[1]: Starting Ceph mds.f for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T03:52:46.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.522+0000 7fca752ee640 1 -- 172.21.15.46:0/241198788 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca70102e80 con 0x7fca70108d00 2024-09-21T03:52:46.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.522+0000 7fca57fff640 1 -- 172.21.15.46:0/241198788 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4744 (secure 0 0 0) 0x7fca70102e80 con 0x7fca70108d00 2024-09-21T03:52:46.525 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:52:46.525 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":6,"btime":"2024-09-21T03:52:44:746992+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-21T03:52:46.525 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 6 2024-09-21T03:52:46.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.525+0000 7fca752ee640 1 -- 172.21.15.46:0/241198788 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fca580b6560 msgr2=0x7fca580b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:46.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.525+0000 7fca752ee640 1 --2- 172.21.15.46:0/241198788 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fca580b6560 0x7fca580b8a70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fca7006c660 tx=0x7fca60009500 comp rx=0 tx=0).stop 2024-09-21T03:52:46.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.525+0000 7fca752ee640 1 -- 172.21.15.46:0/241198788 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca70108d00 msgr2=0x7fca7019bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:46.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.525+0000 7fca752ee640 1 --2- 172.21.15.46:0/241198788 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca70108d00 0x7fca7019bd40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fca6800d950 tx=0x7fca6800de10 comp rx=0 tx=0).stop 2024-09-21T03:52:46.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.525+0000 7fca752ee640 1 -- 172.21.15.46:0/241198788 shutdown_connections 2024-09-21T03:52:46.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.525+0000 7fca752ee640 1 --2- 172.21.15.46:0/241198788 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca70108d00 0x7fca7019bd40 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:46.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.525+0000 7fca752ee640 1 --2- 172.21.15.46:0/241198788 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fca580b6560 0x7fca580b8a70 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:46.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.525+0000 7fca752ee640 1 --2- 172.21.15.46:0/241198788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca701083b0 0x7fca7019b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:46.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.525+0000 7fca752ee640 1 --2- 172.21.15.46:0/241198788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca70102a70 0x7fca7019b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:46.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.525+0000 7fca752ee640 1 -- 172.21.15.46:0/241198788 >> 172.21.15.46:0/241198788 conn(0x7fca70079730 msgr2=0x7fca70104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:46.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.525+0000 7fca752ee640 1 -- 172.21.15.46:0/241198788 shutdown_connections 2024-09-21T03:52:46.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:46.525+0000 7fca752ee640 1 -- 172.21.15.46:0/241198788 wait complete. 2024-09-21T03:52:46.777 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 21 03:52:46 smithi162 podman[63780]: 2024-09-21 03:52:46.411433171 +0000 UTC m=+0.015735424 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:52:46.777 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 21 03:52:46 smithi162 podman[63780]: 2024-09-21 03:52:46.5474302 +0000 UTC m=+0.151732452 container create a992339f779d86189ee100d65351200579dfe31818987ee92a7d4d3a9cfb9efa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-f, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T03:52:46.777 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 21 03:52:46 smithi162 podman[63780]: 2024-09-21 03:52:46.775217189 +0000 UTC m=+0.379519442 container init a992339f779d86189ee100d65351200579dfe31818987ee92a7d4d3a9cfb9efa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-f, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-21T03:52:47.126 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 21 03:52:46 smithi162 podman[63780]: 2024-09-21 03:52:46.778299097 +0000 UTC m=+0.382601351 container start a992339f779d86189ee100d65351200579dfe31818987ee92a7d4d3a9cfb9efa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T03:52:47.126 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 21 03:52:46 smithi162 ceph-mds[63799]: -- 172.21.15.162:0/2776368759 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56488489f860 con 0x564888a47600 2024-09-21T03:52:47.126 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 21 03:52:46 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-f[63795]: starting mds.f at 2024-09-21T03:52:47.126 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 21 03:52:46 smithi162 bash[63780]: a992339f779d86189ee100d65351200579dfe31818987ee92a7d4d3a9cfb9efa 2024-09-21T03:52:47.126 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 21 03:52:46 smithi162 systemd[1]: Started Ceph mds.f for a82de5ec-77cb-11ef-baf5-efdc52797490. 2024-09-21T03:52:47.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:47 smithi046 ceph-mon[30954]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:47.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:47 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/241198788' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:52:47.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:47 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:47.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:47 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:47.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:47 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:47.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:47 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:52:47.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:47 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:52:47.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:47 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:47.605 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:47 smithi162 ceph-mon[35071]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:47.606 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:47 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/241198788' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:52:47.606 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:47 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:47.606 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:47 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:47.606 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:47 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:47.606 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:47 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:52:47.606 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:47 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:52:47.606 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:47 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:47.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:47 smithi105 ceph-mon[34773]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:47.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:47 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/241198788' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:52:47.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:47 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:47.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:47 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:47.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:47 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:47.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:47 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:52:47.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:47 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:52:47.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:47 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:48.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:48 smithi162 ceph-mon[35071]: Deploying daemon mds.c on smithi162 2024-09-21T03:52:48.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:48 smithi162 ceph-mon[35071]: mds.? [v2:172.21.15.162:6834/3551934241,v1:172.21.15.162:6835/3551934241] up:boot 2024-09-21T03:52:48.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:48 smithi162 ceph-mon[35071]: fsmap 6 up:standby 2024-09-21T03:52:48.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:48 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T03:52:48.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:48 smithi046 ceph-mon[30954]: Deploying daemon mds.c on smithi162 2024-09-21T03:52:48.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:48 smithi046 ceph-mon[30954]: mds.? [v2:172.21.15.162:6834/3551934241,v1:172.21.15.162:6835/3551934241] up:boot 2024-09-21T03:52:48.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:48 smithi046 ceph-mon[30954]: fsmap 6 up:standby 2024-09-21T03:52:48.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:48 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T03:52:48.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:48 smithi105 ceph-mon[34773]: Deploying daemon mds.c on smithi162 2024-09-21T03:52:48.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:48 smithi105 ceph-mon[34773]: mds.? [v2:172.21.15.162:6834/3551934241,v1:172.21.15.162:6835/3551934241] up:boot 2024-09-21T03:52:48.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:48 smithi105 ceph-mon[34773]: fsmap 6 up:standby 2024-09-21T03:52:48.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:48 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T03:52:49.054 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 21 03:52:48 smithi162 systemd[1]: Starting Ceph mds.c for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T03:52:49.191 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:52:49.357 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 21 03:52:49 smithi162 podman[64050]: 2024-09-21 03:52:48.955351364 +0000 UTC m=+0.016399981 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:52:49.357 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 21 03:52:49 smithi162 podman[64050]: 2024-09-21 03:52:49.094380204 +0000 UTC m=+0.155428860 container create 88adc97adf03b19d4a34b667fc7218a3b68e4486d056ba6bfd34699a77648cc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-c, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True) 2024-09-21T03:52:49.357 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 21 03:52:49 smithi162 podman[64050]: 2024-09-21 03:52:49.355508945 +0000 UTC m=+0.416557555 container init 88adc97adf03b19d4a34b667fc7218a3b68e4486d056ba6bfd34699a77648cc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-c, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-21T03:52:49.464 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:52:49.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:49 smithi046 ceph-mon[30954]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:49.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:49 smithi162 ceph-mon[35071]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:49.626 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 21 03:52:49 smithi162 podman[64050]: 2024-09-21 03:52:49.358593417 +0000 UTC m=+0.419642037 container start 88adc97adf03b19d4a34b667fc7218a3b68e4486d056ba6bfd34699a77648cc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-c, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T03:52:49.626 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 21 03:52:49 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-c[64066]: starting mds.c at 2024-09-21T03:52:49.626 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 21 03:52:49 smithi162 bash[64050]: 88adc97adf03b19d4a34b667fc7218a3b68e4486d056ba6bfd34699a77648cc5 2024-09-21T03:52:49.626 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 21 03:52:49 smithi162 systemd[1]: Started Ceph mds.c for a82de5ec-77cb-11ef-baf5-efdc52797490. 2024-09-21T03:52:49.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:49 smithi105 ceph-mon[34773]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:50.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.006+0000 7fdc5c76a640 1 -- 172.21.15.46:0/631765327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc541083a0 msgr2=0x7fdc541087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:50.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.006+0000 7fdc5c76a640 1 --2- 172.21.15.46:0/631765327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc541083a0 0x7fdc541087b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdc44009900 tx=0x7fdc4402a410 comp rx=0 tx=0).stop 2024-09-21T03:52:50.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.007+0000 7fdc5c76a640 1 -- 172.21.15.46:0/631765327 shutdown_connections 2024-09-21T03:52:50.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.007+0000 7fdc5c76a640 1 --2- 172.21.15.46:0/631765327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc54108cf0 0x7fdc5410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:50.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.007+0000 7fdc5c76a640 1 --2- 172.21.15.46:0/631765327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc541083a0 0x7fdc541087b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:50.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.007+0000 7fdc5c76a640 1 --2- 172.21.15.46:0/631765327 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc54102a60 0x7fdc54102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:50.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.007+0000 7fdc5c76a640 1 -- 172.21.15.46:0/631765327 >> 172.21.15.46:0/631765327 conn(0x7fdc54079730 msgr2=0x7fdc54079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:50.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.007+0000 7fdc5c76a640 1 -- 172.21.15.46:0/631765327 shutdown_connections 2024-09-21T03:52:50.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.007+0000 7fdc5c76a640 1 -- 172.21.15.46:0/631765327 wait complete. 2024-09-21T03:52:50.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.008+0000 7fdc5c76a640 1 Processor -- start 2024-09-21T03:52:50.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.008+0000 7fdc5c76a640 1 -- start start 2024-09-21T03:52:50.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.008+0000 7fdc5c76a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc54102a60 0x7fdc54199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:50.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.008+0000 7fdc5c76a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc541083a0 0x7fdc54199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:50.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.008+0000 7fdc5c76a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc54108cf0 0x7fdc5419ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:50.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.008+0000 7fdc5c76a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdc541129b0 con 0x7fdc54102a60 2024-09-21T03:52:50.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.008+0000 7fdc5c76a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdc54112830 con 0x7fdc541083a0 2024-09-21T03:52:50.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.008+0000 7fdc5c76a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdc54112b30 con 0x7fdc54108cf0 2024-09-21T03:52:50.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.008+0000 7fdc5a506640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc54102a60 0x7fdc54199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:50.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.008+0000 7fdc5a506640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc54102a60 0x7fdc54199380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36088/0 (socket says 172.21.15.46:36088) 2024-09-21T03:52:50.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.008+0000 7fdc5a506640 1 -- 172.21.15.46:0/2358250819 learned_addr learned my addr 172.21.15.46:0/2358250819 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:52:50.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.008+0000 7fdc59d05640 1 --2- 172.21.15.46:0/2358250819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc541083a0 0x7fdc54199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:50.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.009+0000 7fdc5ad07640 1 --2- 172.21.15.46:0/2358250819 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc54108cf0 0x7fdc5419ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:50.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.009+0000 7fdc5a506640 1 -- 172.21.15.46:0/2358250819 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc54108cf0 msgr2=0x7fdc5419ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:50.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.009+0000 7fdc5a506640 1 --2- 172.21.15.46:0/2358250819 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc54108cf0 0x7fdc5419ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:50.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.009+0000 7fdc5a506640 1 -- 172.21.15.46:0/2358250819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc541083a0 msgr2=0x7fdc54199920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:50.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.009+0000 7fdc5a506640 1 --2- 172.21.15.46:0/2358250819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc541083a0 0x7fdc54199920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:50.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.009+0000 7fdc5a506640 1 -- 172.21.15.46:0/2358250819 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc5419f230 con 0x7fdc54102a60 2024-09-21T03:52:50.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.009+0000 7fdc59d05640 1 --2- 172.21.15.46:0/2358250819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc541083a0 0x7fdc54199920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:52:50.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.009+0000 7fdc5a506640 1 --2- 172.21.15.46:0/2358250819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc54102a60 0x7fdc54199380 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000c920 tx=0x7fdc5000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:50.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.009+0000 7fdc4b7fe640 1 -- 172.21.15.46:0/2358250819 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc50007c70 con 0x7fdc54102a60 2024-09-21T03:52:50.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.009+0000 7fdc5c76a640 1 -- 172.21.15.46:0/2358250819 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc5419f520 con 0x7fdc54102a60 2024-09-21T03:52:50.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.009+0000 7fdc4b7fe640 1 -- 172.21.15.46:0/2358250819 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc50007e10 con 0x7fdc54102a60 2024-09-21T03:52:50.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.009+0000 7fdc4b7fe640 1 -- 172.21.15.46:0/2358250819 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc50018820 con 0x7fdc54102a60 2024-09-21T03:52:50.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.009+0000 7fdc5c76a640 1 -- 172.21.15.46:0/2358250819 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc541a5d40 con 0x7fdc54102a60 2024-09-21T03:52:50.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.010+0000 7fdc5c76a640 1 -- 172.21.15.46:0/2358250819 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc54102e70 con 0x7fdc54102a60 2024-09-21T03:52:50.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.012+0000 7fdc4b7fe640 1 -- 172.21.15.46:0/2358250819 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fdc5000f450 con 0x7fdc54102a60 2024-09-21T03:52:50.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.013+0000 7fdc4b7fe640 1 --2- 172.21.15.46:0/2358250819 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fdc400b6590 0x7fdc400b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:50.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.013+0000 7fdc4b7fe640 1 -- 172.21.15.46:0/2358250819 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fdc500e7430 con 0x7fdc54102a60 2024-09-21T03:52:50.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.013+0000 7fdc59d05640 1 --2- 172.21.15.46:0/2358250819 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fdc400b6590 0x7fdc400b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:50.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.013+0000 7fdc59d05640 1 --2- 172.21.15.46:0/2358250819 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fdc400b6590 0x7fdc400b8aa0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdc44006010 tx=0x7fdc44000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:50.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.020+0000 7fdc4b7fe640 1 -- 172.21.15.46:0/2358250819 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdc50014030 con 0x7fdc54102a60 2024-09-21T03:52:50.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.248+0000 7fdc5c76a640 1 -- 172.21.15.46:0/2358250819 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc5419a4b0 con 0x7fdc54102a60 2024-09-21T03:52:50.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.249+0000 7fdc4b7fe640 1 -- 172.21.15.46:0/2358250819 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5572 (secure 0 0 0) 0x7fdc500ae120 con 0x7fdc54102a60 2024-09-21T03:52:50.252 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:52:50.252 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":7,"btime":"2024-09-21T03:52:47:374599+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24652,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3551934241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3551934241},{"type":"v1","addr":"172.21.15.162:6835","nonce":3551934241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-21T03:52:50.253 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 7 2024-09-21T03:52:50.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.251+0000 7fdc5c76a640 1 -- 172.21.15.46:0/2358250819 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fdc400b6590 msgr2=0x7fdc400b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:50.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.251+0000 7fdc5c76a640 1 --2- 172.21.15.46:0/2358250819 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fdc400b6590 0x7fdc400b8aa0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdc44006010 tx=0x7fdc44000bc0 comp rx=0 tx=0).stop 2024-09-21T03:52:50.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.251+0000 7fdc5c76a640 1 -- 172.21.15.46:0/2358250819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc54102a60 msgr2=0x7fdc54199380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:50.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.251+0000 7fdc5c76a640 1 --2- 172.21.15.46:0/2358250819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc54102a60 0x7fdc54199380 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000c920 tx=0x7fdc5000cde0 comp rx=0 tx=0).stop 2024-09-21T03:52:50.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.251+0000 7fdc5c76a640 1 -- 172.21.15.46:0/2358250819 shutdown_connections 2024-09-21T03:52:50.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.251+0000 7fdc5c76a640 1 --2- 172.21.15.46:0/2358250819 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fdc400b6590 0x7fdc400b8aa0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:50.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.251+0000 7fdc5c76a640 1 --2- 172.21.15.46:0/2358250819 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc54108cf0 0x7fdc5419ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:50.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.251+0000 7fdc5c76a640 1 --2- 172.21.15.46:0/2358250819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc541083a0 0x7fdc54199920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:50.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.251+0000 7fdc5c76a640 1 --2- 172.21.15.46:0/2358250819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc54102a60 0x7fdc54199380 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:50.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.251+0000 7fdc5c76a640 1 -- 172.21.15.46:0/2358250819 >> 172.21.15.46:0/2358250819 conn(0x7fdc54079730 msgr2=0x7fdc54104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:50.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.251+0000 7fdc5c76a640 1 -- 172.21.15.46:0/2358250819 shutdown_connections 2024-09-21T03:52:50.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:50.251+0000 7fdc5c76a640 1 -- 172.21.15.46:0/2358250819 wait complete. 2024-09-21T03:52:50.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:50 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:50.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:50 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:50.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:50 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:50.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:50 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:52:50.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:50 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:52:50.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:50 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:50.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:50 smithi105 ceph-mon[34773]: Deploying daemon mds.h on smithi105 2024-09-21T03:52:50.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:50 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/2358250819' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:52:50.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:50 smithi105 ceph-mon[34773]: mds.? [v2:172.21.15.162:6836/48949822,v1:172.21.15.162:6837/48949822] up:boot 2024-09-21T03:52:50.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:50 smithi105 ceph-mon[34773]: fsmap 7 up:standby 2024-09-21T03:52:50.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:50 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T03:52:50.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:50 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:50.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:50 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:50.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:50 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:50.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:50 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:52:50.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:50 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:52:50.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:50 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:50.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:50 smithi162 ceph-mon[35071]: Deploying daemon mds.h on smithi105 2024-09-21T03:52:50.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:50 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/2358250819' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:52:50.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:50 smithi162 ceph-mon[35071]: mds.? [v2:172.21.15.162:6836/48949822,v1:172.21.15.162:6837/48949822] up:boot 2024-09-21T03:52:50.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:50 smithi162 ceph-mon[35071]: fsmap 7 up:standby 2024-09-21T03:52:50.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:50 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T03:52:50.906 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:50 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:50.906 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:50 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:50.906 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:50 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:50.906 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:50 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:52:50.906 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:50 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:52:50.906 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:50 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:50.906 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:50 smithi046 ceph-mon[30954]: Deploying daemon mds.h on smithi105 2024-09-21T03:52:50.906 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:50 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/2358250819' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:52:50.906 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:50 smithi046 ceph-mon[30954]: mds.? [v2:172.21.15.162:6836/48949822,v1:172.21.15.162:6837/48949822] up:boot 2024-09-21T03:52:50.906 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:50 smithi046 ceph-mon[30954]: fsmap 7 up:standby 2024-09-21T03:52:50.906 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:50 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T03:52:51.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:51 smithi105 ceph-mon[34773]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:51.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:51 smithi162 ceph-mon[35071]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:52.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:51 smithi046 ceph-mon[30954]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:52.318 INFO:journalctl@ceph.mds.h.smithi105.stdout:Sep 21 03:52:52 smithi105 systemd[1]: Started Ceph mds.h for a82de5ec-77cb-11ef-baf5-efdc52797490. 2024-09-21T03:52:52.935 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:52:53.210 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:52:53.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:53 smithi046 ceph-mon[30954]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:53.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:53 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:53.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:53 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:53.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:53 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:53.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:53 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:52:53.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:53 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:52:53.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:53 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:53.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:53 smithi046 ceph-mon[30954]: Deploying daemon mds.i on smithi162 2024-09-21T03:52:53.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:53 smithi046 ceph-mon[30954]: mds.? [v2:172.21.15.105:6836/3548633196,v1:172.21.15.105:6837/3548633196] up:boot 2024-09-21T03:52:53.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:53 smithi046 ceph-mon[30954]: fsmap 8 up:standby 2024-09-21T03:52:53.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:53 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T03:52:53.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:53 smithi105 ceph-mon[34773]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:53.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:53 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:53.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:53 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:53.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:53 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:53.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:53 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:52:53.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:53 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:52:53.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:53 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:53.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:53 smithi105 ceph-mon[34773]: Deploying daemon mds.i on smithi162 2024-09-21T03:52:53.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:53 smithi105 ceph-mon[34773]: mds.? [v2:172.21.15.105:6836/3548633196,v1:172.21.15.105:6837/3548633196] up:boot 2024-09-21T03:52:53.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:53 smithi105 ceph-mon[34773]: fsmap 8 up:standby 2024-09-21T03:52:53.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:53 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T03:52:53.573 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:53 smithi162 ceph-mon[35071]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:53.573 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:53 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:53.573 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:53 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:53.573 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:53 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:53.573 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:53 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:52:53.573 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:53 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:52:53.573 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:53 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:53.573 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:53 smithi162 ceph-mon[35071]: Deploying daemon mds.i on smithi162 2024-09-21T03:52:53.574 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:53 smithi162 ceph-mon[35071]: mds.? [v2:172.21.15.105:6836/3548633196,v1:172.21.15.105:6837/3548633196] up:boot 2024-09-21T03:52:53.574 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:53 smithi162 ceph-mon[35071]: fsmap 8 up:standby 2024-09-21T03:52:53.574 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:53 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T03:52:53.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.624+0000 7ff01a500640 1 -- 172.21.15.46:0/1362280574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff014102ae0 msgr2=0x7ff014102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:53.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.624+0000 7ff01a500640 1 --2- 172.21.15.46:0/1362280574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff014102ae0 0x7ff014102ef0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff004009900 tx=0x7ff00402a410 comp rx=0 tx=0).stop 2024-09-21T03:52:53.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.624+0000 7ff01a500640 1 -- 172.21.15.46:0/1362280574 shutdown_connections 2024-09-21T03:52:53.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.624+0000 7ff01a500640 1 --2- 172.21.15.46:0/1362280574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff014108d70 0x7ff01410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:53.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.624+0000 7ff01a500640 1 --2- 172.21.15.46:0/1362280574 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff014108420 0x7ff014108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:53.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.624+0000 7ff01a500640 1 --2- 172.21.15.46:0/1362280574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff014102ae0 0x7ff014102ef0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:53.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.624+0000 7ff01a500640 1 -- 172.21.15.46:0/1362280574 >> 172.21.15.46:0/1362280574 conn(0x7ff014079770 msgr2=0x7ff014079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:53.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.624+0000 7ff01a500640 1 -- 172.21.15.46:0/1362280574 shutdown_connections 2024-09-21T03:52:53.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.624+0000 7ff01a500640 1 -- 172.21.15.46:0/1362280574 wait complete. 2024-09-21T03:52:53.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.625+0000 7ff01a500640 1 Processor -- start 2024-09-21T03:52:53.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.625+0000 7ff01a500640 1 -- start start 2024-09-21T03:52:53.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.625+0000 7ff01a500640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff014102ae0 0x7ff01419a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:53.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.625+0000 7ff01a500640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff014108420 0x7ff01419ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:53.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.625+0000 7ff01a500640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff014108d70 0x7ff01419fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:53.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.625+0000 7ff01a500640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff014112a30 con 0x7ff014108420 2024-09-21T03:52:53.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.625+0000 7ff01a500640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff0141128b0 con 0x7ff014102ae0 2024-09-21T03:52:53.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.625+0000 7ff01a500640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff014112bb0 con 0x7ff014108d70 2024-09-21T03:52:53.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.625+0000 7ff00bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff014108420 0x7ff01419ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:53.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.625+0000 7ff00bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff014108420 0x7ff01419ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46800/0 (socket says 172.21.15.46:46800) 2024-09-21T03:52:53.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.625+0000 7ff00bfff640 1 -- 172.21.15.46:0/3657647785 learned_addr learned my addr 172.21.15.46:0/3657647785 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:52:53.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.625+0000 7ff013fff640 1 --2- 172.21.15.46:0/3657647785 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff014102ae0 0x7ff01419a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:53.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.625+0000 7ff018a9d640 1 --2- 172.21.15.46:0/3657647785 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff014108d70 0x7ff01419fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:53.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.626+0000 7ff00bfff640 1 -- 172.21.15.46:0/3657647785 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff014108d70 msgr2=0x7ff01419fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:53.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.626+0000 7ff00bfff640 1 --2- 172.21.15.46:0/3657647785 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff014108d70 0x7ff01419fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:53.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.626+0000 7ff00bfff640 1 -- 172.21.15.46:0/3657647785 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff014102ae0 msgr2=0x7ff01419a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:53.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.626+0000 7ff00bfff640 1 --2- 172.21.15.46:0/3657647785 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff014102ae0 0x7ff01419a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:53.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.626+0000 7ff00bfff640 1 -- 172.21.15.46:0/3657647785 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0141a0520 con 0x7ff014108420 2024-09-21T03:52:53.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.626+0000 7ff018a9d640 1 --2- 172.21.15.46:0/3657647785 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff014108d70 0x7ff01419fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:52:53.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.626+0000 7ff013fff640 1 --2- 172.21.15.46:0/3657647785 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff014102ae0 0x7ff01419a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:52:53.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.626+0000 7ff00bfff640 1 --2- 172.21.15.46:0/3657647785 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff014108420 0x7ff01419ab50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7feffc00d740 tx=0x7feffc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:53.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.626+0000 7ff011ffb640 1 -- 172.21.15.46:0/3657647785 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feffc017070 con 0x7ff014108420 2024-09-21T03:52:53.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.626+0000 7ff011ffb640 1 -- 172.21.15.46:0/3657647785 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feffc00de50 con 0x7ff014108420 2024-09-21T03:52:53.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.626+0000 7ff01a500640 1 -- 172.21.15.46:0/3657647785 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0141a0810 con 0x7ff014108420 2024-09-21T03:52:53.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.626+0000 7ff011ffb640 1 -- 172.21.15.46:0/3657647785 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feffc00f620 con 0x7ff014108420 2024-09-21T03:52:53.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.626+0000 7ff01a500640 1 -- 172.21.15.46:0/3657647785 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0141a6f70 con 0x7ff014108420 2024-09-21T03:52:53.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.627+0000 7ff01a500640 1 -- 172.21.15.46:0/3657647785 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff014103d60 con 0x7ff014108420 2024-09-21T03:52:53.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.629+0000 7ff011ffb640 1 -- 172.21.15.46:0/3657647785 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7feffc01a070 con 0x7ff014108420 2024-09-21T03:52:53.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.630+0000 7ff011ffb640 1 --2- 172.21.15.46:0/3657647785 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff0000b6560 0x7ff0000b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:53.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.630+0000 7ff013fff640 1 --2- 172.21.15.46:0/3657647785 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff0000b6560 0x7ff0000b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:53.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.630+0000 7ff011ffb640 1 -- 172.21.15.46:0/3657647785 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7feffc0e6a20 con 0x7ff014108420 2024-09-21T03:52:53.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.631+0000 7ff013fff640 1 --2- 172.21.15.46:0/3657647785 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff0000b6560 0x7ff0000b8a70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff004031440 tx=0x7ff004009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:53.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.633+0000 7ff011ffb640 1 -- 172.21.15.46:0/3657647785 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feffc0ad680 con 0x7ff014108420 2024-09-21T03:52:53.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.859+0000 7ff01a500640 1 -- 172.21.15.46:0/3657647785 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff01419b6e0 con 0x7ff014108420 2024-09-21T03:52:53.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.859+0000 7ff011ffb640 1 -- 172.21.15.46:0/3657647785 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7222 (secure 0 0 0) 0x7feffc0b1a60 con 0x7ff014108420 2024-09-21T03:52:53.863 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:52:53.863 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":9,"btime":"2024-09-21T03:52:52:525842+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3548633196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":3548633196},{"type":"v1","addr":"172.21.15.105:6837","nonce":3548633196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24652,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3551934241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3551934241},{"type":"v1","addr":"172.21.15.162:6835","nonce":3551934241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/48949822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":48949822},{"type":"v1","addr":"172.21.15.162:6837","nonce":48949822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-21T03:52:53.863 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 9 2024-09-21T03:52:53.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.861+0000 7ff01a500640 1 -- 172.21.15.46:0/3657647785 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff0000b6560 msgr2=0x7ff0000b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:53.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.861+0000 7ff01a500640 1 --2- 172.21.15.46:0/3657647785 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff0000b6560 0x7ff0000b8a70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff004031440 tx=0x7ff004009680 comp rx=0 tx=0).stop 2024-09-21T03:52:53.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.861+0000 7ff01a500640 1 -- 172.21.15.46:0/3657647785 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff014108420 msgr2=0x7ff01419ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:53.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.861+0000 7ff01a500640 1 --2- 172.21.15.46:0/3657647785 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff014108420 0x7ff01419ab50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7feffc00d740 tx=0x7feffc00dc00 comp rx=0 tx=0).stop 2024-09-21T03:52:53.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.861+0000 7ff01a500640 1 -- 172.21.15.46:0/3657647785 shutdown_connections 2024-09-21T03:52:53.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.862+0000 7ff01a500640 1 --2- 172.21.15.46:0/3657647785 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff0000b6560 0x7ff0000b8a70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:53.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.862+0000 7ff01a500640 1 --2- 172.21.15.46:0/3657647785 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff014108d70 0x7ff01419fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:53.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.862+0000 7ff01a500640 1 --2- 172.21.15.46:0/3657647785 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff014108420 0x7ff01419ab50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:53.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.862+0000 7ff01a500640 1 --2- 172.21.15.46:0/3657647785 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff014102ae0 0x7ff01419a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:53.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.862+0000 7ff01a500640 1 -- 172.21.15.46:0/3657647785 >> 172.21.15.46:0/3657647785 conn(0x7ff014079770 msgr2=0x7ff014101ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:53.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.862+0000 7ff01a500640 1 -- 172.21.15.46:0/3657647785 shutdown_connections 2024-09-21T03:52:53.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:53.862+0000 7ff01a500640 1 -- 172.21.15.46:0/3657647785 wait complete. 2024-09-21T03:52:54.126 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 21 03:52:54 smithi162 systemd[1]: Starting Ceph mds.i for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T03:52:54.429 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:54 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3657647785' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:52:54.430 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 21 03:52:54 smithi162 podman[64319]: 2024-09-21 03:52:54.173422518 +0000 UTC m=+0.016222198 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:52:54.430 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 21 03:52:54 smithi162 podman[64319]: 2024-09-21 03:52:54.307321509 +0000 UTC m=+0.150121180 container create 44540b407dca7b3ea6d64784a47967b9f36d6275c36342325640cd2cfd508c47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-i, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:52:54.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:54 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3657647785' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:52:54.567 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:54 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3657647785' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:52:54.876 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 21 03:52:54 smithi162 podman[64319]: 2024-09-21 03:52:54.560069706 +0000 UTC m=+0.402869379 container init 44540b407dca7b3ea6d64784a47967b9f36d6275c36342325640cd2cfd508c47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-i, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T03:52:54.876 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 21 03:52:54 smithi162 podman[64319]: 2024-09-21 03:52:54.56340841 +0000 UTC m=+0.406208080 container start 44540b407dca7b3ea6d64784a47967b9f36d6275c36342325640cd2cfd508c47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-i, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:52:54.876 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 21 03:52:54 smithi162 ceph-mds[64338]: -- 172.21.15.162:0/2887042622 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555e2db33860 con 0x555e31cdb180 2024-09-21T03:52:54.876 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 21 03:52:54 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-i[64334]: starting mds.i at 2024-09-21T03:52:54.876 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 21 03:52:54 smithi162 bash[64319]: 44540b407dca7b3ea6d64784a47967b9f36d6275c36342325640cd2cfd508c47 2024-09-21T03:52:54.876 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 21 03:52:54 smithi162 systemd[1]: Started Ceph mds.i for a82de5ec-77cb-11ef-baf5-efdc52797490. 2024-09-21T03:52:56.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:55 smithi046 ceph-mon[30954]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:56.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:55 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:56.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:55 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:56.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:55 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:56.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:55 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:52:56.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:55 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:52:56.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:55 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:56.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:55 smithi046 ceph-mon[30954]: Deploying daemon mds.g on smithi046 2024-09-21T03:52:56.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:55 smithi046 ceph-mon[30954]: mds.? [v2:172.21.15.162:6838/2196053213,v1:172.21.15.162:6839/2196053213] up:boot 2024-09-21T03:52:56.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:55 smithi046 ceph-mon[30954]: fsmap 9 up:standby 2024-09-21T03:52:56.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:55 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T03:52:56.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:55 smithi105 ceph-mon[34773]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:56.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:55 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:56.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:55 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:56.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:55 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:56.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:55 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:52:56.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:55 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:52:56.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:55 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:56.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:55 smithi105 ceph-mon[34773]: Deploying daemon mds.g on smithi046 2024-09-21T03:52:56.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:55 smithi105 ceph-mon[34773]: mds.? [v2:172.21.15.162:6838/2196053213,v1:172.21.15.162:6839/2196053213] up:boot 2024-09-21T03:52:56.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:55 smithi105 ceph-mon[34773]: fsmap 9 up:standby 2024-09-21T03:52:56.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:55 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T03:52:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:55 smithi162 ceph-mon[35071]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:55 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:55 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:55 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:55 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:52:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:55 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:52:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:55 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:55 smithi162 ceph-mon[35071]: Deploying daemon mds.g on smithi046 2024-09-21T03:52:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:55 smithi162 ceph-mon[35071]: mds.? [v2:172.21.15.162:6838/2196053213,v1:172.21.15.162:6839/2196053213] up:boot 2024-09-21T03:52:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:55 smithi162 ceph-mon[35071]: fsmap 9 up:standby 2024-09-21T03:52:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:55 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T03:52:56.570 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:52:56.959 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 21 03:52:56 smithi046 systemd[1]: Starting Ceph mds.g for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T03:52:57.239 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 21 03:52:56 smithi046 podman[73496]: 2024-09-21 03:52:56.859711436 +0000 UTC m=+0.016431491 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:52:57.240 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 21 03:52:56 smithi046 podman[73496]: 2024-09-21 03:52:56.993336072 +0000 UTC m=+0.150056109 container create c065a7f44fa9fd0a292e4abdaeca8449f7dafbc4820e9699327ec1f1cec83bc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-g, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:52:57.240 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 21 03:52:57 smithi046 podman[73496]: 2024-09-21 03:52:57.238098658 +0000 UTC m=+0.394818712 container init c065a7f44fa9fd0a292e4abdaeca8449f7dafbc4820e9699327ec1f1cec83bc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-g, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-21T03:52:57.428 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:52:57.501 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 21 03:52:57 smithi046 podman[73496]: 2024-09-21 03:52:57.241259793 +0000 UTC m=+0.397979838 container start c065a7f44fa9fd0a292e4abdaeca8449f7dafbc4820e9699327ec1f1cec83bc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:52:57.501 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 21 03:52:57 smithi046 ceph-mds[73539]: -- 172.21.15.46:0/1984377971 <== mon.0 v2:172.21.15.46:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556e98567860 con 0x556e9c70fa80 2024-09-21T03:52:57.502 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 21 03:52:57 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-g[73524]: starting mds.g at 2024-09-21T03:52:57.502 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 21 03:52:57 smithi046 bash[73496]: c065a7f44fa9fd0a292e4abdaeca8449f7dafbc4820e9699327ec1f1cec83bc4 2024-09-21T03:52:57.502 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 21 03:52:57 smithi046 systemd[1]: Started Ceph mds.g for a82de5ec-77cb-11ef-baf5-efdc52797490. 2024-09-21T03:52:57.811 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:57 smithi046 ceph-mon[30954]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:57.811 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:57 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:57.811 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:57 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:57.811 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:57 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:57.812 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:57 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:52:57.812 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:57 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:52:57.812 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:57 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:57.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.902+0000 7fee956e0640 1 -- 172.21.15.46:0/905997535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee90102f20 msgr2=0x7fee9010fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:57.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.902+0000 7fee956e0640 1 --2- 172.21.15.46:0/905997535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee90102f20 0x7fee9010fc40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fee84009900 tx=0x7fee8402a480 comp rx=0 tx=0).stop 2024-09-21T03:52:57.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.902+0000 7fee956e0640 1 -- 172.21.15.46:0/905997535 shutdown_connections 2024-09-21T03:52:57.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.902+0000 7fee956e0640 1 --2- 172.21.15.46:0/905997535 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee90110180 0x7fee901125a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:57.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.902+0000 7fee956e0640 1 --2- 172.21.15.46:0/905997535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee90102f20 0x7fee9010fc40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:57.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.902+0000 7fee956e0640 1 --2- 172.21.15.46:0/905997535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee901025d0 0x7fee901029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:57.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.902+0000 7fee956e0640 1 -- 172.21.15.46:0/905997535 >> 172.21.15.46:0/905997535 conn(0x7fee90079730 msgr2=0x7fee90079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:57.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.902+0000 7fee956e0640 1 -- 172.21.15.46:0/905997535 shutdown_connections 2024-09-21T03:52:57.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.902+0000 7fee956e0640 1 -- 172.21.15.46:0/905997535 wait complete. 2024-09-21T03:52:57.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.903+0000 7fee956e0640 1 Processor -- start 2024-09-21T03:52:57.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.903+0000 7fee956e0640 1 -- start start 2024-09-21T03:52:57.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.903+0000 7fee956e0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee901025d0 0x7fee9019c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:57.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.903+0000 7fee956e0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee90102f20 0x7fee9019cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:57.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.903+0000 7fee956e0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee90110180 0x7fee901a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:57.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.903+0000 7fee956e0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fee90115c40 con 0x7fee90110180 2024-09-21T03:52:57.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.903+0000 7fee956e0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fee90115ac0 con 0x7fee901025d0 2024-09-21T03:52:57.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.903+0000 7fee956e0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fee90115dc0 con 0x7fee90102f20 2024-09-21T03:52:57.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.904+0000 7fee8f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee90110180 0x7fee901a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:57.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.904+0000 7fee8f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee90110180 0x7fee901a1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46820/0 (socket says 172.21.15.46:46820) 2024-09-21T03:52:57.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.904+0000 7fee8f7fe640 1 -- 172.21.15.46:0/3882540841 learned_addr learned my addr 172.21.15.46:0/3882540841 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:52:57.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.904+0000 7fee8effd640 1 --2- 172.21.15.46:0/3882540841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee901025d0 0x7fee9019c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:57.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.904+0000 7fee8e7fc640 1 --2- 172.21.15.46:0/3882540841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee90102f20 0x7fee9019cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:57.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.904+0000 7fee8f7fe640 1 -- 172.21.15.46:0/3882540841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee90102f20 msgr2=0x7fee9019cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:57.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.904+0000 7fee8f7fe640 1 --2- 172.21.15.46:0/3882540841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee90102f20 0x7fee9019cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:57.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.904+0000 7fee8f7fe640 1 -- 172.21.15.46:0/3882540841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee901025d0 msgr2=0x7fee9019c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:57.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.904+0000 7fee8f7fe640 1 --2- 172.21.15.46:0/3882540841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee901025d0 0x7fee9019c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:57.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.904+0000 7fee8f7fe640 1 -- 172.21.15.46:0/3882540841 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee901a24c0 con 0x7fee90110180 2024-09-21T03:52:57.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.904+0000 7fee8e7fc640 1 --2- 172.21.15.46:0/3882540841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee90102f20 0x7fee9019cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:52:57.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.904+0000 7fee8f7fe640 1 --2- 172.21.15.46:0/3882540841 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee90110180 0x7fee901a1e50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fee8800e970 tx=0x7fee8800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:57.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.904+0000 7fee77fff640 1 -- 172.21.15.46:0/3882540841 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8800ccc0 con 0x7fee90110180 2024-09-21T03:52:57.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.904+0000 7fee956e0640 1 -- 172.21.15.46:0/3882540841 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee901a27b0 con 0x7fee90110180 2024-09-21T03:52:57.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.904+0000 7fee77fff640 1 -- 172.21.15.46:0/3882540841 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee8800ce60 con 0x7fee90110180 2024-09-21T03:52:57.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.904+0000 7fee77fff640 1 -- 172.21.15.46:0/3882540841 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee88010430 con 0x7fee90110180 2024-09-21T03:52:57.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.904+0000 7fee956e0640 1 -- 172.21.15.46:0/3882540841 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee901a8fd0 con 0x7fee90110180 2024-09-21T03:52:57.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.906+0000 7fee956e0640 1 -- 172.21.15.46:0/3882540841 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee9006b560 con 0x7fee90110180 2024-09-21T03:52:57.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.907+0000 7fee77fff640 1 -- 172.21.15.46:0/3882540841 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fee88004f90 con 0x7fee90110180 2024-09-21T03:52:57.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.908+0000 7fee77fff640 1 --2- 172.21.15.46:0/3882540841 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fee780b6590 0x7fee780b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:57.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.908+0000 7fee8effd640 1 --2- 172.21.15.46:0/3882540841 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fee780b6590 0x7fee780b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:57.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.908+0000 7fee77fff640 1 -- 172.21.15.46:0/3882540841 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fee880e74e0 con 0x7fee90110180 2024-09-21T03:52:57.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.908+0000 7fee8effd640 1 --2- 172.21.15.46:0/3882540841 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fee780b6590 0x7fee780b8aa0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fee80007ec0 tx=0x7fee800075b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:57.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:57.912+0000 7fee77fff640 1 -- 172.21.15.46:0/3882540841 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fee880ae0a0 con 0x7fee90110180 2024-09-21T03:52:58.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:57 smithi105 ceph-mon[34773]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:58.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:57 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:58.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:57 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:58.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:57 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:58.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:57 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:52:58.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:57 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:52:58.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:57 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:58.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:57 smithi162 ceph-mon[35071]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:52:58.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:57 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:58.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:57 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:58.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:57 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:52:58.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:57 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:52:58.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:57 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:52:58.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:57 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:58.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:58.146+0000 7fee956e0640 1 -- 172.21.15.46:0/3882540841 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee9010b370 con 0x7fee90110180 2024-09-21T03:52:58.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:58.147+0000 7fee77fff640 1 -- 172.21.15.46:0/3882540841 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8878 (secure 0 0 0) 0x7fee880b2480 con 0x7fee90110180 2024-09-21T03:52:58.149 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:52:58.149 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":11,"btime":"2024-09-21T03:52:57:719843+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1766354184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1766354184},{"type":"v1","addr":"172.21.15.46:6839","nonce":1766354184}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3548633196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":3548633196},{"type":"v1","addr":"172.21.15.105:6837","nonce":3548633196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24652,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3551934241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3551934241},{"type":"v1","addr":"172.21.15.162:6835","nonce":3551934241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/48949822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":48949822},{"type":"v1","addr":"172.21.15.162:6837","nonce":48949822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24673,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/2196053213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2196053213},{"type":"v1","addr":"172.21.15.162:6839","nonce":2196053213}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T03:52:58.149 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 11 2024-09-21T03:52:58.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:58.149+0000 7fee956e0640 1 -- 172.21.15.46:0/3882540841 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fee780b6590 msgr2=0x7fee780b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:58.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:58.149+0000 7fee956e0640 1 --2- 172.21.15.46:0/3882540841 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fee780b6590 0x7fee780b8aa0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fee80007ec0 tx=0x7fee800075b0 comp rx=0 tx=0).stop 2024-09-21T03:52:58.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:58.149+0000 7fee956e0640 1 -- 172.21.15.46:0/3882540841 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee90110180 msgr2=0x7fee901a1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:58.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:58.149+0000 7fee956e0640 1 --2- 172.21.15.46:0/3882540841 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee90110180 0x7fee901a1e50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fee8800e970 tx=0x7fee8800ed70 comp rx=0 tx=0).stop 2024-09-21T03:52:58.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:58.149+0000 7fee956e0640 1 -- 172.21.15.46:0/3882540841 shutdown_connections 2024-09-21T03:52:58.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:58.149+0000 7fee956e0640 1 --2- 172.21.15.46:0/3882540841 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee90110180 0x7fee901a1e50 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:58.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:58.149+0000 7fee956e0640 1 --2- 172.21.15.46:0/3882540841 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fee780b6590 0x7fee780b8aa0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:58.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:58.149+0000 7fee956e0640 1 --2- 172.21.15.46:0/3882540841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee90102f20 0x7fee9019cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:58.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:58.149+0000 7fee956e0640 1 --2- 172.21.15.46:0/3882540841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee901025d0 0x7fee9019c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:58.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:58.149+0000 7fee956e0640 1 -- 172.21.15.46:0/3882540841 >> 172.21.15.46:0/3882540841 conn(0x7fee90079730 msgr2=0x7fee90111580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:58.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:58.149+0000 7fee956e0640 1 -- 172.21.15.46:0/3882540841 shutdown_connections 2024-09-21T03:52:58.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:52:58.149+0000 7fee956e0640 1 -- 172.21.15.46:0/3882540841 wait complete. 2024-09-21T03:52:58.997 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:58 smithi046 ceph-mon[30954]: Deploying daemon mds.a on smithi046 2024-09-21T03:52:58.997 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:58 smithi046 ceph-mon[30954]: mds.? [v2:172.21.15.46:6838/1766354184,v1:172.21.15.46:6839/1766354184] up:boot 2024-09-21T03:52:58.997 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:58 smithi046 ceph-mon[30954]: fsmap 10 up:standby 2024-09-21T03:52:58.997 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:58 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T03:52:58.997 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:58 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3882540841' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:52:59.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:58 smithi105 ceph-mon[34773]: Deploying daemon mds.a on smithi046 2024-09-21T03:52:59.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:58 smithi105 ceph-mon[34773]: mds.? [v2:172.21.15.46:6838/1766354184,v1:172.21.15.46:6839/1766354184] up:boot 2024-09-21T03:52:59.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:58 smithi105 ceph-mon[34773]: fsmap 10 up:standby 2024-09-21T03:52:59.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:58 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T03:52:59.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:58 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3882540841' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:52:59.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:58 smithi162 ceph-mon[35071]: Deploying daemon mds.a on smithi046 2024-09-21T03:52:59.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:58 smithi162 ceph-mon[35071]: mds.? [v2:172.21.15.46:6838/1766354184,v1:172.21.15.46:6839/1766354184] up:boot 2024-09-21T03:52:59.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:58 smithi162 ceph-mon[35071]: fsmap 10 up:standby 2024-09-21T03:52:59.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:58 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T03:52:59.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:58 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3882540841' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:52:59.957 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:52:59 smithi046 ceph-mon[30954]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:53:00.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:52:59 smithi105 ceph-mon[34773]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:53:00.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:52:59 smithi162 ceph-mon[35071]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:53:00.251 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 21 03:53:00 smithi046 systemd[1]: Starting Ceph mds.a for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T03:53:00.616 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 21 03:53:00 smithi046 podman[73859]: 2024-09-21 03:53:00.266058353 +0000 UTC m=+0.016999001 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:53:00.616 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 21 03:53:00 smithi046 podman[73859]: 2024-09-21 03:53:00.386982509 +0000 UTC m=+0.137923144 container create cabdd9be3786fd3ff2287062f0352ece87c6c22f7e5fadc75ffe79326d3f8f60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-a, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:53:00.616 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 21 03:53:00 smithi046 podman[73859]: 2024-09-21 03:53:00.614799476 +0000 UTC m=+0.365740116 container init cabdd9be3786fd3ff2287062f0352ece87c6c22f7e5fadc75ffe79326d3f8f60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-21T03:53:01.001 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 21 03:53:00 smithi046 podman[73859]: 2024-09-21 03:53:00.617860738 +0000 UTC m=+0.368801367 container start cabdd9be3786fd3ff2287062f0352ece87c6c22f7e5fadc75ffe79326d3f8f60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-a, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T03:53:01.002 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 21 03:53:00 smithi046 ceph-mds[73878]: -- 172.21.15.46:0/2151704652 <== mon.0 v2:172.21.15.46:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56110668bc20 con 0x56110a833180 2024-09-21T03:53:01.002 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 21 03:53:00 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-a[73874]: starting mds.a at 2024-09-21T03:53:01.002 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 21 03:53:00 smithi046 bash[73859]: cabdd9be3786fd3ff2287062f0352ece87c6c22f7e5fadc75ffe79326d3f8f60 2024-09-21T03:53:01.002 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 21 03:53:00 smithi046 systemd[1]: Started Ceph mds.a for a82de5ec-77cb-11ef-baf5-efdc52797490. 2024-09-21T03:53:01.336 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:53:01.598 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:01.997 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:01 smithi046 ceph-mon[30954]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:53:01.997 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:01 smithi046 ceph-mon[30954]: mds.? [v2:172.21.15.46:6840/1901774207,v1:172.21.15.46:6841/1901774207] up:boot 2024-09-21T03:53:01.997 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:01 smithi046 ceph-mon[30954]: fsmap 11 up:standby 2024-09-21T03:53:01.997 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:01 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T03:53:01.997 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:01 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:01.997 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:01 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:01.997 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:01 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:01.998 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:01 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:53:01.998 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:01 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:53:01.998 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:01 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:01.998 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:01 smithi046 ceph-mon[30954]: Deploying daemon mds.b on smithi105 2024-09-21T03:53:02.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:01 smithi105 ceph-mon[34773]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:53:02.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:01 smithi105 ceph-mon[34773]: mds.? [v2:172.21.15.46:6840/1901774207,v1:172.21.15.46:6841/1901774207] up:boot 2024-09-21T03:53:02.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:01 smithi105 ceph-mon[34773]: fsmap 11 up:standby 2024-09-21T03:53:02.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:01 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T03:53:02.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:01 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:02.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:01 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:02.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:01 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:02.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:01 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:53:02.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:01 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:53:02.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:01 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:02.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:01 smithi105 ceph-mon[34773]: Deploying daemon mds.b on smithi105 2024-09-21T03:53:02.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.089+0000 7f9463d59640 1 -- 172.21.15.46:0/1737780413 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f945c1094f0 msgr2=0x7f945c109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:02.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.089+0000 7f9463d59640 1 --2- 172.21.15.46:0/1737780413 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f945c1094f0 0x7f945c109900 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f944c009900 tx=0x7f944c02a410 comp rx=0 tx=0).stop 2024-09-21T03:53:02.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.089+0000 7f9463d59640 1 -- 172.21.15.46:0/1737780413 shutdown_connections 2024-09-21T03:53:02.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.089+0000 7f9463d59640 1 --2- 172.21.15.46:0/1737780413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f945c109e40 0x7f945c110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:02.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.089+0000 7f9463d59640 1 --2- 172.21.15.46:0/1737780413 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f945c1094f0 0x7f945c109900 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:02.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.089+0000 7f9463d59640 1 --2- 172.21.15.46:0/1737780413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f945c103bb0 0x7f945c103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:02.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.089+0000 7f9463d59640 1 -- 172.21.15.46:0/1737780413 >> 172.21.15.46:0/1737780413 conn(0x7f945c0ff600 msgr2=0x7f945c101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:02.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.089+0000 7f9463d59640 1 -- 172.21.15.46:0/1737780413 shutdown_connections 2024-09-21T03:53:02.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.089+0000 7f9463d59640 1 -- 172.21.15.46:0/1737780413 wait complete. 2024-09-21T03:53:02.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.090+0000 7f9463d59640 1 Processor -- start 2024-09-21T03:53:02.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.090+0000 7f9463d59640 1 -- start start 2024-09-21T03:53:02.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.090+0000 7f9463d59640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f945c103bb0 0x7f945c19a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:02.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.090+0000 7f9463d59640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f945c1094f0 0x7f945c19aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:02.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.090+0000 7f9463d59640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f945c109e40 0x7f945c19fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:02.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.090+0000 7f9463d59640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f945c113b00 con 0x7f945c103bb0 2024-09-21T03:53:02.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.090+0000 7f9463d59640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f945c113980 con 0x7f945c1094f0 2024-09-21T03:53:02.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.090+0000 7f9463d59640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f945c113c80 con 0x7f945c109e40 2024-09-21T03:53:02.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.090+0000 7f9461af5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f945c103bb0 0x7f945c19a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:02.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.090+0000 7f9461af5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f945c103bb0 0x7f945c19a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44278/0 (socket says 172.21.15.46:44278) 2024-09-21T03:53:02.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.090+0000 7f9461af5640 1 -- 172.21.15.46:0/1293358418 learned_addr learned my addr 172.21.15.46:0/1293358418 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:53:02.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.090+0000 7f94612f4640 1 --2- 172.21.15.46:0/1293358418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f945c1094f0 0x7f945c19aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:02.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.090+0000 7f94622f6640 1 --2- 172.21.15.46:0/1293358418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f945c109e40 0x7f945c19fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:02.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.090+0000 7f9461af5640 1 -- 172.21.15.46:0/1293358418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f945c109e40 msgr2=0x7f945c19fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:02.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.090+0000 7f9461af5640 1 --2- 172.21.15.46:0/1293358418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f945c109e40 0x7f945c19fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:02.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.090+0000 7f9461af5640 1 -- 172.21.15.46:0/1293358418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f945c1094f0 msgr2=0x7f945c19aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:02.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.090+0000 7f9461af5640 1 --2- 172.21.15.46:0/1293358418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f945c1094f0 0x7f945c19aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:02.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.090+0000 7f9461af5640 1 -- 172.21.15.46:0/1293358418 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f945c1a0380 con 0x7f945c103bb0 2024-09-21T03:53:02.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.090+0000 7f94622f6640 1 --2- 172.21.15.46:0/1293358418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f945c109e40 0x7f945c19fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:53:02.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.091+0000 7f9461af5640 1 --2- 172.21.15.46:0/1293358418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f945c103bb0 0x7f945c19a4d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f945800d950 tx=0x7f945800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:02.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.091+0000 7f9452ffd640 1 -- 172.21.15.46:0/1293358418 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9458017070 con 0x7f945c103bb0 2024-09-21T03:53:02.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.091+0000 7f9463d59640 1 -- 172.21.15.46:0/1293358418 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f945c1a0670 con 0x7f945c103bb0 2024-09-21T03:53:02.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.091+0000 7f9452ffd640 1 -- 172.21.15.46:0/1293358418 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9458009c30 con 0x7f945c103bb0 2024-09-21T03:53:02.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.091+0000 7f9452ffd640 1 -- 172.21.15.46:0/1293358418 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945800f620 con 0x7f945c103bb0 2024-09-21T03:53:02.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.091+0000 7f9463d59640 1 -- 172.21.15.46:0/1293358418 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f945c1a6e90 con 0x7f945c103bb0 2024-09-21T03:53:02.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.092+0000 7f9463d59640 1 -- 172.21.15.46:0/1293358418 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f945c104e30 con 0x7f945c103bb0 2024-09-21T03:53:02.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.094+0000 7f9452ffd640 1 -- 172.21.15.46:0/1293358418 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f9458005030 con 0x7f945c103bb0 2024-09-21T03:53:02.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.094+0000 7f9452ffd640 1 --2- 172.21.15.46:0/1293358418 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f94480b6590 0x7f94480b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:02.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.094+0000 7f94612f4640 1 --2- 172.21.15.46:0/1293358418 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f94480b6590 0x7f94480b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:02.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.094+0000 7f9452ffd640 1 -- 172.21.15.46:0/1293358418 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f94580e6c40 con 0x7f945c103bb0 2024-09-21T03:53:02.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.095+0000 7f94612f4640 1 --2- 172.21.15.46:0/1293358418 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f94480b6590 0x7f94480b8aa0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f944c009230 tx=0x7f944c031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:02.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.098+0000 7f9452ffd640 1 -- 172.21.15.46:0/1293358418 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f94580ad8a0 con 0x7f945c103bb0 2024-09-21T03:53:02.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:01 smithi162 ceph-mon[35071]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:53:02.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:01 smithi162 ceph-mon[35071]: mds.? [v2:172.21.15.46:6840/1901774207,v1:172.21.15.46:6841/1901774207] up:boot 2024-09-21T03:53:02.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:01 smithi162 ceph-mon[35071]: fsmap 11 up:standby 2024-09-21T03:53:02.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:01 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T03:53:02.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:01 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:02.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:01 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:02.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:01 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:02.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:01 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:53:02.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:01 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:53:02.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:01 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:02.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:01 smithi162 ceph-mon[35071]: Deploying daemon mds.b on smithi105 2024-09-21T03:53:02.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.332+0000 7f9463d59640 1 -- 172.21.15.46:0/1293358418 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f945c103fc0 con 0x7f945c103bb0 2024-09-21T03:53:02.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.333+0000 7f9452ffd640 1 -- 172.21.15.46:0/1293358418 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9704 (secure 0 0 0) 0x7f94580d0020 con 0x7f945c103bb0 2024-09-21T03:53:02.335 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:53:02.335 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":12,"btime":"2024-09-21T03:53:00:737072+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1766354184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1766354184},{"type":"v1","addr":"172.21.15.46:6839","nonce":1766354184}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/1901774207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":1901774207},{"type":"v1","addr":"172.21.15.46:6841","nonce":1901774207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3548633196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":3548633196},{"type":"v1","addr":"172.21.15.105:6837","nonce":3548633196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24652,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3551934241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3551934241},{"type":"v1","addr":"172.21.15.162:6835","nonce":3551934241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/48949822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":48949822},{"type":"v1","addr":"172.21.15.162:6837","nonce":48949822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24673,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/2196053213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2196053213},{"type":"v1","addr":"172.21.15.162:6839","nonce":2196053213}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T03:53:02.336 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 12 2024-09-21T03:53:02.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.335+0000 7f9463d59640 1 -- 172.21.15.46:0/1293358418 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f94480b6590 msgr2=0x7f94480b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:02.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.335+0000 7f9463d59640 1 --2- 172.21.15.46:0/1293358418 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f94480b6590 0x7f94480b8aa0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f944c009230 tx=0x7f944c031400 comp rx=0 tx=0).stop 2024-09-21T03:53:02.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.335+0000 7f9463d59640 1 -- 172.21.15.46:0/1293358418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f945c103bb0 msgr2=0x7f945c19a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:02.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.335+0000 7f9463d59640 1 --2- 172.21.15.46:0/1293358418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f945c103bb0 0x7f945c19a4d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f945800d950 tx=0x7f945800de10 comp rx=0 tx=0).stop 2024-09-21T03:53:02.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.335+0000 7f9463d59640 1 -- 172.21.15.46:0/1293358418 shutdown_connections 2024-09-21T03:53:02.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.335+0000 7f9463d59640 1 --2- 172.21.15.46:0/1293358418 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f94480b6590 0x7f94480b8aa0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:02.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.335+0000 7f9463d59640 1 --2- 172.21.15.46:0/1293358418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f945c109e40 0x7f945c19fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:02.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.335+0000 7f9463d59640 1 --2- 172.21.15.46:0/1293358418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f945c1094f0 0x7f945c19aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:02.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.335+0000 7f9463d59640 1 --2- 172.21.15.46:0/1293358418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f945c103bb0 0x7f945c19a4d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:02.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.335+0000 7f9463d59640 1 -- 172.21.15.46:0/1293358418 >> 172.21.15.46:0/1293358418 conn(0x7f945c0ff600 msgr2=0x7f945c101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:02.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.336+0000 7f9463d59640 1 -- 172.21.15.46:0/1293358418 shutdown_connections 2024-09-21T03:53:02.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:02.336+0000 7f9463d59640 1 -- 172.21.15.46:0/1293358418 wait complete. 2024-09-21T03:53:02.978 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:02 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/1293358418' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:53:03.050 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:02 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/1293358418' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:53:03.050 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 21 03:53:02 smithi105 systemd[1]: Starting Ceph mds.b for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T03:53:03.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:02 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/1293358418' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:53:03.318 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 21 03:53:03 smithi105 podman[63723]: 2024-09-21 03:53:02.950488796 +0000 UTC m=+0.015911867 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:53:03.318 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 21 03:53:03 smithi105 podman[63723]: 2024-09-21 03:53:03.073601147 +0000 UTC m=+0.139024207 container create 03d3be8b83bd7c5a56ae3810e0d892bb8a06d50731f30e24940a77e68ec09377 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:53:03.753 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 21 03:53:03 smithi105 podman[63723]: 2024-09-21 03:53:03.326324303 +0000 UTC m=+0.391747364 container init 03d3be8b83bd7c5a56ae3810e0d892bb8a06d50731f30e24940a77e68ec09377 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-b, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T03:53:03.753 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 21 03:53:03 smithi105 podman[63723]: 2024-09-21 03:53:03.329081502 +0000 UTC m=+0.394504565 container start 03d3be8b83bd7c5a56ae3810e0d892bb8a06d50731f30e24940a77e68ec09377 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-b, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T03:53:03.754 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 21 03:53:03 smithi105 ceph-mds[63742]: -- 172.21.15.105:0/2159865421 <== mon.2 v2:172.21.15.105:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f10a207860 con 0x55f10e3af180 2024-09-21T03:53:03.754 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 21 03:53:03 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-b[63738]: starting mds.b at 2024-09-21T03:53:03.754 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 21 03:53:03 smithi105 bash[63723]: 03d3be8b83bd7c5a56ae3810e0d892bb8a06d50731f30e24940a77e68ec09377 2024-09-21T03:53:03.754 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 21 03:53:03 smithi105 systemd[1]: Started Ceph mds.b for a82de5ec-77cb-11ef-baf5-efdc52797490. 2024-09-21T03:53:04.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:03 smithi105 ceph-mon[34773]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:53:04.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:03 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:04.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:03 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:04.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:03 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:04.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:03 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:04.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:03 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:04.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:03 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:53:04.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:03 smithi162 ceph-mon[35071]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:53:04.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:03 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:04.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:03 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:04.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:03 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:04.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:03 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:04.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:03 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:04.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:03 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:53:04.165 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:03 smithi046 ceph-mon[30954]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:53:04.165 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:03 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:04.165 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:03 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:04.165 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:03 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:04.165 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:03 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:04.166 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:03 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:04.166 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:03 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:53:05.009 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:53:05.035 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:04 smithi046 ceph-mon[30954]: mds.? [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] up:boot 2024-09-21T03:53:05.035 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:04 smithi046 ceph-mon[30954]: fsmap 12 up:standby 2024-09-21T03:53:05.035 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:04 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T03:53:05.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:04 smithi105 ceph-mon[34773]: mds.? [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] up:boot 2024-09-21T03:53:05.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:04 smithi105 ceph-mon[34773]: fsmap 12 up:standby 2024-09-21T03:53:05.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:04 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T03:53:05.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:04 smithi162 ceph-mon[35071]: mds.? [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] up:boot 2024-09-21T03:53:05.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:04 smithi162 ceph-mon[35071]: fsmap 12 up:standby 2024-09-21T03:53:05.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:04 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T03:53:05.275 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:05.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.772+0000 7f224b356640 1 -- 172.21.15.46:0/3191081583 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2244108cf0 msgr2=0x7f224410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:05.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.772+0000 7f224b356640 1 --2- 172.21.15.46:0/3191081583 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2244108cf0 0x7f224410f520 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f223c009900 tx=0x7f223c02a410 comp rx=0 tx=0).stop 2024-09-21T03:53:05.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.772+0000 7f224b356640 1 -- 172.21.15.46:0/3191081583 shutdown_connections 2024-09-21T03:53:05.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.772+0000 7f224b356640 1 --2- 172.21.15.46:0/3191081583 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2244108cf0 0x7f224410f520 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:05.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.772+0000 7f224b356640 1 --2- 172.21.15.46:0/3191081583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22441083a0 0x7f22441087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:05.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.772+0000 7f224b356640 1 --2- 172.21.15.46:0/3191081583 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2244102a60 0x7f2244102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:05.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.772+0000 7f224b356640 1 -- 172.21.15.46:0/3191081583 >> 172.21.15.46:0/3191081583 conn(0x7f2244079730 msgr2=0x7f2244079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:05.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.772+0000 7f224b356640 1 -- 172.21.15.46:0/3191081583 shutdown_connections 2024-09-21T03:53:05.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.772+0000 7f224b356640 1 -- 172.21.15.46:0/3191081583 wait complete. 2024-09-21T03:53:05.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.773+0000 7f224b356640 1 Processor -- start 2024-09-21T03:53:05.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.773+0000 7f224b356640 1 -- start start 2024-09-21T03:53:05.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.773+0000 7f224b356640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2244102a60 0x7f224419c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:05.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.773+0000 7f224b356640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22441083a0 0x7f224419cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:05.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.773+0000 7f224b356640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2244108cf0 0x7f22441a1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:05.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.773+0000 7f224b356640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2244112960 con 0x7f2244108cf0 2024-09-21T03:53:05.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.773+0000 7f224b356640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f22441127e0 con 0x7f2244102a60 2024-09-21T03:53:05.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.773+0000 7f224b356640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2244112ae0 con 0x7f22441083a0 2024-09-21T03:53:05.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.773+0000 7f22498f3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2244108cf0 0x7f22441a1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:05.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.773+0000 7f22498f3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2244108cf0 0x7f22441a1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44290/0 (socket says 172.21.15.46:44290) 2024-09-21T03:53:05.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.773+0000 7f22498f3640 1 -- 172.21.15.46:0/348195197 learned_addr learned my addr 172.21.15.46:0/348195197 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:53:05.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.773+0000 7f22488f1640 1 --2- 172.21.15.46:0/348195197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22441083a0 0x7f224419cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:05.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.774+0000 7f22490f2640 1 --2- 172.21.15.46:0/348195197 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2244102a60 0x7f224419c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:05.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.774+0000 7f22498f3640 1 -- 172.21.15.46:0/348195197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22441083a0 msgr2=0x7f224419cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:05.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.774+0000 7f22498f3640 1 --2- 172.21.15.46:0/348195197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22441083a0 0x7f224419cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:05.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.774+0000 7f22498f3640 1 -- 172.21.15.46:0/348195197 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2244102a60 msgr2=0x7f224419c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:05.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.774+0000 7f22498f3640 1 --2- 172.21.15.46:0/348195197 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2244102a60 0x7f224419c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:05.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.774+0000 7f22498f3640 1 -- 172.21.15.46:0/348195197 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22441a2560 con 0x7f2244108cf0 2024-09-21T03:53:05.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.774+0000 7f22490f2640 1 --2- 172.21.15.46:0/348195197 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2244102a60 0x7f224419c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:53:05.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.774+0000 7f22498f3640 1 --2- 172.21.15.46:0/348195197 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2244108cf0 0x7f22441a1e30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f223c004770 tx=0x7f223c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:05.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.774+0000 7f22427fc640 1 -- 172.21.15.46:0/348195197 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223c03f030 con 0x7f2244108cf0 2024-09-21T03:53:05.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.774+0000 7f22427fc640 1 -- 172.21.15.46:0/348195197 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f223c004440 con 0x7f2244108cf0 2024-09-21T03:53:05.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.774+0000 7f224b356640 1 -- 172.21.15.46:0/348195197 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22441a27f0 con 0x7f2244108cf0 2024-09-21T03:53:05.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.774+0000 7f22427fc640 1 -- 172.21.15.46:0/348195197 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223c035070 con 0x7f2244108cf0 2024-09-21T03:53:05.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.774+0000 7f224b356640 1 -- 172.21.15.46:0/348195197 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22441a8fb0 con 0x7f2244108cf0 2024-09-21T03:53:05.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.775+0000 7f224b356640 1 -- 172.21.15.46:0/348195197 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2244103ce0 con 0x7f2244108cf0 2024-09-21T03:53:05.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.777+0000 7f22427fc640 1 -- 172.21.15.46:0/348195197 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f223c042030 con 0x7f2244108cf0 2024-09-21T03:53:05.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.777+0000 7f22427fc640 1 --2- 172.21.15.46:0/348195197 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f222c0b6560 0x7f222c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:05.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.777+0000 7f22490f2640 1 --2- 172.21.15.46:0/348195197 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f222c0b6560 0x7f222c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:05.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.777+0000 7f22427fc640 1 -- 172.21.15.46:0/348195197 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f223c1075f0 con 0x7f2244108cf0 2024-09-21T03:53:05.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.778+0000 7f22490f2640 1 --2- 172.21.15.46:0/348195197 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f222c0b6560 0x7f222c0b8a70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2234005fd0 tx=0x7f2234009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:05.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:05.781+0000 7f22427fc640 1 -- 172.21.15.46:0/348195197 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f223c0ce250 con 0x7f2244108cf0 2024-09-21T03:53:05.943 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:05 smithi162 ceph-mon[35071]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:53:05.943 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:05 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:05.943 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:05 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:05.943 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:05 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:05.943 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:05 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:05.943 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:05 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:05.944 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:05 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:05.944 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:05 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:05.944 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:05 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:53:05.944 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:05 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:05.944 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:05 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:53:06.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:05 smithi046 ceph-mon[30954]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:53:06.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:05 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:06.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:05 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:06.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:05 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:06.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:05 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:06.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:05 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:06.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:05 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:06.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:05 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:06.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:05 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:53:06.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:05 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:06.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:05 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:53:06.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:06.018+0000 7f224b356640 1 -- 172.21.15.46:0/348195197 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22441a9180 con 0x7f2244108cf0 2024-09-21T03:53:06.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:06.018+0000 7f22427fc640 1 -- 172.21.15.46:0/348195197 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10533 (secure 0 0 0) 0x7f223c0d2630 con 0x7f2244108cf0 2024-09-21T03:53:06.021 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:53:06.021 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":13,"btime":"2024-09-21T03:53:03:750520+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1766354184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1766354184},{"type":"v1","addr":"172.21.15.46:6839","nonce":1766354184}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/1901774207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":1901774207},{"type":"v1","addr":"172.21.15.46:6841","nonce":1901774207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3548633196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":3548633196},{"type":"v1","addr":"172.21.15.105:6837","nonce":3548633196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24652,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3551934241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3551934241},{"type":"v1","addr":"172.21.15.162:6835","nonce":3551934241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/48949822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":48949822},{"type":"v1","addr":"172.21.15.162:6837","nonce":48949822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24673,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/2196053213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2196053213},{"type":"v1","addr":"172.21.15.162:6839","nonce":2196053213}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24680,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6839/3911438406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":3911438406},{"type":"v1","addr":"172.21.15.105:6839","nonce":3911438406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-21T03:53:06.021 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 13 2024-09-21T03:53:06.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:06.021+0000 7f224b356640 1 -- 172.21.15.46:0/348195197 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f222c0b6560 msgr2=0x7f222c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:06.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:06.021+0000 7f224b356640 1 --2- 172.21.15.46:0/348195197 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f222c0b6560 0x7f222c0b8a70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2234005fd0 tx=0x7f2234009500 comp rx=0 tx=0).stop 2024-09-21T03:53:06.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:06.021+0000 7f224b356640 1 -- 172.21.15.46:0/348195197 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2244108cf0 msgr2=0x7f22441a1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:06.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:06.021+0000 7f224b356640 1 --2- 172.21.15.46:0/348195197 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2244108cf0 0x7f22441a1e30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f223c004770 tx=0x7f223c004040 comp rx=0 tx=0).stop 2024-09-21T03:53:06.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:06.021+0000 7f224b356640 1 -- 172.21.15.46:0/348195197 shutdown_connections 2024-09-21T03:53:06.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:06.021+0000 7f224b356640 1 --2- 172.21.15.46:0/348195197 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2244108cf0 0x7f22441a1e30 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:06.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:06.021+0000 7f224b356640 1 --2- 172.21.15.46:0/348195197 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f222c0b6560 0x7f222c0b8a70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:06.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:06.021+0000 7f224b356640 1 --2- 172.21.15.46:0/348195197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22441083a0 0x7f224419cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:06.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:06.021+0000 7f224b356640 1 --2- 172.21.15.46:0/348195197 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2244102a60 0x7f224419c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:06.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:06.021+0000 7f224b356640 1 -- 172.21.15.46:0/348195197 >> 172.21.15.46:0/348195197 conn(0x7f2244079730 msgr2=0x7f2244104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:06.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:06.021+0000 7f224b356640 1 -- 172.21.15.46:0/348195197 shutdown_connections 2024-09-21T03:53:06.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:06.021+0000 7f224b356640 1 -- 172.21.15.46:0/348195197 wait complete. 2024-09-21T03:53:06.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:05 smithi105 ceph-mon[34773]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:53:06.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:05 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:06.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:05 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:06.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:05 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:06.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:05 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:06.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:05 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:06.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:05 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:06.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:05 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:06.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:05 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:53:06.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:05 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:06.069 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:05 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:53:06.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:06 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/348195197' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:53:06.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:06 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:06.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:06 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:06.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:06 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:06.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:06 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:07.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:06 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/348195197' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:53:07.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:06 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:07.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:06 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:07.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:06 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:07.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:06 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:07.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:06 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/348195197' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:53:07.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:06 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:07.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:06 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:07.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:06 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:07.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:06 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:07.305 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph --format=json-pretty osd lspools 2024-09-21T03:53:07.638 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:08.052 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:07 smithi046 ceph-mon[30954]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:53:08.052 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:07 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:08.052 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:07 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:08.052 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:07 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:08.052 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:07 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:08.052 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:07 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:53:08.053 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:07 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:08.067 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:07 smithi105 ceph-mon[34773]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:53:08.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:07 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:08.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:07 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:08.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:07 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:08.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:07 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:08.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:07 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:53:08.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:07 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:08.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:07 smithi162 ceph-mon[35071]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:53:08.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:07 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:08.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:07 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:08.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:07 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:08.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:07 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:08.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:07 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:53:08.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:07 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:53:08.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.141+0000 7efd74d44640 1 -- 172.21.15.46:0/319345381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd70105250 msgr2=0x7efd7010d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:08.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.141+0000 7efd74d44640 1 --2- 172.21.15.46:0/319345381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd70105250 0x7efd7010d970 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efd58009900 tx=0x7efd5802a410 comp rx=0 tx=0).stop 2024-09-21T03:53:08.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.141+0000 7efd74d44640 1 -- 172.21.15.46:0/319345381 shutdown_connections 2024-09-21T03:53:08.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.141+0000 7efd74d44640 1 --2- 172.21.15.46:0/319345381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd7010deb0 0x7efd70110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:08.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.141+0000 7efd74d44640 1 --2- 172.21.15.46:0/319345381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd70105250 0x7efd7010d970 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:08.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.141+0000 7efd74d44640 1 --2- 172.21.15.46:0/319345381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd70104900 0x7efd70104d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:08.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.141+0000 7efd74d44640 1 -- 172.21.15.46:0/319345381 >> 172.21.15.46:0/319345381 conn(0x7efd70079760 msgr2=0x7efd70079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:08.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.141+0000 7efd74d44640 1 -- 172.21.15.46:0/319345381 shutdown_connections 2024-09-21T03:53:08.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.141+0000 7efd74d44640 1 -- 172.21.15.46:0/319345381 wait complete. 2024-09-21T03:53:08.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.142+0000 7efd74d44640 1 Processor -- start 2024-09-21T03:53:08.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.142+0000 7efd74d44640 1 -- start start 2024-09-21T03:53:08.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.143+0000 7efd74d44640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd70104900 0x7efd7019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:08.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.143+0000 7efd74d44640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd70105250 0x7efd7019ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:08.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.143+0000 7efd74d44640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd7010deb0 0x7efd7019fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:08.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.143+0000 7efd74d44640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7efd70113aa0 con 0x7efd70104900 2024-09-21T03:53:08.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.143+0000 7efd74d44640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efd70113920 con 0x7efd7010deb0 2024-09-21T03:53:08.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.143+0000 7efd74d44640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efd70113c20 con 0x7efd70105250 2024-09-21T03:53:08.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.143+0000 7efd6e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd70104900 0x7efd7019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:08.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.143+0000 7efd6e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd70104900 0x7efd7019a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44306/0 (socket says 172.21.15.46:44306) 2024-09-21T03:53:08.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.143+0000 7efd6e59c640 1 -- 172.21.15.46:0/1602871745 learned_addr learned my addr 172.21.15.46:0/1602871745 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:53:08.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.143+0000 7efd6ed9d640 1 --2- 172.21.15.46:0/1602871745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd7010deb0 0x7efd7019fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:08.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.143+0000 7efd65d9b640 1 --2- 172.21.15.46:0/1602871745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd70105250 0x7efd7019ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:08.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.143+0000 7efd6e59c640 1 -- 172.21.15.46:0/1602871745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd70105250 msgr2=0x7efd7019ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:08.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.143+0000 7efd6e59c640 1 --2- 172.21.15.46:0/1602871745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd70105250 0x7efd7019ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:08.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.143+0000 7efd6e59c640 1 -- 172.21.15.46:0/1602871745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd7010deb0 msgr2=0x7efd7019fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:08.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.143+0000 7efd6e59c640 1 --2- 172.21.15.46:0/1602871745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd7010deb0 0x7efd7019fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.143+0000 7efd6e59c640 1 -- 172.21.15.46:0/1602871745 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd701a04a0 con 0x7efd70104900 2024-09-21T03:53:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.144+0000 7efd6e59c640 1 --2- 172.21.15.46:0/1602871745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd70104900 0x7efd7019a5f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7efd6000d950 tx=0x7efd6000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.144+0000 7efd67fff640 1 -- 172.21.15.46:0/1602871745 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd60017070 con 0x7efd70104900 2024-09-21T03:53:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.144+0000 7efd74d44640 1 -- 172.21.15.46:0/1602871745 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd701a0790 con 0x7efd70104900 2024-09-21T03:53:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.144+0000 7efd67fff640 1 -- 172.21.15.46:0/1602871745 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd60009c30 con 0x7efd70104900 2024-09-21T03:53:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.144+0000 7efd67fff640 1 -- 172.21.15.46:0/1602871745 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6000f620 con 0x7efd70104900 2024-09-21T03:53:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.144+0000 7efd74d44640 1 -- 172.21.15.46:0/1602871745 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd701a6fb0 con 0x7efd70104900 2024-09-21T03:53:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.145+0000 7efd74d44640 1 -- 172.21.15.46:0/1602871745 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd7006c150 con 0x7efd70104900 2024-09-21T03:53:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.147+0000 7efd67fff640 1 -- 172.21.15.46:0/1602871745 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7efd6001a070 con 0x7efd70104900 2024-09-21T03:53:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.148+0000 7efd67fff640 1 --2- 172.21.15.46:0/1602871745 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7efd5c0b6590 0x7efd5c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.148+0000 7efd65d9b640 1 --2- 172.21.15.46:0/1602871745 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7efd5c0b6590 0x7efd5c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.148+0000 7efd67fff640 1 -- 172.21.15.46:0/1602871745 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7efd600e6af0 con 0x7efd70104900 2024-09-21T03:53:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.148+0000 7efd65d9b640 1 --2- 172.21.15.46:0/1602871745 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7efd5c0b6590 0x7efd5c0b8aa0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efd58000c00 tx=0x7efd58031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.151+0000 7efd67fff640 1 -- 172.21.15.46:0/1602871745 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efd600ad6b0 con 0x7efd70104900 2024-09-21T03:53:08.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.341+0000 7efd74d44640 1 -- 172.21.15.46:0/1602871745 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7efd701a7180 con 0x7efd70104900 2024-09-21T03:53:08.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.341+0000 7efd67fff640 1 -- 172.21.15.46:0/1602871745 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v70) ==== 84+0+65 (secure 0 0 0) 0x7efd600b1a90 con 0x7efd70104900 2024-09-21T03:53:08.343 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:53:08.343 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2024-09-21T03:53:08.344 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T03:53:08.344 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 1, 2024-09-21T03:53:08.344 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": ".mgr" 2024-09-21T03:53:08.344 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:53:08.344 INFO:teuthology.orchestra.run.smithi046.stdout:] 2024-09-21T03:53:08.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.343+0000 7efd74d44640 1 -- 172.21.15.46:0/1602871745 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7efd5c0b6590 msgr2=0x7efd5c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:08.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.343+0000 7efd74d44640 1 --2- 172.21.15.46:0/1602871745 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7efd5c0b6590 0x7efd5c0b8aa0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efd58000c00 tx=0x7efd58031400 comp rx=0 tx=0).stop 2024-09-21T03:53:08.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.343+0000 7efd74d44640 1 -- 172.21.15.46:0/1602871745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd70104900 msgr2=0x7efd7019a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:08.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.343+0000 7efd74d44640 1 --2- 172.21.15.46:0/1602871745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd70104900 0x7efd7019a5f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7efd6000d950 tx=0x7efd6000de10 comp rx=0 tx=0).stop 2024-09-21T03:53:08.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.344+0000 7efd74d44640 1 -- 172.21.15.46:0/1602871745 shutdown_connections 2024-09-21T03:53:08.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.344+0000 7efd74d44640 1 --2- 172.21.15.46:0/1602871745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd7010deb0 0x7efd7019fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:08.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.344+0000 7efd74d44640 1 --2- 172.21.15.46:0/1602871745 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7efd5c0b6590 0x7efd5c0b8aa0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:08.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.344+0000 7efd74d44640 1 --2- 172.21.15.46:0/1602871745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd70105250 0x7efd7019ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:08.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.344+0000 7efd74d44640 1 --2- 172.21.15.46:0/1602871745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd70104900 0x7efd7019a5f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:08.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.344+0000 7efd74d44640 1 -- 172.21.15.46:0/1602871745 >> 172.21.15.46:0/1602871745 conn(0x7efd70079760 msgr2=0x7efd70107ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:08.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.344+0000 7efd74d44640 1 -- 172.21.15.46:0/1602871745 shutdown_connections 2024-09-21T03:53:08.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:08.344+0000 7efd74d44640 1 -- 172.21.15.46:0/1602871745 wait complete. 2024-09-21T03:53:08.949 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:08 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/1602871745' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T03:53:08.978 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T03:53:08.979 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T03:53:09.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:08 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/1602871745' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T03:53:09.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:08 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/1602871745' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T03:53:09.245 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:09.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.741+0000 7f4d056db640 1 -- 172.21.15.46:0/1134234457 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d00107bd0 msgr2=0x7f4d00107fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:09.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.741+0000 7f4d056db640 1 --2- 172.21.15.46:0/1134234457 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d00107bd0 0x7f4d00107fe0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8009900 tx=0x7f4ce802a410 comp rx=0 tx=0).stop 2024-09-21T03:53:09.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.741+0000 7f4d056db640 1 -- 172.21.15.46:0/1134234457 shutdown_connections 2024-09-21T03:53:09.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.741+0000 7f4d056db640 1 --2- 172.21.15.46:0/1134234457 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d00108520 0x7f4d0010ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:09.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.741+0000 7f4d056db640 1 --2- 172.21.15.46:0/1134234457 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d00107bd0 0x7f4d00107fe0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:09.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.741+0000 7f4d056db640 1 --2- 172.21.15.46:0/1134234457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d00102290 0x7f4d001026a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:09.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.741+0000 7f4d056db640 1 -- 172.21.15.46:0/1134234457 >> 172.21.15.46:0/1134234457 conn(0x7f4d00079ea0 msgr2=0x7f4d0007a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:09.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.741+0000 7f4d056db640 1 -- 172.21.15.46:0/1134234457 shutdown_connections 2024-09-21T03:53:09.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.741+0000 7f4d056db640 1 -- 172.21.15.46:0/1134234457 wait complete. 2024-09-21T03:53:09.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.742+0000 7f4d056db640 1 Processor -- start 2024-09-21T03:53:09.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.742+0000 7f4d056db640 1 -- start start 2024-09-21T03:53:09.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.742+0000 7f4d056db640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d00102290 0x7f4d0019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:09.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.742+0000 7f4d056db640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d00107bd0 0x7f4d0019ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:09.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.742+0000 7f4d056db640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d00108520 0x7f4d0019fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:09.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.742+0000 7f4d056db640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4d00111960 con 0x7f4d00107bd0 2024-09-21T03:53:09.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.742+0000 7f4d056db640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4d001117e0 con 0x7f4d00102290 2024-09-21T03:53:09.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.742+0000 7f4d056db640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4d00111ae0 con 0x7f4d00108520 2024-09-21T03:53:09.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.742+0000 7f4cf67fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d00107bd0 0x7f4d0019ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:09.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.742+0000 7f4cf67fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d00107bd0 0x7f4d0019ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44328/0 (socket says 172.21.15.46:44328) 2024-09-21T03:53:09.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.742+0000 7f4cf67fc640 1 -- 172.21.15.46:0/3811440990 learned_addr learned my addr 172.21.15.46:0/3811440990 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:53:09.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.742+0000 7f4cfeffd640 1 --2- 172.21.15.46:0/3811440990 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d00102290 0x7f4d0019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:09.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.742+0000 7f4cff7fe640 1 --2- 172.21.15.46:0/3811440990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d00108520 0x7f4d0019fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:09.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.743+0000 7f4cf67fc640 1 -- 172.21.15.46:0/3811440990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d00108520 msgr2=0x7f4d0019fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:09.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.743+0000 7f4cf67fc640 1 --2- 172.21.15.46:0/3811440990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d00108520 0x7f4d0019fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:09.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.743+0000 7f4cf67fc640 1 -- 172.21.15.46:0/3811440990 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d00102290 msgr2=0x7f4d0019a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:09.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.743+0000 7f4cf67fc640 1 --2- 172.21.15.46:0/3811440990 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d00102290 0x7f4d0019a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:09.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.743+0000 7f4cf67fc640 1 -- 172.21.15.46:0/3811440990 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d001a0440 con 0x7f4d00107bd0 2024-09-21T03:53:09.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.743+0000 7f4cfeffd640 1 --2- 172.21.15.46:0/3811440990 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d00102290 0x7f4d0019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:53:09.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.743+0000 7f4cf67fc640 1 --2- 172.21.15.46:0/3811440990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d00107bd0 0x7f4d0019ab30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4ce802a930 tx=0x7f4ce8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:09.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.743+0000 7f4cfcff9640 1 -- 172.21.15.46:0/3811440990 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce803f030 con 0x7f4d00107bd0 2024-09-21T03:53:09.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.743+0000 7f4d056db640 1 -- 172.21.15.46:0/3811440990 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d001a06d0 con 0x7f4d00107bd0 2024-09-21T03:53:09.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.743+0000 7f4cfcff9640 1 -- 172.21.15.46:0/3811440990 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ce8003aa0 con 0x7f4d00107bd0 2024-09-21T03:53:09.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.743+0000 7f4cfcff9640 1 -- 172.21.15.46:0/3811440990 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8035070 con 0x7f4d00107bd0 2024-09-21T03:53:09.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.743+0000 7f4d056db640 1 -- 172.21.15.46:0/3811440990 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d001a0c00 con 0x7f4d00107bd0 2024-09-21T03:53:09.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.744+0000 7f4d056db640 1 -- 172.21.15.46:0/3811440990 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d001026a0 con 0x7f4d00107bd0 2024-09-21T03:53:09.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.746+0000 7f4cfcff9640 1 -- 172.21.15.46:0/3811440990 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f4ce8042030 con 0x7f4d00107bd0 2024-09-21T03:53:09.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.747+0000 7f4cfcff9640 1 --2- 172.21.15.46:0/3811440990 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4cec0b6590 0x7f4cec0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:09.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.747+0000 7f4cfeffd640 1 --2- 172.21.15.46:0/3811440990 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4cec0b6590 0x7f4cec0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:09.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.747+0000 7f4cfcff9640 1 -- 172.21.15.46:0/3811440990 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f4ce8107b70 con 0x7f4d00107bd0 2024-09-21T03:53:09.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.747+0000 7f4cfeffd640 1 --2- 172.21.15.46:0/3811440990 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4cec0b6590 0x7f4cec0b8aa0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4cf000abe0 tx=0x7f4cf000a5c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:09.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.750+0000 7f4cfcff9640 1 -- 172.21.15.46:0/3811440990 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4d001a0c00 con 0x7f4d00107bd0 2024-09-21T03:53:09.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:09.938+0000 7f4d056db640 1 -- 172.21.15.46:0/3811440990 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f4d0019b6c0 con 0x7f4d00107bd0 2024-09-21T03:53:09.941 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:09 smithi046 ceph-mon[30954]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:53:10.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:09 smithi105 ceph-mon[34773]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:53:10.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:09 smithi162 ceph-mon[35071]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:53:10.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:10.785+0000 7f4cfcff9640 1 -- 172.21.15.46:0/3811440990 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v71) ==== 138+0+0 (secure 0 0 0) 0x7f4ce80ce7b0 con 0x7f4d00107bd0 2024-09-21T03:53:10.788 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' created 2024-09-21T03:53:10.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:10.789+0000 7f4d056db640 1 -- 172.21.15.46:0/3811440990 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4cec0b6590 msgr2=0x7f4cec0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:10.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:10.789+0000 7f4d056db640 1 --2- 172.21.15.46:0/3811440990 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4cec0b6590 0x7f4cec0b8aa0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4cf000abe0 tx=0x7f4cf000a5c0 comp rx=0 tx=0).stop 2024-09-21T03:53:10.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:10.789+0000 7f4d056db640 1 -- 172.21.15.46:0/3811440990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d00107bd0 msgr2=0x7f4d0019ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:10.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:10.789+0000 7f4d056db640 1 --2- 172.21.15.46:0/3811440990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d00107bd0 0x7f4d0019ab30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4ce802a930 tx=0x7f4ce8004270 comp rx=0 tx=0).stop 2024-09-21T03:53:10.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:10.789+0000 7f4d056db640 1 -- 172.21.15.46:0/3811440990 shutdown_connections 2024-09-21T03:53:10.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:10.789+0000 7f4d056db640 1 --2- 172.21.15.46:0/3811440990 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4cec0b6590 0x7f4cec0b8aa0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:10.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:10.789+0000 7f4d056db640 1 --2- 172.21.15.46:0/3811440990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d00108520 0x7f4d0019fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:10.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:10.789+0000 7f4d056db640 1 --2- 172.21.15.46:0/3811440990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d00107bd0 0x7f4d0019ab30 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:10.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:10.789+0000 7f4d056db640 1 --2- 172.21.15.46:0/3811440990 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d00102290 0x7f4d0019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:10.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:10.789+0000 7f4d056db640 1 -- 172.21.15.46:0/3811440990 >> 172.21.15.46:0/3811440990 conn(0x7f4d00079ea0 msgr2=0x7f4d00101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:10.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:10.789+0000 7f4d056db640 1 -- 172.21.15.46:0/3811440990 shutdown_connections 2024-09-21T03:53:10.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:10.789+0000 7f4d056db640 1 -- 172.21.15.46:0/3811440990 wait complete. 2024-09-21T03:53:11.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:10 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3811440990' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T03:53:11.099 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:10 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3811440990' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T03:53:11.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:10 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3811440990' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T03:53:11.540 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T03:53:11.799 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:11 smithi046 ceph-mon[30954]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:53:11.800 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:11 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3811440990' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T03:53:11.800 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:11 smithi046 ceph-mon[30954]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T03:53:11.816 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:12.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:11 smithi105 ceph-mon[34773]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:53:12.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:11 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3811440990' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T03:53:12.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:11 smithi105 ceph-mon[34773]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T03:53:12.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:11 smithi162 ceph-mon[35071]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:53:12.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:11 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3811440990' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T03:53:12.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:11 smithi162 ceph-mon[35071]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T03:53:12.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.318+0000 7f41c1bd4640 1 -- 172.21.15.46:0/18833512 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41bc109df0 msgr2=0x7f41bc110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:12.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.318+0000 7f41c1bd4640 1 --2- 172.21.15.46:0/18833512 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41bc109df0 0x7f41bc110620 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f41b4009ca0 tx=0x7f41b402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.318+0000 7f41c1bd4640 1 -- 172.21.15.46:0/18833512 shutdown_connections 2024-09-21T03:53:12.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.318+0000 7f41c1bd4640 1 --2- 172.21.15.46:0/18833512 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41bc109df0 0x7f41bc110620 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.318+0000 7f41c1bd4640 1 --2- 172.21.15.46:0/18833512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41bc1094a0 0x7f41bc1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.318+0000 7f41c1bd4640 1 --2- 172.21.15.46:0/18833512 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41bc103b60 0x7f41bc103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.318+0000 7f41c1bd4640 1 -- 172.21.15.46:0/18833512 >> 172.21.15.46:0/18833512 conn(0x7f41bc07b850 msgr2=0x7f41bc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:12.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.318+0000 7f41c1bd4640 1 -- 172.21.15.46:0/18833512 shutdown_connections 2024-09-21T03:53:12.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.319+0000 7f41c1bd4640 1 -- 172.21.15.46:0/18833512 wait complete. 2024-09-21T03:53:12.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.319+0000 7f41c1bd4640 1 Processor -- start 2024-09-21T03:53:12.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.319+0000 7f41c1bd4640 1 -- start start 2024-09-21T03:53:12.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.320+0000 7f41c1bd4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41bc103b60 0x7f41bc19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:12.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.320+0000 7f41c1bd4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41bc1094a0 0x7f41bc19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:12.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.320+0000 7f41c1bd4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41bc109df0 0x7f41bc19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:12.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.320+0000 7f41c1bd4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f41bc113ab0 con 0x7f41bc109df0 2024-09-21T03:53:12.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.320+0000 7f41c1bd4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f41bc113930 con 0x7f41bc103b60 2024-09-21T03:53:12.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.320+0000 7f41c1bd4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f41bc113c30 con 0x7f41bc1094a0 2024-09-21T03:53:12.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.320+0000 7f41bbfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41bc109df0 0x7f41bc19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:12.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.320+0000 7f41bbfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41bc109df0 0x7f41bc19fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60802/0 (socket says 172.21.15.46:60802) 2024-09-21T03:53:12.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.320+0000 7f41bbfff640 1 -- 172.21.15.46:0/2367334703 learned_addr learned my addr 172.21.15.46:0/2367334703 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:53:12.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.320+0000 7f41bb7fe640 1 --2- 172.21.15.46:0/2367334703 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41bc103b60 0x7f41bc19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:12.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.320+0000 7f41baffd640 1 --2- 172.21.15.46:0/2367334703 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41bc1094a0 0x7f41bc19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:12.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.320+0000 7f41bbfff640 1 -- 172.21.15.46:0/2367334703 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41bc1094a0 msgr2=0x7f41bc19aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:12.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.320+0000 7f41bbfff640 1 --2- 172.21.15.46:0/2367334703 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41bc1094a0 0x7f41bc19aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.320+0000 7f41bbfff640 1 -- 172.21.15.46:0/2367334703 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41bc103b60 msgr2=0x7f41bc19a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:12.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.320+0000 7f41bbfff640 1 --2- 172.21.15.46:0/2367334703 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41bc103b60 0x7f41bc19a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.320+0000 7f41bbfff640 1 -- 172.21.15.46:0/2367334703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41bc1a0330 con 0x7f41bc109df0 2024-09-21T03:53:12.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.321+0000 7f41bbfff640 1 --2- 172.21.15.46:0/2367334703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41bc109df0 0x7f41bc19fcc0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f41b4005cc0 tx=0x7f41b402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:12.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.321+0000 7f41b8ff9640 1 -- 172.21.15.46:0/2367334703 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b4003bf0 con 0x7f41bc109df0 2024-09-21T03:53:12.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.321+0000 7f41b8ff9640 1 -- 172.21.15.46:0/2367334703 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41b4003d90 con 0x7f41bc109df0 2024-09-21T03:53:12.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.321+0000 7f41c1bd4640 1 -- 172.21.15.46:0/2367334703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41bc1a05c0 con 0x7f41bc109df0 2024-09-21T03:53:12.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.321+0000 7f41b8ff9640 1 -- 172.21.15.46:0/2367334703 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b402fb20 con 0x7f41bc109df0 2024-09-21T03:53:12.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.321+0000 7f41c1bd4640 1 -- 172.21.15.46:0/2367334703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41bc1a6e40 con 0x7f41bc109df0 2024-09-21T03:53:12.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.322+0000 7f41c1bd4640 1 -- 172.21.15.46:0/2367334703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41bc103f70 con 0x7f41bc109df0 2024-09-21T03:53:12.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.324+0000 7f41b8ff9640 1 -- 172.21.15.46:0/2367334703 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f41b4004580 con 0x7f41bc109df0 2024-09-21T03:53:12.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.324+0000 7f41b8ff9640 1 --2- 172.21.15.46:0/2367334703 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f41a40b6610 0x7f41a40b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:12.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.324+0000 7f41bb7fe640 1 --2- 172.21.15.46:0/2367334703 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f41a40b6610 0x7f41a40b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:12.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.325+0000 7f41b8ff9640 1 -- 172.21.15.46:0/2367334703 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7712+0+0 (secure 0 0 0) 0x7f41b4108510 con 0x7f41bc109df0 2024-09-21T03:53:12.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.325+0000 7f41bb7fe640 1 --2- 172.21.15.46:0/2367334703 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f41a40b6610 0x7f41a40b8b20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f41ac00abe0 tx=0x7f41ac00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:12.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.328+0000 7f41b8ff9640 1 -- 172.21.15.46:0/2367334703 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f41b40098b0 con 0x7f41bc109df0 2024-09-21T03:53:12.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.517+0000 7f41c1bd4640 1 -- 172.21.15.46:0/2367334703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f41bc10bbe0 con 0x7f41bc109df0 2024-09-21T03:53:12.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.802+0000 7f41b8ff9640 1 -- 172.21.15.46:0/2367334703 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v73) ==== 170+0+0 (secure 0 0 0) 0x7f41b40cf000 con 0x7f41bc109df0 2024-09-21T03:53:12.804 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' created 2024-09-21T03:53:12.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.805+0000 7f41c1bd4640 1 -- 172.21.15.46:0/2367334703 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f41a40b6610 msgr2=0x7f41a40b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:12.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.805+0000 7f41c1bd4640 1 --2- 172.21.15.46:0/2367334703 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f41a40b6610 0x7f41a40b8b20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f41ac00abe0 tx=0x7f41ac00a2d0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.805+0000 7f41c1bd4640 1 -- 172.21.15.46:0/2367334703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41bc109df0 msgr2=0x7f41bc19fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:12.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.805+0000 7f41c1bd4640 1 --2- 172.21.15.46:0/2367334703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41bc109df0 0x7f41bc19fcc0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f41b4005cc0 tx=0x7f41b402f380 comp rx=0 tx=0).stop 2024-09-21T03:53:12.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.805+0000 7f41c1bd4640 1 -- 172.21.15.46:0/2367334703 shutdown_connections 2024-09-21T03:53:12.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.805+0000 7f41c1bd4640 1 --2- 172.21.15.46:0/2367334703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41bc109df0 0x7f41bc19fcc0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.805+0000 7f41c1bd4640 1 --2- 172.21.15.46:0/2367334703 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f41a40b6610 0x7f41a40b8b20 secure :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f41ac00abe0 tx=0x7f41ac00a2d0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.805+0000 7f41c1bd4640 1 --2- 172.21.15.46:0/2367334703 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41bc1094a0 0x7f41bc19aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.805+0000 7f41c1bd4640 1 --2- 172.21.15.46:0/2367334703 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41bc103b60 0x7f41bc19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.805+0000 7f41c1bd4640 1 -- 172.21.15.46:0/2367334703 >> 172.21.15.46:0/2367334703 conn(0x7f41bc07b850 msgr2=0x7f41bc1074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:12.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.805+0000 7f41c1bd4640 1 -- 172.21.15.46:0/2367334703 shutdown_connections 2024-09-21T03:53:12.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:12.806+0000 7f41c1bd4640 1 -- 172.21.15.46:0/2367334703 wait complete. 2024-09-21T03:53:13.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:12 smithi105 ceph-mon[34773]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T03:53:13.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:12 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/2367334703' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T03:53:13.108 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:12 smithi046 ceph-mon[30954]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T03:53:13.109 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:12 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/2367334703' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T03:53:13.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:12 smithi162 ceph-mon[35071]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T03:53:13.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:12 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/2367334703' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T03:53:13.473 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T03:53:13.731 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:14.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:13 smithi105 ceph-mon[34773]: pgmap v260: 33 pgs: 1 creating+activating, 16 creating+peering, 2 active+clean, 14 unknown; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:53:14.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:13 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/2367334703' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T03:53:14.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:13 smithi105 ceph-mon[34773]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T03:53:14.123 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:13 smithi046 ceph-mon[30954]: pgmap v260: 33 pgs: 1 creating+activating, 16 creating+peering, 2 active+clean, 14 unknown; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:53:14.123 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:13 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/2367334703' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T03:53:14.123 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:13 smithi046 ceph-mon[30954]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T03:53:14.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:13 smithi162 ceph-mon[35071]: pgmap v260: 33 pgs: 1 creating+activating, 16 creating+peering, 2 active+clean, 14 unknown; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:53:14.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:13 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/2367334703' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T03:53:14.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:13 smithi162 ceph-mon[35071]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T03:53:14.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.217+0000 7f20f4802640 1 -- 172.21.15.46:0/1116611499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20f0109e10 msgr2=0x7f20f0110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:14.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.217+0000 7f20f4802640 1 --2- 172.21.15.46:0/1116611499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20f0109e10 0x7f20f0110640 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f20e8009900 tx=0x7f20e802a410 comp rx=0 tx=0).stop 2024-09-21T03:53:14.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.217+0000 7f20f4802640 1 -- 172.21.15.46:0/1116611499 shutdown_connections 2024-09-21T03:53:14.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.217+0000 7f20f4802640 1 --2- 172.21.15.46:0/1116611499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20f0109e10 0x7f20f0110640 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:14.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.217+0000 7f20f4802640 1 --2- 172.21.15.46:0/1116611499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20f01094c0 0x7f20f01098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:14.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.217+0000 7f20f4802640 1 --2- 172.21.15.46:0/1116611499 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20f0103b80 0x7f20f0103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:14.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.217+0000 7f20f4802640 1 -- 172.21.15.46:0/1116611499 >> 172.21.15.46:0/1116611499 conn(0x7f20f00ff610 msgr2=0x7f20f0101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:14.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.217+0000 7f20f4802640 1 -- 172.21.15.46:0/1116611499 shutdown_connections 2024-09-21T03:53:14.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.217+0000 7f20f4802640 1 -- 172.21.15.46:0/1116611499 wait complete. 2024-09-21T03:53:14.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.218+0000 7f20f4802640 1 Processor -- start 2024-09-21T03:53:14.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.218+0000 7f20f4802640 1 -- start start 2024-09-21T03:53:14.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.218+0000 7f20f4802640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20f0103b80 0x7f20f019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:14.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.218+0000 7f20f4802640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20f01094c0 0x7f20f019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:14.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.218+0000 7f20f4802640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20f0109e10 0x7f20f019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:14.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.218+0000 7f20f4802640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f20f0113ad0 con 0x7f20f01094c0 2024-09-21T03:53:14.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.218+0000 7f20f4802640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f20f0113950 con 0x7f20f0109e10 2024-09-21T03:53:14.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.218+0000 7f20f4802640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f20f0113c50 con 0x7f20f0103b80 2024-09-21T03:53:14.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.219+0000 7f20edd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20f01094c0 0x7f20f019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:14.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.219+0000 7f20edd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20f01094c0 0x7f20f019aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60812/0 (socket says 172.21.15.46:60812) 2024-09-21T03:53:14.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.219+0000 7f20edd9b640 1 -- 172.21.15.46:0/2580755787 learned_addr learned my addr 172.21.15.46:0/2580755787 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:53:14.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.219+0000 7f20ee59c640 1 --2- 172.21.15.46:0/2580755787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20f0103b80 0x7f20f019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:14.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.219+0000 7f20eed9d640 1 --2- 172.21.15.46:0/2580755787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20f0109e10 0x7f20f019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:14.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.219+0000 7f20edd9b640 1 -- 172.21.15.46:0/2580755787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20f0103b80 msgr2=0x7f20f019a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:14.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.219+0000 7f20edd9b640 1 --2- 172.21.15.46:0/2580755787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20f0103b80 0x7f20f019a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:14.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.219+0000 7f20edd9b640 1 -- 172.21.15.46:0/2580755787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20f0109e10 msgr2=0x7f20f019fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:14.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.219+0000 7f20edd9b640 1 --2- 172.21.15.46:0/2580755787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20f0109e10 0x7f20f019fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:14.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.219+0000 7f20edd9b640 1 -- 172.21.15.46:0/2580755787 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f01a0450 con 0x7f20f01094c0 2024-09-21T03:53:14.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.219+0000 7f20edd9b640 1 --2- 172.21.15.46:0/2580755787 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20f01094c0 0x7f20f019aa80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f20d800e9c0 tx=0x7f20d800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:14.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.219+0000 7f20e77fe640 1 -- 172.21.15.46:0/2580755787 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d800ccc0 con 0x7f20f01094c0 2024-09-21T03:53:14.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.219+0000 7f20e77fe640 1 -- 172.21.15.46:0/2580755787 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20d80054d0 con 0x7f20f01094c0 2024-09-21T03:53:14.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.219+0000 7f20f4802640 1 -- 172.21.15.46:0/2580755787 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20f01a0740 con 0x7f20f01094c0 2024-09-21T03:53:14.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.219+0000 7f20e77fe640 1 -- 172.21.15.46:0/2580755787 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d8010430 con 0x7f20f01094c0 2024-09-21T03:53:14.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.219+0000 7f20f4802640 1 -- 172.21.15.46:0/2580755787 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20f01a6ea0 con 0x7f20f01094c0 2024-09-21T03:53:14.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.220+0000 7f20f4802640 1 -- 172.21.15.46:0/2580755787 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20f0104e00 con 0x7f20f01094c0 2024-09-21T03:53:14.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.222+0000 7f20e77fe640 1 -- 172.21.15.46:0/2580755787 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f20d8005000 con 0x7f20f01094c0 2024-09-21T03:53:14.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.223+0000 7f20e77fe640 1 --2- 172.21.15.46:0/2580755787 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f20dc0b65e0 0x7f20dc0b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:14.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.223+0000 7f20ee59c640 1 --2- 172.21.15.46:0/2580755787 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f20dc0b65e0 0x7f20dc0b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:14.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.223+0000 7f20e77fe640 1 -- 172.21.15.46:0/2580755787 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8094+0+0 (secure 0 0 0) 0x7f20d80e7760 con 0x7f20f01094c0 2024-09-21T03:53:14.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.224+0000 7f20ee59c640 1 --2- 172.21.15.46:0/2580755787 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f20dc0b65e0 0x7f20dc0b8af0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f20e0005fd0 tx=0x7f20e0009760 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:14.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.226+0000 7f20e77fe640 1 -- 172.21.15.46:0/2580755787 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f20d8056710 con 0x7f20f01094c0 2024-09-21T03:53:14.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.451+0000 7f20f4802640 1 -- 172.21.15.46:0/2580755787 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f20f019b610 con 0x7f20f01094c0 2024-09-21T03:53:14.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.817+0000 7f20e77fe640 1 -- 172.21.15.46:0/2580755787 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f20f019b610 con 0x7f20f01094c0 2024-09-21T03:53:14.819 INFO:teuthology.orchestra.run.smithi046.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T03:53:14.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.820+0000 7f20f4802640 1 -- 172.21.15.46:0/2580755787 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f20dc0b65e0 msgr2=0x7f20dc0b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:14.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.820+0000 7f20f4802640 1 --2- 172.21.15.46:0/2580755787 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f20dc0b65e0 0x7f20dc0b8af0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f20e0005fd0 tx=0x7f20e0009760 comp rx=0 tx=0).stop 2024-09-21T03:53:14.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.820+0000 7f20f4802640 1 -- 172.21.15.46:0/2580755787 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20f01094c0 msgr2=0x7f20f019aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:14.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.820+0000 7f20f4802640 1 --2- 172.21.15.46:0/2580755787 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20f01094c0 0x7f20f019aa80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f20d800e9c0 tx=0x7f20d800ee80 comp rx=0 tx=0).stop 2024-09-21T03:53:14.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.820+0000 7f20f4802640 1 -- 172.21.15.46:0/2580755787 shutdown_connections 2024-09-21T03:53:14.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.820+0000 7f20f4802640 1 --2- 172.21.15.46:0/2580755787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20f0109e10 0x7f20f019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:14.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.820+0000 7f20f4802640 1 --2- 172.21.15.46:0/2580755787 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20f01094c0 0x7f20f019aa80 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:14.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.820+0000 7f20f4802640 1 --2- 172.21.15.46:0/2580755787 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f20dc0b65e0 0x7f20dc0b8af0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:14.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.820+0000 7f20f4802640 1 --2- 172.21.15.46:0/2580755787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20f0103b80 0x7f20f019a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:14.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.820+0000 7f20f4802640 1 -- 172.21.15.46:0/2580755787 >> 172.21.15.46:0/2580755787 conn(0x7f20f00ff610 msgr2=0x7f20f0108af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:14.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.820+0000 7f20f4802640 1 -- 172.21.15.46:0/2580755787 shutdown_connections 2024-09-21T03:53:14.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:14.820+0000 7f20f4802640 1 -- 172.21.15.46:0/2580755787 wait complete. 2024-09-21T03:53:15.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:14 smithi162 ceph-mon[35071]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T03:53:15.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:14 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/2580755787' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T03:53:15.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:14 smithi162 ceph-mon[35071]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T03:53:15.186 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:14 smithi046 ceph-mon[30954]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T03:53:15.186 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:14 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/2580755787' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T03:53:15.186 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:14 smithi046 ceph-mon[30954]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T03:53:15.243 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:14 smithi105 ceph-mon[34773]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T03:53:15.243 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:14 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/2580755787' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T03:53:15.243 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:14 smithi105 ceph-mon[34773]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T03:53:15.554 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T03:53:15.814 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:16.079 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:15 smithi046 ceph-mon[30954]: pgmap v263: 97 pgs: 1 creating+activating, 27 creating+peering, 13 active+clean, 56 unknown; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:53:16.079 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:15 smithi046 ceph-mon[30954]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T03:53:16.079 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:15 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/2580755787' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T03:53:16.079 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:15 smithi046 ceph-mon[30954]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T03:53:16.080 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:15 smithi046 ceph-mon[30954]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T03:53:16.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:15 smithi162 ceph-mon[35071]: pgmap v263: 97 pgs: 1 creating+activating, 27 creating+peering, 13 active+clean, 56 unknown; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:53:16.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:15 smithi162 ceph-mon[35071]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T03:53:16.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:15 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/2580755787' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T03:53:16.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:15 smithi162 ceph-mon[35071]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T03:53:16.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:15 smithi162 ceph-mon[35071]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T03:53:16.203 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:15 smithi105 ceph-mon[34773]: pgmap v263: 97 pgs: 1 creating+activating, 27 creating+peering, 13 active+clean, 56 unknown; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:53:16.203 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:15 smithi105 ceph-mon[34773]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T03:53:16.203 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:15 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/2580755787' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T03:53:16.203 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:15 smithi105 ceph-mon[34773]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T03:53:16.203 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:15 smithi105 ceph-mon[34773]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T03:53:16.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.247+0000 7fdb75315640 1 -- 172.21.15.46:0/1870185578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb701049b0 msgr2=0x7fdb70104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:16.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.247+0000 7fdb75315640 1 --2- 172.21.15.46:0/1870185578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb701049b0 0x7fdb70104dc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009ca0 tx=0x7fdb6002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.247+0000 7fdb75315640 1 -- 172.21.15.46:0/1870185578 shutdown_connections 2024-09-21T03:53:16.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.247+0000 7fdb75315640 1 --2- 172.21.15.46:0/1870185578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb7010de10 0x7fdb70110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.247+0000 7fdb75315640 1 --2- 172.21.15.46:0/1870185578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb70105300 0x7fdb7010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.247+0000 7fdb75315640 1 --2- 172.21.15.46:0/1870185578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb701049b0 0x7fdb70104dc0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.247+0000 7fdb75315640 1 -- 172.21.15.46:0/1870185578 >> 172.21.15.46:0/1870185578 conn(0x7fdb70079730 msgr2=0x7fdb70079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:16.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.247+0000 7fdb75315640 1 -- 172.21.15.46:0/1870185578 shutdown_connections 2024-09-21T03:53:16.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.247+0000 7fdb75315640 1 -- 172.21.15.46:0/1870185578 wait complete. 2024-09-21T03:53:16.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.247+0000 7fdb75315640 1 Processor -- start 2024-09-21T03:53:16.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.248+0000 7fdb75315640 1 -- start start 2024-09-21T03:53:16.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.248+0000 7fdb75315640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb701049b0 0x7fdb7019a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:16.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.248+0000 7fdb75315640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb70105300 0x7fdb7019ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:16.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.248+0000 7fdb75315640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb7010de10 0x7fdb7019fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:16.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.248+0000 7fdb75315640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdb70113a90 con 0x7fdb701049b0 2024-09-21T03:53:16.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.248+0000 7fdb75315640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdb70113910 con 0x7fdb7010de10 2024-09-21T03:53:16.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.248+0000 7fdb75315640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdb70113c10 con 0x7fdb70105300 2024-09-21T03:53:16.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.248+0000 7fdb6effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb701049b0 0x7fdb7019a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:16.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.248+0000 7fdb6effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb701049b0 0x7fdb7019a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60836/0 (socket says 172.21.15.46:60836) 2024-09-21T03:53:16.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.248+0000 7fdb6effd640 1 -- 172.21.15.46:0/872576856 learned_addr learned my addr 172.21.15.46:0/872576856 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:53:16.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.248+0000 7fdb6f7fe640 1 --2- 172.21.15.46:0/872576856 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb7010de10 0x7fdb7019fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:16.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.248+0000 7fdb6e7fc640 1 --2- 172.21.15.46:0/872576856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb70105300 0x7fdb7019ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:16.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.249+0000 7fdb6effd640 1 -- 172.21.15.46:0/872576856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb70105300 msgr2=0x7fdb7019ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:16.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.249+0000 7fdb6effd640 1 --2- 172.21.15.46:0/872576856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb70105300 0x7fdb7019ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.249+0000 7fdb6effd640 1 -- 172.21.15.46:0/872576856 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb7010de10 msgr2=0x7fdb7019fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:16.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.249+0000 7fdb6effd640 1 --2- 172.21.15.46:0/872576856 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb7010de10 0x7fdb7019fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.249+0000 7fdb6effd640 1 -- 172.21.15.46:0/872576856 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb701a04d0 con 0x7fdb701049b0 2024-09-21T03:53:16.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.249+0000 7fdb6effd640 1 --2- 172.21.15.46:0/872576856 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb701049b0 0x7fdb7019a560 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdb6002ade0 tx=0x7fdb60031770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:16.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.249+0000 7fdb67fff640 1 -- 172.21.15.46:0/872576856 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb60003b70 con 0x7fdb701049b0 2024-09-21T03:53:16.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.249+0000 7fdb67fff640 1 -- 172.21.15.46:0/872576856 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb60003d10 con 0x7fdb701049b0 2024-09-21T03:53:16.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.249+0000 7fdb75315640 1 -- 172.21.15.46:0/872576856 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb701a0760 con 0x7fdb701049b0 2024-09-21T03:53:16.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.249+0000 7fdb67fff640 1 -- 172.21.15.46:0/872576856 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6002fa50 con 0x7fdb701049b0 2024-09-21T03:53:16.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.249+0000 7fdb75315640 1 -- 172.21.15.46:0/872576856 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb701a6f20 con 0x7fdb701049b0 2024-09-21T03:53:16.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.250+0000 7fdb75315640 1 -- 172.21.15.46:0/872576856 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb70104dc0 con 0x7fdb701049b0 2024-09-21T03:53:16.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.252+0000 7fdb67fff640 1 -- 172.21.15.46:0/872576856 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fdb60004580 con 0x7fdb701049b0 2024-09-21T03:53:16.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.252+0000 7fdb67fff640 1 --2- 172.21.15.46:0/872576856 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fdb5c0b65e0 0x7fdb5c0b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:16.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.253+0000 7fdb6e7fc640 1 --2- 172.21.15.46:0/872576856 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fdb5c0b65e0 0x7fdb5c0b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:16.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.253+0000 7fdb67fff640 1 -- 172.21.15.46:0/872576856 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7fdb60108700 con 0x7fdb701049b0 2024-09-21T03:53:16.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.253+0000 7fdb6e7fc640 1 --2- 172.21.15.46:0/872576856 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fdb5c0b65e0 0x7fdb5c0b8af0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdb58005fd0 tx=0x7fdb58005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:16.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.256+0000 7fdb67fff640 1 -- 172.21.15.46:0/872576856 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdb600cef50 con 0x7fdb701049b0 2024-09-21T03:53:16.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.444+0000 7fdb75315640 1 -- 172.21.15.46:0/872576856 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdb7019b690 con 0x7fdb701049b0 2024-09-21T03:53:16.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.446+0000 7fdb67fff640 1 -- 172.21.15.46:0/872576856 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22594 (secure 0 0 0) 0x7fdb7019b690 con 0x7fdb701049b0 2024-09-21T03:53:16.448 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:53:16.449 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":75,"fsid":"a82de5ec-77cb-11ef-baf5-efdc52797490","created":"2024-09-21T03:44:31.512271+0000","modified":"2024-09-21T03:53:14.452862+0000","last_up_change":"2024-09-21T03:52:22.609789+0000","last_in_change":"2024-09-21T03:51:58.812316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:48:30.407205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:53:09.943833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:53:12.521980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ff9e1a8-fec7-422c-b594-880efe4684f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6803","nonce":791989880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6805","nonce":791989880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6809","nonce":791989880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6807","nonce":791989880}]},"public_addr":"172.21.15.46:6803/791989880","cluster_addr":"172.21.15.46:6805/791989880","heartbeat_back_addr":"172.21.15.46:6809/791989880","heartbeat_front_addr":"172.21.15.46:6807/791989880","state":["exists","up"]},{"osd":1,"uuid":"3df1bee7-615e-44d0-bd43-2370db6cd06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6801","nonce":1123652172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6803","nonce":1123652172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6807","nonce":1123652172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6805","nonce":1123652172}]},"public_addr":"172.21.15.105:6801/1123652172","cluster_addr":"172.21.15.105:6803/1123652172","heartbeat_back_addr":"172.21.15.105:6807/1123652172","heartbeat_front_addr":"172.21.15.105:6805/1123652172","state":["exists","up"]},{"osd":2,"uuid":"52d0e57f-cfca-447a-8a57-b1d5364cb4d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6801","nonce":34930776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6803","nonce":34930776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6807","nonce":34930776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6805","nonce":34930776}]},"public_addr":"172.21.15.162:6801/34930776","cluster_addr":"172.21.15.162:6803/34930776","heartbeat_back_addr":"172.21.15.162:6807/34930776","heartbeat_front_addr":"172.21.15.162:6805/34930776","state":["exists","up"]},{"osd":3,"uuid":"6f25f721-fc50-4b80-944b-d3df28e7a2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6811","nonce":1355580104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6813","nonce":1355580104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6817","nonce":1355580104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6815","nonce":1355580104}]},"public_addr":"172.21.15.46:6811/1355580104","cluster_addr":"172.21.15.46:6813/1355580104","heartbeat_back_addr":"172.21.15.46:6817/1355580104","heartbeat_front_addr":"172.21.15.46:6815/1355580104","state":["exists","up"]},{"osd":4,"uuid":"c2f41084-e5a1-4b5f-b799-a84b38da63a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6809","nonce":3566174660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6811","nonce":3566174660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6815","nonce":3566174660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6813","nonce":3566174660}]},"public_addr":"172.21.15.105:6809/3566174660","cluster_addr":"172.21.15.105:6811/3566174660","heartbeat_back_addr":"172.21.15.105:6815/3566174660","heartbeat_front_addr":"172.21.15.105:6813/3566174660","state":["exists","up"]},{"osd":5,"uuid":"b433d03b-fae8-4ece-b967-a8af91bc3ab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6809","nonce":3043419818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6811","nonce":3043419818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6815","nonce":3043419818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6813","nonce":3043419818}]},"public_addr":"172.21.15.162:6809/3043419818","cluster_addr":"172.21.15.162:6811/3043419818","heartbeat_back_addr":"172.21.15.162:6815/3043419818","heartbeat_front_addr":"172.21.15.162:6813/3043419818","state":["exists","up"]},{"osd":6,"uuid":"e6b5ce54-69aa-4811-9ca3-cab50525a175","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6819","nonce":1615361645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6821","nonce":1615361645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6825","nonce":1615361645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6823","nonce":1615361645}]},"public_addr":"172.21.15.46:6819/1615361645","cluster_addr":"172.21.15.46:6821/1615361645","heartbeat_back_addr":"172.21.15.46:6825/1615361645","heartbeat_front_addr":"172.21.15.46:6823/1615361645","state":["exists","up"]},{"osd":7,"uuid":"a6e89d5d-ce31-4e0c-9019-5eb13b134feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6817","nonce":1015687379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6819","nonce":1015687379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6823","nonce":1015687379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6821","nonce":1015687379}]},"public_addr":"172.21.15.105:6817/1015687379","cluster_addr":"172.21.15.105:6819/1015687379","heartbeat_back_addr":"172.21.15.105:6823/1015687379","heartbeat_front_addr":"172.21.15.105:6821/1015687379","state":["exists","up"]},{"osd":8,"uuid":"27b2ccec-65be-47b3-a924-c5939ba1cb5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6817","nonce":3441747512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6819","nonce":3441747512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6823","nonce":3441747512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6821","nonce":3441747512}]},"public_addr":"172.21.15.162:6817/3441747512","cluster_addr":"172.21.15.162:6819/3441747512","heartbeat_back_addr":"172.21.15.162:6823/3441747512","heartbeat_front_addr":"172.21.15.162:6821/3441747512","state":["exists","up"]},{"osd":9,"uuid":"3f7cb70c-73c7-48e8-a32b-7445eda2126d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6827","nonce":382230768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6829","nonce":382230768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6833","nonce":382230768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6831","nonce":382230768}]},"public_addr":"172.21.15.46:6827/382230768","cluster_addr":"172.21.15.46:6829/382230768","heartbeat_back_addr":"172.21.15.46:6833/382230768","heartbeat_front_addr":"172.21.15.46:6831/382230768","state":["exists","up"]},{"osd":10,"uuid":"76c3da87-f3c5-4985-87fd-647717b6af85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6825","nonce":1664619099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6827","nonce":1664619099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6831","nonce":1664619099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6829","nonce":1664619099}]},"public_addr":"172.21.15.105:6825/1664619099","cluster_addr":"172.21.15.105:6827/1664619099","heartbeat_back_addr":"172.21.15.105:6831/1664619099","heartbeat_front_addr":"172.21.15.105:6829/1664619099","state":["exists","up"]},{"osd":11,"uuid":"13269da8-5f05-4ce2-9c7a-6dd9c1041cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6825","nonce":1014820476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6827","nonce":1014820476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6831","nonce":1014820476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6829","nonce":1014820476}]},"public_addr":"172.21.15.162:6825/1014820476","cluster_addr":"172.21.15.162:6827/1014820476","heartbeat_back_addr":"172.21.15.162:6831/1014820476","heartbeat_front_addr":"172.21.15.162:6829/1014820476","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:47:38.630436+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:03.441596+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:28.647341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:54.270316+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:49:19.783873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:49:45.344485+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:50:12.165326+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:50:38.095996+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:03.814612+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:29.469718+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:55.407340+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:52:20.360243+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:6801/878116252":"2024-09-22T03:46:31.942086+0000","172.21.15.46:6800/878116252":"2024-09-22T03:46:31.942086+0000","172.21.15.46:0/3574041742":"2024-09-22T03:45:05.097136+0000","172.21.15.46:6801/1185001582":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/2839831446":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/3423884605":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/2761976928":"2024-09-22T03:46:31.942086+0000","172.21.15.46:0/1149961133":"2024-09-22T03:45:05.097136+0000","172.21.15.46:6800/1185001582":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/641493295":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/4033661287":"2024-09-22T03:45:31.101657+0000","172.21.15.46:6800/2733048710":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/3972416280":"2024-09-22T03:46:31.942086+0000","172.21.15.46:6801/2733048710":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/1662975018":"2024-09-22T03:46:31.942086+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:53:16.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.448+0000 7fdb75315640 1 -- 172.21.15.46:0/872576856 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fdb5c0b65e0 msgr2=0x7fdb5c0b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:16.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.448+0000 7fdb75315640 1 --2- 172.21.15.46:0/872576856 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fdb5c0b65e0 0x7fdb5c0b8af0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdb58005fd0 tx=0x7fdb58005850 comp rx=0 tx=0).stop 2024-09-21T03:53:16.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.448+0000 7fdb75315640 1 -- 172.21.15.46:0/872576856 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb701049b0 msgr2=0x7fdb7019a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:16.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.448+0000 7fdb75315640 1 --2- 172.21.15.46:0/872576856 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb701049b0 0x7fdb7019a560 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdb6002ade0 tx=0x7fdb60031770 comp rx=0 tx=0).stop 2024-09-21T03:53:16.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.448+0000 7fdb75315640 1 -- 172.21.15.46:0/872576856 shutdown_connections 2024-09-21T03:53:16.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.448+0000 7fdb75315640 1 --2- 172.21.15.46:0/872576856 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb7010de10 0x7fdb7019fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.448+0000 7fdb75315640 1 --2- 172.21.15.46:0/872576856 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fdb5c0b65e0 0x7fdb5c0b8af0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.448+0000 7fdb75315640 1 --2- 172.21.15.46:0/872576856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb70105300 0x7fdb7019ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.448+0000 7fdb75315640 1 --2- 172.21.15.46:0/872576856 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb701049b0 0x7fdb7019a560 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.448+0000 7fdb75315640 1 -- 172.21.15.46:0/872576856 >> 172.21.15.46:0/872576856 conn(0x7fdb70079730 msgr2=0x7fdb700ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:16.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.448+0000 7fdb75315640 1 -- 172.21.15.46:0/872576856 shutdown_connections 2024-09-21T03:53:16.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:16.448+0000 7fdb75315640 1 -- 172.21.15.46:0/872576856 wait complete. 2024-09-21T03:53:17.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:16 smithi162 ceph-mon[35071]: mds.? [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] up:active 2024-09-21T03:53:17.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:16 smithi162 ceph-mon[35071]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T03:53:17.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:16 smithi162 ceph-mon[35071]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T03:53:17.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:16 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/872576856' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:53:17.128 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:16 smithi046 ceph-mon[30954]: mds.? [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] up:active 2024-09-21T03:53:17.129 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:16 smithi046 ceph-mon[30954]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T03:53:17.129 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:16 smithi046 ceph-mon[30954]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T03:53:17.129 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:16 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/872576856' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:53:17.157 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T03:53:17.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:16 smithi105 ceph-mon[34773]: mds.? [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] up:active 2024-09-21T03:53:17.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:16 smithi105 ceph-mon[34773]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T03:53:17.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:16 smithi105 ceph-mon[34773]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T03:53:17.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:16 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/872576856' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:53:17.414 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:17.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.899+0000 7f4301866640 1 -- 172.21.15.46:0/2645729952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42fc102a60 msgr2=0x7f42fc102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:17.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.899+0000 7f4301866640 1 --2- 172.21.15.46:0/2645729952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42fc102a60 0x7f42fc102e70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f42ec009900 tx=0x7f42ec02a410 comp rx=0 tx=0).stop 2024-09-21T03:53:17.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.899+0000 7f4301866640 1 -- 172.21.15.46:0/2645729952 shutdown_connections 2024-09-21T03:53:17.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.899+0000 7f4301866640 1 --2- 172.21.15.46:0/2645729952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42fc108cf0 0x7f42fc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.899+0000 7f4301866640 1 --2- 172.21.15.46:0/2645729952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42fc1083a0 0x7f42fc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.899+0000 7f4301866640 1 --2- 172.21.15.46:0/2645729952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42fc102a60 0x7f42fc102e70 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.899+0000 7f4301866640 1 -- 172.21.15.46:0/2645729952 >> 172.21.15.46:0/2645729952 conn(0x7f42fc079730 msgr2=0x7f42fc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:17.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.899+0000 7f4301866640 1 -- 172.21.15.46:0/2645729952 shutdown_connections 2024-09-21T03:53:17.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.899+0000 7f4301866640 1 -- 172.21.15.46:0/2645729952 wait complete. 2024-09-21T03:53:17.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.900+0000 7f4301866640 1 Processor -- start 2024-09-21T03:53:17.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.900+0000 7f4301866640 1 -- start start 2024-09-21T03:53:17.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.900+0000 7f4301866640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42fc102a60 0x7f42fc10ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:17.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.900+0000 7f4301866640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42fc1083a0 0x7f42fc1104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:17.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.900+0000 7f4301866640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42fc108cf0 0x7f42fc110a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:17.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.900+0000 7f4301866640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f42fc113ac0 con 0x7f42fc108cf0 2024-09-21T03:53:17.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.900+0000 7f4301866640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f42fc113940 con 0x7f42fc102a60 2024-09-21T03:53:17.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.900+0000 7f4301866640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f42fc113c40 con 0x7f42fc1083a0 2024-09-21T03:53:17.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.900+0000 7f42fb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42fc108cf0 0x7f42fc110a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:17.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.900+0000 7f42fb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42fc108cf0 0x7f42fc110a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60844/0 (socket says 172.21.15.46:60844) 2024-09-21T03:53:17.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.900+0000 7f42fb7fe640 1 -- 172.21.15.46:0/1299724688 learned_addr learned my addr 172.21.15.46:0/1299724688 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:53:17.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.900+0000 7f42fa7fc640 1 --2- 172.21.15.46:0/1299724688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42fc1083a0 0x7f42fc1104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:17.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.900+0000 7f42faffd640 1 --2- 172.21.15.46:0/1299724688 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42fc102a60 0x7f42fc10ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:17.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.901+0000 7f42fb7fe640 1 -- 172.21.15.46:0/1299724688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42fc1083a0 msgr2=0x7f42fc1104f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:17.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.901+0000 7f42fb7fe640 1 --2- 172.21.15.46:0/1299724688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42fc1083a0 0x7f42fc1104f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.901+0000 7f42fb7fe640 1 -- 172.21.15.46:0/1299724688 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42fc102a60 msgr2=0x7f42fc10ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:17.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.901+0000 7f42fb7fe640 1 --2- 172.21.15.46:0/1299724688 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42fc102a60 0x7f42fc10ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.901+0000 7f42fb7fe640 1 -- 172.21.15.46:0/1299724688 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42fc1a86e0 con 0x7f42fc108cf0 2024-09-21T03:53:17.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.901+0000 7f42faffd640 1 --2- 172.21.15.46:0/1299724688 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42fc102a60 0x7f42fc10ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:53:17.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.901+0000 7f42fb7fe640 1 --2- 172.21.15.46:0/1299724688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42fc108cf0 0x7f42fc110a30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f42f400cce0 tx=0x7f42f400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:17.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.901+0000 7f4300864640 1 -- 172.21.15.46:0/1299724688 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f400f450 con 0x7f42fc108cf0 2024-09-21T03:53:17.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.901+0000 7f4301866640 1 -- 172.21.15.46:0/1299724688 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42fc1a89d0 con 0x7f42fc108cf0 2024-09-21T03:53:17.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.901+0000 7f4300864640 1 -- 172.21.15.46:0/1299724688 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42f400faa0 con 0x7f42fc108cf0 2024-09-21T03:53:17.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.901+0000 7f4300864640 1 -- 172.21.15.46:0/1299724688 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f4018b70 con 0x7f42fc108cf0 2024-09-21T03:53:17.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.901+0000 7f4301866640 1 -- 172.21.15.46:0/1299724688 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42fc1a8f40 con 0x7f42fc108cf0 2024-09-21T03:53:17.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.902+0000 7f4301866640 1 -- 172.21.15.46:0/1299724688 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42fc102e70 con 0x7f42fc108cf0 2024-09-21T03:53:17.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.905+0000 7f4300864640 1 -- 172.21.15.46:0/1299724688 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f42f4018d10 con 0x7f42fc108cf0 2024-09-21T03:53:17.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.906+0000 7f4300864640 1 --2- 172.21.15.46:0/1299724688 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f42e40b6560 0x7f42e40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:17.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.906+0000 7f42faffd640 1 --2- 172.21.15.46:0/1299724688 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f42e40b6560 0x7f42e40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:17.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.906+0000 7f4300864640 1 -- 172.21.15.46:0/1299724688 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f42f40e7940 con 0x7f42fc108cf0 2024-09-21T03:53:17.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.906+0000 7f42faffd640 1 --2- 172.21.15.46:0/1299724688 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f42e40b6560 0x7f42e40b8a70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f42ec000c00 tx=0x7f42ec031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:17.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:17.909+0000 7f4300864640 1 -- 172.21.15.46:0/1299724688 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f42f4014030 con 0x7f42fc108cf0 2024-09-21T03:53:18.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:18.097+0000 7f4301866640 1 -- 172.21.15.46:0/1299724688 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f42fc1112b0 con 0x7f42fc108cf0 2024-09-21T03:53:18.100 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:17 smithi046 ceph-mon[30954]: pgmap v265: 97 pgs: 1 creating+activating, 23 creating+peering, 48 active+clean, 25 unknown; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:53:18.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:18.098+0000 7f4300864640 1 -- 172.21.15.46:0/1299724688 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22594 (secure 0 0 0) 0x7f42f40ae220 con 0x7f42fc108cf0 2024-09-21T03:53:18.101 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:53:18.101 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":75,"fsid":"a82de5ec-77cb-11ef-baf5-efdc52797490","created":"2024-09-21T03:44:31.512271+0000","modified":"2024-09-21T03:53:14.452862+0000","last_up_change":"2024-09-21T03:52:22.609789+0000","last_in_change":"2024-09-21T03:51:58.812316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:48:30.407205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:53:09.943833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:53:12.521980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ff9e1a8-fec7-422c-b594-880efe4684f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6803","nonce":791989880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6805","nonce":791989880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6809","nonce":791989880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6807","nonce":791989880}]},"public_addr":"172.21.15.46:6803/791989880","cluster_addr":"172.21.15.46:6805/791989880","heartbeat_back_addr":"172.21.15.46:6809/791989880","heartbeat_front_addr":"172.21.15.46:6807/791989880","state":["exists","up"]},{"osd":1,"uuid":"3df1bee7-615e-44d0-bd43-2370db6cd06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6801","nonce":1123652172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6803","nonce":1123652172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6807","nonce":1123652172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6805","nonce":1123652172}]},"public_addr":"172.21.15.105:6801/1123652172","cluster_addr":"172.21.15.105:6803/1123652172","heartbeat_back_addr":"172.21.15.105:6807/1123652172","heartbeat_front_addr":"172.21.15.105:6805/1123652172","state":["exists","up"]},{"osd":2,"uuid":"52d0e57f-cfca-447a-8a57-b1d5364cb4d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6801","nonce":34930776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6803","nonce":34930776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6807","nonce":34930776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6805","nonce":34930776}]},"public_addr":"172.21.15.162:6801/34930776","cluster_addr":"172.21.15.162:6803/34930776","heartbeat_back_addr":"172.21.15.162:6807/34930776","heartbeat_front_addr":"172.21.15.162:6805/34930776","state":["exists","up"]},{"osd":3,"uuid":"6f25f721-fc50-4b80-944b-d3df28e7a2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6811","nonce":1355580104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6813","nonce":1355580104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6817","nonce":1355580104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6815","nonce":1355580104}]},"public_addr":"172.21.15.46:6811/1355580104","cluster_addr":"172.21.15.46:6813/1355580104","heartbeat_back_addr":"172.21.15.46:6817/1355580104","heartbeat_front_addr":"172.21.15.46:6815/1355580104","state":["exists","up"]},{"osd":4,"uuid":"c2f41084-e5a1-4b5f-b799-a84b38da63a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6809","nonce":3566174660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6811","nonce":3566174660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6815","nonce":3566174660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6813","nonce":3566174660}]},"public_addr":"172.21.15.105:6809/3566174660","cluster_addr":"172.21.15.105:6811/3566174660","heartbeat_back_addr":"172.21.15.105:6815/3566174660","heartbeat_front_addr":"172.21.15.105:6813/3566174660","state":["exists","up"]},{"osd":5,"uuid":"b433d03b-fae8-4ece-b967-a8af91bc3ab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6809","nonce":3043419818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6811","nonce":3043419818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6815","nonce":3043419818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6813","nonce":3043419818}]},"public_addr":"172.21.15.162:6809/3043419818","cluster_addr":"172.21.15.162:6811/3043419818","heartbeat_back_addr":"172.21.15.162:6815/3043419818","heartbeat_front_addr":"172.21.15.162:6813/3043419818","state":["exists","up"]},{"osd":6,"uuid":"e6b5ce54-69aa-4811-9ca3-cab50525a175","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6819","nonce":1615361645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6821","nonce":1615361645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6825","nonce":1615361645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6823","nonce":1615361645}]},"public_addr":"172.21.15.46:6819/1615361645","cluster_addr":"172.21.15.46:6821/1615361645","heartbeat_back_addr":"172.21.15.46:6825/1615361645","heartbeat_front_addr":"172.21.15.46:6823/1615361645","state":["exists","up"]},{"osd":7,"uuid":"a6e89d5d-ce31-4e0c-9019-5eb13b134feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6817","nonce":1015687379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6819","nonce":1015687379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6823","nonce":1015687379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6821","nonce":1015687379}]},"public_addr":"172.21.15.105:6817/1015687379","cluster_addr":"172.21.15.105:6819/1015687379","heartbeat_back_addr":"172.21.15.105:6823/1015687379","heartbeat_front_addr":"172.21.15.105:6821/1015687379","state":["exists","up"]},{"osd":8,"uuid":"27b2ccec-65be-47b3-a924-c5939ba1cb5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6817","nonce":3441747512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6819","nonce":3441747512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6823","nonce":3441747512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6821","nonce":3441747512}]},"public_addr":"172.21.15.162:6817/3441747512","cluster_addr":"172.21.15.162:6819/3441747512","heartbeat_back_addr":"172.21.15.162:6823/3441747512","heartbeat_front_addr":"172.21.15.162:6821/3441747512","state":["exists","up"]},{"osd":9,"uuid":"3f7cb70c-73c7-48e8-a32b-7445eda2126d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6827","nonce":382230768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6829","nonce":382230768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6833","nonce":382230768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6831","nonce":382230768}]},"public_addr":"172.21.15.46:6827/382230768","cluster_addr":"172.21.15.46:6829/382230768","heartbeat_back_addr":"172.21.15.46:6833/382230768","heartbeat_front_addr":"172.21.15.46:6831/382230768","state":["exists","up"]},{"osd":10,"uuid":"76c3da87-f3c5-4985-87fd-647717b6af85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6825","nonce":1664619099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6827","nonce":1664619099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6831","nonce":1664619099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6829","nonce":1664619099}]},"public_addr":"172.21.15.105:6825/1664619099","cluster_addr":"172.21.15.105:6827/1664619099","heartbeat_back_addr":"172.21.15.105:6831/1664619099","heartbeat_front_addr":"172.21.15.105:6829/1664619099","state":["exists","up"]},{"osd":11,"uuid":"13269da8-5f05-4ce2-9c7a-6dd9c1041cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6825","nonce":1014820476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6827","nonce":1014820476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6831","nonce":1014820476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6829","nonce":1014820476}]},"public_addr":"172.21.15.162:6825/1014820476","cluster_addr":"172.21.15.162:6827/1014820476","heartbeat_back_addr":"172.21.15.162:6831/1014820476","heartbeat_front_addr":"172.21.15.162:6829/1014820476","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:47:38.630436+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:03.441596+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:28.647341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:54.270316+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:49:19.783873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:49:45.344485+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:50:12.165326+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:50:38.095996+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:03.814612+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:29.469718+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:55.407340+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:52:20.360243+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:6801/878116252":"2024-09-22T03:46:31.942086+0000","172.21.15.46:6800/878116252":"2024-09-22T03:46:31.942086+0000","172.21.15.46:0/3574041742":"2024-09-22T03:45:05.097136+0000","172.21.15.46:6801/1185001582":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/2839831446":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/3423884605":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/2761976928":"2024-09-22T03:46:31.942086+0000","172.21.15.46:0/1149961133":"2024-09-22T03:45:05.097136+0000","172.21.15.46:6800/1185001582":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/641493295":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/4033661287":"2024-09-22T03:45:31.101657+0000","172.21.15.46:6800/2733048710":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/3972416280":"2024-09-22T03:46:31.942086+0000","172.21.15.46:6801/2733048710":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/1662975018":"2024-09-22T03:46:31.942086+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:53:18.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:18.101+0000 7f4301866640 1 -- 172.21.15.46:0/1299724688 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f42e40b6560 msgr2=0x7f42e40b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:18.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:18.101+0000 7f4301866640 1 --2- 172.21.15.46:0/1299724688 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f42e40b6560 0x7f42e40b8a70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f42ec000c00 tx=0x7f42ec031400 comp rx=0 tx=0).stop 2024-09-21T03:53:18.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:18.101+0000 7f4301866640 1 -- 172.21.15.46:0/1299724688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42fc108cf0 msgr2=0x7f42fc110a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:18.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:18.101+0000 7f4301866640 1 --2- 172.21.15.46:0/1299724688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42fc108cf0 0x7f42fc110a30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f42f400cce0 tx=0x7f42f400a620 comp rx=0 tx=0).stop 2024-09-21T03:53:18.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:18.101+0000 7f4301866640 1 -- 172.21.15.46:0/1299724688 shutdown_connections 2024-09-21T03:53:18.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:18.101+0000 7f4301866640 1 --2- 172.21.15.46:0/1299724688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42fc108cf0 0x7f42fc110a30 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:18.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:18.101+0000 7f4301866640 1 --2- 172.21.15.46:0/1299724688 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f42e40b6560 0x7f42e40b8a70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:18.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:18.101+0000 7f4301866640 1 --2- 172.21.15.46:0/1299724688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42fc1083a0 0x7f42fc1104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:18.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:18.101+0000 7f4301866640 1 --2- 172.21.15.46:0/1299724688 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42fc102a60 0x7f42fc10ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:18.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:18.101+0000 7f4301866640 1 -- 172.21.15.46:0/1299724688 >> 172.21.15.46:0/1299724688 conn(0x7f42fc079730 msgr2=0x7f42fc101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:18.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:18.101+0000 7f4301866640 1 -- 172.21.15.46:0/1299724688 shutdown_connections 2024-09-21T03:53:18.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:18.101+0000 7f4301866640 1 -- 172.21.15.46:0/1299724688 wait complete. 2024-09-21T03:53:18.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:17 smithi162 ceph-mon[35071]: pgmap v265: 97 pgs: 1 creating+activating, 23 creating+peering, 48 active+clean, 25 unknown; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:53:18.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:17 smithi105 ceph-mon[34773]: pgmap v265: 97 pgs: 1 creating+activating, 23 creating+peering, 48 active+clean, 25 unknown; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:53:18.829 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs set cephfs standby_count_wanted 0 2024-09-21T03:53:19.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:18 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/1299724688' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:53:19.068 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 21 03:53:18 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-b[63738]: 2024-09-21T03:53:18.765+0000 7f07ff8de640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T03:53:19.090 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:19.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:18 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/1299724688' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:53:19.136 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:18 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/1299724688' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:53:19.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.577+0000 7f294f686640 1 -- 172.21.15.46:0/1784580020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29481049b0 msgr2=0x7f2948104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:19.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.577+0000 7f294f686640 1 --2- 172.21.15.46:0/1784580020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29481049b0 0x7f2948104dc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2944009900 tx=0x7f294402a410 comp rx=0 tx=0).stop 2024-09-21T03:53:19.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.577+0000 7f294f686640 1 -- 172.21.15.46:0/1784580020 shutdown_connections 2024-09-21T03:53:19.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.577+0000 7f294f686640 1 --2- 172.21.15.46:0/1784580020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f294810de10 0x7f2948110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.577+0000 7f294f686640 1 --2- 172.21.15.46:0/1784580020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2948105300 0x7f294810d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.577+0000 7f294f686640 1 --2- 172.21.15.46:0/1784580020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29481049b0 0x7f2948104dc0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.577+0000 7f294f686640 1 -- 172.21.15.46:0/1784580020 >> 172.21.15.46:0/1784580020 conn(0x7f2948079730 msgr2=0x7f2948079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:19.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.577+0000 7f294f686640 1 -- 172.21.15.46:0/1784580020 shutdown_connections 2024-09-21T03:53:19.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.577+0000 7f294f686640 1 -- 172.21.15.46:0/1784580020 wait complete. 2024-09-21T03:53:19.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.577+0000 7f294f686640 1 Processor -- start 2024-09-21T03:53:19.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.577+0000 7f294f686640 1 -- start start 2024-09-21T03:53:19.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.578+0000 7f294f686640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29481049b0 0x7f294819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:19.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.578+0000 7f294f686640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2948105300 0x7f294819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:19.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.578+0000 7f294f686640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f294810de10 0x7f294819fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:19.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.578+0000 7f294f686640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2948113a90 con 0x7f2948105300 2024-09-21T03:53:19.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.578+0000 7f294f686640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2948113910 con 0x7f294810de10 2024-09-21T03:53:19.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.578+0000 7f294f686640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2948113c10 con 0x7f29481049b0 2024-09-21T03:53:19.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.578+0000 7f294cc21640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2948105300 0x7f294819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:19.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.578+0000 7f294cc21640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2948105300 0x7f294819ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60854/0 (socket says 172.21.15.46:60854) 2024-09-21T03:53:19.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.578+0000 7f294cc21640 1 -- 172.21.15.46:0/1584010517 learned_addr learned my addr 172.21.15.46:0/1584010517 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:53:19.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.578+0000 7f294d422640 1 --2- 172.21.15.46:0/1584010517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29481049b0 0x7f294819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:19.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.578+0000 7f294dc23640 1 --2- 172.21.15.46:0/1584010517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f294810de10 0x7f294819fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:19.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.578+0000 7f294cc21640 1 -- 172.21.15.46:0/1584010517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29481049b0 msgr2=0x7f294819a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:19.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.578+0000 7f294cc21640 1 --2- 172.21.15.46:0/1584010517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29481049b0 0x7f294819a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.578+0000 7f294cc21640 1 -- 172.21.15.46:0/1584010517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f294810de10 msgr2=0x7f294819fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:19.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.578+0000 7f294cc21640 1 --2- 172.21.15.46:0/1584010517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f294810de10 0x7f294819fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.578+0000 7f294cc21640 1 -- 172.21.15.46:0/1584010517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29481a0470 con 0x7f2948105300 2024-09-21T03:53:19.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.578+0000 7f294dc23640 1 --2- 172.21.15.46:0/1584010517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f294810de10 0x7f294819fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:53:19.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.578+0000 7f294d422640 1 --2- 172.21.15.46:0/1584010517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29481049b0 0x7f294819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:53:19.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.578+0000 7f294cc21640 1 --2- 172.21.15.46:0/1584010517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2948105300 0x7f294819ab60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f293800c970 tx=0x7f293800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:19.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.578+0000 7f293e7fc640 1 -- 172.21.15.46:0/1584010517 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2938004220 con 0x7f2948105300 2024-09-21T03:53:19.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.579+0000 7f294f686640 1 -- 172.21.15.46:0/1584010517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29481a0760 con 0x7f2948105300 2024-09-21T03:53:19.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.579+0000 7f293e7fc640 1 -- 172.21.15.46:0/1584010517 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29380043c0 con 0x7f2948105300 2024-09-21T03:53:19.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.579+0000 7f293e7fc640 1 -- 172.21.15.46:0/1584010517 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2938004a00 con 0x7f2948105300 2024-09-21T03:53:19.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.579+0000 7f294f686640 1 -- 172.21.15.46:0/1584010517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29481a6f80 con 0x7f2948105300 2024-09-21T03:53:19.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.580+0000 7f294f686640 1 -- 172.21.15.46:0/1584010517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f294806b560 con 0x7f2948105300 2024-09-21T03:53:19.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.581+0000 7f293e7fc640 1 -- 172.21.15.46:0/1584010517 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f29380079b0 con 0x7f2948105300 2024-09-21T03:53:19.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.582+0000 7f293e7fc640 1 --2- 172.21.15.46:0/1584010517 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f29340b6590 0x7f29340b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:19.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.582+0000 7f294d422640 1 --2- 172.21.15.46:0/1584010517 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f29340b6590 0x7f29340b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:19.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.582+0000 7f293e7fc640 1 -- 172.21.15.46:0/1584010517 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f29380e7540 con 0x7f2948105300 2024-09-21T03:53:19.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.582+0000 7f294d422640 1 --2- 172.21.15.46:0/1584010517 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f29340b6590 0x7f29340b8aa0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2944000c00 tx=0x7f2944031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:19.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.585+0000 7f293e7fc640 1 -- 172.21.15.46:0/1584010517 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2938014030 con 0x7f2948105300 2024-09-21T03:53:19.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.816+0000 7f294f686640 1 -- 172.21.15.46:0/1584010517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f2948104dc0 con 0x7f2948105300 2024-09-21T03:53:19.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.840+0000 7f293e7fc640 1 -- 172.21.15.46:0/1584010517 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f29380addf0 con 0x7f2948105300 2024-09-21T03:53:19.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.842+0000 7f294f686640 1 -- 172.21.15.46:0/1584010517 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f29340b6590 msgr2=0x7f29340b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:19.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.842+0000 7f294f686640 1 --2- 172.21.15.46:0/1584010517 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f29340b6590 0x7f29340b8aa0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2944000c00 tx=0x7f2944031400 comp rx=0 tx=0).stop 2024-09-21T03:53:19.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.842+0000 7f294f686640 1 -- 172.21.15.46:0/1584010517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2948105300 msgr2=0x7f294819ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:19.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.842+0000 7f294f686640 1 --2- 172.21.15.46:0/1584010517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2948105300 0x7f294819ab60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f293800c970 tx=0x7f293800ce30 comp rx=0 tx=0).stop 2024-09-21T03:53:19.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.842+0000 7f294f686640 1 -- 172.21.15.46:0/1584010517 shutdown_connections 2024-09-21T03:53:19.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.842+0000 7f294f686640 1 --2- 172.21.15.46:0/1584010517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f294810de10 0x7f294819fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.842+0000 7f294f686640 1 --2- 172.21.15.46:0/1584010517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2948105300 0x7f294819ab60 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.842+0000 7f294f686640 1 --2- 172.21.15.46:0/1584010517 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f29340b6590 0x7f29340b8aa0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.842+0000 7f294f686640 1 --2- 172.21.15.46:0/1584010517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29481049b0 0x7f294819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.842+0000 7f294f686640 1 -- 172.21.15.46:0/1584010517 >> 172.21.15.46:0/1584010517 conn(0x7f2948079730 msgr2=0x7f29481008c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:19.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.843+0000 7f294f686640 1 -- 172.21.15.46:0/1584010517 shutdown_connections 2024-09-21T03:53:19.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:19.843+0000 7f294f686640 1 -- 172.21.15.46:0/1584010517 wait complete. 2024-09-21T03:53:20.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:19 smithi046 ceph-mon[30954]: pgmap v266: 97 pgs: 7 creating+peering, 90 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-21T03:53:20.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:19 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/1584010517' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T03:53:20.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:19 smithi162 ceph-mon[35071]: pgmap v266: 97 pgs: 7 creating+peering, 90 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-21T03:53:20.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:19 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/1584010517' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T03:53:20.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:19 smithi105 ceph-mon[34773]: pgmap v266: 97 pgs: 7 creating+peering, 90 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-21T03:53:20.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:19 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/1584010517' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T03:53:20.535 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 1, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-21T03:53:20.536 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs set cephfs allow_standby_replay true 2024-09-21T03:53:20.805 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:21.074 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:20 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/1584010517' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T03:53:21.074 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:20 smithi046 ceph-mon[30954]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T03:53:21.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:20 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/1584010517' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T03:53:21.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:20 smithi162 ceph-mon[35071]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T03:53:21.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.280+0000 7f68b4bb3640 1 -- 172.21.15.46:0/1877613958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68b010b6f0 msgr2=0x7f68b010bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:21.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.280+0000 7f68b4bb3640 1 --2- 172.21.15.46:0/1877613958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68b010b6f0 0x7f68b010bb00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f68a4009900 tx=0x7f68a402a410 comp rx=0 tx=0).stop 2024-09-21T03:53:21.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.280+0000 7f68b4bb3640 1 -- 172.21.15.46:0/1877613958 shutdown_connections 2024-09-21T03:53:21.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.280+0000 7f68b4bb3640 1 --2- 172.21.15.46:0/1877613958 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68b010c040 0x7f68b0112870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:21.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.280+0000 7f68b4bb3640 1 --2- 172.21.15.46:0/1877613958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68b010b6f0 0x7f68b010bb00 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:21.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.280+0000 7f68b4bb3640 1 --2- 172.21.15.46:0/1877613958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68b0105db0 0x7f68b01061c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:21.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.280+0000 7f68b4bb3640 1 -- 172.21.15.46:0/1877613958 >> 172.21.15.46:0/1877613958 conn(0x7f68b0101800 msgr2=0x7f68b0103c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:21.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.280+0000 7f68b4bb3640 1 -- 172.21.15.46:0/1877613958 shutdown_connections 2024-09-21T03:53:21.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.280+0000 7f68b4bb3640 1 -- 172.21.15.46:0/1877613958 wait complete. 2024-09-21T03:53:21.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.281+0000 7f68b4bb3640 1 Processor -- start 2024-09-21T03:53:21.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.281+0000 7f68b4bb3640 1 -- start start 2024-09-21T03:53:21.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.282+0000 7f68b4bb3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68b0105db0 0x7f68b019c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:21.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.282+0000 7f68b4bb3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68b010b6f0 0x7f68b019ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:21.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.282+0000 7f68b4bb3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68b010c040 0x7f68b01a1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:21.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.282+0000 7f68b4bb3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f68b0115d20 con 0x7f68b010b6f0 2024-09-21T03:53:21.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.282+0000 7f68b4bb3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f68b0115ba0 con 0x7f68b0105db0 2024-09-21T03:53:21.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.282+0000 7f68b4bb3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f68b0115ea0 con 0x7f68b010c040 2024-09-21T03:53:21.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.282+0000 7f68add9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68b010b6f0 0x7f68b019ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:21.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.282+0000 7f68add9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68b010b6f0 0x7f68b019ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60880/0 (socket says 172.21.15.46:60880) 2024-09-21T03:53:21.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.282+0000 7f68add9b640 1 -- 172.21.15.46:0/2440461343 learned_addr learned my addr 172.21.15.46:0/2440461343 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:53:21.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.282+0000 7f68aed9d640 1 --2- 172.21.15.46:0/2440461343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68b010c040 0x7f68b01a1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:21.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.282+0000 7f68ae59c640 1 --2- 172.21.15.46:0/2440461343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68b0105db0 0x7f68b019c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:21.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.282+0000 7f68add9b640 1 -- 172.21.15.46:0/2440461343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68b010c040 msgr2=0x7f68b01a1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:21.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.282+0000 7f68add9b640 1 --2- 172.21.15.46:0/2440461343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68b010c040 0x7f68b01a1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:21.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.282+0000 7f68add9b640 1 -- 172.21.15.46:0/2440461343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68b0105db0 msgr2=0x7f68b019c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:21.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.282+0000 7f68add9b640 1 --2- 172.21.15.46:0/2440461343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68b0105db0 0x7f68b019c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:21.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.282+0000 7f68add9b640 1 -- 172.21.15.46:0/2440461343 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b01a26a0 con 0x7f68b010b6f0 2024-09-21T03:53:21.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.282+0000 7f68ae59c640 1 --2- 172.21.15.46:0/2440461343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68b0105db0 0x7f68b019c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:53:21.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.283+0000 7f68add9b640 1 --2- 172.21.15.46:0/2440461343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68b010b6f0 0x7f68b019ccd0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f68a4006010 tx=0x7f68a4004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:21.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.283+0000 7f689f7fe640 1 -- 172.21.15.46:0/2440461343 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a403f030 con 0x7f68b010b6f0 2024-09-21T03:53:21.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.283+0000 7f689f7fe640 1 -- 172.21.15.46:0/2440461343 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68a4003aa0 con 0x7f68b010b6f0 2024-09-21T03:53:21.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.283+0000 7f68b4bb3640 1 -- 172.21.15.46:0/2440461343 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68b01a2930 con 0x7f68b010b6f0 2024-09-21T03:53:21.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.283+0000 7f689f7fe640 1 -- 172.21.15.46:0/2440461343 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a4035070 con 0x7f68b010b6f0 2024-09-21T03:53:21.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.283+0000 7f68b4bb3640 1 -- 172.21.15.46:0/2440461343 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68b01a90f0 con 0x7f68b010b6f0 2024-09-21T03:53:21.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.284+0000 7f68b4bb3640 1 -- 172.21.15.46:0/2440461343 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68b01061c0 con 0x7f68b010b6f0 2024-09-21T03:53:21.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.286+0000 7f689f7fe640 1 -- 172.21.15.46:0/2440461343 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f68a4042030 con 0x7f68b010b6f0 2024-09-21T03:53:21.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.286+0000 7f689f7fe640 1 --2- 172.21.15.46:0/2440461343 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f68980b6560 0x7f68980b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:21.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.286+0000 7f68ae59c640 1 --2- 172.21.15.46:0/2440461343 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f68980b6560 0x7f68980b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:21.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.286+0000 7f689f7fe640 1 -- 172.21.15.46:0/2440461343 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f68a4107be0 con 0x7f68b010b6f0 2024-09-21T03:53:21.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.287+0000 7f68ae59c640 1 --2- 172.21.15.46:0/2440461343 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f68980b6560 0x7f68980b8a70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f68a0009930 tx=0x7f68a0008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:21.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.290+0000 7f689f7fe640 1 -- 172.21.15.46:0/2440461343 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f68a40ce490 con 0x7f68b010b6f0 2024-09-21T03:53:21.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:20 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/1584010517' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T03:53:21.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:20 smithi105 ceph-mon[34773]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T03:53:21.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.519+0000 7f68b4bb3640 1 -- 172.21.15.46:0/2440461343 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f68b019d860 con 0x7f68b010b6f0 2024-09-21T03:53:21.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.858+0000 7f689f7fe640 1 -- 172.21.15.46:0/2440461343 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7f68a40d2870 con 0x7f68b010b6f0 2024-09-21T03:53:21.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.860+0000 7f68b4bb3640 1 -- 172.21.15.46:0/2440461343 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f68980b6560 msgr2=0x7f68980b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:21.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.860+0000 7f68b4bb3640 1 --2- 172.21.15.46:0/2440461343 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f68980b6560 0x7f68980b8a70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f68a0009930 tx=0x7f68a0008040 comp rx=0 tx=0).stop 2024-09-21T03:53:21.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.860+0000 7f68b4bb3640 1 -- 172.21.15.46:0/2440461343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68b010b6f0 msgr2=0x7f68b019ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:21.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.860+0000 7f68b4bb3640 1 --2- 172.21.15.46:0/2440461343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68b010b6f0 0x7f68b019ccd0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f68a4006010 tx=0x7f68a4004060 comp rx=0 tx=0).stop 2024-09-21T03:53:21.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.860+0000 7f68b4bb3640 1 -- 172.21.15.46:0/2440461343 shutdown_connections 2024-09-21T03:53:21.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.860+0000 7f68b4bb3640 1 --2- 172.21.15.46:0/2440461343 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f68980b6560 0x7f68980b8a70 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:21.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.860+0000 7f68b4bb3640 1 --2- 172.21.15.46:0/2440461343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68b010c040 0x7f68b01a1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:21.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.860+0000 7f68b4bb3640 1 --2- 172.21.15.46:0/2440461343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68b010b6f0 0x7f68b019ccd0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:21.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.860+0000 7f68b4bb3640 1 --2- 172.21.15.46:0/2440461343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68b0105db0 0x7f68b019c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:21.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.860+0000 7f68b4bb3640 1 -- 172.21.15.46:0/2440461343 >> 172.21.15.46:0/2440461343 conn(0x7f68b0101800 msgr2=0x7f68b0103c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:21.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.860+0000 7f68b4bb3640 1 -- 172.21.15.46:0/2440461343 shutdown_connections 2024-09-21T03:53:21.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:21.860+0000 7f68b4bb3640 1 -- 172.21.15.46:0/2440461343 wait complete. 2024-09-21T03:53:22.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:21 smithi162 ceph-mon[35071]: pgmap v267: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-21T03:53:22.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:21 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/2440461343' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T03:53:22.238 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:21 smithi046 ceph-mon[30954]: pgmap v267: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-21T03:53:22.238 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:21 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/2440461343' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T03:53:22.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:21 smithi105 ceph-mon[34773]: pgmap v267: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-21T03:53:22.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:21 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/2440461343' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T03:53:22.575 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs set cephfs session_timeout 300 2024-09-21T03:53:22.834 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:23.119 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:22 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/2440461343' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T03:53:23.119 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:22 smithi046 ceph-mon[30954]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T03:53:23.119 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:22 smithi046 ceph-mon[30954]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T03:53:23.120 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:22 smithi046 ceph-mon[30954]: pgmap v268: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T03:53:23.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:22 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/2440461343' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T03:53:23.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:22 smithi162 ceph-mon[35071]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T03:53:23.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:22 smithi162 ceph-mon[35071]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T03:53:23.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:22 smithi162 ceph-mon[35071]: pgmap v268: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T03:53:23.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:22 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/2440461343' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T03:53:23.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:22 smithi105 ceph-mon[34773]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T03:53:23.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:22 smithi105 ceph-mon[34773]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T03:53:23.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:22 smithi105 ceph-mon[34773]: pgmap v268: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T03:53:23.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.352+0000 7fa335668640 1 -- 172.21.15.46:0/4175779445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3301083c0 msgr2=0x7fa3301087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:23.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.352+0000 7fa335668640 1 --2- 172.21.15.46:0/4175779445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3301083c0 0x7fa3301087d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa318009900 tx=0x7fa31802a410 comp rx=0 tx=0).stop 2024-09-21T03:53:23.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.352+0000 7fa335668640 1 -- 172.21.15.46:0/4175779445 shutdown_connections 2024-09-21T03:53:23.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.352+0000 7fa335668640 1 --2- 172.21.15.46:0/4175779445 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa330108d10 0x7fa33010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.352+0000 7fa335668640 1 --2- 172.21.15.46:0/4175779445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3301083c0 0x7fa3301087d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.352+0000 7fa335668640 1 --2- 172.21.15.46:0/4175779445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa330102a80 0x7fa330102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.352+0000 7fa335668640 1 -- 172.21.15.46:0/4175779445 >> 172.21.15.46:0/4175779445 conn(0x7fa330079740 msgr2=0x7fa330079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:23.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.352+0000 7fa335668640 1 -- 172.21.15.46:0/4175779445 shutdown_connections 2024-09-21T03:53:23.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.352+0000 7fa335668640 1 -- 172.21.15.46:0/4175779445 wait complete. 2024-09-21T03:53:23.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.353+0000 7fa335668640 1 Processor -- start 2024-09-21T03:53:23.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.353+0000 7fa335668640 1 -- start start 2024-09-21T03:53:23.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.353+0000 7fa335668640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa330102a80 0x7fa33019a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:23.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.353+0000 7fa335668640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3301083c0 0x7fa33019a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:23.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.353+0000 7fa335668640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa330108d10 0x7fa33019fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:23.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.353+0000 7fa335668640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa330113aa0 con 0x7fa3301083c0 2024-09-21T03:53:23.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.353+0000 7fa335668640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa330113920 con 0x7fa330102a80 2024-09-21T03:53:23.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.353+0000 7fa335668640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa330113c20 con 0x7fa330108d10 2024-09-21T03:53:23.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.354+0000 7fa327fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3301083c0 0x7fa33019a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:23.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.354+0000 7fa327fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3301083c0 0x7fa33019a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49502/0 (socket says 172.21.15.46:49502) 2024-09-21T03:53:23.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.354+0000 7fa327fff640 1 -- 172.21.15.46:0/855920003 learned_addr learned my addr 172.21.15.46:0/855920003 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:53:23.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.354+0000 7fa32f7fe640 1 --2- 172.21.15.46:0/855920003 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa330108d10 0x7fa33019fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:23.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.354+0000 7fa32effd640 1 --2- 172.21.15.46:0/855920003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa330102a80 0x7fa33019a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:23.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.354+0000 7fa327fff640 1 -- 172.21.15.46:0/855920003 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa330108d10 msgr2=0x7fa33019fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:23.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.354+0000 7fa327fff640 1 --2- 172.21.15.46:0/855920003 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa330108d10 0x7fa33019fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.354+0000 7fa327fff640 1 -- 172.21.15.46:0/855920003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa330102a80 msgr2=0x7fa33019a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:23.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.354+0000 7fa327fff640 1 --2- 172.21.15.46:0/855920003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa330102a80 0x7fa33019a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.354+0000 7fa327fff640 1 -- 172.21.15.46:0/855920003 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3301a03c0 con 0x7fa3301083c0 2024-09-21T03:53:23.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.354+0000 7fa327fff640 1 --2- 172.21.15.46:0/855920003 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3301083c0 0x7fa33019a9f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa318006010 tx=0x7fa318004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:23.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.354+0000 7fa32cff9640 1 -- 172.21.15.46:0/855920003 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31803f030 con 0x7fa3301083c0 2024-09-21T03:53:23.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.354+0000 7fa32cff9640 1 -- 172.21.15.46:0/855920003 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa318003aa0 con 0x7fa3301083c0 2024-09-21T03:53:23.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.354+0000 7fa32cff9640 1 -- 172.21.15.46:0/855920003 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa318035070 con 0x7fa3301083c0 2024-09-21T03:53:23.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.354+0000 7fa335668640 1 -- 172.21.15.46:0/855920003 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3301a0650 con 0x7fa3301083c0 2024-09-21T03:53:23.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.354+0000 7fa335668640 1 -- 172.21.15.46:0/855920003 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3301a6e10 con 0x7fa3301083c0 2024-09-21T03:53:23.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.355+0000 7fa335668640 1 -- 172.21.15.46:0/855920003 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa330103d00 con 0x7fa3301083c0 2024-09-21T03:53:23.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.357+0000 7fa32cff9640 1 -- 172.21.15.46:0/855920003 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fa318042030 con 0x7fa3301083c0 2024-09-21T03:53:23.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.358+0000 7fa32cff9640 1 --2- 172.21.15.46:0/855920003 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa31c0b65e0 0x7fa31c0b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:23.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.358+0000 7fa32effd640 1 --2- 172.21.15.46:0/855920003 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa31c0b65e0 0x7fa31c0b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:23.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.358+0000 7fa32cff9640 1 -- 172.21.15.46:0/855920003 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7fa318107a10 con 0x7fa3301083c0 2024-09-21T03:53:23.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.358+0000 7fa32effd640 1 --2- 172.21.15.46:0/855920003 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa31c0b65e0 0x7fa31c0b8af0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa320005fd0 tx=0x7fa32000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:23.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.361+0000 7fa32cff9640 1 -- 172.21.15.46:0/855920003 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa3180d26a0 con 0x7fa3301083c0 2024-09-21T03:53:23.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.591+0000 7fa335668640 1 -- 172.21.15.46:0/855920003 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fa33019b580 con 0x7fa3301083c0 2024-09-21T03:53:23.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.871+0000 7fa32cff9640 1 -- 172.21.15.46:0/855920003 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v20) ==== 115+0+0 (secure 0 0 0) 0x7fa3180d75e0 con 0x7fa3301083c0 2024-09-21T03:53:23.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.873+0000 7fa335668640 1 -- 172.21.15.46:0/855920003 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa31c0b65e0 msgr2=0x7fa31c0b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:23.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.873+0000 7fa335668640 1 --2- 172.21.15.46:0/855920003 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa31c0b65e0 0x7fa31c0b8af0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa320005fd0 tx=0x7fa32000b390 comp rx=0 tx=0).stop 2024-09-21T03:53:23.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.873+0000 7fa335668640 1 -- 172.21.15.46:0/855920003 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3301083c0 msgr2=0x7fa33019a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:23.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.873+0000 7fa335668640 1 --2- 172.21.15.46:0/855920003 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3301083c0 0x7fa33019a9f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa318006010 tx=0x7fa318004060 comp rx=0 tx=0).stop 2024-09-21T03:53:23.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.873+0000 7fa335668640 1 -- 172.21.15.46:0/855920003 shutdown_connections 2024-09-21T03:53:23.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.873+0000 7fa335668640 1 --2- 172.21.15.46:0/855920003 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa31c0b65e0 0x7fa31c0b8af0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.873+0000 7fa335668640 1 --2- 172.21.15.46:0/855920003 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa330108d10 0x7fa33019fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.873+0000 7fa335668640 1 --2- 172.21.15.46:0/855920003 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3301083c0 0x7fa33019a9f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.873+0000 7fa335668640 1 --2- 172.21.15.46:0/855920003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa330102a80 0x7fa33019a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.873+0000 7fa335668640 1 -- 172.21.15.46:0/855920003 >> 172.21.15.46:0/855920003 conn(0x7fa330079740 msgr2=0x7fa330104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:23.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.874+0000 7fa335668640 1 -- 172.21.15.46:0/855920003 shutdown_connections 2024-09-21T03:53:23.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:23.874+0000 7fa335668640 1 -- 172.21.15.46:0/855920003 wait complete. 2024-09-21T03:53:24.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:23 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/855920003' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T03:53:24.238 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:23 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/855920003' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T03:53:24.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:23 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/855920003' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T03:53:24.554 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-09-21T03:53:24.554 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs subvolumegroup create cephfs qa 2024-09-21T03:53:24.813 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:25.210 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:24 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/855920003' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T03:53:25.210 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:24 smithi046 ceph-mon[30954]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T03:53:25.210 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:24 smithi046 ceph-mon[30954]: pgmap v269: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 409 B/s rd, 1.4 KiB/s wr, 4 op/s 2024-09-21T03:53:25.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.303+0000 7f0f55741640 1 -- 172.21.15.46:0/2142187860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f50103b60 msgr2=0x7f0f50103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:25.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.303+0000 7f0f55741640 1 --2- 172.21.15.46:0/2142187860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f50103b60 0x7f0f50103f70 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0f40009ca0 tx=0x7f0f4002a8e0 comp rx=0 tx=0).stop 2024-09-21T03:53:25.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.303+0000 7f0f55741640 1 -- 172.21.15.46:0/2142187860 shutdown_connections 2024-09-21T03:53:25.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.303+0000 7f0f55741640 1 --2- 172.21.15.46:0/2142187860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f50109df0 0x7f0f50110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:25.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.303+0000 7f0f55741640 1 --2- 172.21.15.46:0/2142187860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f501094a0 0x7f0f501098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:25.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.303+0000 7f0f55741640 1 --2- 172.21.15.46:0/2142187860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f50103b60 0x7f0f50103f70 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:25.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.303+0000 7f0f55741640 1 -- 172.21.15.46:0/2142187860 >> 172.21.15.46:0/2142187860 conn(0x7f0f5007b850 msgr2=0x7f0f5007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:25.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.303+0000 7f0f55741640 1 -- 172.21.15.46:0/2142187860 shutdown_connections 2024-09-21T03:53:25.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.303+0000 7f0f55741640 1 -- 172.21.15.46:0/2142187860 wait complete. 2024-09-21T03:53:25.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.304+0000 7f0f55741640 1 Processor -- start 2024-09-21T03:53:25.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.304+0000 7f0f55741640 1 -- start start 2024-09-21T03:53:25.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.304+0000 7f0f55741640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f50103b60 0x7f0f5019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:25.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.304+0000 7f0f55741640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f501094a0 0x7f0f5019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:25.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.304+0000 7f0f55741640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f50109df0 0x7f0f5019fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:25.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.304+0000 7f0f55741640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0f50113b70 con 0x7f0f50103b60 2024-09-21T03:53:25.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.304+0000 7f0f55741640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0f501139f0 con 0x7f0f50109df0 2024-09-21T03:53:25.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.304+0000 7f0f55741640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0f50113cf0 con 0x7f0f501094a0 2024-09-21T03:53:25.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.304+0000 7f0f4effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f50103b60 0x7f0f5019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:25.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.304+0000 7f0f4effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f50103b60 0x7f0f5019a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49524/0 (socket says 172.21.15.46:49524) 2024-09-21T03:53:25.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.304+0000 7f0f4effd640 1 -- 172.21.15.46:0/1243638333 learned_addr learned my addr 172.21.15.46:0/1243638333 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:53:25.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.304+0000 7f0f4e7fc640 1 --2- 172.21.15.46:0/1243638333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f501094a0 0x7f0f5019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:25.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.304+0000 7f0f4effd640 1 -- 172.21.15.46:0/1243638333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f501094a0 msgr2=0x7f0f5019ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:25.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.304+0000 7f0f4effd640 1 --2- 172.21.15.46:0/1243638333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f501094a0 0x7f0f5019ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:25.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.305+0000 7f0f4effd640 1 -- 172.21.15.46:0/1243638333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f50109df0 msgr2=0x7f0f5019fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:25.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.304+0000 7f0f4f7fe640 1 --2- 172.21.15.46:0/1243638333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f50109df0 0x7f0f5019fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:25.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.305+0000 7f0f4effd640 1 --2- 172.21.15.46:0/1243638333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f50109df0 0x7f0f5019fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:25.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.305+0000 7f0f4effd640 1 -- 172.21.15.46:0/1243638333 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f501a0530 con 0x7f0f50103b60 2024-09-21T03:53:25.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.305+0000 7f0f4effd640 1 --2- 172.21.15.46:0/1243638333 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f50103b60 0x7f0f5019a5c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0f4002ae00 tx=0x7f0f40003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:25.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.305+0000 7f0f47fff640 1 -- 172.21.15.46:0/1243638333 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f40004240 con 0x7f0f50103b60 2024-09-21T03:53:25.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.305+0000 7f0f55741640 1 -- 172.21.15.46:0/1243638333 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f501a07c0 con 0x7f0f50103b60 2024-09-21T03:53:25.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.305+0000 7f0f47fff640 1 -- 172.21.15.46:0/1243638333 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f40003e50 con 0x7f0f50103b60 2024-09-21T03:53:25.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.305+0000 7f0f47fff640 1 -- 172.21.15.46:0/1243638333 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4003a400 con 0x7f0f50103b60 2024-09-21T03:53:25.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.305+0000 7f0f55741640 1 -- 172.21.15.46:0/1243638333 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f501a6f80 con 0x7f0f50103b60 2024-09-21T03:53:25.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.306+0000 7f0f55741640 1 -- 172.21.15.46:0/1243638333 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f50103ff0 con 0x7f0f50103b60 2024-09-21T03:53:25.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.308+0000 7f0f47fff640 1 -- 172.21.15.46:0/1243638333 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f0f400305e0 con 0x7f0f50103b60 2024-09-21T03:53:25.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.309+0000 7f0f47fff640 1 --2- 172.21.15.46:0/1243638333 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f0f3c0b65e0 0x7f0f3c0b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:25.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.309+0000 7f0f4e7fc640 1 --2- 172.21.15.46:0/1243638333 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f0f3c0b65e0 0x7f0f3c0b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:25.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.309+0000 7f0f47fff640 1 -- 172.21.15.46:0/1243638333 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f0f40108bf0 con 0x7f0f50103b60 2024-09-21T03:53:25.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.309+0000 7f0f4e7fc640 1 --2- 172.21.15.46:0/1243638333 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f0f3c0b65e0 0x7f0f3c0b8af0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0f50106450 tx=0x7f0f38008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:25.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.312+0000 7f0f47fff640 1 -- 172.21.15.46:0/1243638333 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0f400cf440 con 0x7f0f50103b60 2024-09-21T03:53:25.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:24 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/855920003' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T03:53:25.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:24 smithi105 ceph-mon[34773]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T03:53:25.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:24 smithi105 ceph-mon[34773]: pgmap v269: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 409 B/s rd, 1.4 KiB/s wr, 4 op/s 2024-09-21T03:53:25.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:24 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/855920003' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T03:53:25.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:24 smithi162 ceph-mon[35071]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T03:53:25.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:24 smithi162 ceph-mon[35071]: pgmap v269: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 409 B/s rd, 1.4 KiB/s wr, 4 op/s 2024-09-21T03:53:25.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.524+0000 7f0f55741640 1 -- 172.21.15.46:0/1243638333 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f0f50063800 con 0x7f0f3c0b65e0 2024-09-21T03:53:25.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.544+0000 7f0f47fff640 1 -- 172.21.15.46:0/1243638333 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0f50063800 con 0x7f0f3c0b65e0 2024-09-21T03:53:25.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.546+0000 7f0f55741640 1 -- 172.21.15.46:0/1243638333 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f0f3c0b65e0 msgr2=0x7f0f3c0b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:25.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.546+0000 7f0f55741640 1 --2- 172.21.15.46:0/1243638333 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f0f3c0b65e0 0x7f0f3c0b8af0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0f50106450 tx=0x7f0f38008040 comp rx=0 tx=0).stop 2024-09-21T03:53:25.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.546+0000 7f0f55741640 1 -- 172.21.15.46:0/1243638333 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f50103b60 msgr2=0x7f0f5019a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:25.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.546+0000 7f0f55741640 1 --2- 172.21.15.46:0/1243638333 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f50103b60 0x7f0f5019a5c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0f4002ae00 tx=0x7f0f40003ba0 comp rx=0 tx=0).stop 2024-09-21T03:53:25.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.546+0000 7f0f55741640 1 -- 172.21.15.46:0/1243638333 shutdown_connections 2024-09-21T03:53:25.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.546+0000 7f0f55741640 1 --2- 172.21.15.46:0/1243638333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f50109df0 0x7f0f5019fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:25.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.546+0000 7f0f55741640 1 --2- 172.21.15.46:0/1243638333 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f0f3c0b65e0 0x7f0f3c0b8af0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:25.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.546+0000 7f0f55741640 1 --2- 172.21.15.46:0/1243638333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f501094a0 0x7f0f5019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:25.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.546+0000 7f0f55741640 1 --2- 172.21.15.46:0/1243638333 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f50103b60 0x7f0f5019a5c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:25.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.546+0000 7f0f55741640 1 -- 172.21.15.46:0/1243638333 >> 172.21.15.46:0/1243638333 conn(0x7f0f5007b850 msgr2=0x7f0f501075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:25.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.546+0000 7f0f55741640 1 -- 172.21.15.46:0/1243638333 shutdown_connections 2024-09-21T03:53:25.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:25.546+0000 7f0f55741640 1 -- 172.21.15.46:0/1243638333 wait complete. 2024-09-21T03:53:25.880 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:53:25 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: 2024-09-21T03:53:25.529+0000 7f5014ae4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T03:53:25.881 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:53:25 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: 2024-09-21T03:53:25.529+0000 7f5014ae4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T03:53:25.881 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:53:25 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: 2024-09-21T03:53:25.529+0000 7f5014ae4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T03:53:25.881 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:53:25 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: 2024-09-21T03:53:25.529+0000 7f5014ae4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T03:53:25.881 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:53:25 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: 2024-09-21T03:53:25.529+0000 7f5014ae4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T03:53:26.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:25 smithi105 ceph-mon[34773]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:26.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:25 smithi046 ceph-mon[30954]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:26.338 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-21T03:53:26.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:25 smithi162 ceph-mon[35071]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:26.597 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:27.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:26 smithi046 ceph-mon[30954]: pgmap v270: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 364 B/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-21T03:53:27.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.114+0000 7f8073a59640 1 -- 172.21.15.46:0/939765356 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f806c103b60 msgr2=0x7f806c103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:27.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.114+0000 7f8073a59640 1 --2- 172.21.15.46:0/939765356 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f806c103b60 0x7f806c103f70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f805c009ca0 tx=0x7f805c02a8e0 comp rx=0 tx=0).stop 2024-09-21T03:53:27.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.114+0000 7f8073a59640 1 -- 172.21.15.46:0/939765356 shutdown_connections 2024-09-21T03:53:27.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.114+0000 7f8073a59640 1 --2- 172.21.15.46:0/939765356 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f806c109df0 0x7f806c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:27.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.114+0000 7f8073a59640 1 --2- 172.21.15.46:0/939765356 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f806c1094a0 0x7f806c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:27.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.114+0000 7f8073a59640 1 --2- 172.21.15.46:0/939765356 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f806c103b60 0x7f806c103f70 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:27.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.114+0000 7f8073a59640 1 -- 172.21.15.46:0/939765356 >> 172.21.15.46:0/939765356 conn(0x7f806c07b850 msgr2=0x7f806c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:27.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.114+0000 7f8073a59640 1 -- 172.21.15.46:0/939765356 shutdown_connections 2024-09-21T03:53:27.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.114+0000 7f8073a59640 1 -- 172.21.15.46:0/939765356 wait complete. 2024-09-21T03:53:27.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.115+0000 7f8073a59640 1 Processor -- start 2024-09-21T03:53:27.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.115+0000 7f8073a59640 1 -- start start 2024-09-21T03:53:27.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.115+0000 7f8073a59640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f806c103b60 0x7f806c19a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:27.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.115+0000 7f8073a59640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f806c1094a0 0x7f806c19aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:27.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.115+0000 7f8073a59640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f806c109df0 0x7f806c19fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:27.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.115+0000 7f8073a59640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f806c113b30 con 0x7f806c103b60 2024-09-21T03:53:27.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.115+0000 7f8073a59640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f806c1139b0 con 0x7f806c1094a0 2024-09-21T03:53:27.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.115+0000 7f8073a59640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f806c113cb0 con 0x7f806c109df0 2024-09-21T03:53:27.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.115+0000 7f80717f5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f806c103b60 0x7f806c19a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:27.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.115+0000 7f80717f5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f806c103b60 0x7f806c19a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49578/0 (socket says 172.21.15.46:49578) 2024-09-21T03:53:27.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.115+0000 7f80717f5640 1 -- 172.21.15.46:0/1782590737 learned_addr learned my addr 172.21.15.46:0/1782590737 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:53:27.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.115+0000 7f8070ff4640 1 --2- 172.21.15.46:0/1782590737 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f806c1094a0 0x7f806c19aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:27.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.115+0000 7f8071ff6640 1 --2- 172.21.15.46:0/1782590737 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f806c109df0 0x7f806c19fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:27.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.116+0000 7f80717f5640 1 -- 172.21.15.46:0/1782590737 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f806c109df0 msgr2=0x7f806c19fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:27.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.116+0000 7f80717f5640 1 --2- 172.21.15.46:0/1782590737 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f806c109df0 0x7f806c19fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:27.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.116+0000 7f80717f5640 1 -- 172.21.15.46:0/1782590737 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f806c1094a0 msgr2=0x7f806c19aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:27.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.116+0000 7f80717f5640 1 --2- 172.21.15.46:0/1782590737 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f806c1094a0 0x7f806c19aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:27.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.116+0000 7f80717f5640 1 -- 172.21.15.46:0/1782590737 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f806c1a04b0 con 0x7f806c103b60 2024-09-21T03:53:27.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.116+0000 7f80717f5640 1 --2- 172.21.15.46:0/1782590737 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f806c103b60 0x7f806c19a540 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f805c005cc0 tx=0x7f805c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:27.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.116+0000 7f806a7fc640 1 -- 172.21.15.46:0/1782590737 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805c004040 con 0x7f806c103b60 2024-09-21T03:53:27.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.116+0000 7f806a7fc640 1 -- 172.21.15.46:0/1782590737 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f805c004690 con 0x7f806c103b60 2024-09-21T03:53:27.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.116+0000 7f8073a59640 1 -- 172.21.15.46:0/1782590737 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f806c1a0740 con 0x7f806c103b60 2024-09-21T03:53:27.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.116+0000 7f806a7fc640 1 -- 172.21.15.46:0/1782590737 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805c030cd0 con 0x7f806c103b60 2024-09-21T03:53:27.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.116+0000 7f8073a59640 1 -- 172.21.15.46:0/1782590737 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f806c1a6f00 con 0x7f806c103b60 2024-09-21T03:53:27.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.117+0000 7f8073a59640 1 -- 172.21.15.46:0/1782590737 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f806c103f70 con 0x7f806c103b60 2024-09-21T03:53:27.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.119+0000 7f806a7fc640 1 -- 172.21.15.46:0/1782590737 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f805c0041e0 con 0x7f806c103b60 2024-09-21T03:53:27.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.120+0000 7f806a7fc640 1 --2- 172.21.15.46:0/1782590737 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f80540b6670 0x7f80540b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:27.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.120+0000 7f8070ff4640 1 --2- 172.21.15.46:0/1782590737 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f80540b6670 0x7f80540b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:27.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.120+0000 7f806a7fc640 1 -- 172.21.15.46:0/1782590737 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f805c1088a0 con 0x7f806c103b60 2024-09-21T03:53:27.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.121+0000 7f8070ff4640 1 --2- 172.21.15.46:0/1782590737 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f80540b6670 0x7f80540b8b80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8060005d00 tx=0x7f8060005c50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:27.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.123+0000 7f806a7fc640 1 -- 172.21.15.46:0/1782590737 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f805c0ceff0 con 0x7f806c103b60 2024-09-21T03:53:27.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:26 smithi105 ceph-mon[34773]: pgmap v270: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 364 B/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-21T03:53:27.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.338+0000 7f8073a59640 1 -- 172.21.15.46:0/1782590737 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f806c063800 con 0x7f80540b6670 2024-09-21T03:53:27.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.366+0000 7f806a7fc640 1 -- 172.21.15.46:0/1782590737 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f806c063800 con 0x7f80540b6670 2024-09-21T03:53:27.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.368+0000 7f8073a59640 1 -- 172.21.15.46:0/1782590737 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f80540b6670 msgr2=0x7f80540b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:27.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.368+0000 7f8073a59640 1 --2- 172.21.15.46:0/1782590737 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f80540b6670 0x7f80540b8b80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8060005d00 tx=0x7f8060005c50 comp rx=0 tx=0).stop 2024-09-21T03:53:27.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.368+0000 7f8073a59640 1 -- 172.21.15.46:0/1782590737 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f806c103b60 msgr2=0x7f806c19a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:27.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.368+0000 7f8073a59640 1 --2- 172.21.15.46:0/1782590737 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f806c103b60 0x7f806c19a540 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f805c005cc0 tx=0x7f805c003ba0 comp rx=0 tx=0).stop 2024-09-21T03:53:27.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.368+0000 7f8073a59640 1 -- 172.21.15.46:0/1782590737 shutdown_connections 2024-09-21T03:53:27.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.368+0000 7f8073a59640 1 --2- 172.21.15.46:0/1782590737 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f80540b6670 0x7f80540b8b80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:27.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.368+0000 7f8073a59640 1 --2- 172.21.15.46:0/1782590737 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f806c109df0 0x7f806c19fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:27.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.368+0000 7f8073a59640 1 --2- 172.21.15.46:0/1782590737 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f806c1094a0 0x7f806c19aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:27.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.368+0000 7f8073a59640 1 --2- 172.21.15.46:0/1782590737 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f806c103b60 0x7f806c19a540 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:27.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.368+0000 7f8073a59640 1 -- 172.21.15.46:0/1782590737 >> 172.21.15.46:0/1782590737 conn(0x7f806c07b850 msgr2=0x7f806c107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:27.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.368+0000 7f8073a59640 1 -- 172.21.15.46:0/1782590737 shutdown_connections 2024-09-21T03:53:27.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:27.368+0000 7f8073a59640 1 -- 172.21.15.46:0/1782590737 wait complete. 2024-09-21T03:53:27.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:26 smithi162 ceph-mon[35071]: pgmap v270: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 364 B/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-21T03:53:28.117 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:27 smithi046 ceph-mon[30954]: mgrmap e21: x(active, since 6m), standbys: y, z 2024-09-21T03:53:28.117 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:27 smithi046 ceph-mon[30954]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:28.149 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-21T03:53:28.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:27 smithi105 ceph-mon[34773]: mgrmap e21: x(active, since 6m), standbys: y, z 2024-09-21T03:53:28.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:27 smithi105 ceph-mon[34773]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:28.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:27 smithi162 ceph-mon[35071]: mgrmap e21: x(active, since 6m), standbys: y, z 2024-09-21T03:53:28.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:27 smithi162 ceph-mon[35071]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:28.411 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:28.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.934+0000 7fa878bd7640 1 -- 172.21.15.46:0/707937345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8741020b0 msgr2=0x7fa8741024c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:28.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.934+0000 7fa878bd7640 1 --2- 172.21.15.46:0/707937345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8741020b0 0x7fa8741024c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa864009900 tx=0x7fa86402a410 comp rx=0 tx=0).stop 2024-09-21T03:53:28.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.934+0000 7fa878bd7640 1 -- 172.21.15.46:0/707937345 shutdown_connections 2024-09-21T03:53:28.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.934+0000 7fa878bd7640 1 --2- 172.21.15.46:0/707937345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa874106bf0 0x7fa874110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:28.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.934+0000 7fa878bd7640 1 --2- 172.21.15.46:0/707937345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8741062a0 0x7fa8741066b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:28.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.934+0000 7fa878bd7640 1 --2- 172.21.15.46:0/707937345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8741020b0 0x7fa8741024c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:28.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.934+0000 7fa878bd7640 1 -- 172.21.15.46:0/707937345 >> 172.21.15.46:0/707937345 conn(0x7fa874079e30 msgr2=0x7fa87407a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:28.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.934+0000 7fa878bd7640 1 -- 172.21.15.46:0/707937345 shutdown_connections 2024-09-21T03:53:28.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.934+0000 7fa878bd7640 1 -- 172.21.15.46:0/707937345 wait complete. 2024-09-21T03:53:28.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.935+0000 7fa878bd7640 1 Processor -- start 2024-09-21T03:53:28.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.935+0000 7fa878bd7640 1 -- start start 2024-09-21T03:53:28.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.935+0000 7fa878bd7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8741020b0 0x7fa874103050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:28.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.935+0000 7fa878bd7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8741062a0 0x7fa874103590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:28.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.935+0000 7fa878bd7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa874106bf0 0x7fa874103ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:28.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.935+0000 7fa878bd7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa874113af0 con 0x7fa8741020b0 2024-09-21T03:53:28.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.935+0000 7fa878bd7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa874113970 con 0x7fa8741062a0 2024-09-21T03:53:28.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.935+0000 7fa878bd7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa874113c70 con 0x7fa874106bf0 2024-09-21T03:53:28.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.935+0000 7fa87259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8741020b0 0x7fa874103050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:28.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.935+0000 7fa87259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8741020b0 0x7fa874103050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49592/0 (socket says 172.21.15.46:49592) 2024-09-21T03:53:28.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.935+0000 7fa87259c640 1 -- 172.21.15.46:0/2424486422 learned_addr learned my addr 172.21.15.46:0/2424486422 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:53:28.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.935+0000 7fa872d9d640 1 --2- 172.21.15.46:0/2424486422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa874106bf0 0x7fa874103ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:28.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.935+0000 7fa871d9b640 1 --2- 172.21.15.46:0/2424486422 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8741062a0 0x7fa874103590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:28.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.936+0000 7fa87259c640 1 -- 172.21.15.46:0/2424486422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa874106bf0 msgr2=0x7fa874103ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:28.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.936+0000 7fa87259c640 1 --2- 172.21.15.46:0/2424486422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa874106bf0 0x7fa874103ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:28.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.936+0000 7fa87259c640 1 -- 172.21.15.46:0/2424486422 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8741062a0 msgr2=0x7fa874103590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:28.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.936+0000 7fa87259c640 1 --2- 172.21.15.46:0/2424486422 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8741062a0 0x7fa874103590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:28.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.936+0000 7fa87259c640 1 -- 172.21.15.46:0/2424486422 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8741a8760 con 0x7fa8741020b0 2024-09-21T03:53:28.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.936+0000 7fa87259c640 1 --2- 172.21.15.46:0/2424486422 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8741020b0 0x7fa874103050 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa864005940 tx=0x7fa8640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:28.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.936+0000 7fa8637fe640 1 -- 172.21.15.46:0/2424486422 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86403f030 con 0x7fa8741020b0 2024-09-21T03:53:28.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.936+0000 7fa878bd7640 1 -- 172.21.15.46:0/2424486422 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8741a89f0 con 0x7fa8741020b0 2024-09-21T03:53:28.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.936+0000 7fa8637fe640 1 -- 172.21.15.46:0/2424486422 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa864003cb0 con 0x7fa8741020b0 2024-09-21T03:53:28.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.936+0000 7fa8637fe640 1 -- 172.21.15.46:0/2424486422 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa864035070 con 0x7fa8741020b0 2024-09-21T03:53:28.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.936+0000 7fa878bd7640 1 -- 172.21.15.46:0/2424486422 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8741a8ed0 con 0x7fa8741020b0 2024-09-21T03:53:28.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.937+0000 7fa878bd7640 1 -- 172.21.15.46:0/2424486422 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8741024c0 con 0x7fa8741020b0 2024-09-21T03:53:28.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.939+0000 7fa8637fe640 1 -- 172.21.15.46:0/2424486422 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fa864042030 con 0x7fa8741020b0 2024-09-21T03:53:28.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.940+0000 7fa8637fe640 1 --2- 172.21.15.46:0/2424486422 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa85c0b65f0 0x7fa85c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:28.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.940+0000 7fa871d9b640 1 --2- 172.21.15.46:0/2424486422 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa85c0b65f0 0x7fa85c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:28.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.940+0000 7fa8637fe640 1 -- 172.21.15.46:0/2424486422 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7fa864107ff0 con 0x7fa8741020b0 2024-09-21T03:53:28.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.940+0000 7fa871d9b640 1 --2- 172.21.15.46:0/2424486422 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa85c0b65f0 0x7fa85c0b8b00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa874101d20 tx=0x7fa86800b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:28.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:28.943+0000 7fa8637fe640 1 -- 172.21.15.46:0/2424486422 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa8640d2ac0 con 0x7fa8741020b0 2024-09-21T03:53:29.161 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:28 smithi046 ceph-mon[30954]: pgmap v271: 97 pgs: 97 active+clean; 601 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3.4 KiB/s wr, 6 op/s 2024-09-21T03:53:29.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:29.159+0000 7fa878bd7640 1 -- 172.21.15.46:0/2424486422 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fa874063800 con 0x7fa85c0b65f0 2024-09-21T03:53:29.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:29.166+0000 7fa8637fe640 1 -- 172.21.15.46:0/2424486422 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fa874063800 con 0x7fa85c0b65f0 2024-09-21T03:53:29.168 INFO:teuthology.orchestra.run.smithi046.stdout:/volumes/qa/sv_0/4fa1d813-97b8-48c4-ac80-f63d1bd7c4a4 2024-09-21T03:53:29.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:29.168+0000 7fa878bd7640 1 -- 172.21.15.46:0/2424486422 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa85c0b65f0 msgr2=0x7fa85c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:29.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:29.168+0000 7fa878bd7640 1 --2- 172.21.15.46:0/2424486422 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa85c0b65f0 0x7fa85c0b8b00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa874101d20 tx=0x7fa86800b410 comp rx=0 tx=0).stop 2024-09-21T03:53:29.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:29.168+0000 7fa878bd7640 1 -- 172.21.15.46:0/2424486422 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8741020b0 msgr2=0x7fa874103050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:29.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:29.168+0000 7fa878bd7640 1 --2- 172.21.15.46:0/2424486422 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8741020b0 0x7fa874103050 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa864005940 tx=0x7fa8640042f0 comp rx=0 tx=0).stop 2024-09-21T03:53:29.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:29.168+0000 7fa878bd7640 1 -- 172.21.15.46:0/2424486422 shutdown_connections 2024-09-21T03:53:29.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:29.168+0000 7fa878bd7640 1 --2- 172.21.15.46:0/2424486422 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa85c0b65f0 0x7fa85c0b8b00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:29.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:29.168+0000 7fa878bd7640 1 --2- 172.21.15.46:0/2424486422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa874106bf0 0x7fa874103ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:29.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:29.168+0000 7fa878bd7640 1 --2- 172.21.15.46:0/2424486422 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8741062a0 0x7fa874103590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:29.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:29.168+0000 7fa878bd7640 1 --2- 172.21.15.46:0/2424486422 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8741020b0 0x7fa874103050 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:29.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:29.168+0000 7fa878bd7640 1 -- 172.21.15.46:0/2424486422 >> 172.21.15.46:0/2424486422 conn(0x7fa874079e30 msgr2=0x7fa874108090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:29.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:29.168+0000 7fa878bd7640 1 -- 172.21.15.46:0/2424486422 shutdown_connections 2024-09-21T03:53:29.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:29.168+0000 7fa878bd7640 1 -- 172.21.15.46:0/2424486422 wait complete. 2024-09-21T03:53:29.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:28 smithi105 ceph-mon[34773]: pgmap v271: 97 pgs: 97 active+clean; 601 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3.4 KiB/s wr, 6 op/s 2024-09-21T03:53:29.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:28 smithi162 ceph-mon[35071]: pgmap v271: 97 pgs: 97 active+clean; 601 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3.4 KiB/s wr, 6 op/s 2024-09-21T03:53:29.834 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-21T03:53:30.094 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:30.215 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:29 smithi046 ceph-mon[30954]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:30.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:29 smithi105 ceph-mon[34773]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:30.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:29 smithi162 ceph-mon[35071]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:30.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.608+0000 7f7b9c792640 1 -- 172.21.15.46:0/3431511149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b94103b60 msgr2=0x7f7b94103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:30.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.608+0000 7f7b9c792640 1 --2- 172.21.15.46:0/3431511149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b94103b60 0x7f7b94103f70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7b90009900 tx=0x7f7b9002a410 comp rx=0 tx=0).stop 2024-09-21T03:53:30.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.609+0000 7f7b9c792640 1 -- 172.21.15.46:0/3431511149 shutdown_connections 2024-09-21T03:53:30.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.609+0000 7f7b9c792640 1 --2- 172.21.15.46:0/3431511149 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b94109df0 0x7f7b94110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:30.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.609+0000 7f7b9c792640 1 --2- 172.21.15.46:0/3431511149 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b941094a0 0x7f7b941098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:30.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.609+0000 7f7b9c792640 1 --2- 172.21.15.46:0/3431511149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b94103b60 0x7f7b94103f70 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:30.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.609+0000 7f7b9c792640 1 -- 172.21.15.46:0/3431511149 >> 172.21.15.46:0/3431511149 conn(0x7f7b9407b850 msgr2=0x7f7b9407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:30.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.609+0000 7f7b9c792640 1 -- 172.21.15.46:0/3431511149 shutdown_connections 2024-09-21T03:53:30.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.609+0000 7f7b9c792640 1 -- 172.21.15.46:0/3431511149 wait complete. 2024-09-21T03:53:30.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.609+0000 7f7b9c792640 1 Processor -- start 2024-09-21T03:53:30.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.609+0000 7f7b9c792640 1 -- start start 2024-09-21T03:53:30.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.610+0000 7f7b9c792640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b94103b60 0x7f7b9419a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:30.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.610+0000 7f7b9c792640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b941094a0 0x7f7b9419aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:30.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.610+0000 7f7b9c792640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b94109df0 0x7f7b9419fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:30.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.610+0000 7f7b9c792640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7b94113b30 con 0x7f7b94109df0 2024-09-21T03:53:30.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.610+0000 7f7b9c792640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7b941139b0 con 0x7f7b94103b60 2024-09-21T03:53:30.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.610+0000 7f7b9c792640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7b94113cb0 con 0x7f7b941094a0 2024-09-21T03:53:30.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.610+0000 7f7b9ad2f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b94109df0 0x7f7b9419fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:30.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.610+0000 7f7b9ad2f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b94109df0 0x7f7b9419fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49614/0 (socket says 172.21.15.46:49614) 2024-09-21T03:53:30.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.610+0000 7f7b9ad2f640 1 -- 172.21.15.46:0/47059615 learned_addr learned my addr 172.21.15.46:0/47059615 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:53:30.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.610+0000 7f7b99d2d640 1 --2- 172.21.15.46:0/47059615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b941094a0 0x7f7b9419aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:30.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.610+0000 7f7b9a52e640 1 --2- 172.21.15.46:0/47059615 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b94103b60 0x7f7b9419a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:30.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.610+0000 7f7b9ad2f640 1 -- 172.21.15.46:0/47059615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b941094a0 msgr2=0x7f7b9419aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:30.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.610+0000 7f7b9ad2f640 1 --2- 172.21.15.46:0/47059615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b941094a0 0x7f7b9419aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:30.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.610+0000 7f7b9ad2f640 1 -- 172.21.15.46:0/47059615 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b94103b60 msgr2=0x7f7b9419a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:30.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.610+0000 7f7b9ad2f640 1 --2- 172.21.15.46:0/47059615 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b94103b60 0x7f7b9419a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:30.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.610+0000 7f7b9ad2f640 1 -- 172.21.15.46:0/47059615 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b941a0490 con 0x7f7b94109df0 2024-09-21T03:53:30.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.610+0000 7f7b9ad2f640 1 --2- 172.21.15.46:0/47059615 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b94109df0 0x7f7b9419fd60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00b970 tx=0x7f7b8c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:30.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.611+0000 7f7b8b7fe640 1 -- 172.21.15.46:0/47059615 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c019070 con 0x7f7b94109df0 2024-09-21T03:53:30.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.611+0000 7f7b8b7fe640 1 -- 172.21.15.46:0/47059615 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b8c014440 con 0x7f7b94109df0 2024-09-21T03:53:30.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.611+0000 7f7b9c792640 1 -- 172.21.15.46:0/47059615 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b941a0780 con 0x7f7b94109df0 2024-09-21T03:53:30.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.611+0000 7f7b8b7fe640 1 -- 172.21.15.46:0/47059615 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c0075d0 con 0x7f7b94109df0 2024-09-21T03:53:30.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.611+0000 7f7b9c792640 1 -- 172.21.15.46:0/47059615 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b941a6ee0 con 0x7f7b94109df0 2024-09-21T03:53:30.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.612+0000 7f7b9c792640 1 -- 172.21.15.46:0/47059615 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b94103f70 con 0x7f7b94109df0 2024-09-21T03:53:30.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.613+0000 7f7b8b7fe640 1 -- 172.21.15.46:0/47059615 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f7b8c01c070 con 0x7f7b94109df0 2024-09-21T03:53:30.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.614+0000 7f7b8b7fe640 1 --2- 172.21.15.46:0/47059615 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7b800b65f0 0x7f7b800b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:30.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.614+0000 7f7b9a52e640 1 --2- 172.21.15.46:0/47059615 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7b800b65f0 0x7f7b800b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:30.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.614+0000 7f7b8b7fe640 1 -- 172.21.15.46:0/47059615 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f7b8c0e6ea0 con 0x7f7b94109df0 2024-09-21T03:53:30.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.615+0000 7f7b9a52e640 1 --2- 172.21.15.46:0/47059615 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7b800b65f0 0x7f7b800b8b00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7b90031440 tx=0x7f7b90005d50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:30.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.617+0000 7f7b8b7fe640 1 -- 172.21.15.46:0/47059615 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7b8c0b1970 con 0x7f7b94109df0 2024-09-21T03:53:30.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.833+0000 7f7b9c792640 1 -- 172.21.15.46:0/47059615 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f7b94063800 con 0x7f7b800b65f0 2024-09-21T03:53:30.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.861+0000 7f7b8b7fe640 1 -- 172.21.15.46:0/47059615 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7b94063800 con 0x7f7b800b65f0 2024-09-21T03:53:30.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.863+0000 7f7b9c792640 1 -- 172.21.15.46:0/47059615 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7b800b65f0 msgr2=0x7f7b800b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:30.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.863+0000 7f7b9c792640 1 --2- 172.21.15.46:0/47059615 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7b800b65f0 0x7f7b800b8b00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7b90031440 tx=0x7f7b90005d50 comp rx=0 tx=0).stop 2024-09-21T03:53:30.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.863+0000 7f7b9c792640 1 -- 172.21.15.46:0/47059615 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b94109df0 msgr2=0x7f7b9419fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:30.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.863+0000 7f7b9c792640 1 --2- 172.21.15.46:0/47059615 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b94109df0 0x7f7b9419fd60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00b970 tx=0x7f7b8c00be30 comp rx=0 tx=0).stop 2024-09-21T03:53:30.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.864+0000 7f7b9c792640 1 -- 172.21.15.46:0/47059615 shutdown_connections 2024-09-21T03:53:30.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.864+0000 7f7b9c792640 1 --2- 172.21.15.46:0/47059615 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b94109df0 0x7f7b9419fd60 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:30.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.864+0000 7f7b9c792640 1 --2- 172.21.15.46:0/47059615 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7b800b65f0 0x7f7b800b8b00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:30.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.864+0000 7f7b9c792640 1 --2- 172.21.15.46:0/47059615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b941094a0 0x7f7b9419aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:30.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.864+0000 7f7b9c792640 1 --2- 172.21.15.46:0/47059615 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b94103b60 0x7f7b9419a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:30.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.864+0000 7f7b9c792640 1 -- 172.21.15.46:0/47059615 >> 172.21.15.46:0/47059615 conn(0x7f7b9407b850 msgr2=0x7f7b94107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:30.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.864+0000 7f7b9c792640 1 -- 172.21.15.46:0/47059615 shutdown_connections 2024-09-21T03:53:30.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:30.864+0000 7f7b9c792640 1 -- 172.21.15.46:0/47059615 wait complete. 2024-09-21T03:53:31.238 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:30 smithi046 ceph-mon[30954]: pgmap v272: 97 pgs: 97 active+clean; 601 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T03:53:31.238 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:30 smithi046 ceph-mon[30954]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:31.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:30 smithi105 ceph-mon[34773]: pgmap v272: 97 pgs: 97 active+clean; 601 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T03:53:31.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:30 smithi105 ceph-mon[34773]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:31.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:30 smithi162 ceph-mon[35071]: pgmap v272: 97 pgs: 97 active+clean; 601 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T03:53:31.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:30 smithi162 ceph-mon[35071]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:31.667 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-21T03:53:31.936 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:32.204 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:32 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-09-21T03:53:32.204 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:32 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]} : dispatch 2024-09-21T03:53:32.204 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:32 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]} : dispatch 2024-09-21T03:53:32.204 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:32 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]} : dispatch 2024-09-21T03:53:32.204 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:32 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]} : dispatch 2024-09-21T03:53:32.204 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:32 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]} : dispatch 2024-09-21T03:53:32.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:32 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-09-21T03:53:32.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:32 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]} : dispatch 2024-09-21T03:53:32.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:32 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]} : dispatch 2024-09-21T03:53:32.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:32 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]} : dispatch 2024-09-21T03:53:32.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:32 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]} : dispatch 2024-09-21T03:53:32.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:32 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]} : dispatch 2024-09-21T03:53:32.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:32 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-09-21T03:53:32.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:32 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]} : dispatch 2024-09-21T03:53:32.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:32 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]} : dispatch 2024-09-21T03:53:32.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:32 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]} : dispatch 2024-09-21T03:53:32.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:32 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]} : dispatch 2024-09-21T03:53:32.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:32 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]} : dispatch 2024-09-21T03:53:32.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.470+0000 7fdf24fa4640 1 -- 172.21.15.46:0/3247846195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf20101fe0 msgr2=0x7fdf201023f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:32.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.470+0000 7fdf24fa4640 1 --2- 172.21.15.46:0/3247846195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf20101fe0 0x7fdf201023f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009900 tx=0x7fdf1002a3f0 comp rx=0 tx=0).stop 2024-09-21T03:53:32.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.470+0000 7fdf24fa4640 1 -- 172.21.15.46:0/3247846195 shutdown_connections 2024-09-21T03:53:32.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.470+0000 7fdf24fa4640 1 --2- 172.21.15.46:0/3247846195 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf20109e10 0x7fdf20110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:32.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.470+0000 7fdf24fa4640 1 --2- 172.21.15.46:0/3247846195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf201094c0 0x7fdf201098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:32.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.470+0000 7fdf24fa4640 1 --2- 172.21.15.46:0/3247846195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf20101fe0 0x7fdf201023f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:32.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.470+0000 7fdf24fa4640 1 -- 172.21.15.46:0/3247846195 >> 172.21.15.46:0/3247846195 conn(0x7fdf20077bc0 msgr2=0x7fdf20078000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:32.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.470+0000 7fdf24fa4640 1 -- 172.21.15.46:0/3247846195 shutdown_connections 2024-09-21T03:53:32.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.471+0000 7fdf24fa4640 1 -- 172.21.15.46:0/3247846195 wait complete. 2024-09-21T03:53:32.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.471+0000 7fdf24fa4640 1 Processor -- start 2024-09-21T03:53:32.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.472+0000 7fdf24fa4640 1 -- start start 2024-09-21T03:53:32.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.472+0000 7fdf24fa4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf20101fe0 0x7fdf20074e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:32.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.472+0000 7fdf24fa4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf201094c0 0x7fdf2006e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:32.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.472+0000 7fdf24fa4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf20109e10 0x7fdf2006e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:32.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.472+0000 7fdf24fa4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdf20113a80 con 0x7fdf201094c0 2024-09-21T03:53:32.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.472+0000 7fdf24fa4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdf20113900 con 0x7fdf20101fe0 2024-09-21T03:53:32.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.472+0000 7fdf24fa4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdf20113c00 con 0x7fdf20109e10 2024-09-21T03:53:32.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.472+0000 7fdf1dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf201094c0 0x7fdf2006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:32.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.472+0000 7fdf1dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf201094c0 0x7fdf2006e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37494/0 (socket says 172.21.15.46:37494) 2024-09-21T03:53:32.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.472+0000 7fdf1dd9b640 1 -- 172.21.15.46:0/3415500644 learned_addr learned my addr 172.21.15.46:0/3415500644 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:53:32.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.472+0000 7fdf1e59c640 1 --2- 172.21.15.46:0/3415500644 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf20101fe0 0x7fdf20074e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:32.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.472+0000 7fdf1ed9d640 1 --2- 172.21.15.46:0/3415500644 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf20109e10 0x7fdf2006e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:32.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.472+0000 7fdf1dd9b640 1 -- 172.21.15.46:0/3415500644 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf20109e10 msgr2=0x7fdf2006e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:32.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.472+0000 7fdf1dd9b640 1 --2- 172.21.15.46:0/3415500644 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf20109e10 0x7fdf2006e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:32.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.472+0000 7fdf1dd9b640 1 -- 172.21.15.46:0/3415500644 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf20101fe0 msgr2=0x7fdf20074e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:32.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.472+0000 7fdf1dd9b640 1 --2- 172.21.15.46:0/3415500644 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf20101fe0 0x7fdf20074e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:32.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.472+0000 7fdf1dd9b640 1 -- 172.21.15.46:0/3415500644 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf2006ee00 con 0x7fdf201094c0 2024-09-21T03:53:32.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.473+0000 7fdf1dd9b640 1 --2- 172.21.15.46:0/3415500644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf201094c0 0x7fdf2006e110 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fdf1400cce0 tx=0x7fdf1400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:32.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.473+0000 7fdf0f7fe640 1 -- 172.21.15.46:0/3415500644 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1400f450 con 0x7fdf201094c0 2024-09-21T03:53:32.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.473+0000 7fdf24fa4640 1 -- 172.21.15.46:0/3415500644 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf20073ab0 con 0x7fdf201094c0 2024-09-21T03:53:32.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.473+0000 7fdf0f7fe640 1 -- 172.21.15.46:0/3415500644 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf1400faa0 con 0x7fdf201094c0 2024-09-21T03:53:32.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.473+0000 7fdf0f7fe640 1 -- 172.21.15.46:0/3415500644 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf14018b70 con 0x7fdf201094c0 2024-09-21T03:53:32.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.473+0000 7fdf24fa4640 1 -- 172.21.15.46:0/3415500644 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf20073fc0 con 0x7fdf201094c0 2024-09-21T03:53:32.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.474+0000 7fdf24fa4640 1 -- 172.21.15.46:0/3415500644 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf201023f0 con 0x7fdf201094c0 2024-09-21T03:53:32.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.477+0000 7fdf0f7fe640 1 -- 172.21.15.46:0/3415500644 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fdf14018d10 con 0x7fdf201094c0 2024-09-21T03:53:32.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.478+0000 7fdf0f7fe640 1 --2- 172.21.15.46:0/3415500644 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fdf080b65f0 0x7fdf080b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:32.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.478+0000 7fdf1e59c640 1 --2- 172.21.15.46:0/3415500644 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fdf080b65f0 0x7fdf080b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:32.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.478+0000 7fdf0f7fe640 1 -- 172.21.15.46:0/3415500644 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8368+0+0 (secure 0 0 0) 0x7fdf140e7b10 con 0x7fdf201094c0 2024-09-21T03:53:32.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.478+0000 7fdf1e59c640 1 --2- 172.21.15.46:0/3415500644 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fdf080b65f0 0x7fdf080b8b00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdf10031440 tx=0x7fdf10005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:32.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.481+0000 7fdf0f7fe640 1 -- 172.21.15.46:0/3415500644 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdf14055710 con 0x7fdf201094c0 2024-09-21T03:53:32.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.699+0000 7fdf24fa4640 1 -- 172.21.15.46:0/3415500644 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fdf2010b7b0 con 0x7fdf080b65f0 2024-09-21T03:53:32.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.703+0000 7fdf0f7fe640 1 -- 172.21.15.46:0/3415500644 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fdf2010b7b0 con 0x7fdf080b65f0 2024-09-21T03:53:32.706 INFO:teuthology.orchestra.run.smithi046.stdout:/volumes/qa/sv_1/efeca3cd-c7ed-440d-b824-950247d10374 2024-09-21T03:53:32.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.706+0000 7fdf24fa4640 1 -- 172.21.15.46:0/3415500644 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fdf080b65f0 msgr2=0x7fdf080b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:32.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.706+0000 7fdf24fa4640 1 --2- 172.21.15.46:0/3415500644 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fdf080b65f0 0x7fdf080b8b00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdf10031440 tx=0x7fdf10005e80 comp rx=0 tx=0).stop 2024-09-21T03:53:32.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.706+0000 7fdf24fa4640 1 -- 172.21.15.46:0/3415500644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf201094c0 msgr2=0x7fdf2006e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:32.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.706+0000 7fdf24fa4640 1 --2- 172.21.15.46:0/3415500644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf201094c0 0x7fdf2006e110 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fdf1400cce0 tx=0x7fdf1400a620 comp rx=0 tx=0).stop 2024-09-21T03:53:32.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.706+0000 7fdf24fa4640 1 -- 172.21.15.46:0/3415500644 shutdown_connections 2024-09-21T03:53:32.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.706+0000 7fdf24fa4640 1 --2- 172.21.15.46:0/3415500644 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fdf080b65f0 0x7fdf080b8b00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:32.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.706+0000 7fdf24fa4640 1 --2- 172.21.15.46:0/3415500644 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf20109e10 0x7fdf2006e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:32.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.706+0000 7fdf24fa4640 1 --2- 172.21.15.46:0/3415500644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf201094c0 0x7fdf2006e110 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:32.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.706+0000 7fdf24fa4640 1 --2- 172.21.15.46:0/3415500644 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf20101fe0 0x7fdf20074e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:32.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.706+0000 7fdf24fa4640 1 -- 172.21.15.46:0/3415500644 >> 172.21.15.46:0/3415500644 conn(0x7fdf20077bc0 msgr2=0x7fdf201075b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:32.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.706+0000 7fdf24fa4640 1 -- 172.21.15.46:0/3415500644 shutdown_connections 2024-09-21T03:53:32.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:32.706+0000 7fdf24fa4640 1 -- 172.21.15.46:0/3415500644 wait complete. 2024-09-21T03:53:33.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:33 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-21T03:53:33.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:33 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-21T03:53:33.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:33 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-09-21T03:53:33.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:33 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-09-21T03:53:33.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:33 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-09-21T03:53:33.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:33 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-21T03:53:33.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:33 smithi105 ceph-mon[34773]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T03:53:33.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:33 smithi105 ceph-mon[34773]: pgmap v274: 97 pgs: 97 active+clean; 601 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3.0 KiB/s wr, 3 op/s 2024-09-21T03:53:33.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:33 smithi105 ceph-mon[34773]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:33.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:33 smithi105 ceph-mon[34773]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T03:53:33.364 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:33 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-21T03:53:33.364 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:33 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-21T03:53:33.364 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:33 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-09-21T03:53:33.364 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:33 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-09-21T03:53:33.364 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:33 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-09-21T03:53:33.364 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:33 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-21T03:53:33.364 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:33 smithi046 ceph-mon[30954]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T03:53:33.364 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:33 smithi046 ceph-mon[30954]: pgmap v274: 97 pgs: 97 active+clean; 601 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3.0 KiB/s wr, 3 op/s 2024-09-21T03:53:33.364 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:33 smithi046 ceph-mon[30954]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:33.364 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:33 smithi046 ceph-mon[30954]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T03:53:33.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:33 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-21T03:53:33.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:33 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-21T03:53:33.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:33 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-09-21T03:53:33.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:33 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-09-21T03:53:33.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:33 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-09-21T03:53:33.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:33 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-21T03:53:33.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:33 smithi162 ceph-mon[35071]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T03:53:33.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:33 smithi162 ceph-mon[35071]: pgmap v274: 97 pgs: 97 active+clean; 601 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3.0 KiB/s wr, 3 op/s 2024-09-21T03:53:33.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:33 smithi162 ceph-mon[35071]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:33.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:33 smithi162 ceph-mon[35071]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T03:53:33.394 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:53:33.654 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:34.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.102+0000 7f7838c1c640 1 -- 172.21.15.46:0/2441979120 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7834108d10 msgr2=0x7f783410f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:34.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.102+0000 7f7838c1c640 1 --2- 172.21.15.46:0/2441979120 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7834108d10 0x7f783410f540 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f782c009900 tx=0x7f782c02a410 comp rx=0 tx=0).stop 2024-09-21T03:53:34.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.102+0000 7f7838c1c640 1 -- 172.21.15.46:0/2441979120 shutdown_connections 2024-09-21T03:53:34.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.102+0000 7f7838c1c640 1 --2- 172.21.15.46:0/2441979120 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7834108d10 0x7f783410f540 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:34.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.102+0000 7f7838c1c640 1 --2- 172.21.15.46:0/2441979120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78341083c0 0x7f78341087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:34.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.102+0000 7f7838c1c640 1 --2- 172.21.15.46:0/2441979120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7834102a80 0x7f7834102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:34.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.102+0000 7f7838c1c640 1 -- 172.21.15.46:0/2441979120 >> 172.21.15.46:0/2441979120 conn(0x7f7834079740 msgr2=0x7f7834079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:34.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.102+0000 7f7838c1c640 1 -- 172.21.15.46:0/2441979120 shutdown_connections 2024-09-21T03:53:34.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.102+0000 7f7838c1c640 1 -- 172.21.15.46:0/2441979120 wait complete. 2024-09-21T03:53:34.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.103+0000 7f7838c1c640 1 Processor -- start 2024-09-21T03:53:34.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.103+0000 7f7838c1c640 1 -- start start 2024-09-21T03:53:34.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.103+0000 7f7838c1c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7834102a80 0x7f783419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:34.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.103+0000 7f7838c1c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78341083c0 0x7f783419aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:34.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.103+0000 7f7838c1c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7834108d10 0x7f783419fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:34.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.103+0000 7f7838c1c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7834113ad0 con 0x7f7834102a80 2024-09-21T03:53:34.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.103+0000 7f7838c1c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7834113950 con 0x7f78341083c0 2024-09-21T03:53:34.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.103+0000 7f7838c1c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7834113c50 con 0x7f7834108d10 2024-09-21T03:53:34.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.103+0000 7f783259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7834102a80 0x7f783419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:34.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.103+0000 7f783259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7834102a80 0x7f783419a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37508/0 (socket says 172.21.15.46:37508) 2024-09-21T03:53:34.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.103+0000 7f783259c640 1 -- 172.21.15.46:0/3064596339 learned_addr learned my addr 172.21.15.46:0/3064596339 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:53:34.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.103+0000 7f7831d9b640 1 --2- 172.21.15.46:0/3064596339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78341083c0 0x7f783419aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:34.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.103+0000 7f7832d9d640 1 --2- 172.21.15.46:0/3064596339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7834108d10 0x7f783419fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:34.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.103+0000 7f783259c640 1 -- 172.21.15.46:0/3064596339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7834108d10 msgr2=0x7f783419fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:34.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.103+0000 7f783259c640 1 --2- 172.21.15.46:0/3064596339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7834108d10 0x7f783419fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:34.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.103+0000 7f783259c640 1 -- 172.21.15.46:0/3064596339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78341083c0 msgr2=0x7f783419aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:34.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.103+0000 7f783259c640 1 --2- 172.21.15.46:0/3064596339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78341083c0 0x7f783419aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:34.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.103+0000 7f783259c640 1 -- 172.21.15.46:0/3064596339 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78341a03f0 con 0x7f7834102a80 2024-09-21T03:53:34.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.104+0000 7f783259c640 1 --2- 172.21.15.46:0/3064596339 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7834102a80 0x7f783419a480 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f782400d950 tx=0x7f782400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:34.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.104+0000 7f78237fe640 1 -- 172.21.15.46:0/3064596339 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7824017070 con 0x7f7834102a80 2024-09-21T03:53:34.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.104+0000 7f78237fe640 1 -- 172.21.15.46:0/3064596339 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7824009c30 con 0x7f7834102a80 2024-09-21T03:53:34.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.104+0000 7f7838c1c640 1 -- 172.21.15.46:0/3064596339 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78341a06e0 con 0x7f7834102a80 2024-09-21T03:53:34.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.104+0000 7f78237fe640 1 -- 172.21.15.46:0/3064596339 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782400f620 con 0x7f7834102a80 2024-09-21T03:53:34.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.104+0000 7f7838c1c640 1 -- 172.21.15.46:0/3064596339 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78341a6e40 con 0x7f7834102a80 2024-09-21T03:53:34.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.105+0000 7f7838c1c640 1 -- 172.21.15.46:0/3064596339 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7834103d00 con 0x7f7834102a80 2024-09-21T03:53:34.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.106+0000 7f78237fe640 1 -- 172.21.15.46:0/3064596339 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f7824005030 con 0x7f7834102a80 2024-09-21T03:53:34.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.107+0000 7f78237fe640 1 --2- 172.21.15.46:0/3064596339 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f781c0b65f0 0x7f781c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:34.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.107+0000 7f7831d9b640 1 --2- 172.21.15.46:0/3064596339 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f781c0b65f0 0x7f781c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:34.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.107+0000 7f78237fe640 1 -- 172.21.15.46:0/3064596339 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f78240e7230 con 0x7f7834102a80 2024-09-21T03:53:34.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.108+0000 7f7831d9b640 1 --2- 172.21.15.46:0/3064596339 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f781c0b65f0 0x7f781c0b8b00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7828005c40 tx=0x7f7828005bd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:34.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.111+0000 7f78237fe640 1 -- 172.21.15.46:0/3064596339 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f78240ad8e0 con 0x7f7834102a80 2024-09-21T03:53:34.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.336+0000 7f7838c1c640 1 -- 172.21.15.46:0/3064596339 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7834102e90 con 0x7f7834102a80 2024-09-21T03:53:34.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.336+0000 7f78237fe640 1 -- 172.21.15.46:0/3064596339 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f7824009de0 con 0x7f7834102a80 2024-09-21T03:53:34.339 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:53:34.339 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"btime":"2024-09-21T03:53:23:865820+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1766354184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1766354184},{"type":"v1","addr":"172.21.15.46:6839","nonce":1766354184}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/1901774207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":1901774207},{"type":"v1","addr":"172.21.15.46:6841","nonce":1901774207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3548633196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":3548633196},{"type":"v1","addr":"172.21.15.105:6837","nonce":3548633196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24652,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3551934241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3551934241},{"type":"v1","addr":"172.21.15.162:6835","nonce":3551934241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/48949822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":48949822},{"type":"v1","addr":"172.21.15.162:6837","nonce":48949822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:53:14.452819+0000","modified":"2024-09-21T03:53:23.593278+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24680},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/2196053213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2196053213},{"type":"v1","addr":"172.21.15.162:6839","nonce":2196053213}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.105:6839/3911438406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":3911438406},{"type":"v1","addr":"172.21.15.105:6839","nonce":3911438406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24680,"qdb_cluster":[24680]},"id":1}]} 2024-09-21T03:53:34.339 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T03:53:34.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.339+0000 7f7838c1c640 1 -- 172.21.15.46:0/3064596339 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f781c0b65f0 msgr2=0x7f781c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:34.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.339+0000 7f7838c1c640 1 --2- 172.21.15.46:0/3064596339 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f781c0b65f0 0x7f781c0b8b00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7828005c40 tx=0x7f7828005bd0 comp rx=0 tx=0).stop 2024-09-21T03:53:34.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.339+0000 7f7838c1c640 1 -- 172.21.15.46:0/3064596339 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7834102a80 msgr2=0x7f783419a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:34.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.339+0000 7f7838c1c640 1 --2- 172.21.15.46:0/3064596339 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7834102a80 0x7f783419a480 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f782400d950 tx=0x7f782400de10 comp rx=0 tx=0).stop 2024-09-21T03:53:34.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.339+0000 7f7838c1c640 1 -- 172.21.15.46:0/3064596339 shutdown_connections 2024-09-21T03:53:34.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.339+0000 7f7838c1c640 1 --2- 172.21.15.46:0/3064596339 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f781c0b65f0 0x7f781c0b8b00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:34.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.339+0000 7f7838c1c640 1 --2- 172.21.15.46:0/3064596339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7834108d10 0x7f783419fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:34.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.339+0000 7f7838c1c640 1 --2- 172.21.15.46:0/3064596339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78341083c0 0x7f783419aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:34.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.339+0000 7f7838c1c640 1 --2- 172.21.15.46:0/3064596339 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7834102a80 0x7f783419a480 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:34.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.339+0000 7f7838c1c640 1 -- 172.21.15.46:0/3064596339 >> 172.21.15.46:0/3064596339 conn(0x7f7834079740 msgr2=0x7f78341043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:34.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.339+0000 7f7838c1c640 1 -- 172.21.15.46:0/3064596339 shutdown_connections 2024-09-21T03:53:34.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:34.339+0000 7f7838c1c640 1 -- 172.21.15.46:0/3064596339 wait complete. 2024-09-21T03:53:35.058 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T03:53:35.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:35 smithi105 ceph-mon[34773]: pgmap v276: 97 pgs: 1 peering, 96 active+clean; 622 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.6 KiB/s wr, 6 op/s 2024-09-21T03:53:35.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:35 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3064596339' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:53:35.322 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:35.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:35 smithi162 ceph-mon[35071]: pgmap v276: 97 pgs: 1 peering, 96 active+clean; 622 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.6 KiB/s wr, 6 op/s 2024-09-21T03:53:35.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:35 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3064596339' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:53:35.443 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:35 smithi046 ceph-mon[30954]: pgmap v276: 97 pgs: 1 peering, 96 active+clean; 622 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.6 KiB/s wr, 6 op/s 2024-09-21T03:53:35.443 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:35 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3064596339' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:53:35.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.842+0000 7fa3f474e640 1 -- 172.21.15.46:0/3985826756 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3ec1051c0 msgr2=0x7fa3ec1055d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:35.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.842+0000 7fa3f474e640 1 --2- 172.21.15.46:0/3985826756 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3ec1051c0 0x7fa3ec1055d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc009900 tx=0x7fa3dc02a410 comp rx=0 tx=0).stop 2024-09-21T03:53:35.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.842+0000 7fa3f474e640 1 -- 172.21.15.46:0/3985826756 shutdown_connections 2024-09-21T03:53:35.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.842+0000 7fa3f474e640 1 --2- 172.21.15.46:0/3985826756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3ec105b10 0x7fa3ec10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:35.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.842+0000 7fa3f474e640 1 --2- 172.21.15.46:0/3985826756 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3ec1051c0 0x7fa3ec1055d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:35.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.842+0000 7fa3f474e640 1 --2- 172.21.15.46:0/3985826756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3ec1031f0 0x7fa3ec103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:35.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.842+0000 7fa3f474e640 1 -- 172.21.15.46:0/3985826756 >> 172.21.15.46:0/3985826756 conn(0x7fa3ec079e40 msgr2=0x7fa3ec07a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:35.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.842+0000 7fa3f474e640 1 -- 172.21.15.46:0/3985826756 shutdown_connections 2024-09-21T03:53:35.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.842+0000 7fa3f474e640 1 -- 172.21.15.46:0/3985826756 wait complete. 2024-09-21T03:53:35.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.843+0000 7fa3f474e640 1 Processor -- start 2024-09-21T03:53:35.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.843+0000 7fa3f474e640 1 -- start start 2024-09-21T03:53:35.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.843+0000 7fa3f474e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3ec1031f0 0x7fa3ec19b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:35.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.843+0000 7fa3f474e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3ec1051c0 0x7fa3ec19b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:35.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.843+0000 7fa3f474e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3ec105b10 0x7fa3ec19bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:35.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.843+0000 7fa3f474e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ec1129e0 con 0x7fa3ec1031f0 2024-09-21T03:53:35.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.843+0000 7fa3f474e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ec112860 con 0x7fa3ec1051c0 2024-09-21T03:53:35.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.843+0000 7fa3f474e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ec112b60 con 0x7fa3ec105b10 2024-09-21T03:53:35.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.843+0000 7fa3f24ea640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3ec1031f0 0x7fa3ec19b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:35.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.843+0000 7fa3f24ea640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3ec1031f0 0x7fa3ec19b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37524/0 (socket says 172.21.15.46:37524) 2024-09-21T03:53:35.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.843+0000 7fa3f24ea640 1 -- 172.21.15.46:0/244169378 learned_addr learned my addr 172.21.15.46:0/244169378 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:53:35.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.843+0000 7fa3f1ce9640 1 --2- 172.21.15.46:0/244169378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3ec1051c0 0x7fa3ec19b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:35.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.844+0000 7fa3f2ceb640 1 --2- 172.21.15.46:0/244169378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3ec105b10 0x7fa3ec19bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:35.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.844+0000 7fa3f24ea640 1 -- 172.21.15.46:0/244169378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3ec105b10 msgr2=0x7fa3ec19bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:35.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.844+0000 7fa3f24ea640 1 --2- 172.21.15.46:0/244169378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3ec105b10 0x7fa3ec19bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:35.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.844+0000 7fa3f24ea640 1 -- 172.21.15.46:0/244169378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3ec1051c0 msgr2=0x7fa3ec19b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:35.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.844+0000 7fa3f24ea640 1 --2- 172.21.15.46:0/244169378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3ec1051c0 0x7fa3ec19b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:35.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.844+0000 7fa3f24ea640 1 -- 172.21.15.46:0/244169378 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3ec1a6570 con 0x7fa3ec1031f0 2024-09-21T03:53:35.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.844+0000 7fa3f2ceb640 1 --2- 172.21.15.46:0/244169378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3ec105b10 0x7fa3ec19bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:53:35.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.844+0000 7fa3f24ea640 1 --2- 172.21.15.46:0/244169378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3ec1031f0 0x7fa3ec19b370 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa3e800d950 tx=0x7fa3e800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:35.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.844+0000 7fa3e37fe640 1 -- 172.21.15.46:0/244169378 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e8017020 con 0x7fa3ec1031f0 2024-09-21T03:53:35.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.844+0000 7fa3f474e640 1 -- 172.21.15.46:0/244169378 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3ec1a6860 con 0x7fa3ec1031f0 2024-09-21T03:53:35.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.844+0000 7fa3e37fe640 1 -- 172.21.15.46:0/244169378 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3e8009c30 con 0x7fa3ec1031f0 2024-09-21T03:53:35.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.844+0000 7fa3e37fe640 1 -- 172.21.15.46:0/244169378 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e800f6b0 con 0x7fa3ec1031f0 2024-09-21T03:53:35.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.844+0000 7fa3f474e640 1 -- 172.21.15.46:0/244169378 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3ec1a6d70 con 0x7fa3ec1031f0 2024-09-21T03:53:35.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.845+0000 7fa3f474e640 1 -- 172.21.15.46:0/244169378 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3ec103600 con 0x7fa3ec1031f0 2024-09-21T03:53:35.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.847+0000 7fa3e37fe640 1 -- 172.21.15.46:0/244169378 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fa3e801a020 con 0x7fa3ec1031f0 2024-09-21T03:53:35.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.848+0000 7fa3e37fe640 1 --2- 172.21.15.46:0/244169378 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa3d80b6620 0x7fa3d80b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:35.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.848+0000 7fa3f1ce9640 1 --2- 172.21.15.46:0/244169378 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa3d80b6620 0x7fa3d80b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:35.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.848+0000 7fa3e37fe640 1 -- 172.21.15.46:0/244169378 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fa3e80e71e0 con 0x7fa3ec1031f0 2024-09-21T03:53:35.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.848+0000 7fa3f1ce9640 1 --2- 172.21.15.46:0/244169378 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa3d80b6620 0x7fa3d80b8b30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc005940 tx=0x7fa3dc0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:35.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:35.852+0000 7fa3e37fe640 1 -- 172.21.15.46:0/244169378 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa3e8021070 con 0x7fa3ec1031f0 2024-09-21T03:53:36.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:36.040+0000 7fa3f474e640 1 -- 172.21.15.46:0/244169378 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa3ec102260 con 0x7fa3ec1031f0 2024-09-21T03:53:36.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:36.041+0000 7fa3e37fe640 1 -- 172.21.15.46:0/244169378 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22876 (secure 0 0 0) 0x7fa3e80ad890 con 0x7fa3ec1031f0 2024-09-21T03:53:36.044 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:53:36.044 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":77,"fsid":"a82de5ec-77cb-11ef-baf5-efdc52797490","created":"2024-09-21T03:44:31.512271+0000","modified":"2024-09-21T03:53:33.028150+0000","last_up_change":"2024-09-21T03:52:22.609789+0000","last_in_change":"2024-09-21T03:51:58.812316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:48:30.407205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:53:09.943833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:53:12.521980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ff9e1a8-fec7-422c-b594-880efe4684f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6803","nonce":791989880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6805","nonce":791989880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6809","nonce":791989880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6807","nonce":791989880}]},"public_addr":"172.21.15.46:6803/791989880","cluster_addr":"172.21.15.46:6805/791989880","heartbeat_back_addr":"172.21.15.46:6809/791989880","heartbeat_front_addr":"172.21.15.46:6807/791989880","state":["exists","up"]},{"osd":1,"uuid":"3df1bee7-615e-44d0-bd43-2370db6cd06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6801","nonce":1123652172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6803","nonce":1123652172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6807","nonce":1123652172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6805","nonce":1123652172}]},"public_addr":"172.21.15.105:6801/1123652172","cluster_addr":"172.21.15.105:6803/1123652172","heartbeat_back_addr":"172.21.15.105:6807/1123652172","heartbeat_front_addr":"172.21.15.105:6805/1123652172","state":["exists","up"]},{"osd":2,"uuid":"52d0e57f-cfca-447a-8a57-b1d5364cb4d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6801","nonce":34930776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6803","nonce":34930776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6807","nonce":34930776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6805","nonce":34930776}]},"public_addr":"172.21.15.162:6801/34930776","cluster_addr":"172.21.15.162:6803/34930776","heartbeat_back_addr":"172.21.15.162:6807/34930776","heartbeat_front_addr":"172.21.15.162:6805/34930776","state":["exists","up"]},{"osd":3,"uuid":"6f25f721-fc50-4b80-944b-d3df28e7a2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6811","nonce":1355580104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6813","nonce":1355580104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6817","nonce":1355580104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6815","nonce":1355580104}]},"public_addr":"172.21.15.46:6811/1355580104","cluster_addr":"172.21.15.46:6813/1355580104","heartbeat_back_addr":"172.21.15.46:6817/1355580104","heartbeat_front_addr":"172.21.15.46:6815/1355580104","state":["exists","up"]},{"osd":4,"uuid":"c2f41084-e5a1-4b5f-b799-a84b38da63a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6809","nonce":3566174660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6811","nonce":3566174660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6815","nonce":3566174660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6813","nonce":3566174660}]},"public_addr":"172.21.15.105:6809/3566174660","cluster_addr":"172.21.15.105:6811/3566174660","heartbeat_back_addr":"172.21.15.105:6815/3566174660","heartbeat_front_addr":"172.21.15.105:6813/3566174660","state":["exists","up"]},{"osd":5,"uuid":"b433d03b-fae8-4ece-b967-a8af91bc3ab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6809","nonce":3043419818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6811","nonce":3043419818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6815","nonce":3043419818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6813","nonce":3043419818}]},"public_addr":"172.21.15.162:6809/3043419818","cluster_addr":"172.21.15.162:6811/3043419818","heartbeat_back_addr":"172.21.15.162:6815/3043419818","heartbeat_front_addr":"172.21.15.162:6813/3043419818","state":["exists","up"]},{"osd":6,"uuid":"e6b5ce54-69aa-4811-9ca3-cab50525a175","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6819","nonce":1615361645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6821","nonce":1615361645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6825","nonce":1615361645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6823","nonce":1615361645}]},"public_addr":"172.21.15.46:6819/1615361645","cluster_addr":"172.21.15.46:6821/1615361645","heartbeat_back_addr":"172.21.15.46:6825/1615361645","heartbeat_front_addr":"172.21.15.46:6823/1615361645","state":["exists","up"]},{"osd":7,"uuid":"a6e89d5d-ce31-4e0c-9019-5eb13b134feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6817","nonce":1015687379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6819","nonce":1015687379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6823","nonce":1015687379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6821","nonce":1015687379}]},"public_addr":"172.21.15.105:6817/1015687379","cluster_addr":"172.21.15.105:6819/1015687379","heartbeat_back_addr":"172.21.15.105:6823/1015687379","heartbeat_front_addr":"172.21.15.105:6821/1015687379","state":["exists","up"]},{"osd":8,"uuid":"27b2ccec-65be-47b3-a924-c5939ba1cb5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6817","nonce":3441747512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6819","nonce":3441747512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6823","nonce":3441747512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6821","nonce":3441747512}]},"public_addr":"172.21.15.162:6817/3441747512","cluster_addr":"172.21.15.162:6819/3441747512","heartbeat_back_addr":"172.21.15.162:6823/3441747512","heartbeat_front_addr":"172.21.15.162:6821/3441747512","state":["exists","up"]},{"osd":9,"uuid":"3f7cb70c-73c7-48e8-a32b-7445eda2126d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6827","nonce":382230768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6829","nonce":382230768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6833","nonce":382230768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6831","nonce":382230768}]},"public_addr":"172.21.15.46:6827/382230768","cluster_addr":"172.21.15.46:6829/382230768","heartbeat_back_addr":"172.21.15.46:6833/382230768","heartbeat_front_addr":"172.21.15.46:6831/382230768","state":["exists","up"]},{"osd":10,"uuid":"76c3da87-f3c5-4985-87fd-647717b6af85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6825","nonce":1664619099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6827","nonce":1664619099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6831","nonce":1664619099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6829","nonce":1664619099}]},"public_addr":"172.21.15.105:6825/1664619099","cluster_addr":"172.21.15.105:6827/1664619099","heartbeat_back_addr":"172.21.15.105:6831/1664619099","heartbeat_front_addr":"172.21.15.105:6829/1664619099","state":["exists","up"]},{"osd":11,"uuid":"13269da8-5f05-4ce2-9c7a-6dd9c1041cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6825","nonce":1014820476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6827","nonce":1014820476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6831","nonce":1014820476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6829","nonce":1014820476}]},"public_addr":"172.21.15.162:6825/1014820476","cluster_addr":"172.21.15.162:6827/1014820476","heartbeat_back_addr":"172.21.15.162:6831/1014820476","heartbeat_front_addr":"172.21.15.162:6829/1014820476","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:47:38.630436+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:03.441596+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:28.647341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:54.270316+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:49:19.783873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:49:45.344485+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:50:12.165326+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:50:38.095996+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:03.814612+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:29.469718+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:55.407340+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:52:20.360243+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:6801/878116252":"2024-09-22T03:46:31.942086+0000","172.21.15.46:6800/878116252":"2024-09-22T03:46:31.942086+0000","172.21.15.46:0/3574041742":"2024-09-22T03:45:05.097136+0000","172.21.15.46:6801/1185001582":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/2839831446":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/3423884605":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/2761976928":"2024-09-22T03:46:31.942086+0000","172.21.15.46:0/1149961133":"2024-09-22T03:45:05.097136+0000","172.21.15.46:6800/1185001582":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/641493295":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/4033661287":"2024-09-22T03:45:31.101657+0000","172.21.15.46:6800/2733048710":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/3972416280":"2024-09-22T03:46:31.942086+0000","172.21.15.46:6801/2733048710":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/1662975018":"2024-09-22T03:46:31.942086+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:53:36.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:36.044+0000 7fa3f474e640 1 -- 172.21.15.46:0/244169378 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa3d80b6620 msgr2=0x7fa3d80b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:36.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:36.044+0000 7fa3f474e640 1 --2- 172.21.15.46:0/244169378 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa3d80b6620 0x7fa3d80b8b30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc005940 tx=0x7fa3dc0058d0 comp rx=0 tx=0).stop 2024-09-21T03:53:36.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:36.044+0000 7fa3f474e640 1 -- 172.21.15.46:0/244169378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3ec1031f0 msgr2=0x7fa3ec19b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:36.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:36.044+0000 7fa3f474e640 1 --2- 172.21.15.46:0/244169378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3ec1031f0 0x7fa3ec19b370 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa3e800d950 tx=0x7fa3e800de10 comp rx=0 tx=0).stop 2024-09-21T03:53:36.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:36.044+0000 7fa3f474e640 1 -- 172.21.15.46:0/244169378 shutdown_connections 2024-09-21T03:53:36.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:36.044+0000 7fa3f474e640 1 --2- 172.21.15.46:0/244169378 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa3d80b6620 0x7fa3d80b8b30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:36.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:36.044+0000 7fa3f474e640 1 --2- 172.21.15.46:0/244169378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3ec105b10 0x7fa3ec19bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:36.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:36.044+0000 7fa3f474e640 1 --2- 172.21.15.46:0/244169378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3ec1051c0 0x7fa3ec19b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:36.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:36.044+0000 7fa3f474e640 1 --2- 172.21.15.46:0/244169378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3ec1031f0 0x7fa3ec19b370 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:36.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:36.044+0000 7fa3f474e640 1 -- 172.21.15.46:0/244169378 >> 172.21.15.46:0/244169378 conn(0x7fa3ec079e40 msgr2=0x7fa3ec1064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:36.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:36.044+0000 7fa3f474e640 1 -- 172.21.15.46:0/244169378 shutdown_connections 2024-09-21T03:53:36.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:36.044+0000 7fa3f474e640 1 -- 172.21.15.46:0/244169378 wait complete. 2024-09-21T03:53:36.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:36 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/244169378' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:53:36.355 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:36 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/244169378' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:53:36.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:36 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/244169378' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:53:36.686 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T03:53:36.686 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T03:53:36.943 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:37.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:37 smithi105 ceph-mon[34773]: pgmap v277: 97 pgs: 1 peering, 96 active+clean; 622 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 2 op/s 2024-09-21T03:53:37.322 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:37 smithi046 ceph-mon[30954]: pgmap v277: 97 pgs: 1 peering, 96 active+clean; 622 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 2 op/s 2024-09-21T03:53:37.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:37 smithi162 ceph-mon[35071]: pgmap v277: 97 pgs: 1 peering, 96 active+clean; 622 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 2 op/s 2024-09-21T03:53:37.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.412+0000 7f85623a1640 1 -- 172.21.15.46:0/2918937117 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f855c1092d0 msgr2=0x7f855c1096e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:37.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.412+0000 7f85623a1640 1 --2- 172.21.15.46:0/2918937117 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f855c1092d0 0x7f855c1096e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f854c009900 tx=0x7f854c02a410 comp rx=0 tx=0).stop 2024-09-21T03:53:37.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.412+0000 7f85623a1640 1 -- 172.21.15.46:0/2918937117 shutdown_connections 2024-09-21T03:53:37.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.412+0000 7f85623a1640 1 --2- 172.21.15.46:0/2918937117 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f855c109c20 0x7f855c110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:37.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.412+0000 7f85623a1640 1 --2- 172.21.15.46:0/2918937117 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f855c1092d0 0x7f855c1096e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:37.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.412+0000 7f85623a1640 1 --2- 172.21.15.46:0/2918937117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f855c103990 0x7f855c103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:37.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.412+0000 7f85623a1640 1 -- 172.21.15.46:0/2918937117 >> 172.21.15.46:0/2918937117 conn(0x7f855c0ff3e0 msgr2=0x7f855c101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:37.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.412+0000 7f85623a1640 1 -- 172.21.15.46:0/2918937117 shutdown_connections 2024-09-21T03:53:37.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.412+0000 7f85623a1640 1 -- 172.21.15.46:0/2918937117 wait complete. 2024-09-21T03:53:37.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.412+0000 7f85623a1640 1 Processor -- start 2024-09-21T03:53:37.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.412+0000 7f85623a1640 1 -- start start 2024-09-21T03:53:37.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.413+0000 7f85623a1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f855c103990 0x7f855c19a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:37.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.413+0000 7f85623a1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f855c1092d0 0x7f855c19a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:37.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.413+0000 7f85623a1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f855c109c20 0x7f855c19fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:37.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.413+0000 7f85623a1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f855c1138e0 con 0x7f855c109c20 2024-09-21T03:53:37.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.413+0000 7f85623a1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f855c113760 con 0x7f855c1092d0 2024-09-21T03:53:37.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.413+0000 7f85623a1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f855c113a60 con 0x7f855c103990 2024-09-21T03:53:37.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.413+0000 7f8561ba0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f855c109c20 0x7f855c19fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:37.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.413+0000 7f8561ba0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f855c109c20 0x7f855c19fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37544/0 (socket says 172.21.15.46:37544) 2024-09-21T03:53:37.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.413+0000 7f8561ba0640 1 -- 172.21.15.46:0/2677086963 learned_addr learned my addr 172.21.15.46:0/2677086963 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:53:37.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.413+0000 7f856139f640 1 --2- 172.21.15.46:0/2677086963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f855c103990 0x7f855c19a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:37.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.413+0000 7f8560b9e640 1 --2- 172.21.15.46:0/2677086963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f855c1092d0 0x7f855c19a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:37.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.413+0000 7f8561ba0640 1 -- 172.21.15.46:0/2677086963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f855c103990 msgr2=0x7f855c19a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:37.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.413+0000 7f8561ba0640 1 --2- 172.21.15.46:0/2677086963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f855c103990 0x7f855c19a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:37.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.413+0000 7f8561ba0640 1 -- 172.21.15.46:0/2677086963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f855c1092d0 msgr2=0x7f855c19a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:37.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.413+0000 7f8561ba0640 1 --2- 172.21.15.46:0/2677086963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f855c1092d0 0x7f855c19a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:37.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.413+0000 7f8561ba0640 1 -- 172.21.15.46:0/2677086963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f855c1a0280 con 0x7f855c109c20 2024-09-21T03:53:37.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.413+0000 7f8561ba0640 1 --2- 172.21.15.46:0/2677086963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f855c109c20 0x7f855c19fb50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f855400eb10 tx=0x7f855400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:37.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.414+0000 7f85527fc640 1 -- 172.21.15.46:0/2677086963 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8554004b20 con 0x7f855c109c20 2024-09-21T03:53:37.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.414+0000 7f85527fc640 1 -- 172.21.15.46:0/2677086963 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8554004cc0 con 0x7f855c109c20 2024-09-21T03:53:37.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.414+0000 7f85623a1640 1 -- 172.21.15.46:0/2677086963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f855c1a0570 con 0x7f855c109c20 2024-09-21T03:53:37.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.414+0000 7f85527fc640 1 -- 172.21.15.46:0/2677086963 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8554010670 con 0x7f855c109c20 2024-09-21T03:53:37.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.414+0000 7f85623a1640 1 -- 172.21.15.46:0/2677086963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f855c1a6cd0 con 0x7f855c109c20 2024-09-21T03:53:37.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.415+0000 7f85623a1640 1 -- 172.21.15.46:0/2677086963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f855c103da0 con 0x7f855c109c20 2024-09-21T03:53:37.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.416+0000 7f85527fc640 1 -- 172.21.15.46:0/2677086963 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f8554005000 con 0x7f855c109c20 2024-09-21T03:53:37.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.417+0000 7f85527fc640 1 --2- 172.21.15.46:0/2677086963 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f85480b65f0 0x7f85480b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:37.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.417+0000 7f856139f640 1 --2- 172.21.15.46:0/2677086963 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f85480b65f0 0x7f85480b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:37.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.418+0000 7f85527fc640 1 -- 172.21.15.46:0/2677086963 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f85540e7d40 con 0x7f855c109c20 2024-09-21T03:53:37.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.418+0000 7f856139f640 1 --2- 172.21.15.46:0/2677086963 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f85480b65f0 0x7f85480b8b00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8558005d00 tx=0x7f8558005c50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:37.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.421+0000 7f85527fc640 1 -- 172.21.15.46:0/2677086963 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8554056710 con 0x7f855c109c20 2024-09-21T03:53:37.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.610+0000 7f85623a1640 1 -- 172.21.15.46:0/2677086963 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f855c063800 con 0x7f85480b65f0 2024-09-21T03:53:37.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.616+0000 7f85527fc640 1 -- 172.21.15.46:0/2677086963 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258786 (secure 0 0 0) 0x7f855c063800 con 0x7f85480b65f0 2024-09-21T03:53:37.621 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:53:37.622 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-09-21T03:53:37.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.620+0000 7f85623a1640 1 -- 172.21.15.46:0/2677086963 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f85480b65f0 msgr2=0x7f85480b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:37.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.620+0000 7f85623a1640 1 --2- 172.21.15.46:0/2677086963 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f85480b65f0 0x7f85480b8b00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8558005d00 tx=0x7f8558005c50 comp rx=0 tx=0).stop 2024-09-21T03:53:37.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.620+0000 7f85623a1640 1 -- 172.21.15.46:0/2677086963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f855c109c20 msgr2=0x7f855c19fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:37.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.620+0000 7f85623a1640 1 --2- 172.21.15.46:0/2677086963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f855c109c20 0x7f855c19fb50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f855400eb10 tx=0x7f855400c2d0 comp rx=0 tx=0).stop 2024-09-21T03:53:37.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.620+0000 7f85623a1640 1 -- 172.21.15.46:0/2677086963 shutdown_connections 2024-09-21T03:53:37.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.620+0000 7f85623a1640 1 --2- 172.21.15.46:0/2677086963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f855c109c20 0x7f855c19fb50 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:37.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.620+0000 7f85623a1640 1 --2- 172.21.15.46:0/2677086963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f855c1092d0 0x7f855c19a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:37.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.620+0000 7f85623a1640 1 --2- 172.21.15.46:0/2677086963 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f85480b65f0 0x7f85480b8b00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:37.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.620+0000 7f85623a1640 1 --2- 172.21.15.46:0/2677086963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f855c103990 0x7f855c19a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:37.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.620+0000 7f85623a1640 1 -- 172.21.15.46:0/2677086963 >> 172.21.15.46:0/2677086963 conn(0x7f855c0ff3e0 msgr2=0x7f855c101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:37.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.620+0000 7f85623a1640 1 -- 172.21.15.46:0/2677086963 shutdown_connections 2024-09-21T03:53:37.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:37.620+0000 7f85623a1640 1 -- 172.21.15.46:0/2677086963 wait complete. 2024-09-21T03:53:38.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:38 smithi046 ceph-mon[30954]: from='client.14961 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:53:38.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:38 smithi105 ceph-mon[34773]: from='client.14961 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:53:38.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:38 smithi162 ceph-mon[35071]: from='client.14961 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:53:38.423 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":277,"stamp":"2024-09-21T03:53:36.037072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":636603,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":115,"num_read_kb":132,"num_write":189,"num_write_kb":2217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":293,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":380072,"kb_used_data":9968,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124561752,"statfs":{"total":1151940427776,"available":1151551234048,"internally_reserved":0,"allocated":10207232,"data_stored":6792073,"data_compressed":140541,"data_compressed_allocated":180224,"data_compressed_original":1859584,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":20920,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":42,"num_write":11,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002009"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034971+0000","last_change":"2024-09-21T03:53:13.835177+0000","last_active":"2024-09-21T03:53:33.034971+0000","last_peered":"2024-09-21T03:53:33.034971+0000","last_clean":"2024-09-21T03:53:33.034971+0000","last_became_active":"2024-09-21T03:53:13.834779+0000","last_became_peered":"2024-09-21T03:53:13.834779+0000","last_unstale":"2024-09-21T03:53:33.034971+0000","last_undegraded":"2024-09-21T03:53:33.034971+0000","last_fullsized":"2024-09-21T03:53:33.034971+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:10.632059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123205+0000","last_change":"2024-09-21T03:53:13.829689+0000","last_active":"2024-09-21T03:53:33.123205+0000","last_peered":"2024-09-21T03:53:33.123205+0000","last_clean":"2024-09-21T03:53:33.123205+0000","last_became_active":"2024-09-21T03:53:13.828732+0000","last_became_peered":"2024-09-21T03:53:13.828732+0000","last_unstale":"2024-09-21T03:53:33.123205+0000","last_undegraded":"2024-09-21T03:53:33.123205+0000","last_fullsized":"2024-09-21T03:53:33.123205+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:35.270218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123057+0000","last_change":"2024-09-21T03:53:13.836545+0000","last_active":"2024-09-21T03:53:33.123057+0000","last_peered":"2024-09-21T03:53:33.123057+0000","last_clean":"2024-09-21T03:53:33.123057+0000","last_became_active":"2024-09-21T03:53:13.835781+0000","last_became_peered":"2024-09-21T03:53:13.835781+0000","last_unstale":"2024-09-21T03:53:33.123057+0000","last_undegraded":"2024-09-21T03:53:33.123057+0000","last_fullsized":"2024-09-21T03:53:33.123057+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:13.130016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T03:53:32.031056+0000","last_change":"2024-09-21T03:53:13.832292+0000","last_active":"2024-09-21T03:53:32.031056+0000","last_peered":"2024-09-21T03:53:32.031056+0000","last_clean":"2024-09-21T03:53:32.031056+0000","last_became_active":"2024-09-21T03:53:13.831311+0000","last_became_peered":"2024-09-21T03:53:13.831311+0000","last_unstale":"2024-09-21T03:53:32.031056+0000","last_undegraded":"2024-09-21T03:53:32.031056+0000","last_fullsized":"2024-09-21T03:53:32.031056+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:38:49.425261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:53:14.826764+0000","last_change":"2024-09-21T03:53:13.825130+0000","last_active":"2024-09-21T03:53:14.826764+0000","last_peered":"2024-09-21T03:53:14.826764+0000","last_clean":"2024-09-21T03:53:14.826764+0000","last_became_active":"2024-09-21T03:53:13.824795+0000","last_became_peered":"2024-09-21T03:53:13.824795+0000","last_unstale":"2024-09-21T03:53:14.826764+0000","last_undegraded":"2024-09-21T03:53:14.826764+0000","last_fullsized":"2024-09-21T03:53:14.826764+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:22.653270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T03:53:32.035403+0000","last_change":"2024-09-21T03:53:13.834449+0000","last_active":"2024-09-21T03:53:32.035403+0000","last_peered":"2024-09-21T03:53:32.035403+0000","last_clean":"2024-09-21T03:53:32.035403+0000","last_became_active":"2024-09-21T03:53:13.832727+0000","last_became_peered":"2024-09-21T03:53:13.832727+0000","last_unstale":"2024-09-21T03:53:32.035403+0000","last_undegraded":"2024-09-21T03:53:32.035403+0000","last_fullsized":"2024-09-21T03:53:32.035403+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:36.479962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035845+0000","last_change":"2024-09-21T03:53:13.821938+0000","last_active":"2024-09-21T03:53:33.035845+0000","last_peered":"2024-09-21T03:53:33.035845+0000","last_clean":"2024-09-21T03:53:33.035845+0000","last_became_active":"2024-09-21T03:53:13.821569+0000","last_became_peered":"2024-09-21T03:53:13.821569+0000","last_unstale":"2024-09-21T03:53:33.035845+0000","last_undegraded":"2024-09-21T03:53:33.035845+0000","last_fullsized":"2024-09-21T03:53:33.035845+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:04.309212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:53:14.813328+0000","last_change":"2024-09-21T03:53:13.833471+0000","last_active":"2024-09-21T03:53:14.813328+0000","last_peered":"2024-09-21T03:53:14.813328+0000","last_clean":"2024-09-21T03:53:14.813328+0000","last_became_active":"2024-09-21T03:53:13.832779+0000","last_became_peered":"2024-09-21T03:53:13.832779+0000","last_unstale":"2024-09-21T03:53:14.813328+0000","last_undegraded":"2024-09-21T03:53:14.813328+0000","last_fullsized":"2024-09-21T03:53:14.813328+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:15.402265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032934+0000","last_change":"2024-09-21T03:53:13.833077+0000","last_active":"2024-09-21T03:53:33.032934+0000","last_peered":"2024-09-21T03:53:33.032934+0000","last_clean":"2024-09-21T03:53:33.032934+0000","last_became_active":"2024-09-21T03:53:13.832625+0000","last_became_peered":"2024-09-21T03:53:13.832625+0000","last_unstale":"2024-09-21T03:53:33.032934+0000","last_undegraded":"2024-09-21T03:53:33.032934+0000","last_fullsized":"2024-09-21T03:53:33.032934+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:13.158754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T03:53:32.036230+0000","last_change":"2024-09-21T03:53:13.835417+0000","last_active":"2024-09-21T03:53:32.036230+0000","last_peered":"2024-09-21T03:53:32.036230+0000","last_clean":"2024-09-21T03:53:32.036230+0000","last_became_active":"2024-09-21T03:53:13.835081+0000","last_became_peered":"2024-09-21T03:53:13.835081+0000","last_unstale":"2024-09-21T03:53:32.036230+0000","last_undegraded":"2024-09-21T03:53:32.036230+0000","last_fullsized":"2024-09-21T03:53:32.036230+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:29.239879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036187+0000","last_change":"2024-09-21T03:53:13.836575+0000","last_active":"2024-09-21T03:53:33.036187+0000","last_peered":"2024-09-21T03:53:33.036187+0000","last_clean":"2024-09-21T03:53:33.036187+0000","last_became_active":"2024-09-21T03:53:13.836184+0000","last_became_peered":"2024-09-21T03:53:13.836184+0000","last_unstale":"2024-09-21T03:53:33.036187+0000","last_undegraded":"2024-09-21T03:53:33.036187+0000","last_fullsized":"2024-09-21T03:53:33.036187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:06.602354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:53:14.814352+0000","last_change":"2024-09-21T03:53:13.832675+0000","last_active":"2024-09-21T03:53:14.814352+0000","last_peered":"2024-09-21T03:53:14.814352+0000","last_clean":"2024-09-21T03:53:14.814352+0000","last_became_active":"2024-09-21T03:53:13.831923+0000","last_became_peered":"2024-09-21T03:53:13.831923+0000","last_unstale":"2024-09-21T03:53:14.814352+0000","last_undegraded":"2024-09-21T03:53:14.814352+0000","last_fullsized":"2024-09-21T03:53:14.814352+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:41.065563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031708+0000","last_change":"2024-09-21T03:53:13.814729+0000","last_active":"2024-09-21T03:53:33.031708+0000","last_peered":"2024-09-21T03:53:33.031708+0000","last_clean":"2024-09-21T03:53:33.031708+0000","last_became_active":"2024-09-21T03:53:13.814317+0000","last_became_peered":"2024-09-21T03:53:13.814317+0000","last_unstale":"2024-09-21T03:53:33.031708+0000","last_undegraded":"2024-09-21T03:53:33.031708+0000","last_fullsized":"2024-09-21T03:53:33.031708+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:30.779754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122847+0000","last_change":"2024-09-21T03:53:13.833280+0000","last_active":"2024-09-21T03:53:33.122847+0000","last_peered":"2024-09-21T03:53:33.122847+0000","last_clean":"2024-09-21T03:53:33.122847+0000","last_became_active":"2024-09-21T03:53:13.831799+0000","last_became_peered":"2024-09-21T03:53:13.831799+0000","last_unstale":"2024-09-21T03:53:33.122847+0000","last_undegraded":"2024-09-21T03:53:33.122847+0000","last_fullsized":"2024-09-21T03:53:33.122847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:33.923946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122733+0000","last_change":"2024-09-21T03:53:13.832142+0000","last_active":"2024-09-21T03:53:33.122733+0000","last_peered":"2024-09-21T03:53:33.122733+0000","last_clean":"2024-09-21T03:53:33.122733+0000","last_became_active":"2024-09-21T03:53:13.831756+0000","last_became_peered":"2024-09-21T03:53:13.831756+0000","last_unstale":"2024-09-21T03:53:33.122733+0000","last_undegraded":"2024-09-21T03:53:33.122733+0000","last_fullsized":"2024-09-21T03:53:33.122733+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:43.941161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032362+0000","last_change":"2024-09-21T03:53:13.834085+0000","last_active":"2024-09-21T03:53:33.032362+0000","last_peered":"2024-09-21T03:53:33.032362+0000","last_clean":"2024-09-21T03:53:33.032362+0000","last_became_active":"2024-09-21T03:53:13.833668+0000","last_became_peered":"2024-09-21T03:53:13.833668+0000","last_unstale":"2024-09-21T03:53:33.032362+0000","last_undegraded":"2024-09-21T03:53:33.032362+0000","last_fullsized":"2024-09-21T03:53:33.032362+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:08:26.939873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035098+0000","last_change":"2024-09-21T03:53:13.836133+0000","last_active":"2024-09-21T03:53:33.035098+0000","last_peered":"2024-09-21T03:53:33.035098+0000","last_clean":"2024-09-21T03:53:33.035098+0000","last_became_active":"2024-09-21T03:53:13.835681+0000","last_became_peered":"2024-09-21T03:53:13.835681+0000","last_unstale":"2024-09-21T03:53:33.035098+0000","last_undegraded":"2024-09-21T03:53:33.035098+0000","last_fullsized":"2024-09-21T03:53:33.035098+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:02.691622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:53:14.828767+0000","last_change":"2024-09-21T03:53:13.834069+0000","last_active":"2024-09-21T03:53:14.828767+0000","last_peered":"2024-09-21T03:53:14.828767+0000","last_clean":"2024-09-21T03:53:14.828767+0000","last_became_active":"2024-09-21T03:53:13.833714+0000","last_became_peered":"2024-09-21T03:53:13.833714+0000","last_unstale":"2024-09-21T03:53:14.828767+0000","last_undegraded":"2024-09-21T03:53:14.828767+0000","last_fullsized":"2024-09-21T03:53:14.828767+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:12.479790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:53:14.816083+0000","last_change":"2024-09-21T03:53:13.827788+0000","last_active":"2024-09-21T03:53:14.816083+0000","last_peered":"2024-09-21T03:53:14.816083+0000","last_clean":"2024-09-21T03:53:14.816083+0000","last_became_active":"2024-09-21T03:53:13.827461+0000","last_became_peered":"2024-09-21T03:53:13.827461+0000","last_unstale":"2024-09-21T03:53:14.816083+0000","last_undegraded":"2024-09-21T03:53:14.816083+0000","last_fullsized":"2024-09-21T03:53:14.816083+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:38.003243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034635+0000","last_change":"2024-09-21T03:53:13.836880+0000","last_active":"2024-09-21T03:53:33.034635+0000","last_peered":"2024-09-21T03:53:33.034635+0000","last_clean":"2024-09-21T03:53:33.034635+0000","last_became_active":"2024-09-21T03:53:13.836531+0000","last_became_peered":"2024-09-21T03:53:13.836531+0000","last_unstale":"2024-09-21T03:53:33.034635+0000","last_undegraded":"2024-09-21T03:53:33.034635+0000","last_fullsized":"2024-09-21T03:53:33.034635+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:52.825826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031827+0000","last_change":"2024-09-21T03:53:13.823160+0000","last_active":"2024-09-21T03:53:33.031827+0000","last_peered":"2024-09-21T03:53:33.031827+0000","last_clean":"2024-09-21T03:53:33.031827+0000","last_became_active":"2024-09-21T03:53:13.822076+0000","last_became_peered":"2024-09-21T03:53:13.822076+0000","last_unstale":"2024-09-21T03:53:33.031827+0000","last_undegraded":"2024-09-21T03:53:33.031827+0000","last_fullsized":"2024-09-21T03:53:33.031827+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:26.277249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032827+0000","last_change":"2024-09-21T03:53:13.831822+0000","last_active":"2024-09-21T03:53:33.032827+0000","last_peered":"2024-09-21T03:53:33.032827+0000","last_clean":"2024-09-21T03:53:33.032827+0000","last_became_active":"2024-09-21T03:53:13.831395+0000","last_became_peered":"2024-09-21T03:53:13.831395+0000","last_unstale":"2024-09-21T03:53:33.032827+0000","last_undegraded":"2024-09-21T03:53:33.032827+0000","last_fullsized":"2024-09-21T03:53:33.032827+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:48.541339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:53:14.813022+0000","last_change":"2024-09-21T03:53:13.834576+0000","last_active":"2024-09-21T03:53:14.813022+0000","last_peered":"2024-09-21T03:53:14.813022+0000","last_clean":"2024-09-21T03:53:14.813022+0000","last_became_active":"2024-09-21T03:53:13.834229+0000","last_became_peered":"2024-09-21T03:53:13.834229+0000","last_unstale":"2024-09-21T03:53:14.813022+0000","last_undegraded":"2024-09-21T03:53:14.813022+0000","last_fullsized":"2024-09-21T03:53:14.813022+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:36.101399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T03:53:32.034158+0000","last_change":"2024-09-21T03:53:13.824049+0000","last_active":"2024-09-21T03:53:32.034158+0000","last_peered":"2024-09-21T03:53:32.034158+0000","last_clean":"2024-09-21T03:53:32.034158+0000","last_became_active":"2024-09-21T03:53:13.823510+0000","last_became_peered":"2024-09-21T03:53:13.823510+0000","last_unstale":"2024-09-21T03:53:32.034158+0000","last_undegraded":"2024-09-21T03:53:32.034158+0000","last_fullsized":"2024-09-21T03:53:32.034158+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:36.615951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:53:14.813483+0000","last_change":"2024-09-21T03:53:13.837327+0000","last_active":"2024-09-21T03:53:14.813483+0000","last_peered":"2024-09-21T03:53:14.813483+0000","last_clean":"2024-09-21T03:53:14.813483+0000","last_became_active":"2024-09-21T03:53:13.836940+0000","last_became_peered":"2024-09-21T03:53:13.836940+0000","last_unstale":"2024-09-21T03:53:14.813483+0000","last_undegraded":"2024-09-21T03:53:14.813483+0000","last_fullsized":"2024-09-21T03:53:14.813483+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:49.248838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:53:14.816081+0000","last_change":"2024-09-21T03:53:13.829540+0000","last_active":"2024-09-21T03:53:14.816081+0000","last_peered":"2024-09-21T03:53:14.816081+0000","last_clean":"2024-09-21T03:53:14.816081+0000","last_became_active":"2024-09-21T03:53:13.828953+0000","last_became_peered":"2024-09-21T03:53:13.828953+0000","last_unstale":"2024-09-21T03:53:14.816081+0000","last_undegraded":"2024-09-21T03:53:14.816081+0000","last_fullsized":"2024-09-21T03:53:14.816081+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:07.631226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034762+0000","last_change":"2024-09-21T03:53:13.835009+0000","last_active":"2024-09-21T03:53:33.034762+0000","last_peered":"2024-09-21T03:53:33.034762+0000","last_clean":"2024-09-21T03:53:33.034762+0000","last_became_active":"2024-09-21T03:53:13.834454+0000","last_became_peered":"2024-09-21T03:53:13.834454+0000","last_unstale":"2024-09-21T03:53:33.034762+0000","last_undegraded":"2024-09-21T03:53:33.034762+0000","last_fullsized":"2024-09-21T03:53:33.034762+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:34:06.114394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031624+0000","last_change":"2024-09-21T03:53:13.826846+0000","last_active":"2024-09-21T03:53:33.031624+0000","last_peered":"2024-09-21T03:53:33.031624+0000","last_clean":"2024-09-21T03:53:33.031624+0000","last_became_active":"2024-09-21T03:53:13.826460+0000","last_became_peered":"2024-09-21T03:53:13.826460+0000","last_unstale":"2024-09-21T03:53:33.031624+0000","last_undegraded":"2024-09-21T03:53:33.031624+0000","last_fullsized":"2024-09-21T03:53:33.031624+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:24.081091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123429+0000","last_change":"2024-09-21T03:53:13.837134+0000","last_active":"2024-09-21T03:53:33.123429+0000","last_peered":"2024-09-21T03:53:33.123429+0000","last_clean":"2024-09-21T03:53:33.123429+0000","last_became_active":"2024-09-21T03:53:13.836729+0000","last_became_peered":"2024-09-21T03:53:13.836729+0000","last_unstale":"2024-09-21T03:53:33.123429+0000","last_undegraded":"2024-09-21T03:53:33.123429+0000","last_fullsized":"2024-09-21T03:53:33.123429+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:08.677375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:53:14.815622+0000","last_change":"2024-09-21T03:53:13.838100+0000","last_active":"2024-09-21T03:53:14.815622+0000","last_peered":"2024-09-21T03:53:14.815622+0000","last_clean":"2024-09-21T03:53:14.815622+0000","last_became_active":"2024-09-21T03:53:13.833495+0000","last_became_peered":"2024-09-21T03:53:13.833495+0000","last_unstale":"2024-09-21T03:53:14.815622+0000","last_undegraded":"2024-09-21T03:53:14.815622+0000","last_fullsized":"2024-09-21T03:53:14.815622+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:52:00.705434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:53:14.816039+0000","last_change":"2024-09-21T03:53:13.835806+0000","last_active":"2024-09-21T03:53:14.816039+0000","last_peered":"2024-09-21T03:53:14.816039+0000","last_clean":"2024-09-21T03:53:14.816039+0000","last_became_active":"2024-09-21T03:53:13.835453+0000","last_became_peered":"2024-09-21T03:53:13.835453+0000","last_unstale":"2024-09-21T03:53:14.816039+0000","last_undegraded":"2024-09-21T03:53:14.816039+0000","last_fullsized":"2024-09-21T03:53:14.816039+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:56:16.296808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034530+0000","last_change":"2024-09-21T03:53:13.831171+0000","last_active":"2024-09-21T03:53:33.034530+0000","last_peered":"2024-09-21T03:53:33.034530+0000","last_clean":"2024-09-21T03:53:33.034530+0000","last_became_active":"2024-09-21T03:53:13.830734+0000","last_became_peered":"2024-09-21T03:53:13.830734+0000","last_unstale":"2024-09-21T03:53:33.034530+0000","last_undegraded":"2024-09-21T03:53:33.034530+0000","last_fullsized":"2024-09-21T03:53:33.034530+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:00:56.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:53:14.827216+0000","last_change":"2024-09-21T03:53:13.820580+0000","last_active":"2024-09-21T03:53:14.827216+0000","last_peered":"2024-09-21T03:53:14.827216+0000","last_clean":"2024-09-21T03:53:14.827216+0000","last_became_active":"2024-09-21T03:53:13.820237+0000","last_became_peered":"2024-09-21T03:53:13.820237+0000","last_unstale":"2024-09-21T03:53:14.827216+0000","last_undegraded":"2024-09-21T03:53:14.827216+0000","last_fullsized":"2024-09-21T03:53:14.827216+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:15.067629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'1","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T03:53:32.034949+0000","last_change":"2024-09-21T03:53:11.804667+0000","last_active":"2024-09-21T03:53:32.034949+0000","last_peered":"2024-09-21T03:53:32.034949+0000","last_clean":"2024-09-21T03:53:32.034949+0000","last_became_active":"2024-09-21T03:53:11.804231+0000","last_became_peered":"2024-09-21T03:53:11.804231+0000","last_unstale":"2024-09-21T03:53:32.034949+0000","last_undegraded":"2024-09-21T03:53:32.034949+0000","last_fullsized":"2024-09-21T03:53:32.034949+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:36.425699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T03:53:32.034818+0000","last_change":"2024-09-21T03:53:13.831602+0000","last_active":"2024-09-21T03:53:32.034818+0000","last_peered":"2024-09-21T03:53:32.034818+0000","last_clean":"2024-09-21T03:53:32.034818+0000","last_became_active":"2024-09-21T03:53:13.831274+0000","last_became_peered":"2024-09-21T03:53:13.831274+0000","last_unstale":"2024-09-21T03:53:32.034818+0000","last_undegraded":"2024-09-21T03:53:32.034818+0000","last_fullsized":"2024-09-21T03:53:32.034818+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:33.603025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'1","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T03:53:32.035444+0000","last_change":"2024-09-21T03:53:11.807722+0000","last_active":"2024-09-21T03:53:32.035444+0000","last_peered":"2024-09-21T03:53:32.035444+0000","last_clean":"2024-09-21T03:53:32.035444+0000","last_became_active":"2024-09-21T03:53:11.807294+0000","last_became_peered":"2024-09-21T03:53:11.807294+0000","last_unstale":"2024-09-21T03:53:32.035444+0000","last_undegraded":"2024-09-21T03:53:32.035444+0000","last_fullsized":"2024-09-21T03:53:32.035444+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:59.696572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031405+0000","last_change":"2024-09-21T03:53:11.803680+0000","last_active":"2024-09-21T03:53:33.031405+0000","last_peered":"2024-09-21T03:53:33.031405+0000","last_clean":"2024-09-21T03:53:33.031405+0000","last_became_active":"2024-09-21T03:53:11.803310+0000","last_became_peered":"2024-09-21T03:53:11.803310+0000","last_unstale":"2024-09-21T03:53:33.031405+0000","last_undegraded":"2024-09-21T03:53:33.031405+0000","last_fullsized":"2024-09-21T03:53:33.031405+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:25.276545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:53:14.812972+0000","last_change":"2024-09-21T03:53:13.834847+0000","last_active":"2024-09-21T03:53:14.812972+0000","last_peered":"2024-09-21T03:53:14.812972+0000","last_clean":"2024-09-21T03:53:14.812972+0000","last_became_active":"2024-09-21T03:53:13.834448+0000","last_became_peered":"2024-09-21T03:53:13.834448+0000","last_unstale":"2024-09-21T03:53:14.812972+0000","last_undegraded":"2024-09-21T03:53:14.812972+0000","last_fullsized":"2024-09-21T03:53:14.812972+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:47:39.213364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T03:53:32.035059+0000","last_change":"2024-09-21T03:53:11.807372+0000","last_active":"2024-09-21T03:53:32.035059+0000","last_peered":"2024-09-21T03:53:32.035059+0000","last_clean":"2024-09-21T03:53:32.035059+0000","last_became_active":"2024-09-21T03:53:11.807064+0000","last_became_peered":"2024-09-21T03:53:11.807064+0000","last_unstale":"2024-09-21T03:53:32.035059+0000","last_undegraded":"2024-09-21T03:53:32.035059+0000","last_fullsized":"2024-09-21T03:53:32.035059+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:00.743039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:53:14.828887+0000","last_change":"2024-09-21T03:53:13.821169+0000","last_active":"2024-09-21T03:53:14.828887+0000","last_peered":"2024-09-21T03:53:14.828887+0000","last_clean":"2024-09-21T03:53:14.828887+0000","last_became_active":"2024-09-21T03:53:13.820810+0000","last_became_peered":"2024-09-21T03:53:13.820810+0000","last_unstale":"2024-09-21T03:53:14.828887+0000","last_undegraded":"2024-09-21T03:53:14.828887+0000","last_fullsized":"2024-09-21T03:53:14.828887+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:54.568383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T03:53:32.036184+0000","last_change":"2024-09-21T03:53:11.805663+0000","last_active":"2024-09-21T03:53:32.036184+0000","last_peered":"2024-09-21T03:53:32.036184+0000","last_clean":"2024-09-21T03:53:32.036184+0000","last_became_active":"2024-09-21T03:53:11.805099+0000","last_became_peered":"2024-09-21T03:53:11.805099+0000","last_unstale":"2024-09-21T03:53:32.036184+0000","last_undegraded":"2024-09-21T03:53:32.036184+0000","last_fullsized":"2024-09-21T03:53:32.036184+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:47.306589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032728+0000","last_change":"2024-09-21T03:53:13.827745+0000","last_active":"2024-09-21T03:53:33.032728+0000","last_peered":"2024-09-21T03:53:33.032728+0000","last_clean":"2024-09-21T03:53:33.032728+0000","last_became_active":"2024-09-21T03:53:13.827229+0000","last_became_peered":"2024-09-21T03:53:13.827229+0000","last_unstale":"2024-09-21T03:53:33.032728+0000","last_undegraded":"2024-09-21T03:53:33.032728+0000","last_fullsized":"2024-09-21T03:53:33.032728+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:53.760919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036288+0000","last_change":"2024-09-21T03:53:11.803697+0000","last_active":"2024-09-21T03:53:33.036288+0000","last_peered":"2024-09-21T03:53:33.036288+0000","last_clean":"2024-09-21T03:53:33.036288+0000","last_became_active":"2024-09-21T03:53:11.801539+0000","last_became_peered":"2024-09-21T03:53:11.801539+0000","last_unstale":"2024-09-21T03:53:33.036288+0000","last_undegraded":"2024-09-21T03:53:33.036288+0000","last_fullsized":"2024-09-21T03:53:33.036288+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:53.096622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123637+0000","last_change":"2024-09-21T03:53:13.832771+0000","last_active":"2024-09-21T03:53:33.123637+0000","last_peered":"2024-09-21T03:53:33.123637+0000","last_clean":"2024-09-21T03:53:33.123637+0000","last_became_active":"2024-09-21T03:53:13.832414+0000","last_became_peered":"2024-09-21T03:53:13.832414+0000","last_unstale":"2024-09-21T03:53:33.123637+0000","last_undegraded":"2024-09-21T03:53:33.123637+0000","last_fullsized":"2024-09-21T03:53:33.123637+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:58:42.287731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'3","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T03:53:32.034008+0000","last_change":"2024-09-21T03:53:12.604482+0000","last_active":"2024-09-21T03:53:32.034008+0000","last_peered":"2024-09-21T03:53:32.034008+0000","last_clean":"2024-09-21T03:53:32.034008+0000","last_became_active":"2024-09-21T03:53:12.603973+0000","last_became_peered":"2024-09-21T03:53:12.603973+0000","last_unstale":"2024-09-21T03:53:32.034008+0000","last_undegraded":"2024-09-21T03:53:32.034008+0000","last_fullsized":"2024-09-21T03:53:32.034008+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:11.932329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032506+0000","last_change":"2024-09-21T03:53:13.842106+0000","last_active":"2024-09-21T03:53:33.032506+0000","last_peered":"2024-09-21T03:53:33.032506+0000","last_clean":"2024-09-21T03:53:33.032506+0000","last_became_active":"2024-09-21T03:53:13.841758+0000","last_became_peered":"2024-09-21T03:53:13.841758+0000","last_unstale":"2024-09-21T03:53:33.032506+0000","last_undegraded":"2024-09-21T03:53:33.032506+0000","last_fullsized":"2024-09-21T03:53:33.032506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:37.045045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'19","reported_seq":68,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T03:53:32.036186+0000","last_change":"2024-09-21T03:53:11.805385+0000","last_active":"2024-09-21T03:53:32.036186+0000","last_peered":"2024-09-21T03:53:32.036186+0000","last_clean":"2024-09-21T03:53:32.036186+0000","last_became_active":"2024-09-21T03:53:11.804958+0000","last_became_peered":"2024-09-21T03:53:11.804958+0000","last_unstale":"2024-09-21T03:53:32.036186+0000","last_undegraded":"2024-09-21T03:53:32.036186+0000","last_fullsized":"2024-09-21T03:53:32.036186+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:59.197216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45203,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":57,"num_write":19,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:53:14.826850+0000","last_change":"2024-09-21T03:53:13.828095+0000","last_active":"2024-09-21T03:53:14.826850+0000","last_peered":"2024-09-21T03:53:14.826850+0000","last_clean":"2024-09-21T03:53:14.826850+0000","last_became_active":"2024-09-21T03:53:13.827761+0000","last_became_peered":"2024-09-21T03:53:13.827761+0000","last_unstale":"2024-09-21T03:53:14.826850+0000","last_undegraded":"2024-09-21T03:53:14.826850+0000","last_fullsized":"2024-09-21T03:53:14.826850+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:42:28.981463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'2","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:53:14.834264+0000","last_change":"2024-09-21T03:53:11.801611+0000","last_active":"2024-09-21T03:53:14.834264+0000","last_peered":"2024-09-21T03:53:14.834264+0000","last_clean":"2024-09-21T03:53:14.834264+0000","last_became_active":"2024-09-21T03:53:11.801185+0000","last_became_peered":"2024-09-21T03:53:11.801185+0000","last_unstale":"2024-09-21T03:53:14.834264+0000","last_undegraded":"2024-09-21T03:53:14.834264+0000","last_fullsized":"2024-09-21T03:53:14.834264+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:16.990963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031447+0000","last_change":"2024-09-21T03:53:13.827393+0000","last_active":"2024-09-21T03:53:33.031447+0000","last_peered":"2024-09-21T03:53:33.031447+0000","last_clean":"2024-09-21T03:53:33.031447+0000","last_became_active":"2024-09-21T03:53:13.826912+0000","last_became_peered":"2024-09-21T03:53:13.826912+0000","last_unstale":"2024-09-21T03:53:33.031447+0000","last_undegraded":"2024-09-21T03:53:33.031447+0000","last_fullsized":"2024-09-21T03:53:33.031447+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:52.313989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T03:53:32.033716+0000","last_change":"2024-09-21T03:53:11.805437+0000","last_active":"2024-09-21T03:53:32.033716+0000","last_peered":"2024-09-21T03:53:32.033716+0000","last_clean":"2024-09-21T03:53:32.033716+0000","last_became_active":"2024-09-21T03:53:11.805048+0000","last_became_peered":"2024-09-21T03:53:11.805048+0000","last_unstale":"2024-09-21T03:53:32.033716+0000","last_undegraded":"2024-09-21T03:53:32.033716+0000","last_fullsized":"2024-09-21T03:53:32.033716+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:03.288694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036034+0000","last_change":"2024-09-21T03:53:13.836917+0000","last_active":"2024-09-21T03:53:33.036034+0000","last_peered":"2024-09-21T03:53:33.036034+0000","last_clean":"2024-09-21T03:53:33.036034+0000","last_became_active":"2024-09-21T03:53:13.836514+0000","last_became_peered":"2024-09-21T03:53:13.836514+0000","last_unstale":"2024-09-21T03:53:33.036034+0000","last_undegraded":"2024-09-21T03:53:33.036034+0000","last_fullsized":"2024-09-21T03:53:33.036034+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:17.512017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T03:53:32.030797+0000","last_change":"2024-09-21T03:53:11.808403+0000","last_active":"2024-09-21T03:53:32.030797+0000","last_peered":"2024-09-21T03:53:32.030797+0000","last_clean":"2024-09-21T03:53:32.030797+0000","last_became_active":"2024-09-21T03:53:11.807895+0000","last_became_peered":"2024-09-21T03:53:11.807895+0000","last_unstale":"2024-09-21T03:53:32.030797+0000","last_undegraded":"2024-09-21T03:53:32.030797+0000","last_fullsized":"2024-09-21T03:53:32.030797+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:33.548683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.125777+0000","last_change":"2024-09-21T03:53:33.125556+0000","last_active":"2024-09-21T03:53:33.125777+0000","last_peered":"2024-09-21T03:53:33.125777+0000","last_clean":"2024-09-21T03:53:33.125777+0000","last_became_active":"2024-09-21T03:53:33.125084+0000","last_became_peered":"2024-09-21T03:53:33.125084+0000","last_unstale":"2024-09-21T03:53:33.125777+0000","last_undegraded":"2024-09-21T03:53:33.125777+0000","last_fullsized":"2024-09-21T03:53:33.125777+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:40:23.997329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'8","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:53:14.834939+0000","last_change":"2024-09-21T03:53:12.605672+0000","last_active":"2024-09-21T03:53:14.834939+0000","last_peered":"2024-09-21T03:53:14.834939+0000","last_clean":"2024-09-21T03:53:14.834939+0000","last_became_active":"2024-09-21T03:53:12.604644+0000","last_became_peered":"2024-09-21T03:53:12.604644+0000","last_unstale":"2024-09-21T03:53:14.834939+0000","last_undegraded":"2024-09-21T03:53:14.834939+0000","last_fullsized":"2024-09-21T03:53:14.834939+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:44.810762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T03:53:32.033227+0000","last_change":"2024-09-21T03:53:13.833861+0000","last_active":"2024-09-21T03:53:32.033227+0000","last_peered":"2024-09-21T03:53:32.033227+0000","last_clean":"2024-09-21T03:53:32.033227+0000","last_became_active":"2024-09-21T03:53:13.832900+0000","last_became_peered":"2024-09-21T03:53:13.832900+0000","last_unstale":"2024-09-21T03:53:32.033227+0000","last_undegraded":"2024-09-21T03:53:32.033227+0000","last_fullsized":"2024-09-21T03:53:32.033227+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:12.047171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'1","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:53:14.834105+0000","last_change":"2024-09-21T03:53:11.799844+0000","last_active":"2024-09-21T03:53:14.834105+0000","last_peered":"2024-09-21T03:53:14.834105+0000","last_clean":"2024-09-21T03:53:14.834105+0000","last_became_active":"2024-09-21T03:53:11.799412+0000","last_became_peered":"2024-09-21T03:53:11.799412+0000","last_unstale":"2024-09-21T03:53:14.834105+0000","last_undegraded":"2024-09-21T03:53:14.834105+0000","last_fullsized":"2024-09-21T03:53:14.834105+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:49.826500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034751+0000","last_change":"2024-09-21T03:53:13.836690+0000","last_active":"2024-09-21T03:53:33.034751+0000","last_peered":"2024-09-21T03:53:33.034751+0000","last_clean":"2024-09-21T03:53:33.034751+0000","last_became_active":"2024-09-21T03:53:13.836337+0000","last_became_peered":"2024-09-21T03:53:13.836337+0000","last_unstale":"2024-09-21T03:53:33.034751+0000","last_undegraded":"2024-09-21T03:53:33.034751+0000","last_fullsized":"2024-09-21T03:53:33.034751+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:15.999869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031625+0000","last_change":"2024-09-21T03:53:11.799597+0000","last_active":"2024-09-21T03:53:33.031625+0000","last_peered":"2024-09-21T03:53:33.031625+0000","last_clean":"2024-09-21T03:53:33.031625+0000","last_became_active":"2024-09-21T03:53:11.799175+0000","last_became_peered":"2024-09-21T03:53:11.799175+0000","last_unstale":"2024-09-21T03:53:33.031625+0000","last_undegraded":"2024-09-21T03:53:33.031625+0000","last_fullsized":"2024-09-21T03:53:33.031625+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:41.668587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036592+0000","last_change":"2024-09-21T03:53:13.831228+0000","last_active":"2024-09-21T03:53:33.036592+0000","last_peered":"2024-09-21T03:53:33.036592+0000","last_clean":"2024-09-21T03:53:33.036592+0000","last_became_active":"2024-09-21T03:53:13.830880+0000","last_became_peered":"2024-09-21T03:53:13.830880+0000","last_unstale":"2024-09-21T03:53:33.036592+0000","last_undegraded":"2024-09-21T03:53:33.036592+0000","last_fullsized":"2024-09-21T03:53:33.036592+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:45.770622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T03:53:32.034144+0000","last_change":"2024-09-21T03:53:11.803560+0000","last_active":"2024-09-21T03:53:32.034144+0000","last_peered":"2024-09-21T03:53:32.034144+0000","last_clean":"2024-09-21T03:53:32.034144+0000","last_became_active":"2024-09-21T03:53:11.803090+0000","last_became_peered":"2024-09-21T03:53:11.803090+0000","last_unstale":"2024-09-21T03:53:32.034144+0000","last_undegraded":"2024-09-21T03:53:32.034144+0000","last_fullsized":"2024-09-21T03:53:32.034144+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:23.993694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036373+0000","last_change":"2024-09-21T03:53:13.825907+0000","last_active":"2024-09-21T03:53:33.036373+0000","last_peered":"2024-09-21T03:53:33.036373+0000","last_clean":"2024-09-21T03:53:33.036373+0000","last_became_active":"2024-09-21T03:53:13.825485+0000","last_became_peered":"2024-09-21T03:53:13.825485+0000","last_unstale":"2024-09-21T03:53:33.036373+0000","last_undegraded":"2024-09-21T03:53:33.036373+0000","last_fullsized":"2024-09-21T03:53:33.036373+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:39.166215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:53:14.815846+0000","last_change":"2024-09-21T03:53:12.605947+0000","last_active":"2024-09-21T03:53:14.815846+0000","last_peered":"2024-09-21T03:53:14.815846+0000","last_clean":"2024-09-21T03:53:14.815846+0000","last_became_active":"2024-09-21T03:53:12.604516+0000","last_became_peered":"2024-09-21T03:53:12.604516+0000","last_unstale":"2024-09-21T03:53:14.815846+0000","last_undegraded":"2024-09-21T03:53:14.815846+0000","last_fullsized":"2024-09-21T03:53:14.815846+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:42.500174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036503+0000","last_change":"2024-09-21T03:53:13.834108+0000","last_active":"2024-09-21T03:53:33.036503+0000","last_peered":"2024-09-21T03:53:33.036503+0000","last_clean":"2024-09-21T03:53:33.036503+0000","last_became_active":"2024-09-21T03:53:13.833734+0000","last_became_peered":"2024-09-21T03:53:13.833734+0000","last_unstale":"2024-09-21T03:53:33.036503+0000","last_undegraded":"2024-09-21T03:53:33.036503+0000","last_fullsized":"2024-09-21T03:53:33.036503+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:39.032450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":97,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036156+0000","last_change":"2024-09-21T03:51:59.139085+0000","last_active":"2024-09-21T03:53:33.036156+0000","last_peered":"2024-09-21T03:53:33.036156+0000","last_clean":"2024-09-21T03:53:33.036156+0000","last_became_active":"2024-09-21T03:51:59.026450+0000","last_became_peered":"2024-09-21T03:51:59.026450+0000","last_unstale":"2024-09-21T03:53:33.036156+0000","last_undegraded":"2024-09-21T03:53:33.036156+0000","last_fullsized":"2024-09-21T03:53:33.036156+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:48:31.139457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:48:31.139457+0000","last_clean_scrub_stamp":"2024-09-21T03:48:31.139457+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:54.047170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T03:53:32.030804+0000","last_change":"2024-09-21T03:53:11.805792+0000","last_active":"2024-09-21T03:53:32.030804+0000","last_peered":"2024-09-21T03:53:32.030804+0000","last_clean":"2024-09-21T03:53:32.030804+0000","last_became_active":"2024-09-21T03:53:11.805375+0000","last_became_peered":"2024-09-21T03:53:11.805375+0000","last_unstale":"2024-09-21T03:53:32.030804+0000","last_undegraded":"2024-09-21T03:53:32.030804+0000","last_fullsized":"2024-09-21T03:53:32.030804+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:55.466187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:53:14.813342+0000","last_change":"2024-09-21T03:53:13.835211+0000","last_active":"2024-09-21T03:53:14.813342+0000","last_peered":"2024-09-21T03:53:14.813342+0000","last_clean":"2024-09-21T03:53:14.813342+0000","last_became_active":"2024-09-21T03:53:13.833649+0000","last_became_peered":"2024-09-21T03:53:13.833649+0000","last_unstale":"2024-09-21T03:53:14.813342+0000","last_undegraded":"2024-09-21T03:53:14.813342+0000","last_fullsized":"2024-09-21T03:53:14.813342+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:57.962287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035996+0000","last_change":"2024-09-21T03:53:11.801670+0000","last_active":"2024-09-21T03:53:33.035996+0000","last_peered":"2024-09-21T03:53:33.035996+0000","last_clean":"2024-09-21T03:53:33.035996+0000","last_became_active":"2024-09-21T03:53:11.801291+0000","last_became_peered":"2024-09-21T03:53:11.801291+0000","last_unstale":"2024-09-21T03:53:33.035996+0000","last_undegraded":"2024-09-21T03:53:33.035996+0000","last_fullsized":"2024-09-21T03:53:33.035996+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:37.450592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.096813+0000","last_change":"2024-09-21T03:53:33.096727+0000","last_active":"2024-09-21T03:53:33.096813+0000","last_peered":"2024-09-21T03:53:33.096813+0000","last_clean":"2024-09-21T03:53:33.096813+0000","last_became_active":"2024-09-21T03:53:33.096234+0000","last_became_peered":"2024-09-21T03:53:33.096234+0000","last_unstale":"2024-09-21T03:53:33.096813+0000","last_undegraded":"2024-09-21T03:53:33.096813+0000","last_fullsized":"2024-09-21T03:53:33.096813+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:56:24.375992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031550+0000","last_change":"2024-09-21T03:53:12.604170+0000","last_active":"2024-09-21T03:53:33.031550+0000","last_peered":"2024-09-21T03:53:33.031550+0000","last_clean":"2024-09-21T03:53:33.031550+0000","last_became_active":"2024-09-21T03:53:12.603765+0000","last_became_peered":"2024-09-21T03:53:12.603765+0000","last_unstale":"2024-09-21T03:53:33.031550+0000","last_undegraded":"2024-09-21T03:53:33.031550+0000","last_fullsized":"2024-09-21T03:53:33.031550+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:08.606037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"peering","last_fresh":"2024-09-21T03:53:17.651284+0000","last_change":"2024-09-21T03:53:32.033442+0000","last_active":"2024-09-21T03:53:32.033442+0000","last_peered":"2024-09-21T03:53:17.651284+0000","last_clean":"2024-09-21T03:53:17.651284+0000","last_became_active":"2024-09-21T03:53:13.829187+0000","last_became_peered":"2024-09-21T03:53:13.829187+0000","last_unstale":"2024-09-21T03:53:17.651284+0000","last_undegraded":"2024-09-21T03:53:17.651284+0000","last_fullsized":"2024-09-21T03:53:17.651284+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,4,8],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036128+0000","last_change":"2024-09-21T03:53:11.803316+0000","last_active":"2024-09-21T03:53:33.036128+0000","last_peered":"2024-09-21T03:53:33.036128+0000","last_clean":"2024-09-21T03:53:33.036128+0000","last_became_active":"2024-09-21T03:53:11.801976+0000","last_became_peered":"2024-09-21T03:53:11.801976+0000","last_unstale":"2024-09-21T03:53:33.036128+0000","last_undegraded":"2024-09-21T03:53:33.036128+0000","last_fullsized":"2024-09-21T03:53:33.036128+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:43.596037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T03:53:32.035641+0000","last_change":"2024-09-21T03:53:13.838006+0000","last_active":"2024-09-21T03:53:32.035641+0000","last_peered":"2024-09-21T03:53:32.035641+0000","last_clean":"2024-09-21T03:53:32.035641+0000","last_became_active":"2024-09-21T03:53:13.835903+0000","last_became_peered":"2024-09-21T03:53:13.835903+0000","last_unstale":"2024-09-21T03:53:32.035641+0000","last_undegraded":"2024-09-21T03:53:32.035641+0000","last_fullsized":"2024-09-21T03:53:32.035641+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:54:56.730044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:53:14.826892+0000","last_change":"2024-09-21T03:53:12.604876+0000","last_active":"2024-09-21T03:53:14.826892+0000","last_peered":"2024-09-21T03:53:14.826892+0000","last_clean":"2024-09-21T03:53:14.826892+0000","last_became_active":"2024-09-21T03:53:12.604499+0000","last_became_peered":"2024-09-21T03:53:12.604499+0000","last_unstale":"2024-09-21T03:53:14.826892+0000","last_undegraded":"2024-09-21T03:53:14.826892+0000","last_fullsized":"2024-09-21T03:53:14.826892+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:53.872420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":17,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T03:53:32.035760+0000","last_change":"2024-09-21T03:53:13.827805+0000","last_active":"2024-09-21T03:53:32.035760+0000","last_peered":"2024-09-21T03:53:32.035760+0000","last_clean":"2024-09-21T03:53:32.035760+0000","last_became_active":"2024-09-21T03:53:13.827368+0000","last_became_peered":"2024-09-21T03:53:13.827368+0000","last_unstale":"2024-09-21T03:53:32.035760+0000","last_undegraded":"2024-09-21T03:53:32.035760+0000","last_fullsized":"2024-09-21T03:53:32.035760+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:24.539396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:53:14.830279+0000","last_change":"2024-09-21T03:53:12.605032+0000","last_active":"2024-09-21T03:53:14.830279+0000","last_peered":"2024-09-21T03:53:14.830279+0000","last_clean":"2024-09-21T03:53:14.830279+0000","last_became_active":"2024-09-21T03:53:12.604561+0000","last_became_peered":"2024-09-21T03:53:12.604561+0000","last_unstale":"2024-09-21T03:53:14.830279+0000","last_undegraded":"2024-09-21T03:53:14.830279+0000","last_fullsized":"2024-09-21T03:53:14.830279+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:20.361768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031744+0000","last_change":"2024-09-21T03:53:13.821539+0000","last_active":"2024-09-21T03:53:33.031744+0000","last_peered":"2024-09-21T03:53:33.031744+0000","last_clean":"2024-09-21T03:53:33.031744+0000","last_became_active":"2024-09-21T03:53:13.821196+0000","last_became_peered":"2024-09-21T03:53:13.821196+0000","last_unstale":"2024-09-21T03:53:33.031744+0000","last_undegraded":"2024-09-21T03:53:33.031744+0000","last_fullsized":"2024-09-21T03:53:33.031744+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:00.627993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'4","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:53:27.826100+0000","last_change":"2024-09-21T03:53:11.799669+0000","last_active":"2024-09-21T03:53:27.826100+0000","last_peered":"2024-09-21T03:53:27.826100+0000","last_clean":"2024-09-21T03:53:27.826100+0000","last_became_active":"2024-09-21T03:53:11.799355+0000","last_became_peered":"2024-09-21T03:53:11.799355+0000","last_unstale":"2024-09-21T03:53:27.826100+0000","last_undegraded":"2024-09-21T03:53:27.826100+0000","last_fullsized":"2024-09-21T03:53:27.826100+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:33.032206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:53:14.813580+0000","last_change":"2024-09-21T03:53:13.828551+0000","last_active":"2024-09-21T03:53:14.813580+0000","last_peered":"2024-09-21T03:53:14.813580+0000","last_clean":"2024-09-21T03:53:14.813580+0000","last_became_active":"2024-09-21T03:53:13.828185+0000","last_became_peered":"2024-09-21T03:53:13.828185+0000","last_unstale":"2024-09-21T03:53:14.813580+0000","last_undegraded":"2024-09-21T03:53:14.813580+0000","last_fullsized":"2024-09-21T03:53:14.813580+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:31.852755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'2","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T03:53:32.031409+0000","last_change":"2024-09-21T03:53:12.279823+0000","last_active":"2024-09-21T03:53:32.031409+0000","last_peered":"2024-09-21T03:53:32.031409+0000","last_clean":"2024-09-21T03:53:32.031409+0000","last_became_active":"2024-09-21T03:53:12.279384+0000","last_became_peered":"2024-09-21T03:53:12.279384+0000","last_unstale":"2024-09-21T03:53:32.031409+0000","last_undegraded":"2024-09-21T03:53:32.031409+0000","last_fullsized":"2024-09-21T03:53:32.031409+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:42.568690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123319+0000","last_change":"2024-09-21T03:53:13.831041+0000","last_active":"2024-09-21T03:53:33.123319+0000","last_peered":"2024-09-21T03:53:33.123319+0000","last_clean":"2024-09-21T03:53:33.123319+0000","last_became_active":"2024-09-21T03:53:13.830654+0000","last_became_peered":"2024-09-21T03:53:13.830654+0000","last_unstale":"2024-09-21T03:53:33.123319+0000","last_undegraded":"2024-09-21T03:53:33.123319+0000","last_fullsized":"2024-09-21T03:53:33.123319+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:04.815719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032478+0000","last_change":"2024-09-21T03:53:12.604949+0000","last_active":"2024-09-21T03:53:33.032478+0000","last_peered":"2024-09-21T03:53:33.032478+0000","last_clean":"2024-09-21T03:53:33.032478+0000","last_became_active":"2024-09-21T03:53:12.604516+0000","last_became_peered":"2024-09-21T03:53:12.604516+0000","last_unstale":"2024-09-21T03:53:33.032478+0000","last_undegraded":"2024-09-21T03:53:33.032478+0000","last_fullsized":"2024-09-21T03:53:33.032478+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:33.964125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:53:14.826965+0000","last_change":"2024-09-21T03:53:13.834813+0000","last_active":"2024-09-21T03:53:14.826965+0000","last_peered":"2024-09-21T03:53:14.826965+0000","last_clean":"2024-09-21T03:53:14.826965+0000","last_became_active":"2024-09-21T03:53:13.834436+0000","last_became_peered":"2024-09-21T03:53:13.834436+0000","last_unstale":"2024-09-21T03:53:14.826965+0000","last_undegraded":"2024-09-21T03:53:14.826965+0000","last_fullsized":"2024-09-21T03:53:14.826965+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:42:40.990668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:53:14.813052+0000","last_change":"2024-09-21T03:53:11.801828+0000","last_active":"2024-09-21T03:53:14.813052+0000","last_peered":"2024-09-21T03:53:14.813052+0000","last_clean":"2024-09-21T03:53:14.813052+0000","last_became_active":"2024-09-21T03:53:11.800969+0000","last_became_peered":"2024-09-21T03:53:11.800969+0000","last_unstale":"2024-09-21T03:53:14.813052+0000","last_undegraded":"2024-09-21T03:53:14.813052+0000","last_fullsized":"2024-09-21T03:53:14.813052+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:36.117523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034772+0000","last_change":"2024-09-21T03:53:13.835393+0000","last_active":"2024-09-21T03:53:33.034772+0000","last_peered":"2024-09-21T03:53:33.034772+0000","last_clean":"2024-09-21T03:53:33.034772+0000","last_became_active":"2024-09-21T03:53:13.834541+0000","last_became_peered":"2024-09-21T03:53:13.834541+0000","last_unstale":"2024-09-21T03:53:33.034772+0000","last_undegraded":"2024-09-21T03:53:33.034772+0000","last_fullsized":"2024-09-21T03:53:33.034772+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:40.140004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.125328+0000","last_change":"2024-09-21T03:53:33.124524+0000","last_active":"2024-09-21T03:53:33.125328+0000","last_peered":"2024-09-21T03:53:33.125328+0000","last_clean":"2024-09-21T03:53:33.125328+0000","last_became_active":"2024-09-21T03:53:33.123945+0000","last_became_peered":"2024-09-21T03:53:33.123945+0000","last_unstale":"2024-09-21T03:53:33.125328+0000","last_undegraded":"2024-09-21T03:53:33.125328+0000","last_fullsized":"2024-09-21T03:53:33.125328+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:50.967123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:53:14.813429+0000","last_change":"2024-09-21T03:53:13.832597+0000","last_active":"2024-09-21T03:53:14.813429+0000","last_peered":"2024-09-21T03:53:14.813429+0000","last_clean":"2024-09-21T03:53:14.813429+0000","last_became_active":"2024-09-21T03:53:13.832237+0000","last_became_peered":"2024-09-21T03:53:13.832237+0000","last_unstale":"2024-09-21T03:53:14.813429+0000","last_undegraded":"2024-09-21T03:53:14.813429+0000","last_fullsized":"2024-09-21T03:53:14.813429+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:31.907478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'2","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:53:14.832859+0000","last_change":"2024-09-21T03:53:11.804875+0000","last_active":"2024-09-21T03:53:14.832859+0000","last_peered":"2024-09-21T03:53:14.832859+0000","last_clean":"2024-09-21T03:53:14.832859+0000","last_became_active":"2024-09-21T03:53:11.804320+0000","last_became_peered":"2024-09-21T03:53:11.804320+0000","last_unstale":"2024-09-21T03:53:14.832859+0000","last_undegraded":"2024-09-21T03:53:14.832859+0000","last_fullsized":"2024-09-21T03:53:14.832859+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:37:58.747573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035965+0000","last_change":"2024-09-21T03:53:13.837804+0000","last_active":"2024-09-21T03:53:33.035965+0000","last_peered":"2024-09-21T03:53:33.035965+0000","last_clean":"2024-09-21T03:53:33.035965+0000","last_became_active":"2024-09-21T03:53:13.837440+0000","last_became_peered":"2024-09-21T03:53:13.837440+0000","last_unstale":"2024-09-21T03:53:33.035965+0000","last_undegraded":"2024-09-21T03:53:33.035965+0000","last_fullsized":"2024-09-21T03:53:33.035965+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:15.471544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T03:53:32.033875+0000","last_change":"2024-09-21T03:53:13.833231+0000","last_active":"2024-09-21T03:53:32.033875+0000","last_peered":"2024-09-21T03:53:32.033875+0000","last_clean":"2024-09-21T03:53:32.033875+0000","last_became_active":"2024-09-21T03:53:13.832908+0000","last_became_peered":"2024-09-21T03:53:13.832908+0000","last_unstale":"2024-09-21T03:53:32.033875+0000","last_undegraded":"2024-09-21T03:53:32.033875+0000","last_fullsized":"2024-09-21T03:53:32.033875+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:40.191231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:53:14.834100+0000","last_change":"2024-09-21T03:53:11.802237+0000","last_active":"2024-09-21T03:53:14.834100+0000","last_peered":"2024-09-21T03:53:14.834100+0000","last_clean":"2024-09-21T03:53:14.834100+0000","last_became_active":"2024-09-21T03:53:11.801845+0000","last_became_peered":"2024-09-21T03:53:11.801845+0000","last_unstale":"2024-09-21T03:53:14.834100+0000","last_undegraded":"2024-09-21T03:53:14.834100+0000","last_fullsized":"2024-09-21T03:53:14.834100+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:34.714908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032488+0000","last_change":"2024-09-21T03:53:13.831495+0000","last_active":"2024-09-21T03:53:33.032488+0000","last_peered":"2024-09-21T03:53:33.032488+0000","last_clean":"2024-09-21T03:53:33.032488+0000","last_became_active":"2024-09-21T03:53:13.831107+0000","last_became_peered":"2024-09-21T03:53:13.831107+0000","last_unstale":"2024-09-21T03:53:33.032488+0000","last_undegraded":"2024-09-21T03:53:33.032488+0000","last_fullsized":"2024-09-21T03:53:33.032488+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:12:09.751036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:53:14.834298+0000","last_change":"2024-09-21T03:53:11.805910+0000","last_active":"2024-09-21T03:53:14.834298+0000","last_peered":"2024-09-21T03:53:14.834298+0000","last_clean":"2024-09-21T03:53:14.834298+0000","last_became_active":"2024-09-21T03:53:11.805461+0000","last_became_peered":"2024-09-21T03:53:11.805461+0000","last_unstale":"2024-09-21T03:53:14.834298+0000","last_undegraded":"2024-09-21T03:53:14.834298+0000","last_fullsized":"2024-09-21T03:53:14.834298+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:36:56.132055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123607+0000","last_change":"2024-09-21T03:53:13.834930+0000","last_active":"2024-09-21T03:53:33.123607+0000","last_peered":"2024-09-21T03:53:33.123607+0000","last_clean":"2024-09-21T03:53:33.123607+0000","last_became_active":"2024-09-21T03:53:13.834368+0000","last_became_peered":"2024-09-21T03:53:13.834368+0000","last_unstale":"2024-09-21T03:53:33.123607+0000","last_undegraded":"2024-09-21T03:53:33.123607+0000","last_fullsized":"2024-09-21T03:53:33.123607+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:53.798811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:53:14.813679+0000","last_change":"2024-09-21T03:53:12.604827+0000","last_active":"2024-09-21T03:53:14.813679+0000","last_peered":"2024-09-21T03:53:14.813679+0000","last_clean":"2024-09-21T03:53:14.813679+0000","last_became_active":"2024-09-21T03:53:12.604406+0000","last_became_peered":"2024-09-21T03:53:12.604406+0000","last_unstale":"2024-09-21T03:53:14.813679+0000","last_undegraded":"2024-09-21T03:53:14.813679+0000","last_fullsized":"2024-09-21T03:53:14.813679+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:03:12.942354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:53:14.813358+0000","last_change":"2024-09-21T03:53:13.830482+0000","last_active":"2024-09-21T03:53:14.813358+0000","last_peered":"2024-09-21T03:53:14.813358+0000","last_clean":"2024-09-21T03:53:14.813358+0000","last_became_active":"2024-09-21T03:53:13.829970+0000","last_became_peered":"2024-09-21T03:53:13.829970+0000","last_unstale":"2024-09-21T03:53:14.813358+0000","last_undegraded":"2024-09-21T03:53:14.813358+0000","last_fullsized":"2024-09-21T03:53:14.813358+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:21.617459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'4","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:53:14.833850+0000","last_change":"2024-09-21T03:53:11.801931+0000","last_active":"2024-09-21T03:53:14.833850+0000","last_peered":"2024-09-21T03:53:14.833850+0000","last_clean":"2024-09-21T03:53:14.833850+0000","last_became_active":"2024-09-21T03:53:11.801587+0000","last_became_peered":"2024-09-21T03:53:11.801587+0000","last_unstale":"2024-09-21T03:53:14.833850+0000","last_undegraded":"2024-09-21T03:53:14.833850+0000","last_fullsized":"2024-09-21T03:53:14.833850+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:47.329060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":46001,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":34,"num_read_kb":63,"num_write":64,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":150105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285514,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743441,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31988,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713164,"statfs":{"total":95995035648,"available":95962279936,"internally_reserved":0,"allocated":819200,"data_stored":407969,"data_compressed":2875,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939670,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":937984,"data_stored":1043851,"data_compressed":39171,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103195,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":811008,"data_stored":399809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299424,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31980,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713172,"statfs":{"total":95995035648,"available":95962288128,"internally_reserved":0,"allocated":815104,"data_stored":399831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462950,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":888832,"data_stored":1007644,"data_compressed":42053,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626475,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":835584,"data_stored":416694,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822704,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":884736,"data_stored":998636,"data_compressed":39171,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986229,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31988,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713164,"statfs":{"total":95995035648,"available":95962279936,"internally_reserved":0,"allocated":811008,"data_stored":399249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182456,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36148,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709004,"statfs":{"total":95995035648,"available":95958020096,"internally_reserved":0,"allocated":823296,"data_stored":399565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378687,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":847872,"data_stored":428276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542213,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":897024,"data_stored":473882,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705738,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":835584,"data_stored":416667,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34678,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34678,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34678,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36296,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36296,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36296,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36296,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36296,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":57305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":45237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":45397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:53:38.428 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T03:53:38.695 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:39.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.231+0000 7f3a1f8d0640 1 -- 172.21.15.46:0/3698961142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a18109570 msgr2=0x7f3a18109980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:39.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.231+0000 7f3a1f8d0640 1 --2- 172.21.15.46:0/3698961142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a18109570 0x7f3a18109980 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c009900 tx=0x7f3a0c02a410 comp rx=0 tx=0).stop 2024-09-21T03:53:39.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.231+0000 7f3a1f8d0640 1 -- 172.21.15.46:0/3698961142 shutdown_connections 2024-09-21T03:53:39.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.231+0000 7f3a1f8d0640 1 --2- 172.21.15.46:0/3698961142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a18109ec0 0x7f3a181106f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:39.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.231+0000 7f3a1f8d0640 1 --2- 172.21.15.46:0/3698961142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a18109570 0x7f3a18109980 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:39.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.231+0000 7f3a1f8d0640 1 --2- 172.21.15.46:0/3698961142 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a18103c30 0x7f3a18104040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:39.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.231+0000 7f3a1f8d0640 1 -- 172.21.15.46:0/3698961142 >> 172.21.15.46:0/3698961142 conn(0x7f3a1807b8d0 msgr2=0x7f3a1807bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:39.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.231+0000 7f3a1f8d0640 1 -- 172.21.15.46:0/3698961142 shutdown_connections 2024-09-21T03:53:39.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.231+0000 7f3a1f8d0640 1 -- 172.21.15.46:0/3698961142 wait complete. 2024-09-21T03:53:39.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.231+0000 7f3a1f8d0640 1 Processor -- start 2024-09-21T03:53:39.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.232+0000 7f3a1f8d0640 1 -- start start 2024-09-21T03:53:39.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.232+0000 7f3a1f8d0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a18103c30 0x7f3a18075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:39.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.232+0000 7f3a1f8d0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a18109570 0x7f3a18075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:39.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.232+0000 7f3a1f8d0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a18109ec0 0x7f3a18076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:39.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.232+0000 7f3a1f8d0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3a18113ae0 con 0x7f3a18103c30 2024-09-21T03:53:39.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.232+0000 7f3a1f8d0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3a18113960 con 0x7f3a18109570 2024-09-21T03:53:39.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.232+0000 7f3a1f8d0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3a18113c60 con 0x7f3a18109ec0 2024-09-21T03:53:39.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.232+0000 7f3a1d66c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a18103c30 0x7f3a18075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:39.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.232+0000 7f3a1d66c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a18103c30 0x7f3a18075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37562/0 (socket says 172.21.15.46:37562) 2024-09-21T03:53:39.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.232+0000 7f3a1d66c640 1 -- 172.21.15.46:0/2000949740 learned_addr learned my addr 172.21.15.46:0/2000949740 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:53:39.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.232+0000 7f3a1ce6b640 1 --2- 172.21.15.46:0/2000949740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a18109570 0x7f3a18075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:39.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.232+0000 7f3a1de6d640 1 --2- 172.21.15.46:0/2000949740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a18109ec0 0x7f3a18076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:39.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.232+0000 7f3a1d66c640 1 -- 172.21.15.46:0/2000949740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a18109ec0 msgr2=0x7f3a18076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:39.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.232+0000 7f3a1d66c640 1 --2- 172.21.15.46:0/2000949740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a18109ec0 0x7f3a18076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:39.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.232+0000 7f3a1d66c640 1 -- 172.21.15.46:0/2000949740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a18109570 msgr2=0x7f3a18075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:39.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.232+0000 7f3a1d66c640 1 --2- 172.21.15.46:0/2000949740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a18109570 0x7f3a18075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:39.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.232+0000 7f3a1d66c640 1 -- 172.21.15.46:0/2000949740 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a181a87d0 con 0x7f3a18103c30 2024-09-21T03:53:39.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.233+0000 7f3a1d66c640 1 --2- 172.21.15.46:0/2000949740 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a18103c30 0x7f3a18075710 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3a0800eab0 tx=0x7f3a0800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:39.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.233+0000 7f3a167fc640 1 -- 172.21.15.46:0/2000949740 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0800ce40 con 0x7f3a18103c30 2024-09-21T03:53:39.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.233+0000 7f3a1f8d0640 1 -- 172.21.15.46:0/2000949740 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a181a8ac0 con 0x7f3a18103c30 2024-09-21T03:53:39.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.233+0000 7f3a167fc640 1 -- 172.21.15.46:0/2000949740 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a08011920 con 0x7f3a18103c30 2024-09-21T03:53:39.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.233+0000 7f3a167fc640 1 -- 172.21.15.46:0/2000949740 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a08010a30 con 0x7f3a18103c30 2024-09-21T03:53:39.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.233+0000 7f3a1f8d0640 1 -- 172.21.15.46:0/2000949740 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a181a8fd0 con 0x7f3a18103c30 2024-09-21T03:53:39.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.234+0000 7f3a1f8d0640 1 -- 172.21.15.46:0/2000949740 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a18104040 con 0x7f3a18103c30 2024-09-21T03:53:39.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.237+0000 7f3a167fc640 1 -- 172.21.15.46:0/2000949740 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f3a08010bd0 con 0x7f3a18103c30 2024-09-21T03:53:39.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.237+0000 7f3a167fc640 1 --2- 172.21.15.46:0/2000949740 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f3a000b65f0 0x7f3a000b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:39.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.237+0000 7f3a1ce6b640 1 --2- 172.21.15.46:0/2000949740 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f3a000b65f0 0x7f3a000b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:39.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.238+0000 7f3a167fc640 1 -- 172.21.15.46:0/2000949740 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f3a080e7b90 con 0x7f3a18103c30 2024-09-21T03:53:39.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.238+0000 7f3a1ce6b640 1 --2- 172.21.15.46:0/2000949740 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f3a000b65f0 0x7f3a000b8b00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c009230 tx=0x7f3a0c031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:39.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.240+0000 7f3a167fc640 1 -- 172.21.15.46:0/2000949740 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3a08016030 con 0x7f3a18103c30 2024-09-21T03:53:39.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:39 smithi046 ceph-mon[30954]: pgmap v278: 97 pgs: 97 active+clean; 634 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.4 KiB/s wr, 6 op/s 2024-09-21T03:53:39.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:39 smithi105 ceph-mon[34773]: pgmap v278: 97 pgs: 97 active+clean; 634 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.4 KiB/s wr, 6 op/s 2024-09-21T03:53:39.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:39 smithi162 ceph-mon[35071]: pgmap v278: 97 pgs: 97 active+clean; 634 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.4 KiB/s wr, 6 op/s 2024-09-21T03:53:39.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.426+0000 7f3a1f8d0640 1 -- 172.21.15.46:0/2000949740 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3a18063800 con 0x7f3a000b65f0 2024-09-21T03:53:39.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.430+0000 7f3a167fc640 1 -- 172.21.15.46:0/2000949740 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258879 (secure 0 0 0) 0x7f3a18063800 con 0x7f3a000b65f0 2024-09-21T03:53:39.435 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:53:39.436 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-09-21T03:53:39.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.433+0000 7f3a1f8d0640 1 -- 172.21.15.46:0/2000949740 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f3a000b65f0 msgr2=0x7f3a000b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:39.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.433+0000 7f3a1f8d0640 1 --2- 172.21.15.46:0/2000949740 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f3a000b65f0 0x7f3a000b8b00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c009230 tx=0x7f3a0c031400 comp rx=0 tx=0).stop 2024-09-21T03:53:39.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.433+0000 7f3a1f8d0640 1 -- 172.21.15.46:0/2000949740 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a18103c30 msgr2=0x7f3a18075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:39.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.433+0000 7f3a1f8d0640 1 --2- 172.21.15.46:0/2000949740 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a18103c30 0x7f3a18075710 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3a0800eab0 tx=0x7f3a0800ef70 comp rx=0 tx=0).stop 2024-09-21T03:53:39.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.434+0000 7f3a1f8d0640 1 -- 172.21.15.46:0/2000949740 shutdown_connections 2024-09-21T03:53:39.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.434+0000 7f3a1f8d0640 1 --2- 172.21.15.46:0/2000949740 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f3a000b65f0 0x7f3a000b8b00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:39.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.434+0000 7f3a1f8d0640 1 --2- 172.21.15.46:0/2000949740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a18109ec0 0x7f3a18076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:39.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.434+0000 7f3a1f8d0640 1 --2- 172.21.15.46:0/2000949740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a18109570 0x7f3a18075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:39.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.434+0000 7f3a1f8d0640 1 --2- 172.21.15.46:0/2000949740 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a18103c30 0x7f3a18075710 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:39.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.434+0000 7f3a1f8d0640 1 -- 172.21.15.46:0/2000949740 >> 172.21.15.46:0/2000949740 conn(0x7f3a1807b8d0 msgr2=0x7f3a18107660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:39.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.434+0000 7f3a1f8d0640 1 -- 172.21.15.46:0/2000949740 shutdown_connections 2024-09-21T03:53:39.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:39.434+0000 7f3a1f8d0640 1 -- 172.21.15.46:0/2000949740 wait complete. 2024-09-21T03:53:40.158 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":278,"stamp":"2024-09-21T03:53:38.037550+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":648705,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":126,"num_read_kb":149,"num_write":203,"num_write_kb":2234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":380280,"kb_used_data":10152,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124561544,"statfs":{"total":1151940427776,"available":1151551021056,"internally_reserved":0,"allocated":10395648,"data_stored":6936431,"data_compressed":175090,"data_compressed_allocated":229376,"data_compressed_original":1957888,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":33022,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":59,"num_write":25,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001929"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034971+0000","last_change":"2024-09-21T03:53:13.835177+0000","last_active":"2024-09-21T03:53:33.034971+0000","last_peered":"2024-09-21T03:53:33.034971+0000","last_clean":"2024-09-21T03:53:33.034971+0000","last_became_active":"2024-09-21T03:53:13.834779+0000","last_became_peered":"2024-09-21T03:53:13.834779+0000","last_unstale":"2024-09-21T03:53:33.034971+0000","last_undegraded":"2024-09-21T03:53:33.034971+0000","last_fullsized":"2024-09-21T03:53:33.034971+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:10.632059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123205+0000","last_change":"2024-09-21T03:53:13.829689+0000","last_active":"2024-09-21T03:53:33.123205+0000","last_peered":"2024-09-21T03:53:33.123205+0000","last_clean":"2024-09-21T03:53:33.123205+0000","last_became_active":"2024-09-21T03:53:13.828732+0000","last_became_peered":"2024-09-21T03:53:13.828732+0000","last_unstale":"2024-09-21T03:53:33.123205+0000","last_undegraded":"2024-09-21T03:53:33.123205+0000","last_fullsized":"2024-09-21T03:53:33.123205+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:35.270218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123057+0000","last_change":"2024-09-21T03:53:13.836545+0000","last_active":"2024-09-21T03:53:33.123057+0000","last_peered":"2024-09-21T03:53:33.123057+0000","last_clean":"2024-09-21T03:53:33.123057+0000","last_became_active":"2024-09-21T03:53:13.835781+0000","last_became_peered":"2024-09-21T03:53:13.835781+0000","last_unstale":"2024-09-21T03:53:33.123057+0000","last_undegraded":"2024-09-21T03:53:33.123057+0000","last_fullsized":"2024-09-21T03:53:33.123057+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:13.130016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123786+0000","last_change":"2024-09-21T03:53:13.832292+0000","last_active":"2024-09-21T03:53:33.123786+0000","last_peered":"2024-09-21T03:53:33.123786+0000","last_clean":"2024-09-21T03:53:33.123786+0000","last_became_active":"2024-09-21T03:53:13.831311+0000","last_became_peered":"2024-09-21T03:53:13.831311+0000","last_unstale":"2024-09-21T03:53:33.123786+0000","last_undegraded":"2024-09-21T03:53:33.123786+0000","last_fullsized":"2024-09-21T03:53:33.123786+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:38:49.425261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123152+0000","last_change":"2024-09-21T03:53:13.825130+0000","last_active":"2024-09-21T03:53:33.123152+0000","last_peered":"2024-09-21T03:53:33.123152+0000","last_clean":"2024-09-21T03:53:33.123152+0000","last_became_active":"2024-09-21T03:53:13.824795+0000","last_became_peered":"2024-09-21T03:53:13.824795+0000","last_unstale":"2024-09-21T03:53:33.123152+0000","last_undegraded":"2024-09-21T03:53:33.123152+0000","last_fullsized":"2024-09-21T03:53:33.123152+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:22.653270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123230+0000","last_change":"2024-09-21T03:53:13.834449+0000","last_active":"2024-09-21T03:53:33.123230+0000","last_peered":"2024-09-21T03:53:33.123230+0000","last_clean":"2024-09-21T03:53:33.123230+0000","last_became_active":"2024-09-21T03:53:13.832727+0000","last_became_peered":"2024-09-21T03:53:13.832727+0000","last_unstale":"2024-09-21T03:53:33.123230+0000","last_undegraded":"2024-09-21T03:53:33.123230+0000","last_fullsized":"2024-09-21T03:53:33.123230+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:36.479962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035845+0000","last_change":"2024-09-21T03:53:13.821938+0000","last_active":"2024-09-21T03:53:33.035845+0000","last_peered":"2024-09-21T03:53:33.035845+0000","last_clean":"2024-09-21T03:53:33.035845+0000","last_became_active":"2024-09-21T03:53:13.821569+0000","last_became_peered":"2024-09-21T03:53:13.821569+0000","last_unstale":"2024-09-21T03:53:33.035845+0000","last_undegraded":"2024-09-21T03:53:33.035845+0000","last_fullsized":"2024-09-21T03:53:33.035845+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:04.309212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122491+0000","last_change":"2024-09-21T03:53:13.833471+0000","last_active":"2024-09-21T03:53:33.122491+0000","last_peered":"2024-09-21T03:53:33.122491+0000","last_clean":"2024-09-21T03:53:33.122491+0000","last_became_active":"2024-09-21T03:53:13.832779+0000","last_became_peered":"2024-09-21T03:53:13.832779+0000","last_unstale":"2024-09-21T03:53:33.122491+0000","last_undegraded":"2024-09-21T03:53:33.122491+0000","last_fullsized":"2024-09-21T03:53:33.122491+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:15.402265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032934+0000","last_change":"2024-09-21T03:53:13.833077+0000","last_active":"2024-09-21T03:53:33.032934+0000","last_peered":"2024-09-21T03:53:33.032934+0000","last_clean":"2024-09-21T03:53:33.032934+0000","last_became_active":"2024-09-21T03:53:13.832625+0000","last_became_peered":"2024-09-21T03:53:13.832625+0000","last_unstale":"2024-09-21T03:53:33.032934+0000","last_undegraded":"2024-09-21T03:53:33.032934+0000","last_fullsized":"2024-09-21T03:53:33.032934+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:13.158754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124857+0000","last_change":"2024-09-21T03:53:13.835417+0000","last_active":"2024-09-21T03:53:33.124857+0000","last_peered":"2024-09-21T03:53:33.124857+0000","last_clean":"2024-09-21T03:53:33.124857+0000","last_became_active":"2024-09-21T03:53:13.835081+0000","last_became_peered":"2024-09-21T03:53:13.835081+0000","last_unstale":"2024-09-21T03:53:33.124857+0000","last_undegraded":"2024-09-21T03:53:33.124857+0000","last_fullsized":"2024-09-21T03:53:33.124857+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:29.239879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036187+0000","last_change":"2024-09-21T03:53:13.836575+0000","last_active":"2024-09-21T03:53:33.036187+0000","last_peered":"2024-09-21T03:53:33.036187+0000","last_clean":"2024-09-21T03:53:33.036187+0000","last_became_active":"2024-09-21T03:53:13.836184+0000","last_became_peered":"2024-09-21T03:53:13.836184+0000","last_unstale":"2024-09-21T03:53:33.036187+0000","last_undegraded":"2024-09-21T03:53:33.036187+0000","last_fullsized":"2024-09-21T03:53:33.036187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:06.602354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.126314+0000","last_change":"2024-09-21T03:53:33.125896+0000","last_active":"2024-09-21T03:53:33.126314+0000","last_peered":"2024-09-21T03:53:33.126314+0000","last_clean":"2024-09-21T03:53:33.126314+0000","last_became_active":"2024-09-21T03:53:33.125488+0000","last_became_peered":"2024-09-21T03:53:33.125488+0000","last_unstale":"2024-09-21T03:53:33.126314+0000","last_undegraded":"2024-09-21T03:53:33.126314+0000","last_fullsized":"2024-09-21T03:53:33.126314+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:09.742892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031708+0000","last_change":"2024-09-21T03:53:13.814729+0000","last_active":"2024-09-21T03:53:33.031708+0000","last_peered":"2024-09-21T03:53:33.031708+0000","last_clean":"2024-09-21T03:53:33.031708+0000","last_became_active":"2024-09-21T03:53:13.814317+0000","last_became_peered":"2024-09-21T03:53:13.814317+0000","last_unstale":"2024-09-21T03:53:33.031708+0000","last_undegraded":"2024-09-21T03:53:33.031708+0000","last_fullsized":"2024-09-21T03:53:33.031708+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:30.779754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122847+0000","last_change":"2024-09-21T03:53:13.833280+0000","last_active":"2024-09-21T03:53:33.122847+0000","last_peered":"2024-09-21T03:53:33.122847+0000","last_clean":"2024-09-21T03:53:33.122847+0000","last_became_active":"2024-09-21T03:53:13.831799+0000","last_became_peered":"2024-09-21T03:53:13.831799+0000","last_unstale":"2024-09-21T03:53:33.122847+0000","last_undegraded":"2024-09-21T03:53:33.122847+0000","last_fullsized":"2024-09-21T03:53:33.122847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:33.923946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122733+0000","last_change":"2024-09-21T03:53:13.832142+0000","last_active":"2024-09-21T03:53:33.122733+0000","last_peered":"2024-09-21T03:53:33.122733+0000","last_clean":"2024-09-21T03:53:33.122733+0000","last_became_active":"2024-09-21T03:53:13.831756+0000","last_became_peered":"2024-09-21T03:53:13.831756+0000","last_unstale":"2024-09-21T03:53:33.122733+0000","last_undegraded":"2024-09-21T03:53:33.122733+0000","last_fullsized":"2024-09-21T03:53:33.122733+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:43.941161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032362+0000","last_change":"2024-09-21T03:53:13.834085+0000","last_active":"2024-09-21T03:53:33.032362+0000","last_peered":"2024-09-21T03:53:33.032362+0000","last_clean":"2024-09-21T03:53:33.032362+0000","last_became_active":"2024-09-21T03:53:13.833668+0000","last_became_peered":"2024-09-21T03:53:13.833668+0000","last_unstale":"2024-09-21T03:53:33.032362+0000","last_undegraded":"2024-09-21T03:53:33.032362+0000","last_fullsized":"2024-09-21T03:53:33.032362+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:08:26.939873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035098+0000","last_change":"2024-09-21T03:53:13.836133+0000","last_active":"2024-09-21T03:53:33.035098+0000","last_peered":"2024-09-21T03:53:33.035098+0000","last_clean":"2024-09-21T03:53:33.035098+0000","last_became_active":"2024-09-21T03:53:13.835681+0000","last_became_peered":"2024-09-21T03:53:13.835681+0000","last_unstale":"2024-09-21T03:53:33.035098+0000","last_undegraded":"2024-09-21T03:53:33.035098+0000","last_fullsized":"2024-09-21T03:53:33.035098+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:02.691622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035103+0000","last_change":"2024-09-21T03:53:13.834069+0000","last_active":"2024-09-21T03:53:33.035103+0000","last_peered":"2024-09-21T03:53:33.035103+0000","last_clean":"2024-09-21T03:53:33.035103+0000","last_became_active":"2024-09-21T03:53:13.833714+0000","last_became_peered":"2024-09-21T03:53:13.833714+0000","last_unstale":"2024-09-21T03:53:33.035103+0000","last_undegraded":"2024-09-21T03:53:33.035103+0000","last_fullsized":"2024-09-21T03:53:33.035103+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:12.479790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.095236+0000","last_change":"2024-09-21T03:53:13.827788+0000","last_active":"2024-09-21T03:53:33.095236+0000","last_peered":"2024-09-21T03:53:33.095236+0000","last_clean":"2024-09-21T03:53:33.095236+0000","last_became_active":"2024-09-21T03:53:13.827461+0000","last_became_peered":"2024-09-21T03:53:13.827461+0000","last_unstale":"2024-09-21T03:53:33.095236+0000","last_undegraded":"2024-09-21T03:53:33.095236+0000","last_fullsized":"2024-09-21T03:53:33.095236+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:38.003243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034635+0000","last_change":"2024-09-21T03:53:13.836880+0000","last_active":"2024-09-21T03:53:33.034635+0000","last_peered":"2024-09-21T03:53:33.034635+0000","last_clean":"2024-09-21T03:53:33.034635+0000","last_became_active":"2024-09-21T03:53:13.836531+0000","last_became_peered":"2024-09-21T03:53:13.836531+0000","last_unstale":"2024-09-21T03:53:33.034635+0000","last_undegraded":"2024-09-21T03:53:33.034635+0000","last_fullsized":"2024-09-21T03:53:33.034635+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:52.825826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031827+0000","last_change":"2024-09-21T03:53:13.823160+0000","last_active":"2024-09-21T03:53:33.031827+0000","last_peered":"2024-09-21T03:53:33.031827+0000","last_clean":"2024-09-21T03:53:33.031827+0000","last_became_active":"2024-09-21T03:53:13.822076+0000","last_became_peered":"2024-09-21T03:53:13.822076+0000","last_unstale":"2024-09-21T03:53:33.031827+0000","last_undegraded":"2024-09-21T03:53:33.031827+0000","last_fullsized":"2024-09-21T03:53:33.031827+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:26.277249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032827+0000","last_change":"2024-09-21T03:53:13.831822+0000","last_active":"2024-09-21T03:53:33.032827+0000","last_peered":"2024-09-21T03:53:33.032827+0000","last_clean":"2024-09-21T03:53:33.032827+0000","last_became_active":"2024-09-21T03:53:13.831395+0000","last_became_peered":"2024-09-21T03:53:13.831395+0000","last_unstale":"2024-09-21T03:53:33.032827+0000","last_undegraded":"2024-09-21T03:53:33.032827+0000","last_fullsized":"2024-09-21T03:53:33.032827+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:48.541339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122588+0000","last_change":"2024-09-21T03:53:13.834576+0000","last_active":"2024-09-21T03:53:33.122588+0000","last_peered":"2024-09-21T03:53:33.122588+0000","last_clean":"2024-09-21T03:53:33.122588+0000","last_became_active":"2024-09-21T03:53:13.834229+0000","last_became_peered":"2024-09-21T03:53:13.834229+0000","last_unstale":"2024-09-21T03:53:33.122588+0000","last_undegraded":"2024-09-21T03:53:33.122588+0000","last_fullsized":"2024-09-21T03:53:33.122588+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:36.101399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040298+0000","last_change":"2024-09-21T03:53:13.824049+0000","last_active":"2024-09-21T03:53:33.040298+0000","last_peered":"2024-09-21T03:53:33.040298+0000","last_clean":"2024-09-21T03:53:33.040298+0000","last_became_active":"2024-09-21T03:53:13.823510+0000","last_became_peered":"2024-09-21T03:53:13.823510+0000","last_unstale":"2024-09-21T03:53:33.040298+0000","last_undegraded":"2024-09-21T03:53:33.040298+0000","last_fullsized":"2024-09-21T03:53:33.040298+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:36.615951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123804+0000","last_change":"2024-09-21T03:53:13.837327+0000","last_active":"2024-09-21T03:53:33.123804+0000","last_peered":"2024-09-21T03:53:33.123804+0000","last_clean":"2024-09-21T03:53:33.123804+0000","last_became_active":"2024-09-21T03:53:13.836940+0000","last_became_peered":"2024-09-21T03:53:13.836940+0000","last_unstale":"2024-09-21T03:53:33.123804+0000","last_undegraded":"2024-09-21T03:53:33.123804+0000","last_fullsized":"2024-09-21T03:53:33.123804+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:49.248838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.095260+0000","last_change":"2024-09-21T03:53:13.829540+0000","last_active":"2024-09-21T03:53:33.095260+0000","last_peered":"2024-09-21T03:53:33.095260+0000","last_clean":"2024-09-21T03:53:33.095260+0000","last_became_active":"2024-09-21T03:53:13.828953+0000","last_became_peered":"2024-09-21T03:53:13.828953+0000","last_unstale":"2024-09-21T03:53:33.095260+0000","last_undegraded":"2024-09-21T03:53:33.095260+0000","last_fullsized":"2024-09-21T03:53:33.095260+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:07.631226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034762+0000","last_change":"2024-09-21T03:53:13.835009+0000","last_active":"2024-09-21T03:53:33.034762+0000","last_peered":"2024-09-21T03:53:33.034762+0000","last_clean":"2024-09-21T03:53:33.034762+0000","last_became_active":"2024-09-21T03:53:13.834454+0000","last_became_peered":"2024-09-21T03:53:13.834454+0000","last_unstale":"2024-09-21T03:53:33.034762+0000","last_undegraded":"2024-09-21T03:53:33.034762+0000","last_fullsized":"2024-09-21T03:53:33.034762+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:34:06.114394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031624+0000","last_change":"2024-09-21T03:53:13.826846+0000","last_active":"2024-09-21T03:53:33.031624+0000","last_peered":"2024-09-21T03:53:33.031624+0000","last_clean":"2024-09-21T03:53:33.031624+0000","last_became_active":"2024-09-21T03:53:13.826460+0000","last_became_peered":"2024-09-21T03:53:13.826460+0000","last_unstale":"2024-09-21T03:53:33.031624+0000","last_undegraded":"2024-09-21T03:53:33.031624+0000","last_fullsized":"2024-09-21T03:53:33.031624+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:24.081091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123429+0000","last_change":"2024-09-21T03:53:13.837134+0000","last_active":"2024-09-21T03:53:33.123429+0000","last_peered":"2024-09-21T03:53:33.123429+0000","last_clean":"2024-09-21T03:53:33.123429+0000","last_became_active":"2024-09-21T03:53:13.836729+0000","last_became_peered":"2024-09-21T03:53:13.836729+0000","last_unstale":"2024-09-21T03:53:33.123429+0000","last_undegraded":"2024-09-21T03:53:33.123429+0000","last_fullsized":"2024-09-21T03:53:33.123429+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:08.677375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.094680+0000","last_change":"2024-09-21T03:53:13.838100+0000","last_active":"2024-09-21T03:53:33.094680+0000","last_peered":"2024-09-21T03:53:33.094680+0000","last_clean":"2024-09-21T03:53:33.094680+0000","last_became_active":"2024-09-21T03:53:13.833495+0000","last_became_peered":"2024-09-21T03:53:13.833495+0000","last_unstale":"2024-09-21T03:53:33.094680+0000","last_undegraded":"2024-09-21T03:53:33.094680+0000","last_fullsized":"2024-09-21T03:53:33.094680+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:52:00.705434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.095021+0000","last_change":"2024-09-21T03:53:13.835806+0000","last_active":"2024-09-21T03:53:33.095021+0000","last_peered":"2024-09-21T03:53:33.095021+0000","last_clean":"2024-09-21T03:53:33.095021+0000","last_became_active":"2024-09-21T03:53:13.835453+0000","last_became_peered":"2024-09-21T03:53:13.835453+0000","last_unstale":"2024-09-21T03:53:33.095021+0000","last_undegraded":"2024-09-21T03:53:33.095021+0000","last_fullsized":"2024-09-21T03:53:33.095021+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:56:16.296808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034530+0000","last_change":"2024-09-21T03:53:13.831171+0000","last_active":"2024-09-21T03:53:33.034530+0000","last_peered":"2024-09-21T03:53:33.034530+0000","last_clean":"2024-09-21T03:53:33.034530+0000","last_became_active":"2024-09-21T03:53:13.830734+0000","last_became_peered":"2024-09-21T03:53:13.830734+0000","last_unstale":"2024-09-21T03:53:33.034530+0000","last_undegraded":"2024-09-21T03:53:33.034530+0000","last_fullsized":"2024-09-21T03:53:33.034530+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:00:56.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123100+0000","last_change":"2024-09-21T03:53:13.820580+0000","last_active":"2024-09-21T03:53:33.123100+0000","last_peered":"2024-09-21T03:53:33.123100+0000","last_clean":"2024-09-21T03:53:33.123100+0000","last_became_active":"2024-09-21T03:53:13.820237+0000","last_became_peered":"2024-09-21T03:53:13.820237+0000","last_unstale":"2024-09-21T03:53:33.123100+0000","last_undegraded":"2024-09-21T03:53:33.123100+0000","last_fullsized":"2024-09-21T03:53:33.123100+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:15.067629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040549+0000","last_change":"2024-09-21T03:53:11.804667+0000","last_active":"2024-09-21T03:53:33.040549+0000","last_peered":"2024-09-21T03:53:33.040549+0000","last_clean":"2024-09-21T03:53:33.040549+0000","last_became_active":"2024-09-21T03:53:11.804231+0000","last_became_peered":"2024-09-21T03:53:11.804231+0000","last_unstale":"2024-09-21T03:53:33.040549+0000","last_undegraded":"2024-09-21T03:53:33.040549+0000","last_fullsized":"2024-09-21T03:53:33.040549+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:36.425699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040361+0000","last_change":"2024-09-21T03:53:13.831602+0000","last_active":"2024-09-21T03:53:33.040361+0000","last_peered":"2024-09-21T03:53:33.040361+0000","last_clean":"2024-09-21T03:53:33.040361+0000","last_became_active":"2024-09-21T03:53:13.831274+0000","last_became_peered":"2024-09-21T03:53:13.831274+0000","last_unstale":"2024-09-21T03:53:33.040361+0000","last_undegraded":"2024-09-21T03:53:33.040361+0000","last_fullsized":"2024-09-21T03:53:33.040361+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:33.603025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123276+0000","last_change":"2024-09-21T03:53:11.807722+0000","last_active":"2024-09-21T03:53:33.123276+0000","last_peered":"2024-09-21T03:53:33.123276+0000","last_clean":"2024-09-21T03:53:33.123276+0000","last_became_active":"2024-09-21T03:53:11.807294+0000","last_became_peered":"2024-09-21T03:53:11.807294+0000","last_unstale":"2024-09-21T03:53:33.123276+0000","last_undegraded":"2024-09-21T03:53:33.123276+0000","last_fullsized":"2024-09-21T03:53:33.123276+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:59.696572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031405+0000","last_change":"2024-09-21T03:53:11.803680+0000","last_active":"2024-09-21T03:53:33.031405+0000","last_peered":"2024-09-21T03:53:33.031405+0000","last_clean":"2024-09-21T03:53:33.031405+0000","last_became_active":"2024-09-21T03:53:11.803310+0000","last_became_peered":"2024-09-21T03:53:11.803310+0000","last_unstale":"2024-09-21T03:53:33.031405+0000","last_undegraded":"2024-09-21T03:53:33.031405+0000","last_fullsized":"2024-09-21T03:53:33.031405+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:25.276545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122501+0000","last_change":"2024-09-21T03:53:13.834847+0000","last_active":"2024-09-21T03:53:33.122501+0000","last_peered":"2024-09-21T03:53:33.122501+0000","last_clean":"2024-09-21T03:53:33.122501+0000","last_became_active":"2024-09-21T03:53:13.834448+0000","last_became_peered":"2024-09-21T03:53:13.834448+0000","last_unstale":"2024-09-21T03:53:33.122501+0000","last_undegraded":"2024-09-21T03:53:33.122501+0000","last_fullsized":"2024-09-21T03:53:33.122501+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:47:39.213364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040606+0000","last_change":"2024-09-21T03:53:11.807372+0000","last_active":"2024-09-21T03:53:33.040606+0000","last_peered":"2024-09-21T03:53:33.040606+0000","last_clean":"2024-09-21T03:53:33.040606+0000","last_became_active":"2024-09-21T03:53:11.807064+0000","last_became_peered":"2024-09-21T03:53:11.807064+0000","last_unstale":"2024-09-21T03:53:33.040606+0000","last_undegraded":"2024-09-21T03:53:33.040606+0000","last_fullsized":"2024-09-21T03:53:33.040606+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:00.743039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034954+0000","last_change":"2024-09-21T03:53:13.821169+0000","last_active":"2024-09-21T03:53:33.034954+0000","last_peered":"2024-09-21T03:53:33.034954+0000","last_clean":"2024-09-21T03:53:33.034954+0000","last_became_active":"2024-09-21T03:53:13.820810+0000","last_became_peered":"2024-09-21T03:53:13.820810+0000","last_unstale":"2024-09-21T03:53:33.034954+0000","last_undegraded":"2024-09-21T03:53:33.034954+0000","last_fullsized":"2024-09-21T03:53:33.034954+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:54.568383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124708+0000","last_change":"2024-09-21T03:53:11.805663+0000","last_active":"2024-09-21T03:53:33.124708+0000","last_peered":"2024-09-21T03:53:33.124708+0000","last_clean":"2024-09-21T03:53:33.124708+0000","last_became_active":"2024-09-21T03:53:11.805099+0000","last_became_peered":"2024-09-21T03:53:11.805099+0000","last_unstale":"2024-09-21T03:53:33.124708+0000","last_undegraded":"2024-09-21T03:53:33.124708+0000","last_fullsized":"2024-09-21T03:53:33.124708+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:47.306589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032728+0000","last_change":"2024-09-21T03:53:13.827745+0000","last_active":"2024-09-21T03:53:33.032728+0000","last_peered":"2024-09-21T03:53:33.032728+0000","last_clean":"2024-09-21T03:53:33.032728+0000","last_became_active":"2024-09-21T03:53:13.827229+0000","last_became_peered":"2024-09-21T03:53:13.827229+0000","last_unstale":"2024-09-21T03:53:33.032728+0000","last_undegraded":"2024-09-21T03:53:33.032728+0000","last_fullsized":"2024-09-21T03:53:33.032728+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:53.760919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036288+0000","last_change":"2024-09-21T03:53:11.803697+0000","last_active":"2024-09-21T03:53:33.036288+0000","last_peered":"2024-09-21T03:53:33.036288+0000","last_clean":"2024-09-21T03:53:33.036288+0000","last_became_active":"2024-09-21T03:53:11.801539+0000","last_became_peered":"2024-09-21T03:53:11.801539+0000","last_unstale":"2024-09-21T03:53:33.036288+0000","last_undegraded":"2024-09-21T03:53:33.036288+0000","last_fullsized":"2024-09-21T03:53:33.036288+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:53.096622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123637+0000","last_change":"2024-09-21T03:53:13.832771+0000","last_active":"2024-09-21T03:53:33.123637+0000","last_peered":"2024-09-21T03:53:33.123637+0000","last_clean":"2024-09-21T03:53:33.123637+0000","last_became_active":"2024-09-21T03:53:13.832414+0000","last_became_peered":"2024-09-21T03:53:13.832414+0000","last_unstale":"2024-09-21T03:53:33.123637+0000","last_undegraded":"2024-09-21T03:53:33.123637+0000","last_fullsized":"2024-09-21T03:53:33.123637+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:58:42.287731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.041017+0000","last_change":"2024-09-21T03:53:12.604482+0000","last_active":"2024-09-21T03:53:33.041017+0000","last_peered":"2024-09-21T03:53:33.041017+0000","last_clean":"2024-09-21T03:53:33.041017+0000","last_became_active":"2024-09-21T03:53:12.603973+0000","last_became_peered":"2024-09-21T03:53:12.603973+0000","last_unstale":"2024-09-21T03:53:33.041017+0000","last_undegraded":"2024-09-21T03:53:33.041017+0000","last_fullsized":"2024-09-21T03:53:33.041017+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:11.932329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032506+0000","last_change":"2024-09-21T03:53:13.842106+0000","last_active":"2024-09-21T03:53:33.032506+0000","last_peered":"2024-09-21T03:53:33.032506+0000","last_clean":"2024-09-21T03:53:33.032506+0000","last_became_active":"2024-09-21T03:53:13.841758+0000","last_became_peered":"2024-09-21T03:53:13.841758+0000","last_unstale":"2024-09-21T03:53:33.032506+0000","last_undegraded":"2024-09-21T03:53:33.032506+0000","last_fullsized":"2024-09-21T03:53:33.032506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:37.045045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'25","reported_seq":87,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:36.904769+0000","last_change":"2024-09-21T03:53:11.805385+0000","last_active":"2024-09-21T03:53:36.904769+0000","last_peered":"2024-09-21T03:53:36.904769+0000","last_clean":"2024-09-21T03:53:36.904769+0000","last_became_active":"2024-09-21T03:53:11.804958+0000","last_became_peered":"2024-09-21T03:53:11.804958+0000","last_unstale":"2024-09-21T03:53:36.904769+0000","last_undegraded":"2024-09-21T03:53:36.904769+0000","last_fullsized":"2024-09-21T03:53:36.904769+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:59.197216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57305,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":39,"num_read_kb":74,"num_write":25,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123691+0000","last_change":"2024-09-21T03:53:13.828095+0000","last_active":"2024-09-21T03:53:33.123691+0000","last_peered":"2024-09-21T03:53:33.123691+0000","last_clean":"2024-09-21T03:53:33.123691+0000","last_became_active":"2024-09-21T03:53:13.827761+0000","last_became_peered":"2024-09-21T03:53:13.827761+0000","last_unstale":"2024-09-21T03:53:33.123691+0000","last_undegraded":"2024-09-21T03:53:33.123691+0000","last_fullsized":"2024-09-21T03:53:33.123691+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:42:28.981463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.094939+0000","last_change":"2024-09-21T03:53:11.801611+0000","last_active":"2024-09-21T03:53:33.094939+0000","last_peered":"2024-09-21T03:53:33.094939+0000","last_clean":"2024-09-21T03:53:33.094939+0000","last_became_active":"2024-09-21T03:53:11.801185+0000","last_became_peered":"2024-09-21T03:53:11.801185+0000","last_unstale":"2024-09-21T03:53:33.094939+0000","last_undegraded":"2024-09-21T03:53:33.094939+0000","last_fullsized":"2024-09-21T03:53:33.094939+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:16.990963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031447+0000","last_change":"2024-09-21T03:53:13.827393+0000","last_active":"2024-09-21T03:53:33.031447+0000","last_peered":"2024-09-21T03:53:33.031447+0000","last_clean":"2024-09-21T03:53:33.031447+0000","last_became_active":"2024-09-21T03:53:13.826912+0000","last_became_peered":"2024-09-21T03:53:13.826912+0000","last_unstale":"2024-09-21T03:53:33.031447+0000","last_undegraded":"2024-09-21T03:53:33.031447+0000","last_fullsized":"2024-09-21T03:53:33.031447+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:52.313989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040555+0000","last_change":"2024-09-21T03:53:11.805437+0000","last_active":"2024-09-21T03:53:33.040555+0000","last_peered":"2024-09-21T03:53:33.040555+0000","last_clean":"2024-09-21T03:53:33.040555+0000","last_became_active":"2024-09-21T03:53:11.805048+0000","last_became_peered":"2024-09-21T03:53:11.805048+0000","last_unstale":"2024-09-21T03:53:33.040555+0000","last_undegraded":"2024-09-21T03:53:33.040555+0000","last_fullsized":"2024-09-21T03:53:33.040555+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:03.288694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036034+0000","last_change":"2024-09-21T03:53:13.836917+0000","last_active":"2024-09-21T03:53:33.036034+0000","last_peered":"2024-09-21T03:53:33.036034+0000","last_clean":"2024-09-21T03:53:33.036034+0000","last_became_active":"2024-09-21T03:53:13.836514+0000","last_became_peered":"2024-09-21T03:53:13.836514+0000","last_unstale":"2024-09-21T03:53:33.036034+0000","last_undegraded":"2024-09-21T03:53:33.036034+0000","last_fullsized":"2024-09-21T03:53:33.036034+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:17.512017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123559+0000","last_change":"2024-09-21T03:53:11.808403+0000","last_active":"2024-09-21T03:53:33.123559+0000","last_peered":"2024-09-21T03:53:33.123559+0000","last_clean":"2024-09-21T03:53:33.123559+0000","last_became_active":"2024-09-21T03:53:11.807895+0000","last_became_peered":"2024-09-21T03:53:11.807895+0000","last_unstale":"2024-09-21T03:53:33.123559+0000","last_undegraded":"2024-09-21T03:53:33.123559+0000","last_fullsized":"2024-09-21T03:53:33.123559+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:33.548683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.125777+0000","last_change":"2024-09-21T03:53:33.125556+0000","last_active":"2024-09-21T03:53:33.125777+0000","last_peered":"2024-09-21T03:53:33.125777+0000","last_clean":"2024-09-21T03:53:33.125777+0000","last_became_active":"2024-09-21T03:53:33.125084+0000","last_became_peered":"2024-09-21T03:53:33.125084+0000","last_unstale":"2024-09-21T03:53:33.125777+0000","last_undegraded":"2024-09-21T03:53:33.125777+0000","last_fullsized":"2024-09-21T03:53:33.125777+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:40:23.997329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'8","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123320+0000","last_change":"2024-09-21T03:53:12.605672+0000","last_active":"2024-09-21T03:53:33.123320+0000","last_peered":"2024-09-21T03:53:33.123320+0000","last_clean":"2024-09-21T03:53:33.123320+0000","last_became_active":"2024-09-21T03:53:12.604644+0000","last_became_peered":"2024-09-21T03:53:12.604644+0000","last_unstale":"2024-09-21T03:53:33.123320+0000","last_undegraded":"2024-09-21T03:53:33.123320+0000","last_fullsized":"2024-09-21T03:53:33.123320+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:44.810762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040395+0000","last_change":"2024-09-21T03:53:13.833861+0000","last_active":"2024-09-21T03:53:33.040395+0000","last_peered":"2024-09-21T03:53:33.040395+0000","last_clean":"2024-09-21T03:53:33.040395+0000","last_became_active":"2024-09-21T03:53:13.832900+0000","last_became_peered":"2024-09-21T03:53:13.832900+0000","last_unstale":"2024-09-21T03:53:33.040395+0000","last_undegraded":"2024-09-21T03:53:33.040395+0000","last_fullsized":"2024-09-21T03:53:33.040395+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:12.047171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124020+0000","last_change":"2024-09-21T03:53:11.799844+0000","last_active":"2024-09-21T03:53:33.124020+0000","last_peered":"2024-09-21T03:53:33.124020+0000","last_clean":"2024-09-21T03:53:33.124020+0000","last_became_active":"2024-09-21T03:53:11.799412+0000","last_became_peered":"2024-09-21T03:53:11.799412+0000","last_unstale":"2024-09-21T03:53:33.124020+0000","last_undegraded":"2024-09-21T03:53:33.124020+0000","last_fullsized":"2024-09-21T03:53:33.124020+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:49.826500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034751+0000","last_change":"2024-09-21T03:53:13.836690+0000","last_active":"2024-09-21T03:53:33.034751+0000","last_peered":"2024-09-21T03:53:33.034751+0000","last_clean":"2024-09-21T03:53:33.034751+0000","last_became_active":"2024-09-21T03:53:13.836337+0000","last_became_peered":"2024-09-21T03:53:13.836337+0000","last_unstale":"2024-09-21T03:53:33.034751+0000","last_undegraded":"2024-09-21T03:53:33.034751+0000","last_fullsized":"2024-09-21T03:53:33.034751+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:15.999869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031625+0000","last_change":"2024-09-21T03:53:11.799597+0000","last_active":"2024-09-21T03:53:33.031625+0000","last_peered":"2024-09-21T03:53:33.031625+0000","last_clean":"2024-09-21T03:53:33.031625+0000","last_became_active":"2024-09-21T03:53:11.799175+0000","last_became_peered":"2024-09-21T03:53:11.799175+0000","last_unstale":"2024-09-21T03:53:33.031625+0000","last_undegraded":"2024-09-21T03:53:33.031625+0000","last_fullsized":"2024-09-21T03:53:33.031625+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:41.668587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036592+0000","last_change":"2024-09-21T03:53:13.831228+0000","last_active":"2024-09-21T03:53:33.036592+0000","last_peered":"2024-09-21T03:53:33.036592+0000","last_clean":"2024-09-21T03:53:33.036592+0000","last_became_active":"2024-09-21T03:53:13.830880+0000","last_became_peered":"2024-09-21T03:53:13.830880+0000","last_unstale":"2024-09-21T03:53:33.036592+0000","last_undegraded":"2024-09-21T03:53:33.036592+0000","last_fullsized":"2024-09-21T03:53:33.036592+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:45.770622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.041069+0000","last_change":"2024-09-21T03:53:11.803560+0000","last_active":"2024-09-21T03:53:33.041069+0000","last_peered":"2024-09-21T03:53:33.041069+0000","last_clean":"2024-09-21T03:53:33.041069+0000","last_became_active":"2024-09-21T03:53:11.803090+0000","last_became_peered":"2024-09-21T03:53:11.803090+0000","last_unstale":"2024-09-21T03:53:33.041069+0000","last_undegraded":"2024-09-21T03:53:33.041069+0000","last_fullsized":"2024-09-21T03:53:33.041069+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:23.993694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036373+0000","last_change":"2024-09-21T03:53:13.825907+0000","last_active":"2024-09-21T03:53:33.036373+0000","last_peered":"2024-09-21T03:53:33.036373+0000","last_clean":"2024-09-21T03:53:33.036373+0000","last_became_active":"2024-09-21T03:53:13.825485+0000","last_became_peered":"2024-09-21T03:53:13.825485+0000","last_unstale":"2024-09-21T03:53:33.036373+0000","last_undegraded":"2024-09-21T03:53:33.036373+0000","last_fullsized":"2024-09-21T03:53:33.036373+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:39.166215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.095338+0000","last_change":"2024-09-21T03:53:12.605947+0000","last_active":"2024-09-21T03:53:33.095338+0000","last_peered":"2024-09-21T03:53:33.095338+0000","last_clean":"2024-09-21T03:53:33.095338+0000","last_became_active":"2024-09-21T03:53:12.604516+0000","last_became_peered":"2024-09-21T03:53:12.604516+0000","last_unstale":"2024-09-21T03:53:33.095338+0000","last_undegraded":"2024-09-21T03:53:33.095338+0000","last_fullsized":"2024-09-21T03:53:33.095338+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:42.500174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036503+0000","last_change":"2024-09-21T03:53:13.834108+0000","last_active":"2024-09-21T03:53:33.036503+0000","last_peered":"2024-09-21T03:53:33.036503+0000","last_clean":"2024-09-21T03:53:33.036503+0000","last_became_active":"2024-09-21T03:53:13.833734+0000","last_became_peered":"2024-09-21T03:53:13.833734+0000","last_unstale":"2024-09-21T03:53:33.036503+0000","last_undegraded":"2024-09-21T03:53:33.036503+0000","last_fullsized":"2024-09-21T03:53:33.036503+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:39.032450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":97,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036156+0000","last_change":"2024-09-21T03:51:59.139085+0000","last_active":"2024-09-21T03:53:33.036156+0000","last_peered":"2024-09-21T03:53:33.036156+0000","last_clean":"2024-09-21T03:53:33.036156+0000","last_became_active":"2024-09-21T03:51:59.026450+0000","last_became_peered":"2024-09-21T03:51:59.026450+0000","last_unstale":"2024-09-21T03:53:33.036156+0000","last_undegraded":"2024-09-21T03:53:33.036156+0000","last_fullsized":"2024-09-21T03:53:33.036156+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:48:31.139457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:48:31.139457+0000","last_clean_scrub_stamp":"2024-09-21T03:48:31.139457+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:54.047170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123454+0000","last_change":"2024-09-21T03:53:11.805792+0000","last_active":"2024-09-21T03:53:33.123454+0000","last_peered":"2024-09-21T03:53:33.123454+0000","last_clean":"2024-09-21T03:53:33.123454+0000","last_became_active":"2024-09-21T03:53:11.805375+0000","last_became_peered":"2024-09-21T03:53:11.805375+0000","last_unstale":"2024-09-21T03:53:33.123454+0000","last_undegraded":"2024-09-21T03:53:33.123454+0000","last_fullsized":"2024-09-21T03:53:33.123454+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:55.466187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122971+0000","last_change":"2024-09-21T03:53:13.835211+0000","last_active":"2024-09-21T03:53:33.122971+0000","last_peered":"2024-09-21T03:53:33.122971+0000","last_clean":"2024-09-21T03:53:33.122971+0000","last_became_active":"2024-09-21T03:53:13.833649+0000","last_became_peered":"2024-09-21T03:53:13.833649+0000","last_unstale":"2024-09-21T03:53:33.122971+0000","last_undegraded":"2024-09-21T03:53:33.122971+0000","last_fullsized":"2024-09-21T03:53:33.122971+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:57.962287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035996+0000","last_change":"2024-09-21T03:53:11.801670+0000","last_active":"2024-09-21T03:53:33.035996+0000","last_peered":"2024-09-21T03:53:33.035996+0000","last_clean":"2024-09-21T03:53:33.035996+0000","last_became_active":"2024-09-21T03:53:11.801291+0000","last_became_peered":"2024-09-21T03:53:11.801291+0000","last_unstale":"2024-09-21T03:53:33.035996+0000","last_undegraded":"2024-09-21T03:53:33.035996+0000","last_fullsized":"2024-09-21T03:53:33.035996+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:37.450592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.096813+0000","last_change":"2024-09-21T03:53:33.096727+0000","last_active":"2024-09-21T03:53:33.096813+0000","last_peered":"2024-09-21T03:53:33.096813+0000","last_clean":"2024-09-21T03:53:33.096813+0000","last_became_active":"2024-09-21T03:53:33.096234+0000","last_became_peered":"2024-09-21T03:53:33.096234+0000","last_unstale":"2024-09-21T03:53:33.096813+0000","last_undegraded":"2024-09-21T03:53:33.096813+0000","last_fullsized":"2024-09-21T03:53:33.096813+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:56:24.375992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031550+0000","last_change":"2024-09-21T03:53:12.604170+0000","last_active":"2024-09-21T03:53:33.031550+0000","last_peered":"2024-09-21T03:53:33.031550+0000","last_clean":"2024-09-21T03:53:33.031550+0000","last_became_active":"2024-09-21T03:53:12.603765+0000","last_became_peered":"2024-09-21T03:53:12.603765+0000","last_unstale":"2024-09-21T03:53:33.031550+0000","last_undegraded":"2024-09-21T03:53:33.031550+0000","last_fullsized":"2024-09-21T03:53:33.031550+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:08.606037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.125077+0000","last_change":"2024-09-21T03:53:33.124969+0000","last_active":"2024-09-21T03:53:33.125077+0000","last_peered":"2024-09-21T03:53:33.125077+0000","last_clean":"2024-09-21T03:53:33.125077+0000","last_became_active":"2024-09-21T03:53:33.124496+0000","last_became_peered":"2024-09-21T03:53:33.124496+0000","last_unstale":"2024-09-21T03:53:33.125077+0000","last_undegraded":"2024-09-21T03:53:33.125077+0000","last_fullsized":"2024-09-21T03:53:33.125077+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:56.730146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036128+0000","last_change":"2024-09-21T03:53:11.803316+0000","last_active":"2024-09-21T03:53:33.036128+0000","last_peered":"2024-09-21T03:53:33.036128+0000","last_clean":"2024-09-21T03:53:33.036128+0000","last_became_active":"2024-09-21T03:53:11.801976+0000","last_became_peered":"2024-09-21T03:53:11.801976+0000","last_unstale":"2024-09-21T03:53:33.036128+0000","last_undegraded":"2024-09-21T03:53:33.036128+0000","last_fullsized":"2024-09-21T03:53:33.036128+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:43.596037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124177+0000","last_change":"2024-09-21T03:53:13.838006+0000","last_active":"2024-09-21T03:53:33.124177+0000","last_peered":"2024-09-21T03:53:33.124177+0000","last_clean":"2024-09-21T03:53:33.124177+0000","last_became_active":"2024-09-21T03:53:13.835903+0000","last_became_peered":"2024-09-21T03:53:13.835903+0000","last_unstale":"2024-09-21T03:53:33.124177+0000","last_undegraded":"2024-09-21T03:53:33.124177+0000","last_fullsized":"2024-09-21T03:53:33.124177+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:54:56.730044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124836+0000","last_change":"2024-09-21T03:53:33.124720+0000","last_active":"2024-09-21T03:53:33.124836+0000","last_peered":"2024-09-21T03:53:33.124836+0000","last_clean":"2024-09-21T03:53:33.124836+0000","last_became_active":"2024-09-21T03:53:33.124232+0000","last_became_peered":"2024-09-21T03:53:33.124232+0000","last_unstale":"2024-09-21T03:53:33.124836+0000","last_undegraded":"2024-09-21T03:53:33.124836+0000","last_fullsized":"2024-09-21T03:53:33.124836+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:23.810493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124631+0000","last_change":"2024-09-21T03:53:13.827805+0000","last_active":"2024-09-21T03:53:33.124631+0000","last_peered":"2024-09-21T03:53:33.124631+0000","last_clean":"2024-09-21T03:53:33.124631+0000","last_became_active":"2024-09-21T03:53:13.827368+0000","last_became_peered":"2024-09-21T03:53:13.827368+0000","last_unstale":"2024-09-21T03:53:33.124631+0000","last_undegraded":"2024-09-21T03:53:33.124631+0000","last_fullsized":"2024-09-21T03:53:33.124631+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:24.539396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123881+0000","last_change":"2024-09-21T03:53:12.605032+0000","last_active":"2024-09-21T03:53:33.123881+0000","last_peered":"2024-09-21T03:53:33.123881+0000","last_clean":"2024-09-21T03:53:33.123881+0000","last_became_active":"2024-09-21T03:53:12.604561+0000","last_became_peered":"2024-09-21T03:53:12.604561+0000","last_unstale":"2024-09-21T03:53:33.123881+0000","last_undegraded":"2024-09-21T03:53:33.123881+0000","last_fullsized":"2024-09-21T03:53:33.123881+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:20.361768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031744+0000","last_change":"2024-09-21T03:53:13.821539+0000","last_active":"2024-09-21T03:53:33.031744+0000","last_peered":"2024-09-21T03:53:33.031744+0000","last_clean":"2024-09-21T03:53:33.031744+0000","last_became_active":"2024-09-21T03:53:13.821196+0000","last_became_peered":"2024-09-21T03:53:13.821196+0000","last_unstale":"2024-09-21T03:53:33.031744+0000","last_undegraded":"2024-09-21T03:53:33.031744+0000","last_fullsized":"2024-09-21T03:53:33.031744+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:00.627993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'8","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.827448+0000","last_change":"2024-09-21T03:53:11.799669+0000","last_active":"2024-09-21T03:53:33.827448+0000","last_peered":"2024-09-21T03:53:33.827448+0000","last_clean":"2024-09-21T03:53:33.827448+0000","last_became_active":"2024-09-21T03:53:11.799355+0000","last_became_peered":"2024-09-21T03:53:11.799355+0000","last_unstale":"2024-09-21T03:53:33.827448+0000","last_undegraded":"2024-09-21T03:53:33.827448+0000","last_fullsized":"2024-09-21T03:53:33.827448+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:33.032206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123797+0000","last_change":"2024-09-21T03:53:13.828551+0000","last_active":"2024-09-21T03:53:33.123797+0000","last_peered":"2024-09-21T03:53:33.123797+0000","last_clean":"2024-09-21T03:53:33.123797+0000","last_became_active":"2024-09-21T03:53:13.828185+0000","last_became_peered":"2024-09-21T03:53:13.828185+0000","last_unstale":"2024-09-21T03:53:33.123797+0000","last_undegraded":"2024-09-21T03:53:33.123797+0000","last_fullsized":"2024-09-21T03:53:33.123797+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:31.852755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124078+0000","last_change":"2024-09-21T03:53:12.279823+0000","last_active":"2024-09-21T03:53:33.124078+0000","last_peered":"2024-09-21T03:53:33.124078+0000","last_clean":"2024-09-21T03:53:33.124078+0000","last_became_active":"2024-09-21T03:53:12.279384+0000","last_became_peered":"2024-09-21T03:53:12.279384+0000","last_unstale":"2024-09-21T03:53:33.124078+0000","last_undegraded":"2024-09-21T03:53:33.124078+0000","last_fullsized":"2024-09-21T03:53:33.124078+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:42.568690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123319+0000","last_change":"2024-09-21T03:53:13.831041+0000","last_active":"2024-09-21T03:53:33.123319+0000","last_peered":"2024-09-21T03:53:33.123319+0000","last_clean":"2024-09-21T03:53:33.123319+0000","last_became_active":"2024-09-21T03:53:13.830654+0000","last_became_peered":"2024-09-21T03:53:13.830654+0000","last_unstale":"2024-09-21T03:53:33.123319+0000","last_undegraded":"2024-09-21T03:53:33.123319+0000","last_fullsized":"2024-09-21T03:53:33.123319+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:04.815719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032478+0000","last_change":"2024-09-21T03:53:12.604949+0000","last_active":"2024-09-21T03:53:33.032478+0000","last_peered":"2024-09-21T03:53:33.032478+0000","last_clean":"2024-09-21T03:53:33.032478+0000","last_became_active":"2024-09-21T03:53:12.604516+0000","last_became_peered":"2024-09-21T03:53:12.604516+0000","last_unstale":"2024-09-21T03:53:33.032478+0000","last_undegraded":"2024-09-21T03:53:33.032478+0000","last_fullsized":"2024-09-21T03:53:33.032478+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:33.964125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123050+0000","last_change":"2024-09-21T03:53:13.834813+0000","last_active":"2024-09-21T03:53:33.123050+0000","last_peered":"2024-09-21T03:53:33.123050+0000","last_clean":"2024-09-21T03:53:33.123050+0000","last_became_active":"2024-09-21T03:53:13.834436+0000","last_became_peered":"2024-09-21T03:53:13.834436+0000","last_unstale":"2024-09-21T03:53:33.123050+0000","last_undegraded":"2024-09-21T03:53:33.123050+0000","last_fullsized":"2024-09-21T03:53:33.123050+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:42:40.990668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122665+0000","last_change":"2024-09-21T03:53:11.801828+0000","last_active":"2024-09-21T03:53:33.122665+0000","last_peered":"2024-09-21T03:53:33.122665+0000","last_clean":"2024-09-21T03:53:33.122665+0000","last_became_active":"2024-09-21T03:53:11.800969+0000","last_became_peered":"2024-09-21T03:53:11.800969+0000","last_unstale":"2024-09-21T03:53:33.122665+0000","last_undegraded":"2024-09-21T03:53:33.122665+0000","last_fullsized":"2024-09-21T03:53:33.122665+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:36.117523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034772+0000","last_change":"2024-09-21T03:53:13.835393+0000","last_active":"2024-09-21T03:53:33.034772+0000","last_peered":"2024-09-21T03:53:33.034772+0000","last_clean":"2024-09-21T03:53:33.034772+0000","last_became_active":"2024-09-21T03:53:13.834541+0000","last_became_peered":"2024-09-21T03:53:13.834541+0000","last_unstale":"2024-09-21T03:53:33.034772+0000","last_undegraded":"2024-09-21T03:53:33.034772+0000","last_fullsized":"2024-09-21T03:53:33.034772+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:40.140004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.125328+0000","last_change":"2024-09-21T03:53:33.124524+0000","last_active":"2024-09-21T03:53:33.125328+0000","last_peered":"2024-09-21T03:53:33.125328+0000","last_clean":"2024-09-21T03:53:33.125328+0000","last_became_active":"2024-09-21T03:53:33.123945+0000","last_became_peered":"2024-09-21T03:53:33.123945+0000","last_unstale":"2024-09-21T03:53:33.125328+0000","last_undegraded":"2024-09-21T03:53:33.125328+0000","last_fullsized":"2024-09-21T03:53:33.125328+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:50.967123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122926+0000","last_change":"2024-09-21T03:53:13.832597+0000","last_active":"2024-09-21T03:53:33.122926+0000","last_peered":"2024-09-21T03:53:33.122926+0000","last_clean":"2024-09-21T03:53:33.122926+0000","last_became_active":"2024-09-21T03:53:13.832237+0000","last_became_peered":"2024-09-21T03:53:13.832237+0000","last_unstale":"2024-09-21T03:53:33.122926+0000","last_undegraded":"2024-09-21T03:53:33.122926+0000","last_fullsized":"2024-09-21T03:53:33.122926+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:31.907478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123185+0000","last_change":"2024-09-21T03:53:11.804875+0000","last_active":"2024-09-21T03:53:33.123185+0000","last_peered":"2024-09-21T03:53:33.123185+0000","last_clean":"2024-09-21T03:53:33.123185+0000","last_became_active":"2024-09-21T03:53:11.804320+0000","last_became_peered":"2024-09-21T03:53:11.804320+0000","last_unstale":"2024-09-21T03:53:33.123185+0000","last_undegraded":"2024-09-21T03:53:33.123185+0000","last_fullsized":"2024-09-21T03:53:33.123185+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:37:58.747573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035965+0000","last_change":"2024-09-21T03:53:13.837804+0000","last_active":"2024-09-21T03:53:33.035965+0000","last_peered":"2024-09-21T03:53:33.035965+0000","last_clean":"2024-09-21T03:53:33.035965+0000","last_became_active":"2024-09-21T03:53:13.837440+0000","last_became_peered":"2024-09-21T03:53:13.837440+0000","last_unstale":"2024-09-21T03:53:33.035965+0000","last_undegraded":"2024-09-21T03:53:33.035965+0000","last_fullsized":"2024-09-21T03:53:33.035965+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:15.471544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040923+0000","last_change":"2024-09-21T03:53:13.833231+0000","last_active":"2024-09-21T03:53:33.040923+0000","last_peered":"2024-09-21T03:53:33.040923+0000","last_clean":"2024-09-21T03:53:33.040923+0000","last_became_active":"2024-09-21T03:53:13.832908+0000","last_became_peered":"2024-09-21T03:53:13.832908+0000","last_unstale":"2024-09-21T03:53:33.040923+0000","last_undegraded":"2024-09-21T03:53:33.040923+0000","last_fullsized":"2024-09-21T03:53:33.040923+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:40.191231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123570+0000","last_change":"2024-09-21T03:53:11.802237+0000","last_active":"2024-09-21T03:53:33.123570+0000","last_peered":"2024-09-21T03:53:33.123570+0000","last_clean":"2024-09-21T03:53:33.123570+0000","last_became_active":"2024-09-21T03:53:11.801845+0000","last_became_peered":"2024-09-21T03:53:11.801845+0000","last_unstale":"2024-09-21T03:53:33.123570+0000","last_undegraded":"2024-09-21T03:53:33.123570+0000","last_fullsized":"2024-09-21T03:53:33.123570+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:34.714908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032488+0000","last_change":"2024-09-21T03:53:13.831495+0000","last_active":"2024-09-21T03:53:33.032488+0000","last_peered":"2024-09-21T03:53:33.032488+0000","last_clean":"2024-09-21T03:53:33.032488+0000","last_became_active":"2024-09-21T03:53:13.831107+0000","last_became_peered":"2024-09-21T03:53:13.831107+0000","last_unstale":"2024-09-21T03:53:33.032488+0000","last_undegraded":"2024-09-21T03:53:33.032488+0000","last_fullsized":"2024-09-21T03:53:33.032488+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:12:09.751036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123850+0000","last_change":"2024-09-21T03:53:11.805910+0000","last_active":"2024-09-21T03:53:33.123850+0000","last_peered":"2024-09-21T03:53:33.123850+0000","last_clean":"2024-09-21T03:53:33.123850+0000","last_became_active":"2024-09-21T03:53:11.805461+0000","last_became_peered":"2024-09-21T03:53:11.805461+0000","last_unstale":"2024-09-21T03:53:33.123850+0000","last_undegraded":"2024-09-21T03:53:33.123850+0000","last_fullsized":"2024-09-21T03:53:33.123850+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:36:56.132055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123607+0000","last_change":"2024-09-21T03:53:13.834930+0000","last_active":"2024-09-21T03:53:33.123607+0000","last_peered":"2024-09-21T03:53:33.123607+0000","last_clean":"2024-09-21T03:53:33.123607+0000","last_became_active":"2024-09-21T03:53:13.834368+0000","last_became_peered":"2024-09-21T03:53:13.834368+0000","last_unstale":"2024-09-21T03:53:33.123607+0000","last_undegraded":"2024-09-21T03:53:33.123607+0000","last_fullsized":"2024-09-21T03:53:33.123607+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:53.798811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123728+0000","last_change":"2024-09-21T03:53:12.604827+0000","last_active":"2024-09-21T03:53:33.123728+0000","last_peered":"2024-09-21T03:53:33.123728+0000","last_clean":"2024-09-21T03:53:33.123728+0000","last_became_active":"2024-09-21T03:53:12.604406+0000","last_became_peered":"2024-09-21T03:53:12.604406+0000","last_unstale":"2024-09-21T03:53:33.123728+0000","last_undegraded":"2024-09-21T03:53:33.123728+0000","last_fullsized":"2024-09-21T03:53:33.123728+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:03:12.942354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123562+0000","last_change":"2024-09-21T03:53:13.830482+0000","last_active":"2024-09-21T03:53:33.123562+0000","last_peered":"2024-09-21T03:53:33.123562+0000","last_clean":"2024-09-21T03:53:33.123562+0000","last_became_active":"2024-09-21T03:53:13.829970+0000","last_became_peered":"2024-09-21T03:53:13.829970+0000","last_unstale":"2024-09-21T03:53:33.123562+0000","last_undegraded":"2024-09-21T03:53:33.123562+0000","last_fullsized":"2024-09-21T03:53:33.123562+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:21.617459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035213+0000","last_change":"2024-09-21T03:53:11.801931+0000","last_active":"2024-09-21T03:53:33.035213+0000","last_peered":"2024-09-21T03:53:33.035213+0000","last_clean":"2024-09-21T03:53:33.035213+0000","last_became_active":"2024-09-21T03:53:11.801587+0000","last_became_peered":"2024-09-21T03:53:11.801587+0000","last_unstale":"2024-09-21T03:53:33.035213+0000","last_undegraded":"2024-09-21T03:53:33.035213+0000","last_fullsized":"2024-09-21T03:53:33.035213+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:47.329060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":58103,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":45,"num_read_kb":80,"num_write":78,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":174309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65,"ondisk_log_size":65,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285514,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743441,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31988,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713164,"statfs":{"total":95995035648,"available":95962279936,"internally_reserved":0,"allocated":819200,"data_stored":407969,"data_compressed":2875,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939671,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":962560,"data_stored":1064561,"data_compressed":42053,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103196,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":835584,"data_stored":417159,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299425,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":839680,"data_stored":417181,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462950,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":888832,"data_stored":1007644,"data_compressed":42053,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626475,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":835584,"data_stored":416694,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822705,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":897024,"data_stored":1007244,"data_compressed":42053,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986230,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":835584,"data_stored":416599,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182457,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36176,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708976,"statfs":{"total":95995035648,"available":95957991424,"internally_reserved":0,"allocated":847872,"data_stored":416915,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378688,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":901120,"data_stored":473916,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542213,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":897024,"data_stored":473882,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705738,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":835584,"data_stored":416667,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34678,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34678,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34678,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36296,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36296,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36296,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36296,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36296,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":57305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":57339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":57499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:53:40.162 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T03:53:40.163 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T03:53:40.163 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T03:53:40.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:40 smithi162 ceph-mon[35071]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:53:40.423 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:40.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:40 smithi046 ceph-mon[30954]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:53:40.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:40 smithi105 ceph-mon[34773]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:53:40.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.882+0000 7ff6f28e9640 1 -- 172.21.15.46:0/1639613971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6ec1083c0 msgr2=0x7ff6ec1087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:40.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.882+0000 7ff6f28e9640 1 --2- 172.21.15.46:0/1639613971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6ec1083c0 0x7ff6ec1087d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4009900 tx=0x7ff6d402a410 comp rx=0 tx=0).stop 2024-09-21T03:53:40.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.882+0000 7ff6f28e9640 1 -- 172.21.15.46:0/1639613971 shutdown_connections 2024-09-21T03:53:40.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.882+0000 7ff6f28e9640 1 --2- 172.21.15.46:0/1639613971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6ec108d10 0x7ff6ec10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:40.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.882+0000 7ff6f28e9640 1 --2- 172.21.15.46:0/1639613971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6ec1083c0 0x7ff6ec1087d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:40.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.882+0000 7ff6f28e9640 1 --2- 172.21.15.46:0/1639613971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6ec102a80 0x7ff6ec102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:40.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.882+0000 7ff6f28e9640 1 -- 172.21.15.46:0/1639613971 >> 172.21.15.46:0/1639613971 conn(0x7ff6ec079760 msgr2=0x7ff6ec079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:40.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.882+0000 7ff6f28e9640 1 -- 172.21.15.46:0/1639613971 shutdown_connections 2024-09-21T03:53:40.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.882+0000 7ff6f28e9640 1 -- 172.21.15.46:0/1639613971 wait complete. 2024-09-21T03:53:40.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.883+0000 7ff6f28e9640 1 Processor -- start 2024-09-21T03:53:40.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.883+0000 7ff6f28e9640 1 -- start start 2024-09-21T03:53:40.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.883+0000 7ff6f28e9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6ec102a80 0x7ff6ec10fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:40.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.883+0000 7ff6f28e9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6ec1083c0 0x7ff6ec110310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:40.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.883+0000 7ff6f28e9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6ec108d10 0x7ff6ec110850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:40.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.883+0000 7ff6f28e9640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec113a90 con 0x7ff6ec1083c0 2024-09-21T03:53:40.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.883+0000 7ff6f28e9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec113910 con 0x7ff6ec102a80 2024-09-21T03:53:40.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.883+0000 7ff6f28e9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec113c10 con 0x7ff6ec108d10 2024-09-21T03:53:40.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.883+0000 7ff6e3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6ec1083c0 0x7ff6ec110310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:40.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.883+0000 7ff6e3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6ec1083c0 0x7ff6ec110310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37576/0 (socket says 172.21.15.46:37576) 2024-09-21T03:53:40.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.883+0000 7ff6e3fff640 1 -- 172.21.15.46:0/3363210445 learned_addr learned my addr 172.21.15.46:0/3363210445 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:53:40.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.883+0000 7ff6f0e86640 1 --2- 172.21.15.46:0/3363210445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6ec108d10 0x7ff6ec110850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:40.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.883+0000 7ff6ebfff640 1 --2- 172.21.15.46:0/3363210445 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6ec102a80 0x7ff6ec10fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:40.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.884+0000 7ff6e3fff640 1 -- 172.21.15.46:0/3363210445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6ec108d10 msgr2=0x7ff6ec110850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:40.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.884+0000 7ff6e3fff640 1 --2- 172.21.15.46:0/3363210445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6ec108d10 0x7ff6ec110850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:40.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.884+0000 7ff6e3fff640 1 -- 172.21.15.46:0/3363210445 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6ec102a80 msgr2=0x7ff6ec10fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:40.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.884+0000 7ff6e3fff640 1 --2- 172.21.15.46:0/3363210445 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6ec102a80 0x7ff6ec10fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:40.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.884+0000 7ff6e3fff640 1 -- 172.21.15.46:0/3363210445 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6ec1a8780 con 0x7ff6ec1083c0 2024-09-21T03:53:40.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.884+0000 7ff6e3fff640 1 --2- 172.21.15.46:0/3363210445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6ec1083c0 0x7ff6ec110310 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4032fd0 tx=0x7ff6d4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:40.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.884+0000 7ff6e9ffb640 1 -- 172.21.15.46:0/3363210445 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d403f030 con 0x7ff6ec1083c0 2024-09-21T03:53:40.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.884+0000 7ff6f28e9640 1 -- 172.21.15.46:0/3363210445 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6ec1a8a10 con 0x7ff6ec1083c0 2024-09-21T03:53:40.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.884+0000 7ff6e9ffb640 1 -- 172.21.15.46:0/3363210445 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6d4004490 con 0x7ff6ec1083c0 2024-09-21T03:53:40.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.884+0000 7ff6e9ffb640 1 -- 172.21.15.46:0/3363210445 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4035070 con 0x7ff6ec1083c0 2024-09-21T03:53:40.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.884+0000 7ff6f28e9640 1 -- 172.21.15.46:0/3363210445 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6ec1a8f40 con 0x7ff6ec1083c0 2024-09-21T03:53:40.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.885+0000 7ff6f28e9640 1 -- 172.21.15.46:0/3363210445 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6ec102e90 con 0x7ff6ec1083c0 2024-09-21T03:53:40.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.887+0000 7ff6e9ffb640 1 -- 172.21.15.46:0/3363210445 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7ff6d4042030 con 0x7ff6ec1083c0 2024-09-21T03:53:40.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.887+0000 7ff6e9ffb640 1 --2- 172.21.15.46:0/3363210445 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff6d80b65f0 0x7ff6d80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:40.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.887+0000 7ff6ebfff640 1 --2- 172.21.15.46:0/3363210445 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff6d80b65f0 0x7ff6d80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:40.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.887+0000 7ff6e9ffb640 1 -- 172.21.15.46:0/3363210445 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7ff6d4107e50 con 0x7ff6ec1083c0 2024-09-21T03:53:40.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.888+0000 7ff6ebfff640 1 --2- 172.21.15.46:0/3363210445 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff6d80b65f0 0x7ff6d80b8b00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec111820 tx=0x7ff6dc00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:40.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:40.891+0000 7ff6e9ffb640 1 -- 172.21.15.46:0/3363210445 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff6d40d28e0 con 0x7ff6ec1083c0 2024-09-21T03:53:41.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:41.151+0000 7ff6f28e9640 1 -- 172.21.15.46:0/3363210445 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7ff6ec1110d0 con 0x7ff6ec1083c0 2024-09-21T03:53:41.154 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:41 smithi046 ceph-mon[30954]: pgmap v279: 97 pgs: 97 active+clean; 634 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.0 KiB/s wr, 5 op/s 2024-09-21T03:53:41.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:41.155+0000 7ff6e9ffb640 1 -- 172.21.15.46:0/3363210445 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7ff6d40d7820 con 0x7ff6ec1083c0 2024-09-21T03:53:41.157 INFO:teuthology.orchestra.run.smithi046.stdout:[client.0] 2024-09-21T03:53:41.157 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBFQ+5mOpklCRAAANfwcVfMlB6+KXDC1/GMrA== 2024-09-21T03:53:41.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:41.157+0000 7ff6f28e9640 1 -- 172.21.15.46:0/3363210445 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff6d80b65f0 msgr2=0x7ff6d80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:41.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:41.157+0000 7ff6f28e9640 1 --2- 172.21.15.46:0/3363210445 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff6d80b65f0 0x7ff6d80b8b00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec111820 tx=0x7ff6dc00b390 comp rx=0 tx=0).stop 2024-09-21T03:53:41.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:41.157+0000 7ff6f28e9640 1 -- 172.21.15.46:0/3363210445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6ec1083c0 msgr2=0x7ff6ec110310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:41.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:41.157+0000 7ff6f28e9640 1 --2- 172.21.15.46:0/3363210445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6ec1083c0 0x7ff6ec110310 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4032fd0 tx=0x7ff6d4004270 comp rx=0 tx=0).stop 2024-09-21T03:53:41.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:41.157+0000 7ff6f28e9640 1 -- 172.21.15.46:0/3363210445 shutdown_connections 2024-09-21T03:53:41.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:41.157+0000 7ff6f28e9640 1 --2- 172.21.15.46:0/3363210445 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff6d80b65f0 0x7ff6d80b8b00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:41.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:41.157+0000 7ff6f28e9640 1 --2- 172.21.15.46:0/3363210445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6ec108d10 0x7ff6ec110850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:41.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:41.157+0000 7ff6f28e9640 1 --2- 172.21.15.46:0/3363210445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6ec1083c0 0x7ff6ec110310 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:41.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:41.157+0000 7ff6f28e9640 1 --2- 172.21.15.46:0/3363210445 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6ec102a80 0x7ff6ec10fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:41.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:41.157+0000 7ff6f28e9640 1 -- 172.21.15.46:0/3363210445 >> 172.21.15.46:0/3363210445 conn(0x7ff6ec079760 msgr2=0x7ff6ec104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:41.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:41.157+0000 7ff6f28e9640 1 -- 172.21.15.46:0/3363210445 shutdown_connections 2024-09-21T03:53:41.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:41.157+0000 7ff6f28e9640 1 -- 172.21.15.46:0/3363210445 wait complete. 2024-09-21T03:53:41.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:41 smithi162 ceph-mon[35071]: pgmap v279: 97 pgs: 97 active+clean; 634 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.0 KiB/s wr, 5 op/s 2024-09-21T03:53:41.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:41 smithi105 ceph-mon[34773]: pgmap v279: 97 pgs: 97 active+clean; 634 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.0 KiB/s wr, 5 op/s 2024-09-21T03:53:41.955 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T03:53:41.955 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T03:53:41.955 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T03:53:41.997 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph config log 1 --format=json 2024-09-21T03:53:42.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:42 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3363210445' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T03:53:42.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:42 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3363210445' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T03:53:42.298 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:42.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:42 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3363210445' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T03:53:42.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:42 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3363210445' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T03:53:42.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:42 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3363210445' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T03:53:42.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:42 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3363210445' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T03:53:42.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.887+0000 7f1a024c7640 1 -- 172.21.15.46:0/2352775762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19fc103b60 msgr2=0x7f19fc103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:42.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.887+0000 7f1a024c7640 1 --2- 172.21.15.46:0/2352775762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19fc103b60 0x7f19fc103f70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f19ec009900 tx=0x7f19ec02a410 comp rx=0 tx=0).stop 2024-09-21T03:53:42.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.887+0000 7f1a024c7640 1 -- 172.21.15.46:0/2352775762 shutdown_connections 2024-09-21T03:53:42.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.887+0000 7f1a024c7640 1 --2- 172.21.15.46:0/2352775762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19fc109df0 0x7f19fc110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:42.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.887+0000 7f1a024c7640 1 --2- 172.21.15.46:0/2352775762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19fc1094a0 0x7f19fc1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:42.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.887+0000 7f1a024c7640 1 --2- 172.21.15.46:0/2352775762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19fc103b60 0x7f19fc103f70 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:42.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.887+0000 7f1a024c7640 1 -- 172.21.15.46:0/2352775762 >> 172.21.15.46:0/2352775762 conn(0x7f19fc07b850 msgr2=0x7f19fc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:42.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.887+0000 7f1a024c7640 1 -- 172.21.15.46:0/2352775762 shutdown_connections 2024-09-21T03:53:42.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.887+0000 7f1a024c7640 1 -- 172.21.15.46:0/2352775762 wait complete. 2024-09-21T03:53:42.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.888+0000 7f1a024c7640 1 Processor -- start 2024-09-21T03:53:42.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.888+0000 7f1a024c7640 1 -- start start 2024-09-21T03:53:42.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.889+0000 7f1a024c7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19fc103b60 0x7f19fc19a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:42.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.889+0000 7f1a024c7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19fc1094a0 0x7f19fc19aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:42.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.889+0000 7f1a024c7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19fc109df0 0x7f19fc19fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:42.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.889+0000 7f1a024c7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f19fc113ab0 con 0x7f19fc1094a0 2024-09-21T03:53:42.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.889+0000 7f1a024c7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f19fc113930 con 0x7f19fc109df0 2024-09-21T03:53:42.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.889+0000 7f1a024c7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f19fc113c30 con 0x7f19fc103b60 2024-09-21T03:53:42.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.889+0000 7f19fb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19fc1094a0 0x7f19fc19aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:42.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.889+0000 7f19fb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19fc1094a0 0x7f19fc19aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48498/0 (socket says 172.21.15.46:48498) 2024-09-21T03:53:42.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.889+0000 7f19fb7fe640 1 -- 172.21.15.46:0/2501910545 learned_addr learned my addr 172.21.15.46:0/2501910545 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:53:42.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.889+0000 7f1a00a64640 1 --2- 172.21.15.46:0/2501910545 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19fc109df0 0x7f19fc19fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:42.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.889+0000 7f19fbfff640 1 --2- 172.21.15.46:0/2501910545 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19fc103b60 0x7f19fc19a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:42.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.889+0000 7f19fb7fe640 1 -- 172.21.15.46:0/2501910545 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19fc103b60 msgr2=0x7f19fc19a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:42.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.889+0000 7f19fb7fe640 1 --2- 172.21.15.46:0/2501910545 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19fc103b60 0x7f19fc19a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:42.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.889+0000 7f19fb7fe640 1 -- 172.21.15.46:0/2501910545 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19fc109df0 msgr2=0x7f19fc19fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:42.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.889+0000 7f19fb7fe640 1 --2- 172.21.15.46:0/2501910545 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19fc109df0 0x7f19fc19fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:42.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.889+0000 7f19fb7fe640 1 -- 172.21.15.46:0/2501910545 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19fc1a03d0 con 0x7f19fc1094a0 2024-09-21T03:53:42.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.889+0000 7f19fb7fe640 1 --2- 172.21.15.46:0/2501910545 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19fc1094a0 0x7f19fc19aa00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f19f000d740 tx=0x7f19f000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:42.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.889+0000 7f19f97fa640 1 -- 172.21.15.46:0/2501910545 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f0017070 con 0x7f19fc1094a0 2024-09-21T03:53:42.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.890+0000 7f19f97fa640 1 -- 172.21.15.46:0/2501910545 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19f000de50 con 0x7f19fc1094a0 2024-09-21T03:53:42.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.890+0000 7f1a024c7640 1 -- 172.21.15.46:0/2501910545 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19fc1a06c0 con 0x7f19fc1094a0 2024-09-21T03:53:42.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.890+0000 7f19f97fa640 1 -- 172.21.15.46:0/2501910545 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f000f620 con 0x7f19fc1094a0 2024-09-21T03:53:42.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.890+0000 7f1a024c7640 1 -- 172.21.15.46:0/2501910545 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19fc1a6e20 con 0x7f19fc1094a0 2024-09-21T03:53:42.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.891+0000 7f1a024c7640 1 -- 172.21.15.46:0/2501910545 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19fc103f70 con 0x7f19fc1094a0 2024-09-21T03:53:42.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.892+0000 7f19f97fa640 1 -- 172.21.15.46:0/2501910545 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f19f001a070 con 0x7f19fc1094a0 2024-09-21T03:53:42.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.893+0000 7f19f97fa640 1 --2- 172.21.15.46:0/2501910545 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f19e40b65f0 0x7f19e40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:42.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.893+0000 7f19fbfff640 1 --2- 172.21.15.46:0/2501910545 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f19e40b65f0 0x7f19e40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:42.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.893+0000 7f19f97fa640 1 -- 172.21.15.46:0/2501910545 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f19f00e6ea0 con 0x7f19fc1094a0 2024-09-21T03:53:42.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.894+0000 7f19fbfff640 1 --2- 172.21.15.46:0/2501910545 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f19e40b65f0 0x7f19e40b8b00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f19ec031440 tx=0x7f19ec009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:42.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:42.896+0000 7f19f97fa640 1 -- 172.21.15.46:0/2501910545 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f19f00b1930 con 0x7f19fc1094a0 2024-09-21T03:53:43.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:43.088+0000 7f1a024c7640 1 -- 172.21.15.46:0/2501910545 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f19fc19b590 con 0x7f19fc1094a0 2024-09-21T03:53:43.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:43.089+0000 7f19f97fa640 1 -- 172.21.15.46:0/2501910545 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v58) ==== 86+0+133 (secure 0 0 0) 0x7f19fc19b590 con 0x7f19fc1094a0 2024-09-21T03:53:43.091 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:53:43.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:43.091+0000 7f1a024c7640 1 -- 172.21.15.46:0/2501910545 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f19e40b65f0 msgr2=0x7f19e40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:43.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:43.091+0000 7f1a024c7640 1 --2- 172.21.15.46:0/2501910545 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f19e40b65f0 0x7f19e40b8b00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f19ec031440 tx=0x7f19ec009560 comp rx=0 tx=0).stop 2024-09-21T03:53:43.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:43.091+0000 7f1a024c7640 1 -- 172.21.15.46:0/2501910545 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19fc1094a0 msgr2=0x7f19fc19aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:43.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:43.091+0000 7f1a024c7640 1 --2- 172.21.15.46:0/2501910545 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19fc1094a0 0x7f19fc19aa00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f19f000d740 tx=0x7f19f000dc00 comp rx=0 tx=0).stop 2024-09-21T03:53:43.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:43.091+0000 7f1a024c7640 1 -- 172.21.15.46:0/2501910545 shutdown_connections 2024-09-21T03:53:43.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:43.091+0000 7f1a024c7640 1 --2- 172.21.15.46:0/2501910545 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19fc109df0 0x7f19fc19fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:43.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:43.091+0000 7f1a024c7640 1 --2- 172.21.15.46:0/2501910545 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19fc1094a0 0x7f19fc19aa00 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:43.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:43.091+0000 7f1a024c7640 1 --2- 172.21.15.46:0/2501910545 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f19e40b65f0 0x7f19e40b8b00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:43.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:43.091+0000 7f1a024c7640 1 --2- 172.21.15.46:0/2501910545 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19fc103b60 0x7f19fc19a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:43.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:43.091+0000 7f1a024c7640 1 -- 172.21.15.46:0/2501910545 >> 172.21.15.46:0/2501910545 conn(0x7f19fc07b850 msgr2=0x7f19fc107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:43.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:43.091+0000 7f1a024c7640 1 -- 172.21.15.46:0/2501910545 shutdown_connections 2024-09-21T03:53:43.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:43.091+0000 7f1a024c7640 1 -- 172.21.15.46:0/2501910545 wait complete. 2024-09-21T03:53:43.464 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:43 smithi046 ceph-mon[30954]: pgmap v280: 97 pgs: 97 active+clean; 634 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.0 KiB/s wr, 4 op/s 2024-09-21T03:53:43.465 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:43 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/2501910545' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T03:53:43.469 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:43 smithi105 ceph-mon[34773]: pgmap v280: 97 pgs: 97 active+clean; 634 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.0 KiB/s wr, 4 op/s 2024-09-21T03:53:43.469 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:43 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/2501910545' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T03:53:43.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:43 smithi162 ceph-mon[35071]: pgmap v280: 97 pgs: 97 active+clean; 634 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.0 KiB/s wr, 4 op/s 2024-09-21T03:53:43.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:43 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/2501910545' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T03:53:43.919 INFO:teuthology.orchestra.run.smithi046.stdout:[{"version":58,"timestamp":"2024-09-21T03:53:03.492215+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-21T03:53:43.920 INFO:tasks.ceph_manager:config epoch is 58 2024-09-21T03:53:43.920 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T03:53:43.920 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T03:53:43.920 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T03:53:44.186 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:44.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.646+0000 7fa7fd1ea640 1 -- 172.21.15.46:0/3199265267 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7f81094a0 msgr2=0x7fa7f81098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:44.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.646+0000 7fa7fd1ea640 1 --2- 172.21.15.46:0/3199265267 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7f81094a0 0x7fa7f81098b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009900 tx=0x7fa7ec02a410 comp rx=0 tx=0).stop 2024-09-21T03:53:44.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.647+0000 7fa7fd1ea640 1 -- 172.21.15.46:0/3199265267 shutdown_connections 2024-09-21T03:53:44.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.647+0000 7fa7fd1ea640 1 --2- 172.21.15.46:0/3199265267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7f8109df0 0x7fa7f8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:44.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.647+0000 7fa7fd1ea640 1 --2- 172.21.15.46:0/3199265267 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7f81094a0 0x7fa7f81098b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:44.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.647+0000 7fa7fd1ea640 1 --2- 172.21.15.46:0/3199265267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7f8103b60 0x7fa7f8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:44.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.647+0000 7fa7fd1ea640 1 -- 172.21.15.46:0/3199265267 >> 172.21.15.46:0/3199265267 conn(0x7fa7f807b850 msgr2=0x7fa7f807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:44.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.647+0000 7fa7fd1ea640 1 -- 172.21.15.46:0/3199265267 shutdown_connections 2024-09-21T03:53:44.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.647+0000 7fa7fd1ea640 1 -- 172.21.15.46:0/3199265267 wait complete. 2024-09-21T03:53:44.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.647+0000 7fa7fd1ea640 1 Processor -- start 2024-09-21T03:53:44.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.648+0000 7fa7fd1ea640 1 -- start start 2024-09-21T03:53:44.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.648+0000 7fa7fd1ea640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7f8103b60 0x7fa7f819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:44.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.648+0000 7fa7fd1ea640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7f81094a0 0x7fa7f819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:44.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.648+0000 7fa7fd1ea640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7f8109df0 0x7fa7f819fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:44.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.648+0000 7fa7fd1ea640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f8113ab0 con 0x7fa7f81094a0 2024-09-21T03:53:44.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.648+0000 7fa7fd1ea640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f8113930 con 0x7fa7f8109df0 2024-09-21T03:53:44.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.648+0000 7fa7fd1ea640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f8113c30 con 0x7fa7f8103b60 2024-09-21T03:53:44.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.648+0000 7fa7f659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7f81094a0 0x7fa7f819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:44.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.648+0000 7fa7f659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7f81094a0 0x7fa7f819aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48516/0 (socket says 172.21.15.46:48516) 2024-09-21T03:53:44.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.648+0000 7fa7f659c640 1 -- 172.21.15.46:0/3322705813 learned_addr learned my addr 172.21.15.46:0/3322705813 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:53:44.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.648+0000 7fa7f759e640 1 --2- 172.21.15.46:0/3322705813 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7f8109df0 0x7fa7f819fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:44.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.648+0000 7fa7f6d9d640 1 --2- 172.21.15.46:0/3322705813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7f8103b60 0x7fa7f819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:44.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.648+0000 7fa7f659c640 1 -- 172.21.15.46:0/3322705813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7f8103b60 msgr2=0x7fa7f819a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:44.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.648+0000 7fa7f659c640 1 --2- 172.21.15.46:0/3322705813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7f8103b60 0x7fa7f819a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:44.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.648+0000 7fa7f659c640 1 -- 172.21.15.46:0/3322705813 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7f8109df0 msgr2=0x7fa7f819fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:44.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.648+0000 7fa7f659c640 1 --2- 172.21.15.46:0/3322705813 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7f8109df0 0x7fa7f819fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:44.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.648+0000 7fa7f659c640 1 -- 172.21.15.46:0/3322705813 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f81a03f0 con 0x7fa7f81094a0 2024-09-21T03:53:44.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.649+0000 7fa7f659c640 1 --2- 172.21.15.46:0/3322705813 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7f81094a0 0x7fa7f819aa20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec02a930 tx=0x7fa7ec004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:44.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.649+0000 7fa7dffff640 1 -- 172.21.15.46:0/3322705813 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec03f030 con 0x7fa7f81094a0 2024-09-21T03:53:44.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.649+0000 7fa7dffff640 1 -- 172.21.15.46:0/3322705813 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7ec003aa0 con 0x7fa7f81094a0 2024-09-21T03:53:44.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.649+0000 7fa7fd1ea640 1 -- 172.21.15.46:0/3322705813 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7f81a0680 con 0x7fa7f81094a0 2024-09-21T03:53:44.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.649+0000 7fa7dffff640 1 -- 172.21.15.46:0/3322705813 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec035070 con 0x7fa7f81094a0 2024-09-21T03:53:44.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.649+0000 7fa7fd1ea640 1 -- 172.21.15.46:0/3322705813 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7f81a6e40 con 0x7fa7f81094a0 2024-09-21T03:53:44.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.650+0000 7fa7fd1ea640 1 -- 172.21.15.46:0/3322705813 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7f8104de0 con 0x7fa7f81094a0 2024-09-21T03:53:44.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.652+0000 7fa7dffff640 1 -- 172.21.15.46:0/3322705813 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fa7ec042030 con 0x7fa7f81094a0 2024-09-21T03:53:44.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.652+0000 7fa7dffff640 1 --2- 172.21.15.46:0/3322705813 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa7e00b65f0 0x7fa7e00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:44.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.653+0000 7fa7f6d9d640 1 --2- 172.21.15.46:0/3322705813 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa7e00b65f0 0x7fa7e00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:44.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.653+0000 7fa7dffff640 1 -- 172.21.15.46:0/3322705813 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fa7ec108010 con 0x7fa7f81094a0 2024-09-21T03:53:44.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.653+0000 7fa7f6d9d640 1 --2- 172.21.15.46:0/3322705813 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa7e00b65f0 0x7fa7e00b8b00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa7e80058c0 tx=0x7fa7e800a4c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:44.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.656+0000 7fa7dffff640 1 -- 172.21.15.46:0/3322705813 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa7ec0ce6c0 con 0x7fa7f81094a0 2024-09-21T03:53:44.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.892+0000 7fa7fd1ea640 1 -- 172.21.15.46:0/3322705813 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fa7f810bbe0 con 0x7fa7f81094a0 2024-09-21T03:53:44.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.898+0000 7fa7dffff640 1 -- 172.21.15.46:0/3322705813 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v21) ==== 74+0+296452 (secure 0 0 0) 0x7fa7ec0d5e20 con 0x7fa7f81094a0 2024-09-21T03:53:44.904 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:53:44.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.901+0000 7fa7fd1ea640 1 -- 172.21.15.46:0/3322705813 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa7e00b65f0 msgr2=0x7fa7e00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:44.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.901+0000 7fa7fd1ea640 1 --2- 172.21.15.46:0/3322705813 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa7e00b65f0 0x7fa7e00b8b00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa7e80058c0 tx=0x7fa7e800a4c0 comp rx=0 tx=0).stop 2024-09-21T03:53:44.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.901+0000 7fa7fd1ea640 1 -- 172.21.15.46:0/3322705813 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7f81094a0 msgr2=0x7fa7f819aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:44.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.901+0000 7fa7fd1ea640 1 --2- 172.21.15.46:0/3322705813 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7f81094a0 0x7fa7f819aa20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec02a930 tx=0x7fa7ec004270 comp rx=0 tx=0).stop 2024-09-21T03:53:44.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.901+0000 7fa7fd1ea640 1 -- 172.21.15.46:0/3322705813 shutdown_connections 2024-09-21T03:53:44.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.901+0000 7fa7fd1ea640 1 --2- 172.21.15.46:0/3322705813 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7f8109df0 0x7fa7f819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:44.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.901+0000 7fa7fd1ea640 1 --2- 172.21.15.46:0/3322705813 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7f81094a0 0x7fa7f819aa20 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:44.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.901+0000 7fa7fd1ea640 1 --2- 172.21.15.46:0/3322705813 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa7e00b65f0 0x7fa7e00b8b00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:44.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.901+0000 7fa7fd1ea640 1 --2- 172.21.15.46:0/3322705813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7f8103b60 0x7fa7f819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:44.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.901+0000 7fa7fd1ea640 1 -- 172.21.15.46:0/3322705813 >> 172.21.15.46:0/3322705813 conn(0x7fa7f807b850 msgr2=0x7fa7f8107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:44.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.902+0000 7fa7fd1ea640 1 -- 172.21.15.46:0/3322705813 shutdown_connections 2024-09-21T03:53:44.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:44.902+0000 7fa7fd1ea640 1 -- 172.21.15.46:0/3322705813 wait complete. 2024-09-21T03:53:45.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:45 smithi046 ceph-mon[30954]: pgmap v281: 97 pgs: 97 active+clean; 638 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2024-09-21T03:53:45.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:45 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3322705813' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T03:53:45.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:45 smithi105 ceph-mon[34773]: pgmap v281: 97 pgs: 97 active+clean; 638 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2024-09-21T03:53:45.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:45 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3322705813' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T03:53:45.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:45 smithi162 ceph-mon[35071]: pgmap v281: 97 pgs: 97 active+clean; 638 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2024-09-21T03:53:45.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:45 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3322705813' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T03:53:45.723 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"flags":0,"active_gid":14223,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1928997883},{"type":"v1","addr":"172.21.15.46:6801","nonce":1928997883}]},"active_addr":"172.21.15.46:6801/1928997883","active_change":"2024-09-21T03:46:31.942258+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24164,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24166,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.46:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":2196922549}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":2529879242}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":582434867}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":811400203}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":1864900692}]}]} 2024-09-21T03:53:45.729 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T03:53:45.729 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T03:53:45.730 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T03:53:45.998 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:46.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.498+0000 7fdb2ff6b640 1 -- 172.21.15.46:0/597394711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb281083a0 msgr2=0x7fdb281087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:46.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.498+0000 7fdb2ff6b640 1 --2- 172.21.15.46:0/597394711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb281083a0 0x7fdb281087b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fdb18009900 tx=0x7fdb1802a410 comp rx=0 tx=0).stop 2024-09-21T03:53:46.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.498+0000 7fdb2ff6b640 1 -- 172.21.15.46:0/597394711 shutdown_connections 2024-09-21T03:53:46.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.498+0000 7fdb2ff6b640 1 --2- 172.21.15.46:0/597394711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb28108cf0 0x7fdb2810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:46.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.498+0000 7fdb2ff6b640 1 --2- 172.21.15.46:0/597394711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb281083a0 0x7fdb281087b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:46.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.498+0000 7fdb2ff6b640 1 --2- 172.21.15.46:0/597394711 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb28102a60 0x7fdb28102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:46.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.498+0000 7fdb2ff6b640 1 -- 172.21.15.46:0/597394711 >> 172.21.15.46:0/597394711 conn(0x7fdb28079730 msgr2=0x7fdb28079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:46.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.498+0000 7fdb2ff6b640 1 -- 172.21.15.46:0/597394711 shutdown_connections 2024-09-21T03:53:46.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.498+0000 7fdb2ff6b640 1 -- 172.21.15.46:0/597394711 wait complete. 2024-09-21T03:53:46.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.499+0000 7fdb2ff6b640 1 Processor -- start 2024-09-21T03:53:46.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.499+0000 7fdb2ff6b640 1 -- start start 2024-09-21T03:53:46.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.499+0000 7fdb2ff6b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb28102a60 0x7fdb28199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:46.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.499+0000 7fdb2ff6b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb281083a0 0x7fdb281999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:46.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.499+0000 7fdb2ff6b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb28108cf0 0x7fdb2819ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:46.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.499+0000 7fdb2ff6b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdb28112960 con 0x7fdb28108cf0 2024-09-21T03:53:46.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.499+0000 7fdb2ff6b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdb281127e0 con 0x7fdb281083a0 2024-09-21T03:53:46.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.499+0000 7fdb2ff6b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdb28112ae0 con 0x7fdb28102a60 2024-09-21T03:53:46.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.499+0000 7fdb2e508640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb28108cf0 0x7fdb2819ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:46.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.500+0000 7fdb2e508640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb28108cf0 0x7fdb2819ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48538/0 (socket says 172.21.15.46:48538) 2024-09-21T03:53:46.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.500+0000 7fdb2e508640 1 -- 172.21.15.46:0/1179251626 learned_addr learned my addr 172.21.15.46:0/1179251626 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:53:46.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.500+0000 7fdb2dd07640 1 --2- 172.21.15.46:0/1179251626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb28102a60 0x7fdb28199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:46.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.500+0000 7fdb2d506640 1 --2- 172.21.15.46:0/1179251626 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb281083a0 0x7fdb281999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:46.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.500+0000 7fdb2e508640 1 -- 172.21.15.46:0/1179251626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb28102a60 msgr2=0x7fdb28199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:46.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.500+0000 7fdb2e508640 1 --2- 172.21.15.46:0/1179251626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb28102a60 0x7fdb28199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:46.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.500+0000 7fdb2e508640 1 -- 172.21.15.46:0/1179251626 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb281083a0 msgr2=0x7fdb281999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:46.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.500+0000 7fdb2e508640 1 --2- 172.21.15.46:0/1179251626 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb281083a0 0x7fdb281999d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:46.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.500+0000 7fdb2e508640 1 -- 172.21.15.46:0/1179251626 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb2819f2e0 con 0x7fdb28108cf0 2024-09-21T03:53:46.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.500+0000 7fdb2d506640 1 --2- 172.21.15.46:0/1179251626 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb281083a0 0x7fdb281999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:53:46.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.500+0000 7fdb2e508640 1 --2- 172.21.15.46:0/1179251626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb28108cf0 0x7fdb2819ec70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fdb2000cce0 tx=0x7fdb2000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:46.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.500+0000 7fdb1effd640 1 -- 172.21.15.46:0/1179251626 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb2000f450 con 0x7fdb28108cf0 2024-09-21T03:53:46.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.500+0000 7fdb2ff6b640 1 -- 172.21.15.46:0/1179251626 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb2819f5d0 con 0x7fdb28108cf0 2024-09-21T03:53:46.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.500+0000 7fdb1effd640 1 -- 172.21.15.46:0/1179251626 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb2000faa0 con 0x7fdb28108cf0 2024-09-21T03:53:46.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.500+0000 7fdb1effd640 1 -- 172.21.15.46:0/1179251626 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb20018b70 con 0x7fdb28108cf0 2024-09-21T03:53:46.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.500+0000 7fdb2ff6b640 1 -- 172.21.15.46:0/1179251626 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb2806ae60 con 0x7fdb28108cf0 2024-09-21T03:53:46.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.501+0000 7fdb2ff6b640 1 -- 172.21.15.46:0/1179251626 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb28103ce0 con 0x7fdb28108cf0 2024-09-21T03:53:46.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.503+0000 7fdb1effd640 1 -- 172.21.15.46:0/1179251626 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fdb20018d10 con 0x7fdb28108cf0 2024-09-21T03:53:46.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.504+0000 7fdb1effd640 1 --2- 172.21.15.46:0/1179251626 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fdb140b6620 0x7fdb140b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:46.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.504+0000 7fdb2dd07640 1 --2- 172.21.15.46:0/1179251626 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fdb140b6620 0x7fdb140b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:46.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.504+0000 7fdb1effd640 1 -- 172.21.15.46:0/1179251626 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fdb200e7a50 con 0x7fdb28108cf0 2024-09-21T03:53:46.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.504+0000 7fdb2dd07640 1 --2- 172.21.15.46:0/1179251626 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fdb140b6620 0x7fdb140b8b30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdb24005d00 tx=0x7fdb2400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:46.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.507+0000 7fdb1effd640 1 -- 172.21.15.46:0/1179251626 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdb20014030 con 0x7fdb28108cf0 2024-09-21T03:53:46.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.696+0000 7fdb2ff6b640 1 -- 172.21.15.46:0/1179251626 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdb28102e70 con 0x7fdb28108cf0 2024-09-21T03:53:46.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.698+0000 7fdb1effd640 1 -- 172.21.15.46:0/1179251626 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22876 (secure 0 0 0) 0x7fdb28102e70 con 0x7fdb28108cf0 2024-09-21T03:53:46.700 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:53:46.700 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":77,"fsid":"a82de5ec-77cb-11ef-baf5-efdc52797490","created":"2024-09-21T03:44:31.512271+0000","modified":"2024-09-21T03:53:33.028150+0000","last_up_change":"2024-09-21T03:52:22.609789+0000","last_in_change":"2024-09-21T03:51:58.812316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:48:30.407205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:53:09.943833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:53:12.521980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ff9e1a8-fec7-422c-b594-880efe4684f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6803","nonce":791989880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6805","nonce":791989880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6809","nonce":791989880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6807","nonce":791989880}]},"public_addr":"172.21.15.46:6803/791989880","cluster_addr":"172.21.15.46:6805/791989880","heartbeat_back_addr":"172.21.15.46:6809/791989880","heartbeat_front_addr":"172.21.15.46:6807/791989880","state":["exists","up"]},{"osd":1,"uuid":"3df1bee7-615e-44d0-bd43-2370db6cd06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6801","nonce":1123652172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6803","nonce":1123652172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6807","nonce":1123652172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6805","nonce":1123652172}]},"public_addr":"172.21.15.105:6801/1123652172","cluster_addr":"172.21.15.105:6803/1123652172","heartbeat_back_addr":"172.21.15.105:6807/1123652172","heartbeat_front_addr":"172.21.15.105:6805/1123652172","state":["exists","up"]},{"osd":2,"uuid":"52d0e57f-cfca-447a-8a57-b1d5364cb4d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6801","nonce":34930776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6803","nonce":34930776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6807","nonce":34930776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6805","nonce":34930776}]},"public_addr":"172.21.15.162:6801/34930776","cluster_addr":"172.21.15.162:6803/34930776","heartbeat_back_addr":"172.21.15.162:6807/34930776","heartbeat_front_addr":"172.21.15.162:6805/34930776","state":["exists","up"]},{"osd":3,"uuid":"6f25f721-fc50-4b80-944b-d3df28e7a2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6811","nonce":1355580104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6813","nonce":1355580104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6817","nonce":1355580104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6815","nonce":1355580104}]},"public_addr":"172.21.15.46:6811/1355580104","cluster_addr":"172.21.15.46:6813/1355580104","heartbeat_back_addr":"172.21.15.46:6817/1355580104","heartbeat_front_addr":"172.21.15.46:6815/1355580104","state":["exists","up"]},{"osd":4,"uuid":"c2f41084-e5a1-4b5f-b799-a84b38da63a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6809","nonce":3566174660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6811","nonce":3566174660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6815","nonce":3566174660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6813","nonce":3566174660}]},"public_addr":"172.21.15.105:6809/3566174660","cluster_addr":"172.21.15.105:6811/3566174660","heartbeat_back_addr":"172.21.15.105:6815/3566174660","heartbeat_front_addr":"172.21.15.105:6813/3566174660","state":["exists","up"]},{"osd":5,"uuid":"b433d03b-fae8-4ece-b967-a8af91bc3ab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6809","nonce":3043419818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6811","nonce":3043419818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6815","nonce":3043419818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6813","nonce":3043419818}]},"public_addr":"172.21.15.162:6809/3043419818","cluster_addr":"172.21.15.162:6811/3043419818","heartbeat_back_addr":"172.21.15.162:6815/3043419818","heartbeat_front_addr":"172.21.15.162:6813/3043419818","state":["exists","up"]},{"osd":6,"uuid":"e6b5ce54-69aa-4811-9ca3-cab50525a175","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6819","nonce":1615361645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6821","nonce":1615361645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6825","nonce":1615361645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6823","nonce":1615361645}]},"public_addr":"172.21.15.46:6819/1615361645","cluster_addr":"172.21.15.46:6821/1615361645","heartbeat_back_addr":"172.21.15.46:6825/1615361645","heartbeat_front_addr":"172.21.15.46:6823/1615361645","state":["exists","up"]},{"osd":7,"uuid":"a6e89d5d-ce31-4e0c-9019-5eb13b134feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6817","nonce":1015687379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6819","nonce":1015687379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6823","nonce":1015687379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6821","nonce":1015687379}]},"public_addr":"172.21.15.105:6817/1015687379","cluster_addr":"172.21.15.105:6819/1015687379","heartbeat_back_addr":"172.21.15.105:6823/1015687379","heartbeat_front_addr":"172.21.15.105:6821/1015687379","state":["exists","up"]},{"osd":8,"uuid":"27b2ccec-65be-47b3-a924-c5939ba1cb5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6817","nonce":3441747512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6819","nonce":3441747512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6823","nonce":3441747512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6821","nonce":3441747512}]},"public_addr":"172.21.15.162:6817/3441747512","cluster_addr":"172.21.15.162:6819/3441747512","heartbeat_back_addr":"172.21.15.162:6823/3441747512","heartbeat_front_addr":"172.21.15.162:6821/3441747512","state":["exists","up"]},{"osd":9,"uuid":"3f7cb70c-73c7-48e8-a32b-7445eda2126d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6827","nonce":382230768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6829","nonce":382230768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6833","nonce":382230768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6831","nonce":382230768}]},"public_addr":"172.21.15.46:6827/382230768","cluster_addr":"172.21.15.46:6829/382230768","heartbeat_back_addr":"172.21.15.46:6833/382230768","heartbeat_front_addr":"172.21.15.46:6831/382230768","state":["exists","up"]},{"osd":10,"uuid":"76c3da87-f3c5-4985-87fd-647717b6af85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6825","nonce":1664619099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6827","nonce":1664619099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6831","nonce":1664619099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6829","nonce":1664619099}]},"public_addr":"172.21.15.105:6825/1664619099","cluster_addr":"172.21.15.105:6827/1664619099","heartbeat_back_addr":"172.21.15.105:6831/1664619099","heartbeat_front_addr":"172.21.15.105:6829/1664619099","state":["exists","up"]},{"osd":11,"uuid":"13269da8-5f05-4ce2-9c7a-6dd9c1041cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6825","nonce":1014820476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6827","nonce":1014820476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6831","nonce":1014820476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6829","nonce":1014820476}]},"public_addr":"172.21.15.162:6825/1014820476","cluster_addr":"172.21.15.162:6827/1014820476","heartbeat_back_addr":"172.21.15.162:6831/1014820476","heartbeat_front_addr":"172.21.15.162:6829/1014820476","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:47:38.630436+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:03.441596+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:28.647341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:54.270316+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:49:19.783873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:49:45.344485+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:50:12.165326+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:50:38.095996+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:03.814612+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:29.469718+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:55.407340+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:52:20.360243+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:6801/878116252":"2024-09-22T03:46:31.942086+0000","172.21.15.46:6800/878116252":"2024-09-22T03:46:31.942086+0000","172.21.15.46:0/3574041742":"2024-09-22T03:45:05.097136+0000","172.21.15.46:6801/1185001582":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/2839831446":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/3423884605":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/2761976928":"2024-09-22T03:46:31.942086+0000","172.21.15.46:0/1149961133":"2024-09-22T03:45:05.097136+0000","172.21.15.46:6800/1185001582":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/641493295":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/4033661287":"2024-09-22T03:45:31.101657+0000","172.21.15.46:6800/2733048710":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/3972416280":"2024-09-22T03:46:31.942086+0000","172.21.15.46:6801/2733048710":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/1662975018":"2024-09-22T03:46:31.942086+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:53:46.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.700+0000 7fdb2ff6b640 1 -- 172.21.15.46:0/1179251626 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fdb140b6620 msgr2=0x7fdb140b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:46.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.700+0000 7fdb2ff6b640 1 --2- 172.21.15.46:0/1179251626 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fdb140b6620 0x7fdb140b8b30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdb24005d00 tx=0x7fdb2400b410 comp rx=0 tx=0).stop 2024-09-21T03:53:46.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.700+0000 7fdb2ff6b640 1 -- 172.21.15.46:0/1179251626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb28108cf0 msgr2=0x7fdb2819ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:46.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.700+0000 7fdb2ff6b640 1 --2- 172.21.15.46:0/1179251626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb28108cf0 0x7fdb2819ec70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fdb2000cce0 tx=0x7fdb2000a620 comp rx=0 tx=0).stop 2024-09-21T03:53:46.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.700+0000 7fdb2ff6b640 1 -- 172.21.15.46:0/1179251626 shutdown_connections 2024-09-21T03:53:46.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.700+0000 7fdb2ff6b640 1 --2- 172.21.15.46:0/1179251626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb28108cf0 0x7fdb2819ec70 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:46.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.700+0000 7fdb2ff6b640 1 --2- 172.21.15.46:0/1179251626 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb281083a0 0x7fdb281999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:46.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.700+0000 7fdb2ff6b640 1 --2- 172.21.15.46:0/1179251626 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fdb140b6620 0x7fdb140b8b30 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:46.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.700+0000 7fdb2ff6b640 1 --2- 172.21.15.46:0/1179251626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb28102a60 0x7fdb28199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:46.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.700+0000 7fdb2ff6b640 1 -- 172.21.15.46:0/1179251626 >> 172.21.15.46:0/1179251626 conn(0x7fdb28079730 msgr2=0x7fdb28104520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:46.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.701+0000 7fdb2ff6b640 1 -- 172.21.15.46:0/1179251626 shutdown_connections 2024-09-21T03:53:46.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:46.701+0000 7fdb2ff6b640 1 -- 172.21.15.46:0/1179251626 wait complete. 2024-09-21T03:53:47.339 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:47 smithi046 ceph-mon[30954]: pgmap v282: 97 pgs: 97 active+clean; 638 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.8 KiB/s wr, 3 op/s 2024-09-21T03:53:47.339 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:47 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/1179251626' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:53:47.372 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T03:53:47.372 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T03:53:47.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:47 smithi105 ceph-mon[34773]: pgmap v282: 97 pgs: 97 active+clean; 638 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.8 KiB/s wr, 3 op/s 2024-09-21T03:53:47.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:47 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/1179251626' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:53:47.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:47 smithi162 ceph-mon[35071]: pgmap v282: 97 pgs: 97 active+clean; 638 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.8 KiB/s wr, 3 op/s 2024-09-21T03:53:47.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:47 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/1179251626' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:53:47.633 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:48.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.177+0000 7f914ae55640 1 -- 172.21.15.46:0/2272707269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9144103b80 msgr2=0x7f9144103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:48.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.177+0000 7f914ae55640 1 --2- 172.21.15.46:0/2272707269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9144103b80 0x7f9144103f90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9134009900 tx=0x7f913402a410 comp rx=0 tx=0).stop 2024-09-21T03:53:48.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.177+0000 7f914ae55640 1 -- 172.21.15.46:0/2272707269 shutdown_connections 2024-09-21T03:53:48.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.177+0000 7f914ae55640 1 --2- 172.21.15.46:0/2272707269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9144109e10 0x7f9144110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:48.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.177+0000 7f914ae55640 1 --2- 172.21.15.46:0/2272707269 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91441094c0 0x7f91441098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:48.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.177+0000 7f914ae55640 1 --2- 172.21.15.46:0/2272707269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9144103b80 0x7f9144103f90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:48.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.177+0000 7f914ae55640 1 -- 172.21.15.46:0/2272707269 >> 172.21.15.46:0/2272707269 conn(0x7f91440ff5d0 msgr2=0x7f9144101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:48.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.177+0000 7f914ae55640 1 -- 172.21.15.46:0/2272707269 shutdown_connections 2024-09-21T03:53:48.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.177+0000 7f914ae55640 1 -- 172.21.15.46:0/2272707269 wait complete. 2024-09-21T03:53:48.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.177+0000 7f914ae55640 1 Processor -- start 2024-09-21T03:53:48.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.178+0000 7f914ae55640 1 -- start start 2024-09-21T03:53:48.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.178+0000 7f914ae55640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9144103b80 0x7f914419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:48.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.178+0000 7f914ae55640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91441094c0 0x7f914419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:48.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.178+0000 7f914ae55640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9144109e10 0x7f914419fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:48.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.178+0000 7f914ae55640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9144113ad0 con 0x7f91441094c0 2024-09-21T03:53:48.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.178+0000 7f914ae55640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9144113950 con 0x7f9144103b80 2024-09-21T03:53:48.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.178+0000 7f914ae55640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9144113c50 con 0x7f9144109e10 2024-09-21T03:53:48.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.178+0000 7f9143fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91441094c0 0x7f914419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:48.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.178+0000 7f9143fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91441094c0 0x7f914419aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48558/0 (socket says 172.21.15.46:48558) 2024-09-21T03:53:48.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.178+0000 7f9143fff640 1 -- 172.21.15.46:0/4205850590 learned_addr learned my addr 172.21.15.46:0/4205850590 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:53:48.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.178+0000 7f9148bf1640 1 --2- 172.21.15.46:0/4205850590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9144103b80 0x7f914419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:48.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.178+0000 7f91493f2640 1 --2- 172.21.15.46:0/4205850590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9144109e10 0x7f914419fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:48.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.178+0000 7f9143fff640 1 -- 172.21.15.46:0/4205850590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9144109e10 msgr2=0x7f914419fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:48.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.178+0000 7f9143fff640 1 --2- 172.21.15.46:0/4205850590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9144109e10 0x7f914419fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:48.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.178+0000 7f9143fff640 1 -- 172.21.15.46:0/4205850590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9144103b80 msgr2=0x7f914419a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:48.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.178+0000 7f9143fff640 1 --2- 172.21.15.46:0/4205850590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9144103b80 0x7f914419a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:48.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.178+0000 7f9143fff640 1 -- 172.21.15.46:0/4205850590 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91441a0350 con 0x7f91441094c0 2024-09-21T03:53:48.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.178+0000 7f9148bf1640 1 --2- 172.21.15.46:0/4205850590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9144103b80 0x7f914419a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:53:48.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.178+0000 7f91493f2640 1 --2- 172.21.15.46:0/4205850590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9144109e10 0x7f914419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:53:48.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.179+0000 7f9143fff640 1 --2- 172.21.15.46:0/4205850590 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91441094c0 0x7f914419aa40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f913800c970 tx=0x7f913800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:48.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.179+0000 7f9141ffb640 1 -- 172.21.15.46:0/4205850590 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9138007bb0 con 0x7f91441094c0 2024-09-21T03:53:48.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.179+0000 7f914ae55640 1 -- 172.21.15.46:0/4205850590 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91441a0640 con 0x7f91441094c0 2024-09-21T03:53:48.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.179+0000 7f9141ffb640 1 -- 172.21.15.46:0/4205850590 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9138007d50 con 0x7f91441094c0 2024-09-21T03:53:48.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.179+0000 7f9141ffb640 1 -- 172.21.15.46:0/4205850590 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9138004e10 con 0x7f91441094c0 2024-09-21T03:53:48.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.179+0000 7f914ae55640 1 -- 172.21.15.46:0/4205850590 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91441a6e60 con 0x7f91441094c0 2024-09-21T03:53:48.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.180+0000 7f914ae55640 1 -- 172.21.15.46:0/4205850590 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9144103f90 con 0x7f91441094c0 2024-09-21T03:53:48.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.181+0000 7f9141ffb640 1 -- 172.21.15.46:0/4205850590 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f9138005000 con 0x7f91441094c0 2024-09-21T03:53:48.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.182+0000 7f9141ffb640 1 --2- 172.21.15.46:0/4205850590 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f912c0b6620 0x7f912c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:48.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.182+0000 7f9148bf1640 1 --2- 172.21.15.46:0/4205850590 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f912c0b6620 0x7f912c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:48.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.182+0000 7f9141ffb640 1 -- 172.21.15.46:0/4205850590 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f91380e7380 con 0x7f91441094c0 2024-09-21T03:53:48.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.183+0000 7f9148bf1640 1 --2- 172.21.15.46:0/4205850590 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f912c0b6620 0x7f912c0b8b30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9134031440 tx=0x7f9134005d50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:48.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.187+0000 7f9141ffb640 1 -- 172.21.15.46:0/4205850590 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9138014030 con 0x7f91441094c0 2024-09-21T03:53:48.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.375+0000 7f914ae55640 1 -- 172.21.15.46:0/4205850590 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f914410b650 con 0x7f91441094c0 2024-09-21T03:53:48.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.377+0000 7f9141ffb640 1 -- 172.21.15.46:0/4205850590 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22876 (secure 0 0 0) 0x7f91380ada30 con 0x7f91441094c0 2024-09-21T03:53:48.379 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:53:48.380 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":77,"fsid":"a82de5ec-77cb-11ef-baf5-efdc52797490","created":"2024-09-21T03:44:31.512271+0000","modified":"2024-09-21T03:53:33.028150+0000","last_up_change":"2024-09-21T03:52:22.609789+0000","last_in_change":"2024-09-21T03:51:58.812316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:48:30.407205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:53:09.943833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:53:12.521980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ff9e1a8-fec7-422c-b594-880efe4684f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6803","nonce":791989880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6805","nonce":791989880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6809","nonce":791989880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6807","nonce":791989880}]},"public_addr":"172.21.15.46:6803/791989880","cluster_addr":"172.21.15.46:6805/791989880","heartbeat_back_addr":"172.21.15.46:6809/791989880","heartbeat_front_addr":"172.21.15.46:6807/791989880","state":["exists","up"]},{"osd":1,"uuid":"3df1bee7-615e-44d0-bd43-2370db6cd06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6801","nonce":1123652172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6803","nonce":1123652172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6807","nonce":1123652172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6805","nonce":1123652172}]},"public_addr":"172.21.15.105:6801/1123652172","cluster_addr":"172.21.15.105:6803/1123652172","heartbeat_back_addr":"172.21.15.105:6807/1123652172","heartbeat_front_addr":"172.21.15.105:6805/1123652172","state":["exists","up"]},{"osd":2,"uuid":"52d0e57f-cfca-447a-8a57-b1d5364cb4d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6801","nonce":34930776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6803","nonce":34930776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6807","nonce":34930776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6805","nonce":34930776}]},"public_addr":"172.21.15.162:6801/34930776","cluster_addr":"172.21.15.162:6803/34930776","heartbeat_back_addr":"172.21.15.162:6807/34930776","heartbeat_front_addr":"172.21.15.162:6805/34930776","state":["exists","up"]},{"osd":3,"uuid":"6f25f721-fc50-4b80-944b-d3df28e7a2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6811","nonce":1355580104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6813","nonce":1355580104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6817","nonce":1355580104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6815","nonce":1355580104}]},"public_addr":"172.21.15.46:6811/1355580104","cluster_addr":"172.21.15.46:6813/1355580104","heartbeat_back_addr":"172.21.15.46:6817/1355580104","heartbeat_front_addr":"172.21.15.46:6815/1355580104","state":["exists","up"]},{"osd":4,"uuid":"c2f41084-e5a1-4b5f-b799-a84b38da63a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6809","nonce":3566174660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6811","nonce":3566174660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6815","nonce":3566174660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6813","nonce":3566174660}]},"public_addr":"172.21.15.105:6809/3566174660","cluster_addr":"172.21.15.105:6811/3566174660","heartbeat_back_addr":"172.21.15.105:6815/3566174660","heartbeat_front_addr":"172.21.15.105:6813/3566174660","state":["exists","up"]},{"osd":5,"uuid":"b433d03b-fae8-4ece-b967-a8af91bc3ab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6809","nonce":3043419818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6811","nonce":3043419818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6815","nonce":3043419818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6813","nonce":3043419818}]},"public_addr":"172.21.15.162:6809/3043419818","cluster_addr":"172.21.15.162:6811/3043419818","heartbeat_back_addr":"172.21.15.162:6815/3043419818","heartbeat_front_addr":"172.21.15.162:6813/3043419818","state":["exists","up"]},{"osd":6,"uuid":"e6b5ce54-69aa-4811-9ca3-cab50525a175","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6819","nonce":1615361645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6821","nonce":1615361645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6825","nonce":1615361645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6823","nonce":1615361645}]},"public_addr":"172.21.15.46:6819/1615361645","cluster_addr":"172.21.15.46:6821/1615361645","heartbeat_back_addr":"172.21.15.46:6825/1615361645","heartbeat_front_addr":"172.21.15.46:6823/1615361645","state":["exists","up"]},{"osd":7,"uuid":"a6e89d5d-ce31-4e0c-9019-5eb13b134feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6817","nonce":1015687379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6819","nonce":1015687379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6823","nonce":1015687379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6821","nonce":1015687379}]},"public_addr":"172.21.15.105:6817/1015687379","cluster_addr":"172.21.15.105:6819/1015687379","heartbeat_back_addr":"172.21.15.105:6823/1015687379","heartbeat_front_addr":"172.21.15.105:6821/1015687379","state":["exists","up"]},{"osd":8,"uuid":"27b2ccec-65be-47b3-a924-c5939ba1cb5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6817","nonce":3441747512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6819","nonce":3441747512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6823","nonce":3441747512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6821","nonce":3441747512}]},"public_addr":"172.21.15.162:6817/3441747512","cluster_addr":"172.21.15.162:6819/3441747512","heartbeat_back_addr":"172.21.15.162:6823/3441747512","heartbeat_front_addr":"172.21.15.162:6821/3441747512","state":["exists","up"]},{"osd":9,"uuid":"3f7cb70c-73c7-48e8-a32b-7445eda2126d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6827","nonce":382230768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6829","nonce":382230768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6833","nonce":382230768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6831","nonce":382230768}]},"public_addr":"172.21.15.46:6827/382230768","cluster_addr":"172.21.15.46:6829/382230768","heartbeat_back_addr":"172.21.15.46:6833/382230768","heartbeat_front_addr":"172.21.15.46:6831/382230768","state":["exists","up"]},{"osd":10,"uuid":"76c3da87-f3c5-4985-87fd-647717b6af85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6825","nonce":1664619099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6827","nonce":1664619099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6831","nonce":1664619099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6829","nonce":1664619099}]},"public_addr":"172.21.15.105:6825/1664619099","cluster_addr":"172.21.15.105:6827/1664619099","heartbeat_back_addr":"172.21.15.105:6831/1664619099","heartbeat_front_addr":"172.21.15.105:6829/1664619099","state":["exists","up"]},{"osd":11,"uuid":"13269da8-5f05-4ce2-9c7a-6dd9c1041cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6825","nonce":1014820476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6827","nonce":1014820476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6831","nonce":1014820476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6829","nonce":1014820476}]},"public_addr":"172.21.15.162:6825/1014820476","cluster_addr":"172.21.15.162:6827/1014820476","heartbeat_back_addr":"172.21.15.162:6831/1014820476","heartbeat_front_addr":"172.21.15.162:6829/1014820476","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:47:38.630436+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:03.441596+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:28.647341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:54.270316+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:49:19.783873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:49:45.344485+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:50:12.165326+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:50:38.095996+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:03.814612+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:29.469718+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:55.407340+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:52:20.360243+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:6801/878116252":"2024-09-22T03:46:31.942086+0000","172.21.15.46:6800/878116252":"2024-09-22T03:46:31.942086+0000","172.21.15.46:0/3574041742":"2024-09-22T03:45:05.097136+0000","172.21.15.46:6801/1185001582":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/2839831446":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/3423884605":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/2761976928":"2024-09-22T03:46:31.942086+0000","172.21.15.46:0/1149961133":"2024-09-22T03:45:05.097136+0000","172.21.15.46:6800/1185001582":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/641493295":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/4033661287":"2024-09-22T03:45:31.101657+0000","172.21.15.46:6800/2733048710":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/3972416280":"2024-09-22T03:46:31.942086+0000","172.21.15.46:6801/2733048710":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/1662975018":"2024-09-22T03:46:31.942086+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:53:48.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.379+0000 7f914ae55640 1 -- 172.21.15.46:0/4205850590 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f912c0b6620 msgr2=0x7f912c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:48.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.379+0000 7f914ae55640 1 --2- 172.21.15.46:0/4205850590 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f912c0b6620 0x7f912c0b8b30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9134031440 tx=0x7f9134005d50 comp rx=0 tx=0).stop 2024-09-21T03:53:48.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.380+0000 7f914ae55640 1 -- 172.21.15.46:0/4205850590 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91441094c0 msgr2=0x7f914419aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:48.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.380+0000 7f914ae55640 1 --2- 172.21.15.46:0/4205850590 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91441094c0 0x7f914419aa40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f913800c970 tx=0x7f913800ce30 comp rx=0 tx=0).stop 2024-09-21T03:53:48.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.380+0000 7f914ae55640 1 -- 172.21.15.46:0/4205850590 shutdown_connections 2024-09-21T03:53:48.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.380+0000 7f914ae55640 1 --2- 172.21.15.46:0/4205850590 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f912c0b6620 0x7f912c0b8b30 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:48.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.380+0000 7f914ae55640 1 --2- 172.21.15.46:0/4205850590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9144109e10 0x7f914419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:48.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.380+0000 7f914ae55640 1 --2- 172.21.15.46:0/4205850590 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91441094c0 0x7f914419aa40 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:48.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.380+0000 7f914ae55640 1 --2- 172.21.15.46:0/4205850590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9144103b80 0x7f914419a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:48.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.380+0000 7f914ae55640 1 -- 172.21.15.46:0/4205850590 >> 172.21.15.46:0/4205850590 conn(0x7f91440ff5d0 msgr2=0x7f91441019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:48.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.380+0000 7f914ae55640 1 -- 172.21.15.46:0/4205850590 shutdown_connections 2024-09-21T03:53:48.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:48.380+0000 7f914ae55640 1 -- 172.21.15.46:0/4205850590 wait complete. 2024-09-21T03:53:49.152 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T03:53:49.152 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T03:53:49.153 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T03:53:49.153 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T03:53:49.153 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T03:53:49.154 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T03:53:49.154 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell osd.6 flush_pg_stats 2024-09-21T03:53:49.155 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell osd.7 flush_pg_stats 2024-09-21T03:53:49.155 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell osd.8 flush_pg_stats 2024-09-21T03:53:49.155 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell osd.9 flush_pg_stats 2024-09-21T03:53:49.156 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell osd.10 flush_pg_stats 2024-09-21T03:53:49.156 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell osd.11 flush_pg_stats 2024-09-21T03:53:49.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:49 smithi046 ceph-mon[30954]: pgmap v283: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.4 KiB/s wr, 4 op/s 2024-09-21T03:53:49.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:49 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/4205850590' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:53:49.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:49 smithi105 ceph-mon[34773]: pgmap v283: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.4 KiB/s wr, 4 op/s 2024-09-21T03:53:49.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:49 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/4205850590' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:53:49.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:49 smithi162 ceph-mon[35071]: pgmap v283: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.4 KiB/s wr, 4 op/s 2024-09-21T03:53:49.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:49 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/4205850590' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:53:49.862 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:49.866 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:50.247 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:50.252 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:50.253 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:50.255 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:50.258 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:50.258 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:50.258 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:50.261 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:50.262 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:50.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.779+0000 7f94f2005640 1 -- 172.21.15.46:0/1162848324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94ec102f90 msgr2=0x7f94ec10fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:50.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.779+0000 7f94f2005640 1 --2- 172.21.15.46:0/1162848324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94ec102f90 0x7f94ec10fcb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f94e0009900 tx=0x7f94e002a480 comp rx=0 tx=0).stop 2024-09-21T03:53:50.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.779+0000 7f94f2005640 1 -- 172.21.15.46:0/1162848324 shutdown_connections 2024-09-21T03:53:50.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.779+0000 7f94f2005640 1 --2- 172.21.15.46:0/1162848324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94ec1101f0 0x7f94ec112610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:50.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.779+0000 7f94f2005640 1 --2- 172.21.15.46:0/1162848324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94ec102f90 0x7f94ec10fcb0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:50.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.779+0000 7f94f2005640 1 --2- 172.21.15.46:0/1162848324 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94ec102640 0x7f94ec102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:50.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.779+0000 7f94f2005640 1 -- 172.21.15.46:0/1162848324 >> 172.21.15.46:0/1162848324 conn(0x7f94ec079730 msgr2=0x7f94ec079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:50.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.779+0000 7f94f2005640 1 -- 172.21.15.46:0/1162848324 shutdown_connections 2024-09-21T03:53:50.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.779+0000 7f94f2005640 1 -- 172.21.15.46:0/1162848324 wait complete. 2024-09-21T03:53:50.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.780+0000 7f94f2005640 1 Processor -- start 2024-09-21T03:53:50.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.780+0000 7f94f2005640 1 -- start start 2024-09-21T03:53:50.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.780+0000 7f94f2005640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94ec102640 0x7f94ec19c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:50.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.780+0000 7f94f2005640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94ec102f90 0x7f94ec19cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:50.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.780+0000 7f94f2005640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94ec1101f0 0x7f94ec1a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:50.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.780+0000 7f94f2005640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f94ec115c60 con 0x7f94ec102f90 2024-09-21T03:53:50.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.780+0000 7f94f2005640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f94ec115ae0 con 0x7f94ec102640 2024-09-21T03:53:50.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.780+0000 7f94f2005640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f94ec115de0 con 0x7f94ec1101f0 2024-09-21T03:53:50.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.780+0000 7f94eaffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94ec102f90 0x7f94ec19cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:50.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.780+0000 7f94eaffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94ec102f90 0x7f94ec19cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48582/0 (socket says 172.21.15.46:48582) 2024-09-21T03:53:50.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.780+0000 7f94eaffd640 1 -- 172.21.15.46:0/2642987884 learned_addr learned my addr 172.21.15.46:0/2642987884 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:53:50.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.780+0000 7f94ebfff640 1 --2- 172.21.15.46:0/2642987884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94ec1101f0 0x7f94ec1a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:50.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.781+0000 7f94eb7fe640 1 --2- 172.21.15.46:0/2642987884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94ec102640 0x7f94ec19c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:50.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.781+0000 7f94eaffd640 1 -- 172.21.15.46:0/2642987884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94ec1101f0 msgr2=0x7f94ec1a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:50.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.781+0000 7f94eaffd640 1 --2- 172.21.15.46:0/2642987884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94ec1101f0 0x7f94ec1a1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:50.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.781+0000 7f94eaffd640 1 -- 172.21.15.46:0/2642987884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94ec102640 msgr2=0x7f94ec19c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:50.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.781+0000 7f94eaffd640 1 --2- 172.21.15.46:0/2642987884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94ec102640 0x7f94ec19c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:50.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.781+0000 7f94eaffd640 1 -- 172.21.15.46:0/2642987884 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94ec1a2580 con 0x7f94ec102f90 2024-09-21T03:53:50.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.781+0000 7f94eaffd640 1 --2- 172.21.15.46:0/2642987884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94ec102f90 0x7f94ec19cbb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f94e0005940 tx=0x7f94e00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:50.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.781+0000 7f94e8ff9640 1 -- 172.21.15.46:0/2642987884 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e003f030 con 0x7f94ec102f90 2024-09-21T03:53:50.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.781+0000 7f94f2005640 1 -- 172.21.15.46:0/2642987884 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94ec1a2810 con 0x7f94ec102f90 2024-09-21T03:53:50.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.781+0000 7f94e8ff9640 1 -- 172.21.15.46:0/2642987884 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94e0003cb0 con 0x7f94ec102f90 2024-09-21T03:53:50.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.781+0000 7f94e8ff9640 1 -- 172.21.15.46:0/2642987884 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e0035070 con 0x7f94ec102f90 2024-09-21T03:53:50.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.781+0000 7f94f2005640 1 -- 172.21.15.46:0/2642987884 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94ec1a8fd0 con 0x7f94ec102f90 2024-09-21T03:53:50.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.782+0000 7f94f2005640 1 -- 172.21.15.46:0/2642987884 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f94ec10a780 con 0x7f94ec102f90 2024-09-21T03:53:50.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.784+0000 7f94e8ff9640 1 -- 172.21.15.46:0/2642987884 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f94e0042030 con 0x7f94ec102f90 2024-09-21T03:53:50.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.784+0000 7f94e8ff9640 1 --2- 172.21.15.46:0/2642987884 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f94d40b65f0 0x7f94d40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:50.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.785+0000 7f94eb7fe640 1 --2- 172.21.15.46:0/2642987884 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f94d40b65f0 0x7f94d40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:50.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.785+0000 7f94e8ff9640 1 -- 172.21.15.46:0/2642987884 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f94e0108020 con 0x7f94ec102f90 2024-09-21T03:53:50.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.785+0000 7f94e8ff9640 1 --2- 172.21.15.46:0/2642987884 >> [v2:172.21.15.105:6816/1015687379,v1:172.21.15.105:6817/1015687379] conn(0x7f94d40c0260 0x7f94d40c2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:50.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.785+0000 7f94e8ff9640 1 -- 172.21.15.46:0/2642987884 --> [v2:172.21.15.105:6816/1015687379,v1:172.21.15.105:6817/1015687379] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f94e002eec0 con 0x7f94d40c0260 2024-09-21T03:53:50.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.785+0000 7f94e8ff9640 1 -- 172.21.15.46:0/2642987884 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f94e0108500 con 0x7f94ec102f90 2024-09-21T03:53:50.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.785+0000 7f94eb7fe640 1 --2- 172.21.15.46:0/2642987884 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f94d40b65f0 0x7f94d40b8b00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f94dc005fd0 tx=0x7f94dc005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:50.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.785+0000 7f94ebfff640 1 --2- 172.21.15.46:0/2642987884 >> [v2:172.21.15.105:6816/1015687379,v1:172.21.15.105:6817/1015687379] conn(0x7f94d40c0260 0x7f94d40c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:50.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.786+0000 7f94ebfff640 1 --2- 172.21.15.46:0/2642987884 >> [v2:172.21.15.105:6816/1015687379,v1:172.21.15.105:6817/1015687379] conn(0x7f94d40c0260 0x7f94d40c2750 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:50.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.786+0000 7f94e8ff9640 1 -- 172.21.15.46:0/2642987884 <== osd.7 v2:172.21.15.105:6816/1015687379 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f94e002eec0 con 0x7f94d40c0260 2024-09-21T03:53:50.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.801+0000 7f94f2005640 1 -- 172.21.15.46:0/2642987884 --> [v2:172.21.15.105:6816/1015687379,v1:172.21.15.105:6817/1015687379] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f94ec06b390 con 0x7f94d40c0260 2024-09-21T03:53:50.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.802+0000 7f94e8ff9640 1 -- 172.21.15.46:0/2642987884 <== osd.7 v2:172.21.15.105:6816/1015687379 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f94ec06b390 con 0x7f94d40c0260 2024-09-21T03:53:50.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.802+0000 7f94f2005640 1 -- 172.21.15.46:0/2642987884 >> [v2:172.21.15.105:6816/1015687379,v1:172.21.15.105:6817/1015687379] conn(0x7f94d40c0260 msgr2=0x7f94d40c2750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:50.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.802+0000 7f94f2005640 1 --2- 172.21.15.46:0/2642987884 >> [v2:172.21.15.105:6816/1015687379,v1:172.21.15.105:6817/1015687379] conn(0x7f94d40c0260 0x7f94d40c2750 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:50.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.802+0000 7f94f2005640 1 -- 172.21.15.46:0/2642987884 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f94d40b65f0 msgr2=0x7f94d40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:50.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.802+0000 7f94f2005640 1 --2- 172.21.15.46:0/2642987884 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f94d40b65f0 0x7f94d40b8b00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f94dc005fd0 tx=0x7f94dc005850 comp rx=0 tx=0).stop 2024-09-21T03:53:50.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.802+0000 7f94f2005640 1 -- 172.21.15.46:0/2642987884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94ec102f90 msgr2=0x7f94ec19cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:50.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.802+0000 7f94f2005640 1 --2- 172.21.15.46:0/2642987884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94ec102f90 0x7f94ec19cbb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f94e0005940 tx=0x7f94e00042f0 comp rx=0 tx=0).stop 2024-09-21T03:53:50.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.802+0000 7f94ebfff640 1 -- 172.21.15.46:0/2642987884 reap_dead start 2024-09-21T03:53:50.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.803+0000 7f94f2005640 1 -- 172.21.15.46:0/2642987884 shutdown_connections 2024-09-21T03:53:50.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.803+0000 7f94f2005640 1 -- 172.21.15.46:0/2642987884 >> 172.21.15.46:0/2642987884 conn(0x7f94ec079730 msgr2=0x7f94ec109d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:50.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.803+0000 7f94f2005640 1 -- 172.21.15.46:0/2642987884 shutdown_connections 2024-09-21T03:53:50.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.803+0000 7f94f2005640 1 -- 172.21.15.46:0/2642987884 wait complete. 2024-09-21T03:53:51.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.888+0000 7f2074429640 1 -- 172.21.15.46:0/2419765903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f206c1083a0 msgr2=0x7f206c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:51.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.888+0000 7f2074429640 1 --2- 172.21.15.46:0/2419765903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f206c1083a0 0x7f206c1087b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f205c009900 tx=0x7f205c02a3f0 comp rx=0 tx=0).stop 2024-09-21T03:53:51.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.889+0000 7f2074429640 1 -- 172.21.15.46:0/2419765903 shutdown_connections 2024-09-21T03:53:51.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.889+0000 7f2074429640 1 --2- 172.21.15.46:0/2419765903 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f206c108cf0 0x7f206c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:51.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.889+0000 7f2074429640 1 --2- 172.21.15.46:0/2419765903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f206c1083a0 0x7f206c1087b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:51.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.889+0000 7f2074429640 1 --2- 172.21.15.46:0/2419765903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f206c102a60 0x7f206c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:51.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.889+0000 7f2074429640 1 -- 172.21.15.46:0/2419765903 >> 172.21.15.46:0/2419765903 conn(0x7f206c079730 msgr2=0x7f206c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:51.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.889+0000 7f2074429640 1 -- 172.21.15.46:0/2419765903 shutdown_connections 2024-09-21T03:53:51.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.889+0000 7f2074429640 1 -- 172.21.15.46:0/2419765903 wait complete. 2024-09-21T03:53:51.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.889+0000 7f2074429640 1 Processor -- start 2024-09-21T03:53:51.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.889+0000 7f2074429640 1 -- start start 2024-09-21T03:53:51.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.890+0000 7f2074429640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f206c102a60 0x7f206c19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:51.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.890+0000 7f2074429640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f206c1083a0 0x7f206c19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:51.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.890+0000 7f2074429640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f206c108cf0 0x7f206c19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:51.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.890+0000 7f2074429640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f206c112960 con 0x7f206c102a60 2024-09-21T03:53:51.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.890+0000 7f2074429640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f206c1127e0 con 0x7f206c108cf0 2024-09-21T03:53:51.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.890+0000 7f2074429640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f206c112ae0 con 0x7f206c1083a0 2024-09-21T03:53:51.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.890+0000 7f20721c5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f206c102a60 0x7f206c19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:51.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.891+0000 7f20721c5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f206c102a60 0x7f206c19a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48608/0 (socket says 172.21.15.46:48608) 2024-09-21T03:53:51.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.891+0000 7f20721c5640 1 -- 172.21.15.46:0/561910309 learned_addr learned my addr 172.21.15.46:0/561910309 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:53:51.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.891+0000 7f20729c6640 1 --2- 172.21.15.46:0/561910309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f206c108cf0 0x7f206c19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:51.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.891+0000 7f20721c5640 1 -- 172.21.15.46:0/561910309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f206c1083a0 msgr2=0x7f206c19aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:51.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.891+0000 7f20721c5640 1 --2- 172.21.15.46:0/561910309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f206c1083a0 0x7f206c19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:51.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.891+0000 7f20721c5640 1 -- 172.21.15.46:0/561910309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f206c108cf0 msgr2=0x7f206c19fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:51.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.891+0000 7f20721c5640 1 --2- 172.21.15.46:0/561910309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f206c108cf0 0x7f206c19fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:51.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.891+0000 7f20721c5640 1 -- 172.21.15.46:0/561910309 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f206c1a0330 con 0x7f206c102a60 2024-09-21T03:53:51.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.891+0000 7f20721c5640 1 --2- 172.21.15.46:0/561910309 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f206c102a60 0x7f206c19a480 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f206800d950 tx=0x7f206800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:51.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.892+0000 7f20637fe640 1 -- 172.21.15.46:0/561910309 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2068017070 con 0x7f206c102a60 2024-09-21T03:53:51.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.892+0000 7f20637fe640 1 -- 172.21.15.46:0/561910309 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2068009c30 con 0x7f206c102a60 2024-09-21T03:53:51.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.892+0000 7f2074429640 1 -- 172.21.15.46:0/561910309 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f206c1a0620 con 0x7f206c102a60 2024-09-21T03:53:51.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.892+0000 7f20637fe640 1 -- 172.21.15.46:0/561910309 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206800f620 con 0x7f206c102a60 2024-09-21T03:53:51.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.892+0000 7f2074429640 1 -- 172.21.15.46:0/561910309 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f206c1a6e40 con 0x7f206c102a60 2024-09-21T03:53:51.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.893+0000 7f2074429640 1 -- 172.21.15.46:0/561910309 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f206c063b50 con 0x7f206c102a60 2024-09-21T03:53:51.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.894+0000 7f20637fe640 1 -- 172.21.15.46:0/561910309 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f2068010460 con 0x7f206c102a60 2024-09-21T03:53:51.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.895+0000 7f20637fe640 1 --2- 172.21.15.46:0/561910309 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f20580b66a0 0x7f20580b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:51.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.895+0000 7f20637fe640 1 -- 172.21.15.46:0/561910309 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f20680e7510 con 0x7f206c102a60 2024-09-21T03:53:51.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.895+0000 7f20719c4640 1 --2- 172.21.15.46:0/561910309 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f20580b66a0 0x7f20580b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:51.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.896+0000 7f20637fe640 1 --2- 172.21.15.46:0/561910309 >> [v2:172.21.15.105:6800/1123652172,v1:172.21.15.105:6801/1123652172] conn(0x7f20580c0310 0x7f20580c2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:51.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.896+0000 7f20637fe640 1 -- 172.21.15.46:0/561910309 --> [v2:172.21.15.105:6800/1123652172,v1:172.21.15.105:6801/1123652172] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f20580c2ed0 con 0x7f20580c0310 2024-09-21T03:53:51.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.896+0000 7f20637fe640 1 -- 172.21.15.46:0/561910309 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f20680e7940 con 0x7f206c102a60 2024-09-21T03:53:51.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.896+0000 7f20729c6640 1 --2- 172.21.15.46:0/561910309 >> [v2:172.21.15.105:6800/1123652172,v1:172.21.15.105:6801/1123652172] conn(0x7f20580c0310 0x7f20580c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:51.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.896+0000 7f20719c4640 1 --2- 172.21.15.46:0/561910309 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f20580b66a0 0x7f20580b8bb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f205c02a910 tx=0x7f205c031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:51.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.896+0000 7f20729c6640 1 --2- 172.21.15.46:0/561910309 >> [v2:172.21.15.105:6800/1123652172,v1:172.21.15.105:6801/1123652172] conn(0x7f20580c0310 0x7f20580c2800 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:51.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.897+0000 7f20637fe640 1 -- 172.21.15.46:0/561910309 <== osd.1 v2:172.21.15.105:6800/1123652172 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f20580c2ed0 con 0x7f20580c0310 2024-09-21T03:53:51.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.911+0000 7f2074429640 1 -- 172.21.15.46:0/561910309 --> [v2:172.21.15.105:6800/1123652172,v1:172.21.15.105:6801/1123652172] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f206c063f50 con 0x7f20580c0310 2024-09-21T03:53:51.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.912+0000 7f20637fe640 1 -- 172.21.15.46:0/561910309 <== osd.1 v2:172.21.15.105:6800/1123652172 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f206c063f50 con 0x7f20580c0310 2024-09-21T03:53:51.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.912+0000 7f2074429640 1 -- 172.21.15.46:0/561910309 >> [v2:172.21.15.105:6800/1123652172,v1:172.21.15.105:6801/1123652172] conn(0x7f20580c0310 msgr2=0x7f20580c2800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:51.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.912+0000 7f2074429640 1 --2- 172.21.15.46:0/561910309 >> [v2:172.21.15.105:6800/1123652172,v1:172.21.15.105:6801/1123652172] conn(0x7f20580c0310 0x7f20580c2800 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:51.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.912+0000 7f2074429640 1 -- 172.21.15.46:0/561910309 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f20580b66a0 msgr2=0x7f20580b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:51.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.912+0000 7f2074429640 1 --2- 172.21.15.46:0/561910309 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f20580b66a0 0x7f20580b8bb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f205c02a910 tx=0x7f205c031400 comp rx=0 tx=0).stop 2024-09-21T03:53:51.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.912+0000 7f2074429640 1 -- 172.21.15.46:0/561910309 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f206c102a60 msgr2=0x7f206c19a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:51.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.912+0000 7f2074429640 1 --2- 172.21.15.46:0/561910309 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f206c102a60 0x7f206c19a480 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f206800d950 tx=0x7f206800de10 comp rx=0 tx=0).stop 2024-09-21T03:53:51.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.912+0000 7f20729c6640 1 -- 172.21.15.46:0/561910309 reap_dead start 2024-09-21T03:53:51.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.912+0000 7f2074429640 1 -- 172.21.15.46:0/561910309 shutdown_connections 2024-09-21T03:53:51.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.912+0000 7f2074429640 1 -- 172.21.15.46:0/561910309 >> 172.21.15.46:0/561910309 conn(0x7f206c079730 msgr2=0x7f206c06b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:51.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.912+0000 7f2074429640 1 -- 172.21.15.46:0/561910309 shutdown_connections 2024-09-21T03:53:51.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:50.912+0000 7f2074429640 1 -- 172.21.15.46:0/561910309 wait complete. 2024-09-21T03:53:51.401 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:51.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:51 smithi046 ceph-mon[30954]: pgmap v284: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T03:53:51.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:51 smithi105 ceph-mon[34773]: pgmap v284: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T03:53:51.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:51 smithi162 ceph-mon[35071]: pgmap v284: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T03:53:52.536 INFO:teuthology.orchestra.run.smithi046.stdout:201863462953 2024-09-21T03:53:52.537 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.7 2024-09-21T03:53:52.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.922+0000 7fece065a640 1 -- 172.21.15.46:0/1324806168 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecd8108cf0 msgr2=0x7fecd810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:52.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.922+0000 7fece065a640 1 --2- 172.21.15.46:0/1324806168 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecd8108cf0 0x7fecd810f520 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fecd0009ca0 tx=0x7fecd002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:53:52.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.922+0000 7fece065a640 1 -- 172.21.15.46:0/1324806168 shutdown_connections 2024-09-21T03:53:52.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.922+0000 7fece065a640 1 --2- 172.21.15.46:0/1324806168 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecd8108cf0 0x7fecd810f520 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:52.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.922+0000 7fece065a640 1 --2- 172.21.15.46:0/1324806168 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fecd81083a0 0x7fecd81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:52.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.922+0000 7fece065a640 1 --2- 172.21.15.46:0/1324806168 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecd8102a60 0x7fecd8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:52.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.922+0000 7fece065a640 1 -- 172.21.15.46:0/1324806168 >> 172.21.15.46:0/1324806168 conn(0x7fecd8079730 msgr2=0x7fecd8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:52.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.922+0000 7fece065a640 1 -- 172.21.15.46:0/1324806168 shutdown_connections 2024-09-21T03:53:52.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.922+0000 7fece065a640 1 -- 172.21.15.46:0/1324806168 wait complete. 2024-09-21T03:53:52.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.922+0000 7fece065a640 1 Processor -- start 2024-09-21T03:53:52.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.923+0000 7fece065a640 1 -- start start 2024-09-21T03:53:52.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.923+0000 7fece065a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fecd8102a60 0x7fecd81993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:52.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.923+0000 7fece065a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecd81083a0 0x7fecd8199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:52.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.923+0000 7fece065a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecd8108cf0 0x7fecd819ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:52.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.923+0000 7fece065a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fecd8112960 con 0x7fecd8108cf0 2024-09-21T03:53:52.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.923+0000 7fece065a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fecd81127e0 con 0x7fecd8102a60 2024-09-21T03:53:52.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.923+0000 7fece065a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fecd8112ae0 con 0x7fecd81083a0 2024-09-21T03:53:52.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.923+0000 7fecdebf7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecd8108cf0 0x7fecd819ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:52.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.923+0000 7fecdebf7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecd8108cf0 0x7fecd819ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47764/0 (socket says 172.21.15.46:47764) 2024-09-21T03:53:52.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.923+0000 7fecdebf7640 1 -- 172.21.15.46:0/323821972 learned_addr learned my addr 172.21.15.46:0/323821972 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:53:52.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.923+0000 7fecde3f6640 1 --2- 172.21.15.46:0/323821972 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fecd8102a60 0x7fecd81993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:52.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.923+0000 7fecddbf5640 1 --2- 172.21.15.46:0/323821972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecd81083a0 0x7fecd8199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:52.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.923+0000 7fecdebf7640 1 -- 172.21.15.46:0/323821972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecd81083a0 msgr2=0x7fecd8199950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:52.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.923+0000 7fecdebf7640 1 --2- 172.21.15.46:0/323821972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecd81083a0 0x7fecd8199950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:52.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.923+0000 7fecdebf7640 1 -- 172.21.15.46:0/323821972 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fecd8102a60 msgr2=0x7fecd81993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:52.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.923+0000 7fecdebf7640 1 --2- 172.21.15.46:0/323821972 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fecd8102a60 0x7fecd81993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:52.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.923+0000 7fecdebf7640 1 -- 172.21.15.46:0/323821972 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd819f320 con 0x7fecd8108cf0 2024-09-21T03:53:52.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.923+0000 7fecddbf5640 1 --2- 172.21.15.46:0/323821972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecd81083a0 0x7fecd8199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:53:52.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.924+0000 7fecdebf7640 1 --2- 172.21.15.46:0/323821972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecd8108cf0 0x7fecd819ebf0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fecd00098d0 tx=0x7fecd00317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:52.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.924+0000 7feccf7fe640 1 -- 172.21.15.46:0/323821972 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd0003b70 con 0x7fecd8108cf0 2024-09-21T03:53:52.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.924+0000 7fece065a640 1 -- 172.21.15.46:0/323821972 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecd819f5b0 con 0x7fecd8108cf0 2024-09-21T03:53:52.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.924+0000 7feccf7fe640 1 -- 172.21.15.46:0/323821972 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fecd0003d10 con 0x7fecd8108cf0 2024-09-21T03:53:52.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.924+0000 7feccf7fe640 1 -- 172.21.15.46:0/323821972 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd002fa20 con 0x7fecd8108cf0 2024-09-21T03:53:52.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.924+0000 7fece065a640 1 -- 172.21.15.46:0/323821972 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecd806ae60 con 0x7fecd8108cf0 2024-09-21T03:53:52.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.925+0000 7fece065a640 1 -- 172.21.15.46:0/323821972 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fecd806b3d0 con 0x7fecd8108cf0 2024-09-21T03:53:52.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.927+0000 7feccf7fe640 1 -- 172.21.15.46:0/323821972 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fecd002fbc0 con 0x7fecd8108cf0 2024-09-21T03:53:52.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.927+0000 7feccf7fe640 1 --2- 172.21.15.46:0/323821972 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fecc40b65f0 0x7fecc40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:52.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.927+0000 7fecde3f6640 1 --2- 172.21.15.46:0/323821972 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fecc40b65f0 0x7fecc40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:52.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.927+0000 7feccf7fe640 1 -- 172.21.15.46:0/323821972 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fecd0108b20 con 0x7fecd8108cf0 2024-09-21T03:53:52.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.928+0000 7feccf7fe640 1 --2- 172.21.15.46:0/323821972 >> [v2:172.21.15.46:6818/1615361645,v1:172.21.15.46:6819/1615361645] conn(0x7fecc40c0260 0x7fecc40c2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:52.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.928+0000 7feccf7fe640 1 -- 172.21.15.46:0/323821972 --> [v2:172.21.15.46:6818/1615361645,v1:172.21.15.46:6819/1615361645] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fecd000b150 con 0x7fecc40c0260 2024-09-21T03:53:52.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.928+0000 7feccf7fe640 1 -- 172.21.15.46:0/323821972 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fecd0108f50 con 0x7fecd8108cf0 2024-09-21T03:53:52.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.928+0000 7fecddbf5640 1 --2- 172.21.15.46:0/323821972 >> [v2:172.21.15.46:6818/1615361645,v1:172.21.15.46:6819/1615361645] conn(0x7fecc40c0260 0x7fecc40c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:52.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.928+0000 7fecde3f6640 1 --2- 172.21.15.46:0/323821972 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fecc40b65f0 0x7fecc40b8b00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fecd4009bd0 tx=0x7fecd4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:52.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.928+0000 7fecddbf5640 1 --2- 172.21.15.46:0/323821972 >> [v2:172.21.15.46:6818/1615361645,v1:172.21.15.46:6819/1615361645] conn(0x7fecc40c0260 0x7fecc40c2750 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:52.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.929+0000 7feccf7fe640 1 -- 172.21.15.46:0/323821972 <== osd.6 v2:172.21.15.46:6818/1615361645 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fecd000b150 con 0x7fecc40c0260 2024-09-21T03:53:52.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.943+0000 7fece065a640 1 -- 172.21.15.46:0/323821972 --> [v2:172.21.15.46:6818/1615361645,v1:172.21.15.46:6819/1615361645] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fecd806b7d0 con 0x7fecc40c0260 2024-09-21T03:53:52.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.943+0000 7feccf7fe640 1 -- 172.21.15.46:0/323821972 <== osd.6 v2:172.21.15.46:6818/1615361645 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fecd806b7d0 con 0x7fecc40c0260 2024-09-21T03:53:52.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.943+0000 7fece065a640 1 -- 172.21.15.46:0/323821972 >> [v2:172.21.15.46:6818/1615361645,v1:172.21.15.46:6819/1615361645] conn(0x7fecc40c0260 msgr2=0x7fecc40c2750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:52.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.943+0000 7fece065a640 1 --2- 172.21.15.46:0/323821972 >> [v2:172.21.15.46:6818/1615361645,v1:172.21.15.46:6819/1615361645] conn(0x7fecc40c0260 0x7fecc40c2750 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:52.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.943+0000 7fece065a640 1 -- 172.21.15.46:0/323821972 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fecc40b65f0 msgr2=0x7fecc40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:52.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.943+0000 7fece065a640 1 --2- 172.21.15.46:0/323821972 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fecc40b65f0 0x7fecc40b8b00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fecd4009bd0 tx=0x7fecd4005f90 comp rx=0 tx=0).stop 2024-09-21T03:53:52.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.943+0000 7fece065a640 1 -- 172.21.15.46:0/323821972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecd8108cf0 msgr2=0x7fecd819ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:52.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.943+0000 7fece065a640 1 --2- 172.21.15.46:0/323821972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecd8108cf0 0x7fecd819ebf0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fecd00098d0 tx=0x7fecd00317b0 comp rx=0 tx=0).stop 2024-09-21T03:53:52.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.943+0000 7fecdebf7640 1 -- 172.21.15.46:0/323821972 reap_dead start 2024-09-21T03:53:52.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.943+0000 7fece065a640 1 -- 172.21.15.46:0/323821972 shutdown_connections 2024-09-21T03:53:52.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.943+0000 7fece065a640 1 -- 172.21.15.46:0/323821972 >> 172.21.15.46:0/323821972 conn(0x7fecd8079730 msgr2=0x7fecd8104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:52.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.944+0000 7fece065a640 1 -- 172.21.15.46:0/323821972 shutdown_connections 2024-09-21T03:53:52.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.944+0000 7fece065a640 1 -- 172.21.15.46:0/323821972 wait complete. 2024-09-21T03:53:53.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.831+0000 7fdf859c1640 1 -- 172.21.15.46:0/868876836 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf801049d0 msgr2=0x7fdf80104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:53.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.831+0000 7fdf859c1640 1 --2- 172.21.15.46:0/868876836 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf801049d0 0x7fdf80104de0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fdf70009900 tx=0x7fdf7002a410 comp rx=0 tx=0).stop 2024-09-21T03:53:53.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.831+0000 7fdf859c1640 1 -- 172.21.15.46:0/868876836 shutdown_connections 2024-09-21T03:53:53.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.831+0000 7fdf859c1640 1 --2- 172.21.15.46:0/868876836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf8010de30 0x7fdf80110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:53.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.831+0000 7fdf859c1640 1 --2- 172.21.15.46:0/868876836 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf80105320 0x7fdf8010d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:53.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.831+0000 7fdf859c1640 1 --2- 172.21.15.46:0/868876836 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf801049d0 0x7fdf80104de0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:53.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.831+0000 7fdf859c1640 1 -- 172.21.15.46:0/868876836 >> 172.21.15.46:0/868876836 conn(0x7fdf80079740 msgr2=0x7fdf80079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:53.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.832+0000 7fdf859c1640 1 -- 172.21.15.46:0/868876836 shutdown_connections 2024-09-21T03:53:53.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.832+0000 7fdf859c1640 1 -- 172.21.15.46:0/868876836 wait complete. 2024-09-21T03:53:53.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.832+0000 7fdf859c1640 1 Processor -- start 2024-09-21T03:53:53.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.832+0000 7fdf859c1640 1 -- start start 2024-09-21T03:53:53.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.833+0000 7fdf859c1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf801049d0 0x7fdf8019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:53.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.833+0000 7fdf859c1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf80105320 0x7fdf8019ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:53.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.833+0000 7fdf859c1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf8010de30 0x7fdf8019fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:53.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.833+0000 7fdf859c1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdf80113ae0 con 0x7fdf80105320 2024-09-21T03:53:53.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.833+0000 7fdf859c1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdf80113960 con 0x7fdf8010de30 2024-09-21T03:53:53.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.833+0000 7fdf859c1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdf80113c60 con 0x7fdf801049d0 2024-09-21T03:53:53.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.833+0000 7fdf7e7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf80105320 0x7fdf8019ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:53.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.833+0000 7fdf7e7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf80105320 0x7fdf8019ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47750/0 (socket says 172.21.15.46:47750) 2024-09-21T03:53:53.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.833+0000 7fdf7e7fc640 1 -- 172.21.15.46:0/1236172894 learned_addr learned my addr 172.21.15.46:0/1236172894 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:53:53.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.833+0000 7fdf7effd640 1 --2- 172.21.15.46:0/1236172894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf801049d0 0x7fdf8019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:53.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.833+0000 7fdf7f7fe640 1 --2- 172.21.15.46:0/1236172894 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf8010de30 0x7fdf8019fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:53.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.833+0000 7fdf7e7fc640 1 -- 172.21.15.46:0/1236172894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf801049d0 msgr2=0x7fdf8019a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:53.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.833+0000 7fdf7e7fc640 1 --2- 172.21.15.46:0/1236172894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf801049d0 0x7fdf8019a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:53.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.833+0000 7fdf7e7fc640 1 -- 172.21.15.46:0/1236172894 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf8010de30 msgr2=0x7fdf8019fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:53.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.833+0000 7fdf7e7fc640 1 --2- 172.21.15.46:0/1236172894 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf8010de30 0x7fdf8019fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:53.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.833+0000 7fdf7e7fc640 1 -- 172.21.15.46:0/1236172894 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf801a0540 con 0x7fdf80105320 2024-09-21T03:53:53.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.834+0000 7fdf7e7fc640 1 --2- 172.21.15.46:0/1236172894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf80105320 0x7fdf8019ab70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fdf7400e9f0 tx=0x7fdf7400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:53.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.834+0000 7fdf849bf640 1 -- 172.21.15.46:0/1236172894 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7400ccc0 con 0x7fdf80105320 2024-09-21T03:53:53.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.834+0000 7fdf859c1640 1 -- 172.21.15.46:0/1236172894 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf801a0830 con 0x7fdf80105320 2024-09-21T03:53:53.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.834+0000 7fdf849bf640 1 -- 172.21.15.46:0/1236172894 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf740108e0 con 0x7fdf80105320 2024-09-21T03:53:53.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.834+0000 7fdf849bf640 1 -- 172.21.15.46:0/1236172894 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf74018860 con 0x7fdf80105320 2024-09-21T03:53:53.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.834+0000 7fdf859c1640 1 -- 172.21.15.46:0/1236172894 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf801a6f90 con 0x7fdf80105320 2024-09-21T03:53:53.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.835+0000 7fdf859c1640 1 -- 172.21.15.46:0/1236172894 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdf80063ad0 con 0x7fdf80105320 2024-09-21T03:53:53.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.837+0000 7fdf849bf640 1 -- 172.21.15.46:0/1236172894 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fdf74010430 con 0x7fdf80105320 2024-09-21T03:53:53.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.837+0000 7fdf849bf640 1 --2- 172.21.15.46:0/1236172894 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fdf680b65f0 0x7fdf680b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:53.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.838+0000 7fdf7effd640 1 --2- 172.21.15.46:0/1236172894 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fdf680b65f0 0x7fdf680b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:53.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.838+0000 7fdf849bf640 1 -- 172.21.15.46:0/1236172894 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fdf740e8380 con 0x7fdf80105320 2024-09-21T03:53:53.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.838+0000 7fdf849bf640 1 --2- 172.21.15.46:0/1236172894 >> [v2:172.21.15.162:6808/3043419818,v1:172.21.15.162:6809/3043419818] conn(0x7fdf680c0260 0x7fdf680c2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:53.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.838+0000 7fdf849bf640 1 -- 172.21.15.46:0/1236172894 --> [v2:172.21.15.162:6808/3043419818,v1:172.21.15.162:6809/3043419818] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdf680c2e20 con 0x7fdf680c0260 2024-09-21T03:53:53.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.838+0000 7fdf849bf640 1 -- 172.21.15.46:0/1236172894 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fdf740e87b0 con 0x7fdf80105320 2024-09-21T03:53:53.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.838+0000 7fdf7effd640 1 --2- 172.21.15.46:0/1236172894 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fdf680b65f0 0x7fdf680b8b00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdf70031440 tx=0x7fdf70005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:53.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.838+0000 7fdf7f7fe640 1 --2- 172.21.15.46:0/1236172894 >> [v2:172.21.15.162:6808/3043419818,v1:172.21.15.162:6809/3043419818] conn(0x7fdf680c0260 0x7fdf680c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:53.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.838+0000 7fdf7f7fe640 1 --2- 172.21.15.46:0/1236172894 >> [v2:172.21.15.162:6808/3043419818,v1:172.21.15.162:6809/3043419818] conn(0x7fdf680c0260 0x7fdf680c2750 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:53.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.839+0000 7fdf849bf640 1 -- 172.21.15.46:0/1236172894 <== osd.5 v2:172.21.15.162:6808/3043419818 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdf680c2e20 con 0x7fdf680c0260 2024-09-21T03:53:53.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.853+0000 7fdf859c1640 1 -- 172.21.15.46:0/1236172894 --> [v2:172.21.15.162:6808/3043419818,v1:172.21.15.162:6809/3043419818] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdf80063ed0 con 0x7fdf680c0260 2024-09-21T03:53:53.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.854+0000 7fdf849bf640 1 -- 172.21.15.46:0/1236172894 <== osd.5 v2:172.21.15.162:6808/3043419818 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdf80063ed0 con 0x7fdf680c0260 2024-09-21T03:53:53.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.854+0000 7fdf859c1640 1 -- 172.21.15.46:0/1236172894 >> [v2:172.21.15.162:6808/3043419818,v1:172.21.15.162:6809/3043419818] conn(0x7fdf680c0260 msgr2=0x7fdf680c2750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:53.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.854+0000 7fdf859c1640 1 --2- 172.21.15.46:0/1236172894 >> [v2:172.21.15.162:6808/3043419818,v1:172.21.15.162:6809/3043419818] conn(0x7fdf680c0260 0x7fdf680c2750 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:53.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.854+0000 7fdf859c1640 1 -- 172.21.15.46:0/1236172894 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fdf680b65f0 msgr2=0x7fdf680b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:53.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.854+0000 7fdf859c1640 1 --2- 172.21.15.46:0/1236172894 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fdf680b65f0 0x7fdf680b8b00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdf70031440 tx=0x7fdf70005a20 comp rx=0 tx=0).stop 2024-09-21T03:53:53.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.854+0000 7fdf859c1640 1 -- 172.21.15.46:0/1236172894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf80105320 msgr2=0x7fdf8019ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:53.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.854+0000 7fdf859c1640 1 --2- 172.21.15.46:0/1236172894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf80105320 0x7fdf8019ab70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fdf7400e9f0 tx=0x7fdf7400eeb0 comp rx=0 tx=0).stop 2024-09-21T03:53:53.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.854+0000 7fdf7f7fe640 1 -- 172.21.15.46:0/1236172894 reap_dead start 2024-09-21T03:53:53.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.854+0000 7fdf859c1640 1 -- 172.21.15.46:0/1236172894 shutdown_connections 2024-09-21T03:53:53.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.854+0000 7fdf859c1640 1 -- 172.21.15.46:0/1236172894 >> 172.21.15.46:0/1236172894 conn(0x7fdf80079740 msgr2=0x7fdf801007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:53.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.854+0000 7fdf859c1640 1 -- 172.21.15.46:0/1236172894 shutdown_connections 2024-09-21T03:53:53.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:52.854+0000 7fdf859c1640 1 -- 172.21.15.46:0/1236172894 wait complete. 2024-09-21T03:53:53.492 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:53 smithi046 ceph-mon[30954]: pgmap v285: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T03:53:53.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.489+0000 7fca97ab3640 1 -- 172.21.15.46:0/1140979096 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca900757b0 msgr2=0x7fca90075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:53.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.489+0000 7fca97ab3640 1 --2- 172.21.15.46:0/1140979096 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca900757b0 0x7fca90075bc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fca8c009900 tx=0x7fca8c02a410 comp rx=0 tx=0).stop 2024-09-21T03:53:53.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.489+0000 7fca97ab3640 1 -- 172.21.15.46:0/1140979096 shutdown_connections 2024-09-21T03:53:53.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.489+0000 7fca97ab3640 1 --2- 172.21.15.46:0/1140979096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca90110110 0x7fca90112550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:53.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.489+0000 7fca97ab3640 1 --2- 172.21.15.46:0/1140979096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca90076100 0x7fca9010fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:53.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.489+0000 7fca97ab3640 1 --2- 172.21.15.46:0/1140979096 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca900757b0 0x7fca90075bc0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:53.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.489+0000 7fca97ab3640 1 -- 172.21.15.46:0/1140979096 >> 172.21.15.46:0/1140979096 conn(0x7fca900ff600 msgr2=0x7fca90101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:53.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.490+0000 7fca97ab3640 1 -- 172.21.15.46:0/1140979096 shutdown_connections 2024-09-21T03:53:53.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.490+0000 7fca97ab3640 1 -- 172.21.15.46:0/1140979096 wait complete. 2024-09-21T03:53:53.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.490+0000 7fca97ab3640 1 Processor -- start 2024-09-21T03:53:53.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.490+0000 7fca97ab3640 1 -- start start 2024-09-21T03:53:53.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.491+0000 7fca97ab3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca900757b0 0x7fca9019c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:53.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.491+0000 7fca97ab3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca90076100 0x7fca9019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:53.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.491+0000 7fca97ab3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca90110110 0x7fca901a1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:53.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.491+0000 7fca97ab3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fca90115cc0 con 0x7fca900757b0 2024-09-21T03:53:53.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.491+0000 7fca97ab3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fca90115b40 con 0x7fca90110110 2024-09-21T03:53:53.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.491+0000 7fca97ab3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fca90115e40 con 0x7fca90076100 2024-09-21T03:53:53.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.491+0000 7fca9584f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca900757b0 0x7fca9019c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:53.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.491+0000 7fca9584f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca900757b0 0x7fca9019c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47792/0 (socket says 172.21.15.46:47792) 2024-09-21T03:53:53.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.491+0000 7fca9584f640 1 -- 172.21.15.46:0/2398305261 learned_addr learned my addr 172.21.15.46:0/2398305261 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:53:53.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.491+0000 7fca96050640 1 --2- 172.21.15.46:0/2398305261 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca90110110 0x7fca901a1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:53.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.491+0000 7fca9504e640 1 --2- 172.21.15.46:0/2398305261 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca90076100 0x7fca9019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:53.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.491+0000 7fca9584f640 1 -- 172.21.15.46:0/2398305261 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca90076100 msgr2=0x7fca9019cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:53.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.491+0000 7fca9584f640 1 --2- 172.21.15.46:0/2398305261 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca90076100 0x7fca9019cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:53.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.491+0000 7fca9584f640 1 -- 172.21.15.46:0/2398305261 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca90110110 msgr2=0x7fca901a1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:53.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.491+0000 7fca9584f640 1 --2- 172.21.15.46:0/2398305261 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca90110110 0x7fca901a1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:53.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.491+0000 7fca9584f640 1 -- 172.21.15.46:0/2398305261 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca901a26e0 con 0x7fca900757b0 2024-09-21T03:53:53.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.491+0000 7fca9584f640 1 --2- 172.21.15.46:0/2398305261 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca900757b0 0x7fca9019c770 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fca8c005940 tx=0x7fca8c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:53.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.492+0000 7fca86ffd640 1 -- 172.21.15.46:0/2398305261 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c03f030 con 0x7fca900757b0 2024-09-21T03:53:53.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.492+0000 7fca97ab3640 1 -- 172.21.15.46:0/2398305261 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca901a2970 con 0x7fca900757b0 2024-09-21T03:53:53.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.492+0000 7fca86ffd640 1 -- 172.21.15.46:0/2398305261 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca8c003cb0 con 0x7fca900757b0 2024-09-21T03:53:53.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.492+0000 7fca86ffd640 1 -- 172.21.15.46:0/2398305261 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c035070 con 0x7fca900757b0 2024-09-21T03:53:53.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.492+0000 7fca97ab3640 1 -- 172.21.15.46:0/2398305261 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca901a9130 con 0x7fca900757b0 2024-09-21T03:53:53.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.492+0000 7fca97ab3640 1 -- 172.21.15.46:0/2398305261 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fca9010a5e0 con 0x7fca900757b0 2024-09-21T03:53:53.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.494+0000 7fca86ffd640 1 -- 172.21.15.46:0/2398305261 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fca8c042030 con 0x7fca900757b0 2024-09-21T03:53:53.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.495+0000 7fca86ffd640 1 --2- 172.21.15.46:0/2398305261 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fca7c0b65f0 0x7fca7c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:53.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.495+0000 7fca9504e640 1 --2- 172.21.15.46:0/2398305261 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fca7c0b65f0 0x7fca7c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:53.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.495+0000 7fca86ffd640 1 -- 172.21.15.46:0/2398305261 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fca8c108130 con 0x7fca900757b0 2024-09-21T03:53:53.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.496+0000 7fca86ffd640 1 --2- 172.21.15.46:0/2398305261 >> [v2:172.21.15.162:6800/34930776,v1:172.21.15.162:6801/34930776] conn(0x7fca7c0c0260 0x7fca7c0c2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:53.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.496+0000 7fca86ffd640 1 -- 172.21.15.46:0/2398305261 --> [v2:172.21.15.162:6800/34930776,v1:172.21.15.162:6801/34930776] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca8c046e50 con 0x7fca7c0c0260 2024-09-21T03:53:53.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.496+0000 7fca86ffd640 1 -- 172.21.15.46:0/2398305261 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fca8c108560 con 0x7fca900757b0 2024-09-21T03:53:53.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.496+0000 7fca9504e640 1 --2- 172.21.15.46:0/2398305261 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fca7c0b65f0 0x7fca7c0b8b00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fca80005fd0 tx=0x7fca80005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:53.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.496+0000 7fca96050640 1 --2- 172.21.15.46:0/2398305261 >> [v2:172.21.15.162:6800/34930776,v1:172.21.15.162:6801/34930776] conn(0x7fca7c0c0260 0x7fca7c0c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:53.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.496+0000 7fca96050640 1 --2- 172.21.15.46:0/2398305261 >> [v2:172.21.15.162:6800/34930776,v1:172.21.15.162:6801/34930776] conn(0x7fca7c0c0260 0x7fca7c0c2750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:53.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.497+0000 7fca86ffd640 1 -- 172.21.15.46:0/2398305261 <== osd.2 v2:172.21.15.162:6800/34930776 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fca8c046e50 con 0x7fca7c0c0260 2024-09-21T03:53:53.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.511+0000 7fca97ab3640 1 -- 172.21.15.46:0/2398305261 --> [v2:172.21.15.162:6800/34930776,v1:172.21.15.162:6801/34930776] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fca90076cc0 con 0x7fca7c0c0260 2024-09-21T03:53:53.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.512+0000 7fca86ffd640 1 -- 172.21.15.46:0/2398305261 <== osd.2 v2:172.21.15.162:6800/34930776 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fca90076cc0 con 0x7fca7c0c0260 2024-09-21T03:53:53.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.512+0000 7fca97ab3640 1 -- 172.21.15.46:0/2398305261 >> [v2:172.21.15.162:6800/34930776,v1:172.21.15.162:6801/34930776] conn(0x7fca7c0c0260 msgr2=0x7fca7c0c2750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:53.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.512+0000 7fca97ab3640 1 --2- 172.21.15.46:0/2398305261 >> [v2:172.21.15.162:6800/34930776,v1:172.21.15.162:6801/34930776] conn(0x7fca7c0c0260 0x7fca7c0c2750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:53.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.512+0000 7fca97ab3640 1 -- 172.21.15.46:0/2398305261 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fca7c0b65f0 msgr2=0x7fca7c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:53.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.512+0000 7fca97ab3640 1 --2- 172.21.15.46:0/2398305261 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fca7c0b65f0 0x7fca7c0b8b00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fca80005fd0 tx=0x7fca80005850 comp rx=0 tx=0).stop 2024-09-21T03:53:53.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.512+0000 7fca97ab3640 1 -- 172.21.15.46:0/2398305261 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca900757b0 msgr2=0x7fca9019c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:53.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.512+0000 7fca97ab3640 1 --2- 172.21.15.46:0/2398305261 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca900757b0 0x7fca9019c770 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fca8c005940 tx=0x7fca8c0042f0 comp rx=0 tx=0).stop 2024-09-21T03:53:53.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.512+0000 7fca96050640 1 -- 172.21.15.46:0/2398305261 reap_dead start 2024-09-21T03:53:53.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.513+0000 7fca97ab3640 1 -- 172.21.15.46:0/2398305261 shutdown_connections 2024-09-21T03:53:53.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.513+0000 7fca97ab3640 1 -- 172.21.15.46:0/2398305261 >> 172.21.15.46:0/2398305261 conn(0x7fca900ff600 msgr2=0x7fca90109c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:53.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.513+0000 7fca97ab3640 1 -- 172.21.15.46:0/2398305261 shutdown_connections 2024-09-21T03:53:53.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:53.513+0000 7fca97ab3640 1 -- 172.21.15.46:0/2398305261 wait complete. 2024-09-21T03:53:53.567 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:53 smithi105 ceph-mon[34773]: pgmap v285: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T03:53:53.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:53 smithi162 ceph-mon[35071]: pgmap v285: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T03:53:54.161 INFO:teuthology.orchestra.run.smithi046.stdout:81604378692 2024-09-21T03:53:54.161 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T03:53:55.347 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:55 smithi046 ceph-mon[30954]: pgmap v286: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T03:53:55.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:55 smithi105 ceph-mon[34773]: pgmap v286: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T03:53:55.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:55 smithi162 ceph-mon[35071]: pgmap v286: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T03:53:55.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.916+0000 7fc152fa2640 1 -- 172.21.15.46:0/1903863830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc14c103b80 msgr2=0x7fc14c103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:55.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.916+0000 7fc152fa2640 1 --2- 172.21.15.46:0/1903863830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc14c103b80 0x7fc14c103f90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc140009900 tx=0x7fc14002a3f0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.916+0000 7fc152fa2640 1 -- 172.21.15.46:0/1903863830 shutdown_connections 2024-09-21T03:53:55.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.916+0000 7fc152fa2640 1 --2- 172.21.15.46:0/1903863830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc14c109e10 0x7fc14c110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.916+0000 7fc152fa2640 1 --2- 172.21.15.46:0/1903863830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc14c1094c0 0x7fc14c1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.916+0000 7fc152fa2640 1 --2- 172.21.15.46:0/1903863830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc14c103b80 0x7fc14c103f90 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.916+0000 7fc152fa2640 1 -- 172.21.15.46:0/1903863830 >> 172.21.15.46:0/1903863830 conn(0x7fc14c0ff5d0 msgr2=0x7fc14c101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:55.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.916+0000 7fc152fa2640 1 -- 172.21.15.46:0/1903863830 shutdown_connections 2024-09-21T03:53:55.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.917+0000 7fc152fa2640 1 -- 172.21.15.46:0/1903863830 wait complete. 2024-09-21T03:53:55.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.917+0000 7fc152fa2640 1 Processor -- start 2024-09-21T03:53:55.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.917+0000 7fc152fa2640 1 -- start start 2024-09-21T03:53:55.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.918+0000 7fc152fa2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc14c103b80 0x7fc14c19a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:55.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.918+0000 7fc152fa2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc14c1094c0 0x7fc14c19aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:55.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.918+0000 7fc152fa2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc14c109e10 0x7fc14c19fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:55.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.918+0000 7fc152fa2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc14c113b20 con 0x7fc14c1094c0 2024-09-21T03:53:55.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.918+0000 7fc152fa2640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc14c1139a0 con 0x7fc14c103b80 2024-09-21T03:53:55.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.918+0000 7fc152fa2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc14c113ca0 con 0x7fc14c109e10 2024-09-21T03:53:55.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.918+0000 7fc14bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc14c1094c0 0x7fc14c19aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:55.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.918+0000 7fc14bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc14c1094c0 0x7fc14c19aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47808/0 (socket says 172.21.15.46:47808) 2024-09-21T03:53:55.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.918+0000 7fc14bfff640 1 -- 172.21.15.46:0/892932301 learned_addr learned my addr 172.21.15.46:0/892932301 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:53:55.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.918+0000 7fc150d3e640 1 --2- 172.21.15.46:0/892932301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc14c103b80 0x7fc14c19a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:55.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.918+0000 7fc15153f640 1 --2- 172.21.15.46:0/892932301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc14c109e10 0x7fc14c19fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:55.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.918+0000 7fc14bfff640 1 -- 172.21.15.46:0/892932301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc14c109e10 msgr2=0x7fc14c19fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:55.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.918+0000 7fc14bfff640 1 --2- 172.21.15.46:0/892932301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc14c109e10 0x7fc14c19fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.918+0000 7fc14bfff640 1 -- 172.21.15.46:0/892932301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc14c103b80 msgr2=0x7fc14c19a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:55.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.918+0000 7fc14bfff640 1 --2- 172.21.15.46:0/892932301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc14c103b80 0x7fc14c19a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.918+0000 7fc14bfff640 1 -- 172.21.15.46:0/892932301 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc14c1a0380 con 0x7fc14c1094c0 2024-09-21T03:53:55.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.918+0000 7fc14bfff640 1 --2- 172.21.15.46:0/892932301 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc14c1094c0 0x7fc14c19aa70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc13800c8c0 tx=0x7fc13800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:55.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.918+0000 7fc149ffb640 1 -- 172.21.15.46:0/892932301 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc138007bb0 con 0x7fc14c1094c0 2024-09-21T03:53:55.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.918+0000 7fc149ffb640 1 -- 172.21.15.46:0/892932301 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc138007d50 con 0x7fc14c1094c0 2024-09-21T03:53:55.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.918+0000 7fc152fa2640 1 -- 172.21.15.46:0/892932301 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc14c1a0670 con 0x7fc14c1094c0 2024-09-21T03:53:55.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.918+0000 7fc149ffb640 1 -- 172.21.15.46:0/892932301 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1380187c0 con 0x7fc14c1094c0 2024-09-21T03:53:55.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.919+0000 7fc152fa2640 1 -- 172.21.15.46:0/892932301 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc14c1a6e90 con 0x7fc14c1094c0 2024-09-21T03:53:55.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.919+0000 7fc152fa2640 1 -- 172.21.15.46:0/892932301 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc14c063b50 con 0x7fc14c1094c0 2024-09-21T03:53:55.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.921+0000 7fc149ffb640 1 -- 172.21.15.46:0/892932301 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fc13800fa20 con 0x7fc14c1094c0 2024-09-21T03:53:55.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.922+0000 7fc149ffb640 1 --2- 172.21.15.46:0/892932301 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc13c0b66a0 0x7fc13c0b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:55.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.922+0000 7fc150d3e640 1 --2- 172.21.15.46:0/892932301 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc13c0b66a0 0x7fc13c0b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:55.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.922+0000 7fc149ffb640 1 -- 172.21.15.46:0/892932301 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fc1380e7ac0 con 0x7fc14c1094c0 2024-09-21T03:53:55.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.922+0000 7fc149ffb640 1 --2- 172.21.15.46:0/892932301 >> [v2:172.21.15.105:6808/3566174660,v1:172.21.15.105:6809/3566174660] conn(0x7fc13c0c0310 0x7fc13c0c2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:55.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.922+0000 7fc149ffb640 1 -- 172.21.15.46:0/892932301 --> [v2:172.21.15.105:6808/3566174660,v1:172.21.15.105:6809/3566174660] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc13801ee50 con 0x7fc13c0c0310 2024-09-21T03:53:55.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.922+0000 7fc149ffb640 1 -- 172.21.15.46:0/892932301 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fc1380e7ef0 con 0x7fc14c1094c0 2024-09-21T03:53:55.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.923+0000 7fc150d3e640 1 --2- 172.21.15.46:0/892932301 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc13c0b66a0 0x7fc13c0b8bb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc140000c00 tx=0x7fc140031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:55.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.923+0000 7fc15153f640 1 --2- 172.21.15.46:0/892932301 >> [v2:172.21.15.105:6808/3566174660,v1:172.21.15.105:6809/3566174660] conn(0x7fc13c0c0310 0x7fc13c0c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:55.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.923+0000 7fc15153f640 1 --2- 172.21.15.46:0/892932301 >> [v2:172.21.15.105:6808/3566174660,v1:172.21.15.105:6809/3566174660] conn(0x7fc13c0c0310 0x7fc13c0c2800 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:55.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.924+0000 7fc149ffb640 1 -- 172.21.15.46:0/892932301 <== osd.4 v2:172.21.15.105:6808/3566174660 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc13801ee50 con 0x7fc13c0c0310 2024-09-21T03:53:55.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.938+0000 7fc152fa2640 1 -- 172.21.15.46:0/892932301 --> [v2:172.21.15.105:6808/3566174660,v1:172.21.15.105:6809/3566174660] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc14c063f50 con 0x7fc13c0c0310 2024-09-21T03:53:55.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.938+0000 7fc149ffb640 1 -- 172.21.15.46:0/892932301 <== osd.4 v2:172.21.15.105:6808/3566174660 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc14c063f50 con 0x7fc13c0c0310 2024-09-21T03:53:55.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.939+0000 7fc152fa2640 1 -- 172.21.15.46:0/892932301 >> [v2:172.21.15.105:6808/3566174660,v1:172.21.15.105:6809/3566174660] conn(0x7fc13c0c0310 msgr2=0x7fc13c0c2800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:55.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.939+0000 7fc152fa2640 1 --2- 172.21.15.46:0/892932301 >> [v2:172.21.15.105:6808/3566174660,v1:172.21.15.105:6809/3566174660] conn(0x7fc13c0c0310 0x7fc13c0c2800 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.939+0000 7fc152fa2640 1 -- 172.21.15.46:0/892932301 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc13c0b66a0 msgr2=0x7fc13c0b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:55.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.939+0000 7fc152fa2640 1 --2- 172.21.15.46:0/892932301 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc13c0b66a0 0x7fc13c0b8bb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc140000c00 tx=0x7fc140031400 comp rx=0 tx=0).stop 2024-09-21T03:53:55.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.939+0000 7fc152fa2640 1 -- 172.21.15.46:0/892932301 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc14c1094c0 msgr2=0x7fc14c19aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:55.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.939+0000 7fc152fa2640 1 --2- 172.21.15.46:0/892932301 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc14c1094c0 0x7fc14c19aa70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc13800c8c0 tx=0x7fc13800cd80 comp rx=0 tx=0).stop 2024-09-21T03:53:55.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.939+0000 7fc15153f640 1 -- 172.21.15.46:0/892932301 reap_dead start 2024-09-21T03:53:55.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.939+0000 7fc152fa2640 1 -- 172.21.15.46:0/892932301 shutdown_connections 2024-09-21T03:53:55.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.939+0000 7fc152fa2640 1 -- 172.21.15.46:0/892932301 >> 172.21.15.46:0/892932301 conn(0x7fc14c0ff5d0 msgr2=0x7fc14c1019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:55.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.939+0000 7fc152fa2640 1 -- 172.21.15.46:0/892932301 shutdown_connections 2024-09-21T03:53:55.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:55.939+0000 7fc152fa2640 1 -- 172.21.15.46:0/892932301 wait complete. 2024-09-21T03:53:56.076 INFO:teuthology.orchestra.run.smithi046.stdout:180388626479 2024-09-21T03:53:56.076 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.6 2024-09-21T03:53:56.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.664+0000 7fedb4019640 1 -- 172.21.15.46:0/737818761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedac104840 msgr2=0x7fedac104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:56.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.664+0000 7fedb4019640 1 --2- 172.21.15.46:0/737818761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedac104840 0x7fedac104c50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7feda8009900 tx=0x7feda802a410 comp rx=0 tx=0).stop 2024-09-21T03:53:56.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.664+0000 7fedb4019640 1 -- 172.21.15.46:0/737818761 shutdown_connections 2024-09-21T03:53:56.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.664+0000 7fedb4019640 1 --2- 172.21.15.46:0/737818761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fedac10ddf0 0x7fedac110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:56.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.664+0000 7fedb4019640 1 --2- 172.21.15.46:0/737818761 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fedac105270 0x7fedac10d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:56.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.664+0000 7fedb4019640 1 --2- 172.21.15.46:0/737818761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedac104840 0x7fedac104c50 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:56.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.664+0000 7fedb4019640 1 -- 172.21.15.46:0/737818761 >> 172.21.15.46:0/737818761 conn(0x7fedac079730 msgr2=0x7fedac079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:56.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.664+0000 7fedb4019640 1 -- 172.21.15.46:0/737818761 shutdown_connections 2024-09-21T03:53:56.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.664+0000 7fedb4019640 1 -- 172.21.15.46:0/737818761 wait complete. 2024-09-21T03:53:56.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.665+0000 7fedb4019640 1 Processor -- start 2024-09-21T03:53:56.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.665+0000 7fedb4019640 1 -- start start 2024-09-21T03:53:56.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.665+0000 7fedb4019640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fedac104840 0x7fedac19a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:56.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.665+0000 7fedb4019640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fedac105270 0x7fedac19ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:56.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.665+0000 7fedb4019640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedac10ddf0 0x7fedac19fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:56.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.665+0000 7fedb4019640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fedac113a70 con 0x7fedac10ddf0 2024-09-21T03:53:56.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.665+0000 7fedb4019640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fedac1138f0 con 0x7fedac105270 2024-09-21T03:53:56.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.665+0000 7fedb4019640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fedac113bf0 con 0x7fedac104840 2024-09-21T03:53:56.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.665+0000 7fedb25b6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedac10ddf0 0x7fedac19fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:56.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.666+0000 7fedb25b6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedac10ddf0 0x7fedac19fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47850/0 (socket says 172.21.15.46:47850) 2024-09-21T03:53:56.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.666+0000 7fedb25b6640 1 -- 172.21.15.46:0/1181326928 learned_addr learned my addr 172.21.15.46:0/1181326928 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:53:56.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.666+0000 7fedb1db5640 1 --2- 172.21.15.46:0/1181326928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fedac104840 0x7fedac19a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:56.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.666+0000 7fedb15b4640 1 --2- 172.21.15.46:0/1181326928 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fedac105270 0x7fedac19ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:56.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.666+0000 7fedb25b6640 1 -- 172.21.15.46:0/1181326928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fedac104840 msgr2=0x7fedac19a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:56.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.666+0000 7fedb25b6640 1 --2- 172.21.15.46:0/1181326928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fedac104840 0x7fedac19a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:56.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.666+0000 7fedb25b6640 1 -- 172.21.15.46:0/1181326928 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fedac105270 msgr2=0x7fedac19ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:56.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.666+0000 7fedb25b6640 1 --2- 172.21.15.46:0/1181326928 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fedac105270 0x7fedac19ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:56.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.666+0000 7fedb25b6640 1 -- 172.21.15.46:0/1181326928 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedac1a04d0 con 0x7fedac10ddf0 2024-09-21T03:53:56.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.666+0000 7fedb15b4640 1 --2- 172.21.15.46:0/1181326928 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fedac105270 0x7fedac19ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:53:56.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.666+0000 7fedb1db5640 1 --2- 172.21.15.46:0/1181326928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fedac104840 0x7fedac19a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:53:56.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.666+0000 7fedb25b6640 1 --2- 172.21.15.46:0/1181326928 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedac10ddf0 0x7fedac19fda0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7feda400cad0 tx=0x7feda400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:56.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.666+0000 7feda2ffd640 1 -- 172.21.15.46:0/1181326928 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda400ae20 con 0x7fedac10ddf0 2024-09-21T03:53:56.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.666+0000 7fedb4019640 1 -- 172.21.15.46:0/1181326928 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedac1a07c0 con 0x7fedac10ddf0 2024-09-21T03:53:56.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.666+0000 7feda2ffd640 1 -- 172.21.15.46:0/1181326928 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feda4005020 con 0x7fedac10ddf0 2024-09-21T03:53:56.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.666+0000 7feda2ffd640 1 -- 172.21.15.46:0/1181326928 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda400f6b0 con 0x7fedac10ddf0 2024-09-21T03:53:56.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.666+0000 7fedb4019640 1 -- 172.21.15.46:0/1181326928 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedac1a6f20 con 0x7fedac10ddf0 2024-09-21T03:53:56.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.667+0000 7fedb4019640 1 -- 172.21.15.46:0/1181326928 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fedac107350 con 0x7fedac10ddf0 2024-09-21T03:53:56.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.670+0000 7feda2ffd640 1 -- 172.21.15.46:0/1181326928 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7feda40051d0 con 0x7fedac10ddf0 2024-09-21T03:53:56.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.670+0000 7feda2ffd640 1 --2- 172.21.15.46:0/1181326928 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fed980b65f0 0x7fed980b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:56.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.671+0000 7fedb1db5640 1 --2- 172.21.15.46:0/1181326928 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fed980b65f0 0x7fed980b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:56.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.671+0000 7feda2ffd640 1 -- 172.21.15.46:0/1181326928 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7feda40e7a80 con 0x7fedac10ddf0 2024-09-21T03:53:56.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.671+0000 7feda2ffd640 1 --2- 172.21.15.46:0/1181326928 >> [v2:172.21.15.46:6802/791989880,v1:172.21.15.46:6803/791989880] conn(0x7fed980c0260 0x7fed980c2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:56.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.671+0000 7feda2ffd640 1 -- 172.21.15.46:0/1181326928 --> [v2:172.21.15.46:6802/791989880,v1:172.21.15.46:6803/791989880] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feda401ae50 con 0x7fed980c0260 2024-09-21T03:53:56.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.671+0000 7feda2ffd640 1 -- 172.21.15.46:0/1181326928 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7feda40e7eb0 con 0x7fedac10ddf0 2024-09-21T03:53:56.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.671+0000 7fedb15b4640 1 --2- 172.21.15.46:0/1181326928 >> [v2:172.21.15.46:6802/791989880,v1:172.21.15.46:6803/791989880] conn(0x7fed980c0260 0x7fed980c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:56.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.671+0000 7fedb1db5640 1 --2- 172.21.15.46:0/1181326928 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fed980b65f0 0x7fed980b8b00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7feda8000c00 tx=0x7feda8032da0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:56.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.671+0000 7fedb15b4640 1 --2- 172.21.15.46:0/1181326928 >> [v2:172.21.15.46:6802/791989880,v1:172.21.15.46:6803/791989880] conn(0x7fed980c0260 0x7fed980c2750 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:56.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.673+0000 7feda2ffd640 1 -- 172.21.15.46:0/1181326928 <== osd.0 v2:172.21.15.46:6802/791989880 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feda401ae50 con 0x7fed980c0260 2024-09-21T03:53:56.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.689+0000 7fedb4019640 1 -- 172.21.15.46:0/1181326928 --> [v2:172.21.15.46:6802/791989880,v1:172.21.15.46:6803/791989880] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fedac06b500 con 0x7fed980c0260 2024-09-21T03:53:56.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.690+0000 7feda2ffd640 1 -- 172.21.15.46:0/1181326928 <== osd.0 v2:172.21.15.46:6802/791989880 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fedac06b500 con 0x7fed980c0260 2024-09-21T03:53:56.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.690+0000 7fedb4019640 1 -- 172.21.15.46:0/1181326928 >> [v2:172.21.15.46:6802/791989880,v1:172.21.15.46:6803/791989880] conn(0x7fed980c0260 msgr2=0x7fed980c2750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:56.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.690+0000 7fedb4019640 1 --2- 172.21.15.46:0/1181326928 >> [v2:172.21.15.46:6802/791989880,v1:172.21.15.46:6803/791989880] conn(0x7fed980c0260 0x7fed980c2750 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:56.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.690+0000 7fedb4019640 1 -- 172.21.15.46:0/1181326928 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fed980b65f0 msgr2=0x7fed980b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:56.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.690+0000 7fedb4019640 1 --2- 172.21.15.46:0/1181326928 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fed980b65f0 0x7fed980b8b00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7feda8000c00 tx=0x7feda8032da0 comp rx=0 tx=0).stop 2024-09-21T03:53:56.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.690+0000 7fedb4019640 1 -- 172.21.15.46:0/1181326928 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedac10ddf0 msgr2=0x7fedac19fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:56.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.690+0000 7fedb4019640 1 --2- 172.21.15.46:0/1181326928 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedac10ddf0 0x7fedac19fda0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7feda400cad0 tx=0x7feda400cf90 comp rx=0 tx=0).stop 2024-09-21T03:53:56.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.690+0000 7fedb25b6640 1 -- 172.21.15.46:0/1181326928 reap_dead start 2024-09-21T03:53:56.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.690+0000 7fedb4019640 1 -- 172.21.15.46:0/1181326928 shutdown_connections 2024-09-21T03:53:56.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.690+0000 7fedb4019640 1 -- 172.21.15.46:0/1181326928 >> 172.21.15.46:0/1181326928 conn(0x7fedac079730 msgr2=0x7fedac1068f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:56.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.691+0000 7fedb4019640 1 -- 172.21.15.46:0/1181326928 shutdown_connections 2024-09-21T03:53:56.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.691+0000 7fedb4019640 1 -- 172.21.15.46:0/1181326928 wait complete. 2024-09-21T03:53:56.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.587+0000 7f02f0843640 1 -- 172.21.15.46:0/2821554412 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02ec108d00 msgr2=0x7f02ec10f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:56.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.587+0000 7f02f0843640 1 --2- 172.21.15.46:0/2821554412 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02ec108d00 0x7f02ec10f530 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f02e4009ca0 tx=0x7f02e402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:53:56.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.587+0000 7f02f0843640 1 -- 172.21.15.46:0/2821554412 shutdown_connections 2024-09-21T03:53:56.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.587+0000 7f02f0843640 1 --2- 172.21.15.46:0/2821554412 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02ec108d00 0x7f02ec10f530 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:56.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.587+0000 7f02f0843640 1 --2- 172.21.15.46:0/2821554412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02ec1083b0 0x7f02ec1087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:56.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.587+0000 7f02f0843640 1 --2- 172.21.15.46:0/2821554412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02ec102ac0 0x7f02ec102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:56.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.587+0000 7f02f0843640 1 -- 172.21.15.46:0/2821554412 >> 172.21.15.46:0/2821554412 conn(0x7f02ec079790 msgr2=0x7f02ec079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:56.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.587+0000 7f02f0843640 1 -- 172.21.15.46:0/2821554412 shutdown_connections 2024-09-21T03:53:56.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.587+0000 7f02f0843640 1 -- 172.21.15.46:0/2821554412 wait complete. 2024-09-21T03:53:56.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.588+0000 7f02f0843640 1 Processor -- start 2024-09-21T03:53:56.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.589+0000 7f02f0843640 1 -- start start 2024-09-21T03:53:56.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.589+0000 7f02f0843640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02ec102ac0 0x7f02ec199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:56.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.589+0000 7f02f0843640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02ec1083b0 0x7f02ec199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:56.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.589+0000 7f02f0843640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02ec108d00 0x7f02ec19ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:56.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.589+0000 7f02f0843640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f02ec1129c0 con 0x7f02ec1083b0 2024-09-21T03:53:56.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.589+0000 7f02f0843640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f02ec112840 con 0x7f02ec108d00 2024-09-21T03:53:56.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.589+0000 7f02f0843640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f02ec112b40 con 0x7f02ec102ac0 2024-09-21T03:53:56.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.589+0000 7f02e9d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02ec1083b0 0x7f02ec199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:56.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.589+0000 7f02e9d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02ec1083b0 0x7f02ec199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47826/0 (socket says 172.21.15.46:47826) 2024-09-21T03:53:56.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.589+0000 7f02e9d9b640 1 -- 172.21.15.46:0/506801201 learned_addr learned my addr 172.21.15.46:0/506801201 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:53:56.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.589+0000 7f02ea59c640 1 --2- 172.21.15.46:0/506801201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02ec102ac0 0x7f02ec199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:56.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.589+0000 7f02ead9d640 1 --2- 172.21.15.46:0/506801201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02ec108d00 0x7f02ec19ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:56.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.590+0000 7f02e9d9b640 1 -- 172.21.15.46:0/506801201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02ec102ac0 msgr2=0x7f02ec199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:56.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.590+0000 7f02e9d9b640 1 --2- 172.21.15.46:0/506801201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02ec102ac0 0x7f02ec199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:56.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.590+0000 7f02e9d9b640 1 -- 172.21.15.46:0/506801201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02ec108d00 msgr2=0x7f02ec19ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:56.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.590+0000 7f02e9d9b640 1 --2- 172.21.15.46:0/506801201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02ec108d00 0x7f02ec19ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:56.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.590+0000 7f02e9d9b640 1 -- 172.21.15.46:0/506801201 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02ec19f220 con 0x7f02ec1083b0 2024-09-21T03:53:56.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.590+0000 7f02ead9d640 1 --2- 172.21.15.46:0/506801201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02ec108d00 0x7f02ec19ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:53:56.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.590+0000 7f02e9d9b640 1 --2- 172.21.15.46:0/506801201 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02ec1083b0 0x7f02ec199910 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f02e0009830 tx=0x7f02e0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:56.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.590+0000 7f02db7fe640 1 -- 172.21.15.46:0/506801201 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e001d070 con 0x7f02ec1083b0 2024-09-21T03:53:56.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.590+0000 7f02f0843640 1 -- 172.21.15.46:0/506801201 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02ec19f510 con 0x7f02ec1083b0 2024-09-21T03:53:56.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.590+0000 7f02db7fe640 1 -- 172.21.15.46:0/506801201 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02e0007c50 con 0x7f02ec1083b0 2024-09-21T03:53:56.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.590+0000 7f02db7fe640 1 -- 172.21.15.46:0/506801201 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e0018ce0 con 0x7f02ec1083b0 2024-09-21T03:53:56.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.590+0000 7f02f0843640 1 -- 172.21.15.46:0/506801201 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02ec06b820 con 0x7f02ec1083b0 2024-09-21T03:53:56.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.591+0000 7f02f0843640 1 -- 172.21.15.46:0/506801201 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f02ec06be30 con 0x7f02ec1083b0 2024-09-21T03:53:56.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.593+0000 7f02db7fe640 1 -- 172.21.15.46:0/506801201 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f02e0020070 con 0x7f02ec1083b0 2024-09-21T03:53:56.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.594+0000 7f02db7fe640 1 --2- 172.21.15.46:0/506801201 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f02d40b6620 0x7f02d40b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:56.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.594+0000 7f02ea59c640 1 --2- 172.21.15.46:0/506801201 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f02d40b6620 0x7f02d40b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:56.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.594+0000 7f02db7fe640 1 -- 172.21.15.46:0/506801201 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f02e00e9230 con 0x7f02ec1083b0 2024-09-21T03:53:56.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.594+0000 7f02db7fe640 1 --2- 172.21.15.46:0/506801201 >> [v2:172.21.15.162:6816/3441747512,v1:172.21.15.162:6817/3441747512] conn(0x7f02d40c0290 0x7f02d40c2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:56.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.594+0000 7f02db7fe640 1 -- 172.21.15.46:0/506801201 --> [v2:172.21.15.162:6816/3441747512,v1:172.21.15.162:6817/3441747512] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f02d40c2e50 con 0x7f02d40c0290 2024-09-21T03:53:56.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.594+0000 7f02db7fe640 1 -- 172.21.15.46:0/506801201 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f02e00e95e0 con 0x7f02ec1083b0 2024-09-21T03:53:56.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.594+0000 7f02ea59c640 1 --2- 172.21.15.46:0/506801201 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f02d40b6620 0x7f02d40b8b30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f02dc00abe0 tx=0x7f02dc00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:56.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.595+0000 7f02ead9d640 1 --2- 172.21.15.46:0/506801201 >> [v2:172.21.15.162:6816/3441747512,v1:172.21.15.162:6817/3441747512] conn(0x7f02d40c0290 0x7f02d40c2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:56.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.595+0000 7f02ead9d640 1 --2- 172.21.15.46:0/506801201 >> [v2:172.21.15.162:6816/3441747512,v1:172.21.15.162:6817/3441747512] conn(0x7f02d40c0290 0x7f02d40c2780 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:56.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.596+0000 7f02db7fe640 1 -- 172.21.15.46:0/506801201 <== osd.8 v2:172.21.15.162:6816/3441747512 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f02d40c2e50 con 0x7f02d40c0290 2024-09-21T03:53:56.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.610+0000 7f02f0843640 1 -- 172.21.15.46:0/506801201 --> [v2:172.21.15.162:6816/3441747512,v1:172.21.15.162:6817/3441747512] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f02ec06c230 con 0x7f02d40c0290 2024-09-21T03:53:56.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.610+0000 7f02db7fe640 1 -- 172.21.15.46:0/506801201 <== osd.8 v2:172.21.15.162:6816/3441747512 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f02ec06c230 con 0x7f02d40c0290 2024-09-21T03:53:56.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.611+0000 7f02f0843640 1 -- 172.21.15.46:0/506801201 >> [v2:172.21.15.162:6816/3441747512,v1:172.21.15.162:6817/3441747512] conn(0x7f02d40c0290 msgr2=0x7f02d40c2780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:56.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.611+0000 7f02f0843640 1 --2- 172.21.15.46:0/506801201 >> [v2:172.21.15.162:6816/3441747512,v1:172.21.15.162:6817/3441747512] conn(0x7f02d40c0290 0x7f02d40c2780 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:56.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.611+0000 7f02f0843640 1 -- 172.21.15.46:0/506801201 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f02d40b6620 msgr2=0x7f02d40b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:56.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.611+0000 7f02f0843640 1 --2- 172.21.15.46:0/506801201 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f02d40b6620 0x7f02d40b8b30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f02dc00abe0 tx=0x7f02dc00a2d0 comp rx=0 tx=0).stop 2024-09-21T03:53:56.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.611+0000 7f02f0843640 1 -- 172.21.15.46:0/506801201 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02ec1083b0 msgr2=0x7f02ec199910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:56.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.611+0000 7f02f0843640 1 --2- 172.21.15.46:0/506801201 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02ec1083b0 0x7f02ec199910 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f02e0009830 tx=0x7f02e0009c30 comp rx=0 tx=0).stop 2024-09-21T03:53:56.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.611+0000 7f02ead9d640 1 -- 172.21.15.46:0/506801201 reap_dead start 2024-09-21T03:53:56.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.611+0000 7f02f0843640 1 -- 172.21.15.46:0/506801201 shutdown_connections 2024-09-21T03:53:56.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.611+0000 7f02f0843640 1 -- 172.21.15.46:0/506801201 >> 172.21.15.46:0/506801201 conn(0x7f02ec079790 msgr2=0x7f02ec104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:56.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.611+0000 7f02f0843640 1 -- 172.21.15.46:0/506801201 shutdown_connections 2024-09-21T03:53:56.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:56.611+0000 7f02f0843640 1 -- 172.21.15.46:0/506801201 wait complete. 2024-09-21T03:53:57.498 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:57 smithi046 ceph-mon[30954]: pgmap v287: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-21T03:53:57.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:57 smithi105 ceph-mon[34773]: pgmap v287: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-21T03:53:57.573 INFO:teuthology.orchestra.run.smithi046.stdout:223338299430 2024-09-21T03:53:57.573 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.8 2024-09-21T03:53:57.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:57 smithi162 ceph-mon[35071]: pgmap v287: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-21T03:53:58.104 INFO:teuthology.orchestra.run.smithi046.stdout:60129542217 2024-09-21T03:53:58.104 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T03:53:58.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.314+0000 7f637bf22640 1 -- 172.21.15.46:0/607633511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63741083d0 msgr2=0x7f63741087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:58.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.314+0000 7f637bf22640 1 --2- 172.21.15.46:0/607633511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63741083d0 0x7f63741087e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6364009900 tx=0x7f636402a410 comp rx=0 tx=0).stop 2024-09-21T03:53:58.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.314+0000 7f637bf22640 1 -- 172.21.15.46:0/607633511 shutdown_connections 2024-09-21T03:53:58.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.314+0000 7f637bf22640 1 --2- 172.21.15.46:0/607633511 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6374108d20 0x7f637410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.314+0000 7f637bf22640 1 --2- 172.21.15.46:0/607633511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63741083d0 0x7f63741087e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.314+0000 7f637bf22640 1 --2- 172.21.15.46:0/607633511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6374102ae0 0x7f6374102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.314+0000 7f637bf22640 1 -- 172.21.15.46:0/607633511 >> 172.21.15.46:0/607633511 conn(0x7f63740797b0 msgr2=0x7f6374079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:58.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.314+0000 7f637bf22640 1 -- 172.21.15.46:0/607633511 shutdown_connections 2024-09-21T03:53:58.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.314+0000 7f637bf22640 1 -- 172.21.15.46:0/607633511 wait complete. 2024-09-21T03:53:58.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.315+0000 7f637bf22640 1 Processor -- start 2024-09-21T03:53:58.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.315+0000 7f637bf22640 1 -- start start 2024-09-21T03:53:58.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.316+0000 7f637bf22640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6374102ae0 0x7f637419a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:58.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.316+0000 7f637bf22640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63741083d0 0x7f637419aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:58.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.316+0000 7f637bf22640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6374108d20 0x7f637419fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:58.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.316+0000 7f637bf22640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f63741129e0 con 0x7f6374108d20 2024-09-21T03:53:58.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.316+0000 7f637bf22640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6374112860 con 0x7f6374102ae0 2024-09-21T03:53:58.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.316+0000 7f637bf22640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6374112b60 con 0x7f63741083d0 2024-09-21T03:53:58.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.316+0000 7f637a4bf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6374108d20 0x7f637419fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:58.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.316+0000 7f637a4bf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6374108d20 0x7f637419fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47868/0 (socket says 172.21.15.46:47868) 2024-09-21T03:53:58.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.316+0000 7f637a4bf640 1 -- 172.21.15.46:0/2790871997 learned_addr learned my addr 172.21.15.46:0/2790871997 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:53:58.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.316+0000 7f63794bd640 1 --2- 172.21.15.46:0/2790871997 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63741083d0 0x7f637419aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:58.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.316+0000 7f6379cbe640 1 --2- 172.21.15.46:0/2790871997 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6374102ae0 0x7f637419a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:58.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.316+0000 7f637a4bf640 1 -- 172.21.15.46:0/2790871997 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63741083d0 msgr2=0x7f637419aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:58.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.316+0000 7f637a4bf640 1 --2- 172.21.15.46:0/2790871997 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63741083d0 0x7f637419aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.316+0000 7f637a4bf640 1 -- 172.21.15.46:0/2790871997 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6374102ae0 msgr2=0x7f637419a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:58.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.316+0000 7f637a4bf640 1 --2- 172.21.15.46:0/2790871997 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6374102ae0 0x7f637419a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.316+0000 7f637a4bf640 1 -- 172.21.15.46:0/2790871997 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63741a04b0 con 0x7f6374108d20 2024-09-21T03:53:58.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.317+0000 7f637a4bf640 1 --2- 172.21.15.46:0/2790871997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6374108d20 0x7f637419fd80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f636c00eaa0 tx=0x7f636c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:58.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.317+0000 7f636affd640 1 -- 172.21.15.46:0/2790871997 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636c00cdb0 con 0x7f6374108d20 2024-09-21T03:53:58.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.317+0000 7f637bf22640 1 -- 172.21.15.46:0/2790871997 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63741a07a0 con 0x7f6374108d20 2024-09-21T03:53:58.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.317+0000 7f636affd640 1 -- 172.21.15.46:0/2790871997 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f636c005020 con 0x7f6374108d20 2024-09-21T03:53:58.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.317+0000 7f637bf22640 1 -- 172.21.15.46:0/2790871997 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63740ff550 con 0x7f6374108d20 2024-09-21T03:53:58.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.317+0000 7f636affd640 1 -- 172.21.15.46:0/2790871997 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636c0116d0 con 0x7f6374108d20 2024-09-21T03:53:58.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.318+0000 7f637bf22640 1 -- 172.21.15.46:0/2790871997 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6358001060 con 0x7f6374108d20 2024-09-21T03:53:58.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.320+0000 7f636affd640 1 -- 172.21.15.46:0/2790871997 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f636c004a40 con 0x7f6374108d20 2024-09-21T03:53:58.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.321+0000 7f636affd640 1 --2- 172.21.15.46:0/2790871997 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f63600bee80 0x7f63600c1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:58.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.321+0000 7f6379cbe640 1 --2- 172.21.15.46:0/2790871997 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f63600bee80 0x7f63600c1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:58.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.321+0000 7f636affd640 1 -- 172.21.15.46:0/2790871997 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f636c0e7850 con 0x7f6374108d20 2024-09-21T03:53:58.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.321+0000 7f636affd640 1 --2- 172.21.15.46:0/2790871997 >> [v2:172.21.15.46:6826/382230768,v1:172.21.15.46:6827/382230768] conn(0x7f63600c8af0 0x7f63600cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:58.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.321+0000 7f636affd640 1 -- 172.21.15.46:0/2790871997 --> [v2:172.21.15.46:6826/382230768,v1:172.21.15.46:6827/382230768] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f636c014ec0 con 0x7f63600c8af0 2024-09-21T03:53:58.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.321+0000 7f636affd640 1 -- 172.21.15.46:0/2790871997 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f636c0e7c80 con 0x7f6374108d20 2024-09-21T03:53:58.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.322+0000 7f63794bd640 1 --2- 172.21.15.46:0/2790871997 >> [v2:172.21.15.46:6826/382230768,v1:172.21.15.46:6827/382230768] conn(0x7f63600c8af0 0x7f63600cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:58.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.322+0000 7f6379cbe640 1 --2- 172.21.15.46:0/2790871997 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f63600bee80 0x7f63600c1390 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6370009bd0 tx=0x7f6370005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:58.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.322+0000 7f63794bd640 1 --2- 172.21.15.46:0/2790871997 >> [v2:172.21.15.46:6826/382230768,v1:172.21.15.46:6827/382230768] conn(0x7f63600c8af0 0x7f63600cafe0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:58.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.323+0000 7f636affd640 1 -- 172.21.15.46:0/2790871997 <== osd.9 v2:172.21.15.46:6826/382230768 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f636c014ec0 con 0x7f63600c8af0 2024-09-21T03:53:58.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.337+0000 7f637bf22640 1 -- 172.21.15.46:0/2790871997 --> [v2:172.21.15.46:6826/382230768,v1:172.21.15.46:6827/382230768] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6358002e00 con 0x7f63600c8af0 2024-09-21T03:53:58.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.338+0000 7f636affd640 1 -- 172.21.15.46:0/2790871997 <== osd.9 v2:172.21.15.46:6826/382230768 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6358002e00 con 0x7f63600c8af0 2024-09-21T03:53:58.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.338+0000 7f637bf22640 1 -- 172.21.15.46:0/2790871997 >> [v2:172.21.15.46:6826/382230768,v1:172.21.15.46:6827/382230768] conn(0x7f63600c8af0 msgr2=0x7f63600cafe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:58.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.338+0000 7f637bf22640 1 --2- 172.21.15.46:0/2790871997 >> [v2:172.21.15.46:6826/382230768,v1:172.21.15.46:6827/382230768] conn(0x7f63600c8af0 0x7f63600cafe0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.338+0000 7f637bf22640 1 -- 172.21.15.46:0/2790871997 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f63600bee80 msgr2=0x7f63600c1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:58.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.338+0000 7f637bf22640 1 --2- 172.21.15.46:0/2790871997 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f63600bee80 0x7f63600c1390 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6370009bd0 tx=0x7f6370005f90 comp rx=0 tx=0).stop 2024-09-21T03:53:58.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.338+0000 7f637bf22640 1 -- 172.21.15.46:0/2790871997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6374108d20 msgr2=0x7f637419fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:58.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.338+0000 7f637bf22640 1 --2- 172.21.15.46:0/2790871997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6374108d20 0x7f637419fd80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f636c00eaa0 tx=0x7f636c00ef60 comp rx=0 tx=0).stop 2024-09-21T03:53:58.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.338+0000 7f637a4bf640 1 -- 172.21.15.46:0/2790871997 reap_dead start 2024-09-21T03:53:58.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.338+0000 7f637bf22640 1 -- 172.21.15.46:0/2790871997 shutdown_connections 2024-09-21T03:53:58.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.338+0000 7f637bf22640 1 -- 172.21.15.46:0/2790871997 >> 172.21.15.46:0/2790871997 conn(0x7f63740797b0 msgr2=0x7f63741019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:58.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.338+0000 7f637bf22640 1 -- 172.21.15.46:0/2790871997 shutdown_connections 2024-09-21T03:53:58.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:58.339+0000 7f637bf22640 1 -- 172.21.15.46:0/2790871997 wait complete. 2024-09-21T03:53:58.761 INFO:teuthology.orchestra.run.smithi046.stdout:133143986234 2024-09-21T03:53:58.761 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T03:53:59.328 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:53:59 smithi046 ceph-mon[30954]: pgmap v288: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-21T03:53:59.359 INFO:teuthology.orchestra.run.smithi046.stdout:38654705743 2024-09-21T03:53:59.359 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T03:53:59.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.504+0000 7f3439a27640 1 -- 172.21.15.46:0/1570141573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3434104a10 msgr2=0x7f3434104e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:59.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.504+0000 7f3439a27640 1 --2- 172.21.15.46:0/1570141573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3434104a10 0x7f3434104e20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f341c009900 tx=0x7f341c02a410 comp rx=0 tx=0).stop 2024-09-21T03:53:59.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.504+0000 7f3439a27640 1 -- 172.21.15.46:0/1570141573 shutdown_connections 2024-09-21T03:53:59.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.504+0000 7f3439a27640 1 --2- 172.21.15.46:0/1570141573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f343410de40 0x7f3434110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:59.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.504+0000 7f3439a27640 1 --2- 172.21.15.46:0/1570141573 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3434105360 0x7f343410d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:59.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.504+0000 7f3439a27640 1 --2- 172.21.15.46:0/1570141573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3434104a10 0x7f3434104e20 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:59.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.504+0000 7f3439a27640 1 -- 172.21.15.46:0/1570141573 >> 172.21.15.46:0/1570141573 conn(0x7f3434079720 msgr2=0x7f3434079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:59.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.504+0000 7f3439a27640 1 -- 172.21.15.46:0/1570141573 shutdown_connections 2024-09-21T03:53:59.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.504+0000 7f3439a27640 1 -- 172.21.15.46:0/1570141573 wait complete. 2024-09-21T03:53:59.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.505+0000 7f3439a27640 1 Processor -- start 2024-09-21T03:53:59.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.505+0000 7f3439a27640 1 -- start start 2024-09-21T03:53:59.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.505+0000 7f3439a27640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3434104a10 0x7f343419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:59.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.505+0000 7f3439a27640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3434105360 0x7f343419aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:59.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.505+0000 7f3439a27640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f343410de40 0x7f343419fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:59.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.505+0000 7f3439a27640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3434113a80 con 0x7f343410de40 2024-09-21T03:53:59.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.505+0000 7f3439a27640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3434113900 con 0x7f3434105360 2024-09-21T03:53:59.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.505+0000 7f3439a27640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3434113c00 con 0x7f3434104a10 2024-09-21T03:53:59.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.505+0000 7f34337fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f343410de40 0x7f343419fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:59.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.505+0000 7f34337fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f343410de40 0x7f343419fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47896/0 (socket says 172.21.15.46:47896) 2024-09-21T03:53:59.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.505+0000 7f34337fe640 1 -- 172.21.15.46:0/1914836691 learned_addr learned my addr 172.21.15.46:0/1914836691 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:53:59.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.505+0000 7f3432ffd640 1 --2- 172.21.15.46:0/1914836691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3434104a10 0x7f343419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:59.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.506+0000 7f34327fc640 1 --2- 172.21.15.46:0/1914836691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3434105360 0x7f343419aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:59.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.506+0000 7f34337fe640 1 -- 172.21.15.46:0/1914836691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3434104a10 msgr2=0x7f343419a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:59.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.506+0000 7f34337fe640 1 --2- 172.21.15.46:0/1914836691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3434104a10 0x7f343419a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:59.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.506+0000 7f34337fe640 1 -- 172.21.15.46:0/1914836691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3434105360 msgr2=0x7f343419aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:59.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.506+0000 7f34337fe640 1 --2- 172.21.15.46:0/1914836691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3434105360 0x7f343419aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:59.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.506+0000 7f34337fe640 1 -- 172.21.15.46:0/1914836691 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34341a0400 con 0x7f343410de40 2024-09-21T03:53:59.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.506+0000 7f34337fe640 1 --2- 172.21.15.46:0/1914836691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f343410de40 0x7f343419fcd0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f342c00eaa0 tx=0x7f342c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:59.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.506+0000 7f3438a25640 1 -- 172.21.15.46:0/1914836691 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c00cdb0 con 0x7f343410de40 2024-09-21T03:53:59.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.506+0000 7f3439a27640 1 -- 172.21.15.46:0/1914836691 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34341a06f0 con 0x7f343410de40 2024-09-21T03:53:59.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.506+0000 7f3438a25640 1 -- 172.21.15.46:0/1914836691 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f342c005020 con 0x7f343410de40 2024-09-21T03:53:59.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.506+0000 7f3438a25640 1 -- 172.21.15.46:0/1914836691 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c0116d0 con 0x7f343410de40 2024-09-21T03:53:59.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.506+0000 7f3439a27640 1 -- 172.21.15.46:0/1914836691 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34341a6e50 con 0x7f343410de40 2024-09-21T03:53:59.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.507+0000 7f3439a27640 1 -- 172.21.15.46:0/1914836691 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3434063b50 con 0x7f343410de40 2024-09-21T03:53:59.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.509+0000 7f3438a25640 1 -- 172.21.15.46:0/1914836691 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f342c0051d0 con 0x7f343410de40 2024-09-21T03:53:59.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.510+0000 7f3438a25640 1 --2- 172.21.15.46:0/1914836691 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f34200b65f0 0x7f34200b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:59.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.510+0000 7f3432ffd640 1 --2- 172.21.15.46:0/1914836691 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f34200b65f0 0x7f34200b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:59.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.510+0000 7f3438a25640 1 -- 172.21.15.46:0/1914836691 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f342c0e7710 con 0x7f343410de40 2024-09-21T03:53:59.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.510+0000 7f3438a25640 1 --2- 172.21.15.46:0/1914836691 >> [v2:172.21.15.105:6824/1664619099,v1:172.21.15.105:6825/1664619099] conn(0x7f34200c0260 0x7f34200c2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:59.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.510+0000 7f3438a25640 1 -- 172.21.15.46:0/1914836691 --> [v2:172.21.15.105:6824/1664619099,v1:172.21.15.105:6825/1664619099] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f34200c2e20 con 0x7f34200c0260 2024-09-21T03:53:59.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.510+0000 7f3438a25640 1 -- 172.21.15.46:0/1914836691 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f342c0ee050 con 0x7f343410de40 2024-09-21T03:53:59.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.510+0000 7f3432ffd640 1 --2- 172.21.15.46:0/1914836691 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f34200b65f0 0x7f34200b8b00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f341c031440 tx=0x7f341c009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:59.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.510+0000 7f34327fc640 1 --2- 172.21.15.46:0/1914836691 >> [v2:172.21.15.105:6824/1664619099,v1:172.21.15.105:6825/1664619099] conn(0x7f34200c0260 0x7f34200c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:59.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.511+0000 7f34327fc640 1 --2- 172.21.15.46:0/1914836691 >> [v2:172.21.15.105:6824/1664619099,v1:172.21.15.105:6825/1664619099] conn(0x7f34200c0260 0x7f34200c2750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:59.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.512+0000 7f3438a25640 1 -- 172.21.15.46:0/1914836691 <== osd.10 v2:172.21.15.105:6824/1664619099 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f34200c2e20 con 0x7f34200c0260 2024-09-21T03:53:59.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.526+0000 7f3439a27640 1 -- 172.21.15.46:0/1914836691 --> [v2:172.21.15.105:6824/1664619099,v1:172.21.15.105:6825/1664619099] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3434063fd0 con 0x7f34200c0260 2024-09-21T03:53:59.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.526+0000 7f3438a25640 1 -- 172.21.15.46:0/1914836691 <== osd.10 v2:172.21.15.105:6824/1664619099 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3434063fd0 con 0x7f34200c0260 2024-09-21T03:53:59.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.527+0000 7f3439a27640 1 -- 172.21.15.46:0/1914836691 >> [v2:172.21.15.105:6824/1664619099,v1:172.21.15.105:6825/1664619099] conn(0x7f34200c0260 msgr2=0x7f34200c2750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:59.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.527+0000 7f3439a27640 1 --2- 172.21.15.46:0/1914836691 >> [v2:172.21.15.105:6824/1664619099,v1:172.21.15.105:6825/1664619099] conn(0x7f34200c0260 0x7f34200c2750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:59.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.527+0000 7f3439a27640 1 -- 172.21.15.46:0/1914836691 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f34200b65f0 msgr2=0x7f34200b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:59.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.527+0000 7f3439a27640 1 --2- 172.21.15.46:0/1914836691 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f34200b65f0 0x7f34200b8b00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f341c031440 tx=0x7f341c009560 comp rx=0 tx=0).stop 2024-09-21T03:53:59.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.527+0000 7f3439a27640 1 -- 172.21.15.46:0/1914836691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f343410de40 msgr2=0x7f343419fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:59.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.527+0000 7f3439a27640 1 --2- 172.21.15.46:0/1914836691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f343410de40 0x7f343419fcd0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f342c00eaa0 tx=0x7f342c00ef60 comp rx=0 tx=0).stop 2024-09-21T03:53:59.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.527+0000 7f34337fe640 1 -- 172.21.15.46:0/1914836691 reap_dead start 2024-09-21T03:53:59.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.527+0000 7f3439a27640 1 -- 172.21.15.46:0/1914836691 shutdown_connections 2024-09-21T03:53:59.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.527+0000 7f3439a27640 1 -- 172.21.15.46:0/1914836691 >> 172.21.15.46:0/1914836691 conn(0x7f3434079720 msgr2=0x7f3434100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:59.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.527+0000 7f3439a27640 1 -- 172.21.15.46:0/1914836691 shutdown_connections 2024-09-21T03:53:59.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:53:59.527+0000 7f3439a27640 1 -- 172.21.15.46:0/1914836691 wait complete. 2024-09-21T03:53:59.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:53:59 smithi105 ceph-mon[34773]: pgmap v288: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-21T03:53:59.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:53:59 smithi162 ceph-mon[35071]: pgmap v288: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-21T03:54:00.642 INFO:teuthology.orchestra.run.smithi046.stdout:249108103201 2024-09-21T03:54:00.643 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.9 2024-09-21T03:54:01.018 INFO:teuthology.orchestra.run.smithi046.stdout:154618822709 2024-09-21T03:54:01.018 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T03:54:01.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.232+0000 7ff701f43640 1 -- 172.21.15.46:0/1971804227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6fc10de50 msgr2=0x7ff6fc1102f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:01.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.232+0000 7ff701f43640 1 --2- 172.21.15.46:0/1971804227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6fc10de50 0x7ff6fc1102f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4009900 tx=0x7ff6f402a410 comp rx=0 tx=0).stop 2024-09-21T03:54:01.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.232+0000 7ff701f43640 1 -- 172.21.15.46:0/1971804227 shutdown_connections 2024-09-21T03:54:01.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.232+0000 7ff701f43640 1 --2- 172.21.15.46:0/1971804227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6fc10de50 0x7ff6fc1102f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.232+0000 7ff701f43640 1 --2- 172.21.15.46:0/1971804227 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6fc1052d0 0x7ff6fc10d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.232+0000 7ff701f43640 1 --2- 172.21.15.46:0/1971804227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6fc1048a0 0x7ff6fc104cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.232+0000 7ff701f43640 1 -- 172.21.15.46:0/1971804227 >> 172.21.15.46:0/1971804227 conn(0x7ff6fc079730 msgr2=0x7ff6fc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:01.235 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:01 smithi046 ceph-mon[30954]: pgmap v289: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T03:54:01.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.232+0000 7ff701f43640 1 -- 172.21.15.46:0/1971804227 shutdown_connections 2024-09-21T03:54:01.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.232+0000 7ff701f43640 1 -- 172.21.15.46:0/1971804227 wait complete. 2024-09-21T03:54:01.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.233+0000 7ff701f43640 1 Processor -- start 2024-09-21T03:54:01.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.233+0000 7ff701f43640 1 -- start start 2024-09-21T03:54:01.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.234+0000 7ff701f43640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6fc1048a0 0x7ff6fc19c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:01.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.234+0000 7ff701f43640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6fc1052d0 0x7ff6fc19cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:01.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.234+0000 7ff701f43640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6fc10de50 0x7ff6fc1a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:01.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.234+0000 7ff701f43640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff6fc113a60 con 0x7ff6fc10de50 2024-09-21T03:54:01.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.234+0000 7ff701f43640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff6fc1138e0 con 0x7ff6fc1052d0 2024-09-21T03:54:01.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.234+0000 7ff701f43640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff6fc113be0 con 0x7ff6fc1048a0 2024-09-21T03:54:01.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.234+0000 7ff6fbfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6fc10de50 0x7ff6fc1a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:01.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.234+0000 7ff6fbfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6fc10de50 0x7ff6fc1a1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47912/0 (socket says 172.21.15.46:47912) 2024-09-21T03:54:01.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.234+0000 7ff6fb7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6fc1048a0 0x7ff6fc19c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:01.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.234+0000 7ff6fbfff640 1 -- 172.21.15.46:0/1485651136 learned_addr learned my addr 172.21.15.46:0/1485651136 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:01.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.234+0000 7ff6faffd640 1 --2- 172.21.15.46:0/1485651136 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6fc1052d0 0x7ff6fc19cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:01.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.234+0000 7ff6fb7fe640 1 -- 172.21.15.46:0/1485651136 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6fc1052d0 msgr2=0x7ff6fc19cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:01.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.234+0000 7ff6fb7fe640 1 --2- 172.21.15.46:0/1485651136 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6fc1052d0 0x7ff6fc19cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.234+0000 7ff6fb7fe640 1 -- 172.21.15.46:0/1485651136 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6fc10de50 msgr2=0x7ff6fc1a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:01.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.234+0000 7ff6fb7fe640 1 --2- 172.21.15.46:0/1485651136 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6fc10de50 0x7ff6fc1a1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.234+0000 7ff6fb7fe640 1 -- 172.21.15.46:0/1485651136 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6fc1a2540 con 0x7ff6fc1048a0 2024-09-21T03:54:01.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.235+0000 7ff6fb7fe640 1 --2- 172.21.15.46:0/1485651136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6fc1048a0 0x7ff6fc19c5d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec005fd0 tx=0x7ff6ec00ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:01.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.235+0000 7ff6f8ff9640 1 -- 172.21.15.46:0/1485651136 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec003970 con 0x7ff6fc1048a0 2024-09-21T03:54:01.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.235+0000 7ff6f8ff9640 1 -- 172.21.15.46:0/1485651136 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6ec004020 con 0x7ff6fc1048a0 2024-09-21T03:54:01.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.235+0000 7ff701f43640 1 -- 172.21.15.46:0/1485651136 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6fc1a2830 con 0x7ff6fc1048a0 2024-09-21T03:54:01.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.235+0000 7ff701f43640 1 -- 172.21.15.46:0/1485651136 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6fc1a8f90 con 0x7ff6fc1048a0 2024-09-21T03:54:01.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.235+0000 7ff6f8ff9640 1 -- 172.21.15.46:0/1485651136 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec010720 con 0x7ff6fc1048a0 2024-09-21T03:54:01.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.236+0000 7ff701f43640 1 -- 172.21.15.46:0/1485651136 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff6e8001060 con 0x7ff6fc1048a0 2024-09-21T03:54:01.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.238+0000 7ff6f8ff9640 1 -- 172.21.15.46:0/1485651136 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7ff6ec003b10 con 0x7ff6fc1048a0 2024-09-21T03:54:01.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.238+0000 7ff6f8ff9640 1 --2- 172.21.15.46:0/1485651136 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff6e40b6670 0x7ff6e40b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:01.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.239+0000 7ff6f8ff9640 1 -- 172.21.15.46:0/1485651136 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7ff6ec0e7dd0 con 0x7ff6fc1048a0 2024-09-21T03:54:01.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.239+0000 7ff6faffd640 1 --2- 172.21.15.46:0/1485651136 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff6e40b6670 0x7ff6e40b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:01.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.239+0000 7ff6f8ff9640 1 --2- 172.21.15.46:0/1485651136 >> [v2:172.21.15.162:6824/1014820476,v1:172.21.15.162:6825/1014820476] conn(0x7ff6e40c02e0 0x7ff6e40c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:01.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.239+0000 7ff6f8ff9640 1 -- 172.21.15.46:0/1485651136 --> [v2:172.21.15.162:6824/1014820476,v1:172.21.15.162:6825/1014820476] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff6e40c2ea0 con 0x7ff6e40c02e0 2024-09-21T03:54:01.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.239+0000 7ff6f8ff9640 1 -- 172.21.15.46:0/1485651136 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7ff6ec0e8200 con 0x7ff6fc1048a0 2024-09-21T03:54:01.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.239+0000 7ff6fbfff640 1 --2- 172.21.15.46:0/1485651136 >> [v2:172.21.15.162:6824/1014820476,v1:172.21.15.162:6825/1014820476] conn(0x7ff6e40c02e0 0x7ff6e40c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:01.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.239+0000 7ff6faffd640 1 --2- 172.21.15.46:0/1485651136 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff6e40b6670 0x7ff6e40b8b80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc10faf0 tx=0x7ff6f000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:01.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.240+0000 7ff6fbfff640 1 --2- 172.21.15.46:0/1485651136 >> [v2:172.21.15.162:6824/1014820476,v1:172.21.15.162:6825/1014820476] conn(0x7ff6e40c02e0 0x7ff6e40c27d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:01.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.241+0000 7ff6f8ff9640 1 -- 172.21.15.46:0/1485651136 <== osd.11 v2:172.21.15.162:6824/1014820476 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff6e40c2ea0 con 0x7ff6e40c02e0 2024-09-21T03:54:01.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.258+0000 7ff701f43640 1 -- 172.21.15.46:0/1485651136 --> [v2:172.21.15.162:6824/1014820476,v1:172.21.15.162:6825/1014820476] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff6e8002e00 con 0x7ff6e40c02e0 2024-09-21T03:54:01.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.259+0000 7ff6f8ff9640 1 -- 172.21.15.46:0/1485651136 <== osd.11 v2:172.21.15.162:6824/1014820476 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff6e8002e00 con 0x7ff6e40c02e0 2024-09-21T03:54:01.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.260+0000 7ff701f43640 1 -- 172.21.15.46:0/1485651136 >> [v2:172.21.15.162:6824/1014820476,v1:172.21.15.162:6825/1014820476] conn(0x7ff6e40c02e0 msgr2=0x7ff6e40c27d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:01.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.260+0000 7ff701f43640 1 --2- 172.21.15.46:0/1485651136 >> [v2:172.21.15.162:6824/1014820476,v1:172.21.15.162:6825/1014820476] conn(0x7ff6e40c02e0 0x7ff6e40c27d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.260+0000 7ff701f43640 1 -- 172.21.15.46:0/1485651136 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff6e40b6670 msgr2=0x7ff6e40b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:01.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.260+0000 7ff701f43640 1 --2- 172.21.15.46:0/1485651136 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff6e40b6670 0x7ff6e40b8b80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc10faf0 tx=0x7ff6f000b390 comp rx=0 tx=0).stop 2024-09-21T03:54:01.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.260+0000 7ff701f43640 1 -- 172.21.15.46:0/1485651136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6fc1048a0 msgr2=0x7ff6fc19c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:01.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.260+0000 7ff701f43640 1 --2- 172.21.15.46:0/1485651136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6fc1048a0 0x7ff6fc19c5d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec005fd0 tx=0x7ff6ec00ef90 comp rx=0 tx=0).stop 2024-09-21T03:54:01.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.260+0000 7ff6fbfff640 1 -- 172.21.15.46:0/1485651136 reap_dead start 2024-09-21T03:54:01.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.260+0000 7ff701f43640 1 -- 172.21.15.46:0/1485651136 shutdown_connections 2024-09-21T03:54:01.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.260+0000 7ff701f43640 1 -- 172.21.15.46:0/1485651136 >> 172.21.15.46:0/1485651136 conn(0x7ff6fc079730 msgr2=0x7ff6fc10bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:01.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.260+0000 7ff701f43640 1 -- 172.21.15.46:0/1485651136 shutdown_connections 2024-09-21T03:54:01.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.260+0000 7ff701f43640 1 -- 172.21.15.46:0/1485651136 wait complete. 2024-09-21T03:54:01.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.534+0000 7f260ce87640 1 -- 172.21.15.46:0/1198436662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26081049d0 msgr2=0x7f2608104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:01.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.534+0000 7f260ce87640 1 --2- 172.21.15.46:0/1198436662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26081049d0 0x7f2608104de0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f25f8009ca0 tx=0x7f25f802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.534+0000 7f260ce87640 1 -- 172.21.15.46:0/1198436662 shutdown_connections 2024-09-21T03:54:01.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.534+0000 7f260ce87640 1 --2- 172.21.15.46:0/1198436662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f260810de30 0x7f2608110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.534+0000 7f260ce87640 1 --2- 172.21.15.46:0/1198436662 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2608105320 0x7f260810d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.534+0000 7f260ce87640 1 --2- 172.21.15.46:0/1198436662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26081049d0 0x7f2608104de0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.534+0000 7f260ce87640 1 -- 172.21.15.46:0/1198436662 >> 172.21.15.46:0/1198436662 conn(0x7f2608079740 msgr2=0x7f2608079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:01.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.534+0000 7f260ce87640 1 -- 172.21.15.46:0/1198436662 shutdown_connections 2024-09-21T03:54:01.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.534+0000 7f260ce87640 1 -- 172.21.15.46:0/1198436662 wait complete. 2024-09-21T03:54:01.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.535+0000 7f260ce87640 1 Processor -- start 2024-09-21T03:54:01.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.535+0000 7f260ce87640 1 -- start start 2024-09-21T03:54:01.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.535+0000 7f260ce87640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26081049d0 0x7f260819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:01.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.535+0000 7f260ce87640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2608105320 0x7f260819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:01.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.535+0000 7f260ce87640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f260810de30 0x7f260819fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:01.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.535+0000 7f260ce87640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2608113a90 con 0x7f2608105320 2024-09-21T03:54:01.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.535+0000 7f260ce87640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2608113910 con 0x7f26081049d0 2024-09-21T03:54:01.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.535+0000 7f260ce87640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2608113c10 con 0x7f260810de30 2024-09-21T03:54:01.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.535+0000 7f2605d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2608105320 0x7f260819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:01.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.535+0000 7f2605d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2608105320 0x7f260819ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47936/0 (socket says 172.21.15.46:47936) 2024-09-21T03:54:01.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.535+0000 7f2605d9b640 1 -- 172.21.15.46:0/2835542211 learned_addr learned my addr 172.21.15.46:0/2835542211 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:01.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.535+0000 7f260659c640 1 --2- 172.21.15.46:0/2835542211 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26081049d0 0x7f260819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:01.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.535+0000 7f2606d9d640 1 --2- 172.21.15.46:0/2835542211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f260810de30 0x7f260819fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:01.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.535+0000 7f2605d9b640 1 -- 172.21.15.46:0/2835542211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f260810de30 msgr2=0x7f260819fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:01.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.535+0000 7f2605d9b640 1 --2- 172.21.15.46:0/2835542211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f260810de30 0x7f260819fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.535+0000 7f2605d9b640 1 -- 172.21.15.46:0/2835542211 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26081049d0 msgr2=0x7f260819a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:01.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.535+0000 7f2605d9b640 1 --2- 172.21.15.46:0/2835542211 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26081049d0 0x7f260819a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.535+0000 7f2605d9b640 1 -- 172.21.15.46:0/2835542211 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26081a0450 con 0x7f2608105320 2024-09-21T03:54:01.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.535+0000 7f260659c640 1 --2- 172.21.15.46:0/2835542211 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26081049d0 0x7f260819a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:54:01.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.535+0000 7f2606d9d640 1 --2- 172.21.15.46:0/2835542211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f260810de30 0x7f260819fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:54:01.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.536+0000 7f2605d9b640 1 --2- 172.21.15.46:0/2835542211 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2608105320 0x7f260819ab40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f25fc00d950 tx=0x7f25fc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:01.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.536+0000 7f25f77fe640 1 -- 172.21.15.46:0/2835542211 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25fc017070 con 0x7f2608105320 2024-09-21T03:54:01.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.536+0000 7f260ce87640 1 -- 172.21.15.46:0/2835542211 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26081a0740 con 0x7f2608105320 2024-09-21T03:54:01.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.536+0000 7f25f77fe640 1 -- 172.21.15.46:0/2835542211 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25fc009c30 con 0x7f2608105320 2024-09-21T03:54:01.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.536+0000 7f25f77fe640 1 -- 172.21.15.46:0/2835542211 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25fc0047a0 con 0x7f2608105320 2024-09-21T03:54:01.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.536+0000 7f260ce87640 1 -- 172.21.15.46:0/2835542211 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26081a6f60 con 0x7f2608105320 2024-09-21T03:54:01.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.537+0000 7f260ce87640 1 -- 172.21.15.46:0/2835542211 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2608063b50 con 0x7f2608105320 2024-09-21T03:54:01.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.539+0000 7f25f77fe640 1 -- 172.21.15.46:0/2835542211 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f25fc004020 con 0x7f2608105320 2024-09-21T03:54:01.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.539+0000 7f25f77fe640 1 --2- 172.21.15.46:0/2835542211 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f25f00b6620 0x7f25f00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:01.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.540+0000 7f260659c640 1 --2- 172.21.15.46:0/2835542211 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f25f00b6620 0x7f25f00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:01.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.540+0000 7f25f77fe640 1 -- 172.21.15.46:0/2835542211 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f25fc0e7860 con 0x7f2608105320 2024-09-21T03:54:01.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.540+0000 7f25f77fe640 1 --2- 172.21.15.46:0/2835542211 >> [v2:172.21.15.46:6810/1355580104,v1:172.21.15.46:6811/1355580104] conn(0x7f25f00c0290 0x7f25f00c2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:01.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.540+0000 7f25f77fe640 1 -- 172.21.15.46:0/2835542211 --> [v2:172.21.15.46:6810/1355580104,v1:172.21.15.46:6811/1355580104] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f25f00c2e50 con 0x7f25f00c0290 2024-09-21T03:54:01.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.540+0000 7f25f77fe640 1 -- 172.21.15.46:0/2835542211 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f25fc0e7c90 con 0x7f2608105320 2024-09-21T03:54:01.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.540+0000 7f2606d9d640 1 --2- 172.21.15.46:0/2835542211 >> [v2:172.21.15.46:6810/1355580104,v1:172.21.15.46:6811/1355580104] conn(0x7f25f00c0290 0x7f25f00c2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:01.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.540+0000 7f260659c640 1 --2- 172.21.15.46:0/2835542211 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f25f00b6620 0x7f25f00b8b30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f25f80094e0 tx=0x7f25f80093f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:01.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.540+0000 7f2606d9d640 1 --2- 172.21.15.46:0/2835542211 >> [v2:172.21.15.46:6810/1355580104,v1:172.21.15.46:6811/1355580104] conn(0x7f25f00c0290 0x7f25f00c2780 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:01.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.541+0000 7f25f77fe640 1 -- 172.21.15.46:0/2835542211 <== osd.3 v2:172.21.15.46:6810/1355580104 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f25f00c2e50 con 0x7f25f00c0290 2024-09-21T03:54:01.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.555+0000 7f260ce87640 1 -- 172.21.15.46:0/2835542211 --> [v2:172.21.15.46:6810/1355580104,v1:172.21.15.46:6811/1355580104] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2608063f50 con 0x7f25f00c0290 2024-09-21T03:54:01.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.555+0000 7f25f77fe640 1 -- 172.21.15.46:0/2835542211 <== osd.3 v2:172.21.15.46:6810/1355580104 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2608063f50 con 0x7f25f00c0290 2024-09-21T03:54:01.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.556+0000 7f260ce87640 1 -- 172.21.15.46:0/2835542211 >> [v2:172.21.15.46:6810/1355580104,v1:172.21.15.46:6811/1355580104] conn(0x7f25f00c0290 msgr2=0x7f25f00c2780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:01.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.556+0000 7f260ce87640 1 --2- 172.21.15.46:0/2835542211 >> [v2:172.21.15.46:6810/1355580104,v1:172.21.15.46:6811/1355580104] conn(0x7f25f00c0290 0x7f25f00c2780 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.556+0000 7f260ce87640 1 -- 172.21.15.46:0/2835542211 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f25f00b6620 msgr2=0x7f25f00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:01.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.556+0000 7f260ce87640 1 --2- 172.21.15.46:0/2835542211 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f25f00b6620 0x7f25f00b8b30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f25f80094e0 tx=0x7f25f80093f0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.556+0000 7f260ce87640 1 -- 172.21.15.46:0/2835542211 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2608105320 msgr2=0x7f260819ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:01.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.556+0000 7f260ce87640 1 --2- 172.21.15.46:0/2835542211 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2608105320 0x7f260819ab40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f25fc00d950 tx=0x7f25fc00de10 comp rx=0 tx=0).stop 2024-09-21T03:54:01.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.556+0000 7f2606d9d640 1 -- 172.21.15.46:0/2835542211 reap_dead start 2024-09-21T03:54:01.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.556+0000 7f260ce87640 1 -- 172.21.15.46:0/2835542211 shutdown_connections 2024-09-21T03:54:01.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.556+0000 7f260ce87640 1 -- 172.21.15.46:0/2835542211 >> 172.21.15.46:0/2835542211 conn(0x7f2608079740 msgr2=0x7f26080ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:01.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.556+0000 7f260ce87640 1 -- 172.21.15.46:0/2835542211 shutdown_connections 2024-09-21T03:54:01.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:01.556+0000 7f260ce87640 1 -- 172.21.15.46:0/2835542211 wait complete. 2024-09-21T03:54:01.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:01 smithi105 ceph-mon[34773]: pgmap v289: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T03:54:01.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:01 smithi162 ceph-mon[35071]: pgmap v289: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T03:54:02.703 INFO:teuthology.orchestra.run.smithi046.stdout:270582939676 2024-09-21T03:54:02.703 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.10 2024-09-21T03:54:03.200 INFO:teuthology.orchestra.run.smithi046.stdout:107374182462 2024-09-21T03:54:03.200 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T03:54:03.433 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:03 smithi046 ceph-mon[30954]: pgmap v290: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T03:54:03.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:03 smithi105 ceph-mon[34773]: pgmap v290: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T03:54:03.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:03 smithi162 ceph-mon[35071]: pgmap v290: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T03:54:03.755 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:03.759 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:03.759 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:03.759 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:03.760 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:03.760 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:03.760 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:03.763 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:03.818 INFO:teuthology.orchestra.run.smithi046.stdout:296352743447 2024-09-21T03:54:03.818 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.11 2024-09-21T03:54:04.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.600+0000 7fc400a30640 1 -- 172.21.15.46:0/501662628 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3fc104920 msgr2=0x7fc3fc101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:04.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.600+0000 7fc400a30640 1 --2- 172.21.15.46:0/501662628 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3fc104920 0x7fc3fc101e90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec009900 tx=0x7fc3ec02a410 comp rx=0 tx=0).stop 2024-09-21T03:54:04.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.600+0000 7fc400a30640 1 -- 172.21.15.46:0/501662628 shutdown_connections 2024-09-21T03:54:04.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.600+0000 7fc400a30640 1 --2- 172.21.15.46:0/501662628 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3fc110610 0x7fc3fc112a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:04.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.600+0000 7fc400a30640 1 --2- 172.21.15.46:0/501662628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3fc1023d0 0x7fc3fc1027e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:04.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.600+0000 7fc400a30640 1 --2- 172.21.15.46:0/501662628 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3fc104920 0x7fc3fc101e90 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:04.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.600+0000 7fc400a30640 1 -- 172.21.15.46:0/501662628 >> 172.21.15.46:0/501662628 conn(0x7fc3fc079ea0 msgr2=0x7fc3fc07a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:04.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.601+0000 7fc400a30640 1 -- 172.21.15.46:0/501662628 shutdown_connections 2024-09-21T03:54:04.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.601+0000 7fc400a30640 1 -- 172.21.15.46:0/501662628 wait complete. 2024-09-21T03:54:04.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.601+0000 7fc400a30640 1 Processor -- start 2024-09-21T03:54:04.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.601+0000 7fc400a30640 1 -- start start 2024-09-21T03:54:04.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.602+0000 7fc400a30640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3fc1023d0 0x7fc3fc19c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:04.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.602+0000 7fc400a30640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3fc104920 0x7fc3fc19cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:04.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.602+0000 7fc400a30640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3fc110610 0x7fc3fc1a2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:04.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.602+0000 7fc400a30640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc115f60 con 0x7fc3fc104920 2024-09-21T03:54:04.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.602+0000 7fc400a30640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc115de0 con 0x7fc3fc110610 2024-09-21T03:54:04.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.602+0000 7fc400a30640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc1160e0 con 0x7fc3fc1023d0 2024-09-21T03:54:04.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.602+0000 7fc3f9d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3fc104920 0x7fc3fc19cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:04.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.602+0000 7fc3f9d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3fc104920 0x7fc3fc19cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43888/0 (socket says 172.21.15.46:43888) 2024-09-21T03:54:04.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.602+0000 7fc3f9d9b640 1 -- 172.21.15.46:0/326281061 learned_addr learned my addr 172.21.15.46:0/326281061 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:04.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.602+0000 7fc3fa59c640 1 --2- 172.21.15.46:0/326281061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3fc1023d0 0x7fc3fc19c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:04.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.602+0000 7fc3fad9d640 1 --2- 172.21.15.46:0/326281061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3fc110610 0x7fc3fc1a2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:04.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.602+0000 7fc3f9d9b640 1 -- 172.21.15.46:0/326281061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3fc1023d0 msgr2=0x7fc3fc19c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:04.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.602+0000 7fc3f9d9b640 1 --2- 172.21.15.46:0/326281061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3fc1023d0 0x7fc3fc19c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:04.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.602+0000 7fc3f9d9b640 1 -- 172.21.15.46:0/326281061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3fc110610 msgr2=0x7fc3fc1a2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:04.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.602+0000 7fc3f9d9b640 1 --2- 172.21.15.46:0/326281061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3fc110610 0x7fc3fc1a2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:04.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.602+0000 7fc3f9d9b640 1 -- 172.21.15.46:0/326281061 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3fc1a2940 con 0x7fc3fc104920 2024-09-21T03:54:04.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.602+0000 7fc3fad9d640 1 --2- 172.21.15.46:0/326281061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3fc110610 0x7fc3fc1a2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:54:04.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.603+0000 7fc3f9d9b640 1 --2- 172.21.15.46:0/326281061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3fc104920 0x7fc3fc19cf70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc3e400e9c0 tx=0x7fc3e400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:04.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.603+0000 7fc3f37fe640 1 -- 172.21.15.46:0/326281061 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e400ccc0 con 0x7fc3fc104920 2024-09-21T03:54:04.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.603+0000 7fc400a30640 1 -- 172.21.15.46:0/326281061 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3fc1a2c30 con 0x7fc3fc104920 2024-09-21T03:54:04.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.603+0000 7fc3f37fe640 1 -- 172.21.15.46:0/326281061 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3e40054d0 con 0x7fc3fc104920 2024-09-21T03:54:04.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.603+0000 7fc3f37fe640 1 -- 172.21.15.46:0/326281061 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e4010430 con 0x7fc3fc104920 2024-09-21T03:54:04.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.603+0000 7fc400a30640 1 -- 172.21.15.46:0/326281061 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3fc1a9390 con 0x7fc3fc104920 2024-09-21T03:54:04.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.604+0000 7fc400a30640 1 -- 172.21.15.46:0/326281061 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3fc1027e0 con 0x7fc3fc104920 2024-09-21T03:54:04.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.606+0000 7fc3f37fe640 1 -- 172.21.15.46:0/326281061 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fc3e4005000 con 0x7fc3fc104920 2024-09-21T03:54:04.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.606+0000 7fc3f37fe640 1 --2- 172.21.15.46:0/326281061 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc3e80b65f0 0x7fc3e80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:04.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.607+0000 7fc3fa59c640 1 --2- 172.21.15.46:0/326281061 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc3e80b65f0 0x7fc3e80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:04.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.607+0000 7fc3f37fe640 1 -- 172.21.15.46:0/326281061 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fc3e40e7b60 con 0x7fc3fc104920 2024-09-21T03:54:04.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.607+0000 7fc3fa59c640 1 --2- 172.21.15.46:0/326281061 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc3e80b65f0 0x7fc3e80b8b00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec031440 tx=0x7fc3ec009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:04.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.610+0000 7fc3f37fe640 1 -- 172.21.15.46:0/326281061 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc3e4056710 con 0x7fc3fc104920 2024-09-21T03:54:04.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.799+0000 7fc400a30640 1 -- 172.21.15.46:0/326281061 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fc3fc19db00 con 0x7fc3fc104920 2024-09-21T03:54:04.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.800+0000 7fc3f37fe640 1 -- 172.21.15.46:0/326281061 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc3fc19db00 con 0x7fc3fc104920 2024-09-21T03:54:04.802 INFO:teuthology.orchestra.run.smithi046.stdout:60129542219 2024-09-21T03:54:04.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.800+0000 7fa4105bc640 1 -- 172.21.15.46:0/3314637747 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa40810de10 msgr2=0x7fa408110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:04.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.800+0000 7fa4105bc640 1 --2- 172.21.15.46:0/3314637747 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa40810de10 0x7fa408110300 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa400009ca0 tx=0x7fa40002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:54:04.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.801+0000 7fa4105bc640 1 -- 172.21.15.46:0/3314637747 shutdown_connections 2024-09-21T03:54:04.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.801+0000 7fa4105bc640 1 --2- 172.21.15.46:0/3314637747 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa40810de10 0x7fa408110300 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:04.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.801+0000 7fa4105bc640 1 --2- 172.21.15.46:0/3314637747 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa408105300 0x7fa40810d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:04.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.801+0000 7fa4105bc640 1 --2- 172.21.15.46:0/3314637747 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4081049b0 0x7fa408104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:04.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.801+0000 7fa4105bc640 1 -- 172.21.15.46:0/3314637747 >> 172.21.15.46:0/3314637747 conn(0x7fa408079730 msgr2=0x7fa408079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:04.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.801+0000 7fa4105bc640 1 -- 172.21.15.46:0/3314637747 shutdown_connections 2024-09-21T03:54:04.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.801+0000 7fa4105bc640 1 -- 172.21.15.46:0/3314637747 wait complete. 2024-09-21T03:54:04.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.801+0000 7fa4105bc640 1 Processor -- start 2024-09-21T03:54:04.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.801+0000 7fa4105bc640 1 -- start start 2024-09-21T03:54:04.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.802+0000 7fa4105bc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4081049b0 0x7fa40819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:04.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.802+0000 7fa4105bc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa408105300 0x7fa40819aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:04.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.802+0000 7fa4105bc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa40810de10 0x7fa40819fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:04.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.802+0000 7fa4105bc640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa408113a90 con 0x7fa40810de10 2024-09-21T03:54:04.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.802+0000 7fa4105bc640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa408113910 con 0x7fa408105300 2024-09-21T03:54:04.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.802+0000 7fa4105bc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa408113c10 con 0x7fa4081049b0 2024-09-21T03:54:04.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.802+0000 7fa40eb59640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa40810de10 0x7fa40819fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:04.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.802+0000 7fa40eb59640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa40810de10 0x7fa40819fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43912/0 (socket says 172.21.15.46:43912) 2024-09-21T03:54:04.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.802+0000 7fa40eb59640 1 -- 172.21.15.46:0/3205155382 learned_addr learned my addr 172.21.15.46:0/3205155382 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:04.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.802+0000 7fa40e358640 1 --2- 172.21.15.46:0/3205155382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4081049b0 0x7fa40819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:04.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.802+0000 7fa40db57640 1 --2- 172.21.15.46:0/3205155382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa408105300 0x7fa40819aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:04.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.802+0000 7fa40eb59640 1 -- 172.21.15.46:0/3205155382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4081049b0 msgr2=0x7fa40819a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:04.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.802+0000 7fa40eb59640 1 --2- 172.21.15.46:0/3205155382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4081049b0 0x7fa40819a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:04.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.802+0000 7fa40eb59640 1 -- 172.21.15.46:0/3205155382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa408105300 msgr2=0x7fa40819aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:04.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.802+0000 7fa40eb59640 1 --2- 172.21.15.46:0/3205155382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa408105300 0x7fa40819aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:04.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.802+0000 7fa40eb59640 1 -- 172.21.15.46:0/3205155382 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4081a0430 con 0x7fa40810de10 2024-09-21T03:54:04.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.803+0000 7fa40eb59640 1 --2- 172.21.15.46:0/3205155382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa40810de10 0x7fa40819fd00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa400005cc0 tx=0x7fa40002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:04.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.803+0000 7fc400a30640 1 -- 172.21.15.46:0/326281061 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc3e80b65f0 msgr2=0x7fc3e80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:04.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.803+0000 7fc400a30640 1 --2- 172.21.15.46:0/326281061 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc3e80b65f0 0x7fc3e80b8b00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec031440 tx=0x7fc3ec009560 comp rx=0 tx=0).stop 2024-09-21T03:54:04.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.803+0000 7fc400a30640 1 -- 172.21.15.46:0/326281061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3fc104920 msgr2=0x7fc3fc19cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:04.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.803+0000 7fc400a30640 1 --2- 172.21.15.46:0/326281061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3fc104920 0x7fc3fc19cf70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc3e400e9c0 tx=0x7fc3e400ee80 comp rx=0 tx=0).stop 2024-09-21T03:54:04.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.803+0000 7fc400a30640 1 -- 172.21.15.46:0/326281061 shutdown_connections 2024-09-21T03:54:04.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.803+0000 7fc400a30640 1 --2- 172.21.15.46:0/326281061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3fc110610 0x7fc3fc1a2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:04.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.803+0000 7fc400a30640 1 --2- 172.21.15.46:0/326281061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3fc104920 0x7fc3fc19cf70 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:04.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.803+0000 7fc400a30640 1 --2- 172.21.15.46:0/326281061 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc3e80b65f0 0x7fc3e80b8b00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:04.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.803+0000 7fc400a30640 1 --2- 172.21.15.46:0/326281061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3fc1023d0 0x7fc3fc19c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:04.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.803+0000 7fc400a30640 1 -- 172.21.15.46:0/326281061 >> 172.21.15.46:0/326281061 conn(0x7fc3fc079ea0 msgr2=0x7fc3fc100ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:04.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.803+0000 7fa3ff7fe640 1 -- 172.21.15.46:0/3205155382 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa400003bf0 con 0x7fa40810de10 2024-09-21T03:54:04.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.803+0000 7fa3ff7fe640 1 -- 172.21.15.46:0/3205155382 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa400003d90 con 0x7fa40810de10 2024-09-21T03:54:04.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.803+0000 7fa3ff7fe640 1 -- 172.21.15.46:0/3205155382 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40002fbc0 con 0x7fa40810de10 2024-09-21T03:54:04.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.803+0000 7fc400a30640 1 -- 172.21.15.46:0/326281061 shutdown_connections 2024-09-21T03:54:04.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.803+0000 7fc400a30640 1 -- 172.21.15.46:0/326281061 wait complete. 2024-09-21T03:54:04.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.803+0000 7fa4105bc640 1 -- 172.21.15.46:0/3205155382 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4081a06c0 con 0x7fa40810de10 2024-09-21T03:54:04.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.803+0000 7fa4105bc640 1 -- 172.21.15.46:0/3205155382 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4081a6e80 con 0x7fa40810de10 2024-09-21T03:54:04.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.804+0000 7fa4105bc640 1 -- 172.21.15.46:0/3205155382 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa40806b560 con 0x7fa40810de10 2024-09-21T03:54:04.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.806+0000 7fa3ff7fe640 1 -- 172.21.15.46:0/3205155382 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fa40002fd60 con 0x7fa40810de10 2024-09-21T03:54:04.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.807+0000 7fa3ff7fe640 1 --2- 172.21.15.46:0/3205155382 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa3f40b65f0 0x7fa3f40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:04.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.807+0000 7fa40e358640 1 --2- 172.21.15.46:0/3205155382 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa3f40b65f0 0x7fa3f40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:04.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.807+0000 7fa3ff7fe640 1 -- 172.21.15.46:0/3205155382 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fa400108a50 con 0x7fa40810de10 2024-09-21T03:54:04.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.807+0000 7fa40e358640 1 --2- 172.21.15.46:0/3205155382 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa3f40b65f0 0x7fa3f40b8b00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa404005fd0 tx=0x7fa40400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:04.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:04.811+0000 7fa3ff7fe640 1 -- 172.21.15.46:0/3205155382 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa4000cf100 con 0x7fa40810de10 2024-09-21T03:54:05.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:05.007+0000 7fa4105bc640 1 -- 172.21.15.46:0/3205155382 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fa4081a7050 con 0x7fa40810de10 2024-09-21T03:54:05.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:05.007+0000 7fa3ff7fe640 1 -- 172.21.15.46:0/3205155382 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa4000098b0 con 0x7fa40810de10 2024-09-21T03:54:05.010 INFO:teuthology.orchestra.run.smithi046.stdout:249108103202 2024-09-21T03:54:05.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:05.010+0000 7fa4105bc640 1 -- 172.21.15.46:0/3205155382 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa3f40b65f0 msgr2=0x7fa3f40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:05.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:05.010+0000 7fa4105bc640 1 --2- 172.21.15.46:0/3205155382 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa3f40b65f0 0x7fa3f40b8b00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa404005fd0 tx=0x7fa40400b390 comp rx=0 tx=0).stop 2024-09-21T03:54:05.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:05.010+0000 7fa4105bc640 1 -- 172.21.15.46:0/3205155382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa40810de10 msgr2=0x7fa40819fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:05.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:05.010+0000 7fa4105bc640 1 --2- 172.21.15.46:0/3205155382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa40810de10 0x7fa40819fd00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa400005cc0 tx=0x7fa40002f380 comp rx=0 tx=0).stop 2024-09-21T03:54:05.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:05.010+0000 7fa4105bc640 1 -- 172.21.15.46:0/3205155382 shutdown_connections 2024-09-21T03:54:05.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:05.010+0000 7fa4105bc640 1 --2- 172.21.15.46:0/3205155382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa40810de10 0x7fa40819fd00 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:05.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:05.010+0000 7fa4105bc640 1 --2- 172.21.15.46:0/3205155382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa408105300 0x7fa40819aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:05.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:05.010+0000 7fa4105bc640 1 --2- 172.21.15.46:0/3205155382 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa3f40b65f0 0x7fa3f40b8b00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:05.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:05.010+0000 7fa4105bc640 1 --2- 172.21.15.46:0/3205155382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4081049b0 0x7fa40819a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:05.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:05.010+0000 7fa4105bc640 1 -- 172.21.15.46:0/3205155382 >> 172.21.15.46:0/3205155382 conn(0x7fa408079730 msgr2=0x7fa4080ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:05.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:05.010+0000 7fa4105bc640 1 -- 172.21.15.46:0/3205155382 shutdown_connections 2024-09-21T03:54:05.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:05.010+0000 7fa4105bc640 1 -- 172.21.15.46:0/3205155382 wait complete. 2024-09-21T03:54:05.381 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:05 smithi046 ceph-mon[30954]: pgmap v291: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:54:05.381 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:05 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/326281061' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T03:54:05.381 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:05 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3205155382' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T03:54:05.499 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:05.499 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:05.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:05 smithi105 ceph-mon[34773]: pgmap v291: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:54:05.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:05 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/326281061' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T03:54:05.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:05 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3205155382' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T03:54:05.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:05 smithi162 ceph-mon[35071]: pgmap v291: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:54:05.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:05 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/326281061' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T03:54:05.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:05 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3205155382' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T03:54:05.924 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103201 got 249108103202 for osd.9 2024-09-21T03:54:05.924 DEBUG:teuthology.parallel:result is None 2024-09-21T03:54:06.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.600+0000 7f2a2732c640 1 -- 172.21.15.46:0/3459389112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a20108d70 msgr2=0x7f2a2010f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:06.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.600+0000 7f2a2732c640 1 --2- 172.21.15.46:0/3459389112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a20108d70 0x7f2a2010f5a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2a18009900 tx=0x7f2a1802a410 comp rx=0 tx=0).stop 2024-09-21T03:54:06.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.600+0000 7f2a2732c640 1 -- 172.21.15.46:0/3459389112 shutdown_connections 2024-09-21T03:54:06.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.600+0000 7f2a2732c640 1 --2- 172.21.15.46:0/3459389112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a20108d70 0x7f2a2010f5a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:06.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.600+0000 7f2a2732c640 1 --2- 172.21.15.46:0/3459389112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a20108420 0x7f2a20108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:06.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.600+0000 7f2a2732c640 1 --2- 172.21.15.46:0/3459389112 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a20102ae0 0x7f2a20102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:06.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.600+0000 7f2a2732c640 1 -- 172.21.15.46:0/3459389112 >> 172.21.15.46:0/3459389112 conn(0x7f2a20079770 msgr2=0x7f2a20079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:06.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.601+0000 7f2a2732c640 1 -- 172.21.15.46:0/3459389112 shutdown_connections 2024-09-21T03:54:06.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.601+0000 7f2a2732c640 1 -- 172.21.15.46:0/3459389112 wait complete. 2024-09-21T03:54:06.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.601+0000 7f2a2732c640 1 Processor -- start 2024-09-21T03:54:06.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.601+0000 7f2a2732c640 1 -- start start 2024-09-21T03:54:06.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.602+0000 7f2a2732c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a20102ae0 0x7f2a200ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:06.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.602+0000 7f2a2732c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a20108420 0x7f2a200ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:06.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.602+0000 7f2a2732c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a20108d70 0x7f2a201000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:06.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.602+0000 7f2a2732c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2a20112a30 con 0x7f2a20108d70 2024-09-21T03:54:06.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.602+0000 7f2a2732c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2a201128b0 con 0x7f2a20108420 2024-09-21T03:54:06.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.602+0000 7f2a2732c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2a20112bb0 con 0x7f2a20102ae0 2024-09-21T03:54:06.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.602+0000 7f2a258c9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a20108d70 0x7f2a201000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:06.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.602+0000 7f2a258c9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a20108d70 0x7f2a201000f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43918/0 (socket says 172.21.15.46:43918) 2024-09-21T03:54:06.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.602+0000 7f2a258c9640 1 -- 172.21.15.46:0/3228711653 learned_addr learned my addr 172.21.15.46:0/3228711653 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:06.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.602+0000 7f2a248c7640 1 --2- 172.21.15.46:0/3228711653 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a20108420 0x7f2a200ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:06.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.602+0000 7f2a250c8640 1 --2- 172.21.15.46:0/3228711653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a20102ae0 0x7f2a200ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:06.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.602+0000 7f2a258c9640 1 -- 172.21.15.46:0/3228711653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a20102ae0 msgr2=0x7f2a200ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:06.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.602+0000 7f2a258c9640 1 --2- 172.21.15.46:0/3228711653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a20102ae0 0x7f2a200ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:06.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.602+0000 7f2a258c9640 1 -- 172.21.15.46:0/3228711653 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a20108420 msgr2=0x7f2a200ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:06.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.602+0000 7f2a258c9640 1 --2- 172.21.15.46:0/3228711653 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a20108420 0x7f2a200ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:06.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.602+0000 7f2a258c9640 1 -- 172.21.15.46:0/3228711653 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a201a87f0 con 0x7f2a20108d70 2024-09-21T03:54:06.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.602+0000 7f2a250c8640 1 --2- 172.21.15.46:0/3228711653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a20102ae0 0x7f2a200ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:54:06.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.602+0000 7f2a258c9640 1 --2- 172.21.15.46:0/3228711653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a20108d70 0x7f2a201000f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2a18004770 tx=0x7f2a18004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:06.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.603+0000 7f2a167fc640 1 -- 172.21.15.46:0/3228711653 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1803f030 con 0x7f2a20108d70 2024-09-21T03:54:06.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.603+0000 7f2a167fc640 1 -- 172.21.15.46:0/3228711653 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a18003aa0 con 0x7f2a20108d70 2024-09-21T03:54:06.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.603+0000 7f2a2732c640 1 -- 172.21.15.46:0/3228711653 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a201a8a80 con 0x7f2a20108d70 2024-09-21T03:54:06.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.603+0000 7f2a167fc640 1 -- 172.21.15.46:0/3228711653 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a18035070 con 0x7f2a20108d70 2024-09-21T03:54:06.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.603+0000 7f2a2732c640 1 -- 172.21.15.46:0/3228711653 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a201a8f60 con 0x7f2a20108d70 2024-09-21T03:54:06.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.604+0000 7f2a2732c640 1 -- 172.21.15.46:0/3228711653 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a20103d60 con 0x7f2a20108d70 2024-09-21T03:54:06.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.605+0000 7f2a167fc640 1 -- 172.21.15.46:0/3228711653 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f2a18042030 con 0x7f2a20108d70 2024-09-21T03:54:06.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.606+0000 7f2a167fc640 1 --2- 172.21.15.46:0/3228711653 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f2a0c0b65f0 0x7f2a0c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:06.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.606+0000 7f2a250c8640 1 --2- 172.21.15.46:0/3228711653 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f2a0c0b65f0 0x7f2a0c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:06.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.606+0000 7f2a167fc640 1 -- 172.21.15.46:0/3228711653 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f2a18107fd0 con 0x7f2a20108d70 2024-09-21T03:54:06.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.607+0000 7f2a250c8640 1 --2- 172.21.15.46:0/3228711653 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f2a0c0b65f0 0x7f2a0c0b8b00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c005c40 tx=0x7f2a1c00a430 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:06.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.609+0000 7f2a167fc640 1 -- 172.21.15.46:0/3228711653 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2a180ce640 con 0x7f2a20108d70 2024-09-21T03:54:06.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.800+0000 7f2a2732c640 1 -- 172.21.15.46:0/3228711653 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f2a20102ef0 con 0x7f2a20108d70 2024-09-21T03:54:06.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.801+0000 7f2a167fc640 1 -- 172.21.15.46:0/3228711653 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2a20102ef0 con 0x7f2a20108d70 2024-09-21T03:54:06.803 INFO:teuthology.orchestra.run.smithi046.stdout:81604378694 2024-09-21T03:54:06.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.803+0000 7f2a2732c640 1 -- 172.21.15.46:0/3228711653 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f2a0c0b65f0 msgr2=0x7f2a0c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:06.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.803+0000 7f2a2732c640 1 --2- 172.21.15.46:0/3228711653 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f2a0c0b65f0 0x7f2a0c0b8b00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c005c40 tx=0x7f2a1c00a430 comp rx=0 tx=0).stop 2024-09-21T03:54:06.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.803+0000 7f2a2732c640 1 -- 172.21.15.46:0/3228711653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a20108d70 msgr2=0x7f2a201000f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:06.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.803+0000 7f2a2732c640 1 --2- 172.21.15.46:0/3228711653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a20108d70 0x7f2a201000f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2a18004770 tx=0x7f2a18004270 comp rx=0 tx=0).stop 2024-09-21T03:54:06.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.803+0000 7f2a2732c640 1 -- 172.21.15.46:0/3228711653 shutdown_connections 2024-09-21T03:54:06.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.803+0000 7f2a2732c640 1 --2- 172.21.15.46:0/3228711653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a20108d70 0x7f2a201000f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:06.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.803+0000 7f2a2732c640 1 --2- 172.21.15.46:0/3228711653 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a20108420 0x7f2a200ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:06.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.803+0000 7f2a2732c640 1 --2- 172.21.15.46:0/3228711653 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f2a0c0b65f0 0x7f2a0c0b8b00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:06.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.803+0000 7f2a2732c640 1 --2- 172.21.15.46:0/3228711653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a20102ae0 0x7f2a200ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:06.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.803+0000 7f2a2732c640 1 -- 172.21.15.46:0/3228711653 >> 172.21.15.46:0/3228711653 conn(0x7f2a20079770 msgr2=0x7f2a20101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:06.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.803+0000 7f2a2732c640 1 -- 172.21.15.46:0/3228711653 shutdown_connections 2024-09-21T03:54:06.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.803+0000 7f2a2732c640 1 -- 172.21.15.46:0/3228711653 wait complete. 2024-09-21T03:54:06.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.837+0000 7f4a5b63e640 1 -- 172.21.15.46:0/1993256640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a54102a60 msgr2=0x7f4a54102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.837+0000 7f4a5b63e640 1 --2- 172.21.15.46:0/1993256640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a54102a60 0x7f4a54102e70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4a50009900 tx=0x7f4a5002a3f0 comp rx=0 tx=0).stop 2024-09-21T03:54:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.837+0000 7f4a5b63e640 1 -- 172.21.15.46:0/1993256640 shutdown_connections 2024-09-21T03:54:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.837+0000 7f4a5b63e640 1 --2- 172.21.15.46:0/1993256640 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a54108cf0 0x7f4a5410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.837+0000 7f4a5b63e640 1 --2- 172.21.15.46:0/1993256640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a541083a0 0x7f4a541087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.837+0000 7f4a5b63e640 1 --2- 172.21.15.46:0/1993256640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a54102a60 0x7f4a54102e70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.837+0000 7f4a5b63e640 1 -- 172.21.15.46:0/1993256640 >> 172.21.15.46:0/1993256640 conn(0x7f4a54079730 msgr2=0x7f4a54079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.837+0000 7f4a5b63e640 1 -- 172.21.15.46:0/1993256640 shutdown_connections 2024-09-21T03:54:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.837+0000 7f4a5b63e640 1 -- 172.21.15.46:0/1993256640 wait complete. 2024-09-21T03:54:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.838+0000 7f4a5b63e640 1 Processor -- start 2024-09-21T03:54:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.838+0000 7f4a5b63e640 1 -- start start 2024-09-21T03:54:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.838+0000 7f4a5b63e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a54102a60 0x7f4a54198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.838+0000 7f4a5b63e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a541083a0 0x7f4a541987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.838+0000 7f4a5b63e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a54108cf0 0x7f4a5419da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.838+0000 7f4a5b63e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4a541118a0 con 0x7f4a54102a60 2024-09-21T03:54:06.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.838+0000 7f4a5b63e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4a54111720 con 0x7f4a54108cf0 2024-09-21T03:54:06.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.838+0000 7f4a5b63e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4a54111a20 con 0x7f4a541083a0 2024-09-21T03:54:06.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.838+0000 7f4a593da640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a54102a60 0x7f4a54198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:06.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.839+0000 7f4a593da640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a54102a60 0x7f4a54198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43932/0 (socket says 172.21.15.46:43932) 2024-09-21T03:54:06.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.839+0000 7f4a593da640 1 -- 172.21.15.46:0/2471662246 learned_addr learned my addr 172.21.15.46:0/2471662246 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:06.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.839+0000 7f4a58bd9640 1 --2- 172.21.15.46:0/2471662246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a541083a0 0x7f4a541987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:06.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.839+0000 7f4a59bdb640 1 --2- 172.21.15.46:0/2471662246 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a54108cf0 0x7f4a5419da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:06.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.839+0000 7f4a593da640 1 -- 172.21.15.46:0/2471662246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a541083a0 msgr2=0x7f4a541987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:06.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.839+0000 7f4a593da640 1 --2- 172.21.15.46:0/2471662246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a541083a0 0x7f4a541987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:06.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.839+0000 7f4a593da640 1 -- 172.21.15.46:0/2471662246 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a54108cf0 msgr2=0x7f4a5419da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:06.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.839+0000 7f4a593da640 1 --2- 172.21.15.46:0/2471662246 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a54108cf0 0x7f4a5419da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:06.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.839+0000 7f4a593da640 1 -- 172.21.15.46:0/2471662246 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a5419e1a0 con 0x7f4a54102a60 2024-09-21T03:54:06.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.839+0000 7f4a593da640 1 --2- 172.21.15.46:0/2471662246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a54102a60 0x7f4a54198230 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4a50005ab0 tx=0x7f4a50003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:06.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.839+0000 7f4a4a7fc640 1 -- 172.21.15.46:0/2471662246 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a5003f070 con 0x7f4a54102a60 2024-09-21T03:54:06.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.839+0000 7f4a5b63e640 1 -- 172.21.15.46:0/2471662246 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a5419e430 con 0x7f4a54102a60 2024-09-21T03:54:06.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.839+0000 7f4a4a7fc640 1 -- 172.21.15.46:0/2471662246 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a50031b60 con 0x7f4a54102a60 2024-09-21T03:54:06.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.839+0000 7f4a4a7fc640 1 -- 172.21.15.46:0/2471662246 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a50035030 con 0x7f4a54102a60 2024-09-21T03:54:06.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.839+0000 7f4a5b63e640 1 -- 172.21.15.46:0/2471662246 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a541a4bf0 con 0x7f4a54102a60 2024-09-21T03:54:06.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.840+0000 7f4a5b63e640 1 -- 172.21.15.46:0/2471662246 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a54102e70 con 0x7f4a54102a60 2024-09-21T03:54:06.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.842+0000 7f4a4a7fc640 1 -- 172.21.15.46:0/2471662246 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f4a50042070 con 0x7f4a54102a60 2024-09-21T03:54:06.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.843+0000 7f4a4a7fc640 1 --2- 172.21.15.46:0/2471662246 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4a400ba9f0 0x7f4a400bcf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:06.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.843+0000 7f4a58bd9640 1 --2- 172.21.15.46:0/2471662246 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4a400ba9f0 0x7f4a400bcf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:06.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.843+0000 7f4a4a7fc640 1 -- 172.21.15.46:0/2471662246 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f4a50108430 con 0x7f4a54102a60 2024-09-21T03:54:06.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.844+0000 7f4a58bd9640 1 --2- 172.21.15.46:0/2471662246 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4a400ba9f0 0x7f4a400bcf00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4a440095f0 tx=0x7f4a44005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:06.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:06.847+0000 7f4a4a7fc640 1 -- 172.21.15.46:0/2471662246 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4a500d2ec0 con 0x7f4a54102a60 2024-09-21T03:54:07.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:07.037+0000 7f4a5b63e640 1 -- 172.21.15.46:0/2471662246 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f4a54199360 con 0x7f4a54102a60 2024-09-21T03:54:07.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:07.037+0000 7f4a4a7fc640 1 -- 172.21.15.46:0/2471662246 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4a54199360 con 0x7f4a54102a60 2024-09-21T03:54:07.039 INFO:teuthology.orchestra.run.smithi046.stdout:180388626482 2024-09-21T03:54:07.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:07.039+0000 7f4a5b63e640 1 -- 172.21.15.46:0/2471662246 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4a400ba9f0 msgr2=0x7f4a400bcf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:07.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:07.039+0000 7f4a5b63e640 1 --2- 172.21.15.46:0/2471662246 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4a400ba9f0 0x7f4a400bcf00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4a440095f0 tx=0x7f4a44005f90 comp rx=0 tx=0).stop 2024-09-21T03:54:07.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:07.039+0000 7f4a5b63e640 1 -- 172.21.15.46:0/2471662246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a54102a60 msgr2=0x7f4a54198230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:07.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:07.039+0000 7f4a5b63e640 1 --2- 172.21.15.46:0/2471662246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a54102a60 0x7f4a54198230 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4a50005ab0 tx=0x7f4a50003c10 comp rx=0 tx=0).stop 2024-09-21T03:54:07.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:07.039+0000 7f4a5b63e640 1 -- 172.21.15.46:0/2471662246 shutdown_connections 2024-09-21T03:54:07.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:07.039+0000 7f4a5b63e640 1 --2- 172.21.15.46:0/2471662246 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a54108cf0 0x7f4a5419da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:07.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:07.039+0000 7f4a5b63e640 1 --2- 172.21.15.46:0/2471662246 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4a400ba9f0 0x7f4a400bcf00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:07.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:07.039+0000 7f4a5b63e640 1 --2- 172.21.15.46:0/2471662246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a541083a0 0x7f4a541987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:07.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:07.039+0000 7f4a5b63e640 1 --2- 172.21.15.46:0/2471662246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a54102a60 0x7f4a54198230 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:07.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:07.039+0000 7f4a5b63e640 1 -- 172.21.15.46:0/2471662246 >> 172.21.15.46:0/2471662246 conn(0x7f4a54079730 msgr2=0x7f4a541013b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:07.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:07.039+0000 7f4a5b63e640 1 -- 172.21.15.46:0/2471662246 shutdown_connections 2024-09-21T03:54:07.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:07.039+0000 7f4a5b63e640 1 -- 172.21.15.46:0/2471662246 wait complete. 2024-09-21T03:54:07.409 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:07 smithi046 ceph-mon[30954]: pgmap v292: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:54:07.409 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:07 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3228711653' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T03:54:07.409 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:07 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/2471662246' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T03:54:07.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:07 smithi105 ceph-mon[34773]: pgmap v292: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:54:07.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:07 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3228711653' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T03:54:07.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:07 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/2471662246' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T03:54:07.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:07 smithi162 ceph-mon[35071]: pgmap v292: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:54:07.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:07 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3228711653' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T03:54:07.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:07 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/2471662246' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T03:54:07.757 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626479 got 180388626482 for osd.6 2024-09-21T03:54:07.757 DEBUG:teuthology.parallel:result is None 2024-09-21T03:54:08.402 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:08 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:54:08.520 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:08 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:54:08.520 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:08 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:54:08.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.688+0000 7fd56fc3f640 1 -- 172.21.15.46:0/2089728183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5681083d0 msgr2=0x7fd5681087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:08.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.688+0000 7fd56fc3f640 1 --2- 172.21.15.46:0/2089728183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5681083d0 0x7fd5681087e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd558009900 tx=0x7fd55802a410 comp rx=0 tx=0).stop 2024-09-21T03:54:08.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.688+0000 7fd56fc3f640 1 -- 172.21.15.46:0/2089728183 shutdown_connections 2024-09-21T03:54:08.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.688+0000 7fd56fc3f640 1 --2- 172.21.15.46:0/2089728183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd568108d20 0x7fd56810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:08.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.688+0000 7fd56fc3f640 1 --2- 172.21.15.46:0/2089728183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5681083d0 0x7fd5681087e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:08.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.688+0000 7fd56fc3f640 1 --2- 172.21.15.46:0/2089728183 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd568102ae0 0x7fd568102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:08.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.688+0000 7fd56fc3f640 1 -- 172.21.15.46:0/2089728183 >> 172.21.15.46:0/2089728183 conn(0x7fd568079760 msgr2=0x7fd568079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:08.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.688+0000 7fd56fc3f640 1 -- 172.21.15.46:0/2089728183 shutdown_connections 2024-09-21T03:54:08.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.688+0000 7fd56fc3f640 1 -- 172.21.15.46:0/2089728183 wait complete. 2024-09-21T03:54:08.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.689+0000 7fd56fc3f640 1 Processor -- start 2024-09-21T03:54:08.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.689+0000 7fd56fc3f640 1 -- start start 2024-09-21T03:54:08.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.690+0000 7fd56fc3f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd568102ae0 0x7fd56819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:08.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.690+0000 7fd56fc3f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5681083d0 0x7fd56819aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:08.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.690+0000 7fd56fc3f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd568108d20 0x7fd56819fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:08.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.690+0000 7fd56fc3f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd568112990 con 0x7fd568108d20 2024-09-21T03:54:08.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.690+0000 7fd56fc3f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd568112810 con 0x7fd5681083d0 2024-09-21T03:54:08.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.690+0000 7fd56fc3f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd568112b10 con 0x7fd568102ae0 2024-09-21T03:54:08.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.690+0000 7fd56e1dc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd568108d20 0x7fd56819fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:08.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.690+0000 7fd56e1dc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd568108d20 0x7fd56819fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43956/0 (socket says 172.21.15.46:43956) 2024-09-21T03:54:08.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.690+0000 7fd56e1dc640 1 -- 172.21.15.46:0/1512038543 learned_addr learned my addr 172.21.15.46:0/1512038543 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:08.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.690+0000 7fd56d9db640 1 --2- 172.21.15.46:0/1512038543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd568102ae0 0x7fd56819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:08.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.690+0000 7fd56d1da640 1 --2- 172.21.15.46:0/1512038543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5681083d0 0x7fd56819aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:08.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.690+0000 7fd56e1dc640 1 -- 172.21.15.46:0/1512038543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd568102ae0 msgr2=0x7fd56819a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:08.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.690+0000 7fd56e1dc640 1 --2- 172.21.15.46:0/1512038543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd568102ae0 0x7fd56819a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:08.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.690+0000 7fd56e1dc640 1 -- 172.21.15.46:0/1512038543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5681083d0 msgr2=0x7fd56819aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:08.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.690+0000 7fd56e1dc640 1 --2- 172.21.15.46:0/1512038543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5681083d0 0x7fd56819aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:08.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.690+0000 7fd56e1dc640 1 -- 172.21.15.46:0/1512038543 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5681a03e0 con 0x7fd568108d20 2024-09-21T03:54:08.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.690+0000 7fd56d9db640 1 --2- 172.21.15.46:0/1512038543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd568102ae0 0x7fd56819a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:54:08.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.690+0000 7fd56e1dc640 1 --2- 172.21.15.46:0/1512038543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd568108d20 0x7fd56819fcb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd56000eaa0 tx=0x7fd56000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:08.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.691+0000 7fd55effd640 1 -- 172.21.15.46:0/1512038543 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd56000cdb0 con 0x7fd568108d20 2024-09-21T03:54:08.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.691+0000 7fd55effd640 1 -- 172.21.15.46:0/1512038543 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd560005020 con 0x7fd568108d20 2024-09-21T03:54:08.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.691+0000 7fd56fc3f640 1 -- 172.21.15.46:0/1512038543 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5681a06d0 con 0x7fd568108d20 2024-09-21T03:54:08.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.691+0000 7fd55effd640 1 -- 172.21.15.46:0/1512038543 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5600116d0 con 0x7fd568108d20 2024-09-21T03:54:08.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.691+0000 7fd56fc3f640 1 -- 172.21.15.46:0/1512038543 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5681a6e30 con 0x7fd568108d20 2024-09-21T03:54:08.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.692+0000 7fd56fc3f640 1 -- 172.21.15.46:0/1512038543 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd568102ef0 con 0x7fd568108d20 2024-09-21T03:54:08.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.693+0000 7fd55effd640 1 -- 172.21.15.46:0/1512038543 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fd5600051d0 con 0x7fd568108d20 2024-09-21T03:54:08.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.694+0000 7fd55effd640 1 --2- 172.21.15.46:0/1512038543 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fd5540b65f0 0x7fd5540b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:08.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.694+0000 7fd56d9db640 1 --2- 172.21.15.46:0/1512038543 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fd5540b65f0 0x7fd5540b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:08.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.694+0000 7fd55effd640 1 -- 172.21.15.46:0/1512038543 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fd5600e7a40 con 0x7fd568108d20 2024-09-21T03:54:08.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.695+0000 7fd56d9db640 1 --2- 172.21.15.46:0/1512038543 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fd5540b65f0 0x7fd5540b8b00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd564005d00 tx=0x7fd56400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:08.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.697+0000 7fd55effd640 1 -- 172.21.15.46:0/1512038543 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd560016030 con 0x7fd568108d20 2024-09-21T03:54:08.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.897+0000 7fd56fc3f640 1 -- 172.21.15.46:0/1512038543 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fd56810bb80 con 0x7fd568108d20 2024-09-21T03:54:08.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.898+0000 7fd55effd640 1 -- 172.21.15.46:0/1512038543 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd5600b24d0 con 0x7fd568108d20 2024-09-21T03:54:08.900 INFO:teuthology.orchestra.run.smithi046.stdout:201863462957 2024-09-21T03:54:08.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.900+0000 7fd56fc3f640 1 -- 172.21.15.46:0/1512038543 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fd5540b65f0 msgr2=0x7fd5540b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:08.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.900+0000 7fd56fc3f640 1 --2- 172.21.15.46:0/1512038543 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fd5540b65f0 0x7fd5540b8b00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd564005d00 tx=0x7fd56400b410 comp rx=0 tx=0).stop 2024-09-21T03:54:08.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.900+0000 7fd56fc3f640 1 -- 172.21.15.46:0/1512038543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd568108d20 msgr2=0x7fd56819fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:08.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.900+0000 7fd56fc3f640 1 --2- 172.21.15.46:0/1512038543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd568108d20 0x7fd56819fcb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd56000eaa0 tx=0x7fd56000ef60 comp rx=0 tx=0).stop 2024-09-21T03:54:08.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.900+0000 7fd56fc3f640 1 -- 172.21.15.46:0/1512038543 shutdown_connections 2024-09-21T03:54:08.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.900+0000 7fd56fc3f640 1 --2- 172.21.15.46:0/1512038543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd568108d20 0x7fd56819fcb0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:08.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.900+0000 7fd56fc3f640 1 --2- 172.21.15.46:0/1512038543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5681083d0 0x7fd56819aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:08.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.900+0000 7fd56fc3f640 1 --2- 172.21.15.46:0/1512038543 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fd5540b65f0 0x7fd5540b8b00 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:08.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.900+0000 7fd56fc3f640 1 --2- 172.21.15.46:0/1512038543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd568102ae0 0x7fd56819a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:08.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.900+0000 7fd56fc3f640 1 -- 172.21.15.46:0/1512038543 >> 172.21.15.46:0/1512038543 conn(0x7fd568079760 msgr2=0x7fd56806be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:08.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.900+0000 7fd56fc3f640 1 -- 172.21.15.46:0/1512038543 shutdown_connections 2024-09-21T03:54:08.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.900+0000 7fd56fc3f640 1 -- 172.21.15.46:0/1512038543 wait complete. 2024-09-21T03:54:09.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.949+0000 7f460243a640 1 -- 172.21.15.46:0/3969320762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45fc1094f0 msgr2=0x7f45fc109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:09.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.949+0000 7f460243a640 1 --2- 172.21.15.46:0/3969320762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45fc1094f0 0x7f45fc109900 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f45e4009900 tx=0x7f45e402a410 comp rx=0 tx=0).stop 2024-09-21T03:54:09.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.949+0000 7f460243a640 1 -- 172.21.15.46:0/3969320762 shutdown_connections 2024-09-21T03:54:09.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.949+0000 7f460243a640 1 --2- 172.21.15.46:0/3969320762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45fc109e40 0x7f45fc110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:09.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.949+0000 7f460243a640 1 --2- 172.21.15.46:0/3969320762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45fc1094f0 0x7f45fc109900 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:09.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.949+0000 7f460243a640 1 --2- 172.21.15.46:0/3969320762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45fc103bb0 0x7f45fc103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:09.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.949+0000 7f460243a640 1 -- 172.21.15.46:0/3969320762 >> 172.21.15.46:0/3969320762 conn(0x7f45fc0ff600 msgr2=0x7f45fc101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:09.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.950+0000 7f460243a640 1 -- 172.21.15.46:0/3969320762 shutdown_connections 2024-09-21T03:54:09.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.950+0000 7f460243a640 1 -- 172.21.15.46:0/3969320762 wait complete. 2024-09-21T03:54:09.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.950+0000 7f460243a640 1 Processor -- start 2024-09-21T03:54:09.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.951+0000 7f460243a640 1 -- start start 2024-09-21T03:54:09.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.951+0000 7f460243a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45fc103bb0 0x7f45fc19a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:09.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.951+0000 7f460243a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45fc1094f0 0x7f45fc19aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:09.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.951+0000 7f460243a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45fc109e40 0x7f45fc19fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:09.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.951+0000 7f460243a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc113b00 con 0x7f45fc109e40 2024-09-21T03:54:09.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.951+0000 7f460243a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc113980 con 0x7f45fc103bb0 2024-09-21T03:54:09.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.951+0000 7f460243a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc113c80 con 0x7f45fc1094f0 2024-09-21T03:54:09.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.951+0000 7f45fbfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45fc103bb0 0x7f45fc19a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:09.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.951+0000 7f46009d7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45fc109e40 0x7f45fc19fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:09.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.951+0000 7f45f3fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45fc1094f0 0x7f45fc19aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:09.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.951+0000 7f45f3fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45fc1094f0 0x7f45fc19aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:36240/0 (socket says 172.21.15.46:36240) 2024-09-21T03:54:09.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.951+0000 7f45fbfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45fc103bb0 0x7f45fc19a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.46:33398/0 (socket says 172.21.15.46:33398) 2024-09-21T03:54:09.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.951+0000 7f45f3fff640 1 -- 172.21.15.46:0/2146686579 learned_addr learned my addr 172.21.15.46:0/2146686579 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:09.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.951+0000 7f46009d7640 1 -- 172.21.15.46:0/2146686579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45fc1094f0 msgr2=0x7f45fc19aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:09.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.951+0000 7f46009d7640 1 --2- 172.21.15.46:0/2146686579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45fc1094f0 0x7f45fc19aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:09.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.951+0000 7f46009d7640 1 -- 172.21.15.46:0/2146686579 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45fc103bb0 msgr2=0x7f45fc19a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:09.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.951+0000 7f46009d7640 1 --2- 172.21.15.46:0/2146686579 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45fc103bb0 0x7f45fc19a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:09.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.951+0000 7f46009d7640 1 -- 172.21.15.46:0/2146686579 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45fc1a0460 con 0x7f45fc109e40 2024-09-21T03:54:09.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.951+0000 7f45fbfff640 1 --2- 172.21.15.46:0/2146686579 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45fc103bb0 0x7f45fc19a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:54:09.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.952+0000 7f46009d7640 1 --2- 172.21.15.46:0/2146686579 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45fc109e40 0x7f45fc19fd30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f45f400da10 tx=0x7f45f400ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:09.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.952+0000 7f45f9ffb640 1 -- 172.21.15.46:0/2146686579 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f400bd70 con 0x7f45fc109e40 2024-09-21T03:54:09.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.952+0000 7f45f9ffb640 1 -- 172.21.15.46:0/2146686579 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45f4003e20 con 0x7f45fc109e40 2024-09-21T03:54:09.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.952+0000 7f460243a640 1 -- 172.21.15.46:0/2146686579 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45fc1a0750 con 0x7f45fc109e40 2024-09-21T03:54:09.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.952+0000 7f460243a640 1 -- 172.21.15.46:0/2146686579 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45fc0755f0 con 0x7f45fc109e40 2024-09-21T03:54:09.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.953+0000 7f45f9ffb640 1 -- 172.21.15.46:0/2146686579 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f40106c0 con 0x7f45fc109e40 2024-09-21T03:54:09.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.954+0000 7f460243a640 1 -- 172.21.15.46:0/2146686579 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45fc104e30 con 0x7f45fc109e40 2024-09-21T03:54:09.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.956+0000 7f45f9ffb640 1 -- 172.21.15.46:0/2146686579 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f45f4004270 con 0x7f45fc109e40 2024-09-21T03:54:09.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.957+0000 7f45f9ffb640 1 --2- 172.21.15.46:0/2146686579 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f45e80b66f0 0x7f45e80b8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:09.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.957+0000 7f45f9ffb640 1 -- 172.21.15.46:0/2146686579 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f45f40e78f0 con 0x7f45fc109e40 2024-09-21T03:54:09.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.957+0000 7f45fbfff640 1 --2- 172.21.15.46:0/2146686579 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f45e80b66f0 0x7f45e80b8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:09.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.958+0000 7f45fbfff640 1 --2- 172.21.15.46:0/2146686579 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f45e80b66f0 0x7f45e80b8c00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f45ec009fc0 tx=0x7f45ec005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:09.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:08.962+0000 7f45f9ffb640 1 -- 172.21.15.46:0/2146686579 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f45f40adf60 con 0x7f45fc109e40 2024-09-21T03:54:09.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:09.157+0000 7f460243a640 1 -- 172.21.15.46:0/2146686579 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f45fc10bc10 con 0x7f45fc109e40 2024-09-21T03:54:09.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:09.157+0000 7f45f9ffb640 1 -- 172.21.15.46:0/2146686579 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f45f40b2340 con 0x7f45fc109e40 2024-09-21T03:54:09.211 INFO:teuthology.orchestra.run.smithi046.stdout:223338299432 2024-09-21T03:54:09.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:09.159+0000 7f460243a640 1 -- 172.21.15.46:0/2146686579 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f45e80b66f0 msgr2=0x7f45e80b8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:09.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:09.159+0000 7f460243a640 1 --2- 172.21.15.46:0/2146686579 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f45e80b66f0 0x7f45e80b8c00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f45ec009fc0 tx=0x7f45ec005f90 comp rx=0 tx=0).stop 2024-09-21T03:54:09.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:09.159+0000 7f460243a640 1 -- 172.21.15.46:0/2146686579 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45fc109e40 msgr2=0x7f45fc19fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:09.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:09.159+0000 7f460243a640 1 --2- 172.21.15.46:0/2146686579 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45fc109e40 0x7f45fc19fd30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f45f400da10 tx=0x7f45f400ded0 comp rx=0 tx=0).stop 2024-09-21T03:54:09.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:09.159+0000 7f460243a640 1 -- 172.21.15.46:0/2146686579 shutdown_connections 2024-09-21T03:54:09.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:09.159+0000 7f460243a640 1 --2- 172.21.15.46:0/2146686579 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45fc109e40 0x7f45fc19fd30 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:09.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:09.159+0000 7f460243a640 1 --2- 172.21.15.46:0/2146686579 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f45e80b66f0 0x7f45e80b8c00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:09.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:09.159+0000 7f460243a640 1 --2- 172.21.15.46:0/2146686579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45fc1094f0 0x7f45fc19aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:09.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:09.159+0000 7f460243a640 1 --2- 172.21.15.46:0/2146686579 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45fc103bb0 0x7f45fc19a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:09.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:09.159+0000 7f460243a640 1 -- 172.21.15.46:0/2146686579 >> 172.21.15.46:0/2146686579 conn(0x7f45fc0ff600 msgr2=0x7f45fc101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:09.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:09.160+0000 7f460243a640 1 -- 172.21.15.46:0/2146686579 shutdown_connections 2024-09-21T03:54:09.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:09.160+0000 7f460243a640 1 -- 172.21.15.46:0/2146686579 wait complete. 2024-09-21T03:54:09.495 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:09 smithi046 ceph-mon[30954]: pgmap v293: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:54:09.495 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:09 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/1512038543' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T03:54:09.495 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:09 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/2146686579' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T03:54:09.495 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:09 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:54:09.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:09 smithi105 ceph-mon[34773]: pgmap v293: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:54:09.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:09 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/1512038543' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T03:54:09.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:09 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/2146686579' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T03:54:09.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:09 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:54:09.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:09 smithi162 ceph-mon[35071]: pgmap v293: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:54:09.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:09 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/1512038543' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T03:54:09.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:09 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/2146686579' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T03:54:09.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:09 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:54:09.843 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378692 got 81604378694 for osd.2 2024-09-21T03:54:09.843 DEBUG:teuthology.parallel:result is None 2024-09-21T03:54:10.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.251+0000 7f4a244c5640 1 -- 172.21.15.46:0/1063820775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a1c108cf0 msgr2=0x7f4a1c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:10.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.251+0000 7f4a244c5640 1 --2- 172.21.15.46:0/1063820775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a1c108cf0 0x7f4a1c10f520 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4a14009ca0 tx=0x7f4a1402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:54:10.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.251+0000 7f4a244c5640 1 -- 172.21.15.46:0/1063820775 shutdown_connections 2024-09-21T03:54:10.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.252+0000 7f4a244c5640 1 --2- 172.21.15.46:0/1063820775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a1c108cf0 0x7f4a1c10f520 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:10.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.252+0000 7f4a244c5640 1 --2- 172.21.15.46:0/1063820775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a1c1083a0 0x7f4a1c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:10.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.252+0000 7f4a244c5640 1 --2- 172.21.15.46:0/1063820775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a1c102a60 0x7f4a1c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:10.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.252+0000 7f4a244c5640 1 -- 172.21.15.46:0/1063820775 >> 172.21.15.46:0/1063820775 conn(0x7f4a1c079730 msgr2=0x7f4a1c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:10.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.252+0000 7f4a244c5640 1 -- 172.21.15.46:0/1063820775 shutdown_connections 2024-09-21T03:54:10.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.252+0000 7f4a244c5640 1 -- 172.21.15.46:0/1063820775 wait complete. 2024-09-21T03:54:10.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.252+0000 7f4a244c5640 1 Processor -- start 2024-09-21T03:54:10.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.252+0000 7f4a244c5640 1 -- start start 2024-09-21T03:54:10.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.253+0000 7f4a244c5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a1c102a60 0x7f4a1c1993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:10.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.253+0000 7f4a244c5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a1c1083a0 0x7f4a1c199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:10.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.253+0000 7f4a244c5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a1c108cf0 0x7f4a1c19ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:10.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.253+0000 7f4a244c5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c112960 con 0x7f4a1c102a60 2024-09-21T03:54:10.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.253+0000 7f4a244c5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c1127e0 con 0x7f4a1c108cf0 2024-09-21T03:54:10.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.253+0000 7f4a244c5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c112ae0 con 0x7f4a1c1083a0 2024-09-21T03:54:10.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.253+0000 7f4a22261640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a1c102a60 0x7f4a1c1993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:10.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.253+0000 7f4a22261640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a1c102a60 0x7f4a1c1993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43978/0 (socket says 172.21.15.46:43978) 2024-09-21T03:54:10.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.253+0000 7f4a22261640 1 -- 172.21.15.46:0/1971417945 learned_addr learned my addr 172.21.15.46:0/1971417945 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:10.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.253+0000 7f4a21a60640 1 --2- 172.21.15.46:0/1971417945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a1c1083a0 0x7f4a1c199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:10.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.253+0000 7f4a22a62640 1 --2- 172.21.15.46:0/1971417945 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a1c108cf0 0x7f4a1c19ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:10.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.253+0000 7f4a22261640 1 -- 172.21.15.46:0/1971417945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a1c1083a0 msgr2=0x7f4a1c199950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:10.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.253+0000 7f4a22261640 1 --2- 172.21.15.46:0/1971417945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a1c1083a0 0x7f4a1c199950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:10.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.253+0000 7f4a22261640 1 -- 172.21.15.46:0/1971417945 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a1c108cf0 msgr2=0x7f4a1c19ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:10.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.253+0000 7f4a22261640 1 --2- 172.21.15.46:0/1971417945 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a1c108cf0 0x7f4a1c19ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:10.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.253+0000 7f4a22261640 1 -- 172.21.15.46:0/1971417945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a1c19f320 con 0x7f4a1c102a60 2024-09-21T03:54:10.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.253+0000 7f4a22261640 1 --2- 172.21.15.46:0/1971417945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a1c102a60 0x7f4a1c1993b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800e9f0 tx=0x7f4a1800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:10.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.253+0000 7f4a137fe640 1 -- 172.21.15.46:0/1971417945 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1800cd80 con 0x7f4a1c102a60 2024-09-21T03:54:10.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.253+0000 7f4a137fe640 1 -- 172.21.15.46:0/1971417945 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a180054d0 con 0x7f4a1c102a60 2024-09-21T03:54:10.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.253+0000 7f4a244c5640 1 -- 172.21.15.46:0/1971417945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a1c19f610 con 0x7f4a1c102a60 2024-09-21T03:54:10.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.254+0000 7f4a137fe640 1 -- 172.21.15.46:0/1971417945 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a18010690 con 0x7f4a1c102a60 2024-09-21T03:54:10.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.254+0000 7f4a244c5640 1 -- 172.21.15.46:0/1971417945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a1c1a5d70 con 0x7f4a1c102a60 2024-09-21T03:54:10.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.255+0000 7f4a244c5640 1 -- 172.21.15.46:0/1971417945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a1c102e70 con 0x7f4a1c102a60 2024-09-21T03:54:10.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.256+0000 7f4a137fe640 1 -- 172.21.15.46:0/1971417945 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f4a18004e30 con 0x7f4a1c102a60 2024-09-21T03:54:10.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.257+0000 7f4a137fe640 1 --2- 172.21.15.46:0/1971417945 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4a080b65f0 0x7f4a080b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:10.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.257+0000 7f4a21a60640 1 --2- 172.21.15.46:0/1971417945 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4a080b65f0 0x7f4a080b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:10.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.257+0000 7f4a137fe640 1 -- 172.21.15.46:0/1971417945 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f4a180e7b30 con 0x7f4a1c102a60 2024-09-21T03:54:10.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.258+0000 7f4a21a60640 1 --2- 172.21.15.46:0/1971417945 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4a080b65f0 0x7f4a080b8b00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c105f60 tx=0x7f4a0c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:10.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.260+0000 7f4a137fe640 1 -- 172.21.15.46:0/1971417945 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4a180ae1e0 con 0x7f4a1c102a60 2024-09-21T03:54:10.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.450+0000 7f4a244c5640 1 -- 172.21.15.46:0/1971417945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f4a1c19a4e0 con 0x7f4a1c102a60 2024-09-21T03:54:10.454 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:10 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:54:10.454 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:10 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:54:10.454 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:10 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:54:10.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.451+0000 7f4a137fe640 1 -- 172.21.15.46:0/1971417945 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4a180b25c0 con 0x7f4a1c102a60 2024-09-21T03:54:10.454 INFO:teuthology.orchestra.run.smithi046.stdout:154618822712 2024-09-21T03:54:10.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.453+0000 7f4a244c5640 1 -- 172.21.15.46:0/1971417945 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4a080b65f0 msgr2=0x7f4a080b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:10.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.453+0000 7f4a244c5640 1 --2- 172.21.15.46:0/1971417945 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4a080b65f0 0x7f4a080b8b00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c105f60 tx=0x7f4a0c005f90 comp rx=0 tx=0).stop 2024-09-21T03:54:10.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.453+0000 7f4a244c5640 1 -- 172.21.15.46:0/1971417945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a1c102a60 msgr2=0x7f4a1c1993b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:10.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.453+0000 7f4a244c5640 1 --2- 172.21.15.46:0/1971417945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a1c102a60 0x7f4a1c1993b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800e9f0 tx=0x7f4a1800edf0 comp rx=0 tx=0).stop 2024-09-21T03:54:10.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.453+0000 7f4a244c5640 1 -- 172.21.15.46:0/1971417945 shutdown_connections 2024-09-21T03:54:10.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.453+0000 7f4a244c5640 1 --2- 172.21.15.46:0/1971417945 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a1c108cf0 0x7f4a1c19ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:10.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.453+0000 7f4a244c5640 1 --2- 172.21.15.46:0/1971417945 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4a080b65f0 0x7f4a080b8b00 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:10.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.453+0000 7f4a244c5640 1 --2- 172.21.15.46:0/1971417945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a1c1083a0 0x7f4a1c199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:10.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.453+0000 7f4a244c5640 1 --2- 172.21.15.46:0/1971417945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a1c102a60 0x7f4a1c1993b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:10.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.453+0000 7f4a244c5640 1 -- 172.21.15.46:0/1971417945 >> 172.21.15.46:0/1971417945 conn(0x7f4a1c079730 msgr2=0x7f4a1c104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:10.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.454+0000 7f4a244c5640 1 -- 172.21.15.46:0/1971417945 shutdown_connections 2024-09-21T03:54:10.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.454+0000 7f4a244c5640 1 -- 172.21.15.46:0/1971417945 wait complete. 2024-09-21T03:54:10.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.457+0000 7fa75fd4d640 1 -- 172.21.15.46:0/4067811963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa758108cf0 msgr2=0x7fa75810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:10.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.457+0000 7fa75fd4d640 1 --2- 172.21.15.46:0/4067811963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa758108cf0 0x7fa75810f520 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa750009ca0 tx=0x7fa75002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:54:10.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.457+0000 7fa75fd4d640 1 -- 172.21.15.46:0/4067811963 shutdown_connections 2024-09-21T03:54:10.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.457+0000 7fa75fd4d640 1 --2- 172.21.15.46:0/4067811963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa758108cf0 0x7fa75810f520 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:10.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.457+0000 7fa75fd4d640 1 --2- 172.21.15.46:0/4067811963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7581083a0 0x7fa7581087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:10.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.457+0000 7fa75fd4d640 1 --2- 172.21.15.46:0/4067811963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa758102a60 0x7fa758102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:10.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.457+0000 7fa75fd4d640 1 -- 172.21.15.46:0/4067811963 >> 172.21.15.46:0/4067811963 conn(0x7fa758079730 msgr2=0x7fa758079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:10.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.458+0000 7fa75fd4d640 1 -- 172.21.15.46:0/4067811963 shutdown_connections 2024-09-21T03:54:10.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.458+0000 7fa75fd4d640 1 -- 172.21.15.46:0/4067811963 wait complete. 2024-09-21T03:54:10.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.458+0000 7fa75fd4d640 1 Processor -- start 2024-09-21T03:54:10.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.459+0000 7fa75fd4d640 1 -- start start 2024-09-21T03:54:10.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.459+0000 7fa75fd4d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa758102a60 0x7fa7580ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:10.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.459+0000 7fa75fd4d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7581083a0 0x7fa7580ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:10.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.459+0000 7fa75fd4d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa758108cf0 0x7fa7581000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:10.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.459+0000 7fa75fd4d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa758112960 con 0x7fa758108cf0 2024-09-21T03:54:10.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.459+0000 7fa75fd4d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa7581127e0 con 0x7fa758102a60 2024-09-21T03:54:10.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.459+0000 7fa75fd4d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa758112ae0 con 0x7fa7581083a0 2024-09-21T03:54:10.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.459+0000 7fa75e2ea640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa758108cf0 0x7fa7581000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:10.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.459+0000 7fa75e2ea640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa758108cf0 0x7fa7581000f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43996/0 (socket says 172.21.15.46:43996) 2024-09-21T03:54:10.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.459+0000 7fa75e2ea640 1 -- 172.21.15.46:0/3049888354 learned_addr learned my addr 172.21.15.46:0/3049888354 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:10.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.459+0000 7fa75d2e8640 1 --2- 172.21.15.46:0/3049888354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7581083a0 0x7fa7580ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:10.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.459+0000 7fa75dae9640 1 --2- 172.21.15.46:0/3049888354 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa758102a60 0x7fa7580ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:10.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.460+0000 7fa75d2e8640 1 -- 172.21.15.46:0/3049888354 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa758102a60 msgr2=0x7fa7580ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:10.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.460+0000 7fa75d2e8640 1 --2- 172.21.15.46:0/3049888354 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa758102a60 0x7fa7580ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:10.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.460+0000 7fa75d2e8640 1 -- 172.21.15.46:0/3049888354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa758108cf0 msgr2=0x7fa7581000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:10.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.460+0000 7fa75d2e8640 1 --2- 172.21.15.46:0/3049888354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa758108cf0 0x7fa7581000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:10.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.460+0000 7fa75d2e8640 1 -- 172.21.15.46:0/3049888354 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7581a86c0 con 0x7fa7581083a0 2024-09-21T03:54:10.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.460+0000 7fa75d2e8640 1 --2- 172.21.15.46:0/3049888354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7581083a0 0x7fa7580ffbb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa75400d6a0 tx=0x7fa75400db60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:10.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.460+0000 7fa75dae9640 1 --2- 172.21.15.46:0/3049888354 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa758102a60 0x7fa7580ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:54:10.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.460+0000 7fa74effd640 1 -- 172.21.15.46:0/3049888354 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa754017070 con 0x7fa7581083a0 2024-09-21T03:54:10.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.460+0000 7fa74effd640 1 -- 172.21.15.46:0/3049888354 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa754009820 con 0x7fa7581083a0 2024-09-21T03:54:10.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.460+0000 7fa74effd640 1 -- 172.21.15.46:0/3049888354 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa754004c40 con 0x7fa7581083a0 2024-09-21T03:54:10.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.460+0000 7fa75fd4d640 1 -- 172.21.15.46:0/3049888354 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7581a89b0 con 0x7fa7581083a0 2024-09-21T03:54:10.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.460+0000 7fa75fd4d640 1 -- 172.21.15.46:0/3049888354 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7581a8ea0 con 0x7fa7581083a0 2024-09-21T03:54:10.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.461+0000 7fa75fd4d640 1 -- 172.21.15.46:0/3049888354 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa758102e70 con 0x7fa7581083a0 2024-09-21T03:54:10.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.464+0000 7fa74effd640 1 -- 172.21.15.46:0/3049888354 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fa754005220 con 0x7fa7581083a0 2024-09-21T03:54:10.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.464+0000 7fa74effd640 1 --2- 172.21.15.46:0/3049888354 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa7440b6670 0x7fa7440b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:10.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.465+0000 7fa75dae9640 1 --2- 172.21.15.46:0/3049888354 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa7440b6670 0x7fa7440b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:10.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.465+0000 7fa74effd640 1 -- 172.21.15.46:0/3049888354 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fa7540e69f0 con 0x7fa7581083a0 2024-09-21T03:54:10.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.465+0000 7fa75dae9640 1 --2- 172.21.15.46:0/3049888354 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa7440b6670 0x7fa7440b8b80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa7581010c0 tx=0x7fa748005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:10.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.467+0000 7fa74effd640 1 -- 172.21.15.46:0/3049888354 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa7540b1590 con 0x7fa7581083a0 2024-09-21T03:54:10.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:10 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:54:10.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:10 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:54:10.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:10 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:54:10.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:10 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:54:10.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:10 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:54:10.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:10 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:54:10.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.659+0000 7fa75fd4d640 1 -- 172.21.15.46:0/3049888354 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fa75802e640 con 0x7fa7581083a0 2024-09-21T03:54:10.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.660+0000 7fa74effd640 1 -- 172.21.15.46:0/3049888354 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fa7540b6440 con 0x7fa7581083a0 2024-09-21T03:54:10.662 INFO:teuthology.orchestra.run.smithi046.stdout:270582939678 2024-09-21T03:54:10.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.663+0000 7fa75fd4d640 1 -- 172.21.15.46:0/3049888354 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa7440b6670 msgr2=0x7fa7440b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:10.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.663+0000 7fa75fd4d640 1 --2- 172.21.15.46:0/3049888354 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa7440b6670 0x7fa7440b8b80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa7581010c0 tx=0x7fa748005f90 comp rx=0 tx=0).stop 2024-09-21T03:54:10.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.663+0000 7fa75fd4d640 1 -- 172.21.15.46:0/3049888354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7581083a0 msgr2=0x7fa7580ffbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:10.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.663+0000 7fa75fd4d640 1 --2- 172.21.15.46:0/3049888354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7581083a0 0x7fa7580ffbb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa75400d6a0 tx=0x7fa75400db60 comp rx=0 tx=0).stop 2024-09-21T03:54:10.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.663+0000 7fa75fd4d640 1 -- 172.21.15.46:0/3049888354 shutdown_connections 2024-09-21T03:54:10.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.663+0000 7fa75fd4d640 1 --2- 172.21.15.46:0/3049888354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa758108cf0 0x7fa7581000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:10.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.663+0000 7fa75fd4d640 1 --2- 172.21.15.46:0/3049888354 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa7440b6670 0x7fa7440b8b80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:10.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.663+0000 7fa75fd4d640 1 --2- 172.21.15.46:0/3049888354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7581083a0 0x7fa7580ffbb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:10.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.663+0000 7fa75fd4d640 1 --2- 172.21.15.46:0/3049888354 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa758102a60 0x7fa7580ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:10.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.663+0000 7fa75fd4d640 1 -- 172.21.15.46:0/3049888354 >> 172.21.15.46:0/3049888354 conn(0x7fa758079730 msgr2=0x7fa75806b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:10.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.663+0000 7fa75fd4d640 1 -- 172.21.15.46:0/3049888354 shutdown_connections 2024-09-21T03:54:10.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:10.663+0000 7fa75fd4d640 1 -- 172.21.15.46:0/3049888354 wait complete. 2024-09-21T03:54:11.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.069+0000 7fb4f3ba5640 1 -- 172.21.15.46:0/2663874949 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4ec103b80 msgr2=0x7fb4ec103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:11.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.069+0000 7fb4f3ba5640 1 --2- 172.21.15.46:0/2663874949 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4ec103b80 0x7fb4ec103f90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4009ca0 tx=0x7fb4e402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:54:11.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.069+0000 7fb4f3ba5640 1 -- 172.21.15.46:0/2663874949 shutdown_connections 2024-09-21T03:54:11.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.069+0000 7fb4f3ba5640 1 --2- 172.21.15.46:0/2663874949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4ec109e10 0x7fb4ec110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:11.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.069+0000 7fb4f3ba5640 1 --2- 172.21.15.46:0/2663874949 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4ec1094c0 0x7fb4ec1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:11.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.069+0000 7fb4f3ba5640 1 --2- 172.21.15.46:0/2663874949 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4ec103b80 0x7fb4ec103f90 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:11.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.069+0000 7fb4f3ba5640 1 -- 172.21.15.46:0/2663874949 >> 172.21.15.46:0/2663874949 conn(0x7fb4ec0ff610 msgr2=0x7fb4ec101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:11.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.069+0000 7fb4f3ba5640 1 -- 172.21.15.46:0/2663874949 shutdown_connections 2024-09-21T03:54:11.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.069+0000 7fb4f3ba5640 1 -- 172.21.15.46:0/2663874949 wait complete. 2024-09-21T03:54:11.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.070+0000 7fb4f3ba5640 1 Processor -- start 2024-09-21T03:54:11.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.070+0000 7fb4f3ba5640 1 -- start start 2024-09-21T03:54:11.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.070+0000 7fb4f3ba5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4ec103b80 0x7fb4ec19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:11.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.070+0000 7fb4f3ba5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4ec1094c0 0x7fb4ec19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:11.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.070+0000 7fb4f3ba5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4ec109e10 0x7fb4ec19fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:11.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.070+0000 7fb4f3ba5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb4ec113ad0 con 0x7fb4ec1094c0 2024-09-21T03:54:11.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.070+0000 7fb4f3ba5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb4ec113950 con 0x7fb4ec109e10 2024-09-21T03:54:11.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.070+0000 7fb4f3ba5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb4ec113c50 con 0x7fb4ec103b80 2024-09-21T03:54:11.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.070+0000 7fb4f1140640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4ec1094c0 0x7fb4ec19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:11.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.070+0000 7fb4f1140640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4ec1094c0 0x7fb4ec19aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44012/0 (socket says 172.21.15.46:44012) 2024-09-21T03:54:11.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.070+0000 7fb4f1140640 1 -- 172.21.15.46:0/117152552 learned_addr learned my addr 172.21.15.46:0/117152552 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:11.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.070+0000 7fb4f1941640 1 --2- 172.21.15.46:0/117152552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4ec103b80 0x7fb4ec19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:11.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.070+0000 7fb4f1140640 1 -- 172.21.15.46:0/117152552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4ec103b80 msgr2=0x7fb4ec19a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:11.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.070+0000 7fb4f1140640 1 --2- 172.21.15.46:0/117152552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4ec103b80 0x7fb4ec19a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:11.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.070+0000 7fb4f2142640 1 --2- 172.21.15.46:0/117152552 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4ec109e10 0x7fb4ec19fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:11.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.070+0000 7fb4f1140640 1 -- 172.21.15.46:0/117152552 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4ec109e10 msgr2=0x7fb4ec19fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:11.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.070+0000 7fb4f1140640 1 --2- 172.21.15.46:0/117152552 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4ec109e10 0x7fb4ec19fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:11.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.071+0000 7fb4f1140640 1 -- 172.21.15.46:0/117152552 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4ec1a0410 con 0x7fb4ec1094c0 2024-09-21T03:54:11.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.071+0000 7fb4f1140640 1 --2- 172.21.15.46:0/117152552 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4ec1094c0 0x7fb4ec19aa40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb4e000d740 tx=0x7fb4e000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:11.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.071+0000 7fb4eaffd640 1 -- 172.21.15.46:0/117152552 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e0017070 con 0x7fb4ec1094c0 2024-09-21T03:54:11.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.071+0000 7fb4eaffd640 1 -- 172.21.15.46:0/117152552 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4e000de50 con 0x7fb4ec1094c0 2024-09-21T03:54:11.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.071+0000 7fb4f3ba5640 1 -- 172.21.15.46:0/117152552 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4ec1a0700 con 0x7fb4ec1094c0 2024-09-21T03:54:11.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.071+0000 7fb4eaffd640 1 -- 172.21.15.46:0/117152552 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e000f620 con 0x7fb4ec1094c0 2024-09-21T03:54:11.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.071+0000 7fb4f3ba5640 1 -- 172.21.15.46:0/117152552 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4ec1a6e60 con 0x7fb4ec1094c0 2024-09-21T03:54:11.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.072+0000 7fb4f3ba5640 1 -- 172.21.15.46:0/117152552 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4ec103f90 con 0x7fb4ec1094c0 2024-09-21T03:54:11.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.074+0000 7fb4eaffd640 1 -- 172.21.15.46:0/117152552 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fb4e001a070 con 0x7fb4ec1094c0 2024-09-21T03:54:11.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.075+0000 7fb4eaffd640 1 --2- 172.21.15.46:0/117152552 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb4d40b65f0 0x7fb4d40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:11.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.075+0000 7fb4f1941640 1 --2- 172.21.15.46:0/117152552 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb4d40b65f0 0x7fb4d40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:11.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.075+0000 7fb4eaffd640 1 -- 172.21.15.46:0/117152552 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fb4e00e6f80 con 0x7fb4ec1094c0 2024-09-21T03:54:11.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.076+0000 7fb4f1941640 1 --2- 172.21.15.46:0/117152552 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb4d40b65f0 0x7fb4d40b8b00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4005e30 tx=0x7fb4e4009360 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:11.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.080+0000 7fb4eaffd640 1 -- 172.21.15.46:0/117152552 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb4e00ad5f0 con 0x7fb4ec1094c0 2024-09-21T03:54:11.087 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:11.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.278+0000 7fb4f3ba5640 1 -- 172.21.15.46:0/117152552 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fb4ec10bc40 con 0x7fb4ec1094c0 2024-09-21T03:54:11.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.278+0000 7fb4eaffd640 1 -- 172.21.15.46:0/117152552 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb4e00b19d0 con 0x7fb4ec1094c0 2024-09-21T03:54:11.280 INFO:teuthology.orchestra.run.smithi046.stdout:38654705745 2024-09-21T03:54:11.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.280+0000 7fb4f3ba5640 1 -- 172.21.15.46:0/117152552 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb4d40b65f0 msgr2=0x7fb4d40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:11.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.280+0000 7fb4f3ba5640 1 --2- 172.21.15.46:0/117152552 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb4d40b65f0 0x7fb4d40b8b00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4005e30 tx=0x7fb4e4009360 comp rx=0 tx=0).stop 2024-09-21T03:54:11.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.280+0000 7fb4f3ba5640 1 -- 172.21.15.46:0/117152552 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4ec1094c0 msgr2=0x7fb4ec19aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:11.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.280+0000 7fb4f3ba5640 1 --2- 172.21.15.46:0/117152552 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4ec1094c0 0x7fb4ec19aa40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb4e000d740 tx=0x7fb4e000dc00 comp rx=0 tx=0).stop 2024-09-21T03:54:11.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.280+0000 7fb4f3ba5640 1 -- 172.21.15.46:0/117152552 shutdown_connections 2024-09-21T03:54:11.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.280+0000 7fb4f3ba5640 1 --2- 172.21.15.46:0/117152552 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4ec109e10 0x7fb4ec19fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:11.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.280+0000 7fb4f3ba5640 1 --2- 172.21.15.46:0/117152552 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4ec1094c0 0x7fb4ec19aa40 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:11.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.280+0000 7fb4f3ba5640 1 --2- 172.21.15.46:0/117152552 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb4d40b65f0 0x7fb4d40b8b00 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:11.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.280+0000 7fb4f3ba5640 1 --2- 172.21.15.46:0/117152552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4ec103b80 0x7fb4ec19a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:11.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.280+0000 7fb4f3ba5640 1 -- 172.21.15.46:0/117152552 >> 172.21.15.46:0/117152552 conn(0x7fb4ec0ff610 msgr2=0x7fb4ec108b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:11.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.280+0000 7fb4f3ba5640 1 -- 172.21.15.46:0/117152552 shutdown_connections 2024-09-21T03:54:11.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:11.280+0000 7fb4f3ba5640 1 -- 172.21.15.46:0/117152552 wait complete. 2024-09-21T03:54:11.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:11 smithi105 ceph-mon[34773]: pgmap v294: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:54:11.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:11 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/1971417945' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T03:54:11.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:11 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3049888354' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T03:54:11.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:11 smithi162 ceph-mon[35071]: pgmap v294: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:54:11.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:11 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/1971417945' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T03:54:11.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:11 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3049888354' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T03:54:11.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:11 smithi046 ceph-mon[30954]: pgmap v294: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:54:11.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:11 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/1971417945' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T03:54:11.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:11 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3049888354' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T03:54:11.808 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822709 got 154618822712 for osd.5 2024-09-21T03:54:11.808 DEBUG:teuthology.parallel:result is None 2024-09-21T03:54:12.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:12 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/117152552' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T03:54:12.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:12 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/117152552' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T03:54:12.584 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939676 got 270582939678 for osd.10 2024-09-21T03:54:12.585 DEBUG:teuthology.parallel:result is None 2024-09-21T03:54:12.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:12 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/117152552' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T03:54:12.988 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542217 got 60129542219 for osd.1 2024-09-21T03:54:12.988 DEBUG:teuthology.parallel:result is None 2024-09-21T03:54:13.527 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:13 smithi162 ceph-mon[35071]: pgmap v295: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 1 op/s 2024-09-21T03:54:13.539 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:13 smithi046 ceph-mon[30954]: pgmap v295: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 1 op/s 2024-09-21T03:54:13.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:13 smithi105 ceph-mon[34773]: pgmap v295: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 1 op/s 2024-09-21T03:54:13.574 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462953 got 201863462957 for osd.7 2024-09-21T03:54:13.574 DEBUG:teuthology.parallel:result is None 2024-09-21T03:54:13.684 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299430 got 223338299432 for osd.8 2024-09-21T03:54:13.684 DEBUG:teuthology.parallel:result is None 2024-09-21T03:54:13.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.954+0000 7f6d51aa3640 1 -- 172.21.15.46:0/2130780418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d4c103b60 msgr2=0x7f6d4c103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:13.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.954+0000 7f6d51aa3640 1 --2- 172.21.15.46:0/2130780418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d4c103b60 0x7f6d4c103f70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c009900 tx=0x7f6d3c02a410 comp rx=0 tx=0).stop 2024-09-21T03:54:13.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.954+0000 7f6d51aa3640 1 -- 172.21.15.46:0/2130780418 shutdown_connections 2024-09-21T03:54:13.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.954+0000 7f6d51aa3640 1 --2- 172.21.15.46:0/2130780418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d4c109df0 0x7f6d4c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:13.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.954+0000 7f6d51aa3640 1 --2- 172.21.15.46:0/2130780418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d4c1094a0 0x7f6d4c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:13.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.954+0000 7f6d51aa3640 1 --2- 172.21.15.46:0/2130780418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d4c103b60 0x7f6d4c103f70 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:13.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.954+0000 7f6d51aa3640 1 -- 172.21.15.46:0/2130780418 >> 172.21.15.46:0/2130780418 conn(0x7f6d4c07b850 msgr2=0x7f6d4c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:13.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.954+0000 7f6d51aa3640 1 -- 172.21.15.46:0/2130780418 shutdown_connections 2024-09-21T03:54:13.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.954+0000 7f6d51aa3640 1 -- 172.21.15.46:0/2130780418 wait complete. 2024-09-21T03:54:13.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.955+0000 7f6d51aa3640 1 Processor -- start 2024-09-21T03:54:13.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.955+0000 7f6d51aa3640 1 -- start start 2024-09-21T03:54:13.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.956+0000 7f6d51aa3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d4c103b60 0x7f6d4c19a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:13.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.956+0000 7f6d51aa3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d4c1094a0 0x7f6d4c19aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:13.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.956+0000 7f6d51aa3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d4c109df0 0x7f6d4c19fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:13.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.956+0000 7f6d51aa3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4c113ab0 con 0x7f6d4c1094a0 2024-09-21T03:54:13.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.956+0000 7f6d51aa3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4c113930 con 0x7f6d4c103b60 2024-09-21T03:54:13.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.956+0000 7f6d51aa3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4c113c30 con 0x7f6d4c109df0 2024-09-21T03:54:13.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.956+0000 7f6d4affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d4c1094a0 0x7f6d4c19aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:13.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.956+0000 7f6d4affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d4c1094a0 0x7f6d4c19aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40944/0 (socket says 172.21.15.46:40944) 2024-09-21T03:54:13.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.956+0000 7f6d4affd640 1 -- 172.21.15.46:0/3728301438 learned_addr learned my addr 172.21.15.46:0/3728301438 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:13.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.956+0000 7f6d4bfff640 1 --2- 172.21.15.46:0/3728301438 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d4c109df0 0x7f6d4c19fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:13.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.956+0000 7f6d4b7fe640 1 --2- 172.21.15.46:0/3728301438 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d4c103b60 0x7f6d4c19a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:13.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.956+0000 7f6d4affd640 1 -- 172.21.15.46:0/3728301438 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d4c109df0 msgr2=0x7f6d4c19fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:13.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.956+0000 7f6d4affd640 1 --2- 172.21.15.46:0/3728301438 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d4c109df0 0x7f6d4c19fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:13.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.956+0000 7f6d4affd640 1 -- 172.21.15.46:0/3728301438 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d4c103b60 msgr2=0x7f6d4c19a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:13.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.956+0000 7f6d4affd640 1 --2- 172.21.15.46:0/3728301438 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d4c103b60 0x7f6d4c19a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:13.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.956+0000 7f6d4affd640 1 -- 172.21.15.46:0/3728301438 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d4c1a03d0 con 0x7f6d4c1094a0 2024-09-21T03:54:13.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.956+0000 7f6d4affd640 1 --2- 172.21.15.46:0/3728301438 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d4c1094a0 0x7f6d4c19aac0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6d4000c8c0 tx=0x7f6d4000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:13.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.957+0000 7f6d48ff9640 1 -- 172.21.15.46:0/3728301438 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d40007bb0 con 0x7f6d4c1094a0 2024-09-21T03:54:13.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.957+0000 7f6d51aa3640 1 -- 172.21.15.46:0/3728301438 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d4c1a06c0 con 0x7f6d4c1094a0 2024-09-21T03:54:13.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.957+0000 7f6d48ff9640 1 -- 172.21.15.46:0/3728301438 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d40007d50 con 0x7f6d4c1094a0 2024-09-21T03:54:13.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.957+0000 7f6d48ff9640 1 -- 172.21.15.46:0/3728301438 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d400187c0 con 0x7f6d4c1094a0 2024-09-21T03:54:13.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.957+0000 7f6d51aa3640 1 -- 172.21.15.46:0/3728301438 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d4c1a6ee0 con 0x7f6d4c1094a0 2024-09-21T03:54:13.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.958+0000 7f6d51aa3640 1 -- 172.21.15.46:0/3728301438 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d4c103f70 con 0x7f6d4c1094a0 2024-09-21T03:54:13.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.960+0000 7f6d48ff9640 1 -- 172.21.15.46:0/3728301438 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f6d4000fa20 con 0x7f6d4c1094a0 2024-09-21T03:54:13.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.960+0000 7f6d48ff9640 1 --2- 172.21.15.46:0/3728301438 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f6d340b6620 0x7f6d340b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:13.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.961+0000 7f6d4b7fe640 1 --2- 172.21.15.46:0/3728301438 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f6d340b6620 0x7f6d340b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:13.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.961+0000 7f6d48ff9640 1 -- 172.21.15.46:0/3728301438 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f6d400e7890 con 0x7f6d4c1094a0 2024-09-21T03:54:13.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.961+0000 7f6d4b7fe640 1 --2- 172.21.15.46:0/3728301438 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f6d340b6620 0x7f6d340b8b30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c031440 tx=0x7f6d3c005d50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:13.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:13.964+0000 7f6d48ff9640 1 -- 172.21.15.46:0/3728301438 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6d40014030 con 0x7f6d4c1094a0 2024-09-21T03:54:14.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:14.158+0000 7f6d51aa3640 1 -- 172.21.15.46:0/3728301438 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f6d4c19b650 con 0x7f6d4c1094a0 2024-09-21T03:54:14.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:14.158+0000 7f6d48ff9640 1 -- 172.21.15.46:0/3728301438 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6d4c19b650 con 0x7f6d4c1094a0 2024-09-21T03:54:14.161 INFO:teuthology.orchestra.run.smithi046.stdout:133143986237 2024-09-21T03:54:14.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:14.161+0000 7f6d51aa3640 1 -- 172.21.15.46:0/3728301438 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f6d340b6620 msgr2=0x7f6d340b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:14.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:14.161+0000 7f6d51aa3640 1 --2- 172.21.15.46:0/3728301438 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f6d340b6620 0x7f6d340b8b30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c031440 tx=0x7f6d3c005d50 comp rx=0 tx=0).stop 2024-09-21T03:54:14.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:14.161+0000 7f6d51aa3640 1 -- 172.21.15.46:0/3728301438 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d4c1094a0 msgr2=0x7f6d4c19aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:14.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:14.161+0000 7f6d51aa3640 1 --2- 172.21.15.46:0/3728301438 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d4c1094a0 0x7f6d4c19aac0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6d4000c8c0 tx=0x7f6d4000cd80 comp rx=0 tx=0).stop 2024-09-21T03:54:14.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:14.161+0000 7f6d51aa3640 1 -- 172.21.15.46:0/3728301438 shutdown_connections 2024-09-21T03:54:14.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:14.161+0000 7f6d51aa3640 1 --2- 172.21.15.46:0/3728301438 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f6d340b6620 0x7f6d340b8b30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:14.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:14.161+0000 7f6d51aa3640 1 --2- 172.21.15.46:0/3728301438 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d4c109df0 0x7f6d4c19fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:14.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:14.161+0000 7f6d51aa3640 1 --2- 172.21.15.46:0/3728301438 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d4c1094a0 0x7f6d4c19aac0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:14.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:14.161+0000 7f6d51aa3640 1 --2- 172.21.15.46:0/3728301438 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d4c103b60 0x7f6d4c19a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:14.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:14.161+0000 7f6d51aa3640 1 -- 172.21.15.46:0/3728301438 >> 172.21.15.46:0/3728301438 conn(0x7f6d4c07b850 msgr2=0x7f6d4c107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:14.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:14.161+0000 7f6d51aa3640 1 -- 172.21.15.46:0/3728301438 shutdown_connections 2024-09-21T03:54:14.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:14.161+0000 7f6d51aa3640 1 -- 172.21.15.46:0/3728301438 wait complete. 2024-09-21T03:54:14.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:14 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3728301438' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T03:54:14.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:14 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3728301438' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T03:54:14.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:14 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3728301438' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T03:54:14.945 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705743 got 38654705745 for osd.0 2024-09-21T03:54:14.945 DEBUG:teuthology.parallel:result is None 2024-09-21T03:54:15.337 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986234 got 133143986237 for osd.4 2024-09-21T03:54:15.337 DEBUG:teuthology.parallel:result is None 2024-09-21T03:54:15.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:15 smithi105 ceph-mon[34773]: pgmap v296: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-21T03:54:15.594 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:15 smithi046 ceph-mon[30954]: pgmap v296: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-21T03:54:15.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:15 smithi162 ceph-mon[35071]: pgmap v296: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-21T03:54:15.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.831+0000 7fbbe09c1640 1 -- 172.21.15.46:0/1519863164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbdc10de20 msgr2=0x7fbbdc110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:15.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.831+0000 7fbbe09c1640 1 --2- 172.21.15.46:0/1519863164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbdc10de20 0x7fbbdc110330 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4009ca0 tx=0x7fbbd402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:54:15.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.832+0000 7fbbe09c1640 1 -- 172.21.15.46:0/1519863164 shutdown_connections 2024-09-21T03:54:15.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.832+0000 7fbbe09c1640 1 --2- 172.21.15.46:0/1519863164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbdc10de20 0x7fbbdc110330 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:15.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.832+0000 7fbbe09c1640 1 --2- 172.21.15.46:0/1519863164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbdc1052a0 0x7fbbdc10d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:15.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.832+0000 7fbbe09c1640 1 --2- 172.21.15.46:0/1519863164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbdc104870 0x7fbbdc104c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:15.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.832+0000 7fbbe09c1640 1 -- 172.21.15.46:0/1519863164 >> 172.21.15.46:0/1519863164 conn(0x7fbbdc079750 msgr2=0x7fbbdc079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:15.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.832+0000 7fbbe09c1640 1 -- 172.21.15.46:0/1519863164 shutdown_connections 2024-09-21T03:54:15.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.832+0000 7fbbe09c1640 1 -- 172.21.15.46:0/1519863164 wait complete. 2024-09-21T03:54:15.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.832+0000 7fbbe09c1640 1 Processor -- start 2024-09-21T03:54:15.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.832+0000 7fbbe09c1640 1 -- start start 2024-09-21T03:54:15.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.833+0000 7fbbe09c1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbdc104870 0x7fbbdc19a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:15.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.833+0000 7fbbe09c1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbdc1052a0 0x7fbbdc19aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:15.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.833+0000 7fbbe09c1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbdc10de20 0x7fbbdc19fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:15.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.833+0000 7fbbe09c1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fbbdc113aa0 con 0x7fbbdc1052a0 2024-09-21T03:54:15.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.833+0000 7fbbe09c1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbbdc113920 con 0x7fbbdc104870 2024-09-21T03:54:15.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.833+0000 7fbbe09c1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbbdc113c20 con 0x7fbbdc10de20 2024-09-21T03:54:15.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.833+0000 7fbbd9d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbdc1052a0 0x7fbbdc19aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:15.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.833+0000 7fbbd9d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbdc1052a0 0x7fbbdc19aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40950/0 (socket says 172.21.15.46:40950) 2024-09-21T03:54:15.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.833+0000 7fbbd9d9b640 1 -- 172.21.15.46:0/2465543412 learned_addr learned my addr 172.21.15.46:0/2465543412 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:15.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.833+0000 7fbbdad9d640 1 --2- 172.21.15.46:0/2465543412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbdc10de20 0x7fbbdc19fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:15.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.833+0000 7fbbda59c640 1 --2- 172.21.15.46:0/2465543412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbdc104870 0x7fbbdc19a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:15.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.833+0000 7fbbd9d9b640 1 -- 172.21.15.46:0/2465543412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbdc10de20 msgr2=0x7fbbdc19fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:15.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.833+0000 7fbbd9d9b640 1 --2- 172.21.15.46:0/2465543412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbdc10de20 0x7fbbdc19fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:15.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.833+0000 7fbbd9d9b640 1 -- 172.21.15.46:0/2465543412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbdc104870 msgr2=0x7fbbdc19a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:15.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.833+0000 7fbbd9d9b640 1 --2- 172.21.15.46:0/2465543412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbdc104870 0x7fbbdc19a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:15.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.833+0000 7fbbd9d9b640 1 -- 172.21.15.46:0/2465543412 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbdc1a0440 con 0x7fbbdc1052a0 2024-09-21T03:54:15.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.833+0000 7fbbda59c640 1 --2- 172.21.15.46:0/2465543412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbdc104870 0x7fbbdc19a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:54:15.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.833+0000 7fbbd9d9b640 1 --2- 172.21.15.46:0/2465543412 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbdc1052a0 0x7fbbdc19aa70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbbd000d740 tx=0x7fbbd000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:15.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.834+0000 7fbbcb7fe640 1 -- 172.21.15.46:0/2465543412 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd0017070 con 0x7fbbdc1052a0 2024-09-21T03:54:15.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.834+0000 7fbbcb7fe640 1 -- 172.21.15.46:0/2465543412 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbd000de50 con 0x7fbbdc1052a0 2024-09-21T03:54:15.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.834+0000 7fbbe09c1640 1 -- 172.21.15.46:0/2465543412 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbdc1a0730 con 0x7fbbdc1052a0 2024-09-21T03:54:15.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.834+0000 7fbbcb7fe640 1 -- 172.21.15.46:0/2465543412 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd000f620 con 0x7fbbdc1052a0 2024-09-21T03:54:15.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.834+0000 7fbbe09c1640 1 -- 172.21.15.46:0/2465543412 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbdc1a6e90 con 0x7fbbdc1052a0 2024-09-21T03:54:15.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.835+0000 7fbbe09c1640 1 -- 172.21.15.46:0/2465543412 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbdc06c220 con 0x7fbbdc1052a0 2024-09-21T03:54:15.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.837+0000 7fbbcb7fe640 1 -- 172.21.15.46:0/2465543412 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fbbd001a070 con 0x7fbbdc1052a0 2024-09-21T03:54:15.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.838+0000 7fbbcb7fe640 1 --2- 172.21.15.46:0/2465543412 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fbbc40b65f0 0x7fbbc40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:15.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.838+0000 7fbbda59c640 1 --2- 172.21.15.46:0/2465543412 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fbbc40b65f0 0x7fbbc40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:15.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.838+0000 7fbbcb7fe640 1 -- 172.21.15.46:0/2465543412 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fbbd00e6ec0 con 0x7fbbdc1052a0 2024-09-21T03:54:15.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.839+0000 7fbbda59c640 1 --2- 172.21.15.46:0/2465543412 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fbbc40b65f0 0x7fbbc40b8b00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc06c920 tx=0x7fbbcc005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:15.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:15.841+0000 7fbbcb7fe640 1 -- 172.21.15.46:0/2465543412 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbbd00ad570 con 0x7fbbdc1052a0 2024-09-21T03:54:15.845 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:16.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.038+0000 7fbbe09c1640 1 -- 172.21.15.46:0/2465543412 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fbbdc1a7170 con 0x7fbbdc1052a0 2024-09-21T03:54:16.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.038+0000 7fbbcb7fe640 1 -- 172.21.15.46:0/2465543412 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbbd00b1950 con 0x7fbbdc1052a0 2024-09-21T03:54:16.040 INFO:teuthology.orchestra.run.smithi046.stdout:107374182465 2024-09-21T03:54:16.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.040+0000 7fbbe09c1640 1 -- 172.21.15.46:0/2465543412 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fbbc40b65f0 msgr2=0x7fbbc40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:16.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.040+0000 7fbbe09c1640 1 --2- 172.21.15.46:0/2465543412 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fbbc40b65f0 0x7fbbc40b8b00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc06c920 tx=0x7fbbcc005f90 comp rx=0 tx=0).stop 2024-09-21T03:54:16.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.040+0000 7fbbe09c1640 1 -- 172.21.15.46:0/2465543412 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbdc1052a0 msgr2=0x7fbbdc19aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:16.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.040+0000 7fbbe09c1640 1 --2- 172.21.15.46:0/2465543412 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbdc1052a0 0x7fbbdc19aa70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbbd000d740 tx=0x7fbbd000dc00 comp rx=0 tx=0).stop 2024-09-21T03:54:16.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.040+0000 7fbbe09c1640 1 -- 172.21.15.46:0/2465543412 shutdown_connections 2024-09-21T03:54:16.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.040+0000 7fbbe09c1640 1 --2- 172.21.15.46:0/2465543412 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fbbc40b65f0 0x7fbbc40b8b00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:16.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.040+0000 7fbbe09c1640 1 --2- 172.21.15.46:0/2465543412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbdc10de20 0x7fbbdc19fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:16.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.040+0000 7fbbe09c1640 1 --2- 172.21.15.46:0/2465543412 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbbdc1052a0 0x7fbbdc19aa70 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:16.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.040+0000 7fbbe09c1640 1 --2- 172.21.15.46:0/2465543412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbdc104870 0x7fbbdc19a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:16.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.040+0000 7fbbe09c1640 1 -- 172.21.15.46:0/2465543412 >> 172.21.15.46:0/2465543412 conn(0x7fbbdc079750 msgr2=0x7fbbdc107930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:16.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.041+0000 7fbbe09c1640 1 -- 172.21.15.46:0/2465543412 shutdown_connections 2024-09-21T03:54:16.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.041+0000 7fbbe09c1640 1 -- 172.21.15.46:0/2465543412 wait complete. 2024-09-21T03:54:16.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.518+0000 7fd92813c640 1 -- 172.21.15.46:0/1727573898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9201083c0 msgr2=0x7fd9201087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:16.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.518+0000 7fd92813c640 1 --2- 172.21.15.46:0/1727573898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9201083c0 0x7fd9201087d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd910009900 tx=0x7fd91002a410 comp rx=0 tx=0).stop 2024-09-21T03:54:16.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.518+0000 7fd92813c640 1 -- 172.21.15.46:0/1727573898 shutdown_connections 2024-09-21T03:54:16.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.518+0000 7fd92813c640 1 --2- 172.21.15.46:0/1727573898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd920108d10 0x7fd92010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:16.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.518+0000 7fd92813c640 1 --2- 172.21.15.46:0/1727573898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9201083c0 0x7fd9201087d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:16.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.518+0000 7fd92813c640 1 --2- 172.21.15.46:0/1727573898 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd920102a80 0x7fd920102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:16.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.518+0000 7fd92813c640 1 -- 172.21.15.46:0/1727573898 >> 172.21.15.46:0/1727573898 conn(0x7fd920079740 msgr2=0x7fd920079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:16.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.518+0000 7fd92813c640 1 -- 172.21.15.46:0/1727573898 shutdown_connections 2024-09-21T03:54:16.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.518+0000 7fd92813c640 1 -- 172.21.15.46:0/1727573898 wait complete. 2024-09-21T03:54:16.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.519+0000 7fd92813c640 1 Processor -- start 2024-09-21T03:54:16.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.519+0000 7fd92813c640 1 -- start start 2024-09-21T03:54:16.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.519+0000 7fd92813c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd920102a80 0x7fd9201993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:16.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.519+0000 7fd92813c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9201083c0 0x7fd920199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:16.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.519+0000 7fd92813c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd920108d10 0x7fd92019ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:16.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.519+0000 7fd92813c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd920112980 con 0x7fd920102a80 2024-09-21T03:54:16.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.519+0000 7fd92813c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd920112800 con 0x7fd920108d10 2024-09-21T03:54:16.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.519+0000 7fd92813c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd920112b00 con 0x7fd9201083c0 2024-09-21T03:54:16.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.519+0000 7fd925ed8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd920102a80 0x7fd9201993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:16.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.519+0000 7fd925ed8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd920102a80 0x7fd9201993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40974/0 (socket says 172.21.15.46:40974) 2024-09-21T03:54:16.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.519+0000 7fd925ed8640 1 -- 172.21.15.46:0/153167249 learned_addr learned my addr 172.21.15.46:0/153167249 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:16.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.519+0000 7fd9256d7640 1 --2- 172.21.15.46:0/153167249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9201083c0 0x7fd920199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:16.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.520+0000 7fd9266d9640 1 --2- 172.21.15.46:0/153167249 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd920108d10 0x7fd92019ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:16.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.520+0000 7fd925ed8640 1 -- 172.21.15.46:0/153167249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9201083c0 msgr2=0x7fd920199970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:16.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.520+0000 7fd925ed8640 1 --2- 172.21.15.46:0/153167249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9201083c0 0x7fd920199970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:16.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.520+0000 7fd925ed8640 1 -- 172.21.15.46:0/153167249 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd920108d10 msgr2=0x7fd92019ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:16.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.520+0000 7fd925ed8640 1 --2- 172.21.15.46:0/153167249 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd920108d10 0x7fd92019ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:16.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.520+0000 7fd925ed8640 1 -- 172.21.15.46:0/153167249 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd92019f340 con 0x7fd920102a80 2024-09-21T03:54:16.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.520+0000 7fd9266d9640 1 --2- 172.21.15.46:0/153167249 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd920108d10 0x7fd92019ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:54:16.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.520+0000 7fd9256d7640 1 --2- 172.21.15.46:0/153167249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9201083c0 0x7fd920199970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:54:16.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.520+0000 7fd925ed8640 1 --2- 172.21.15.46:0/153167249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd920102a80 0x7fd9201993d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd91c00c890 tx=0x7fd91c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:16.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.520+0000 7fd916ffd640 1 -- 172.21.15.46:0/153167249 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd91c004220 con 0x7fd920102a80 2024-09-21T03:54:16.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.520+0000 7fd92813c640 1 -- 172.21.15.46:0/153167249 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd92019f630 con 0x7fd920102a80 2024-09-21T03:54:16.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.520+0000 7fd916ffd640 1 -- 172.21.15.46:0/153167249 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd91c0043c0 con 0x7fd920102a80 2024-09-21T03:54:16.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.520+0000 7fd916ffd640 1 -- 172.21.15.46:0/153167249 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd91c004a00 con 0x7fd920102a80 2024-09-21T03:54:16.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.520+0000 7fd92813c640 1 -- 172.21.15.46:0/153167249 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9201a5d90 con 0x7fd920102a80 2024-09-21T03:54:16.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.521+0000 7fd92813c640 1 -- 172.21.15.46:0/153167249 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd920103d00 con 0x7fd920102a80 2024-09-21T03:54:16.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.523+0000 7fd916ffd640 1 -- 172.21.15.46:0/153167249 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fd91c0079b0 con 0x7fd920102a80 2024-09-21T03:54:16.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.523+0000 7fd916ffd640 1 --2- 172.21.15.46:0/153167249 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fd90c0b65f0 0x7fd90c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:16.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.524+0000 7fd9256d7640 1 --2- 172.21.15.46:0/153167249 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fd90c0b65f0 0x7fd90c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:16.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.524+0000 7fd916ffd640 1 -- 172.21.15.46:0/153167249 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fd91c0e73b0 con 0x7fd920102a80 2024-09-21T03:54:16.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.524+0000 7fd9256d7640 1 --2- 172.21.15.46:0/153167249 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fd90c0b65f0 0x7fd90c0b8b00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd910000c00 tx=0x7fd910032da0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:16.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.528+0000 7fd916ffd640 1 -- 172.21.15.46:0/153167249 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd91c014030 con 0x7fd920102a80 2024-09-21T03:54:16.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:16 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/2465543412' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T03:54:16.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:16 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/2465543412' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T03:54:16.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.726+0000 7fd92813c640 1 -- 172.21.15.46:0/153167249 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fd920102e90 con 0x7fd920102a80 2024-09-21T03:54:16.728 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:16 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/2465543412' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T03:54:16.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.726+0000 7fd916ffd640 1 -- 172.21.15.46:0/153167249 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fd91c0ada60 con 0x7fd920102a80 2024-09-21T03:54:16.729 INFO:teuthology.orchestra.run.smithi046.stdout:296352743450 2024-09-21T03:54:16.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.729+0000 7fd92813c640 1 -- 172.21.15.46:0/153167249 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fd90c0b65f0 msgr2=0x7fd90c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:16.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.729+0000 7fd92813c640 1 --2- 172.21.15.46:0/153167249 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fd90c0b65f0 0x7fd90c0b8b00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd910000c00 tx=0x7fd910032da0 comp rx=0 tx=0).stop 2024-09-21T03:54:16.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.729+0000 7fd92813c640 1 -- 172.21.15.46:0/153167249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd920102a80 msgr2=0x7fd9201993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:16.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.729+0000 7fd92813c640 1 --2- 172.21.15.46:0/153167249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd920102a80 0x7fd9201993d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd91c00c890 tx=0x7fd91c00cd50 comp rx=0 tx=0).stop 2024-09-21T03:54:16.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.729+0000 7fd92813c640 1 -- 172.21.15.46:0/153167249 shutdown_connections 2024-09-21T03:54:16.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.729+0000 7fd92813c640 1 --2- 172.21.15.46:0/153167249 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd920108d10 0x7fd92019ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:16.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.729+0000 7fd92813c640 1 --2- 172.21.15.46:0/153167249 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fd90c0b65f0 0x7fd90c0b8b00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:16.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.729+0000 7fd92813c640 1 --2- 172.21.15.46:0/153167249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9201083c0 0x7fd920199970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:16.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.729+0000 7fd92813c640 1 --2- 172.21.15.46:0/153167249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd920102a80 0x7fd9201993d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:16.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.729+0000 7fd92813c640 1 -- 172.21.15.46:0/153167249 >> 172.21.15.46:0/153167249 conn(0x7fd920079740 msgr2=0x7fd920104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:16.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.729+0000 7fd92813c640 1 -- 172.21.15.46:0/153167249 shutdown_connections 2024-09-21T03:54:16.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:16.729+0000 7fd92813c640 1 -- 172.21.15.46:0/153167249 wait complete. 2024-09-21T03:54:17.034 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182462 got 107374182465 for osd.3 2024-09-21T03:54:17.035 DEBUG:teuthology.parallel:result is None 2024-09-21T03:54:17.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:17 smithi105 ceph-mon[34773]: pgmap v297: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:54:17.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:17 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/153167249' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T03:54:17.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:17 smithi162 ceph-mon[35071]: pgmap v297: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:54:17.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:17 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/153167249' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T03:54:17.695 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:17 smithi046 ceph-mon[30954]: pgmap v297: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:54:17.695 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:17 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/153167249' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T03:54:17.730 INFO:tasks.cephadm.ceph_manager.ceph:need seq 296352743447 got 296352743450 for osd.11 2024-09-21T03:54:17.730 DEBUG:teuthology.parallel:result is None 2024-09-21T03:54:17.730 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T03:54:17.731 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T03:54:18.444 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:18.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.934+0000 7f52f0edc640 1 -- 172.21.15.46:0/393992382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52ec105b90 msgr2=0x7f52ec10f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:18.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.934+0000 7f52f0edc640 1 --2- 172.21.15.46:0/393992382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52ec105b90 0x7f52ec10f5e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f52e4009ca0 tx=0x7f52e402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:54:18.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.934+0000 7f52f0edc640 1 -- 172.21.15.46:0/393992382 shutdown_connections 2024-09-21T03:54:18.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.934+0000 7f52f0edc640 1 --2- 172.21.15.46:0/393992382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52ec105b90 0x7f52ec10f5e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:18.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.934+0000 7f52f0edc640 1 --2- 172.21.15.46:0/393992382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52ec105240 0x7f52ec105650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:18.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.934+0000 7f52f0edc640 1 --2- 172.21.15.46:0/393992382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52ec103270 0x7f52ec103680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:18.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.934+0000 7f52f0edc640 1 -- 172.21.15.46:0/393992382 >> 172.21.15.46:0/393992382 conn(0x7f52ec079ec0 msgr2=0x7f52ec07a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:18.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.934+0000 7f52f0edc640 1 -- 172.21.15.46:0/393992382 shutdown_connections 2024-09-21T03:54:18.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.934+0000 7f52f0edc640 1 -- 172.21.15.46:0/393992382 wait complete. 2024-09-21T03:54:18.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.935+0000 7f52f0edc640 1 Processor -- start 2024-09-21T03:54:18.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.935+0000 7f52f0edc640 1 -- start start 2024-09-21T03:54:18.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.935+0000 7f52f0edc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52ec103270 0x7f52ec1100c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:18.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.935+0000 7f52f0edc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52ec105240 0x7f52ec110600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:18.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.935+0000 7f52f0edc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52ec105b90 0x7f52ec110b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:18.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.935+0000 7f52f0edc640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f52ec113b50 con 0x7f52ec105b90 2024-09-21T03:54:18.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.935+0000 7f52f0edc640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f52ec1139d0 con 0x7f52ec103270 2024-09-21T03:54:18.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.935+0000 7f52f0edc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f52ec113cd0 con 0x7f52ec105240 2024-09-21T03:54:18.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.936+0000 7f52ead9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52ec105b90 0x7f52ec110b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:18.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.936+0000 7f52ead9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52ec105b90 0x7f52ec110b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40994/0 (socket says 172.21.15.46:40994) 2024-09-21T03:54:18.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.936+0000 7f52ead9d640 1 -- 172.21.15.46:0/3418595741 learned_addr learned my addr 172.21.15.46:0/3418595741 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:18.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.936+0000 7f52e9d9b640 1 --2- 172.21.15.46:0/3418595741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52ec105240 0x7f52ec110600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:18.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.936+0000 7f52ea59c640 1 --2- 172.21.15.46:0/3418595741 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52ec103270 0x7f52ec1100c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:18.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.936+0000 7f52ead9d640 1 -- 172.21.15.46:0/3418595741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52ec105240 msgr2=0x7f52ec110600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:18.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.936+0000 7f52ead9d640 1 --2- 172.21.15.46:0/3418595741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52ec105240 0x7f52ec110600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:18.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.936+0000 7f52ead9d640 1 -- 172.21.15.46:0/3418595741 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52ec103270 msgr2=0x7f52ec1100c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:18.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.936+0000 7f52ead9d640 1 --2- 172.21.15.46:0/3418595741 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52ec103270 0x7f52ec1100c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:18.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.936+0000 7f52ead9d640 1 -- 172.21.15.46:0/3418595741 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52ec1a8710 con 0x7f52ec105b90 2024-09-21T03:54:18.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.936+0000 7f52ea59c640 1 --2- 172.21.15.46:0/3418595741 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52ec103270 0x7f52ec1100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:54:18.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.936+0000 7f52e9d9b640 1 --2- 172.21.15.46:0/3418595741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52ec105240 0x7f52ec110600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:54:18.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.936+0000 7f52ead9d640 1 --2- 172.21.15.46:0/3418595741 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52ec105b90 0x7f52ec110b40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f52e4005cc0 tx=0x7f52e402f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:18.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.936+0000 7f52db7fe640 1 -- 172.21.15.46:0/3418595741 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e4003cf0 con 0x7f52ec105b90 2024-09-21T03:54:18.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.936+0000 7f52db7fe640 1 -- 172.21.15.46:0/3418595741 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52e40044f0 con 0x7f52ec105b90 2024-09-21T03:54:18.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.936+0000 7f52db7fe640 1 -- 172.21.15.46:0/3418595741 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e402fd10 con 0x7f52ec105b90 2024-09-21T03:54:18.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.936+0000 7f52f0edc640 1 -- 172.21.15.46:0/3418595741 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52ec1a89a0 con 0x7f52ec105b90 2024-09-21T03:54:18.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.936+0000 7f52f0edc640 1 -- 172.21.15.46:0/3418595741 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52ec1a8f30 con 0x7f52ec105b90 2024-09-21T03:54:18.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.937+0000 7f52f0edc640 1 -- 172.21.15.46:0/3418595741 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52ec103680 con 0x7f52ec105b90 2024-09-21T03:54:18.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.939+0000 7f52db7fe640 1 -- 172.21.15.46:0/3418595741 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f52e4004040 con 0x7f52ec105b90 2024-09-21T03:54:18.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.940+0000 7f52db7fe640 1 --2- 172.21.15.46:0/3418595741 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f52d40b6670 0x7f52d40b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:18.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.940+0000 7f52ea59c640 1 --2- 172.21.15.46:0/3418595741 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f52d40b6670 0x7f52d40b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:18.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.940+0000 7f52db7fe640 1 -- 172.21.15.46:0/3418595741 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f52e4108dd0 con 0x7f52ec105b90 2024-09-21T03:54:18.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.940+0000 7f52ea59c640 1 --2- 172.21.15.46:0/3418595741 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f52d40b6670 0x7f52d40b8b80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f52dc0058c0 tx=0x7f52dc005d50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:18.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:18.943+0000 7f52db7fe640 1 -- 172.21.15.46:0/3418595741 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f52e40cf480 con 0x7f52ec105b90 2024-09-21T03:54:19.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:19.145+0000 7f52f0edc640 1 -- 172.21.15.46:0/3418595741 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f52ec063800 con 0x7f52d40b6670 2024-09-21T03:54:19.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:19.150+0000 7f52db7fe640 1 -- 172.21.15.46:0/3418595741 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258883 (secure 0 0 0) 0x7f52ec063800 con 0x7f52d40b6670 2024-09-21T03:54:19.154 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:54:19.155 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-09-21T03:54:19.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:19.153+0000 7f52f0edc640 1 -- 172.21.15.46:0/3418595741 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f52d40b6670 msgr2=0x7f52d40b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:19.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:19.153+0000 7f52f0edc640 1 --2- 172.21.15.46:0/3418595741 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f52d40b6670 0x7f52d40b8b80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f52dc0058c0 tx=0x7f52dc005d50 comp rx=0 tx=0).stop 2024-09-21T03:54:19.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:19.153+0000 7f52f0edc640 1 -- 172.21.15.46:0/3418595741 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52ec105b90 msgr2=0x7f52ec110b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:19.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:19.153+0000 7f52f0edc640 1 --2- 172.21.15.46:0/3418595741 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52ec105b90 0x7f52ec110b40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f52e4005cc0 tx=0x7f52e402f470 comp rx=0 tx=0).stop 2024-09-21T03:54:19.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:19.153+0000 7f52f0edc640 1 -- 172.21.15.46:0/3418595741 shutdown_connections 2024-09-21T03:54:19.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:19.153+0000 7f52f0edc640 1 --2- 172.21.15.46:0/3418595741 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52ec105b90 0x7f52ec110b40 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:19.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:19.153+0000 7f52f0edc640 1 --2- 172.21.15.46:0/3418595741 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f52d40b6670 0x7f52d40b8b80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:19.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:19.153+0000 7f52f0edc640 1 --2- 172.21.15.46:0/3418595741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52ec105240 0x7f52ec110600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:19.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:19.153+0000 7f52f0edc640 1 --2- 172.21.15.46:0/3418595741 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52ec103270 0x7f52ec1100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:19.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:19.153+0000 7f52f0edc640 1 -- 172.21.15.46:0/3418595741 >> 172.21.15.46:0/3418595741 conn(0x7f52ec079ec0 msgr2=0x7f52ec1064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:19.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:19.153+0000 7f52f0edc640 1 -- 172.21.15.46:0/3418595741 shutdown_connections 2024-09-21T03:54:19.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:19.153+0000 7f52f0edc640 1 -- 172.21.15.46:0/3418595741 wait complete. 2024-09-21T03:54:19.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:19 smithi046 ceph-mon[30954]: pgmap v298: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:54:19.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:19 smithi105 ceph-mon[34773]: pgmap v298: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:54:19.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:19 smithi162 ceph-mon[35071]: pgmap v298: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:54:19.915 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":298,"stamp":"2024-09-21T03:54:18.048812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658357,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":208,"num_read_kb":200,"num_write":210,"num_write_kb":2246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":380292,"kb_used_data":10200,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124561532,"statfs":{"total":1151940427776,"available":1151551008768,"internally_reserved":0,"allocated":10444800,"data_stored":6973995,"data_compressed":177972,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":15,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003393"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034971+0000","last_change":"2024-09-21T03:53:13.835177+0000","last_active":"2024-09-21T03:53:33.034971+0000","last_peered":"2024-09-21T03:53:33.034971+0000","last_clean":"2024-09-21T03:53:33.034971+0000","last_became_active":"2024-09-21T03:53:13.834779+0000","last_became_peered":"2024-09-21T03:53:13.834779+0000","last_unstale":"2024-09-21T03:53:33.034971+0000","last_undegraded":"2024-09-21T03:53:33.034971+0000","last_fullsized":"2024-09-21T03:53:33.034971+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:10.632059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123205+0000","last_change":"2024-09-21T03:53:13.829689+0000","last_active":"2024-09-21T03:53:33.123205+0000","last_peered":"2024-09-21T03:53:33.123205+0000","last_clean":"2024-09-21T03:53:33.123205+0000","last_became_active":"2024-09-21T03:53:13.828732+0000","last_became_peered":"2024-09-21T03:53:13.828732+0000","last_unstale":"2024-09-21T03:53:33.123205+0000","last_undegraded":"2024-09-21T03:53:33.123205+0000","last_fullsized":"2024-09-21T03:53:33.123205+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:35.270218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123057+0000","last_change":"2024-09-21T03:53:13.836545+0000","last_active":"2024-09-21T03:53:33.123057+0000","last_peered":"2024-09-21T03:53:33.123057+0000","last_clean":"2024-09-21T03:53:33.123057+0000","last_became_active":"2024-09-21T03:53:13.835781+0000","last_became_peered":"2024-09-21T03:53:13.835781+0000","last_unstale":"2024-09-21T03:53:33.123057+0000","last_undegraded":"2024-09-21T03:53:33.123057+0000","last_fullsized":"2024-09-21T03:53:33.123057+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:13.130016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123786+0000","last_change":"2024-09-21T03:53:13.832292+0000","last_active":"2024-09-21T03:53:33.123786+0000","last_peered":"2024-09-21T03:53:33.123786+0000","last_clean":"2024-09-21T03:53:33.123786+0000","last_became_active":"2024-09-21T03:53:13.831311+0000","last_became_peered":"2024-09-21T03:53:13.831311+0000","last_unstale":"2024-09-21T03:53:33.123786+0000","last_undegraded":"2024-09-21T03:53:33.123786+0000","last_fullsized":"2024-09-21T03:53:33.123786+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:38:49.425261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123152+0000","last_change":"2024-09-21T03:53:13.825130+0000","last_active":"2024-09-21T03:53:33.123152+0000","last_peered":"2024-09-21T03:53:33.123152+0000","last_clean":"2024-09-21T03:53:33.123152+0000","last_became_active":"2024-09-21T03:53:13.824795+0000","last_became_peered":"2024-09-21T03:53:13.824795+0000","last_unstale":"2024-09-21T03:53:33.123152+0000","last_undegraded":"2024-09-21T03:53:33.123152+0000","last_fullsized":"2024-09-21T03:53:33.123152+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:22.653270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123230+0000","last_change":"2024-09-21T03:53:13.834449+0000","last_active":"2024-09-21T03:53:33.123230+0000","last_peered":"2024-09-21T03:53:33.123230+0000","last_clean":"2024-09-21T03:53:33.123230+0000","last_became_active":"2024-09-21T03:53:13.832727+0000","last_became_peered":"2024-09-21T03:53:13.832727+0000","last_unstale":"2024-09-21T03:53:33.123230+0000","last_undegraded":"2024-09-21T03:53:33.123230+0000","last_fullsized":"2024-09-21T03:53:33.123230+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:36.479962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035845+0000","last_change":"2024-09-21T03:53:13.821938+0000","last_active":"2024-09-21T03:53:33.035845+0000","last_peered":"2024-09-21T03:53:33.035845+0000","last_clean":"2024-09-21T03:53:33.035845+0000","last_became_active":"2024-09-21T03:53:13.821569+0000","last_became_peered":"2024-09-21T03:53:13.821569+0000","last_unstale":"2024-09-21T03:53:33.035845+0000","last_undegraded":"2024-09-21T03:53:33.035845+0000","last_fullsized":"2024-09-21T03:53:33.035845+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:04.309212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122491+0000","last_change":"2024-09-21T03:53:13.833471+0000","last_active":"2024-09-21T03:53:33.122491+0000","last_peered":"2024-09-21T03:53:33.122491+0000","last_clean":"2024-09-21T03:53:33.122491+0000","last_became_active":"2024-09-21T03:53:13.832779+0000","last_became_peered":"2024-09-21T03:53:13.832779+0000","last_unstale":"2024-09-21T03:53:33.122491+0000","last_undegraded":"2024-09-21T03:53:33.122491+0000","last_fullsized":"2024-09-21T03:53:33.122491+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:15.402265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032934+0000","last_change":"2024-09-21T03:53:13.833077+0000","last_active":"2024-09-21T03:53:33.032934+0000","last_peered":"2024-09-21T03:53:33.032934+0000","last_clean":"2024-09-21T03:53:33.032934+0000","last_became_active":"2024-09-21T03:53:13.832625+0000","last_became_peered":"2024-09-21T03:53:13.832625+0000","last_unstale":"2024-09-21T03:53:33.032934+0000","last_undegraded":"2024-09-21T03:53:33.032934+0000","last_fullsized":"2024-09-21T03:53:33.032934+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:13.158754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124857+0000","last_change":"2024-09-21T03:53:13.835417+0000","last_active":"2024-09-21T03:53:33.124857+0000","last_peered":"2024-09-21T03:53:33.124857+0000","last_clean":"2024-09-21T03:53:33.124857+0000","last_became_active":"2024-09-21T03:53:13.835081+0000","last_became_peered":"2024-09-21T03:53:13.835081+0000","last_unstale":"2024-09-21T03:53:33.124857+0000","last_undegraded":"2024-09-21T03:53:33.124857+0000","last_fullsized":"2024-09-21T03:53:33.124857+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:29.239879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036187+0000","last_change":"2024-09-21T03:53:13.836575+0000","last_active":"2024-09-21T03:53:33.036187+0000","last_peered":"2024-09-21T03:53:33.036187+0000","last_clean":"2024-09-21T03:53:33.036187+0000","last_became_active":"2024-09-21T03:53:13.836184+0000","last_became_peered":"2024-09-21T03:53:13.836184+0000","last_unstale":"2024-09-21T03:53:33.036187+0000","last_undegraded":"2024-09-21T03:53:33.036187+0000","last_fullsized":"2024-09-21T03:53:33.036187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:06.602354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.126314+0000","last_change":"2024-09-21T03:53:33.125896+0000","last_active":"2024-09-21T03:53:33.126314+0000","last_peered":"2024-09-21T03:53:33.126314+0000","last_clean":"2024-09-21T03:53:33.126314+0000","last_became_active":"2024-09-21T03:53:33.125488+0000","last_became_peered":"2024-09-21T03:53:33.125488+0000","last_unstale":"2024-09-21T03:53:33.126314+0000","last_undegraded":"2024-09-21T03:53:33.126314+0000","last_fullsized":"2024-09-21T03:53:33.126314+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:09.742892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031708+0000","last_change":"2024-09-21T03:53:13.814729+0000","last_active":"2024-09-21T03:53:33.031708+0000","last_peered":"2024-09-21T03:53:33.031708+0000","last_clean":"2024-09-21T03:53:33.031708+0000","last_became_active":"2024-09-21T03:53:13.814317+0000","last_became_peered":"2024-09-21T03:53:13.814317+0000","last_unstale":"2024-09-21T03:53:33.031708+0000","last_undegraded":"2024-09-21T03:53:33.031708+0000","last_fullsized":"2024-09-21T03:53:33.031708+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:30.779754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122847+0000","last_change":"2024-09-21T03:53:13.833280+0000","last_active":"2024-09-21T03:53:33.122847+0000","last_peered":"2024-09-21T03:53:33.122847+0000","last_clean":"2024-09-21T03:53:33.122847+0000","last_became_active":"2024-09-21T03:53:13.831799+0000","last_became_peered":"2024-09-21T03:53:13.831799+0000","last_unstale":"2024-09-21T03:53:33.122847+0000","last_undegraded":"2024-09-21T03:53:33.122847+0000","last_fullsized":"2024-09-21T03:53:33.122847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:33.923946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122733+0000","last_change":"2024-09-21T03:53:13.832142+0000","last_active":"2024-09-21T03:53:33.122733+0000","last_peered":"2024-09-21T03:53:33.122733+0000","last_clean":"2024-09-21T03:53:33.122733+0000","last_became_active":"2024-09-21T03:53:13.831756+0000","last_became_peered":"2024-09-21T03:53:13.831756+0000","last_unstale":"2024-09-21T03:53:33.122733+0000","last_undegraded":"2024-09-21T03:53:33.122733+0000","last_fullsized":"2024-09-21T03:53:33.122733+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:43.941161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032362+0000","last_change":"2024-09-21T03:53:13.834085+0000","last_active":"2024-09-21T03:53:33.032362+0000","last_peered":"2024-09-21T03:53:33.032362+0000","last_clean":"2024-09-21T03:53:33.032362+0000","last_became_active":"2024-09-21T03:53:13.833668+0000","last_became_peered":"2024-09-21T03:53:13.833668+0000","last_unstale":"2024-09-21T03:53:33.032362+0000","last_undegraded":"2024-09-21T03:53:33.032362+0000","last_fullsized":"2024-09-21T03:53:33.032362+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:08:26.939873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035098+0000","last_change":"2024-09-21T03:53:13.836133+0000","last_active":"2024-09-21T03:53:33.035098+0000","last_peered":"2024-09-21T03:53:33.035098+0000","last_clean":"2024-09-21T03:53:33.035098+0000","last_became_active":"2024-09-21T03:53:13.835681+0000","last_became_peered":"2024-09-21T03:53:13.835681+0000","last_unstale":"2024-09-21T03:53:33.035098+0000","last_undegraded":"2024-09-21T03:53:33.035098+0000","last_fullsized":"2024-09-21T03:53:33.035098+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:02.691622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035103+0000","last_change":"2024-09-21T03:53:13.834069+0000","last_active":"2024-09-21T03:53:33.035103+0000","last_peered":"2024-09-21T03:53:33.035103+0000","last_clean":"2024-09-21T03:53:33.035103+0000","last_became_active":"2024-09-21T03:53:13.833714+0000","last_became_peered":"2024-09-21T03:53:13.833714+0000","last_unstale":"2024-09-21T03:53:33.035103+0000","last_undegraded":"2024-09-21T03:53:33.035103+0000","last_fullsized":"2024-09-21T03:53:33.035103+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:12.479790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.095236+0000","last_change":"2024-09-21T03:53:13.827788+0000","last_active":"2024-09-21T03:53:33.095236+0000","last_peered":"2024-09-21T03:53:33.095236+0000","last_clean":"2024-09-21T03:53:33.095236+0000","last_became_active":"2024-09-21T03:53:13.827461+0000","last_became_peered":"2024-09-21T03:53:13.827461+0000","last_unstale":"2024-09-21T03:53:33.095236+0000","last_undegraded":"2024-09-21T03:53:33.095236+0000","last_fullsized":"2024-09-21T03:53:33.095236+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:38.003243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034635+0000","last_change":"2024-09-21T03:53:13.836880+0000","last_active":"2024-09-21T03:53:33.034635+0000","last_peered":"2024-09-21T03:53:33.034635+0000","last_clean":"2024-09-21T03:53:33.034635+0000","last_became_active":"2024-09-21T03:53:13.836531+0000","last_became_peered":"2024-09-21T03:53:13.836531+0000","last_unstale":"2024-09-21T03:53:33.034635+0000","last_undegraded":"2024-09-21T03:53:33.034635+0000","last_fullsized":"2024-09-21T03:53:33.034635+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:52.825826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031827+0000","last_change":"2024-09-21T03:53:13.823160+0000","last_active":"2024-09-21T03:53:33.031827+0000","last_peered":"2024-09-21T03:53:33.031827+0000","last_clean":"2024-09-21T03:53:33.031827+0000","last_became_active":"2024-09-21T03:53:13.822076+0000","last_became_peered":"2024-09-21T03:53:13.822076+0000","last_unstale":"2024-09-21T03:53:33.031827+0000","last_undegraded":"2024-09-21T03:53:33.031827+0000","last_fullsized":"2024-09-21T03:53:33.031827+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:26.277249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032827+0000","last_change":"2024-09-21T03:53:13.831822+0000","last_active":"2024-09-21T03:53:33.032827+0000","last_peered":"2024-09-21T03:53:33.032827+0000","last_clean":"2024-09-21T03:53:33.032827+0000","last_became_active":"2024-09-21T03:53:13.831395+0000","last_became_peered":"2024-09-21T03:53:13.831395+0000","last_unstale":"2024-09-21T03:53:33.032827+0000","last_undegraded":"2024-09-21T03:53:33.032827+0000","last_fullsized":"2024-09-21T03:53:33.032827+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:48.541339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122588+0000","last_change":"2024-09-21T03:53:13.834576+0000","last_active":"2024-09-21T03:53:33.122588+0000","last_peered":"2024-09-21T03:53:33.122588+0000","last_clean":"2024-09-21T03:53:33.122588+0000","last_became_active":"2024-09-21T03:53:13.834229+0000","last_became_peered":"2024-09-21T03:53:13.834229+0000","last_unstale":"2024-09-21T03:53:33.122588+0000","last_undegraded":"2024-09-21T03:53:33.122588+0000","last_fullsized":"2024-09-21T03:53:33.122588+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:36.101399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040298+0000","last_change":"2024-09-21T03:53:13.824049+0000","last_active":"2024-09-21T03:53:33.040298+0000","last_peered":"2024-09-21T03:53:33.040298+0000","last_clean":"2024-09-21T03:53:33.040298+0000","last_became_active":"2024-09-21T03:53:13.823510+0000","last_became_peered":"2024-09-21T03:53:13.823510+0000","last_unstale":"2024-09-21T03:53:33.040298+0000","last_undegraded":"2024-09-21T03:53:33.040298+0000","last_fullsized":"2024-09-21T03:53:33.040298+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:36.615951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123804+0000","last_change":"2024-09-21T03:53:13.837327+0000","last_active":"2024-09-21T03:53:33.123804+0000","last_peered":"2024-09-21T03:53:33.123804+0000","last_clean":"2024-09-21T03:53:33.123804+0000","last_became_active":"2024-09-21T03:53:13.836940+0000","last_became_peered":"2024-09-21T03:53:13.836940+0000","last_unstale":"2024-09-21T03:53:33.123804+0000","last_undegraded":"2024-09-21T03:53:33.123804+0000","last_fullsized":"2024-09-21T03:53:33.123804+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:49.248838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.095260+0000","last_change":"2024-09-21T03:53:13.829540+0000","last_active":"2024-09-21T03:53:33.095260+0000","last_peered":"2024-09-21T03:53:33.095260+0000","last_clean":"2024-09-21T03:53:33.095260+0000","last_became_active":"2024-09-21T03:53:13.828953+0000","last_became_peered":"2024-09-21T03:53:13.828953+0000","last_unstale":"2024-09-21T03:53:33.095260+0000","last_undegraded":"2024-09-21T03:53:33.095260+0000","last_fullsized":"2024-09-21T03:53:33.095260+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:07.631226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034762+0000","last_change":"2024-09-21T03:53:13.835009+0000","last_active":"2024-09-21T03:53:33.034762+0000","last_peered":"2024-09-21T03:53:33.034762+0000","last_clean":"2024-09-21T03:53:33.034762+0000","last_became_active":"2024-09-21T03:53:13.834454+0000","last_became_peered":"2024-09-21T03:53:13.834454+0000","last_unstale":"2024-09-21T03:53:33.034762+0000","last_undegraded":"2024-09-21T03:53:33.034762+0000","last_fullsized":"2024-09-21T03:53:33.034762+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:34:06.114394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031624+0000","last_change":"2024-09-21T03:53:13.826846+0000","last_active":"2024-09-21T03:53:33.031624+0000","last_peered":"2024-09-21T03:53:33.031624+0000","last_clean":"2024-09-21T03:53:33.031624+0000","last_became_active":"2024-09-21T03:53:13.826460+0000","last_became_peered":"2024-09-21T03:53:13.826460+0000","last_unstale":"2024-09-21T03:53:33.031624+0000","last_undegraded":"2024-09-21T03:53:33.031624+0000","last_fullsized":"2024-09-21T03:53:33.031624+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:24.081091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123429+0000","last_change":"2024-09-21T03:53:13.837134+0000","last_active":"2024-09-21T03:53:33.123429+0000","last_peered":"2024-09-21T03:53:33.123429+0000","last_clean":"2024-09-21T03:53:33.123429+0000","last_became_active":"2024-09-21T03:53:13.836729+0000","last_became_peered":"2024-09-21T03:53:13.836729+0000","last_unstale":"2024-09-21T03:53:33.123429+0000","last_undegraded":"2024-09-21T03:53:33.123429+0000","last_fullsized":"2024-09-21T03:53:33.123429+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:08.677375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.094680+0000","last_change":"2024-09-21T03:53:13.838100+0000","last_active":"2024-09-21T03:53:33.094680+0000","last_peered":"2024-09-21T03:53:33.094680+0000","last_clean":"2024-09-21T03:53:33.094680+0000","last_became_active":"2024-09-21T03:53:13.833495+0000","last_became_peered":"2024-09-21T03:53:13.833495+0000","last_unstale":"2024-09-21T03:53:33.094680+0000","last_undegraded":"2024-09-21T03:53:33.094680+0000","last_fullsized":"2024-09-21T03:53:33.094680+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:52:00.705434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.095021+0000","last_change":"2024-09-21T03:53:13.835806+0000","last_active":"2024-09-21T03:53:33.095021+0000","last_peered":"2024-09-21T03:53:33.095021+0000","last_clean":"2024-09-21T03:53:33.095021+0000","last_became_active":"2024-09-21T03:53:13.835453+0000","last_became_peered":"2024-09-21T03:53:13.835453+0000","last_unstale":"2024-09-21T03:53:33.095021+0000","last_undegraded":"2024-09-21T03:53:33.095021+0000","last_fullsized":"2024-09-21T03:53:33.095021+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:56:16.296808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034530+0000","last_change":"2024-09-21T03:53:13.831171+0000","last_active":"2024-09-21T03:53:33.034530+0000","last_peered":"2024-09-21T03:53:33.034530+0000","last_clean":"2024-09-21T03:53:33.034530+0000","last_became_active":"2024-09-21T03:53:13.830734+0000","last_became_peered":"2024-09-21T03:53:13.830734+0000","last_unstale":"2024-09-21T03:53:33.034530+0000","last_undegraded":"2024-09-21T03:53:33.034530+0000","last_fullsized":"2024-09-21T03:53:33.034530+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:00:56.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123100+0000","last_change":"2024-09-21T03:53:13.820580+0000","last_active":"2024-09-21T03:53:33.123100+0000","last_peered":"2024-09-21T03:53:33.123100+0000","last_clean":"2024-09-21T03:53:33.123100+0000","last_became_active":"2024-09-21T03:53:13.820237+0000","last_became_peered":"2024-09-21T03:53:13.820237+0000","last_unstale":"2024-09-21T03:53:33.123100+0000","last_undegraded":"2024-09-21T03:53:33.123100+0000","last_fullsized":"2024-09-21T03:53:33.123100+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:15.067629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040549+0000","last_change":"2024-09-21T03:53:11.804667+0000","last_active":"2024-09-21T03:53:33.040549+0000","last_peered":"2024-09-21T03:53:33.040549+0000","last_clean":"2024-09-21T03:53:33.040549+0000","last_became_active":"2024-09-21T03:53:11.804231+0000","last_became_peered":"2024-09-21T03:53:11.804231+0000","last_unstale":"2024-09-21T03:53:33.040549+0000","last_undegraded":"2024-09-21T03:53:33.040549+0000","last_fullsized":"2024-09-21T03:53:33.040549+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:36.425699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040361+0000","last_change":"2024-09-21T03:53:13.831602+0000","last_active":"2024-09-21T03:53:33.040361+0000","last_peered":"2024-09-21T03:53:33.040361+0000","last_clean":"2024-09-21T03:53:33.040361+0000","last_became_active":"2024-09-21T03:53:13.831274+0000","last_became_peered":"2024-09-21T03:53:13.831274+0000","last_unstale":"2024-09-21T03:53:33.040361+0000","last_undegraded":"2024-09-21T03:53:33.040361+0000","last_fullsized":"2024-09-21T03:53:33.040361+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:33.603025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123276+0000","last_change":"2024-09-21T03:53:11.807722+0000","last_active":"2024-09-21T03:53:33.123276+0000","last_peered":"2024-09-21T03:53:33.123276+0000","last_clean":"2024-09-21T03:53:33.123276+0000","last_became_active":"2024-09-21T03:53:11.807294+0000","last_became_peered":"2024-09-21T03:53:11.807294+0000","last_unstale":"2024-09-21T03:53:33.123276+0000","last_undegraded":"2024-09-21T03:53:33.123276+0000","last_fullsized":"2024-09-21T03:53:33.123276+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:59.696572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031405+0000","last_change":"2024-09-21T03:53:11.803680+0000","last_active":"2024-09-21T03:53:33.031405+0000","last_peered":"2024-09-21T03:53:33.031405+0000","last_clean":"2024-09-21T03:53:33.031405+0000","last_became_active":"2024-09-21T03:53:11.803310+0000","last_became_peered":"2024-09-21T03:53:11.803310+0000","last_unstale":"2024-09-21T03:53:33.031405+0000","last_undegraded":"2024-09-21T03:53:33.031405+0000","last_fullsized":"2024-09-21T03:53:33.031405+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:25.276545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122501+0000","last_change":"2024-09-21T03:53:13.834847+0000","last_active":"2024-09-21T03:53:33.122501+0000","last_peered":"2024-09-21T03:53:33.122501+0000","last_clean":"2024-09-21T03:53:33.122501+0000","last_became_active":"2024-09-21T03:53:13.834448+0000","last_became_peered":"2024-09-21T03:53:13.834448+0000","last_unstale":"2024-09-21T03:53:33.122501+0000","last_undegraded":"2024-09-21T03:53:33.122501+0000","last_fullsized":"2024-09-21T03:53:33.122501+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:47:39.213364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040606+0000","last_change":"2024-09-21T03:53:11.807372+0000","last_active":"2024-09-21T03:53:33.040606+0000","last_peered":"2024-09-21T03:53:33.040606+0000","last_clean":"2024-09-21T03:53:33.040606+0000","last_became_active":"2024-09-21T03:53:11.807064+0000","last_became_peered":"2024-09-21T03:53:11.807064+0000","last_unstale":"2024-09-21T03:53:33.040606+0000","last_undegraded":"2024-09-21T03:53:33.040606+0000","last_fullsized":"2024-09-21T03:53:33.040606+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:00.743039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034954+0000","last_change":"2024-09-21T03:53:13.821169+0000","last_active":"2024-09-21T03:53:33.034954+0000","last_peered":"2024-09-21T03:53:33.034954+0000","last_clean":"2024-09-21T03:53:33.034954+0000","last_became_active":"2024-09-21T03:53:13.820810+0000","last_became_peered":"2024-09-21T03:53:13.820810+0000","last_unstale":"2024-09-21T03:53:33.034954+0000","last_undegraded":"2024-09-21T03:53:33.034954+0000","last_fullsized":"2024-09-21T03:53:33.034954+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:54.568383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124708+0000","last_change":"2024-09-21T03:53:11.805663+0000","last_active":"2024-09-21T03:53:33.124708+0000","last_peered":"2024-09-21T03:53:33.124708+0000","last_clean":"2024-09-21T03:53:33.124708+0000","last_became_active":"2024-09-21T03:53:11.805099+0000","last_became_peered":"2024-09-21T03:53:11.805099+0000","last_unstale":"2024-09-21T03:53:33.124708+0000","last_undegraded":"2024-09-21T03:53:33.124708+0000","last_fullsized":"2024-09-21T03:53:33.124708+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:47.306589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032728+0000","last_change":"2024-09-21T03:53:13.827745+0000","last_active":"2024-09-21T03:53:33.032728+0000","last_peered":"2024-09-21T03:53:33.032728+0000","last_clean":"2024-09-21T03:53:33.032728+0000","last_became_active":"2024-09-21T03:53:13.827229+0000","last_became_peered":"2024-09-21T03:53:13.827229+0000","last_unstale":"2024-09-21T03:53:33.032728+0000","last_undegraded":"2024-09-21T03:53:33.032728+0000","last_fullsized":"2024-09-21T03:53:33.032728+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:53.760919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036288+0000","last_change":"2024-09-21T03:53:11.803697+0000","last_active":"2024-09-21T03:53:33.036288+0000","last_peered":"2024-09-21T03:53:33.036288+0000","last_clean":"2024-09-21T03:53:33.036288+0000","last_became_active":"2024-09-21T03:53:11.801539+0000","last_became_peered":"2024-09-21T03:53:11.801539+0000","last_unstale":"2024-09-21T03:53:33.036288+0000","last_undegraded":"2024-09-21T03:53:33.036288+0000","last_fullsized":"2024-09-21T03:53:33.036288+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:53.096622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123637+0000","last_change":"2024-09-21T03:53:13.832771+0000","last_active":"2024-09-21T03:53:33.123637+0000","last_peered":"2024-09-21T03:53:33.123637+0000","last_clean":"2024-09-21T03:53:33.123637+0000","last_became_active":"2024-09-21T03:53:13.832414+0000","last_became_peered":"2024-09-21T03:53:13.832414+0000","last_unstale":"2024-09-21T03:53:33.123637+0000","last_undegraded":"2024-09-21T03:53:33.123637+0000","last_fullsized":"2024-09-21T03:53:33.123637+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:58:42.287731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.041017+0000","last_change":"2024-09-21T03:53:12.604482+0000","last_active":"2024-09-21T03:53:33.041017+0000","last_peered":"2024-09-21T03:53:33.041017+0000","last_clean":"2024-09-21T03:53:33.041017+0000","last_became_active":"2024-09-21T03:53:12.603973+0000","last_became_peered":"2024-09-21T03:53:12.603973+0000","last_unstale":"2024-09-21T03:53:33.041017+0000","last_undegraded":"2024-09-21T03:53:33.041017+0000","last_fullsized":"2024-09-21T03:53:33.041017+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:11.932329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032506+0000","last_change":"2024-09-21T03:53:13.842106+0000","last_active":"2024-09-21T03:53:33.032506+0000","last_peered":"2024-09-21T03:53:33.032506+0000","last_clean":"2024-09-21T03:53:33.032506+0000","last_became_active":"2024-09-21T03:53:13.841758+0000","last_became_peered":"2024-09-21T03:53:13.841758+0000","last_unstale":"2024-09-21T03:53:33.032506+0000","last_undegraded":"2024-09-21T03:53:33.032506+0000","last_fullsized":"2024-09-21T03:53:33.032506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:37.045045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'28","reported_seq":172,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:54:16.974280+0000","last_change":"2024-09-21T03:53:11.805385+0000","last_active":"2024-09-21T03:54:16.974280+0000","last_peered":"2024-09-21T03:54:16.974280+0000","last_clean":"2024-09-21T03:54:16.974280+0000","last_became_active":"2024-09-21T03:53:11.804958+0000","last_became_peered":"2024-09-21T03:53:11.804958+0000","last_unstale":"2024-09-21T03:54:16.974280+0000","last_undegraded":"2024-09-21T03:54:16.974280+0000","last_fullsized":"2024-09-21T03:54:16.974280+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:59.197216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66957,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":121,"num_read_kb":125,"num_write":28,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123691+0000","last_change":"2024-09-21T03:53:13.828095+0000","last_active":"2024-09-21T03:53:33.123691+0000","last_peered":"2024-09-21T03:53:33.123691+0000","last_clean":"2024-09-21T03:53:33.123691+0000","last_became_active":"2024-09-21T03:53:13.827761+0000","last_became_peered":"2024-09-21T03:53:13.827761+0000","last_unstale":"2024-09-21T03:53:33.123691+0000","last_undegraded":"2024-09-21T03:53:33.123691+0000","last_fullsized":"2024-09-21T03:53:33.123691+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:42:28.981463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.094939+0000","last_change":"2024-09-21T03:53:11.801611+0000","last_active":"2024-09-21T03:53:33.094939+0000","last_peered":"2024-09-21T03:53:33.094939+0000","last_clean":"2024-09-21T03:53:33.094939+0000","last_became_active":"2024-09-21T03:53:11.801185+0000","last_became_peered":"2024-09-21T03:53:11.801185+0000","last_unstale":"2024-09-21T03:53:33.094939+0000","last_undegraded":"2024-09-21T03:53:33.094939+0000","last_fullsized":"2024-09-21T03:53:33.094939+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:16.990963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031447+0000","last_change":"2024-09-21T03:53:13.827393+0000","last_active":"2024-09-21T03:53:33.031447+0000","last_peered":"2024-09-21T03:53:33.031447+0000","last_clean":"2024-09-21T03:53:33.031447+0000","last_became_active":"2024-09-21T03:53:13.826912+0000","last_became_peered":"2024-09-21T03:53:13.826912+0000","last_unstale":"2024-09-21T03:53:33.031447+0000","last_undegraded":"2024-09-21T03:53:33.031447+0000","last_fullsized":"2024-09-21T03:53:33.031447+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:52.313989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040555+0000","last_change":"2024-09-21T03:53:11.805437+0000","last_active":"2024-09-21T03:53:33.040555+0000","last_peered":"2024-09-21T03:53:33.040555+0000","last_clean":"2024-09-21T03:53:33.040555+0000","last_became_active":"2024-09-21T03:53:11.805048+0000","last_became_peered":"2024-09-21T03:53:11.805048+0000","last_unstale":"2024-09-21T03:53:33.040555+0000","last_undegraded":"2024-09-21T03:53:33.040555+0000","last_fullsized":"2024-09-21T03:53:33.040555+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:03.288694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036034+0000","last_change":"2024-09-21T03:53:13.836917+0000","last_active":"2024-09-21T03:53:33.036034+0000","last_peered":"2024-09-21T03:53:33.036034+0000","last_clean":"2024-09-21T03:53:33.036034+0000","last_became_active":"2024-09-21T03:53:13.836514+0000","last_became_peered":"2024-09-21T03:53:13.836514+0000","last_unstale":"2024-09-21T03:53:33.036034+0000","last_undegraded":"2024-09-21T03:53:33.036034+0000","last_fullsized":"2024-09-21T03:53:33.036034+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:17.512017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123559+0000","last_change":"2024-09-21T03:53:11.808403+0000","last_active":"2024-09-21T03:53:33.123559+0000","last_peered":"2024-09-21T03:53:33.123559+0000","last_clean":"2024-09-21T03:53:33.123559+0000","last_became_active":"2024-09-21T03:53:11.807895+0000","last_became_peered":"2024-09-21T03:53:11.807895+0000","last_unstale":"2024-09-21T03:53:33.123559+0000","last_undegraded":"2024-09-21T03:53:33.123559+0000","last_fullsized":"2024-09-21T03:53:33.123559+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:33.548683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.125777+0000","last_change":"2024-09-21T03:53:33.125556+0000","last_active":"2024-09-21T03:53:33.125777+0000","last_peered":"2024-09-21T03:53:33.125777+0000","last_clean":"2024-09-21T03:53:33.125777+0000","last_became_active":"2024-09-21T03:53:33.125084+0000","last_became_peered":"2024-09-21T03:53:33.125084+0000","last_unstale":"2024-09-21T03:53:33.125777+0000","last_undegraded":"2024-09-21T03:53:33.125777+0000","last_fullsized":"2024-09-21T03:53:33.125777+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:40:23.997329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'8","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123320+0000","last_change":"2024-09-21T03:53:12.605672+0000","last_active":"2024-09-21T03:53:33.123320+0000","last_peered":"2024-09-21T03:53:33.123320+0000","last_clean":"2024-09-21T03:53:33.123320+0000","last_became_active":"2024-09-21T03:53:12.604644+0000","last_became_peered":"2024-09-21T03:53:12.604644+0000","last_unstale":"2024-09-21T03:53:33.123320+0000","last_undegraded":"2024-09-21T03:53:33.123320+0000","last_fullsized":"2024-09-21T03:53:33.123320+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:44.810762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040395+0000","last_change":"2024-09-21T03:53:13.833861+0000","last_active":"2024-09-21T03:53:33.040395+0000","last_peered":"2024-09-21T03:53:33.040395+0000","last_clean":"2024-09-21T03:53:33.040395+0000","last_became_active":"2024-09-21T03:53:13.832900+0000","last_became_peered":"2024-09-21T03:53:13.832900+0000","last_unstale":"2024-09-21T03:53:33.040395+0000","last_undegraded":"2024-09-21T03:53:33.040395+0000","last_fullsized":"2024-09-21T03:53:33.040395+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:12.047171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124020+0000","last_change":"2024-09-21T03:53:11.799844+0000","last_active":"2024-09-21T03:53:33.124020+0000","last_peered":"2024-09-21T03:53:33.124020+0000","last_clean":"2024-09-21T03:53:33.124020+0000","last_became_active":"2024-09-21T03:53:11.799412+0000","last_became_peered":"2024-09-21T03:53:11.799412+0000","last_unstale":"2024-09-21T03:53:33.124020+0000","last_undegraded":"2024-09-21T03:53:33.124020+0000","last_fullsized":"2024-09-21T03:53:33.124020+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:49.826500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034751+0000","last_change":"2024-09-21T03:53:13.836690+0000","last_active":"2024-09-21T03:53:33.034751+0000","last_peered":"2024-09-21T03:53:33.034751+0000","last_clean":"2024-09-21T03:53:33.034751+0000","last_became_active":"2024-09-21T03:53:13.836337+0000","last_became_peered":"2024-09-21T03:53:13.836337+0000","last_unstale":"2024-09-21T03:53:33.034751+0000","last_undegraded":"2024-09-21T03:53:33.034751+0000","last_fullsized":"2024-09-21T03:53:33.034751+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:15.999869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031625+0000","last_change":"2024-09-21T03:53:11.799597+0000","last_active":"2024-09-21T03:53:33.031625+0000","last_peered":"2024-09-21T03:53:33.031625+0000","last_clean":"2024-09-21T03:53:33.031625+0000","last_became_active":"2024-09-21T03:53:11.799175+0000","last_became_peered":"2024-09-21T03:53:11.799175+0000","last_unstale":"2024-09-21T03:53:33.031625+0000","last_undegraded":"2024-09-21T03:53:33.031625+0000","last_fullsized":"2024-09-21T03:53:33.031625+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:41.668587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036592+0000","last_change":"2024-09-21T03:53:13.831228+0000","last_active":"2024-09-21T03:53:33.036592+0000","last_peered":"2024-09-21T03:53:33.036592+0000","last_clean":"2024-09-21T03:53:33.036592+0000","last_became_active":"2024-09-21T03:53:13.830880+0000","last_became_peered":"2024-09-21T03:53:13.830880+0000","last_unstale":"2024-09-21T03:53:33.036592+0000","last_undegraded":"2024-09-21T03:53:33.036592+0000","last_fullsized":"2024-09-21T03:53:33.036592+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:45.770622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.041069+0000","last_change":"2024-09-21T03:53:11.803560+0000","last_active":"2024-09-21T03:53:33.041069+0000","last_peered":"2024-09-21T03:53:33.041069+0000","last_clean":"2024-09-21T03:53:33.041069+0000","last_became_active":"2024-09-21T03:53:11.803090+0000","last_became_peered":"2024-09-21T03:53:11.803090+0000","last_unstale":"2024-09-21T03:53:33.041069+0000","last_undegraded":"2024-09-21T03:53:33.041069+0000","last_fullsized":"2024-09-21T03:53:33.041069+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:23.993694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036373+0000","last_change":"2024-09-21T03:53:13.825907+0000","last_active":"2024-09-21T03:53:33.036373+0000","last_peered":"2024-09-21T03:53:33.036373+0000","last_clean":"2024-09-21T03:53:33.036373+0000","last_became_active":"2024-09-21T03:53:13.825485+0000","last_became_peered":"2024-09-21T03:53:13.825485+0000","last_unstale":"2024-09-21T03:53:33.036373+0000","last_undegraded":"2024-09-21T03:53:33.036373+0000","last_fullsized":"2024-09-21T03:53:33.036373+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:39.166215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.095338+0000","last_change":"2024-09-21T03:53:12.605947+0000","last_active":"2024-09-21T03:53:33.095338+0000","last_peered":"2024-09-21T03:53:33.095338+0000","last_clean":"2024-09-21T03:53:33.095338+0000","last_became_active":"2024-09-21T03:53:12.604516+0000","last_became_peered":"2024-09-21T03:53:12.604516+0000","last_unstale":"2024-09-21T03:53:33.095338+0000","last_undegraded":"2024-09-21T03:53:33.095338+0000","last_fullsized":"2024-09-21T03:53:33.095338+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:42.500174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036503+0000","last_change":"2024-09-21T03:53:13.834108+0000","last_active":"2024-09-21T03:53:33.036503+0000","last_peered":"2024-09-21T03:53:33.036503+0000","last_clean":"2024-09-21T03:53:33.036503+0000","last_became_active":"2024-09-21T03:53:13.833734+0000","last_became_peered":"2024-09-21T03:53:13.833734+0000","last_unstale":"2024-09-21T03:53:33.036503+0000","last_undegraded":"2024-09-21T03:53:33.036503+0000","last_fullsized":"2024-09-21T03:53:33.036503+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:39.032450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":97,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036156+0000","last_change":"2024-09-21T03:51:59.139085+0000","last_active":"2024-09-21T03:53:33.036156+0000","last_peered":"2024-09-21T03:53:33.036156+0000","last_clean":"2024-09-21T03:53:33.036156+0000","last_became_active":"2024-09-21T03:51:59.026450+0000","last_became_peered":"2024-09-21T03:51:59.026450+0000","last_unstale":"2024-09-21T03:53:33.036156+0000","last_undegraded":"2024-09-21T03:53:33.036156+0000","last_fullsized":"2024-09-21T03:53:33.036156+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:48:31.139457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:48:31.139457+0000","last_clean_scrub_stamp":"2024-09-21T03:48:31.139457+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:54.047170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123454+0000","last_change":"2024-09-21T03:53:11.805792+0000","last_active":"2024-09-21T03:53:33.123454+0000","last_peered":"2024-09-21T03:53:33.123454+0000","last_clean":"2024-09-21T03:53:33.123454+0000","last_became_active":"2024-09-21T03:53:11.805375+0000","last_became_peered":"2024-09-21T03:53:11.805375+0000","last_unstale":"2024-09-21T03:53:33.123454+0000","last_undegraded":"2024-09-21T03:53:33.123454+0000","last_fullsized":"2024-09-21T03:53:33.123454+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:55.466187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122971+0000","last_change":"2024-09-21T03:53:13.835211+0000","last_active":"2024-09-21T03:53:33.122971+0000","last_peered":"2024-09-21T03:53:33.122971+0000","last_clean":"2024-09-21T03:53:33.122971+0000","last_became_active":"2024-09-21T03:53:13.833649+0000","last_became_peered":"2024-09-21T03:53:13.833649+0000","last_unstale":"2024-09-21T03:53:33.122971+0000","last_undegraded":"2024-09-21T03:53:33.122971+0000","last_fullsized":"2024-09-21T03:53:33.122971+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:57.962287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035996+0000","last_change":"2024-09-21T03:53:11.801670+0000","last_active":"2024-09-21T03:53:33.035996+0000","last_peered":"2024-09-21T03:53:33.035996+0000","last_clean":"2024-09-21T03:53:33.035996+0000","last_became_active":"2024-09-21T03:53:11.801291+0000","last_became_peered":"2024-09-21T03:53:11.801291+0000","last_unstale":"2024-09-21T03:53:33.035996+0000","last_undegraded":"2024-09-21T03:53:33.035996+0000","last_fullsized":"2024-09-21T03:53:33.035996+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:37.450592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.096813+0000","last_change":"2024-09-21T03:53:33.096727+0000","last_active":"2024-09-21T03:53:33.096813+0000","last_peered":"2024-09-21T03:53:33.096813+0000","last_clean":"2024-09-21T03:53:33.096813+0000","last_became_active":"2024-09-21T03:53:33.096234+0000","last_became_peered":"2024-09-21T03:53:33.096234+0000","last_unstale":"2024-09-21T03:53:33.096813+0000","last_undegraded":"2024-09-21T03:53:33.096813+0000","last_fullsized":"2024-09-21T03:53:33.096813+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:56:24.375992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031550+0000","last_change":"2024-09-21T03:53:12.604170+0000","last_active":"2024-09-21T03:53:33.031550+0000","last_peered":"2024-09-21T03:53:33.031550+0000","last_clean":"2024-09-21T03:53:33.031550+0000","last_became_active":"2024-09-21T03:53:12.603765+0000","last_became_peered":"2024-09-21T03:53:12.603765+0000","last_unstale":"2024-09-21T03:53:33.031550+0000","last_undegraded":"2024-09-21T03:53:33.031550+0000","last_fullsized":"2024-09-21T03:53:33.031550+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:08.606037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.125077+0000","last_change":"2024-09-21T03:53:33.124969+0000","last_active":"2024-09-21T03:53:33.125077+0000","last_peered":"2024-09-21T03:53:33.125077+0000","last_clean":"2024-09-21T03:53:33.125077+0000","last_became_active":"2024-09-21T03:53:33.124496+0000","last_became_peered":"2024-09-21T03:53:33.124496+0000","last_unstale":"2024-09-21T03:53:33.125077+0000","last_undegraded":"2024-09-21T03:53:33.125077+0000","last_fullsized":"2024-09-21T03:53:33.125077+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:56.730146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036128+0000","last_change":"2024-09-21T03:53:11.803316+0000","last_active":"2024-09-21T03:53:33.036128+0000","last_peered":"2024-09-21T03:53:33.036128+0000","last_clean":"2024-09-21T03:53:33.036128+0000","last_became_active":"2024-09-21T03:53:11.801976+0000","last_became_peered":"2024-09-21T03:53:11.801976+0000","last_unstale":"2024-09-21T03:53:33.036128+0000","last_undegraded":"2024-09-21T03:53:33.036128+0000","last_fullsized":"2024-09-21T03:53:33.036128+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:43.596037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124177+0000","last_change":"2024-09-21T03:53:13.838006+0000","last_active":"2024-09-21T03:53:33.124177+0000","last_peered":"2024-09-21T03:53:33.124177+0000","last_clean":"2024-09-21T03:53:33.124177+0000","last_became_active":"2024-09-21T03:53:13.835903+0000","last_became_peered":"2024-09-21T03:53:13.835903+0000","last_unstale":"2024-09-21T03:53:33.124177+0000","last_undegraded":"2024-09-21T03:53:33.124177+0000","last_fullsized":"2024-09-21T03:53:33.124177+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:54:56.730044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124836+0000","last_change":"2024-09-21T03:53:33.124720+0000","last_active":"2024-09-21T03:53:33.124836+0000","last_peered":"2024-09-21T03:53:33.124836+0000","last_clean":"2024-09-21T03:53:33.124836+0000","last_became_active":"2024-09-21T03:53:33.124232+0000","last_became_peered":"2024-09-21T03:53:33.124232+0000","last_unstale":"2024-09-21T03:53:33.124836+0000","last_undegraded":"2024-09-21T03:53:33.124836+0000","last_fullsized":"2024-09-21T03:53:33.124836+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:23.810493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124631+0000","last_change":"2024-09-21T03:53:13.827805+0000","last_active":"2024-09-21T03:53:33.124631+0000","last_peered":"2024-09-21T03:53:33.124631+0000","last_clean":"2024-09-21T03:53:33.124631+0000","last_became_active":"2024-09-21T03:53:13.827368+0000","last_became_peered":"2024-09-21T03:53:13.827368+0000","last_unstale":"2024-09-21T03:53:33.124631+0000","last_undegraded":"2024-09-21T03:53:33.124631+0000","last_fullsized":"2024-09-21T03:53:33.124631+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:24.539396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123881+0000","last_change":"2024-09-21T03:53:12.605032+0000","last_active":"2024-09-21T03:53:33.123881+0000","last_peered":"2024-09-21T03:53:33.123881+0000","last_clean":"2024-09-21T03:53:33.123881+0000","last_became_active":"2024-09-21T03:53:12.604561+0000","last_became_peered":"2024-09-21T03:53:12.604561+0000","last_unstale":"2024-09-21T03:53:33.123881+0000","last_undegraded":"2024-09-21T03:53:33.123881+0000","last_fullsized":"2024-09-21T03:53:33.123881+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:20.361768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031744+0000","last_change":"2024-09-21T03:53:13.821539+0000","last_active":"2024-09-21T03:53:33.031744+0000","last_peered":"2024-09-21T03:53:33.031744+0000","last_clean":"2024-09-21T03:53:33.031744+0000","last_became_active":"2024-09-21T03:53:13.821196+0000","last_became_peered":"2024-09-21T03:53:13.821196+0000","last_unstale":"2024-09-21T03:53:33.031744+0000","last_undegraded":"2024-09-21T03:53:33.031744+0000","last_fullsized":"2024-09-21T03:53:33.031744+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:00.627993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'10","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:36.828012+0000","last_change":"2024-09-21T03:53:11.799669+0000","last_active":"2024-09-21T03:53:36.828012+0000","last_peered":"2024-09-21T03:53:36.828012+0000","last_clean":"2024-09-21T03:53:36.828012+0000","last_became_active":"2024-09-21T03:53:11.799355+0000","last_became_peered":"2024-09-21T03:53:11.799355+0000","last_unstale":"2024-09-21T03:53:36.828012+0000","last_undegraded":"2024-09-21T03:53:36.828012+0000","last_fullsized":"2024-09-21T03:53:36.828012+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:33.032206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123797+0000","last_change":"2024-09-21T03:53:13.828551+0000","last_active":"2024-09-21T03:53:33.123797+0000","last_peered":"2024-09-21T03:53:33.123797+0000","last_clean":"2024-09-21T03:53:33.123797+0000","last_became_active":"2024-09-21T03:53:13.828185+0000","last_became_peered":"2024-09-21T03:53:13.828185+0000","last_unstale":"2024-09-21T03:53:33.123797+0000","last_undegraded":"2024-09-21T03:53:33.123797+0000","last_fullsized":"2024-09-21T03:53:33.123797+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:31.852755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124078+0000","last_change":"2024-09-21T03:53:12.279823+0000","last_active":"2024-09-21T03:53:33.124078+0000","last_peered":"2024-09-21T03:53:33.124078+0000","last_clean":"2024-09-21T03:53:33.124078+0000","last_became_active":"2024-09-21T03:53:12.279384+0000","last_became_peered":"2024-09-21T03:53:12.279384+0000","last_unstale":"2024-09-21T03:53:33.124078+0000","last_undegraded":"2024-09-21T03:53:33.124078+0000","last_fullsized":"2024-09-21T03:53:33.124078+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:42.568690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123319+0000","last_change":"2024-09-21T03:53:13.831041+0000","last_active":"2024-09-21T03:53:33.123319+0000","last_peered":"2024-09-21T03:53:33.123319+0000","last_clean":"2024-09-21T03:53:33.123319+0000","last_became_active":"2024-09-21T03:53:13.830654+0000","last_became_peered":"2024-09-21T03:53:13.830654+0000","last_unstale":"2024-09-21T03:53:33.123319+0000","last_undegraded":"2024-09-21T03:53:33.123319+0000","last_fullsized":"2024-09-21T03:53:33.123319+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:04.815719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032478+0000","last_change":"2024-09-21T03:53:12.604949+0000","last_active":"2024-09-21T03:53:33.032478+0000","last_peered":"2024-09-21T03:53:33.032478+0000","last_clean":"2024-09-21T03:53:33.032478+0000","last_became_active":"2024-09-21T03:53:12.604516+0000","last_became_peered":"2024-09-21T03:53:12.604516+0000","last_unstale":"2024-09-21T03:53:33.032478+0000","last_undegraded":"2024-09-21T03:53:33.032478+0000","last_fullsized":"2024-09-21T03:53:33.032478+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:33.964125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123050+0000","last_change":"2024-09-21T03:53:13.834813+0000","last_active":"2024-09-21T03:53:33.123050+0000","last_peered":"2024-09-21T03:53:33.123050+0000","last_clean":"2024-09-21T03:53:33.123050+0000","last_became_active":"2024-09-21T03:53:13.834436+0000","last_became_peered":"2024-09-21T03:53:13.834436+0000","last_unstale":"2024-09-21T03:53:33.123050+0000","last_undegraded":"2024-09-21T03:53:33.123050+0000","last_fullsized":"2024-09-21T03:53:33.123050+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:42:40.990668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122665+0000","last_change":"2024-09-21T03:53:11.801828+0000","last_active":"2024-09-21T03:53:33.122665+0000","last_peered":"2024-09-21T03:53:33.122665+0000","last_clean":"2024-09-21T03:53:33.122665+0000","last_became_active":"2024-09-21T03:53:11.800969+0000","last_became_peered":"2024-09-21T03:53:11.800969+0000","last_unstale":"2024-09-21T03:53:33.122665+0000","last_undegraded":"2024-09-21T03:53:33.122665+0000","last_fullsized":"2024-09-21T03:53:33.122665+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:36.117523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034772+0000","last_change":"2024-09-21T03:53:13.835393+0000","last_active":"2024-09-21T03:53:33.034772+0000","last_peered":"2024-09-21T03:53:33.034772+0000","last_clean":"2024-09-21T03:53:33.034772+0000","last_became_active":"2024-09-21T03:53:13.834541+0000","last_became_peered":"2024-09-21T03:53:13.834541+0000","last_unstale":"2024-09-21T03:53:33.034772+0000","last_undegraded":"2024-09-21T03:53:33.034772+0000","last_fullsized":"2024-09-21T03:53:33.034772+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:40.140004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.125328+0000","last_change":"2024-09-21T03:53:33.124524+0000","last_active":"2024-09-21T03:53:33.125328+0000","last_peered":"2024-09-21T03:53:33.125328+0000","last_clean":"2024-09-21T03:53:33.125328+0000","last_became_active":"2024-09-21T03:53:33.123945+0000","last_became_peered":"2024-09-21T03:53:33.123945+0000","last_unstale":"2024-09-21T03:53:33.125328+0000","last_undegraded":"2024-09-21T03:53:33.125328+0000","last_fullsized":"2024-09-21T03:53:33.125328+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:50.967123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122926+0000","last_change":"2024-09-21T03:53:13.832597+0000","last_active":"2024-09-21T03:53:33.122926+0000","last_peered":"2024-09-21T03:53:33.122926+0000","last_clean":"2024-09-21T03:53:33.122926+0000","last_became_active":"2024-09-21T03:53:13.832237+0000","last_became_peered":"2024-09-21T03:53:13.832237+0000","last_unstale":"2024-09-21T03:53:33.122926+0000","last_undegraded":"2024-09-21T03:53:33.122926+0000","last_fullsized":"2024-09-21T03:53:33.122926+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:31.907478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123185+0000","last_change":"2024-09-21T03:53:11.804875+0000","last_active":"2024-09-21T03:53:33.123185+0000","last_peered":"2024-09-21T03:53:33.123185+0000","last_clean":"2024-09-21T03:53:33.123185+0000","last_became_active":"2024-09-21T03:53:11.804320+0000","last_became_peered":"2024-09-21T03:53:11.804320+0000","last_unstale":"2024-09-21T03:53:33.123185+0000","last_undegraded":"2024-09-21T03:53:33.123185+0000","last_fullsized":"2024-09-21T03:53:33.123185+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:37:58.747573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035965+0000","last_change":"2024-09-21T03:53:13.837804+0000","last_active":"2024-09-21T03:53:33.035965+0000","last_peered":"2024-09-21T03:53:33.035965+0000","last_clean":"2024-09-21T03:53:33.035965+0000","last_became_active":"2024-09-21T03:53:13.837440+0000","last_became_peered":"2024-09-21T03:53:13.837440+0000","last_unstale":"2024-09-21T03:53:33.035965+0000","last_undegraded":"2024-09-21T03:53:33.035965+0000","last_fullsized":"2024-09-21T03:53:33.035965+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:15.471544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040923+0000","last_change":"2024-09-21T03:53:13.833231+0000","last_active":"2024-09-21T03:53:33.040923+0000","last_peered":"2024-09-21T03:53:33.040923+0000","last_clean":"2024-09-21T03:53:33.040923+0000","last_became_active":"2024-09-21T03:53:13.832908+0000","last_became_peered":"2024-09-21T03:53:13.832908+0000","last_unstale":"2024-09-21T03:53:33.040923+0000","last_undegraded":"2024-09-21T03:53:33.040923+0000","last_fullsized":"2024-09-21T03:53:33.040923+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:40.191231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123570+0000","last_change":"2024-09-21T03:53:11.802237+0000","last_active":"2024-09-21T03:53:33.123570+0000","last_peered":"2024-09-21T03:53:33.123570+0000","last_clean":"2024-09-21T03:53:33.123570+0000","last_became_active":"2024-09-21T03:53:11.801845+0000","last_became_peered":"2024-09-21T03:53:11.801845+0000","last_unstale":"2024-09-21T03:53:33.123570+0000","last_undegraded":"2024-09-21T03:53:33.123570+0000","last_fullsized":"2024-09-21T03:53:33.123570+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:34.714908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032488+0000","last_change":"2024-09-21T03:53:13.831495+0000","last_active":"2024-09-21T03:53:33.032488+0000","last_peered":"2024-09-21T03:53:33.032488+0000","last_clean":"2024-09-21T03:53:33.032488+0000","last_became_active":"2024-09-21T03:53:13.831107+0000","last_became_peered":"2024-09-21T03:53:13.831107+0000","last_unstale":"2024-09-21T03:53:33.032488+0000","last_undegraded":"2024-09-21T03:53:33.032488+0000","last_fullsized":"2024-09-21T03:53:33.032488+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:12:09.751036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123850+0000","last_change":"2024-09-21T03:53:11.805910+0000","last_active":"2024-09-21T03:53:33.123850+0000","last_peered":"2024-09-21T03:53:33.123850+0000","last_clean":"2024-09-21T03:53:33.123850+0000","last_became_active":"2024-09-21T03:53:11.805461+0000","last_became_peered":"2024-09-21T03:53:11.805461+0000","last_unstale":"2024-09-21T03:53:33.123850+0000","last_undegraded":"2024-09-21T03:53:33.123850+0000","last_fullsized":"2024-09-21T03:53:33.123850+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:36:56.132055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123607+0000","last_change":"2024-09-21T03:53:13.834930+0000","last_active":"2024-09-21T03:53:33.123607+0000","last_peered":"2024-09-21T03:53:33.123607+0000","last_clean":"2024-09-21T03:53:33.123607+0000","last_became_active":"2024-09-21T03:53:13.834368+0000","last_became_peered":"2024-09-21T03:53:13.834368+0000","last_unstale":"2024-09-21T03:53:33.123607+0000","last_undegraded":"2024-09-21T03:53:33.123607+0000","last_fullsized":"2024-09-21T03:53:33.123607+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:53.798811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123728+0000","last_change":"2024-09-21T03:53:12.604827+0000","last_active":"2024-09-21T03:53:33.123728+0000","last_peered":"2024-09-21T03:53:33.123728+0000","last_clean":"2024-09-21T03:53:33.123728+0000","last_became_active":"2024-09-21T03:53:12.604406+0000","last_became_peered":"2024-09-21T03:53:12.604406+0000","last_unstale":"2024-09-21T03:53:33.123728+0000","last_undegraded":"2024-09-21T03:53:33.123728+0000","last_fullsized":"2024-09-21T03:53:33.123728+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:03:12.942354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123562+0000","last_change":"2024-09-21T03:53:13.830482+0000","last_active":"2024-09-21T03:53:33.123562+0000","last_peered":"2024-09-21T03:53:33.123562+0000","last_clean":"2024-09-21T03:53:33.123562+0000","last_became_active":"2024-09-21T03:53:13.829970+0000","last_became_peered":"2024-09-21T03:53:13.829970+0000","last_unstale":"2024-09-21T03:53:33.123562+0000","last_undegraded":"2024-09-21T03:53:33.123562+0000","last_fullsized":"2024-09-21T03:53:33.123562+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:21.617459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035213+0000","last_change":"2024-09-21T03:53:11.801931+0000","last_active":"2024-09-21T03:53:33.035213+0000","last_peered":"2024-09-21T03:53:33.035213+0000","last_clean":"2024-09-21T03:53:33.035213+0000","last_became_active":"2024-09-21T03:53:11.801587+0000","last_became_peered":"2024-09-21T03:53:11.801587+0000","last_unstale":"2024-09-21T03:53:33.035213+0000","last_undegraded":"2024-09-21T03:53:33.035213+0000","last_fullsized":"2024-09-21T03:53:33.035213+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:47.329060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67755,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":127,"num_read_kb":131,"num_write":85,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":203265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70,"ondisk_log_size":70,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285514,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743450,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":831488,"data_stored":416577,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939680,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":1074213,"data_compressed":42053,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103205,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":835584,"data_stored":417159,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299434,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":839680,"data_stored":417181,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462959,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":888832,"data_stored":1007644,"data_compressed":42053,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626484,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":835584,"data_stored":416694,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822714,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":897024,"data_stored":1007244,"data_compressed":42053,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986239,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":835584,"data_stored":416599,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182466,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36172,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708980,"statfs":{"total":95995035648,"available":95957995520,"internally_reserved":0,"allocated":847872,"data_stored":416915,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378697,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":483568,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542222,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":483534,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705747,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":835584,"data_stored":416667,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34678,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34678,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34678,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36296,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36296,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36296,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36296,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36296,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":66991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":67151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:54:19.919 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T03:54:20.189 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:20.543 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:20 smithi046 ceph-mon[30954]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:54:20.543 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:20 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:54:20.543 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:20 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:54:20.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:20 smithi105 ceph-mon[34773]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:54:20.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:20 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:54:20.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:20 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:54:20.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:20 smithi162 ceph-mon[35071]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:54:20.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:20 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:54:20.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:20 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:54:20.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.761+0000 7fc71885e640 1 -- 172.21.15.46:0/3701919085 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc714102a60 msgr2=0x7fc714102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:20.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.761+0000 7fc71885e640 1 --2- 172.21.15.46:0/3701919085 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc714102a60 0x7fc714102e70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc704009900 tx=0x7fc70402a3f0 comp rx=0 tx=0).stop 2024-09-21T03:54:20.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.761+0000 7fc71885e640 1 -- 172.21.15.46:0/3701919085 shutdown_connections 2024-09-21T03:54:20.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.761+0000 7fc71885e640 1 --2- 172.21.15.46:0/3701919085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc714108cf0 0x7fc71410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:20.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.761+0000 7fc71885e640 1 --2- 172.21.15.46:0/3701919085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7141083a0 0x7fc7141087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:20.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.761+0000 7fc71885e640 1 --2- 172.21.15.46:0/3701919085 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc714102a60 0x7fc714102e70 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:20.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.761+0000 7fc71885e640 1 -- 172.21.15.46:0/3701919085 >> 172.21.15.46:0/3701919085 conn(0x7fc714079730 msgr2=0x7fc714079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:20.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.761+0000 7fc71885e640 1 -- 172.21.15.46:0/3701919085 shutdown_connections 2024-09-21T03:54:20.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.761+0000 7fc71885e640 1 -- 172.21.15.46:0/3701919085 wait complete. 2024-09-21T03:54:20.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.762+0000 7fc71885e640 1 Processor -- start 2024-09-21T03:54:20.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.762+0000 7fc71885e640 1 -- start start 2024-09-21T03:54:20.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.762+0000 7fc71885e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc714102a60 0x7fc71419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:20.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.762+0000 7fc71885e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7141083a0 0x7fc71419aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:20.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.762+0000 7fc71885e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc714108cf0 0x7fc71419fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:20.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.762+0000 7fc71885e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc714113a80 con 0x7fc7141083a0 2024-09-21T03:54:20.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.762+0000 7fc71885e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc714113900 con 0x7fc714102a60 2024-09-21T03:54:20.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.762+0000 7fc71885e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc714113c00 con 0x7fc714108cf0 2024-09-21T03:54:20.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.762+0000 7fc711d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7141083a0 0x7fc71419aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:20.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.762+0000 7fc711d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7141083a0 0x7fc71419aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41002/0 (socket says 172.21.15.46:41002) 2024-09-21T03:54:20.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.762+0000 7fc711d9b640 1 -- 172.21.15.46:0/907801853 learned_addr learned my addr 172.21.15.46:0/907801853 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:20.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.763+0000 7fc712d9d640 1 --2- 172.21.15.46:0/907801853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc714108cf0 0x7fc71419fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:20.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.763+0000 7fc71259c640 1 --2- 172.21.15.46:0/907801853 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc714102a60 0x7fc71419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:20.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.763+0000 7fc711d9b640 1 -- 172.21.15.46:0/907801853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc714108cf0 msgr2=0x7fc71419fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:20.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.763+0000 7fc711d9b640 1 --2- 172.21.15.46:0/907801853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc714108cf0 0x7fc71419fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:20.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.763+0000 7fc711d9b640 1 -- 172.21.15.46:0/907801853 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc714102a60 msgr2=0x7fc71419a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:20.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.763+0000 7fc711d9b640 1 --2- 172.21.15.46:0/907801853 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc714102a60 0x7fc71419a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:20.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.763+0000 7fc711d9b640 1 -- 172.21.15.46:0/907801853 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7141a0340 con 0x7fc7141083a0 2024-09-21T03:54:20.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.763+0000 7fc71259c640 1 --2- 172.21.15.46:0/907801853 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc714102a60 0x7fc71419a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:54:20.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.763+0000 7fc712d9d640 1 --2- 172.21.15.46:0/907801853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc714108cf0 0x7fc71419fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:54:20.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.763+0000 7fc711d9b640 1 --2- 172.21.15.46:0/907801853 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7141083a0 0x7fc71419aa30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc70800d740 tx=0x7fc70800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:20.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.763+0000 7fc7037fe640 1 -- 172.21.15.46:0/907801853 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc708017070 con 0x7fc7141083a0 2024-09-21T03:54:20.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.763+0000 7fc71885e640 1 -- 172.21.15.46:0/907801853 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7141a0630 con 0x7fc7141083a0 2024-09-21T03:54:20.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.763+0000 7fc7037fe640 1 -- 172.21.15.46:0/907801853 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc70800de50 con 0x7fc7141083a0 2024-09-21T03:54:20.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.763+0000 7fc7037fe640 1 -- 172.21.15.46:0/907801853 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc708004ce0 con 0x7fc7141083a0 2024-09-21T03:54:20.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.763+0000 7fc71885e640 1 -- 172.21.15.46:0/907801853 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7141a6e50 con 0x7fc7141083a0 2024-09-21T03:54:20.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.764+0000 7fc71885e640 1 -- 172.21.15.46:0/907801853 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc714102e70 con 0x7fc7141083a0 2024-09-21T03:54:20.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.766+0000 7fc7037fe640 1 -- 172.21.15.46:0/907801853 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fc708004e80 con 0x7fc7141083a0 2024-09-21T03:54:20.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.767+0000 7fc7037fe640 1 --2- 172.21.15.46:0/907801853 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc6fc0b6620 0x7fc6fc0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:20.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.767+0000 7fc71259c640 1 --2- 172.21.15.46:0/907801853 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc6fc0b6620 0x7fc6fc0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:20.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.767+0000 7fc7037fe640 1 -- 172.21.15.46:0/907801853 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fc7080e73c0 con 0x7fc7141083a0 2024-09-21T03:54:20.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.767+0000 7fc71259c640 1 --2- 172.21.15.46:0/907801853 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc6fc0b6620 0x7fc6fc0b8b30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc7040096c0 tx=0x7fc704031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:20.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.770+0000 7fc7037fe640 1 -- 172.21.15.46:0/907801853 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc7080ada70 con 0x7fc7141083a0 2024-09-21T03:54:20.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.954+0000 7fc71885e640 1 -- 172.21.15.46:0/907801853 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc714063800 con 0x7fc6fc0b6620 2024-09-21T03:54:20.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.962+0000 7fc7037fe640 1 -- 172.21.15.46:0/907801853 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258883 (secure 0 0 0) 0x7fc714063800 con 0x7fc6fc0b6620 2024-09-21T03:54:20.966 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:54:20.967 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-09-21T03:54:20.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.965+0000 7fc71885e640 1 -- 172.21.15.46:0/907801853 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc6fc0b6620 msgr2=0x7fc6fc0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:20.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.965+0000 7fc71885e640 1 --2- 172.21.15.46:0/907801853 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc6fc0b6620 0x7fc6fc0b8b30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc7040096c0 tx=0x7fc704031400 comp rx=0 tx=0).stop 2024-09-21T03:54:20.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.965+0000 7fc71885e640 1 -- 172.21.15.46:0/907801853 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7141083a0 msgr2=0x7fc71419aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:20.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.965+0000 7fc71885e640 1 --2- 172.21.15.46:0/907801853 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7141083a0 0x7fc71419aa30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc70800d740 tx=0x7fc70800dc00 comp rx=0 tx=0).stop 2024-09-21T03:54:20.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.965+0000 7fc71885e640 1 -- 172.21.15.46:0/907801853 shutdown_connections 2024-09-21T03:54:20.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.965+0000 7fc71885e640 1 --2- 172.21.15.46:0/907801853 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc6fc0b6620 0x7fc6fc0b8b30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:20.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.965+0000 7fc71885e640 1 --2- 172.21.15.46:0/907801853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc714108cf0 0x7fc71419fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:20.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.965+0000 7fc71885e640 1 --2- 172.21.15.46:0/907801853 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7141083a0 0x7fc71419aa30 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:20.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.965+0000 7fc71885e640 1 --2- 172.21.15.46:0/907801853 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc714102a60 0x7fc71419a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:20.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.965+0000 7fc71885e640 1 -- 172.21.15.46:0/907801853 >> 172.21.15.46:0/907801853 conn(0x7fc714079730 msgr2=0x7fc714101460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:20.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.965+0000 7fc71885e640 1 -- 172.21.15.46:0/907801853 shutdown_connections 2024-09-21T03:54:20.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:20.965+0000 7fc71885e640 1 -- 172.21.15.46:0/907801853 wait complete. 2024-09-21T03:54:21.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:21 smithi105 ceph-mon[34773]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:54:21.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:21 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:54:21.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:21 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:54:21.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:21 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:54:21.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:21 smithi162 ceph-mon[35071]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:54:21.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:21 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:54:21.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:21 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:54:21.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:21 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:54:21.634 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:21 smithi046 ceph-mon[30954]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:54:21.635 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:21 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:54:21.635 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:21 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:54:21.635 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:21 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:54:21.665 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":299,"stamp":"2024-09-21T03:54:20.049349+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658357,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":208,"num_read_kb":200,"num_write":210,"num_write_kb":2246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":380292,"kb_used_data":10200,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124561532,"statfs":{"total":1151940427776,"available":1151551008768,"internally_reserved":0,"allocated":10444800,"data_stored":6973995,"data_compressed":177972,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003224"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034971+0000","last_change":"2024-09-21T03:53:13.835177+0000","last_active":"2024-09-21T03:53:33.034971+0000","last_peered":"2024-09-21T03:53:33.034971+0000","last_clean":"2024-09-21T03:53:33.034971+0000","last_became_active":"2024-09-21T03:53:13.834779+0000","last_became_peered":"2024-09-21T03:53:13.834779+0000","last_unstale":"2024-09-21T03:53:33.034971+0000","last_undegraded":"2024-09-21T03:53:33.034971+0000","last_fullsized":"2024-09-21T03:53:33.034971+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:10.632059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123205+0000","last_change":"2024-09-21T03:53:13.829689+0000","last_active":"2024-09-21T03:53:33.123205+0000","last_peered":"2024-09-21T03:53:33.123205+0000","last_clean":"2024-09-21T03:53:33.123205+0000","last_became_active":"2024-09-21T03:53:13.828732+0000","last_became_peered":"2024-09-21T03:53:13.828732+0000","last_unstale":"2024-09-21T03:53:33.123205+0000","last_undegraded":"2024-09-21T03:53:33.123205+0000","last_fullsized":"2024-09-21T03:53:33.123205+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:35.270218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123057+0000","last_change":"2024-09-21T03:53:13.836545+0000","last_active":"2024-09-21T03:53:33.123057+0000","last_peered":"2024-09-21T03:53:33.123057+0000","last_clean":"2024-09-21T03:53:33.123057+0000","last_became_active":"2024-09-21T03:53:13.835781+0000","last_became_peered":"2024-09-21T03:53:13.835781+0000","last_unstale":"2024-09-21T03:53:33.123057+0000","last_undegraded":"2024-09-21T03:53:33.123057+0000","last_fullsized":"2024-09-21T03:53:33.123057+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:13.130016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123786+0000","last_change":"2024-09-21T03:53:13.832292+0000","last_active":"2024-09-21T03:53:33.123786+0000","last_peered":"2024-09-21T03:53:33.123786+0000","last_clean":"2024-09-21T03:53:33.123786+0000","last_became_active":"2024-09-21T03:53:13.831311+0000","last_became_peered":"2024-09-21T03:53:13.831311+0000","last_unstale":"2024-09-21T03:53:33.123786+0000","last_undegraded":"2024-09-21T03:53:33.123786+0000","last_fullsized":"2024-09-21T03:53:33.123786+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:38:49.425261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123152+0000","last_change":"2024-09-21T03:53:13.825130+0000","last_active":"2024-09-21T03:53:33.123152+0000","last_peered":"2024-09-21T03:53:33.123152+0000","last_clean":"2024-09-21T03:53:33.123152+0000","last_became_active":"2024-09-21T03:53:13.824795+0000","last_became_peered":"2024-09-21T03:53:13.824795+0000","last_unstale":"2024-09-21T03:53:33.123152+0000","last_undegraded":"2024-09-21T03:53:33.123152+0000","last_fullsized":"2024-09-21T03:53:33.123152+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:22.653270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123230+0000","last_change":"2024-09-21T03:53:13.834449+0000","last_active":"2024-09-21T03:53:33.123230+0000","last_peered":"2024-09-21T03:53:33.123230+0000","last_clean":"2024-09-21T03:53:33.123230+0000","last_became_active":"2024-09-21T03:53:13.832727+0000","last_became_peered":"2024-09-21T03:53:13.832727+0000","last_unstale":"2024-09-21T03:53:33.123230+0000","last_undegraded":"2024-09-21T03:53:33.123230+0000","last_fullsized":"2024-09-21T03:53:33.123230+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:36.479962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035845+0000","last_change":"2024-09-21T03:53:13.821938+0000","last_active":"2024-09-21T03:53:33.035845+0000","last_peered":"2024-09-21T03:53:33.035845+0000","last_clean":"2024-09-21T03:53:33.035845+0000","last_became_active":"2024-09-21T03:53:13.821569+0000","last_became_peered":"2024-09-21T03:53:13.821569+0000","last_unstale":"2024-09-21T03:53:33.035845+0000","last_undegraded":"2024-09-21T03:53:33.035845+0000","last_fullsized":"2024-09-21T03:53:33.035845+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:04.309212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122491+0000","last_change":"2024-09-21T03:53:13.833471+0000","last_active":"2024-09-21T03:53:33.122491+0000","last_peered":"2024-09-21T03:53:33.122491+0000","last_clean":"2024-09-21T03:53:33.122491+0000","last_became_active":"2024-09-21T03:53:13.832779+0000","last_became_peered":"2024-09-21T03:53:13.832779+0000","last_unstale":"2024-09-21T03:53:33.122491+0000","last_undegraded":"2024-09-21T03:53:33.122491+0000","last_fullsized":"2024-09-21T03:53:33.122491+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:15.402265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032934+0000","last_change":"2024-09-21T03:53:13.833077+0000","last_active":"2024-09-21T03:53:33.032934+0000","last_peered":"2024-09-21T03:53:33.032934+0000","last_clean":"2024-09-21T03:53:33.032934+0000","last_became_active":"2024-09-21T03:53:13.832625+0000","last_became_peered":"2024-09-21T03:53:13.832625+0000","last_unstale":"2024-09-21T03:53:33.032934+0000","last_undegraded":"2024-09-21T03:53:33.032934+0000","last_fullsized":"2024-09-21T03:53:33.032934+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:13.158754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124857+0000","last_change":"2024-09-21T03:53:13.835417+0000","last_active":"2024-09-21T03:53:33.124857+0000","last_peered":"2024-09-21T03:53:33.124857+0000","last_clean":"2024-09-21T03:53:33.124857+0000","last_became_active":"2024-09-21T03:53:13.835081+0000","last_became_peered":"2024-09-21T03:53:13.835081+0000","last_unstale":"2024-09-21T03:53:33.124857+0000","last_undegraded":"2024-09-21T03:53:33.124857+0000","last_fullsized":"2024-09-21T03:53:33.124857+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:29.239879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036187+0000","last_change":"2024-09-21T03:53:13.836575+0000","last_active":"2024-09-21T03:53:33.036187+0000","last_peered":"2024-09-21T03:53:33.036187+0000","last_clean":"2024-09-21T03:53:33.036187+0000","last_became_active":"2024-09-21T03:53:13.836184+0000","last_became_peered":"2024-09-21T03:53:13.836184+0000","last_unstale":"2024-09-21T03:53:33.036187+0000","last_undegraded":"2024-09-21T03:53:33.036187+0000","last_fullsized":"2024-09-21T03:53:33.036187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:06.602354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.126314+0000","last_change":"2024-09-21T03:53:33.125896+0000","last_active":"2024-09-21T03:53:33.126314+0000","last_peered":"2024-09-21T03:53:33.126314+0000","last_clean":"2024-09-21T03:53:33.126314+0000","last_became_active":"2024-09-21T03:53:33.125488+0000","last_became_peered":"2024-09-21T03:53:33.125488+0000","last_unstale":"2024-09-21T03:53:33.126314+0000","last_undegraded":"2024-09-21T03:53:33.126314+0000","last_fullsized":"2024-09-21T03:53:33.126314+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:09.742892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031708+0000","last_change":"2024-09-21T03:53:13.814729+0000","last_active":"2024-09-21T03:53:33.031708+0000","last_peered":"2024-09-21T03:53:33.031708+0000","last_clean":"2024-09-21T03:53:33.031708+0000","last_became_active":"2024-09-21T03:53:13.814317+0000","last_became_peered":"2024-09-21T03:53:13.814317+0000","last_unstale":"2024-09-21T03:53:33.031708+0000","last_undegraded":"2024-09-21T03:53:33.031708+0000","last_fullsized":"2024-09-21T03:53:33.031708+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:30.779754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122847+0000","last_change":"2024-09-21T03:53:13.833280+0000","last_active":"2024-09-21T03:53:33.122847+0000","last_peered":"2024-09-21T03:53:33.122847+0000","last_clean":"2024-09-21T03:53:33.122847+0000","last_became_active":"2024-09-21T03:53:13.831799+0000","last_became_peered":"2024-09-21T03:53:13.831799+0000","last_unstale":"2024-09-21T03:53:33.122847+0000","last_undegraded":"2024-09-21T03:53:33.122847+0000","last_fullsized":"2024-09-21T03:53:33.122847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:33.923946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122733+0000","last_change":"2024-09-21T03:53:13.832142+0000","last_active":"2024-09-21T03:53:33.122733+0000","last_peered":"2024-09-21T03:53:33.122733+0000","last_clean":"2024-09-21T03:53:33.122733+0000","last_became_active":"2024-09-21T03:53:13.831756+0000","last_became_peered":"2024-09-21T03:53:13.831756+0000","last_unstale":"2024-09-21T03:53:33.122733+0000","last_undegraded":"2024-09-21T03:53:33.122733+0000","last_fullsized":"2024-09-21T03:53:33.122733+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:43.941161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032362+0000","last_change":"2024-09-21T03:53:13.834085+0000","last_active":"2024-09-21T03:53:33.032362+0000","last_peered":"2024-09-21T03:53:33.032362+0000","last_clean":"2024-09-21T03:53:33.032362+0000","last_became_active":"2024-09-21T03:53:13.833668+0000","last_became_peered":"2024-09-21T03:53:13.833668+0000","last_unstale":"2024-09-21T03:53:33.032362+0000","last_undegraded":"2024-09-21T03:53:33.032362+0000","last_fullsized":"2024-09-21T03:53:33.032362+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:08:26.939873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035098+0000","last_change":"2024-09-21T03:53:13.836133+0000","last_active":"2024-09-21T03:53:33.035098+0000","last_peered":"2024-09-21T03:53:33.035098+0000","last_clean":"2024-09-21T03:53:33.035098+0000","last_became_active":"2024-09-21T03:53:13.835681+0000","last_became_peered":"2024-09-21T03:53:13.835681+0000","last_unstale":"2024-09-21T03:53:33.035098+0000","last_undegraded":"2024-09-21T03:53:33.035098+0000","last_fullsized":"2024-09-21T03:53:33.035098+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:02.691622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035103+0000","last_change":"2024-09-21T03:53:13.834069+0000","last_active":"2024-09-21T03:53:33.035103+0000","last_peered":"2024-09-21T03:53:33.035103+0000","last_clean":"2024-09-21T03:53:33.035103+0000","last_became_active":"2024-09-21T03:53:13.833714+0000","last_became_peered":"2024-09-21T03:53:13.833714+0000","last_unstale":"2024-09-21T03:53:33.035103+0000","last_undegraded":"2024-09-21T03:53:33.035103+0000","last_fullsized":"2024-09-21T03:53:33.035103+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:12.479790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.095236+0000","last_change":"2024-09-21T03:53:13.827788+0000","last_active":"2024-09-21T03:53:33.095236+0000","last_peered":"2024-09-21T03:53:33.095236+0000","last_clean":"2024-09-21T03:53:33.095236+0000","last_became_active":"2024-09-21T03:53:13.827461+0000","last_became_peered":"2024-09-21T03:53:13.827461+0000","last_unstale":"2024-09-21T03:53:33.095236+0000","last_undegraded":"2024-09-21T03:53:33.095236+0000","last_fullsized":"2024-09-21T03:53:33.095236+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:38.003243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034635+0000","last_change":"2024-09-21T03:53:13.836880+0000","last_active":"2024-09-21T03:53:33.034635+0000","last_peered":"2024-09-21T03:53:33.034635+0000","last_clean":"2024-09-21T03:53:33.034635+0000","last_became_active":"2024-09-21T03:53:13.836531+0000","last_became_peered":"2024-09-21T03:53:13.836531+0000","last_unstale":"2024-09-21T03:53:33.034635+0000","last_undegraded":"2024-09-21T03:53:33.034635+0000","last_fullsized":"2024-09-21T03:53:33.034635+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:52.825826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031827+0000","last_change":"2024-09-21T03:53:13.823160+0000","last_active":"2024-09-21T03:53:33.031827+0000","last_peered":"2024-09-21T03:53:33.031827+0000","last_clean":"2024-09-21T03:53:33.031827+0000","last_became_active":"2024-09-21T03:53:13.822076+0000","last_became_peered":"2024-09-21T03:53:13.822076+0000","last_unstale":"2024-09-21T03:53:33.031827+0000","last_undegraded":"2024-09-21T03:53:33.031827+0000","last_fullsized":"2024-09-21T03:53:33.031827+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:26.277249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032827+0000","last_change":"2024-09-21T03:53:13.831822+0000","last_active":"2024-09-21T03:53:33.032827+0000","last_peered":"2024-09-21T03:53:33.032827+0000","last_clean":"2024-09-21T03:53:33.032827+0000","last_became_active":"2024-09-21T03:53:13.831395+0000","last_became_peered":"2024-09-21T03:53:13.831395+0000","last_unstale":"2024-09-21T03:53:33.032827+0000","last_undegraded":"2024-09-21T03:53:33.032827+0000","last_fullsized":"2024-09-21T03:53:33.032827+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:48.541339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122588+0000","last_change":"2024-09-21T03:53:13.834576+0000","last_active":"2024-09-21T03:53:33.122588+0000","last_peered":"2024-09-21T03:53:33.122588+0000","last_clean":"2024-09-21T03:53:33.122588+0000","last_became_active":"2024-09-21T03:53:13.834229+0000","last_became_peered":"2024-09-21T03:53:13.834229+0000","last_unstale":"2024-09-21T03:53:33.122588+0000","last_undegraded":"2024-09-21T03:53:33.122588+0000","last_fullsized":"2024-09-21T03:53:33.122588+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:36.101399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040298+0000","last_change":"2024-09-21T03:53:13.824049+0000","last_active":"2024-09-21T03:53:33.040298+0000","last_peered":"2024-09-21T03:53:33.040298+0000","last_clean":"2024-09-21T03:53:33.040298+0000","last_became_active":"2024-09-21T03:53:13.823510+0000","last_became_peered":"2024-09-21T03:53:13.823510+0000","last_unstale":"2024-09-21T03:53:33.040298+0000","last_undegraded":"2024-09-21T03:53:33.040298+0000","last_fullsized":"2024-09-21T03:53:33.040298+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:36.615951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123804+0000","last_change":"2024-09-21T03:53:13.837327+0000","last_active":"2024-09-21T03:53:33.123804+0000","last_peered":"2024-09-21T03:53:33.123804+0000","last_clean":"2024-09-21T03:53:33.123804+0000","last_became_active":"2024-09-21T03:53:13.836940+0000","last_became_peered":"2024-09-21T03:53:13.836940+0000","last_unstale":"2024-09-21T03:53:33.123804+0000","last_undegraded":"2024-09-21T03:53:33.123804+0000","last_fullsized":"2024-09-21T03:53:33.123804+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:49.248838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.095260+0000","last_change":"2024-09-21T03:53:13.829540+0000","last_active":"2024-09-21T03:53:33.095260+0000","last_peered":"2024-09-21T03:53:33.095260+0000","last_clean":"2024-09-21T03:53:33.095260+0000","last_became_active":"2024-09-21T03:53:13.828953+0000","last_became_peered":"2024-09-21T03:53:13.828953+0000","last_unstale":"2024-09-21T03:53:33.095260+0000","last_undegraded":"2024-09-21T03:53:33.095260+0000","last_fullsized":"2024-09-21T03:53:33.095260+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:07.631226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034762+0000","last_change":"2024-09-21T03:53:13.835009+0000","last_active":"2024-09-21T03:53:33.034762+0000","last_peered":"2024-09-21T03:53:33.034762+0000","last_clean":"2024-09-21T03:53:33.034762+0000","last_became_active":"2024-09-21T03:53:13.834454+0000","last_became_peered":"2024-09-21T03:53:13.834454+0000","last_unstale":"2024-09-21T03:53:33.034762+0000","last_undegraded":"2024-09-21T03:53:33.034762+0000","last_fullsized":"2024-09-21T03:53:33.034762+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:34:06.114394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031624+0000","last_change":"2024-09-21T03:53:13.826846+0000","last_active":"2024-09-21T03:53:33.031624+0000","last_peered":"2024-09-21T03:53:33.031624+0000","last_clean":"2024-09-21T03:53:33.031624+0000","last_became_active":"2024-09-21T03:53:13.826460+0000","last_became_peered":"2024-09-21T03:53:13.826460+0000","last_unstale":"2024-09-21T03:53:33.031624+0000","last_undegraded":"2024-09-21T03:53:33.031624+0000","last_fullsized":"2024-09-21T03:53:33.031624+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:24.081091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123429+0000","last_change":"2024-09-21T03:53:13.837134+0000","last_active":"2024-09-21T03:53:33.123429+0000","last_peered":"2024-09-21T03:53:33.123429+0000","last_clean":"2024-09-21T03:53:33.123429+0000","last_became_active":"2024-09-21T03:53:13.836729+0000","last_became_peered":"2024-09-21T03:53:13.836729+0000","last_unstale":"2024-09-21T03:53:33.123429+0000","last_undegraded":"2024-09-21T03:53:33.123429+0000","last_fullsized":"2024-09-21T03:53:33.123429+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:08.677375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.094680+0000","last_change":"2024-09-21T03:53:13.838100+0000","last_active":"2024-09-21T03:53:33.094680+0000","last_peered":"2024-09-21T03:53:33.094680+0000","last_clean":"2024-09-21T03:53:33.094680+0000","last_became_active":"2024-09-21T03:53:13.833495+0000","last_became_peered":"2024-09-21T03:53:13.833495+0000","last_unstale":"2024-09-21T03:53:33.094680+0000","last_undegraded":"2024-09-21T03:53:33.094680+0000","last_fullsized":"2024-09-21T03:53:33.094680+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:52:00.705434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.095021+0000","last_change":"2024-09-21T03:53:13.835806+0000","last_active":"2024-09-21T03:53:33.095021+0000","last_peered":"2024-09-21T03:53:33.095021+0000","last_clean":"2024-09-21T03:53:33.095021+0000","last_became_active":"2024-09-21T03:53:13.835453+0000","last_became_peered":"2024-09-21T03:53:13.835453+0000","last_unstale":"2024-09-21T03:53:33.095021+0000","last_undegraded":"2024-09-21T03:53:33.095021+0000","last_fullsized":"2024-09-21T03:53:33.095021+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:56:16.296808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034530+0000","last_change":"2024-09-21T03:53:13.831171+0000","last_active":"2024-09-21T03:53:33.034530+0000","last_peered":"2024-09-21T03:53:33.034530+0000","last_clean":"2024-09-21T03:53:33.034530+0000","last_became_active":"2024-09-21T03:53:13.830734+0000","last_became_peered":"2024-09-21T03:53:13.830734+0000","last_unstale":"2024-09-21T03:53:33.034530+0000","last_undegraded":"2024-09-21T03:53:33.034530+0000","last_fullsized":"2024-09-21T03:53:33.034530+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:00:56.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123100+0000","last_change":"2024-09-21T03:53:13.820580+0000","last_active":"2024-09-21T03:53:33.123100+0000","last_peered":"2024-09-21T03:53:33.123100+0000","last_clean":"2024-09-21T03:53:33.123100+0000","last_became_active":"2024-09-21T03:53:13.820237+0000","last_became_peered":"2024-09-21T03:53:13.820237+0000","last_unstale":"2024-09-21T03:53:33.123100+0000","last_undegraded":"2024-09-21T03:53:33.123100+0000","last_fullsized":"2024-09-21T03:53:33.123100+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:15.067629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040549+0000","last_change":"2024-09-21T03:53:11.804667+0000","last_active":"2024-09-21T03:53:33.040549+0000","last_peered":"2024-09-21T03:53:33.040549+0000","last_clean":"2024-09-21T03:53:33.040549+0000","last_became_active":"2024-09-21T03:53:11.804231+0000","last_became_peered":"2024-09-21T03:53:11.804231+0000","last_unstale":"2024-09-21T03:53:33.040549+0000","last_undegraded":"2024-09-21T03:53:33.040549+0000","last_fullsized":"2024-09-21T03:53:33.040549+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:36.425699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040361+0000","last_change":"2024-09-21T03:53:13.831602+0000","last_active":"2024-09-21T03:53:33.040361+0000","last_peered":"2024-09-21T03:53:33.040361+0000","last_clean":"2024-09-21T03:53:33.040361+0000","last_became_active":"2024-09-21T03:53:13.831274+0000","last_became_peered":"2024-09-21T03:53:13.831274+0000","last_unstale":"2024-09-21T03:53:33.040361+0000","last_undegraded":"2024-09-21T03:53:33.040361+0000","last_fullsized":"2024-09-21T03:53:33.040361+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:33.603025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123276+0000","last_change":"2024-09-21T03:53:11.807722+0000","last_active":"2024-09-21T03:53:33.123276+0000","last_peered":"2024-09-21T03:53:33.123276+0000","last_clean":"2024-09-21T03:53:33.123276+0000","last_became_active":"2024-09-21T03:53:11.807294+0000","last_became_peered":"2024-09-21T03:53:11.807294+0000","last_unstale":"2024-09-21T03:53:33.123276+0000","last_undegraded":"2024-09-21T03:53:33.123276+0000","last_fullsized":"2024-09-21T03:53:33.123276+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:59.696572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031405+0000","last_change":"2024-09-21T03:53:11.803680+0000","last_active":"2024-09-21T03:53:33.031405+0000","last_peered":"2024-09-21T03:53:33.031405+0000","last_clean":"2024-09-21T03:53:33.031405+0000","last_became_active":"2024-09-21T03:53:11.803310+0000","last_became_peered":"2024-09-21T03:53:11.803310+0000","last_unstale":"2024-09-21T03:53:33.031405+0000","last_undegraded":"2024-09-21T03:53:33.031405+0000","last_fullsized":"2024-09-21T03:53:33.031405+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:25.276545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122501+0000","last_change":"2024-09-21T03:53:13.834847+0000","last_active":"2024-09-21T03:53:33.122501+0000","last_peered":"2024-09-21T03:53:33.122501+0000","last_clean":"2024-09-21T03:53:33.122501+0000","last_became_active":"2024-09-21T03:53:13.834448+0000","last_became_peered":"2024-09-21T03:53:13.834448+0000","last_unstale":"2024-09-21T03:53:33.122501+0000","last_undegraded":"2024-09-21T03:53:33.122501+0000","last_fullsized":"2024-09-21T03:53:33.122501+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:47:39.213364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040606+0000","last_change":"2024-09-21T03:53:11.807372+0000","last_active":"2024-09-21T03:53:33.040606+0000","last_peered":"2024-09-21T03:53:33.040606+0000","last_clean":"2024-09-21T03:53:33.040606+0000","last_became_active":"2024-09-21T03:53:11.807064+0000","last_became_peered":"2024-09-21T03:53:11.807064+0000","last_unstale":"2024-09-21T03:53:33.040606+0000","last_undegraded":"2024-09-21T03:53:33.040606+0000","last_fullsized":"2024-09-21T03:53:33.040606+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:00.743039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034954+0000","last_change":"2024-09-21T03:53:13.821169+0000","last_active":"2024-09-21T03:53:33.034954+0000","last_peered":"2024-09-21T03:53:33.034954+0000","last_clean":"2024-09-21T03:53:33.034954+0000","last_became_active":"2024-09-21T03:53:13.820810+0000","last_became_peered":"2024-09-21T03:53:13.820810+0000","last_unstale":"2024-09-21T03:53:33.034954+0000","last_undegraded":"2024-09-21T03:53:33.034954+0000","last_fullsized":"2024-09-21T03:53:33.034954+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:54.568383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124708+0000","last_change":"2024-09-21T03:53:11.805663+0000","last_active":"2024-09-21T03:53:33.124708+0000","last_peered":"2024-09-21T03:53:33.124708+0000","last_clean":"2024-09-21T03:53:33.124708+0000","last_became_active":"2024-09-21T03:53:11.805099+0000","last_became_peered":"2024-09-21T03:53:11.805099+0000","last_unstale":"2024-09-21T03:53:33.124708+0000","last_undegraded":"2024-09-21T03:53:33.124708+0000","last_fullsized":"2024-09-21T03:53:33.124708+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:47.306589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032728+0000","last_change":"2024-09-21T03:53:13.827745+0000","last_active":"2024-09-21T03:53:33.032728+0000","last_peered":"2024-09-21T03:53:33.032728+0000","last_clean":"2024-09-21T03:53:33.032728+0000","last_became_active":"2024-09-21T03:53:13.827229+0000","last_became_peered":"2024-09-21T03:53:13.827229+0000","last_unstale":"2024-09-21T03:53:33.032728+0000","last_undegraded":"2024-09-21T03:53:33.032728+0000","last_fullsized":"2024-09-21T03:53:33.032728+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:53.760919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036288+0000","last_change":"2024-09-21T03:53:11.803697+0000","last_active":"2024-09-21T03:53:33.036288+0000","last_peered":"2024-09-21T03:53:33.036288+0000","last_clean":"2024-09-21T03:53:33.036288+0000","last_became_active":"2024-09-21T03:53:11.801539+0000","last_became_peered":"2024-09-21T03:53:11.801539+0000","last_unstale":"2024-09-21T03:53:33.036288+0000","last_undegraded":"2024-09-21T03:53:33.036288+0000","last_fullsized":"2024-09-21T03:53:33.036288+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:53.096622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123637+0000","last_change":"2024-09-21T03:53:13.832771+0000","last_active":"2024-09-21T03:53:33.123637+0000","last_peered":"2024-09-21T03:53:33.123637+0000","last_clean":"2024-09-21T03:53:33.123637+0000","last_became_active":"2024-09-21T03:53:13.832414+0000","last_became_peered":"2024-09-21T03:53:13.832414+0000","last_unstale":"2024-09-21T03:53:33.123637+0000","last_undegraded":"2024-09-21T03:53:33.123637+0000","last_fullsized":"2024-09-21T03:53:33.123637+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:58:42.287731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.041017+0000","last_change":"2024-09-21T03:53:12.604482+0000","last_active":"2024-09-21T03:53:33.041017+0000","last_peered":"2024-09-21T03:53:33.041017+0000","last_clean":"2024-09-21T03:53:33.041017+0000","last_became_active":"2024-09-21T03:53:12.603973+0000","last_became_peered":"2024-09-21T03:53:12.603973+0000","last_unstale":"2024-09-21T03:53:33.041017+0000","last_undegraded":"2024-09-21T03:53:33.041017+0000","last_fullsized":"2024-09-21T03:53:33.041017+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:11.932329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032506+0000","last_change":"2024-09-21T03:53:13.842106+0000","last_active":"2024-09-21T03:53:33.032506+0000","last_peered":"2024-09-21T03:53:33.032506+0000","last_clean":"2024-09-21T03:53:33.032506+0000","last_became_active":"2024-09-21T03:53:13.841758+0000","last_became_peered":"2024-09-21T03:53:13.841758+0000","last_unstale":"2024-09-21T03:53:33.032506+0000","last_undegraded":"2024-09-21T03:53:33.032506+0000","last_fullsized":"2024-09-21T03:53:33.032506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:37.045045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'28","reported_seq":172,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:54:16.974280+0000","last_change":"2024-09-21T03:53:11.805385+0000","last_active":"2024-09-21T03:54:16.974280+0000","last_peered":"2024-09-21T03:54:16.974280+0000","last_clean":"2024-09-21T03:54:16.974280+0000","last_became_active":"2024-09-21T03:53:11.804958+0000","last_became_peered":"2024-09-21T03:53:11.804958+0000","last_unstale":"2024-09-21T03:54:16.974280+0000","last_undegraded":"2024-09-21T03:54:16.974280+0000","last_fullsized":"2024-09-21T03:54:16.974280+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:59.197216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66957,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":121,"num_read_kb":125,"num_write":28,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123691+0000","last_change":"2024-09-21T03:53:13.828095+0000","last_active":"2024-09-21T03:53:33.123691+0000","last_peered":"2024-09-21T03:53:33.123691+0000","last_clean":"2024-09-21T03:53:33.123691+0000","last_became_active":"2024-09-21T03:53:13.827761+0000","last_became_peered":"2024-09-21T03:53:13.827761+0000","last_unstale":"2024-09-21T03:53:33.123691+0000","last_undegraded":"2024-09-21T03:53:33.123691+0000","last_fullsized":"2024-09-21T03:53:33.123691+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:42:28.981463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.094939+0000","last_change":"2024-09-21T03:53:11.801611+0000","last_active":"2024-09-21T03:53:33.094939+0000","last_peered":"2024-09-21T03:53:33.094939+0000","last_clean":"2024-09-21T03:53:33.094939+0000","last_became_active":"2024-09-21T03:53:11.801185+0000","last_became_peered":"2024-09-21T03:53:11.801185+0000","last_unstale":"2024-09-21T03:53:33.094939+0000","last_undegraded":"2024-09-21T03:53:33.094939+0000","last_fullsized":"2024-09-21T03:53:33.094939+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:16.990963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031447+0000","last_change":"2024-09-21T03:53:13.827393+0000","last_active":"2024-09-21T03:53:33.031447+0000","last_peered":"2024-09-21T03:53:33.031447+0000","last_clean":"2024-09-21T03:53:33.031447+0000","last_became_active":"2024-09-21T03:53:13.826912+0000","last_became_peered":"2024-09-21T03:53:13.826912+0000","last_unstale":"2024-09-21T03:53:33.031447+0000","last_undegraded":"2024-09-21T03:53:33.031447+0000","last_fullsized":"2024-09-21T03:53:33.031447+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:52.313989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040555+0000","last_change":"2024-09-21T03:53:11.805437+0000","last_active":"2024-09-21T03:53:33.040555+0000","last_peered":"2024-09-21T03:53:33.040555+0000","last_clean":"2024-09-21T03:53:33.040555+0000","last_became_active":"2024-09-21T03:53:11.805048+0000","last_became_peered":"2024-09-21T03:53:11.805048+0000","last_unstale":"2024-09-21T03:53:33.040555+0000","last_undegraded":"2024-09-21T03:53:33.040555+0000","last_fullsized":"2024-09-21T03:53:33.040555+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:03.288694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036034+0000","last_change":"2024-09-21T03:53:13.836917+0000","last_active":"2024-09-21T03:53:33.036034+0000","last_peered":"2024-09-21T03:53:33.036034+0000","last_clean":"2024-09-21T03:53:33.036034+0000","last_became_active":"2024-09-21T03:53:13.836514+0000","last_became_peered":"2024-09-21T03:53:13.836514+0000","last_unstale":"2024-09-21T03:53:33.036034+0000","last_undegraded":"2024-09-21T03:53:33.036034+0000","last_fullsized":"2024-09-21T03:53:33.036034+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:17.512017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123559+0000","last_change":"2024-09-21T03:53:11.808403+0000","last_active":"2024-09-21T03:53:33.123559+0000","last_peered":"2024-09-21T03:53:33.123559+0000","last_clean":"2024-09-21T03:53:33.123559+0000","last_became_active":"2024-09-21T03:53:11.807895+0000","last_became_peered":"2024-09-21T03:53:11.807895+0000","last_unstale":"2024-09-21T03:53:33.123559+0000","last_undegraded":"2024-09-21T03:53:33.123559+0000","last_fullsized":"2024-09-21T03:53:33.123559+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:33.548683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.125777+0000","last_change":"2024-09-21T03:53:33.125556+0000","last_active":"2024-09-21T03:53:33.125777+0000","last_peered":"2024-09-21T03:53:33.125777+0000","last_clean":"2024-09-21T03:53:33.125777+0000","last_became_active":"2024-09-21T03:53:33.125084+0000","last_became_peered":"2024-09-21T03:53:33.125084+0000","last_unstale":"2024-09-21T03:53:33.125777+0000","last_undegraded":"2024-09-21T03:53:33.125777+0000","last_fullsized":"2024-09-21T03:53:33.125777+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:40:23.997329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'8","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123320+0000","last_change":"2024-09-21T03:53:12.605672+0000","last_active":"2024-09-21T03:53:33.123320+0000","last_peered":"2024-09-21T03:53:33.123320+0000","last_clean":"2024-09-21T03:53:33.123320+0000","last_became_active":"2024-09-21T03:53:12.604644+0000","last_became_peered":"2024-09-21T03:53:12.604644+0000","last_unstale":"2024-09-21T03:53:33.123320+0000","last_undegraded":"2024-09-21T03:53:33.123320+0000","last_fullsized":"2024-09-21T03:53:33.123320+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:44.810762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040395+0000","last_change":"2024-09-21T03:53:13.833861+0000","last_active":"2024-09-21T03:53:33.040395+0000","last_peered":"2024-09-21T03:53:33.040395+0000","last_clean":"2024-09-21T03:53:33.040395+0000","last_became_active":"2024-09-21T03:53:13.832900+0000","last_became_peered":"2024-09-21T03:53:13.832900+0000","last_unstale":"2024-09-21T03:53:33.040395+0000","last_undegraded":"2024-09-21T03:53:33.040395+0000","last_fullsized":"2024-09-21T03:53:33.040395+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:12.047171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124020+0000","last_change":"2024-09-21T03:53:11.799844+0000","last_active":"2024-09-21T03:53:33.124020+0000","last_peered":"2024-09-21T03:53:33.124020+0000","last_clean":"2024-09-21T03:53:33.124020+0000","last_became_active":"2024-09-21T03:53:11.799412+0000","last_became_peered":"2024-09-21T03:53:11.799412+0000","last_unstale":"2024-09-21T03:53:33.124020+0000","last_undegraded":"2024-09-21T03:53:33.124020+0000","last_fullsized":"2024-09-21T03:53:33.124020+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:49.826500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034751+0000","last_change":"2024-09-21T03:53:13.836690+0000","last_active":"2024-09-21T03:53:33.034751+0000","last_peered":"2024-09-21T03:53:33.034751+0000","last_clean":"2024-09-21T03:53:33.034751+0000","last_became_active":"2024-09-21T03:53:13.836337+0000","last_became_peered":"2024-09-21T03:53:13.836337+0000","last_unstale":"2024-09-21T03:53:33.034751+0000","last_undegraded":"2024-09-21T03:53:33.034751+0000","last_fullsized":"2024-09-21T03:53:33.034751+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:15.999869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031625+0000","last_change":"2024-09-21T03:53:11.799597+0000","last_active":"2024-09-21T03:53:33.031625+0000","last_peered":"2024-09-21T03:53:33.031625+0000","last_clean":"2024-09-21T03:53:33.031625+0000","last_became_active":"2024-09-21T03:53:11.799175+0000","last_became_peered":"2024-09-21T03:53:11.799175+0000","last_unstale":"2024-09-21T03:53:33.031625+0000","last_undegraded":"2024-09-21T03:53:33.031625+0000","last_fullsized":"2024-09-21T03:53:33.031625+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:41.668587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036592+0000","last_change":"2024-09-21T03:53:13.831228+0000","last_active":"2024-09-21T03:53:33.036592+0000","last_peered":"2024-09-21T03:53:33.036592+0000","last_clean":"2024-09-21T03:53:33.036592+0000","last_became_active":"2024-09-21T03:53:13.830880+0000","last_became_peered":"2024-09-21T03:53:13.830880+0000","last_unstale":"2024-09-21T03:53:33.036592+0000","last_undegraded":"2024-09-21T03:53:33.036592+0000","last_fullsized":"2024-09-21T03:53:33.036592+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:45.770622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.041069+0000","last_change":"2024-09-21T03:53:11.803560+0000","last_active":"2024-09-21T03:53:33.041069+0000","last_peered":"2024-09-21T03:53:33.041069+0000","last_clean":"2024-09-21T03:53:33.041069+0000","last_became_active":"2024-09-21T03:53:11.803090+0000","last_became_peered":"2024-09-21T03:53:11.803090+0000","last_unstale":"2024-09-21T03:53:33.041069+0000","last_undegraded":"2024-09-21T03:53:33.041069+0000","last_fullsized":"2024-09-21T03:53:33.041069+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:23.993694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036373+0000","last_change":"2024-09-21T03:53:13.825907+0000","last_active":"2024-09-21T03:53:33.036373+0000","last_peered":"2024-09-21T03:53:33.036373+0000","last_clean":"2024-09-21T03:53:33.036373+0000","last_became_active":"2024-09-21T03:53:13.825485+0000","last_became_peered":"2024-09-21T03:53:13.825485+0000","last_unstale":"2024-09-21T03:53:33.036373+0000","last_undegraded":"2024-09-21T03:53:33.036373+0000","last_fullsized":"2024-09-21T03:53:33.036373+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:39.166215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.095338+0000","last_change":"2024-09-21T03:53:12.605947+0000","last_active":"2024-09-21T03:53:33.095338+0000","last_peered":"2024-09-21T03:53:33.095338+0000","last_clean":"2024-09-21T03:53:33.095338+0000","last_became_active":"2024-09-21T03:53:12.604516+0000","last_became_peered":"2024-09-21T03:53:12.604516+0000","last_unstale":"2024-09-21T03:53:33.095338+0000","last_undegraded":"2024-09-21T03:53:33.095338+0000","last_fullsized":"2024-09-21T03:53:33.095338+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:42.500174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036503+0000","last_change":"2024-09-21T03:53:13.834108+0000","last_active":"2024-09-21T03:53:33.036503+0000","last_peered":"2024-09-21T03:53:33.036503+0000","last_clean":"2024-09-21T03:53:33.036503+0000","last_became_active":"2024-09-21T03:53:13.833734+0000","last_became_peered":"2024-09-21T03:53:13.833734+0000","last_unstale":"2024-09-21T03:53:33.036503+0000","last_undegraded":"2024-09-21T03:53:33.036503+0000","last_fullsized":"2024-09-21T03:53:33.036503+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:39.032450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":97,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036156+0000","last_change":"2024-09-21T03:51:59.139085+0000","last_active":"2024-09-21T03:53:33.036156+0000","last_peered":"2024-09-21T03:53:33.036156+0000","last_clean":"2024-09-21T03:53:33.036156+0000","last_became_active":"2024-09-21T03:51:59.026450+0000","last_became_peered":"2024-09-21T03:51:59.026450+0000","last_unstale":"2024-09-21T03:53:33.036156+0000","last_undegraded":"2024-09-21T03:53:33.036156+0000","last_fullsized":"2024-09-21T03:53:33.036156+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:48:31.139457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:48:31.139457+0000","last_clean_scrub_stamp":"2024-09-21T03:48:31.139457+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:54.047170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123454+0000","last_change":"2024-09-21T03:53:11.805792+0000","last_active":"2024-09-21T03:53:33.123454+0000","last_peered":"2024-09-21T03:53:33.123454+0000","last_clean":"2024-09-21T03:53:33.123454+0000","last_became_active":"2024-09-21T03:53:11.805375+0000","last_became_peered":"2024-09-21T03:53:11.805375+0000","last_unstale":"2024-09-21T03:53:33.123454+0000","last_undegraded":"2024-09-21T03:53:33.123454+0000","last_fullsized":"2024-09-21T03:53:33.123454+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:55.466187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122971+0000","last_change":"2024-09-21T03:53:13.835211+0000","last_active":"2024-09-21T03:53:33.122971+0000","last_peered":"2024-09-21T03:53:33.122971+0000","last_clean":"2024-09-21T03:53:33.122971+0000","last_became_active":"2024-09-21T03:53:13.833649+0000","last_became_peered":"2024-09-21T03:53:13.833649+0000","last_unstale":"2024-09-21T03:53:33.122971+0000","last_undegraded":"2024-09-21T03:53:33.122971+0000","last_fullsized":"2024-09-21T03:53:33.122971+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:57.962287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035996+0000","last_change":"2024-09-21T03:53:11.801670+0000","last_active":"2024-09-21T03:53:33.035996+0000","last_peered":"2024-09-21T03:53:33.035996+0000","last_clean":"2024-09-21T03:53:33.035996+0000","last_became_active":"2024-09-21T03:53:11.801291+0000","last_became_peered":"2024-09-21T03:53:11.801291+0000","last_unstale":"2024-09-21T03:53:33.035996+0000","last_undegraded":"2024-09-21T03:53:33.035996+0000","last_fullsized":"2024-09-21T03:53:33.035996+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:37.450592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.096813+0000","last_change":"2024-09-21T03:53:33.096727+0000","last_active":"2024-09-21T03:53:33.096813+0000","last_peered":"2024-09-21T03:53:33.096813+0000","last_clean":"2024-09-21T03:53:33.096813+0000","last_became_active":"2024-09-21T03:53:33.096234+0000","last_became_peered":"2024-09-21T03:53:33.096234+0000","last_unstale":"2024-09-21T03:53:33.096813+0000","last_undegraded":"2024-09-21T03:53:33.096813+0000","last_fullsized":"2024-09-21T03:53:33.096813+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:56:24.375992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031550+0000","last_change":"2024-09-21T03:53:12.604170+0000","last_active":"2024-09-21T03:53:33.031550+0000","last_peered":"2024-09-21T03:53:33.031550+0000","last_clean":"2024-09-21T03:53:33.031550+0000","last_became_active":"2024-09-21T03:53:12.603765+0000","last_became_peered":"2024-09-21T03:53:12.603765+0000","last_unstale":"2024-09-21T03:53:33.031550+0000","last_undegraded":"2024-09-21T03:53:33.031550+0000","last_fullsized":"2024-09-21T03:53:33.031550+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:08.606037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.125077+0000","last_change":"2024-09-21T03:53:33.124969+0000","last_active":"2024-09-21T03:53:33.125077+0000","last_peered":"2024-09-21T03:53:33.125077+0000","last_clean":"2024-09-21T03:53:33.125077+0000","last_became_active":"2024-09-21T03:53:33.124496+0000","last_became_peered":"2024-09-21T03:53:33.124496+0000","last_unstale":"2024-09-21T03:53:33.125077+0000","last_undegraded":"2024-09-21T03:53:33.125077+0000","last_fullsized":"2024-09-21T03:53:33.125077+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:56.730146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036128+0000","last_change":"2024-09-21T03:53:11.803316+0000","last_active":"2024-09-21T03:53:33.036128+0000","last_peered":"2024-09-21T03:53:33.036128+0000","last_clean":"2024-09-21T03:53:33.036128+0000","last_became_active":"2024-09-21T03:53:11.801976+0000","last_became_peered":"2024-09-21T03:53:11.801976+0000","last_unstale":"2024-09-21T03:53:33.036128+0000","last_undegraded":"2024-09-21T03:53:33.036128+0000","last_fullsized":"2024-09-21T03:53:33.036128+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:43.596037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124177+0000","last_change":"2024-09-21T03:53:13.838006+0000","last_active":"2024-09-21T03:53:33.124177+0000","last_peered":"2024-09-21T03:53:33.124177+0000","last_clean":"2024-09-21T03:53:33.124177+0000","last_became_active":"2024-09-21T03:53:13.835903+0000","last_became_peered":"2024-09-21T03:53:13.835903+0000","last_unstale":"2024-09-21T03:53:33.124177+0000","last_undegraded":"2024-09-21T03:53:33.124177+0000","last_fullsized":"2024-09-21T03:53:33.124177+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:54:56.730044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124836+0000","last_change":"2024-09-21T03:53:33.124720+0000","last_active":"2024-09-21T03:53:33.124836+0000","last_peered":"2024-09-21T03:53:33.124836+0000","last_clean":"2024-09-21T03:53:33.124836+0000","last_became_active":"2024-09-21T03:53:33.124232+0000","last_became_peered":"2024-09-21T03:53:33.124232+0000","last_unstale":"2024-09-21T03:53:33.124836+0000","last_undegraded":"2024-09-21T03:53:33.124836+0000","last_fullsized":"2024-09-21T03:53:33.124836+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:23.810493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124631+0000","last_change":"2024-09-21T03:53:13.827805+0000","last_active":"2024-09-21T03:53:33.124631+0000","last_peered":"2024-09-21T03:53:33.124631+0000","last_clean":"2024-09-21T03:53:33.124631+0000","last_became_active":"2024-09-21T03:53:13.827368+0000","last_became_peered":"2024-09-21T03:53:13.827368+0000","last_unstale":"2024-09-21T03:53:33.124631+0000","last_undegraded":"2024-09-21T03:53:33.124631+0000","last_fullsized":"2024-09-21T03:53:33.124631+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:24.539396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123881+0000","last_change":"2024-09-21T03:53:12.605032+0000","last_active":"2024-09-21T03:53:33.123881+0000","last_peered":"2024-09-21T03:53:33.123881+0000","last_clean":"2024-09-21T03:53:33.123881+0000","last_became_active":"2024-09-21T03:53:12.604561+0000","last_became_peered":"2024-09-21T03:53:12.604561+0000","last_unstale":"2024-09-21T03:53:33.123881+0000","last_undegraded":"2024-09-21T03:53:33.123881+0000","last_fullsized":"2024-09-21T03:53:33.123881+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:20.361768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031744+0000","last_change":"2024-09-21T03:53:13.821539+0000","last_active":"2024-09-21T03:53:33.031744+0000","last_peered":"2024-09-21T03:53:33.031744+0000","last_clean":"2024-09-21T03:53:33.031744+0000","last_became_active":"2024-09-21T03:53:13.821196+0000","last_became_peered":"2024-09-21T03:53:13.821196+0000","last_unstale":"2024-09-21T03:53:33.031744+0000","last_undegraded":"2024-09-21T03:53:33.031744+0000","last_fullsized":"2024-09-21T03:53:33.031744+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:00.627993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'10","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:36.828012+0000","last_change":"2024-09-21T03:53:11.799669+0000","last_active":"2024-09-21T03:53:36.828012+0000","last_peered":"2024-09-21T03:53:36.828012+0000","last_clean":"2024-09-21T03:53:36.828012+0000","last_became_active":"2024-09-21T03:53:11.799355+0000","last_became_peered":"2024-09-21T03:53:11.799355+0000","last_unstale":"2024-09-21T03:53:36.828012+0000","last_undegraded":"2024-09-21T03:53:36.828012+0000","last_fullsized":"2024-09-21T03:53:36.828012+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:33.032206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123797+0000","last_change":"2024-09-21T03:53:13.828551+0000","last_active":"2024-09-21T03:53:33.123797+0000","last_peered":"2024-09-21T03:53:33.123797+0000","last_clean":"2024-09-21T03:53:33.123797+0000","last_became_active":"2024-09-21T03:53:13.828185+0000","last_became_peered":"2024-09-21T03:53:13.828185+0000","last_unstale":"2024-09-21T03:53:33.123797+0000","last_undegraded":"2024-09-21T03:53:33.123797+0000","last_fullsized":"2024-09-21T03:53:33.123797+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:31.852755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124078+0000","last_change":"2024-09-21T03:53:12.279823+0000","last_active":"2024-09-21T03:53:33.124078+0000","last_peered":"2024-09-21T03:53:33.124078+0000","last_clean":"2024-09-21T03:53:33.124078+0000","last_became_active":"2024-09-21T03:53:12.279384+0000","last_became_peered":"2024-09-21T03:53:12.279384+0000","last_unstale":"2024-09-21T03:53:33.124078+0000","last_undegraded":"2024-09-21T03:53:33.124078+0000","last_fullsized":"2024-09-21T03:53:33.124078+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:42.568690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123319+0000","last_change":"2024-09-21T03:53:13.831041+0000","last_active":"2024-09-21T03:53:33.123319+0000","last_peered":"2024-09-21T03:53:33.123319+0000","last_clean":"2024-09-21T03:53:33.123319+0000","last_became_active":"2024-09-21T03:53:13.830654+0000","last_became_peered":"2024-09-21T03:53:13.830654+0000","last_unstale":"2024-09-21T03:53:33.123319+0000","last_undegraded":"2024-09-21T03:53:33.123319+0000","last_fullsized":"2024-09-21T03:53:33.123319+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:04.815719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032478+0000","last_change":"2024-09-21T03:53:12.604949+0000","last_active":"2024-09-21T03:53:33.032478+0000","last_peered":"2024-09-21T03:53:33.032478+0000","last_clean":"2024-09-21T03:53:33.032478+0000","last_became_active":"2024-09-21T03:53:12.604516+0000","last_became_peered":"2024-09-21T03:53:12.604516+0000","last_unstale":"2024-09-21T03:53:33.032478+0000","last_undegraded":"2024-09-21T03:53:33.032478+0000","last_fullsized":"2024-09-21T03:53:33.032478+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:33.964125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123050+0000","last_change":"2024-09-21T03:53:13.834813+0000","last_active":"2024-09-21T03:53:33.123050+0000","last_peered":"2024-09-21T03:53:33.123050+0000","last_clean":"2024-09-21T03:53:33.123050+0000","last_became_active":"2024-09-21T03:53:13.834436+0000","last_became_peered":"2024-09-21T03:53:13.834436+0000","last_unstale":"2024-09-21T03:53:33.123050+0000","last_undegraded":"2024-09-21T03:53:33.123050+0000","last_fullsized":"2024-09-21T03:53:33.123050+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:42:40.990668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122665+0000","last_change":"2024-09-21T03:53:11.801828+0000","last_active":"2024-09-21T03:53:33.122665+0000","last_peered":"2024-09-21T03:53:33.122665+0000","last_clean":"2024-09-21T03:53:33.122665+0000","last_became_active":"2024-09-21T03:53:11.800969+0000","last_became_peered":"2024-09-21T03:53:11.800969+0000","last_unstale":"2024-09-21T03:53:33.122665+0000","last_undegraded":"2024-09-21T03:53:33.122665+0000","last_fullsized":"2024-09-21T03:53:33.122665+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:36.117523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034772+0000","last_change":"2024-09-21T03:53:13.835393+0000","last_active":"2024-09-21T03:53:33.034772+0000","last_peered":"2024-09-21T03:53:33.034772+0000","last_clean":"2024-09-21T03:53:33.034772+0000","last_became_active":"2024-09-21T03:53:13.834541+0000","last_became_peered":"2024-09-21T03:53:13.834541+0000","last_unstale":"2024-09-21T03:53:33.034772+0000","last_undegraded":"2024-09-21T03:53:33.034772+0000","last_fullsized":"2024-09-21T03:53:33.034772+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:40.140004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.125328+0000","last_change":"2024-09-21T03:53:33.124524+0000","last_active":"2024-09-21T03:53:33.125328+0000","last_peered":"2024-09-21T03:53:33.125328+0000","last_clean":"2024-09-21T03:53:33.125328+0000","last_became_active":"2024-09-21T03:53:33.123945+0000","last_became_peered":"2024-09-21T03:53:33.123945+0000","last_unstale":"2024-09-21T03:53:33.125328+0000","last_undegraded":"2024-09-21T03:53:33.125328+0000","last_fullsized":"2024-09-21T03:53:33.125328+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:50.967123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122926+0000","last_change":"2024-09-21T03:53:13.832597+0000","last_active":"2024-09-21T03:53:33.122926+0000","last_peered":"2024-09-21T03:53:33.122926+0000","last_clean":"2024-09-21T03:53:33.122926+0000","last_became_active":"2024-09-21T03:53:13.832237+0000","last_became_peered":"2024-09-21T03:53:13.832237+0000","last_unstale":"2024-09-21T03:53:33.122926+0000","last_undegraded":"2024-09-21T03:53:33.122926+0000","last_fullsized":"2024-09-21T03:53:33.122926+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:31.907478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123185+0000","last_change":"2024-09-21T03:53:11.804875+0000","last_active":"2024-09-21T03:53:33.123185+0000","last_peered":"2024-09-21T03:53:33.123185+0000","last_clean":"2024-09-21T03:53:33.123185+0000","last_became_active":"2024-09-21T03:53:11.804320+0000","last_became_peered":"2024-09-21T03:53:11.804320+0000","last_unstale":"2024-09-21T03:53:33.123185+0000","last_undegraded":"2024-09-21T03:53:33.123185+0000","last_fullsized":"2024-09-21T03:53:33.123185+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:37:58.747573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035965+0000","last_change":"2024-09-21T03:53:13.837804+0000","last_active":"2024-09-21T03:53:33.035965+0000","last_peered":"2024-09-21T03:53:33.035965+0000","last_clean":"2024-09-21T03:53:33.035965+0000","last_became_active":"2024-09-21T03:53:13.837440+0000","last_became_peered":"2024-09-21T03:53:13.837440+0000","last_unstale":"2024-09-21T03:53:33.035965+0000","last_undegraded":"2024-09-21T03:53:33.035965+0000","last_fullsized":"2024-09-21T03:53:33.035965+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:15.471544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040923+0000","last_change":"2024-09-21T03:53:13.833231+0000","last_active":"2024-09-21T03:53:33.040923+0000","last_peered":"2024-09-21T03:53:33.040923+0000","last_clean":"2024-09-21T03:53:33.040923+0000","last_became_active":"2024-09-21T03:53:13.832908+0000","last_became_peered":"2024-09-21T03:53:13.832908+0000","last_unstale":"2024-09-21T03:53:33.040923+0000","last_undegraded":"2024-09-21T03:53:33.040923+0000","last_fullsized":"2024-09-21T03:53:33.040923+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:40.191231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123570+0000","last_change":"2024-09-21T03:53:11.802237+0000","last_active":"2024-09-21T03:53:33.123570+0000","last_peered":"2024-09-21T03:53:33.123570+0000","last_clean":"2024-09-21T03:53:33.123570+0000","last_became_active":"2024-09-21T03:53:11.801845+0000","last_became_peered":"2024-09-21T03:53:11.801845+0000","last_unstale":"2024-09-21T03:53:33.123570+0000","last_undegraded":"2024-09-21T03:53:33.123570+0000","last_fullsized":"2024-09-21T03:53:33.123570+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:34.714908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032488+0000","last_change":"2024-09-21T03:53:13.831495+0000","last_active":"2024-09-21T03:53:33.032488+0000","last_peered":"2024-09-21T03:53:33.032488+0000","last_clean":"2024-09-21T03:53:33.032488+0000","last_became_active":"2024-09-21T03:53:13.831107+0000","last_became_peered":"2024-09-21T03:53:13.831107+0000","last_unstale":"2024-09-21T03:53:33.032488+0000","last_undegraded":"2024-09-21T03:53:33.032488+0000","last_fullsized":"2024-09-21T03:53:33.032488+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:12:09.751036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123850+0000","last_change":"2024-09-21T03:53:11.805910+0000","last_active":"2024-09-21T03:53:33.123850+0000","last_peered":"2024-09-21T03:53:33.123850+0000","last_clean":"2024-09-21T03:53:33.123850+0000","last_became_active":"2024-09-21T03:53:11.805461+0000","last_became_peered":"2024-09-21T03:53:11.805461+0000","last_unstale":"2024-09-21T03:53:33.123850+0000","last_undegraded":"2024-09-21T03:53:33.123850+0000","last_fullsized":"2024-09-21T03:53:33.123850+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:36:56.132055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123607+0000","last_change":"2024-09-21T03:53:13.834930+0000","last_active":"2024-09-21T03:53:33.123607+0000","last_peered":"2024-09-21T03:53:33.123607+0000","last_clean":"2024-09-21T03:53:33.123607+0000","last_became_active":"2024-09-21T03:53:13.834368+0000","last_became_peered":"2024-09-21T03:53:13.834368+0000","last_unstale":"2024-09-21T03:53:33.123607+0000","last_undegraded":"2024-09-21T03:53:33.123607+0000","last_fullsized":"2024-09-21T03:53:33.123607+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:53.798811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123728+0000","last_change":"2024-09-21T03:53:12.604827+0000","last_active":"2024-09-21T03:53:33.123728+0000","last_peered":"2024-09-21T03:53:33.123728+0000","last_clean":"2024-09-21T03:53:33.123728+0000","last_became_active":"2024-09-21T03:53:12.604406+0000","last_became_peered":"2024-09-21T03:53:12.604406+0000","last_unstale":"2024-09-21T03:53:33.123728+0000","last_undegraded":"2024-09-21T03:53:33.123728+0000","last_fullsized":"2024-09-21T03:53:33.123728+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:03:12.942354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123562+0000","last_change":"2024-09-21T03:53:13.830482+0000","last_active":"2024-09-21T03:53:33.123562+0000","last_peered":"2024-09-21T03:53:33.123562+0000","last_clean":"2024-09-21T03:53:33.123562+0000","last_became_active":"2024-09-21T03:53:13.829970+0000","last_became_peered":"2024-09-21T03:53:13.829970+0000","last_unstale":"2024-09-21T03:53:33.123562+0000","last_undegraded":"2024-09-21T03:53:33.123562+0000","last_fullsized":"2024-09-21T03:53:33.123562+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:21.617459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035213+0000","last_change":"2024-09-21T03:53:11.801931+0000","last_active":"2024-09-21T03:53:33.035213+0000","last_peered":"2024-09-21T03:53:33.035213+0000","last_clean":"2024-09-21T03:53:33.035213+0000","last_became_active":"2024-09-21T03:53:11.801587+0000","last_became_peered":"2024-09-21T03:53:11.801587+0000","last_unstale":"2024-09-21T03:53:33.035213+0000","last_undegraded":"2024-09-21T03:53:33.035213+0000","last_fullsized":"2024-09-21T03:53:33.035213+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:47.329060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67755,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":127,"num_read_kb":131,"num_write":85,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":203265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70,"ondisk_log_size":70,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285514,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743451,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":831488,"data_stored":416577,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939680,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":1074213,"data_compressed":42053,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103205,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":835584,"data_stored":417159,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299434,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":839680,"data_stored":417181,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462959,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":888832,"data_stored":1007644,"data_compressed":42053,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626485,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":835584,"data_stored":416694,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822714,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":897024,"data_stored":1007244,"data_compressed":42053,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986239,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":835584,"data_stored":416599,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182466,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36172,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708980,"statfs":{"total":95995035648,"available":95957995520,"internally_reserved":0,"allocated":847872,"data_stored":416915,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378697,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":483568,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542222,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":483534,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705747,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":835584,"data_stored":416667,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34678,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34678,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34678,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36296,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36296,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36296,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36296,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36296,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":66991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":67151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:54:21.669 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T03:54:21.669 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T03:54:21.669 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T03:54:21.670 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph health --format=json 2024-09-21T03:54:21.940 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:22.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.454+0000 7f7ff31ec640 1 -- 172.21.15.46:0/3685364732 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fec102650 msgr2=0x7f7fec102a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:22.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.454+0000 7f7ff31ec640 1 --2- 172.21.15.46:0/3685364732 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fec102650 0x7f7fec102a60 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0009900 tx=0x7f7fe002a480 comp rx=0 tx=0).stop 2024-09-21T03:54:22.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.454+0000 7f7ff31ec640 1 -- 172.21.15.46:0/3685364732 shutdown_connections 2024-09-21T03:54:22.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.454+0000 7f7ff31ec640 1 --2- 172.21.15.46:0/3685364732 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fec110200 0x7f7fec112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:22.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.454+0000 7f7ff31ec640 1 --2- 172.21.15.46:0/3685364732 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fec102fa0 0x7f7fec10fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:22.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.454+0000 7f7ff31ec640 1 --2- 172.21.15.46:0/3685364732 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fec102650 0x7f7fec102a60 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:22.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.454+0000 7f7ff31ec640 1 -- 172.21.15.46:0/3685364732 >> 172.21.15.46:0/3685364732 conn(0x7f7fec079730 msgr2=0x7f7fec079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:22.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.454+0000 7f7ff31ec640 1 -- 172.21.15.46:0/3685364732 shutdown_connections 2024-09-21T03:54:22.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.454+0000 7f7ff31ec640 1 -- 172.21.15.46:0/3685364732 wait complete. 2024-09-21T03:54:22.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.455+0000 7f7ff31ec640 1 Processor -- start 2024-09-21T03:54:22.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.455+0000 7f7ff31ec640 1 -- start start 2024-09-21T03:54:22.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.455+0000 7f7ff31ec640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fec102650 0x7f7fec19c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:22.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.455+0000 7f7ff31ec640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fec102fa0 0x7f7fec19cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:22.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.455+0000 7f7ff31ec640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fec110200 0x7f7fec1a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:22.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.455+0000 7f7ff31ec640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7fec115c70 con 0x7f7fec110200 2024-09-21T03:54:22.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.455+0000 7f7ff31ec640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7fec115af0 con 0x7f7fec102fa0 2024-09-21T03:54:22.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.455+0000 7f7ff31ec640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7fec115df0 con 0x7f7fec102650 2024-09-21T03:54:22.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.455+0000 7f7ff1789640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fec110200 0x7f7fec1a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:22.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.455+0000 7f7ff1789640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fec110200 0x7f7fec1a1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45172/0 (socket says 172.21.15.46:45172) 2024-09-21T03:54:22.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.455+0000 7f7ff1789640 1 -- 172.21.15.46:0/3665005101 learned_addr learned my addr 172.21.15.46:0/3665005101 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:22.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.455+0000 7f7ff0f88640 1 --2- 172.21.15.46:0/3665005101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fec102650 0x7f7fec19c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:22.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.456+0000 7f7febfff640 1 --2- 172.21.15.46:0/3665005101 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fec102fa0 0x7f7fec19cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:22.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.456+0000 7f7ff1789640 1 -- 172.21.15.46:0/3665005101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fec102650 msgr2=0x7f7fec19c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:22.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.456+0000 7f7ff1789640 1 --2- 172.21.15.46:0/3665005101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fec102650 0x7f7fec19c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:22.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.456+0000 7f7ff1789640 1 -- 172.21.15.46:0/3665005101 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fec102fa0 msgr2=0x7f7fec19cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:22.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.456+0000 7f7ff1789640 1 --2- 172.21.15.46:0/3665005101 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fec102fa0 0x7f7fec19cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:22.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.456+0000 7f7ff1789640 1 -- 172.21.15.46:0/3665005101 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fec1a25b0 con 0x7f7fec110200 2024-09-21T03:54:22.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.456+0000 7f7ff1789640 1 --2- 172.21.15.46:0/3665005101 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fec110200 0x7f7fec1a1e80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7fe400eb10 tx=0x7f7fe400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:22.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.456+0000 7f7fe9ffb640 1 -- 172.21.15.46:0/3665005101 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4004b20 con 0x7f7fec110200 2024-09-21T03:54:22.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.456+0000 7f7ff31ec640 1 -- 172.21.15.46:0/3665005101 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fec1a28a0 con 0x7f7fec110200 2024-09-21T03:54:22.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.456+0000 7f7fe9ffb640 1 -- 172.21.15.46:0/3665005101 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fe4004cc0 con 0x7f7fec110200 2024-09-21T03:54:22.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.456+0000 7f7fe9ffb640 1 -- 172.21.15.46:0/3665005101 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4010670 con 0x7f7fec110200 2024-09-21T03:54:22.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.456+0000 7f7ff31ec640 1 -- 172.21.15.46:0/3665005101 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fec1a9000 con 0x7f7fec110200 2024-09-21T03:54:22.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.457+0000 7f7ff31ec640 1 -- 172.21.15.46:0/3665005101 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fec102a60 con 0x7f7fec110200 2024-09-21T03:54:22.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.460+0000 7f7fe9ffb640 1 -- 172.21.15.46:0/3665005101 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f7fe4005000 con 0x7f7fec110200 2024-09-21T03:54:22.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.461+0000 7f7fe9ffb640 1 --2- 172.21.15.46:0/3665005101 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7fdc0b65f0 0x7f7fdc0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:22.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.461+0000 7f7ff0f88640 1 --2- 172.21.15.46:0/3665005101 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7fdc0b65f0 0x7f7fdc0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:22.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.461+0000 7f7fe9ffb640 1 -- 172.21.15.46:0/3665005101 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f7fe40e7d80 con 0x7f7fec110200 2024-09-21T03:54:22.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.461+0000 7f7ff0f88640 1 --2- 172.21.15.46:0/3665005101 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7fdc0b65f0 0x7f7fdc0b8b00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0031440 tx=0x7f7fe0009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:22.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.464+0000 7f7fe9ffb640 1 -- 172.21.15.46:0/3665005101 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7fe4056710 con 0x7f7fec110200 2024-09-21T03:54:22.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:22 smithi105 ceph-mon[34773]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:54:22.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:22 smithi162 ceph-mon[35071]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:54:22.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.691+0000 7f7ff31ec640 1 -- 172.21.15.46:0/3665005101 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7fec19d770 con 0x7f7fec110200 2024-09-21T03:54:22.695 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:22 smithi046 ceph-mon[30954]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:54:22.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.692+0000 7f7fe9ffb640 1 -- 172.21.15.46:0/3665005101 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f7fec19d770 con 0x7f7fec110200 2024-09-21T03:54:22.695 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:54:22.696 INFO:teuthology.orchestra.run.smithi046.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T03:54:22.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.694+0000 7f7ff31ec640 1 -- 172.21.15.46:0/3665005101 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7fdc0b65f0 msgr2=0x7f7fdc0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:22.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.694+0000 7f7ff31ec640 1 --2- 172.21.15.46:0/3665005101 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7fdc0b65f0 0x7f7fdc0b8b00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0031440 tx=0x7f7fe0009560 comp rx=0 tx=0).stop 2024-09-21T03:54:22.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.694+0000 7f7ff31ec640 1 -- 172.21.15.46:0/3665005101 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fec110200 msgr2=0x7f7fec1a1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:22.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.694+0000 7f7ff31ec640 1 --2- 172.21.15.46:0/3665005101 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fec110200 0x7f7fec1a1e80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7fe400eb10 tx=0x7f7fe400c2d0 comp rx=0 tx=0).stop 2024-09-21T03:54:22.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.694+0000 7f7ff31ec640 1 -- 172.21.15.46:0/3665005101 shutdown_connections 2024-09-21T03:54:22.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.694+0000 7f7ff31ec640 1 --2- 172.21.15.46:0/3665005101 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fec110200 0x7f7fec1a1e80 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:22.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.694+0000 7f7ff31ec640 1 --2- 172.21.15.46:0/3665005101 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fec102fa0 0x7f7fec19cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:22.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.694+0000 7f7ff31ec640 1 --2- 172.21.15.46:0/3665005101 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7fdc0b65f0 0x7f7fdc0b8b00 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:22.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.694+0000 7f7ff31ec640 1 --2- 172.21.15.46:0/3665005101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fec102650 0x7f7fec19c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:22.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.694+0000 7f7ff31ec640 1 -- 172.21.15.46:0/3665005101 >> 172.21.15.46:0/3665005101 conn(0x7f7fec079730 msgr2=0x7f7fec108c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:22.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.694+0000 7f7ff31ec640 1 -- 172.21.15.46:0/3665005101 shutdown_connections 2024-09-21T03:54:22.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:22.694+0000 7f7ff31ec640 1 -- 172.21.15.46:0/3665005101 wait complete. 2024-09-21T03:54:23.390 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T03:54:23.391 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:54:23.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:23 smithi105 ceph-mon[34773]: pgmap v300: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:54:23.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:23 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3665005101' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T03:54:23.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:23 smithi162 ceph-mon[35071]: pgmap v300: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:54:23.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:23 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3665005101' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T03:54:23.651 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:23.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:23 smithi046 ceph-mon[30954]: pgmap v300: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:54:23.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:23 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3665005101' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T03:54:24.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.147+0000 7efd840c0640 1 -- 172.21.15.46:0/575414951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd7c102a60 msgr2=0x7efd7c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:24.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.147+0000 7efd840c0640 1 --2- 172.21.15.46:0/575414951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd7c102a60 0x7efd7c102e70 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7efd78009900 tx=0x7efd7802a410 comp rx=0 tx=0).stop 2024-09-21T03:54:24.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.148+0000 7efd840c0640 1 -- 172.21.15.46:0/575414951 shutdown_connections 2024-09-21T03:54:24.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.148+0000 7efd840c0640 1 --2- 172.21.15.46:0/575414951 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd7c108cf0 0x7efd7c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:24.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.148+0000 7efd840c0640 1 --2- 172.21.15.46:0/575414951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd7c1083a0 0x7efd7c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:24.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.148+0000 7efd840c0640 1 --2- 172.21.15.46:0/575414951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd7c102a60 0x7efd7c102e70 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:24.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.148+0000 7efd840c0640 1 -- 172.21.15.46:0/575414951 >> 172.21.15.46:0/575414951 conn(0x7efd7c079730 msgr2=0x7efd7c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:24.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.148+0000 7efd840c0640 1 -- 172.21.15.46:0/575414951 shutdown_connections 2024-09-21T03:54:24.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.148+0000 7efd840c0640 1 -- 172.21.15.46:0/575414951 wait complete. 2024-09-21T03:54:24.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.148+0000 7efd840c0640 1 Processor -- start 2024-09-21T03:54:24.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.148+0000 7efd840c0640 1 -- start start 2024-09-21T03:54:24.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.149+0000 7efd840c0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd7c102a60 0x7efd7c19b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:24.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.149+0000 7efd840c0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd7c1083a0 0x7efd7c19b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:24.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.149+0000 7efd840c0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd7c108cf0 0x7efd7c19bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:24.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.149+0000 7efd840c0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7efd7c112960 con 0x7efd7c108cf0 2024-09-21T03:54:24.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.149+0000 7efd840c0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efd7c1127e0 con 0x7efd7c102a60 2024-09-21T03:54:24.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.149+0000 7efd840c0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efd7c112ae0 con 0x7efd7c1083a0 2024-09-21T03:54:24.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.149+0000 7efd8265d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd7c108cf0 0x7efd7c19bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:24.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.149+0000 7efd8265d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd7c108cf0 0x7efd7c19bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45192/0 (socket says 172.21.15.46:45192) 2024-09-21T03:54:24.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.149+0000 7efd8265d640 1 -- 172.21.15.46:0/337062608 learned_addr learned my addr 172.21.15.46:0/337062608 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:24.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.149+0000 7efd8165b640 1 --2- 172.21.15.46:0/337062608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd7c1083a0 0x7efd7c19b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:24.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.149+0000 7efd81e5c640 1 --2- 172.21.15.46:0/337062608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd7c102a60 0x7efd7c19b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:24.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.149+0000 7efd8265d640 1 -- 172.21.15.46:0/337062608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd7c1083a0 msgr2=0x7efd7c19b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:24.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.149+0000 7efd8265d640 1 --2- 172.21.15.46:0/337062608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd7c1083a0 0x7efd7c19b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:24.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.149+0000 7efd8265d640 1 -- 172.21.15.46:0/337062608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd7c102a60 msgr2=0x7efd7c19b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:24.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.149+0000 7efd8265d640 1 --2- 172.21.15.46:0/337062608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd7c102a60 0x7efd7c19b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:24.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.149+0000 7efd8265d640 1 -- 172.21.15.46:0/337062608 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd7c1a6530 con 0x7efd7c108cf0 2024-09-21T03:54:24.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.149+0000 7efd8265d640 1 --2- 172.21.15.46:0/337062608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd7c108cf0 0x7efd7c19bcf0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7efd74009fd0 tx=0x7efd7400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:24.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.149+0000 7efd72ffd640 1 -- 172.21.15.46:0/337062608 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd74017070 con 0x7efd7c108cf0 2024-09-21T03:54:24.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.150+0000 7efd72ffd640 1 -- 172.21.15.46:0/337062608 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd74003e20 con 0x7efd7c108cf0 2024-09-21T03:54:24.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.150+0000 7efd72ffd640 1 -- 172.21.15.46:0/337062608 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd74010460 con 0x7efd7c108cf0 2024-09-21T03:54:24.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.150+0000 7efd840c0640 1 -- 172.21.15.46:0/337062608 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd7c1a6820 con 0x7efd7c108cf0 2024-09-21T03:54:24.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.150+0000 7efd840c0640 1 -- 172.21.15.46:0/337062608 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd7c1a6d10 con 0x7efd7c108cf0 2024-09-21T03:54:24.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.151+0000 7efd840c0640 1 -- 172.21.15.46:0/337062608 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd7c102e70 con 0x7efd7c108cf0 2024-09-21T03:54:24.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.152+0000 7efd72ffd640 1 -- 172.21.15.46:0/337062608 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7efd74003970 con 0x7efd7c108cf0 2024-09-21T03:54:24.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.153+0000 7efd72ffd640 1 --2- 172.21.15.46:0/337062608 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7efd680b6670 0x7efd680b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:24.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.154+0000 7efd81e5c640 1 --2- 172.21.15.46:0/337062608 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7efd680b6670 0x7efd680b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:24.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.154+0000 7efd72ffd640 1 -- 172.21.15.46:0/337062608 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7efd740e71d0 con 0x7efd7c108cf0 2024-09-21T03:54:24.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.154+0000 7efd81e5c640 1 --2- 172.21.15.46:0/337062608 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7efd680b6670 0x7efd680b8b80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efd78000c00 tx=0x7efd78031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:24.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.157+0000 7efd72ffd640 1 -- 172.21.15.46:0/337062608 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efd740b1ce0 con 0x7efd7c108cf0 2024-09-21T03:54:24.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.383+0000 7efd840c0640 1 -- 172.21.15.46:0/337062608 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efd7c02e640 con 0x7efd7c108cf0 2024-09-21T03:54:24.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.384+0000 7efd72ffd640 1 -- 172.21.15.46:0/337062608 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7efd740b6c20 con 0x7efd7c108cf0 2024-09-21T03:54:24.387 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:54:24.387 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"btime":"2024-09-21T03:53:23:865820+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1766354184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1766354184},{"type":"v1","addr":"172.21.15.46:6839","nonce":1766354184}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/1901774207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":1901774207},{"type":"v1","addr":"172.21.15.46:6841","nonce":1901774207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3548633196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":3548633196},{"type":"v1","addr":"172.21.15.105:6837","nonce":3548633196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24652,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3551934241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3551934241},{"type":"v1","addr":"172.21.15.162:6835","nonce":3551934241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/48949822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":48949822},{"type":"v1","addr":"172.21.15.162:6837","nonce":48949822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:53:14.452819+0000","modified":"2024-09-21T03:53:23.593278+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24680},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/2196053213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2196053213},{"type":"v1","addr":"172.21.15.162:6839","nonce":2196053213}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.105:6839/3911438406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":3911438406},{"type":"v1","addr":"172.21.15.105:6839","nonce":3911438406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24680,"qdb_cluster":[24680]},"id":1}]} 2024-09-21T03:54:24.388 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T03:54:24.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.386+0000 7efd840c0640 1 -- 172.21.15.46:0/337062608 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7efd680b6670 msgr2=0x7efd680b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:24.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.386+0000 7efd840c0640 1 --2- 172.21.15.46:0/337062608 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7efd680b6670 0x7efd680b8b80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efd78000c00 tx=0x7efd78031400 comp rx=0 tx=0).stop 2024-09-21T03:54:24.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.386+0000 7efd840c0640 1 -- 172.21.15.46:0/337062608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd7c108cf0 msgr2=0x7efd7c19bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:24.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.386+0000 7efd840c0640 1 --2- 172.21.15.46:0/337062608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd7c108cf0 0x7efd7c19bcf0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7efd74009fd0 tx=0x7efd7400b260 comp rx=0 tx=0).stop 2024-09-21T03:54:24.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.386+0000 7efd840c0640 1 -- 172.21.15.46:0/337062608 shutdown_connections 2024-09-21T03:54:24.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.386+0000 7efd840c0640 1 --2- 172.21.15.46:0/337062608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd7c108cf0 0x7efd7c19bcf0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:24.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.386+0000 7efd840c0640 1 --2- 172.21.15.46:0/337062608 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7efd680b6670 0x7efd680b8b80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:24.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.386+0000 7efd840c0640 1 --2- 172.21.15.46:0/337062608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd7c1083a0 0x7efd7c19b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:24.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.386+0000 7efd840c0640 1 --2- 172.21.15.46:0/337062608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd7c102a60 0x7efd7c19b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:24.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.386+0000 7efd840c0640 1 -- 172.21.15.46:0/337062608 >> 172.21.15.46:0/337062608 conn(0x7efd7c079730 msgr2=0x7efd7c1014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:24.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.386+0000 7efd840c0640 1 -- 172.21.15.46:0/337062608 shutdown_connections 2024-09-21T03:54:24.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:24.386+0000 7efd840c0640 1 -- 172.21.15.46:0/337062608 wait complete. 2024-09-21T03:54:25.037 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:54:25.300 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:25.422 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:25 smithi046 ceph-mon[30954]: pgmap v301: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:54:25.422 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:25 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/337062608' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:54:25.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:25 smithi105 ceph-mon[34773]: pgmap v301: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:54:25.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:25 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/337062608' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:54:25.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:25 smithi162 ceph-mon[35071]: pgmap v301: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:54:25.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:25 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/337062608' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:54:25.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.786+0000 7fe144c0d640 1 -- 172.21.15.46:0/3972575453 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1401083a0 msgr2=0x7fe1401087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:25.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.786+0000 7fe144c0d640 1 --2- 172.21.15.46:0/3972575453 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1401083a0 0x7fe1401087b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe134009900 tx=0x7fe13402a410 comp rx=0 tx=0).stop 2024-09-21T03:54:25.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.786+0000 7fe144c0d640 1 -- 172.21.15.46:0/3972575453 shutdown_connections 2024-09-21T03:54:25.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.786+0000 7fe144c0d640 1 --2- 172.21.15.46:0/3972575453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe140108cf0 0x7fe14010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:25.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.786+0000 7fe144c0d640 1 --2- 172.21.15.46:0/3972575453 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1401083a0 0x7fe1401087b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:25.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.786+0000 7fe144c0d640 1 --2- 172.21.15.46:0/3972575453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe140102a60 0x7fe140102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:25.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.786+0000 7fe144c0d640 1 -- 172.21.15.46:0/3972575453 >> 172.21.15.46:0/3972575453 conn(0x7fe140079730 msgr2=0x7fe140079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:25.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.786+0000 7fe144c0d640 1 -- 172.21.15.46:0/3972575453 shutdown_connections 2024-09-21T03:54:25.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.786+0000 7fe144c0d640 1 -- 172.21.15.46:0/3972575453 wait complete. 2024-09-21T03:54:25.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.787+0000 7fe144c0d640 1 Processor -- start 2024-09-21T03:54:25.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.787+0000 7fe144c0d640 1 -- start start 2024-09-21T03:54:25.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.787+0000 7fe144c0d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe140102a60 0x7fe1400ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:25.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.787+0000 7fe144c0d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1401083a0 0x7fe1400ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:25.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.787+0000 7fe144c0d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe140108cf0 0x7fe1401000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:25.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.787+0000 7fe144c0d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe140112960 con 0x7fe140102a60 2024-09-21T03:54:25.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.787+0000 7fe144c0d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe1401127e0 con 0x7fe140108cf0 2024-09-21T03:54:25.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.787+0000 7fe144c0d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe140112ae0 con 0x7fe1401083a0 2024-09-21T03:54:25.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.787+0000 7fe13e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe140102a60 0x7fe1400ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:25.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.787+0000 7fe13e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe140102a60 0x7fe1400ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45200/0 (socket says 172.21.15.46:45200) 2024-09-21T03:54:25.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.787+0000 7fe13e59c640 1 -- 172.21.15.46:0/1710441818 learned_addr learned my addr 172.21.15.46:0/1710441818 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:25.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.787+0000 7fe13dd9b640 1 --2- 172.21.15.46:0/1710441818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1401083a0 0x7fe1400ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:25.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.788+0000 7fe13ed9d640 1 --2- 172.21.15.46:0/1710441818 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe140108cf0 0x7fe1401000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:25.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.788+0000 7fe13e59c640 1 -- 172.21.15.46:0/1710441818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1401083a0 msgr2=0x7fe1400ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:25.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.788+0000 7fe13e59c640 1 --2- 172.21.15.46:0/1710441818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1401083a0 0x7fe1400ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:25.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.788+0000 7fe13e59c640 1 -- 172.21.15.46:0/1710441818 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe140108cf0 msgr2=0x7fe1401000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:25.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.788+0000 7fe13e59c640 1 --2- 172.21.15.46:0/1710441818 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe140108cf0 0x7fe1401000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:25.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.788+0000 7fe13e59c640 1 -- 172.21.15.46:0/1710441818 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1401a8760 con 0x7fe140102a60 2024-09-21T03:54:25.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.788+0000 7fe13ed9d640 1 --2- 172.21.15.46:0/1710441818 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe140108cf0 0x7fe1401000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:54:25.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.788+0000 7fe13e59c640 1 --2- 172.21.15.46:0/1710441818 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe140102a60 0x7fe1400ff670 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe13000d770 tx=0x7fe13000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:25.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.788+0000 7fe12f7fe640 1 -- 172.21.15.46:0/1710441818 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe130017070 con 0x7fe140102a60 2024-09-21T03:54:25.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.788+0000 7fe12f7fe640 1 -- 172.21.15.46:0/1710441818 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1300054d0 con 0x7fe140102a60 2024-09-21T03:54:25.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.788+0000 7fe144c0d640 1 -- 172.21.15.46:0/1710441818 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1401a8a50 con 0x7fe140102a60 2024-09-21T03:54:25.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.788+0000 7fe12f7fe640 1 -- 172.21.15.46:0/1710441818 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe130004c30 con 0x7fe140102a60 2024-09-21T03:54:25.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.788+0000 7fe144c0d640 1 -- 172.21.15.46:0/1710441818 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1401a8f10 con 0x7fe140102a60 2024-09-21T03:54:25.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.789+0000 7fe144c0d640 1 -- 172.21.15.46:0/1710441818 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe140103ce0 con 0x7fe140102a60 2024-09-21T03:54:25.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.792+0000 7fe12f7fe640 1 -- 172.21.15.46:0/1710441818 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fe130004dd0 con 0x7fe140102a60 2024-09-21T03:54:25.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.792+0000 7fe12f7fe640 1 --2- 172.21.15.46:0/1710441818 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe1280b65f0 0x7fe1280b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:25.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.793+0000 7fe13dd9b640 1 --2- 172.21.15.46:0/1710441818 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe1280b65f0 0x7fe1280b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:25.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.793+0000 7fe12f7fe640 1 -- 172.21.15.46:0/1710441818 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fe1300e7500 con 0x7fe140102a60 2024-09-21T03:54:25.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.793+0000 7fe13dd9b640 1 --2- 172.21.15.46:0/1710441818 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe1280b65f0 0x7fe1280b8b00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe134000c00 tx=0x7fe134031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:25.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:25.796+0000 7fe12f7fe640 1 -- 172.21.15.46:0/1710441818 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe1300adbb0 con 0x7fe140102a60 2024-09-21T03:54:26.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:26.026+0000 7fe144c0d640 1 -- 172.21.15.46:0/1710441818 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe140102e70 con 0x7fe140102a60 2024-09-21T03:54:26.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:26.026+0000 7fe12f7fe640 1 -- 172.21.15.46:0/1710441818 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7fe140102e70 con 0x7fe140102a60 2024-09-21T03:54:26.030 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:54:26.030 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"btime":"2024-09-21T03:53:23:865820+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1766354184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1766354184},{"type":"v1","addr":"172.21.15.46:6839","nonce":1766354184}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/1901774207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":1901774207},{"type":"v1","addr":"172.21.15.46:6841","nonce":1901774207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3548633196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":3548633196},{"type":"v1","addr":"172.21.15.105:6837","nonce":3548633196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24652,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3551934241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3551934241},{"type":"v1","addr":"172.21.15.162:6835","nonce":3551934241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/48949822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":48949822},{"type":"v1","addr":"172.21.15.162:6837","nonce":48949822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:53:14.452819+0000","modified":"2024-09-21T03:53:23.593278+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24680},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/2196053213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2196053213},{"type":"v1","addr":"172.21.15.162:6839","nonce":2196053213}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.105:6839/3911438406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":3911438406},{"type":"v1","addr":"172.21.15.105:6839","nonce":3911438406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24680,"qdb_cluster":[24680]},"id":1}]} 2024-09-21T03:54:26.030 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T03:54:26.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:26.028+0000 7fe144c0d640 1 -- 172.21.15.46:0/1710441818 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe1280b65f0 msgr2=0x7fe1280b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:26.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:26.028+0000 7fe144c0d640 1 --2- 172.21.15.46:0/1710441818 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe1280b65f0 0x7fe1280b8b00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe134000c00 tx=0x7fe134031400 comp rx=0 tx=0).stop 2024-09-21T03:54:26.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:26.028+0000 7fe144c0d640 1 -- 172.21.15.46:0/1710441818 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe140102a60 msgr2=0x7fe1400ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:26.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:26.028+0000 7fe144c0d640 1 --2- 172.21.15.46:0/1710441818 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe140102a60 0x7fe1400ff670 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe13000d770 tx=0x7fe13000dc30 comp rx=0 tx=0).stop 2024-09-21T03:54:26.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:26.028+0000 7fe144c0d640 1 -- 172.21.15.46:0/1710441818 shutdown_connections 2024-09-21T03:54:26.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:26.028+0000 7fe144c0d640 1 --2- 172.21.15.46:0/1710441818 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe140108cf0 0x7fe1401000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:26.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:26.028+0000 7fe144c0d640 1 --2- 172.21.15.46:0/1710441818 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe1280b65f0 0x7fe1280b8b00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:26.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:26.028+0000 7fe144c0d640 1 --2- 172.21.15.46:0/1710441818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1401083a0 0x7fe1400ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:26.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:26.028+0000 7fe144c0d640 1 --2- 172.21.15.46:0/1710441818 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe140102a60 0x7fe1400ff670 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:26.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:26.028+0000 7fe144c0d640 1 -- 172.21.15.46:0/1710441818 >> 172.21.15.46:0/1710441818 conn(0x7fe140079730 msgr2=0x7fe14006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:26.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:26.028+0000 7fe144c0d640 1 -- 172.21.15.46:0/1710441818 shutdown_connections 2024-09-21T03:54:26.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:26.029+0000 7fe144c0d640 1 -- 172.21.15.46:0/1710441818 wait complete. 2024-09-21T03:54:26.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:26 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/1710441818' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:54:26.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:26 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/1710441818' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:54:26.679 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:26 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/1710441818' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:54:26.708 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T03:54:26.967 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:27.391 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:27 smithi046 ceph-mon[30954]: pgmap v302: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:54:27.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.480+0000 7fb33bcdf640 1 -- 172.21.15.46:0/3678377347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3341083a0 msgr2=0x7fb3341087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:27.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.480+0000 7fb33bcdf640 1 --2- 172.21.15.46:0/3678377347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3341083a0 0x7fb3341087b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb324009900 tx=0x7fb32402a410 comp rx=0 tx=0).stop 2024-09-21T03:54:27.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.480+0000 7fb33bcdf640 1 -- 172.21.15.46:0/3678377347 shutdown_connections 2024-09-21T03:54:27.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.480+0000 7fb33bcdf640 1 --2- 172.21.15.46:0/3678377347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb334108cf0 0x7fb33410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:27.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.480+0000 7fb33bcdf640 1 --2- 172.21.15.46:0/3678377347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3341083a0 0x7fb3341087b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:27.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.480+0000 7fb33bcdf640 1 --2- 172.21.15.46:0/3678377347 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb334102a60 0x7fb334102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:27.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.480+0000 7fb33bcdf640 1 -- 172.21.15.46:0/3678377347 >> 172.21.15.46:0/3678377347 conn(0x7fb334079720 msgr2=0x7fb334079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:27.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.480+0000 7fb33bcdf640 1 -- 172.21.15.46:0/3678377347 shutdown_connections 2024-09-21T03:54:27.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.480+0000 7fb33bcdf640 1 -- 172.21.15.46:0/3678377347 wait complete. 2024-09-21T03:54:27.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.481+0000 7fb33bcdf640 1 Processor -- start 2024-09-21T03:54:27.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.481+0000 7fb33bcdf640 1 -- start start 2024-09-21T03:54:27.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.482+0000 7fb33bcdf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb334102a60 0x7fb33419a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:27.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.482+0000 7fb33bcdf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3341083a0 0x7fb33419a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:27.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.482+0000 7fb33bcdf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb334108cf0 0x7fb33419fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:27.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.482+0000 7fb33bcdf640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb334113a80 con 0x7fb334102a60 2024-09-21T03:54:27.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.482+0000 7fb33bcdf640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb334113900 con 0x7fb3341083a0 2024-09-21T03:54:27.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.482+0000 7fb33bcdf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb334113c00 con 0x7fb334108cf0 2024-09-21T03:54:27.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.482+0000 7fb339a7b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb334102a60 0x7fb33419a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:27.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.482+0000 7fb339a7b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb334102a60 0x7fb33419a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45220/0 (socket says 172.21.15.46:45220) 2024-09-21T03:54:27.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.482+0000 7fb339a7b640 1 -- 172.21.15.46:0/741228441 learned_addr learned my addr 172.21.15.46:0/741228441 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:27.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.482+0000 7fb33a27c640 1 --2- 172.21.15.46:0/741228441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb334108cf0 0x7fb33419fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:27.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.482+0000 7fb33927a640 1 --2- 172.21.15.46:0/741228441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3341083a0 0x7fb33419a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:27.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.482+0000 7fb339a7b640 1 -- 172.21.15.46:0/741228441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb334108cf0 msgr2=0x7fb33419fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:27.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.482+0000 7fb339a7b640 1 --2- 172.21.15.46:0/741228441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb334108cf0 0x7fb33419fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:27.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.482+0000 7fb339a7b640 1 -- 172.21.15.46:0/741228441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3341083a0 msgr2=0x7fb33419a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:27.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.482+0000 7fb339a7b640 1 --2- 172.21.15.46:0/741228441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3341083a0 0x7fb33419a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:27.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.482+0000 7fb339a7b640 1 -- 172.21.15.46:0/741228441 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3341a0300 con 0x7fb334102a60 2024-09-21T03:54:27.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.482+0000 7fb33a27c640 1 --2- 172.21.15.46:0/741228441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb334108cf0 0x7fb33419fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:54:27.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.482+0000 7fb339a7b640 1 --2- 172.21.15.46:0/741228441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb334102a60 0x7fb33419a450 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb33000c920 tx=0x7fb33000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:27.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.482+0000 7fb32affd640 1 -- 172.21.15.46:0/741228441 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb330007c70 con 0x7fb334102a60 2024-09-21T03:54:27.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.483+0000 7fb32affd640 1 -- 172.21.15.46:0/741228441 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb330007e10 con 0x7fb334102a60 2024-09-21T03:54:27.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.483+0000 7fb32affd640 1 -- 172.21.15.46:0/741228441 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb330018820 con 0x7fb334102a60 2024-09-21T03:54:27.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.483+0000 7fb33bcdf640 1 -- 172.21.15.46:0/741228441 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3341a05f0 con 0x7fb334102a60 2024-09-21T03:54:27.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.483+0000 7fb33bcdf640 1 -- 172.21.15.46:0/741228441 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3341a0ab0 con 0x7fb334102a60 2024-09-21T03:54:27.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.484+0000 7fb33bcdf640 1 -- 172.21.15.46:0/741228441 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb334103ce0 con 0x7fb334102a60 2024-09-21T03:54:27.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.485+0000 7fb32affd640 1 -- 172.21.15.46:0/741228441 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fb33000f450 con 0x7fb334102a60 2024-09-21T03:54:27.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.486+0000 7fb32affd640 1 --2- 172.21.15.46:0/741228441 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb3200b6620 0x7fb3200b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:27.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.486+0000 7fb33927a640 1 --2- 172.21.15.46:0/741228441 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb3200b6620 0x7fb3200b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:27.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.486+0000 7fb32affd640 1 -- 172.21.15.46:0/741228441 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fb3300e7a40 con 0x7fb334102a60 2024-09-21T03:54:27.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.487+0000 7fb33927a640 1 --2- 172.21.15.46:0/741228441 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb3200b6620 0x7fb3200b8b30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb324000c00 tx=0x7fb324031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:27.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.490+0000 7fb32affd640 1 -- 172.21.15.46:0/741228441 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb330014030 con 0x7fb334102a60 2024-09-21T03:54:27.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:27 smithi105 ceph-mon[34773]: pgmap v302: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:54:27.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:27 smithi162 ceph-mon[35071]: pgmap v302: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:54:27.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.677+0000 7fb33bcdf640 1 -- 172.21.15.46:0/741228441 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb334102e70 con 0x7fb334102a60 2024-09-21T03:54:27.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.679+0000 7fb32affd640 1 -- 172.21.15.46:0/741228441 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22876 (secure 0 0 0) 0x7fb334102e70 con 0x7fb334102a60 2024-09-21T03:54:27.682 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:54:27.682 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":77,"fsid":"a82de5ec-77cb-11ef-baf5-efdc52797490","created":"2024-09-21T03:44:31.512271+0000","modified":"2024-09-21T03:53:33.028150+0000","last_up_change":"2024-09-21T03:52:22.609789+0000","last_in_change":"2024-09-21T03:51:58.812316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:48:30.407205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:53:09.943833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:53:12.521980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ff9e1a8-fec7-422c-b594-880efe4684f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6803","nonce":791989880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6805","nonce":791989880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6809","nonce":791989880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6807","nonce":791989880}]},"public_addr":"172.21.15.46:6803/791989880","cluster_addr":"172.21.15.46:6805/791989880","heartbeat_back_addr":"172.21.15.46:6809/791989880","heartbeat_front_addr":"172.21.15.46:6807/791989880","state":["exists","up"]},{"osd":1,"uuid":"3df1bee7-615e-44d0-bd43-2370db6cd06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6801","nonce":1123652172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6803","nonce":1123652172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6807","nonce":1123652172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6805","nonce":1123652172}]},"public_addr":"172.21.15.105:6801/1123652172","cluster_addr":"172.21.15.105:6803/1123652172","heartbeat_back_addr":"172.21.15.105:6807/1123652172","heartbeat_front_addr":"172.21.15.105:6805/1123652172","state":["exists","up"]},{"osd":2,"uuid":"52d0e57f-cfca-447a-8a57-b1d5364cb4d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6801","nonce":34930776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6803","nonce":34930776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6807","nonce":34930776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6805","nonce":34930776}]},"public_addr":"172.21.15.162:6801/34930776","cluster_addr":"172.21.15.162:6803/34930776","heartbeat_back_addr":"172.21.15.162:6807/34930776","heartbeat_front_addr":"172.21.15.162:6805/34930776","state":["exists","up"]},{"osd":3,"uuid":"6f25f721-fc50-4b80-944b-d3df28e7a2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6811","nonce":1355580104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6813","nonce":1355580104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6817","nonce":1355580104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6815","nonce":1355580104}]},"public_addr":"172.21.15.46:6811/1355580104","cluster_addr":"172.21.15.46:6813/1355580104","heartbeat_back_addr":"172.21.15.46:6817/1355580104","heartbeat_front_addr":"172.21.15.46:6815/1355580104","state":["exists","up"]},{"osd":4,"uuid":"c2f41084-e5a1-4b5f-b799-a84b38da63a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6809","nonce":3566174660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6811","nonce":3566174660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6815","nonce":3566174660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6813","nonce":3566174660}]},"public_addr":"172.21.15.105:6809/3566174660","cluster_addr":"172.21.15.105:6811/3566174660","heartbeat_back_addr":"172.21.15.105:6815/3566174660","heartbeat_front_addr":"172.21.15.105:6813/3566174660","state":["exists","up"]},{"osd":5,"uuid":"b433d03b-fae8-4ece-b967-a8af91bc3ab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6809","nonce":3043419818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6811","nonce":3043419818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6815","nonce":3043419818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6813","nonce":3043419818}]},"public_addr":"172.21.15.162:6809/3043419818","cluster_addr":"172.21.15.162:6811/3043419818","heartbeat_back_addr":"172.21.15.162:6815/3043419818","heartbeat_front_addr":"172.21.15.162:6813/3043419818","state":["exists","up"]},{"osd":6,"uuid":"e6b5ce54-69aa-4811-9ca3-cab50525a175","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6819","nonce":1615361645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6821","nonce":1615361645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6825","nonce":1615361645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6823","nonce":1615361645}]},"public_addr":"172.21.15.46:6819/1615361645","cluster_addr":"172.21.15.46:6821/1615361645","heartbeat_back_addr":"172.21.15.46:6825/1615361645","heartbeat_front_addr":"172.21.15.46:6823/1615361645","state":["exists","up"]},{"osd":7,"uuid":"a6e89d5d-ce31-4e0c-9019-5eb13b134feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6817","nonce":1015687379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6819","nonce":1015687379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6823","nonce":1015687379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6821","nonce":1015687379}]},"public_addr":"172.21.15.105:6817/1015687379","cluster_addr":"172.21.15.105:6819/1015687379","heartbeat_back_addr":"172.21.15.105:6823/1015687379","heartbeat_front_addr":"172.21.15.105:6821/1015687379","state":["exists","up"]},{"osd":8,"uuid":"27b2ccec-65be-47b3-a924-c5939ba1cb5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6817","nonce":3441747512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6819","nonce":3441747512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6823","nonce":3441747512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6821","nonce":3441747512}]},"public_addr":"172.21.15.162:6817/3441747512","cluster_addr":"172.21.15.162:6819/3441747512","heartbeat_back_addr":"172.21.15.162:6823/3441747512","heartbeat_front_addr":"172.21.15.162:6821/3441747512","state":["exists","up"]},{"osd":9,"uuid":"3f7cb70c-73c7-48e8-a32b-7445eda2126d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6827","nonce":382230768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6829","nonce":382230768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6833","nonce":382230768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6831","nonce":382230768}]},"public_addr":"172.21.15.46:6827/382230768","cluster_addr":"172.21.15.46:6829/382230768","heartbeat_back_addr":"172.21.15.46:6833/382230768","heartbeat_front_addr":"172.21.15.46:6831/382230768","state":["exists","up"]},{"osd":10,"uuid":"76c3da87-f3c5-4985-87fd-647717b6af85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6825","nonce":1664619099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6827","nonce":1664619099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6831","nonce":1664619099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6829","nonce":1664619099}]},"public_addr":"172.21.15.105:6825/1664619099","cluster_addr":"172.21.15.105:6827/1664619099","heartbeat_back_addr":"172.21.15.105:6831/1664619099","heartbeat_front_addr":"172.21.15.105:6829/1664619099","state":["exists","up"]},{"osd":11,"uuid":"13269da8-5f05-4ce2-9c7a-6dd9c1041cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6825","nonce":1014820476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6827","nonce":1014820476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6831","nonce":1014820476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6829","nonce":1014820476}]},"public_addr":"172.21.15.162:6825/1014820476","cluster_addr":"172.21.15.162:6827/1014820476","heartbeat_back_addr":"172.21.15.162:6831/1014820476","heartbeat_front_addr":"172.21.15.162:6829/1014820476","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:47:38.630436+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:03.441596+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:28.647341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:54.270316+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:49:19.783873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:49:45.344485+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:50:12.165326+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:50:38.095996+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:03.814612+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:29.469718+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:55.407340+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:52:20.360243+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:6801/878116252":"2024-09-22T03:46:31.942086+0000","172.21.15.46:6800/878116252":"2024-09-22T03:46:31.942086+0000","172.21.15.46:0/3574041742":"2024-09-22T03:45:05.097136+0000","172.21.15.46:6801/1185001582":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/2839831446":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/3423884605":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/2761976928":"2024-09-22T03:46:31.942086+0000","172.21.15.46:0/1149961133":"2024-09-22T03:45:05.097136+0000","172.21.15.46:6800/1185001582":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/641493295":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/4033661287":"2024-09-22T03:45:31.101657+0000","172.21.15.46:6800/2733048710":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/3972416280":"2024-09-22T03:46:31.942086+0000","172.21.15.46:6801/2733048710":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/1662975018":"2024-09-22T03:46:31.942086+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:54:27.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.681+0000 7fb33bcdf640 1 -- 172.21.15.46:0/741228441 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb3200b6620 msgr2=0x7fb3200b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:27.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.681+0000 7fb33bcdf640 1 --2- 172.21.15.46:0/741228441 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb3200b6620 0x7fb3200b8b30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb324000c00 tx=0x7fb324031400 comp rx=0 tx=0).stop 2024-09-21T03:54:27.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.681+0000 7fb33bcdf640 1 -- 172.21.15.46:0/741228441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb334102a60 msgr2=0x7fb33419a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:27.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.681+0000 7fb33bcdf640 1 --2- 172.21.15.46:0/741228441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb334102a60 0x7fb33419a450 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb33000c920 tx=0x7fb33000cde0 comp rx=0 tx=0).stop 2024-09-21T03:54:27.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.681+0000 7fb33bcdf640 1 -- 172.21.15.46:0/741228441 shutdown_connections 2024-09-21T03:54:27.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.681+0000 7fb33bcdf640 1 --2- 172.21.15.46:0/741228441 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb3200b6620 0x7fb3200b8b30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:27.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.681+0000 7fb33bcdf640 1 --2- 172.21.15.46:0/741228441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb334108cf0 0x7fb33419fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:27.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.681+0000 7fb33bcdf640 1 --2- 172.21.15.46:0/741228441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3341083a0 0x7fb33419a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:27.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.681+0000 7fb33bcdf640 1 --2- 172.21.15.46:0/741228441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb334102a60 0x7fb33419a450 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:27.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.681+0000 7fb33bcdf640 1 -- 172.21.15.46:0/741228441 >> 172.21.15.46:0/741228441 conn(0x7fb334079720 msgr2=0x7fb3341052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:27.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.681+0000 7fb33bcdf640 1 -- 172.21.15.46:0/741228441 shutdown_connections 2024-09-21T03:54:27.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:27.681+0000 7fb33bcdf640 1 -- 172.21.15.46:0/741228441 wait complete. 2024-09-21T03:54:28.372 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:54:28.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:28 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/741228441' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:54:28.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:28 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/741228441' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:54:28.635 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:28.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:28 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/741228441' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:54:29.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.115+0000 7f0ff450f640 1 -- 172.21.15.46:0/536101256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fec1083a0 msgr2=0x7f0fec1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:29.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.115+0000 7f0ff450f640 1 --2- 172.21.15.46:0/536101256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fec1083a0 0x7f0fec1087b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0009900 tx=0x7f0fe002a410 comp rx=0 tx=0).stop 2024-09-21T03:54:29.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.115+0000 7f0ff450f640 1 -- 172.21.15.46:0/536101256 shutdown_connections 2024-09-21T03:54:29.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.115+0000 7f0ff450f640 1 --2- 172.21.15.46:0/536101256 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0fec108cf0 0x7f0fec10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:29.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.115+0000 7f0ff450f640 1 --2- 172.21.15.46:0/536101256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fec1083a0 0x7f0fec1087b0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:29.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.115+0000 7f0ff450f640 1 --2- 172.21.15.46:0/536101256 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fec102a60 0x7f0fec102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:29.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.115+0000 7f0ff450f640 1 -- 172.21.15.46:0/536101256 >> 172.21.15.46:0/536101256 conn(0x7f0fec079730 msgr2=0x7f0fec079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:29.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.115+0000 7f0ff450f640 1 -- 172.21.15.46:0/536101256 shutdown_connections 2024-09-21T03:54:29.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.115+0000 7f0ff450f640 1 -- 172.21.15.46:0/536101256 wait complete. 2024-09-21T03:54:29.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.116+0000 7f0ff450f640 1 Processor -- start 2024-09-21T03:54:29.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.116+0000 7f0ff450f640 1 -- start start 2024-09-21T03:54:29.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.116+0000 7f0ff450f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fec102a60 0x7f0fec199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:29.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.116+0000 7f0ff450f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fec1083a0 0x7f0fec1998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:29.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.116+0000 7f0ff450f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0fec108cf0 0x7f0fec19eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:29.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.116+0000 7f0ff450f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0fec112960 con 0x7f0fec102a60 2024-09-21T03:54:29.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.116+0000 7f0ff450f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0fec1127e0 con 0x7f0fec108cf0 2024-09-21T03:54:29.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.116+0000 7f0ff450f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0fec112ae0 con 0x7f0fec1083a0 2024-09-21T03:54:29.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.116+0000 7f0ff22ab640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fec102a60 0x7f0fec199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:29.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.116+0000 7f0ff22ab640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fec102a60 0x7f0fec199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45238/0 (socket says 172.21.15.46:45238) 2024-09-21T03:54:29.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.116+0000 7f0ff22ab640 1 -- 172.21.15.46:0/1006298153 learned_addr learned my addr 172.21.15.46:0/1006298153 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:29.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.116+0000 7f0ff2aac640 1 --2- 172.21.15.46:0/1006298153 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0fec108cf0 0x7f0fec19eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:29.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.117+0000 7f0ff1aaa640 1 --2- 172.21.15.46:0/1006298153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fec1083a0 0x7f0fec1998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:29.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.117+0000 7f0ff22ab640 1 -- 172.21.15.46:0/1006298153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fec1083a0 msgr2=0x7f0fec1998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:29.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.117+0000 7f0ff22ab640 1 --2- 172.21.15.46:0/1006298153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fec1083a0 0x7f0fec1998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:29.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.117+0000 7f0ff22ab640 1 -- 172.21.15.46:0/1006298153 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0fec108cf0 msgr2=0x7f0fec19eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:29.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.117+0000 7f0ff22ab640 1 --2- 172.21.15.46:0/1006298153 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0fec108cf0 0x7f0fec19eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:29.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.117+0000 7f0ff22ab640 1 -- 172.21.15.46:0/1006298153 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fec19f280 con 0x7f0fec102a60 2024-09-21T03:54:29.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.117+0000 7f0ff22ab640 1 --2- 172.21.15.46:0/1006298153 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fec102a60 0x7f0fec199310 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc00cce0 tx=0x7f0fdc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:29.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.117+0000 7f0feb7fe640 1 -- 172.21.15.46:0/1006298153 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc004b20 con 0x7f0fec102a60 2024-09-21T03:54:29.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.117+0000 7f0ff450f640 1 -- 172.21.15.46:0/1006298153 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fec19f570 con 0x7f0fec102a60 2024-09-21T03:54:29.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.117+0000 7f0feb7fe640 1 -- 172.21.15.46:0/1006298153 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0fdc004cc0 con 0x7f0fec102a60 2024-09-21T03:54:29.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.117+0000 7f0feb7fe640 1 -- 172.21.15.46:0/1006298153 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc00f7c0 con 0x7f0fec102a60 2024-09-21T03:54:29.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.117+0000 7f0ff450f640 1 -- 172.21.15.46:0/1006298153 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fec1a5cd0 con 0x7f0fec102a60 2024-09-21T03:54:29.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.118+0000 7f0ff450f640 1 -- 172.21.15.46:0/1006298153 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fec102e70 con 0x7f0fec102a60 2024-09-21T03:54:29.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.120+0000 7f0feb7fe640 1 -- 172.21.15.46:0/1006298153 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f0fdc005560 con 0x7f0fec102a60 2024-09-21T03:54:29.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.121+0000 7f0feb7fe640 1 --2- 172.21.15.46:0/1006298153 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f0fd40b65f0 0x7f0fd40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:29.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.121+0000 7f0ff1aaa640 1 --2- 172.21.15.46:0/1006298153 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f0fd40b65f0 0x7f0fd40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:29.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.121+0000 7f0feb7fe640 1 -- 172.21.15.46:0/1006298153 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f0fdc0e7b00 con 0x7f0fec102a60 2024-09-21T03:54:29.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.121+0000 7f0ff1aaa640 1 --2- 172.21.15.46:0/1006298153 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f0fd40b65f0 0x7f0fd40b8b00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0000c00 tx=0x7f0fe0031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:29.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.124+0000 7f0feb7fe640 1 -- 172.21.15.46:0/1006298153 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0fdc014030 con 0x7f0fec102a60 2024-09-21T03:54:29.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.351+0000 7f0ff450f640 1 -- 172.21.15.46:0/1006298153 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0fec19a440 con 0x7f0fec102a60 2024-09-21T03:54:29.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.352+0000 7f0feb7fe640 1 -- 172.21.15.46:0/1006298153 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f0fdc0a9030 con 0x7f0fec102a60 2024-09-21T03:54:29.356 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:54:29.356 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"btime":"2024-09-21T03:53:23:865820+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1766354184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1766354184},{"type":"v1","addr":"172.21.15.46:6839","nonce":1766354184}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/1901774207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":1901774207},{"type":"v1","addr":"172.21.15.46:6841","nonce":1901774207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3548633196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":3548633196},{"type":"v1","addr":"172.21.15.105:6837","nonce":3548633196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24652,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3551934241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3551934241},{"type":"v1","addr":"172.21.15.162:6835","nonce":3551934241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/48949822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":48949822},{"type":"v1","addr":"172.21.15.162:6837","nonce":48949822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:53:14.452819+0000","modified":"2024-09-21T03:53:23.593278+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24680},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/2196053213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2196053213},{"type":"v1","addr":"172.21.15.162:6839","nonce":2196053213}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.105:6839/3911438406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":3911438406},{"type":"v1","addr":"172.21.15.105:6839","nonce":3911438406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24680,"qdb_cluster":[24680]},"id":1}]} 2024-09-21T03:54:29.356 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T03:54:29.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.354+0000 7f0ff450f640 1 -- 172.21.15.46:0/1006298153 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f0fd40b65f0 msgr2=0x7f0fd40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:29.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.354+0000 7f0ff450f640 1 --2- 172.21.15.46:0/1006298153 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f0fd40b65f0 0x7f0fd40b8b00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0000c00 tx=0x7f0fe0031400 comp rx=0 tx=0).stop 2024-09-21T03:54:29.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.354+0000 7f0ff450f640 1 -- 172.21.15.46:0/1006298153 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fec102a60 msgr2=0x7f0fec199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:29.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.354+0000 7f0ff450f640 1 --2- 172.21.15.46:0/1006298153 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fec102a60 0x7f0fec199310 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc00cce0 tx=0x7f0fdc00a620 comp rx=0 tx=0).stop 2024-09-21T03:54:29.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.354+0000 7f0ff450f640 1 -- 172.21.15.46:0/1006298153 shutdown_connections 2024-09-21T03:54:29.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.354+0000 7f0ff450f640 1 --2- 172.21.15.46:0/1006298153 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0fec108cf0 0x7f0fec19eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:29.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.354+0000 7f0ff450f640 1 --2- 172.21.15.46:0/1006298153 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f0fd40b65f0 0x7f0fd40b8b00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:29.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.354+0000 7f0ff450f640 1 --2- 172.21.15.46:0/1006298153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fec1083a0 0x7f0fec1998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:29.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.354+0000 7f0ff450f640 1 --2- 172.21.15.46:0/1006298153 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fec102a60 0x7f0fec199310 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:29.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.354+0000 7f0ff450f640 1 -- 172.21.15.46:0/1006298153 >> 172.21.15.46:0/1006298153 conn(0x7f0fec079730 msgr2=0x7f0fec1043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:29.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.354+0000 7f0ff450f640 1 -- 172.21.15.46:0/1006298153 shutdown_connections 2024-09-21T03:54:29.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:29.355+0000 7f0ff450f640 1 -- 172.21.15.46:0/1006298153 wait complete. 2024-09-21T03:54:29.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:29 smithi105 ceph-mon[34773]: pgmap v303: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:54:29.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:29 smithi162 ceph-mon[35071]: pgmap v303: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:54:29.729 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:29 smithi046 ceph-mon[30954]: pgmap v303: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:54:30.081 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T03:53:14.452819+0000', 'modified': '2024-09-21T03:53:23.593278+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24680}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24673': {'gid': 24673, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.162:6839/2196053213', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6838', 'nonce': 2196053213}, {'type': 'v1', 'addr': '172.21.15.162:6839', 'nonce': 2196053213}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24680': {'gid': 24680, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.105:6839/3911438406', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6838', 'nonce': 3911438406}, {'type': 'v1', 'addr': '172.21.15.105:6839', 'nonce': 3911438406}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24680, 'qdb_cluster': [24680]} 2024-09-21T03:54:30.082 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T03:54:30.082 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T03:54:30.344 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:30.577 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:30 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/1006298153' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:54:30.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:30 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/1006298153' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:54:30.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.798+0000 7f59cb87e640 1 -- 172.21.15.46:0/3649660196 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59c4102a60 msgr2=0x7f59c4102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:30.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.798+0000 7f59cb87e640 1 --2- 172.21.15.46:0/3649660196 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59c4102a60 0x7f59c4102e70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f59c0009900 tx=0x7f59c002a410 comp rx=0 tx=0).stop 2024-09-21T03:54:30.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.798+0000 7f59cb87e640 1 -- 172.21.15.46:0/3649660196 shutdown_connections 2024-09-21T03:54:30.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.798+0000 7f59cb87e640 1 --2- 172.21.15.46:0/3649660196 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59c4108cf0 0x7f59c410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.798+0000 7f59cb87e640 1 --2- 172.21.15.46:0/3649660196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59c41083a0 0x7f59c41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.798+0000 7f59cb87e640 1 --2- 172.21.15.46:0/3649660196 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59c4102a60 0x7f59c4102e70 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.798+0000 7f59cb87e640 1 -- 172.21.15.46:0/3649660196 >> 172.21.15.46:0/3649660196 conn(0x7f59c4079730 msgr2=0x7f59c4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:30.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.798+0000 7f59cb87e640 1 -- 172.21.15.46:0/3649660196 shutdown_connections 2024-09-21T03:54:30.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.798+0000 7f59cb87e640 1 -- 172.21.15.46:0/3649660196 wait complete. 2024-09-21T03:54:30.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.799+0000 7f59cb87e640 1 Processor -- start 2024-09-21T03:54:30.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.799+0000 7f59cb87e640 1 -- start start 2024-09-21T03:54:30.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.799+0000 7f59cb87e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59c4102a60 0x7f59c419b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:30.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.799+0000 7f59cb87e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59c41083a0 0x7f59c419b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:30.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.799+0000 7f59cb87e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59c4108cf0 0x7f59c419bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:30.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.799+0000 7f59cb87e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f59c4112960 con 0x7f59c41083a0 2024-09-21T03:54:30.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.799+0000 7f59cb87e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f59c41127e0 con 0x7f59c4102a60 2024-09-21T03:54:30.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.799+0000 7f59cb87e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f59c4112ae0 con 0x7f59c4108cf0 2024-09-21T03:54:30.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.799+0000 7f59c8e19640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59c41083a0 0x7f59c419b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:30.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.800+0000 7f59c8e19640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59c41083a0 0x7f59c419b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45242/0 (socket says 172.21.15.46:45242) 2024-09-21T03:54:30.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.800+0000 7f59c8e19640 1 -- 172.21.15.46:0/2076376795 learned_addr learned my addr 172.21.15.46:0/2076376795 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:30.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.800+0000 7f59c961a640 1 --2- 172.21.15.46:0/2076376795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59c4102a60 0x7f59c419b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:30.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.800+0000 7f59c8e19640 1 -- 172.21.15.46:0/2076376795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59c4108cf0 msgr2=0x7f59c419bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:30.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.800+0000 7f59c8e19640 1 --2- 172.21.15.46:0/2076376795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59c4108cf0 0x7f59c419bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.800+0000 7f59c8e19640 1 -- 172.21.15.46:0/2076376795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59c4102a60 msgr2=0x7f59c419b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:30.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.800+0000 7f59c8e19640 1 --2- 172.21.15.46:0/2076376795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59c4102a60 0x7f59c419b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.800+0000 7f59c8e19640 1 -- 172.21.15.46:0/2076376795 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c41a65c0 con 0x7f59c41083a0 2024-09-21T03:54:30.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.800+0000 7f59c8e19640 1 --2- 172.21.15.46:0/2076376795 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59c41083a0 0x7f59c419b870 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f59b400d740 tx=0x7f59b400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:30.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.800+0000 7f59ba7fc640 1 -- 172.21.15.46:0/2076376795 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b4017070 con 0x7f59c41083a0 2024-09-21T03:54:30.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.800+0000 7f59ba7fc640 1 -- 172.21.15.46:0/2076376795 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59b400de50 con 0x7f59c41083a0 2024-09-21T03:54:30.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.800+0000 7f59cb87e640 1 -- 172.21.15.46:0/2076376795 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59c41a68b0 con 0x7f59c41083a0 2024-09-21T03:54:30.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.800+0000 7f59ba7fc640 1 -- 172.21.15.46:0/2076376795 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b4004ce0 con 0x7f59c41083a0 2024-09-21T03:54:30.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.800+0000 7f59cb87e640 1 -- 172.21.15.46:0/2076376795 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59c41a6df0 con 0x7f59c41083a0 2024-09-21T03:54:30.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.803+0000 7f59d1df2740 1 Processor -- start 2024-09-21T03:54:30.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.803+0000 7f59d1df2740 1 -- start start 2024-09-21T03:54:30.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.803+0000 7f59ba7fc640 1 -- 172.21.15.46:0/2076376795 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f59b4004e80 con 0x7f59c41083a0 2024-09-21T03:54:30.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.803+0000 7f59d1df2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55916a600f60 0x55916a9a6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:30.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.803+0000 7f59d1df2740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55916a5d80a0 0x55916a9a7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:30.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.803+0000 7f59d1df2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55916a5e0280 0x55916a9a7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:30.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.803+0000 7f59d1df2740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55916a91ec10 con 0x55916a5d80a0 2024-09-21T03:54:30.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.803+0000 7f59d1df2740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55916a90e040 con 0x55916a5e0280 2024-09-21T03:54:30.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.803+0000 7f59d1df2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55916a911e50 con 0x55916a600f60 2024-09-21T03:54:30.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.804+0000 7f59c961a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55916a5d80a0 0x55916a9a7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:30.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.804+0000 7f59c961a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55916a5d80a0 0x55916a9a7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45258/0 (socket says 172.21.15.46:45258) 2024-09-21T03:54:30.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.804+0000 7f59c961a640 1 -- 172.21.15.46:0/873466060 learned_addr learned my addr 172.21.15.46:0/873466060 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:30.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.804+0000 7f59c9e1b640 1 --2- 172.21.15.46:0/873466060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55916a600f60 0x55916a9a6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:30.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.804+0000 7f59c8e19640 1 --2- 172.21.15.46:0/873466060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55916a5e0280 0x55916a9a7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:30.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.804+0000 7f59c961a640 1 -- 172.21.15.46:0/873466060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55916a600f60 msgr2=0x55916a9a6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:54:30.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.804+0000 7f59c961a640 1 --2- 172.21.15.46:0/873466060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55916a600f60 0x55916a9a6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.804+0000 7f59c961a640 1 -- 172.21.15.46:0/873466060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55916a5e0280 msgr2=0x55916a9a7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:54:30.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.804+0000 7f59c961a640 1 --2- 172.21.15.46:0/873466060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55916a5e0280 0x55916a9a7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.804+0000 7f59c961a640 1 -- 172.21.15.46:0/873466060 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55916a66c540 con 0x55916a5d80a0 2024-09-21T03:54:30.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.804+0000 7f59c961a640 1 --2- 172.21.15.46:0/873466060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55916a5d80a0 0x55916a9a7440 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f59c0009900 tx=0x7f59c0032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e710fd7ffca58627 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:30.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.804+0000 7f59ba7fc640 1 --2- 172.21.15.46:0/2076376795 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f59b00b66a0 0x7f59b00b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:30.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.804+0000 7f59af7fe640 1 -- 172.21.15.46:0/873466060 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c0040070 con 0x55916a5d80a0 2024-09-21T03:54:30.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.805+0000 7f59c9e1b640 1 --2- 172.21.15.46:0/2076376795 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f59b00b66a0 0x7f59b00b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:30.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.805+0000 7f59af7fe640 1 -- 172.21.15.46:0/873466060 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59c0032e50 con 0x55916a5d80a0 2024-09-21T03:54:30.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.805+0000 7f59af7fe640 1 -- 172.21.15.46:0/873466060 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c0035040 con 0x55916a5d80a0 2024-09-21T03:54:30.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.805+0000 7f59ba7fc640 1 -- 172.21.15.46:0/2076376795 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f59b40e6eb0 con 0x7f59c41083a0 2024-09-21T03:54:30.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.805+0000 7f59d1df2740 1 -- 172.21.15.46:0/873466060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55916a5d80a0 msgr2=0x55916a9a7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:30.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.805+0000 7f59d1df2740 1 --2- 172.21.15.46:0/873466060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55916a5d80a0 0x55916a9a7440 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f59c0009900 tx=0x7f59c0032c60 comp rx=0 tx=0).stop 2024-09-21T03:54:30.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.805+0000 7f59c9e1b640 1 --2- 172.21.15.46:0/2076376795 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f59b00b66a0 0x7f59b00b8bb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f59bc005c40 tx=0x7f59bc009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:30.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.806+0000 7f59d1df2740 1 -- 172.21.15.46:0/873466060 shutdown_connections 2024-09-21T03:54:30.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.806+0000 7f59d1df2740 1 --2- 172.21.15.46:0/873466060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55916a5e0280 0x55916a9a7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.806+0000 7f59d1df2740 1 --2- 172.21.15.46:0/873466060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55916a5d80a0 0x55916a9a7440 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.806+0000 7f59d1df2740 1 --2- 172.21.15.46:0/873466060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55916a600f60 0x55916a9a6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.806+0000 7f59d1df2740 1 -- 172.21.15.46:0/873466060 >> 172.21.15.46:0/873466060 conn(0x55916a5f5350 msgr2=0x55916a9a4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:30.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.806+0000 7f59d1df2740 1 -- 172.21.15.46:0/873466060 shutdown_connections 2024-09-21T03:54:30.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.806+0000 7f59d1df2740 1 -- 172.21.15.46:0/873466060 wait complete. 2024-09-21T03:54:30.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.806+0000 7f59d1df2740 1 -- start start 2024-09-21T03:54:30.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.806+0000 7f59d1df2740 1 Processor -- start 2024-09-21T03:54:30.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.807+0000 7f59d1df2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55916a5d80a0 0x55916a9b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:30.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.807+0000 7f59d1df2740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55916a5e0280 0x55916a9b2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:30.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.807+0000 7f59d1df2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55916a600f60 0x55916a9be9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:30.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.807+0000 7f59d1df2740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55916a76f5f0 con 0x55916a5e0280 2024-09-21T03:54:30.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.807+0000 7f59d1df2740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55916a8a9010 con 0x55916a600f60 2024-09-21T03:54:30.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.807+0000 7f59d1df2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55916a9b5680 con 0x55916a5d80a0 2024-09-21T03:54:30.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.807+0000 7f59d1df2740 10 client.0 _ll_register_callbacks cb 0x55916a908340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:54:30.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.807+0000 7f59c8e19640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55916a5e0280 0x55916a9b2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:30.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.807+0000 7f59c8e19640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55916a5e0280 0x55916a9b2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45262/0 (socket says 172.21.15.46:45262) 2024-09-21T03:54:30.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.807+0000 7f59c8e19640 1 -- 172.21.15.46:0/389801754 learned_addr learned my addr 172.21.15.46:0/389801754 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:30.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.807+0000 7f59c961a640 1 --2- 172.21.15.46:0/389801754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55916a5d80a0 0x55916a9b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:30.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.807+0000 7f59c9e1b640 1 --2- 172.21.15.46:0/389801754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55916a600f60 0x55916a9be9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:30.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.807+0000 7f59c8e19640 1 -- 172.21.15.46:0/389801754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55916a5d80a0 msgr2=0x55916a9b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:54:30.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.807+0000 7f59c8e19640 1 --2- 172.21.15.46:0/389801754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55916a5d80a0 0x55916a9b27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.807+0000 7f59c8e19640 1 -- 172.21.15.46:0/389801754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55916a600f60 msgr2=0x55916a9be9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:54:30.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.807+0000 7f59c8e19640 1 --2- 172.21.15.46:0/389801754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55916a600f60 0x55916a9be9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.807+0000 7f59c8e19640 1 -- 172.21.15.46:0/389801754 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55916a8d6a00 con 0x55916a5e0280 2024-09-21T03:54:30.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.807+0000 7f59c9e1b640 1 --2- 172.21.15.46:0/389801754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55916a600f60 0x55916a9be9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:54:30.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.807+0000 7f59c8e19640 1 --2- 172.21.15.46:0/389801754 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55916a5e0280 0x55916a9b2db0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f59b40a9430 tx=0x7f59b4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72587d51d5b6ed3d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:30.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.807+0000 7f59acff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:54:30.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.808+0000 7f59acff9640 1 -- 172.21.15.46:0/389801754 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b4020070 con 0x55916a5e0280 2024-09-21T03:54:30.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.808+0000 7f59acff9640 1 -- 172.21.15.46:0/389801754 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f59b40ea020 con 0x55916a5e0280 2024-09-21T03:54:30.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.808+0000 7f59d1df2740 1 -- 172.21.15.46:0/389801754 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59c0032e50 con 0x55916a5e0280 2024-09-21T03:54:30.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.808+0000 7f59acff9640 1 -- 172.21.15.46:0/389801754 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f59b40ac7b0 con 0x55916a5e0280 2024-09-21T03:54:30.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.808+0000 7f59d1df2740 10 client.15195 fetch_fsmap learned FSMap version 20 2024-09-21T03:54:30.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.808+0000 7f59d1df2740 1 -- 172.21.15.46:0/389801754 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55916a9c1570 con 0x55916a5e0280 2024-09-21T03:54:30.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.808+0000 7f59acff9640 1 -- 172.21.15.46:0/389801754 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59c0032e50 con 0x55916a5e0280 2024-09-21T03:54:30.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.808+0000 7f59acff9640 1 -- 172.21.15.46:0/389801754 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f59b40abb30 con 0x55916a5e0280 2024-09-21T03:54:30.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.808+0000 7f59d1df2740 10 client.15195 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:54:30.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.808+0000 7f59d1df2740 10 client.15195 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T03:54:30.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.808+0000 7f59d1df2740 20 client.15195 populate_metadata read hostname 'smithi046' 2024-09-21T03:54:30.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.808+0000 7f59d1df2740 1 --2- 172.21.15.46:0/389801754 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55916a5bf8e0 0x55916a9c5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:30.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.808+0000 7f59d1df2740 4 client.15195 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:54:30.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.808+0000 7f59d1df2740 1 -- 172.21.15.46:0/389801754 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55916a920b60 con 0x55916a5bf8e0 2024-09-21T03:54:30.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.809+0000 7f59c961a640 1 --2- 172.21.15.46:0/389801754 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55916a5bf8e0 0x55916a9c5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:30.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.809+0000 7f59c961a640 1 --2- 172.21.15.46:0/389801754 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55916a5bf8e0 0x55916a9c5030 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a0d9cba7f2319c9 server_cookie=3dd3981825ff434d in_seq=0 out_seq=0 2024-09-21T03:54:30.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.809+0000 7f59acff9640 10 client.15195 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:54:30.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.810+0000 7f59acff9640 1 -- 172.21.15.46:0/389801754 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55916a920b60 con 0x55916a5bf8e0 2024-09-21T03:54:30.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.810+0000 7f59acff9640 10 client.15195 handle_command_reply: tid=0 2024-09-21T03:54:30.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.810+0000 7f59d1df2740 1 client.15195 shutdown 2024-09-21T03:54:30.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.810+0000 7f59d1df2740 1 -- 172.21.15.46:0/389801754 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55916a5e0280 msgr2=0x55916a9b2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:30.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.810+0000 7f59d1df2740 1 --2- 172.21.15.46:0/389801754 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55916a5e0280 0x55916a9b2db0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f59b40a9430 tx=0x7f59b4004770 comp rx=0 tx=0).stop 2024-09-21T03:54:30.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.810+0000 7f59d1df2740 1 -- 172.21.15.46:0/389801754 shutdown_connections 2024-09-21T03:54:30.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.810+0000 7f59d1df2740 1 --2- 172.21.15.46:0/389801754 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55916a5bf8e0 0x55916a9c5030 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.810+0000 7f59d1df2740 1 --2- 172.21.15.46:0/389801754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55916a600f60 0x55916a9be9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.810+0000 7f59d1df2740 1 --2- 172.21.15.46:0/389801754 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55916a5e0280 0x55916a9b2db0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.810+0000 7f59d1df2740 1 --2- 172.21.15.46:0/389801754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55916a5d80a0 0x55916a9b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.810+0000 7f59acff9640 0 client.15195 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:54:30.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.810+0000 7f59d1df2740 1 -- 172.21.15.46:0/389801754 >> 172.21.15.46:0/389801754 conn(0x55916a5f5350 msgr2=0x55916a9aa090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:30.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.811+0000 7f59d1df2740 1 -- 172.21.15.46:0/389801754 shutdown_connections 2024-09-21T03:54:30.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.811+0000 7f59d1df2740 1 -- 172.21.15.46:0/389801754 wait complete. 2024-09-21T03:54:30.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.811+0000 7f59d1df2740 20 client.15195 trim_cache size 0 max 16384 2024-09-21T03:54:30.821 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:30 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/1006298153' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:54:30.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.829+0000 7f59d1df2740 1 Processor -- start 2024-09-21T03:54:30.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.829+0000 7f59d1df2740 1 -- start start 2024-09-21T03:54:30.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.829+0000 7f59d1df2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55916a5d80a0 0x55916a99fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:30.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.829+0000 7f59d1df2740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55916a5e0280 0x55916a9be910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:30.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.829+0000 7f59d1df2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55916a600f60 0x55916a9bee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:30.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.829+0000 7f59d1df2740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55916a9c3370 con 0x55916a5e0280 2024-09-21T03:54:30.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.829+0000 7f59d1df2740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55916a9c3a40 con 0x55916a600f60 2024-09-21T03:54:30.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.829+0000 7f59d1df2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55916a9c4110 con 0x55916a5d80a0 2024-09-21T03:54:30.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.829+0000 7f59c8e19640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55916a5e0280 0x55916a9be910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:30.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.829+0000 7f59c8e19640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55916a5e0280 0x55916a9be910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45270/0 (socket says 172.21.15.46:45270) 2024-09-21T03:54:30.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.829+0000 7f59c8e19640 1 -- 172.21.15.46:0/2888117631 learned_addr learned my addr 172.21.15.46:0/2888117631 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:30.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.830+0000 7f59c961a640 1 --2- 172.21.15.46:0/2888117631 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55916a5d80a0 0x55916a99fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:30.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.830+0000 7f59c9e1b640 1 --2- 172.21.15.46:0/2888117631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55916a600f60 0x55916a9bee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:30.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.830+0000 7f59c8e19640 1 -- 172.21.15.46:0/2888117631 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55916a5d80a0 msgr2=0x55916a99fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:54:30.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.830+0000 7f59c8e19640 1 --2- 172.21.15.46:0/2888117631 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55916a5d80a0 0x55916a99fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.830+0000 7f59c8e19640 1 -- 172.21.15.46:0/2888117631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55916a600f60 msgr2=0x55916a9bee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:54:30.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.830+0000 7f59c8e19640 1 --2- 172.21.15.46:0/2888117631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55916a600f60 0x55916a9bee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.830+0000 7f59c8e19640 1 -- 172.21.15.46:0/2888117631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55916a9a9790 con 0x55916a5e0280 2024-09-21T03:54:30.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.830+0000 7f59c9e1b640 1 --2- 172.21.15.46:0/2888117631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55916a600f60 0x55916a9bee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:54:30.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.830+0000 7f59c8e19640 1 --2- 172.21.15.46:0/2888117631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55916a5e0280 0x55916a9be910 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f59b4005d00 tx=0x7f59b40ea5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d6ae1c8b26f7eee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:30.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.830+0000 7f59aeffd640 1 -- 172.21.15.46:0/2888117631 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b4020070 con 0x55916a5e0280 2024-09-21T03:54:30.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.830+0000 7f59aeffd640 1 -- 172.21.15.46:0/2888117631 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59b40ac970 con 0x55916a5e0280 2024-09-21T03:54:30.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.830+0000 7f59aeffd640 1 -- 172.21.15.46:0/2888117631 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b40ac5d0 con 0x55916a5e0280 2024-09-21T03:54:30.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.831+0000 7f59d1df2740 1 -- 172.21.15.46:0/2888117631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55916a5e0280 msgr2=0x55916a9be910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:30.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.831+0000 7f59d1df2740 1 --2- 172.21.15.46:0/2888117631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55916a5e0280 0x55916a9be910 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f59b4005d00 tx=0x7f59b40ea5d0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.831+0000 7f59d1df2740 1 -- 172.21.15.46:0/2888117631 shutdown_connections 2024-09-21T03:54:30.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.831+0000 7f59d1df2740 1 --2- 172.21.15.46:0/2888117631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55916a600f60 0x55916a9bee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.831+0000 7f59d1df2740 1 --2- 172.21.15.46:0/2888117631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55916a5e0280 0x55916a9be910 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.831+0000 7f59d1df2740 1 --2- 172.21.15.46:0/2888117631 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55916a5d80a0 0x55916a99fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.831+0000 7f59d1df2740 1 -- 172.21.15.46:0/2888117631 >> 172.21.15.46:0/2888117631 conn(0x55916a5f5350 msgr2=0x55916a9ad980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:30.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.831+0000 7f59d1df2740 1 -- 172.21.15.46:0/2888117631 shutdown_connections 2024-09-21T03:54:30.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.831+0000 7f59d1df2740 1 -- 172.21.15.46:0/2888117631 wait complete. 2024-09-21T03:54:30.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.832+0000 7f59d1df2740 1 -- start start 2024-09-21T03:54:30.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.832+0000 7f59d1df2740 1 Processor -- start 2024-09-21T03:54:30.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.832+0000 7f59d1df2740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55916a5d80a0 0x55916a9c7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:30.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.832+0000 7f59d1df2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55916a5e0280 0x55916a9c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:30.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.832+0000 7f59d1df2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55916a600f60 0x55916a9cce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:30.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.832+0000 7f59d1df2740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55916a9c4eb0 con 0x55916a5d80a0 2024-09-21T03:54:30.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.832+0000 7f59d1df2740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55916a9c47e0 con 0x55916a600f60 2024-09-21T03:54:30.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.832+0000 7f59d1df2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55916a9c5580 con 0x55916a5e0280 2024-09-21T03:54:30.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.832+0000 7f59d1df2740 10 client.0 _ll_register_callbacks cb 0x7f59b4009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:54:30.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.832+0000 7f59c961a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55916a5d80a0 0x55916a9c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:30.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.832+0000 7f59c961a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55916a5d80a0 0x55916a9c7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45282/0 (socket says 172.21.15.46:45282) 2024-09-21T03:54:30.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.832+0000 7f59c961a640 1 -- 172.21.15.46:0/1760236158 learned_addr learned my addr 172.21.15.46:0/1760236158 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:30.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.833+0000 7f59c8e19640 1 --2- 172.21.15.46:0/1760236158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55916a5e0280 0x55916a9c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:30.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.833+0000 7f59c9e1b640 1 --2- 172.21.15.46:0/1760236158 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55916a600f60 0x55916a9cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:30.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.833+0000 7f59c961a640 1 -- 172.21.15.46:0/1760236158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55916a5e0280 msgr2=0x55916a9c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:54:30.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.833+0000 7f59c961a640 1 --2- 172.21.15.46:0/1760236158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55916a5e0280 0x55916a9c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.833+0000 7f59c961a640 1 -- 172.21.15.46:0/1760236158 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55916a600f60 msgr2=0x55916a9cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:54:30.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.833+0000 7f59c961a640 1 --2- 172.21.15.46:0/1760236158 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55916a600f60 0x55916a9cce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.833+0000 7f59c961a640 1 -- 172.21.15.46:0/1760236158 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55916a9cd3c0 con 0x55916a5d80a0 2024-09-21T03:54:30.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.833+0000 7f59c961a640 1 --2- 172.21.15.46:0/1760236158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55916a5d80a0 0x55916a9c7740 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f59c00052d0 tx=0x7f59c00050e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa89fead893a39c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:30.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.833+0000 7f59acff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:54:30.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.833+0000 7f59acff9640 1 -- 172.21.15.46:0/1760236158 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c0035040 con 0x55916a5d80a0 2024-09-21T03:54:30.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.833+0000 7f59acff9640 1 -- 172.21.15.46:0/1760236158 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f59c00316a0 con 0x55916a5d80a0 2024-09-21T03:54:30.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.833+0000 7f59d1df2740 1 -- 172.21.15.46:0/1760236158 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59b40ac970 con 0x55916a5d80a0 2024-09-21T03:54:30.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.833+0000 7f59acff9640 1 -- 172.21.15.46:0/1760236158 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f59c005a020 con 0x55916a5d80a0 2024-09-21T03:54:30.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.833+0000 7f59d1df2740 10 client.15201 fetch_fsmap learned FSMap version 20 2024-09-21T03:54:30.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.834+0000 7f59d1df2740 1 -- 172.21.15.46:0/1760236158 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55916aa30b50 con 0x55916a5d80a0 2024-09-21T03:54:30.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.834+0000 7f59acff9640 1 -- 172.21.15.46:0/1760236158 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59b40ac970 con 0x55916a5d80a0 2024-09-21T03:54:30.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.834+0000 7f59acff9640 1 -- 172.21.15.46:0/1760236158 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f59c0003860 con 0x55916a5d80a0 2024-09-21T03:54:30.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.834+0000 7f59d1df2740 10 client.15201 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:54:30.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.834+0000 7f59d1df2740 10 client.15201 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T03:54:30.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.834+0000 7f59d1df2740 20 client.15201 populate_metadata read hostname 'smithi046' 2024-09-21T03:54:30.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.834+0000 7f59d1df2740 1 --2- 172.21.15.46:0/1760236158 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55916a594c90 0x55916aa34040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:30.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.834+0000 7f59d1df2740 4 client.15201 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:54:30.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.834+0000 7f59d1df2740 1 -- 172.21.15.46:0/1760236158 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "status"}) -- 0x55916a91c610 con 0x55916a594c90 2024-09-21T03:54:30.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.834+0000 7f59c8e19640 1 --2- 172.21.15.46:0/1760236158 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55916a594c90 0x55916aa34040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:30.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.835+0000 7f59acff9640 10 client.15201 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:54:30.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.835+0000 7f59c8e19640 1 --2- 172.21.15.46:0/1760236158 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55916a594c90 0x55916aa34040 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c91a5aca9e177e8 server_cookie=cb7ef9ab4c7a0da7 in_seq=0 out_seq=0 2024-09-21T03:54:30.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.835+0000 7f59acff9640 1 -- 172.21.15.46:0/1760236158 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55916a91c610 con 0x55916a594c90 2024-09-21T03:54:30.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.835+0000 7f59acff9640 10 client.15201 handle_command_reply: tid=0 2024-09-21T03:54:30.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.835+0000 7f59d1df2740 1 client.15201 shutdown 2024-09-21T03:54:30.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.835+0000 7f59d1df2740 1 -- 172.21.15.46:0/1760236158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55916a5d80a0 msgr2=0x55916a9c7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:30.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.835+0000 7f59d1df2740 1 --2- 172.21.15.46:0/1760236158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55916a5d80a0 0x55916a9c7740 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f59c00052d0 tx=0x7f59c00050e0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.835+0000 7f59d1df2740 1 -- 172.21.15.46:0/1760236158 shutdown_connections 2024-09-21T03:54:30.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.835+0000 7f59d1df2740 1 --2- 172.21.15.46:0/1760236158 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55916a594c90 0x55916aa34040 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.835+0000 7f59d1df2740 1 --2- 172.21.15.46:0/1760236158 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55916a600f60 0x55916a9cce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.835+0000 7f59d1df2740 1 --2- 172.21.15.46:0/1760236158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55916a5e0280 0x55916a9c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.835+0000 7f59d1df2740 1 --2- 172.21.15.46:0/1760236158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55916a5d80a0 0x55916a9c7740 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.835+0000 7f59d1df2740 1 -- 172.21.15.46:0/1760236158 >> 172.21.15.46:0/1760236158 conn(0x55916a5f5350 msgr2=0x55916a9ad980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:30.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.835+0000 7f59acff9640 0 client.15201 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:54:30.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.835+0000 7f59d1df2740 1 -- 172.21.15.46:0/1760236158 shutdown_connections 2024-09-21T03:54:30.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.835+0000 7f59d1df2740 1 -- 172.21.15.46:0/1760236158 wait complete. 2024-09-21T03:54:30.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.836+0000 7f59d1df2740 20 client.15201 trim_cache size 0 max 16384 2024-09-21T03:54:30.845 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T03:54:30.845 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "a82de5ec-77cb-11ef-baf5-efdc52797490", 2024-09-21T03:54:30.845 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2024-09-21T03:54:30.845 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 24680, 2024-09-21T03:54:30.845 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-09-21T03:54:30.845 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-09-21T03:54:30.845 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-09-21T03:54:30.846 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 76.017851746000005, 2024-09-21T03:54:30.846 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 20, 2024-09-21T03:54:30.846 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 77, 2024-09-21T03:54:30.846 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 75, 2024-09-21T03:54:30.846 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 87.471444325999997 2024-09-21T03:54:30.846 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T03:54:30.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.836+0000 7f59cb87e640 1 -- 172.21.15.46:0/2076376795 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f59b00b66a0 msgr2=0x7f59b00b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:30.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.836+0000 7f59cb87e640 1 --2- 172.21.15.46:0/2076376795 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f59b00b66a0 0x7f59b00b8bb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f59bc005c40 tx=0x7f59bc009560 comp rx=0 tx=0).stop 2024-09-21T03:54:30.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.836+0000 7f59cb87e640 1 -- 172.21.15.46:0/2076376795 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59c41083a0 msgr2=0x7f59c419b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:30.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.836+0000 7f59cb87e640 1 --2- 172.21.15.46:0/2076376795 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59c41083a0 0x7f59c419b870 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f59b400d740 tx=0x7f59b400dc00 comp rx=0 tx=0).stop 2024-09-21T03:54:30.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.836+0000 7f59cb87e640 1 -- 172.21.15.46:0/2076376795 shutdown_connections 2024-09-21T03:54:30.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.836+0000 7f59cb87e640 1 --2- 172.21.15.46:0/2076376795 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f59b00b66a0 0x7f59b00b8bb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.836+0000 7f59cb87e640 1 --2- 172.21.15.46:0/2076376795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59c4108cf0 0x7f59c419bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.836+0000 7f59cb87e640 1 --2- 172.21.15.46:0/2076376795 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59c41083a0 0x7f59c419b870 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.836+0000 7f59cb87e640 1 --2- 172.21.15.46:0/2076376795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59c4102a60 0x7f59c419b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.836+0000 7f59cb87e640 1 -- 172.21.15.46:0/2076376795 >> 172.21.15.46:0/2076376795 conn(0x7f59c4079730 msgr2=0x7f59c4101500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:30.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.836+0000 7f59cb87e640 1 -- 172.21.15.46:0/2076376795 shutdown_connections 2024-09-21T03:54:30.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:30.837+0000 7f59cb87e640 1 -- 172.21.15.46:0/2076376795 wait complete. 2024-09-21T03:54:31.505 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T03:54:31.506 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T03:54:31.514 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi046.front.sepia.ceph.com 2024-09-21T03:54:31.514 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- bash -c 'ceph orch status' 2024-09-21T03:54:31.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:31 smithi162 ceph-mon[35071]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:54:31.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:31 smithi046 ceph-mon[30954]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:54:31.776 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:31.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:31 smithi105 ceph-mon[34773]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:54:32.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.251+0000 7f88d331c640 1 -- 172.21.15.46:0/1877837194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88cc1083b0 msgr2=0x7f88cc1087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:32.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.251+0000 7f88d331c640 1 --2- 172.21.15.46:0/1877837194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88cc1083b0 0x7f88cc1087c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f88bc009900 tx=0x7f88bc02a410 comp rx=0 tx=0).stop 2024-09-21T03:54:32.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.251+0000 7f88d331c640 1 -- 172.21.15.46:0/1877837194 shutdown_connections 2024-09-21T03:54:32.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.251+0000 7f88d331c640 1 --2- 172.21.15.46:0/1877837194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88cc108d00 0x7f88cc10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:32.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.251+0000 7f88d331c640 1 --2- 172.21.15.46:0/1877837194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88cc1083b0 0x7f88cc1087c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:32.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.251+0000 7f88d331c640 1 --2- 172.21.15.46:0/1877837194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88cc102a70 0x7f88cc102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:32.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.251+0000 7f88d331c640 1 -- 172.21.15.46:0/1877837194 >> 172.21.15.46:0/1877837194 conn(0x7f88cc079710 msgr2=0x7f88cc079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:32.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.251+0000 7f88d331c640 1 -- 172.21.15.46:0/1877837194 shutdown_connections 2024-09-21T03:54:32.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.251+0000 7f88d331c640 1 -- 172.21.15.46:0/1877837194 wait complete. 2024-09-21T03:54:32.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.251+0000 7f88d331c640 1 Processor -- start 2024-09-21T03:54:32.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.252+0000 7f88d331c640 1 -- start start 2024-09-21T03:54:32.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.252+0000 7f88d331c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88cc102a70 0x7f88cc19c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:32.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.252+0000 7f88d331c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88cc1083b0 0x7f88cc19cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:32.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.252+0000 7f88d331c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88cc108d00 0x7f88cc1a1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:32.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.252+0000 7f88d331c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f88cc1129c0 con 0x7f88cc1083b0 2024-09-21T03:54:32.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.252+0000 7f88d331c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f88cc112840 con 0x7f88cc102a70 2024-09-21T03:54:32.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.252+0000 7f88d331c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f88cc112b40 con 0x7f88cc108d00 2024-09-21T03:54:32.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.252+0000 7f88d08b7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88cc1083b0 0x7f88cc19cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:32.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.252+0000 7f88d08b7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88cc1083b0 0x7f88cc19cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47912/0 (socket says 172.21.15.46:47912) 2024-09-21T03:54:32.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.252+0000 7f88d08b7640 1 -- 172.21.15.46:0/3153698255 learned_addr learned my addr 172.21.15.46:0/3153698255 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:32.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.252+0000 7f88d10b8640 1 --2- 172.21.15.46:0/3153698255 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88cc102a70 0x7f88cc19c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:32.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.252+0000 7f88d18b9640 1 --2- 172.21.15.46:0/3153698255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88cc108d00 0x7f88cc1a1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:32.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.252+0000 7f88d08b7640 1 -- 172.21.15.46:0/3153698255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88cc108d00 msgr2=0x7f88cc1a1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:32.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.252+0000 7f88d08b7640 1 --2- 172.21.15.46:0/3153698255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88cc108d00 0x7f88cc1a1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:32.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.252+0000 7f88d08b7640 1 -- 172.21.15.46:0/3153698255 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88cc102a70 msgr2=0x7f88cc19c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:32.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.252+0000 7f88d08b7640 1 --2- 172.21.15.46:0/3153698255 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88cc102a70 0x7f88cc19c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:32.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.252+0000 7f88d08b7640 1 -- 172.21.15.46:0/3153698255 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88cc1a2610 con 0x7f88cc1083b0 2024-09-21T03:54:32.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.253+0000 7f88d08b7640 1 --2- 172.21.15.46:0/3153698255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88cc1083b0 0x7f88cc19cc40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f88bc02a930 tx=0x7f88bc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:32.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.253+0000 7f88c27fc640 1 -- 172.21.15.46:0/3153698255 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88bc03f030 con 0x7f88cc1083b0 2024-09-21T03:54:32.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.253+0000 7f88d331c640 1 -- 172.21.15.46:0/3153698255 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88cc1a28a0 con 0x7f88cc1083b0 2024-09-21T03:54:32.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.253+0000 7f88c27fc640 1 -- 172.21.15.46:0/3153698255 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88bc003aa0 con 0x7f88cc1083b0 2024-09-21T03:54:32.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.253+0000 7f88c27fc640 1 -- 172.21.15.46:0/3153698255 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88bc035070 con 0x7f88cc1083b0 2024-09-21T03:54:32.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.253+0000 7f88d331c640 1 -- 172.21.15.46:0/3153698255 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88cc1a9060 con 0x7f88cc1083b0 2024-09-21T03:54:32.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.254+0000 7f88d331c640 1 -- 172.21.15.46:0/3153698255 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88cc103cf0 con 0x7f88cc1083b0 2024-09-21T03:54:32.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.256+0000 7f88c27fc640 1 -- 172.21.15.46:0/3153698255 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f88bc042030 con 0x7f88cc1083b0 2024-09-21T03:54:32.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.257+0000 7f88c27fc640 1 --2- 172.21.15.46:0/3153698255 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f88b80b6670 0x7f88b80b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:32.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.257+0000 7f88d10b8640 1 --2- 172.21.15.46:0/3153698255 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f88b80b6670 0x7f88b80b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:32.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.257+0000 7f88c27fc640 1 -- 172.21.15.46:0/3153698255 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f88bc108120 con 0x7f88cc1083b0 2024-09-21T03:54:32.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.258+0000 7f88d10b8640 1 --2- 172.21.15.46:0/3153698255 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f88b80b6670 0x7f88b80b8b80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f88c80058c0 tx=0x7f88c800a4c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:32.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.260+0000 7f88c27fc640 1 -- 172.21.15.46:0/3153698255 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f88bc0ce790 con 0x7f88cc1083b0 2024-09-21T03:54:32.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.488+0000 7f88d331c640 1 -- 172.21.15.46:0/3153698255 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f88cc100c10 con 0x7f88b80b6670 2024-09-21T03:54:32.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.489+0000 7f88c27fc640 1 -- 172.21.15.46:0/3153698255 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f88cc100c10 con 0x7f88b80b6670 2024-09-21T03:54:32.491 INFO:teuthology.orchestra.run.smithi046.stdout:Backend: cephadm 2024-09-21T03:54:32.492 INFO:teuthology.orchestra.run.smithi046.stdout:Available: Yes 2024-09-21T03:54:32.492 INFO:teuthology.orchestra.run.smithi046.stdout:Paused: No 2024-09-21T03:54:32.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.491+0000 7f88d331c640 1 -- 172.21.15.46:0/3153698255 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f88b80b6670 msgr2=0x7f88b80b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:32.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.491+0000 7f88d331c640 1 --2- 172.21.15.46:0/3153698255 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f88b80b6670 0x7f88b80b8b80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f88c80058c0 tx=0x7f88c800a4c0 comp rx=0 tx=0).stop 2024-09-21T03:54:32.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.491+0000 7f88d331c640 1 -- 172.21.15.46:0/3153698255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88cc1083b0 msgr2=0x7f88cc19cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:32.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.491+0000 7f88d331c640 1 --2- 172.21.15.46:0/3153698255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88cc1083b0 0x7f88cc19cc40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f88bc02a930 tx=0x7f88bc004270 comp rx=0 tx=0).stop 2024-09-21T03:54:32.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.491+0000 7f88d331c640 1 -- 172.21.15.46:0/3153698255 shutdown_connections 2024-09-21T03:54:32.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.491+0000 7f88d331c640 1 --2- 172.21.15.46:0/3153698255 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f88b80b6670 0x7f88b80b8b80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:32.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.491+0000 7f88d331c640 1 --2- 172.21.15.46:0/3153698255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88cc108d00 0x7f88cc1a1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:32.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.491+0000 7f88d331c640 1 --2- 172.21.15.46:0/3153698255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88cc1083b0 0x7f88cc19cc40 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:32.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.491+0000 7f88d331c640 1 --2- 172.21.15.46:0/3153698255 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88cc102a70 0x7f88cc19c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:32.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.491+0000 7f88d331c640 1 -- 172.21.15.46:0/3153698255 >> 172.21.15.46:0/3153698255 conn(0x7f88cc079710 msgr2=0x7f88cc1065d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:32.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.491+0000 7f88d331c640 1 -- 172.21.15.46:0/3153698255 shutdown_connections 2024-09-21T03:54:32.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:32.491+0000 7f88d331c640 1 -- 172.21.15.46:0/3153698255 wait complete. 2024-09-21T03:54:33.195 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ps' 2024-09-21T03:54:33.450 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:33.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:33 smithi046 ceph-mon[30954]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-09-21T03:54:33.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:33 smithi046 ceph-mon[30954]: from='client.15207 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:33.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:33 smithi162 ceph-mon[35071]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-09-21T03:54:33.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:33 smithi162 ceph-mon[35071]: from='client.15207 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:33.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:33 smithi105 ceph-mon[34773]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-09-21T03:54:33.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:33 smithi105 ceph-mon[34773]: from='client.15207 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:33.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.952+0000 7f633551d640 1 -- 172.21.15.46:0/149741891 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6330109df0 msgr2=0x7f6330110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:33.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.952+0000 7f633551d640 1 --2- 172.21.15.46:0/149741891 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6330109df0 0x7f6330110620 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6328009ca0 tx=0x7f632802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:54:33.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.952+0000 7f633551d640 1 -- 172.21.15.46:0/149741891 shutdown_connections 2024-09-21T03:54:33.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.952+0000 7f633551d640 1 --2- 172.21.15.46:0/149741891 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6330109df0 0x7f6330110620 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:33.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.952+0000 7f633551d640 1 --2- 172.21.15.46:0/149741891 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63301094a0 0x7f63301098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:33.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.953+0000 7f633551d640 1 --2- 172.21.15.46:0/149741891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6330103b60 0x7f6330103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:33.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.953+0000 7f633551d640 1 -- 172.21.15.46:0/149741891 >> 172.21.15.46:0/149741891 conn(0x7f633007b850 msgr2=0x7f633007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:33.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.953+0000 7f633551d640 1 -- 172.21.15.46:0/149741891 shutdown_connections 2024-09-21T03:54:33.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.953+0000 7f633551d640 1 -- 172.21.15.46:0/149741891 wait complete. 2024-09-21T03:54:33.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.953+0000 7f633551d640 1 Processor -- start 2024-09-21T03:54:33.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.953+0000 7f633551d640 1 -- start start 2024-09-21T03:54:33.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.954+0000 7f633551d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6330103b60 0x7f6330075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:33.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.954+0000 7f633551d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63301094a0 0x7f6330075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:33.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.954+0000 7f633551d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6330109df0 0x7f6330076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:33.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.954+0000 7f633551d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6330113ab0 con 0x7f6330109df0 2024-09-21T03:54:33.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.954+0000 7f633551d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6330113930 con 0x7f63301094a0 2024-09-21T03:54:33.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.954+0000 7f633551d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6330113c30 con 0x7f6330103b60 2024-09-21T03:54:33.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.954+0000 7f632f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6330109df0 0x7f6330076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:33.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.954+0000 7f632f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6330109df0 0x7f6330076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47930/0 (socket says 172.21.15.46:47930) 2024-09-21T03:54:33.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.954+0000 7f632f7fe640 1 -- 172.21.15.46:0/2232402088 learned_addr learned my addr 172.21.15.46:0/2232402088 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:33.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.954+0000 7f632effd640 1 --2- 172.21.15.46:0/2232402088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6330103b60 0x7f6330075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:33.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.954+0000 7f6327fff640 1 --2- 172.21.15.46:0/2232402088 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63301094a0 0x7f6330075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:33.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.954+0000 7f632f7fe640 1 -- 172.21.15.46:0/2232402088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6330103b60 msgr2=0x7f6330075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:33.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.954+0000 7f632f7fe640 1 --2- 172.21.15.46:0/2232402088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6330103b60 0x7f6330075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:33.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.954+0000 7f632f7fe640 1 -- 172.21.15.46:0/2232402088 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63301094a0 msgr2=0x7f6330075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:33.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.954+0000 7f632f7fe640 1 --2- 172.21.15.46:0/2232402088 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63301094a0 0x7f6330075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:33.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.954+0000 7f632f7fe640 1 -- 172.21.15.46:0/2232402088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63301a8740 con 0x7f6330109df0 2024-09-21T03:54:33.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.954+0000 7f632f7fe640 1 --2- 172.21.15.46:0/2232402088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6330109df0 0x7f6330076190 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6328005cc0 tx=0x7f632802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:33.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.954+0000 7f632cff9640 1 -- 172.21.15.46:0/2232402088 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6328003bf0 con 0x7f6330109df0 2024-09-21T03:54:33.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.955+0000 7f632cff9640 1 -- 172.21.15.46:0/2232402088 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6328003d90 con 0x7f6330109df0 2024-09-21T03:54:33.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.955+0000 7f633551d640 1 -- 172.21.15.46:0/2232402088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63301a89d0 con 0x7f6330109df0 2024-09-21T03:54:33.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.955+0000 7f632cff9640 1 -- 172.21.15.46:0/2232402088 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632802fbc0 con 0x7f6330109df0 2024-09-21T03:54:33.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.955+0000 7f633551d640 1 -- 172.21.15.46:0/2232402088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63301a8f10 con 0x7f6330109df0 2024-09-21T03:54:33.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.955+0000 7f633551d640 1 -- 172.21.15.46:0/2232402088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6330103f70 con 0x7f6330109df0 2024-09-21T03:54:33.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.957+0000 7f632cff9640 1 -- 172.21.15.46:0/2232402088 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f632802fd60 con 0x7f6330109df0 2024-09-21T03:54:33.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.958+0000 7f632cff9640 1 --2- 172.21.15.46:0/2232402088 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f631c0b65f0 0x7f631c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:33.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.958+0000 7f632effd640 1 --2- 172.21.15.46:0/2232402088 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f631c0b65f0 0x7f631c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:33.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.958+0000 7f632cff9640 1 -- 172.21.15.46:0/2232402088 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f6328108d00 con 0x7f6330109df0 2024-09-21T03:54:33.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.959+0000 7f632effd640 1 --2- 172.21.15.46:0/2232402088 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f631c0b65f0 0x7f631c0b8b00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6320005fd0 tx=0x7f6320005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:33.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:33.961+0000 7f632cff9640 1 -- 172.21.15.46:0/2232402088 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f63280cf3b0 con 0x7f6330109df0 2024-09-21T03:54:34.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:34.160+0000 7f633551d640 1 -- 172.21.15.46:0/2232402088 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f6330063800 con 0x7f631c0b65f0 2024-09-21T03:54:34.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:34.172+0000 7f632cff9640 1 -- 172.21.15.46:0/2232402088 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7f6330063800 con 0x7f631c0b65f0 2024-09-21T03:54:34.175 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T03:54:34.175 INFO:teuthology.orchestra.run.smithi046.stdout:mds.a smithi046 running (93s) 14s ago 93s 81.6M - 19.3.0-5120-g18432218 ddce307e1f32 cabdd9be3786 2024-09-21T03:54:34.175 INFO:teuthology.orchestra.run.smithi046.stdout:mds.b smithi105 running (91s) 24s ago 90s 95.9M - 19.3.0-5120-g18432218 ddce307e1f32 03d3be8b83bd 2024-09-21T03:54:34.175 INFO:teuthology.orchestra.run.smithi046.stdout:mds.c smithi162 running (105s) 24s ago 104s 82.0M - 19.3.0-5120-g18432218 ddce307e1f32 88adc97adf03 2024-09-21T03:54:34.175 INFO:teuthology.orchestra.run.smithi046.stdout:mds.d smithi046 running (112s) 14s ago 112s 82.2M - 19.3.0-5120-g18432218 ddce307e1f32 4bd777eda35d 2024-09-21T03:54:34.175 INFO:teuthology.orchestra.run.smithi046.stdout:mds.e smithi105 running (110s) 24s ago 109s 82.2M - 19.3.0-5120-g18432218 ddce307e1f32 b46c80157617 2024-09-21T03:54:34.175 INFO:teuthology.orchestra.run.smithi046.stdout:mds.f smithi162 running (107s) 24s ago 107s 81.5M - 19.3.0-5120-g18432218 ddce307e1f32 a992339f779d 2024-09-21T03:54:34.175 INFO:teuthology.orchestra.run.smithi046.stdout:mds.g smithi046 running (97s) 14s ago 96s 82.0M - 19.3.0-5120-g18432218 ddce307e1f32 c065a7f44fa9 2024-09-21T03:54:34.175 INFO:teuthology.orchestra.run.smithi046.stdout:mds.h smithi105 running (102s) 24s ago 102s 83.5M - 19.3.0-5120-g18432218 ddce307e1f32 7f1b2e9d0064 2024-09-21T03:54:34.175 INFO:teuthology.orchestra.run.smithi046.stdout:mds.i smithi162 running (99s) 24s ago 99s 86.4M - 19.3.0-5120-g18432218 ddce307e1f32 44540b407dca 2024-09-21T03:54:34.176 INFO:teuthology.orchestra.run.smithi046.stdout:mds.j smithi046 running (116s) 14s ago 116s 81.6M - 19.3.0-5120-g18432218 ddce307e1f32 81f7489c3115 2024-09-21T03:54:34.176 INFO:teuthology.orchestra.run.smithi046.stdout:mds.k smithi105 running (119s) 24s ago 119s 82.1M - 19.3.0-5120-g18432218 ddce307e1f32 0c584c8e6fd6 2024-09-21T03:54:34.176 INFO:teuthology.orchestra.run.smithi046.stdout:mds.l smithi162 running (2m) 24s ago 2m 82.1M - 19.3.0-5120-g18432218 ddce307e1f32 b974010889a1 2024-09-21T03:54:34.176 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.x smithi046 *:9283,8765 running (9m) 14s ago 9m 585M - 19.3.0-5120-g18432218 ddce307e1f32 b1ecd01064de 2024-09-21T03:54:34.176 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.y smithi105 *:8443,8765 running (7m) 24s ago 7m 524M - 19.3.0-5120-g18432218 ddce307e1f32 cd1ebcbf48aa 2024-09-21T03:54:34.176 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.z smithi162 *:8443,8765 running (7m) 24s ago 7m 525M - 19.3.0-5120-g18432218 ddce307e1f32 974d68a7ecd5 2024-09-21T03:54:34.176 INFO:teuthology.orchestra.run.smithi046.stdout:mon.a smithi046 running (9m) 14s ago 10m 120M 2048M 19.3.0-5120-g18432218 ddce307e1f32 2da122372490 2024-09-21T03:54:34.176 INFO:teuthology.orchestra.run.smithi046.stdout:mon.b smithi105 running (8m) 24s ago 8m 110M 2048M 19.3.0-5120-g18432218 ddce307e1f32 ddde3b0c49f4 2024-09-21T03:54:34.176 INFO:teuthology.orchestra.run.smithi046.stdout:mon.c smithi162 running (8m) 24s ago 8m 110M 2048M 19.3.0-5120-g18432218 ddce307e1f32 04f27d3f22a2 2024-09-21T03:54:34.176 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (7m) 14s ago 7m 122M 4273M 19.3.0-5120-g18432218 ddce307e1f32 919e9030ece5 2024-09-21T03:54:34.176 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi105 running (6m) 24s ago 6m 124M 4272M 19.3.0-5120-g18432218 ddce307e1f32 4265c72e96e8 2024-09-21T03:54:34.176 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi162 running (6m) 24s ago 6m 115M 4272M 19.3.0-5120-g18432218 ddce307e1f32 77f96c7013d6 2024-09-21T03:54:34.176 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi046 running (5m) 14s ago 5m 124M 4273M 19.3.0-5120-g18432218 ddce307e1f32 585fedfa3c73 2024-09-21T03:54:34.176 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi105 running (5m) 24s ago 5m 119M 4272M 19.3.0-5120-g18432218 ddce307e1f32 065efe691382 2024-09-21T03:54:34.177 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi162 running (4m) 24s ago 4m 113M 4272M 19.3.0-5120-g18432218 ddce307e1f32 b9d6ed4ead0a 2024-09-21T03:54:34.177 INFO:teuthology.orchestra.run.smithi046.stdout:osd.6 smithi046 running (4m) 14s ago 4m 122M 4273M 19.3.0-5120-g18432218 ddce307e1f32 515deeb716a9 2024-09-21T03:54:34.177 INFO:teuthology.orchestra.run.smithi046.stdout:osd.7 smithi105 running (4m) 24s ago 4m 123M 4272M 19.3.0-5120-g18432218 ddce307e1f32 38d4a10dd770 2024-09-21T03:54:34.177 INFO:teuthology.orchestra.run.smithi046.stdout:osd.8 smithi162 running (3m) 24s ago 3m 123M 4272M 19.3.0-5120-g18432218 ddce307e1f32 dd0744cfeded 2024-09-21T03:54:34.177 INFO:teuthology.orchestra.run.smithi046.stdout:osd.9 smithi046 running (3m) 14s ago 3m 108M 4273M 19.3.0-5120-g18432218 ddce307e1f32 7c926f508541 2024-09-21T03:54:34.177 INFO:teuthology.orchestra.run.smithi046.stdout:osd.10 smithi105 running (2m) 24s ago 2m 110M 4272M 19.3.0-5120-g18432218 ddce307e1f32 bc151da30a85 2024-09-21T03:54:34.177 INFO:teuthology.orchestra.run.smithi046.stdout:osd.11 smithi162 running (2m) 24s ago 2m 119M 4272M 19.3.0-5120-g18432218 ddce307e1f32 83528f2e8312 2024-09-21T03:54:34.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:34.175+0000 7f633551d640 1 -- 172.21.15.46:0/2232402088 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f631c0b65f0 msgr2=0x7f631c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:34.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:34.175+0000 7f633551d640 1 --2- 172.21.15.46:0/2232402088 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f631c0b65f0 0x7f631c0b8b00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6320005fd0 tx=0x7f6320005850 comp rx=0 tx=0).stop 2024-09-21T03:54:34.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:34.175+0000 7f633551d640 1 -- 172.21.15.46:0/2232402088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6330109df0 msgr2=0x7f6330076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:34.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:34.175+0000 7f633551d640 1 --2- 172.21.15.46:0/2232402088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6330109df0 0x7f6330076190 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6328005cc0 tx=0x7f632802f380 comp rx=0 tx=0).stop 2024-09-21T03:54:34.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:34.175+0000 7f633551d640 1 -- 172.21.15.46:0/2232402088 shutdown_connections 2024-09-21T03:54:34.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:34.175+0000 7f633551d640 1 --2- 172.21.15.46:0/2232402088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6330109df0 0x7f6330076190 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:34.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:34.175+0000 7f633551d640 1 --2- 172.21.15.46:0/2232402088 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63301094a0 0x7f6330075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:34.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:34.175+0000 7f633551d640 1 --2- 172.21.15.46:0/2232402088 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f631c0b65f0 0x7f631c0b8b00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:34.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:34.175+0000 7f633551d640 1 --2- 172.21.15.46:0/2232402088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6330103b60 0x7f6330075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:34.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:34.175+0000 7f633551d640 1 -- 172.21.15.46:0/2232402088 >> 172.21.15.46:0/2232402088 conn(0x7f633007b850 msgr2=0x7f6330105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:34.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:34.175+0000 7f633551d640 1 -- 172.21.15.46:0/2232402088 shutdown_connections 2024-09-21T03:54:34.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:34.175+0000 7f633551d640 1 -- 172.21.15.46:0/2232402088 wait complete. 2024-09-21T03:54:34.924 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ls' 2024-09-21T03:54:35.186 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:35.604 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:35 smithi046 ceph-mon[30954]: pgmap v306: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:54:35.604 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:35 smithi046 ceph-mon[30954]: from='client.15213 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:35.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:35 smithi162 ceph-mon[35071]: pgmap v306: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:54:35.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:35 smithi162 ceph-mon[35071]: from='client.15213 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:35.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.695+0000 7f00531a3640 1 -- 172.21.15.46:0/1720182778 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f004c1083b0 msgr2=0x7f004c1087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:35.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.695+0000 7f00531a3640 1 --2- 172.21.15.46:0/1720182778 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f004c1083b0 0x7f004c1087c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f003c009ca0 tx=0x7f003c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:54:35.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.695+0000 7f00531a3640 1 -- 172.21.15.46:0/1720182778 shutdown_connections 2024-09-21T03:54:35.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.695+0000 7f00531a3640 1 --2- 172.21.15.46:0/1720182778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f004c108d00 0x7f004c10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:35.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.695+0000 7f00531a3640 1 --2- 172.21.15.46:0/1720182778 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f004c1083b0 0x7f004c1087c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:35.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.695+0000 7f00531a3640 1 --2- 172.21.15.46:0/1720182778 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f004c102a70 0x7f004c102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:35.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.695+0000 7f00531a3640 1 -- 172.21.15.46:0/1720182778 >> 172.21.15.46:0/1720182778 conn(0x7f004c079730 msgr2=0x7f004c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:35.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.695+0000 7f00531a3640 1 -- 172.21.15.46:0/1720182778 shutdown_connections 2024-09-21T03:54:35.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.695+0000 7f00531a3640 1 -- 172.21.15.46:0/1720182778 wait complete. 2024-09-21T03:54:35.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.696+0000 7f00531a3640 1 Processor -- start 2024-09-21T03:54:35.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.696+0000 7f00531a3640 1 -- start start 2024-09-21T03:54:35.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.696+0000 7f00531a3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f004c102a70 0x7f004c19a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:35.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.696+0000 7f00531a3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f004c1083b0 0x7f004c19aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:35.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.696+0000 7f00531a3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f004c108d00 0x7f004c19fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:35.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.696+0000 7f00531a3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f004c112970 con 0x7f004c108d00 2024-09-21T03:54:35.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.696+0000 7f00531a3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f004c1127f0 con 0x7f004c1083b0 2024-09-21T03:54:35.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.696+0000 7f00531a3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f004c112af0 con 0x7f004c102a70 2024-09-21T03:54:35.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.696+0000 7f0051740640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f004c108d00 0x7f004c19fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:35.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.696+0000 7f0051740640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f004c108d00 0x7f004c19fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47950/0 (socket says 172.21.15.46:47950) 2024-09-21T03:54:35.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.696+0000 7f0051740640 1 -- 172.21.15.46:0/3589315731 learned_addr learned my addr 172.21.15.46:0/3589315731 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:35.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.696+0000 7f0050f3f640 1 --2- 172.21.15.46:0/3589315731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f004c102a70 0x7f004c19a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:35.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.697+0000 7f004bfff640 1 --2- 172.21.15.46:0/3589315731 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f004c1083b0 0x7f004c19aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:35.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.697+0000 7f0051740640 1 -- 172.21.15.46:0/3589315731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f004c102a70 msgr2=0x7f004c19a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:35.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.697+0000 7f0051740640 1 --2- 172.21.15.46:0/3589315731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f004c102a70 0x7f004c19a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:35.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.697+0000 7f0051740640 1 -- 172.21.15.46:0/3589315731 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f004c1083b0 msgr2=0x7f004c19aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:35.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.697+0000 7f0051740640 1 --2- 172.21.15.46:0/3589315731 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f004c1083b0 0x7f004c19aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:35.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.697+0000 7f0051740640 1 -- 172.21.15.46:0/3589315731 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f004c1a04c0 con 0x7f004c108d00 2024-09-21T03:54:35.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.697+0000 7f004bfff640 1 --2- 172.21.15.46:0/3589315731 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f004c1083b0 0x7f004c19aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:54:35.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.697+0000 7f0051740640 1 --2- 172.21.15.46:0/3589315731 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f004c108d00 0x7f004c19fd90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f004400d750 tx=0x7f004400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:35.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.697+0000 7f0049ffb640 1 -- 172.21.15.46:0/3589315731 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0044017070 con 0x7f004c108d00 2024-09-21T03:54:35.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.697+0000 7f0049ffb640 1 -- 172.21.15.46:0/3589315731 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00440054d0 con 0x7f004c108d00 2024-09-21T03:54:35.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.697+0000 7f0049ffb640 1 -- 172.21.15.46:0/3589315731 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0044004c60 con 0x7f004c108d00 2024-09-21T03:54:35.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.697+0000 7f00531a3640 1 -- 172.21.15.46:0/3589315731 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f004c1a07b0 con 0x7f004c108d00 2024-09-21T03:54:35.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.697+0000 7f00531a3640 1 -- 172.21.15.46:0/3589315731 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f004c1a6f10 con 0x7f004c108d00 2024-09-21T03:54:35.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.698+0000 7f00531a3640 1 -- 172.21.15.46:0/3589315731 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f004c103cf0 con 0x7f004c108d00 2024-09-21T03:54:35.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.700+0000 7f0049ffb640 1 -- 172.21.15.46:0/3589315731 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f0044009bd0 con 0x7f004c108d00 2024-09-21T03:54:35.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.701+0000 7f0049ffb640 1 --2- 172.21.15.46:0/3589315731 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f00380b65f0 0x7f00380b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:35.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.701+0000 7f0050f3f640 1 --2- 172.21.15.46:0/3589315731 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f00380b65f0 0x7f00380b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:35.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.701+0000 7f0049ffb640 1 -- 172.21.15.46:0/3589315731 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f00440e73d0 con 0x7f004c108d00 2024-09-21T03:54:35.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.701+0000 7f0050f3f640 1 --2- 172.21.15.46:0/3589315731 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f00380b65f0 0x7f00380b8b00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f00340058c0 tx=0x7f003400a4c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:35.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.704+0000 7f0049ffb640 1 -- 172.21.15.46:0/3589315731 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f00440ada40 con 0x7f004c108d00 2024-09-21T03:54:35.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:35 smithi105 ceph-mon[34773]: pgmap v306: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:54:35.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:35 smithi105 ceph-mon[34773]: from='client.15213 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:35.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.901+0000 7f00531a3640 1 -- 172.21.15.46:0/3589315731 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f004c063800 con 0x7f00380b65f0 2024-09-21T03:54:35.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.908+0000 7f0049ffb640 1 -- 172.21.15.46:0/3589315731 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f004c063800 con 0x7f00380b65f0 2024-09-21T03:54:35.910 INFO:teuthology.orchestra.run.smithi046.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-21T03:54:35.910 INFO:teuthology.orchestra.run.smithi046.stdout:mds.all 12/12 26s ago 2m smithi046=a;smithi046=d;smithi046=g;smithi046=j;smithi105=b;smithi105=e;smithi105=h;smithi105=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l;count:12 2024-09-21T03:54:35.910 INFO:teuthology.orchestra.run.smithi046.stdout:mgr 3/3 26s ago 8m smithi046=x;smithi105=y;smithi162=z;count:3 2024-09-21T03:54:35.911 INFO:teuthology.orchestra.run.smithi046.stdout:mon 3/3 26s ago 8m smithi046:172.21.15.46=a;smithi105:172.21.15.105=b;smithi162:172.21.15.162=c;count:3 2024-09-21T03:54:35.911 INFO:teuthology.orchestra.run.smithi046.stdout:osd 12 26s ago - 2024-09-21T03:54:35.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.910+0000 7f00531a3640 1 -- 172.21.15.46:0/3589315731 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f00380b65f0 msgr2=0x7f00380b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:35.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.910+0000 7f00531a3640 1 --2- 172.21.15.46:0/3589315731 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f00380b65f0 0x7f00380b8b00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f00340058c0 tx=0x7f003400a4c0 comp rx=0 tx=0).stop 2024-09-21T03:54:35.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.910+0000 7f00531a3640 1 -- 172.21.15.46:0/3589315731 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f004c108d00 msgr2=0x7f004c19fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:35.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.910+0000 7f00531a3640 1 --2- 172.21.15.46:0/3589315731 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f004c108d00 0x7f004c19fd90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f004400d750 tx=0x7f004400dc10 comp rx=0 tx=0).stop 2024-09-21T03:54:35.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.910+0000 7f00531a3640 1 -- 172.21.15.46:0/3589315731 shutdown_connections 2024-09-21T03:54:35.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.910+0000 7f00531a3640 1 --2- 172.21.15.46:0/3589315731 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f004c108d00 0x7f004c19fd90 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:35.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.910+0000 7f00531a3640 1 --2- 172.21.15.46:0/3589315731 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f004c1083b0 0x7f004c19aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:35.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.910+0000 7f00531a3640 1 --2- 172.21.15.46:0/3589315731 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f00380b65f0 0x7f00380b8b00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:35.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.910+0000 7f00531a3640 1 --2- 172.21.15.46:0/3589315731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f004c102a70 0x7f004c19a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:35.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.910+0000 7f00531a3640 1 -- 172.21.15.46:0/3589315731 >> 172.21.15.46:0/3589315731 conn(0x7f004c079730 msgr2=0x7f004c06bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:35.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.910+0000 7f00531a3640 1 -- 172.21.15.46:0/3589315731 shutdown_connections 2024-09-21T03:54:35.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:35.910+0000 7f00531a3640 1 -- 172.21.15.46:0/3589315731 wait complete. 2024-09-21T03:54:36.547 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- bash -c 'ceph orch host ls' 2024-09-21T03:54:36.804 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:37.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.288+0000 7fb254ab5640 1 -- 172.21.15.46:0/3182832912 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2501083c0 msgr2=0x7fb2501087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:37.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.288+0000 7fb254ab5640 1 --2- 172.21.15.46:0/3182832912 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2501083c0 0x7fb2501087d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb244009900 tx=0x7fb24402a410 comp rx=0 tx=0).stop 2024-09-21T03:54:37.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.288+0000 7fb254ab5640 1 -- 172.21.15.46:0/3182832912 shutdown_connections 2024-09-21T03:54:37.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.288+0000 7fb254ab5640 1 --2- 172.21.15.46:0/3182832912 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb250108d10 0x7fb25010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:37.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.288+0000 7fb254ab5640 1 --2- 172.21.15.46:0/3182832912 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2501083c0 0x7fb2501087d0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:37.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.288+0000 7fb254ab5640 1 --2- 172.21.15.46:0/3182832912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb250102a80 0x7fb250102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:37.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.288+0000 7fb254ab5640 1 -- 172.21.15.46:0/3182832912 >> 172.21.15.46:0/3182832912 conn(0x7fb250079740 msgr2=0x7fb250079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:37.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.288+0000 7fb254ab5640 1 -- 172.21.15.46:0/3182832912 shutdown_connections 2024-09-21T03:54:37.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.288+0000 7fb254ab5640 1 -- 172.21.15.46:0/3182832912 wait complete. 2024-09-21T03:54:37.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.289+0000 7fb254ab5640 1 Processor -- start 2024-09-21T03:54:37.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.289+0000 7fb254ab5640 1 -- start start 2024-09-21T03:54:37.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.290+0000 7fb254ab5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb250102a80 0x7fb2501994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:37.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.290+0000 7fb254ab5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2501083c0 0x7fb250199a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:37.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.290+0000 7fb254ab5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb250108d10 0x7fb25019ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:37.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.290+0000 7fb254ab5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb250112980 con 0x7fb250102a80 2024-09-21T03:54:37.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.290+0000 7fb254ab5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb250112800 con 0x7fb2501083c0 2024-09-21T03:54:37.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.290+0000 7fb254ab5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb250112b00 con 0x7fb250108d10 2024-09-21T03:54:37.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.290+0000 7fb24e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb250102a80 0x7fb2501994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:37.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.290+0000 7fb24e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb250102a80 0x7fb2501994f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47954/0 (socket says 172.21.15.46:47954) 2024-09-21T03:54:37.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.290+0000 7fb24e59c640 1 -- 172.21.15.46:0/2976930585 learned_addr learned my addr 172.21.15.46:0/2976930585 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:37.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.290+0000 7fb24dd9b640 1 --2- 172.21.15.46:0/2976930585 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2501083c0 0x7fb250199a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:37.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.290+0000 7fb24ed9d640 1 --2- 172.21.15.46:0/2976930585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb250108d10 0x7fb25019ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:37.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.290+0000 7fb24e59c640 1 -- 172.21.15.46:0/2976930585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb250108d10 msgr2=0x7fb25019ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:37.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.290+0000 7fb24e59c640 1 --2- 172.21.15.46:0/2976930585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb250108d10 0x7fb25019ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:37.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.290+0000 7fb24e59c640 1 -- 172.21.15.46:0/2976930585 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2501083c0 msgr2=0x7fb250199a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:37.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.290+0000 7fb24e59c640 1 --2- 172.21.15.46:0/2976930585 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2501083c0 0x7fb250199a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:37.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.290+0000 7fb24e59c640 1 -- 172.21.15.46:0/2976930585 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb25019f3a0 con 0x7fb250102a80 2024-09-21T03:54:37.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.290+0000 7fb24ed9d640 1 --2- 172.21.15.46:0/2976930585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb250108d10 0x7fb25019ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:54:37.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.290+0000 7fb24e59c640 1 --2- 172.21.15.46:0/2976930585 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb250102a80 0x7fb2501994f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb24000c920 tx=0x7fb24000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:37.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.291+0000 7fb23f7fe640 1 -- 172.21.15.46:0/2976930585 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb240007c70 con 0x7fb250102a80 2024-09-21T03:54:37.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.291+0000 7fb23f7fe640 1 -- 172.21.15.46:0/2976930585 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb240007e10 con 0x7fb250102a80 2024-09-21T03:54:37.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.291+0000 7fb23f7fe640 1 -- 172.21.15.46:0/2976930585 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb240018820 con 0x7fb250102a80 2024-09-21T03:54:37.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.291+0000 7fb254ab5640 1 -- 172.21.15.46:0/2976930585 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb25019f690 con 0x7fb250102a80 2024-09-21T03:54:37.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.291+0000 7fb254ab5640 1 -- 172.21.15.46:0/2976930585 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2501a5eb0 con 0x7fb250102a80 2024-09-21T03:54:37.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.292+0000 7fb254ab5640 1 -- 172.21.15.46:0/2976930585 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb250103d00 con 0x7fb250102a80 2024-09-21T03:54:37.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.293+0000 7fb23f7fe640 1 -- 172.21.15.46:0/2976930585 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fb24000f450 con 0x7fb250102a80 2024-09-21T03:54:37.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.294+0000 7fb23f7fe640 1 --2- 172.21.15.46:0/2976930585 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb2380b66a0 0x7fb2380b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:37.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.295+0000 7fb24dd9b640 1 --2- 172.21.15.46:0/2976930585 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb2380b66a0 0x7fb2380b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:37.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.295+0000 7fb23f7fe640 1 -- 172.21.15.46:0/2976930585 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fb2400e78c0 con 0x7fb250102a80 2024-09-21T03:54:37.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.295+0000 7fb24dd9b640 1 --2- 172.21.15.46:0/2976930585 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb2380b66a0 0x7fb2380b8bb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb244000c00 tx=0x7fb244031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:37.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.298+0000 7fb23f7fe640 1 -- 172.21.15.46:0/2976930585 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb240014030 con 0x7fb250102a80 2024-09-21T03:54:37.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.493+0000 7fb254ab5640 1 -- 172.21.15.46:0/2976930585 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fb250063800 con 0x7fb2380b66a0 2024-09-21T03:54:37.495 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:37 smithi046 ceph-mon[30954]: from='client.15219 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:37.495 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:37 smithi046 ceph-mon[30954]: pgmap v307: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-09-21T03:54:37.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.495+0000 7fb23f7fe640 1 -- 172.21.15.46:0/2976930585 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fb250063800 con 0x7fb2380b66a0 2024-09-21T03:54:37.497 INFO:teuthology.orchestra.run.smithi046.stdout:HOST ADDR LABELS STATUS 2024-09-21T03:54:37.497 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046 172.21.15.46 2024-09-21T03:54:37.497 INFO:teuthology.orchestra.run.smithi046.stdout:smithi105 172.21.15.105 2024-09-21T03:54:37.497 INFO:teuthology.orchestra.run.smithi046.stdout:smithi162 172.21.15.162 2024-09-21T03:54:37.497 INFO:teuthology.orchestra.run.smithi046.stdout:3 hosts in cluster 2024-09-21T03:54:37.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.497+0000 7fb254ab5640 1 -- 172.21.15.46:0/2976930585 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb2380b66a0 msgr2=0x7fb2380b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:37.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.497+0000 7fb254ab5640 1 --2- 172.21.15.46:0/2976930585 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb2380b66a0 0x7fb2380b8bb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb244000c00 tx=0x7fb244031400 comp rx=0 tx=0).stop 2024-09-21T03:54:37.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.497+0000 7fb254ab5640 1 -- 172.21.15.46:0/2976930585 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb250102a80 msgr2=0x7fb2501994f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:37.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.497+0000 7fb254ab5640 1 --2- 172.21.15.46:0/2976930585 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb250102a80 0x7fb2501994f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb24000c920 tx=0x7fb24000cde0 comp rx=0 tx=0).stop 2024-09-21T03:54:37.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.497+0000 7fb254ab5640 1 -- 172.21.15.46:0/2976930585 shutdown_connections 2024-09-21T03:54:37.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.497+0000 7fb254ab5640 1 --2- 172.21.15.46:0/2976930585 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb2380b66a0 0x7fb2380b8bb0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:37.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.497+0000 7fb254ab5640 1 --2- 172.21.15.46:0/2976930585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb250108d10 0x7fb25019ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:37.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.497+0000 7fb254ab5640 1 --2- 172.21.15.46:0/2976930585 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2501083c0 0x7fb250199a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:37.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.497+0000 7fb254ab5640 1 --2- 172.21.15.46:0/2976930585 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb250102a80 0x7fb2501994f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:37.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.497+0000 7fb254ab5640 1 -- 172.21.15.46:0/2976930585 >> 172.21.15.46:0/2976930585 conn(0x7fb250079740 msgr2=0x7fb250104580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:37.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.497+0000 7fb254ab5640 1 -- 172.21.15.46:0/2976930585 shutdown_connections 2024-09-21T03:54:37.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:37.497+0000 7fb254ab5640 1 -- 172.21.15.46:0/2976930585 wait complete. 2024-09-21T03:54:37.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:37 smithi162 ceph-mon[35071]: from='client.15219 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:37.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:37 smithi162 ceph-mon[35071]: pgmap v307: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-09-21T03:54:37.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:37 smithi105 ceph-mon[34773]: from='client.15219 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:37.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:37 smithi105 ceph-mon[34773]: pgmap v307: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-09-21T03:54:38.163 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- bash -c 'ceph orch device ls' 2024-09-21T03:54:38.431 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:38.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:38 smithi046 ceph-mon[30954]: from='client.15225 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:38.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:38 smithi162 ceph-mon[35071]: from='client.15225 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:38.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:38 smithi105 ceph-mon[34773]: from='client.15225 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:38.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.957+0000 7f91e1e51640 1 -- 172.21.15.46:0/3198050983 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91dc108d00 msgr2=0x7f91dc10f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:38.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.957+0000 7f91e1e51640 1 --2- 172.21.15.46:0/3198050983 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91dc108d00 0x7f91dc10f530 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f91d4009ca0 tx=0x7f91d402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:54:38.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.957+0000 7f91e1e51640 1 -- 172.21.15.46:0/3198050983 shutdown_connections 2024-09-21T03:54:38.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.957+0000 7f91e1e51640 1 --2- 172.21.15.46:0/3198050983 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91dc108d00 0x7f91dc10f530 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:38.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.957+0000 7f91e1e51640 1 --2- 172.21.15.46:0/3198050983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91dc1083b0 0x7f91dc1087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:38.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.957+0000 7f91e1e51640 1 --2- 172.21.15.46:0/3198050983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91dc102a70 0x7f91dc102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:38.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.957+0000 7f91e1e51640 1 -- 172.21.15.46:0/3198050983 >> 172.21.15.46:0/3198050983 conn(0x7f91dc079730 msgr2=0x7f91dc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:38.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.957+0000 7f91e1e51640 1 -- 172.21.15.46:0/3198050983 shutdown_connections 2024-09-21T03:54:38.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.957+0000 7f91e1e51640 1 -- 172.21.15.46:0/3198050983 wait complete. 2024-09-21T03:54:38.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.958+0000 7f91e1e51640 1 Processor -- start 2024-09-21T03:54:38.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.958+0000 7f91e1e51640 1 -- start start 2024-09-21T03:54:38.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.958+0000 7f91e1e51640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91dc102a70 0x7f91dc19a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:38.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.958+0000 7f91e1e51640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91dc1083b0 0x7f91dc19a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:38.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.958+0000 7f91e1e51640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91dc108d00 0x7f91dc19fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:38.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.958+0000 7f91e1e51640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f91dc112970 con 0x7f91dc1083b0 2024-09-21T03:54:38.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.958+0000 7f91e1e51640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f91dc1127f0 con 0x7f91dc108d00 2024-09-21T03:54:38.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.958+0000 7f91e1e51640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f91dc112af0 con 0x7f91dc102a70 2024-09-21T03:54:38.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.958+0000 7f91d2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91dc1083b0 0x7f91dc19a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:38.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.959+0000 7f91d2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91dc1083b0 0x7f91dc19a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47982/0 (socket says 172.21.15.46:47982) 2024-09-21T03:54:38.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.959+0000 7f91d2ffd640 1 -- 172.21.15.46:0/4270292237 learned_addr learned my addr 172.21.15.46:0/4270292237 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:38.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.959+0000 7f91dbfff640 1 --2- 172.21.15.46:0/4270292237 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91dc108d00 0x7f91dc19fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:38.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.959+0000 7f91db7fe640 1 --2- 172.21.15.46:0/4270292237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91dc102a70 0x7f91dc19a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:38.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.959+0000 7f91d2ffd640 1 -- 172.21.15.46:0/4270292237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91dc102a70 msgr2=0x7f91dc19a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:38.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.959+0000 7f91d2ffd640 1 --2- 172.21.15.46:0/4270292237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91dc102a70 0x7f91dc19a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:38.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.959+0000 7f91d2ffd640 1 -- 172.21.15.46:0/4270292237 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91dc108d00 msgr2=0x7f91dc19fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:38.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.959+0000 7f91d2ffd640 1 --2- 172.21.15.46:0/4270292237 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91dc108d00 0x7f91dc19fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:38.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.959+0000 7f91d2ffd640 1 -- 172.21.15.46:0/4270292237 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91dc1a0380 con 0x7f91dc1083b0 2024-09-21T03:54:38.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.959+0000 7f91d2ffd640 1 --2- 172.21.15.46:0/4270292237 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91dc1083b0 0x7f91dc19a9b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f91c400d740 tx=0x7f91c400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:38.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.959+0000 7f91d97fa640 1 -- 172.21.15.46:0/4270292237 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c4017070 con 0x7f91dc1083b0 2024-09-21T03:54:38.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.959+0000 7f91d97fa640 1 -- 172.21.15.46:0/4270292237 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91c400de50 con 0x7f91dc1083b0 2024-09-21T03:54:38.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.959+0000 7f91e1e51640 1 -- 172.21.15.46:0/4270292237 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91dc1a0670 con 0x7f91dc1083b0 2024-09-21T03:54:38.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.959+0000 7f91d97fa640 1 -- 172.21.15.46:0/4270292237 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c4004ce0 con 0x7f91dc1083b0 2024-09-21T03:54:38.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.959+0000 7f91e1e51640 1 -- 172.21.15.46:0/4270292237 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91dc1a6dd0 con 0x7f91dc1083b0 2024-09-21T03:54:38.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.960+0000 7f91e1e51640 1 -- 172.21.15.46:0/4270292237 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91dc103cf0 con 0x7f91dc1083b0 2024-09-21T03:54:38.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.962+0000 7f91d97fa640 1 -- 172.21.15.46:0/4270292237 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f91c4004e80 con 0x7f91dc1083b0 2024-09-21T03:54:38.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.963+0000 7f91d97fa640 1 --2- 172.21.15.46:0/4270292237 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f91c80b65f0 0x7f91c80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:38.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.963+0000 7f91db7fe640 1 --2- 172.21.15.46:0/4270292237 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f91c80b65f0 0x7f91c80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:38.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.963+0000 7f91d97fa640 1 -- 172.21.15.46:0/4270292237 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f91c40e72c0 con 0x7f91dc1083b0 2024-09-21T03:54:38.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.963+0000 7f91db7fe640 1 --2- 172.21.15.46:0/4270292237 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f91c80b65f0 0x7f91c80b8b00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f91cc00bbe0 tx=0x7f91cc00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:38.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:38.966+0000 7f91d97fa640 1 -- 172.21.15.46:0/4270292237 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f91c40b1d10 con 0x7f91dc1083b0 2024-09-21T03:54:39.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:39.161+0000 7f91e1e51640 1 -- 172.21.15.46:0/4270292237 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f91dc063800 con 0x7f91c80b65f0 2024-09-21T03:54:39.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:39.163+0000 7f91d97fa640 1 -- 172.21.15.46:0/4270292237 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f91dc063800 con 0x7f91c80b65f0 2024-09-21T03:54:39.165 INFO:teuthology.orchestra.run.smithi046.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-21T03:54:39.165 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7512009A480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-21T03:54:39.165 INFO:teuthology.orchestra.run.smithi046.stdout:smithi105 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400TR400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-21T03:54:39.165 INFO:teuthology.orchestra.run.smithi046.stdout:smithi162 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300JU400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-21T03:54:39.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:39.165+0000 7f91e1e51640 1 -- 172.21.15.46:0/4270292237 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f91c80b65f0 msgr2=0x7f91c80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:39.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:39.165+0000 7f91e1e51640 1 --2- 172.21.15.46:0/4270292237 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f91c80b65f0 0x7f91c80b8b00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f91cc00bbe0 tx=0x7f91cc00b390 comp rx=0 tx=0).stop 2024-09-21T03:54:39.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:39.165+0000 7f91e1e51640 1 -- 172.21.15.46:0/4270292237 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91dc1083b0 msgr2=0x7f91dc19a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:39.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:39.165+0000 7f91e1e51640 1 --2- 172.21.15.46:0/4270292237 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91dc1083b0 0x7f91dc19a9b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f91c400d740 tx=0x7f91c400dc00 comp rx=0 tx=0).stop 2024-09-21T03:54:39.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:39.165+0000 7f91e1e51640 1 -- 172.21.15.46:0/4270292237 shutdown_connections 2024-09-21T03:54:39.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:39.165+0000 7f91e1e51640 1 --2- 172.21.15.46:0/4270292237 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91dc108d00 0x7f91dc19fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:39.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:39.165+0000 7f91e1e51640 1 --2- 172.21.15.46:0/4270292237 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91dc1083b0 0x7f91dc19a9b0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:39.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:39.165+0000 7f91e1e51640 1 --2- 172.21.15.46:0/4270292237 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f91c80b65f0 0x7f91c80b8b00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:39.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:39.165+0000 7f91e1e51640 1 --2- 172.21.15.46:0/4270292237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91dc102a70 0x7f91dc19a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:39.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:39.165+0000 7f91e1e51640 1 -- 172.21.15.46:0/4270292237 >> 172.21.15.46:0/4270292237 conn(0x7f91dc079730 msgr2=0x7f91dc06be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:39.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:39.165+0000 7f91e1e51640 1 -- 172.21.15.46:0/4270292237 shutdown_connections 2024-09-21T03:54:39.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:39.165+0000 7f91e1e51640 1 -- 172.21.15.46:0/4270292237 wait complete. 2024-09-21T03:54:39.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:39 smithi046 ceph-mon[30954]: pgmap v308: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:54:39.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:39 smithi162 ceph-mon[35071]: pgmap v308: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:54:39.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:39 smithi105 ceph-mon[34773]: pgmap v308: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:54:39.839 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T03:54:39.846 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi046.front.sepia.ceph.com 2024-09-21T03:54:39.847 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T03:54:40.107 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:40.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:40 smithi046 ceph-mon[30954]: from='client.15231 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:40.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.596+0000 7f7c470ec640 1 -- 172.21.15.46:0/2846523853 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c40104a10 msgr2=0x7f7c40104e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:40.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.596+0000 7f7c470ec640 1 --2- 172.21.15.46:0/2846523853 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c40104a10 0x7f7c40104e20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7c34009900 tx=0x7f7c3402a410 comp rx=0 tx=0).stop 2024-09-21T03:54:40.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.596+0000 7f7c470ec640 1 -- 172.21.15.46:0/2846523853 shutdown_connections 2024-09-21T03:54:40.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.596+0000 7f7c470ec640 1 --2- 172.21.15.46:0/2846523853 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c4010de40 0x7f7c40110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:40.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.596+0000 7f7c470ec640 1 --2- 172.21.15.46:0/2846523853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c40105360 0x7f7c4010d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:40.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.596+0000 7f7c470ec640 1 --2- 172.21.15.46:0/2846523853 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c40104a10 0x7f7c40104e20 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:40.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.596+0000 7f7c470ec640 1 -- 172.21.15.46:0/2846523853 >> 172.21.15.46:0/2846523853 conn(0x7f7c40079720 msgr2=0x7f7c40079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:40.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.597+0000 7f7c470ec640 1 -- 172.21.15.46:0/2846523853 shutdown_connections 2024-09-21T03:54:40.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.597+0000 7f7c470ec640 1 -- 172.21.15.46:0/2846523853 wait complete. 2024-09-21T03:54:40.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.597+0000 7f7c470ec640 1 Processor -- start 2024-09-21T03:54:40.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.597+0000 7f7c470ec640 1 -- start start 2024-09-21T03:54:40.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.598+0000 7f7c470ec640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c40104a10 0x7f7c40102750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:40.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.598+0000 7f7c470ec640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c40105360 0x7f7c40102c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:40.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.598+0000 7f7c470ec640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c4010de40 0x7f7c401031d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:40.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.598+0000 7f7c470ec640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7c40113aa0 con 0x7f7c4010de40 2024-09-21T03:54:40.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.598+0000 7f7c470ec640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7c40113920 con 0x7f7c40104a10 2024-09-21T03:54:40.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.598+0000 7f7c470ec640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7c40113c20 con 0x7f7c40105360 2024-09-21T03:54:40.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.598+0000 7f7c45689640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c4010de40 0x7f7c401031d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:40.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.598+0000 7f7c45689640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c4010de40 0x7f7c401031d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48000/0 (socket says 172.21.15.46:48000) 2024-09-21T03:54:40.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.598+0000 7f7c45689640 1 -- 172.21.15.46:0/3373056341 learned_addr learned my addr 172.21.15.46:0/3373056341 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:40.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.598+0000 7f7c44e88640 1 --2- 172.21.15.46:0/3373056341 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c40104a10 0x7f7c40102750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:40.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.598+0000 7f7c3ffff640 1 --2- 172.21.15.46:0/3373056341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c40105360 0x7f7c40102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:40.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.598+0000 7f7c45689640 1 -- 172.21.15.46:0/3373056341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c40105360 msgr2=0x7f7c40102c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:40.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.598+0000 7f7c45689640 1 --2- 172.21.15.46:0/3373056341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c40105360 0x7f7c40102c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:40.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.598+0000 7f7c45689640 1 -- 172.21.15.46:0/3373056341 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c40104a10 msgr2=0x7f7c40102750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:40.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.598+0000 7f7c45689640 1 --2- 172.21.15.46:0/3373056341 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c40104a10 0x7f7c40102750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:40.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.598+0000 7f7c45689640 1 -- 172.21.15.46:0/3373056341 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c401a8750 con 0x7f7c4010de40 2024-09-21T03:54:40.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.598+0000 7f7c45689640 1 --2- 172.21.15.46:0/3373056341 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c4010de40 0x7f7c401031d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7c3800eaa0 tx=0x7f7c3800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:40.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.599+0000 7f7c3dffb640 1 -- 172.21.15.46:0/3373056341 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3800cdb0 con 0x7f7c4010de40 2024-09-21T03:54:40.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.599+0000 7f7c3dffb640 1 -- 172.21.15.46:0/3373056341 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c38005020 con 0x7f7c4010de40 2024-09-21T03:54:40.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.599+0000 7f7c470ec640 1 -- 172.21.15.46:0/3373056341 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c401a8a40 con 0x7f7c4010de40 2024-09-21T03:54:40.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.599+0000 7f7c3dffb640 1 -- 172.21.15.46:0/3373056341 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c380116d0 con 0x7f7c4010de40 2024-09-21T03:54:40.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.599+0000 7f7c470ec640 1 -- 172.21.15.46:0/3373056341 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c401a8f80 con 0x7f7c4010de40 2024-09-21T03:54:40.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.600+0000 7f7c470ec640 1 -- 172.21.15.46:0/3373056341 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c40104e20 con 0x7f7c4010de40 2024-09-21T03:54:40.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.601+0000 7f7c3dffb640 1 -- 172.21.15.46:0/3373056341 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f7c380051d0 con 0x7f7c4010de40 2024-09-21T03:54:40.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.602+0000 7f7c3dffb640 1 --2- 172.21.15.46:0/3373056341 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7c300b6670 0x7f7c300b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:40.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.602+0000 7f7c44e88640 1 --2- 172.21.15.46:0/3373056341 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7c300b6670 0x7f7c300b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:40.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.602+0000 7f7c3dffb640 1 -- 172.21.15.46:0/3373056341 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f7c380e7a30 con 0x7f7c4010de40 2024-09-21T03:54:40.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.603+0000 7f7c44e88640 1 --2- 172.21.15.46:0/3373056341 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7c300b6670 0x7f7c300b8b80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7c34000c00 tx=0x7f7c34031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:40.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.606+0000 7f7c3dffb640 1 -- 172.21.15.46:0/3373056341 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7c38016030 con 0x7f7c4010de40 2024-09-21T03:54:40.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:40 smithi162 ceph-mon[35071]: from='client.15231 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:40.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:40 smithi105 ceph-mon[34773]: from='client.15231 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:40.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.833+0000 7f7c470ec640 1 -- 172.21.15.46:0/3373056341 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f7c40103a50 con 0x7f7c4010de40 2024-09-21T03:54:40.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.834+0000 7f7c3dffb640 1 -- 172.21.15.46:0/3373056341 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) ==== 76+0+3052 (secure 0 0 0) 0x7f7c380b2500 con 0x7f7c4010de40 2024-09-21T03:54:40.836 INFO:teuthology.orchestra.run.smithi046.stdout:e20 2024-09-21T03:54:40.836 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T03:53:23:865820+0000 2024-09-21T03:54:40.836 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T03:54:40.836 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T03:54:40.836 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T03:54:40.836 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:54:40.837 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T03:54:40.837 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T03:54:40.837 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 20 2024-09-21T03:54:40.837 INFO:teuthology.orchestra.run.smithi046.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T03:54:40.837 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T03:53:14.452819+0000 2024-09-21T03:54:40.837 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T03:53:23.593278+0000 2024-09-21T03:54:40.837 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T03:54:40.837 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T03:54:40.837 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 300 2024-09-21T03:54:40.837 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T03:54:40.837 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T03:54:40.837 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T03:54:40.837 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T03:54:40.837 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T03:54:40.838 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 0 2024-09-21T03:54:40.838 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T03:54:40.838 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 1 2024-09-21T03:54:40.838 INFO:teuthology.orchestra.run.smithi046.stdout:in 0 2024-09-21T03:54:40.838 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=24680} 2024-09-21T03:54:40.838 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-09-21T03:54:40.838 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T03:54:40.838 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T03:54:40.838 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T03:54:40.838 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T03:54:40.838 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data disabled 2024-09-21T03:54:40.838 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T03:54:40.838 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T03:54:40.839 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 0 2024-09-21T03:54:40.839 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 24680 members: 24680 2024-09-21T03:54:40.839 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.b{0:24680} state up:active seq 4 addr [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:54:40.839 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.i{0:24673} state up:standby-replay seq 1 addr [v2:172.21.15.162:6838/2196053213,v1:172.21.15.162:6839/2196053213] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:54:40.839 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:54:40.839 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:54:40.839 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-09-21T03:54:40.839 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:54:40.839 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.d{-1:14772} state up:standby seq 1 addr [v2:172.21.15.46:6836/1276108734,v1:172.21.15.46:6837/1276108734] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:54:40.839 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.g{-1:14826} state up:standby seq 1 addr [v2:172.21.15.46:6838/1766354184,v1:172.21.15.46:6839/1766354184] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:54:40.839 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.a{-1:14838} state up:standby seq 1 addr [v2:172.21.15.46:6840/1901774207,v1:172.21.15.46:6841/1901774207] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:54:40.839 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.k{-1:24590} state up:standby seq 1 addr [v2:172.21.15.105:6832/3633636261,v1:172.21.15.105:6833/3633636261] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:54:40.839 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.j{-1:24602} state up:standby seq 1 addr [v2:172.21.15.46:6834/3565344000,v1:172.21.15.46:6835/3565344000] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:54:40.840 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.l{-1:24604} state up:standby seq 1 addr [v2:172.21.15.162:6832/1270522354,v1:172.21.15.162:6833/1270522354] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:54:40.840 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.e{-1:24617} state up:standby seq 1 addr [v2:172.21.15.105:6834/1564869545,v1:172.21.15.105:6835/1564869545] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:54:40.840 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.h{-1:24641} state up:standby seq 1 addr [v2:172.21.15.105:6836/3548633196,v1:172.21.15.105:6837/3548633196] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:54:40.840 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.f{-1:24652} state up:standby seq 1 addr [v2:172.21.15.162:6834/3551934241,v1:172.21.15.162:6835/3551934241] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:54:40.840 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.c{-1:24658} state up:standby seq 1 addr [v2:172.21.15.162:6836/48949822,v1:172.21.15.162:6837/48949822] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:54:40.840 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T03:54:40.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.836+0000 7f7c470ec640 1 -- 172.21.15.46:0/3373056341 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7c300b6670 msgr2=0x7f7c300b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:40.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.836+0000 7f7c470ec640 1 --2- 172.21.15.46:0/3373056341 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7c300b6670 0x7f7c300b8b80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7c34000c00 tx=0x7f7c34031400 comp rx=0 tx=0).stop 2024-09-21T03:54:40.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.836+0000 7f7c470ec640 1 -- 172.21.15.46:0/3373056341 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c4010de40 msgr2=0x7f7c401031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:40.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.836+0000 7f7c470ec640 1 --2- 172.21.15.46:0/3373056341 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c4010de40 0x7f7c401031d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7c3800eaa0 tx=0x7f7c3800ef60 comp rx=0 tx=0).stop 2024-09-21T03:54:40.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.836+0000 7f7c470ec640 1 -- 172.21.15.46:0/3373056341 shutdown_connections 2024-09-21T03:54:40.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.836+0000 7f7c470ec640 1 --2- 172.21.15.46:0/3373056341 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c4010de40 0x7f7c401031d0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:40.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.836+0000 7f7c470ec640 1 --2- 172.21.15.46:0/3373056341 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7c300b6670 0x7f7c300b8b80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:40.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.836+0000 7f7c470ec640 1 --2- 172.21.15.46:0/3373056341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c40105360 0x7f7c40102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:40.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.836+0000 7f7c470ec640 1 --2- 172.21.15.46:0/3373056341 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c40104a10 0x7f7c40102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:40.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.836+0000 7f7c470ec640 1 -- 172.21.15.46:0/3373056341 >> 172.21.15.46:0/3373056341 conn(0x7f7c40079720 msgr2=0x7f7c40107940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:40.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.836+0000 7f7c470ec640 1 -- 172.21.15.46:0/3373056341 shutdown_connections 2024-09-21T03:54:40.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:40.836+0000 7f7c470ec640 1 -- 172.21.15.46:0/3373056341 wait complete. 2024-09-21T03:54:41.542 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:41 smithi046 ceph-mon[30954]: pgmap v309: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-09-21T03:54:41.542 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:41 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3373056341' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T03:54:41.543 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- bash -c 'ceph osd dump' 2024-09-21T03:54:41.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:41 smithi162 ceph-mon[35071]: pgmap v309: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-09-21T03:54:41.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:41 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3373056341' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T03:54:41.804 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:41.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:41 smithi105 ceph-mon[34773]: pgmap v309: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-09-21T03:54:41.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:41 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3373056341' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T03:54:42.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.273+0000 7fcdc81a0640 1 -- 172.21.15.46:0/4157230629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdc0102a60 msgr2=0x7fcdc0102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:42.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.273+0000 7fcdc81a0640 1 --2- 172.21.15.46:0/4157230629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdc0102a60 0x7fcdc0102e70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc009900 tx=0x7fcdbc02a410 comp rx=0 tx=0).stop 2024-09-21T03:54:42.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.273+0000 7fcdc81a0640 1 -- 172.21.15.46:0/4157230629 shutdown_connections 2024-09-21T03:54:42.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.273+0000 7fcdc81a0640 1 --2- 172.21.15.46:0/4157230629 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdc0108cf0 0x7fcdc010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:42.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.273+0000 7fcdc81a0640 1 --2- 172.21.15.46:0/4157230629 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdc01083a0 0x7fcdc01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:42.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.273+0000 7fcdc81a0640 1 --2- 172.21.15.46:0/4157230629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdc0102a60 0x7fcdc0102e70 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:42.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.273+0000 7fcdc81a0640 1 -- 172.21.15.46:0/4157230629 >> 172.21.15.46:0/4157230629 conn(0x7fcdc0079730 msgr2=0x7fcdc0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:42.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.273+0000 7fcdc81a0640 1 -- 172.21.15.46:0/4157230629 shutdown_connections 2024-09-21T03:54:42.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.273+0000 7fcdc81a0640 1 -- 172.21.15.46:0/4157230629 wait complete. 2024-09-21T03:54:42.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.274+0000 7fcdc81a0640 1 Processor -- start 2024-09-21T03:54:42.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.274+0000 7fcdc81a0640 1 -- start start 2024-09-21T03:54:42.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.274+0000 7fcdc81a0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdc0102a60 0x7fcdc019a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:42.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.274+0000 7fcdc81a0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdc01083a0 0x7fcdc019aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:42.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.274+0000 7fcdc81a0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdc0108cf0 0x7fcdc019fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:42.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.274+0000 7fcdc81a0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc0112960 con 0x7fcdc0102a60 2024-09-21T03:54:42.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.274+0000 7fcdc81a0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc01127e0 con 0x7fcdc01083a0 2024-09-21T03:54:42.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.274+0000 7fcdc81a0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc0112ae0 con 0x7fcdc0108cf0 2024-09-21T03:54:42.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.274+0000 7fcdc5f3c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdc0102a60 0x7fcdc019a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:42.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.274+0000 7fcdc5f3c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdc0102a60 0x7fcdc019a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60712/0 (socket says 172.21.15.46:60712) 2024-09-21T03:54:42.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.274+0000 7fcdc5f3c640 1 -- 172.21.15.46:0/3859762085 learned_addr learned my addr 172.21.15.46:0/3859762085 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:42.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.274+0000 7fcdc573b640 1 --2- 172.21.15.46:0/3859762085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdc01083a0 0x7fcdc019aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:42.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.275+0000 7fcdc673d640 1 --2- 172.21.15.46:0/3859762085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdc0108cf0 0x7fcdc019fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:42.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.275+0000 7fcdc5f3c640 1 -- 172.21.15.46:0/3859762085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdc0108cf0 msgr2=0x7fcdc019fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:42.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.275+0000 7fcdc5f3c640 1 --2- 172.21.15.46:0/3859762085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdc0108cf0 0x7fcdc019fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:42.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.275+0000 7fcdc5f3c640 1 -- 172.21.15.46:0/3859762085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdc01083a0 msgr2=0x7fcdc019aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:42.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.275+0000 7fcdc5f3c640 1 --2- 172.21.15.46:0/3859762085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdc01083a0 0x7fcdc019aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:42.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.275+0000 7fcdc5f3c640 1 -- 172.21.15.46:0/3859762085 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdc01a03f0 con 0x7fcdc0102a60 2024-09-21T03:54:42.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.275+0000 7fcdc673d640 1 --2- 172.21.15.46:0/3859762085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdc0108cf0 0x7fcdc019fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:54:42.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.275+0000 7fcdc5f3c640 1 --2- 172.21.15.46:0/3859762085 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdc0102a60 0x7fcdc019a480 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc005940 tx=0x7fcdbc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:42.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.275+0000 7fcdb6ffd640 1 -- 172.21.15.46:0/3859762085 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc03f030 con 0x7fcdc0102a60 2024-09-21T03:54:42.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.275+0000 7fcdb6ffd640 1 -- 172.21.15.46:0/3859762085 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcdbc003cb0 con 0x7fcdc0102a60 2024-09-21T03:54:42.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.275+0000 7fcdc81a0640 1 -- 172.21.15.46:0/3859762085 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdc01a0680 con 0x7fcdc0102a60 2024-09-21T03:54:42.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.275+0000 7fcdb6ffd640 1 -- 172.21.15.46:0/3859762085 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc035070 con 0x7fcdc0102a60 2024-09-21T03:54:42.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.275+0000 7fcdc81a0640 1 -- 172.21.15.46:0/3859762085 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdc01a6e40 con 0x7fcdc0102a60 2024-09-21T03:54:42.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.276+0000 7fcdc81a0640 1 -- 172.21.15.46:0/3859762085 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdc0103ce0 con 0x7fcdc0102a60 2024-09-21T03:54:42.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.278+0000 7fcdb6ffd640 1 -- 172.21.15.46:0/3859762085 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fcdbc042030 con 0x7fcdc0102a60 2024-09-21T03:54:42.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.278+0000 7fcdb6ffd640 1 --2- 172.21.15.46:0/3859762085 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fcdac0b65f0 0x7fcdac0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:42.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.279+0000 7fcdc573b640 1 --2- 172.21.15.46:0/3859762085 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fcdac0b65f0 0x7fcdac0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:42.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.279+0000 7fcdb6ffd640 1 -- 172.21.15.46:0/3859762085 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fcdbc108140 con 0x7fcdc0102a60 2024-09-21T03:54:42.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.279+0000 7fcdc573b640 1 --2- 172.21.15.46:0/3859762085 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fcdac0b65f0 0x7fcdac0b8b00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0100d20 tx=0x7fcdb000a250 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:42.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.282+0000 7fcdb6ffd640 1 -- 172.21.15.46:0/3859762085 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcdbc0ce7b0 con 0x7fcdc0102a60 2024-09-21T03:54:42.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.475+0000 7fcdc81a0640 1 -- 172.21.15.46:0/3859762085 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fcdc0102e70 con 0x7fcdc0102a60 2024-09-21T03:54:42.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.476+0000 7fcdb6ffd640 1 -- 172.21.15.46:0/3859762085 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v77) ==== 56+0+5611 (secure 0 0 0) 0x7fcdbc0d2b90 con 0x7fcdc0102a60 2024-09-21T03:54:42.478 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 77 2024-09-21T03:54:42.478 INFO:teuthology.orchestra.run.smithi046.stdout:fsid a82de5ec-77cb-11ef-baf5-efdc52797490 2024-09-21T03:54:42.478 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T03:44:31.512271+0000 2024-09-21T03:54:42.479 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T03:53:33.028150+0000 2024-09-21T03:54:42.479 INFO:teuthology.orchestra.run.smithi046.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-21T03:54:42.479 INFO:teuthology.orchestra.run.smithi046.stdout:crush_version 26 2024-09-21T03:54:42.479 INFO:teuthology.orchestra.run.smithi046.stdout:full_ratio 0.95 2024-09-21T03:54:42.479 INFO:teuthology.orchestra.run.smithi046.stdout:backfillfull_ratio 0.9 2024-09-21T03:54:42.479 INFO:teuthology.orchestra.run.smithi046.stdout:nearfull_ratio 0.85 2024-09-21T03:54:42.479 INFO:teuthology.orchestra.run.smithi046.stdout:require_min_compat_client luminous 2024-09-21T03:54:42.479 INFO:teuthology.orchestra.run.smithi046.stdout:min_compat_client luminous 2024-09-21T03:54:42.479 INFO:teuthology.orchestra.run.smithi046.stdout:require_osd_release squid 2024-09-21T03:54:42.479 INFO:teuthology.orchestra.run.smithi046.stdout:stretch_mode_enabled false 2024-09-21T03:54:42.479 INFO:teuthology.orchestra.run.smithi046.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-21T03:54:42.480 INFO:teuthology.orchestra.run.smithi046.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 75 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-09-21T03:54:42.480 INFO:teuthology.orchestra.run.smithi046.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 75 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-21T03:54:42.480 INFO:teuthology.orchestra.run.smithi046.stdout:max_osd 12 2024-09-21T03:54:42.480 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 up in weight 1 up_from 9 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.46:6802/791989880,v1:172.21.15.46:6803/791989880] [v2:172.21.15.46:6804/791989880,v1:172.21.15.46:6805/791989880] exists,up 6ff9e1a8-fec7-422c-b594-880efe4684f3 2024-09-21T03:54:42.480 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 up in weight 1 up_from 14 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.105:6800/1123652172,v1:172.21.15.105:6801/1123652172] [v2:172.21.15.105:6802/1123652172,v1:172.21.15.105:6803/1123652172] exists,up 3df1bee7-615e-44d0-bd43-2370db6cd06d 2024-09-21T03:54:42.480 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 up in weight 1 up_from 19 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.162:6800/34930776,v1:172.21.15.162:6801/34930776] [v2:172.21.15.162:6802/34930776,v1:172.21.15.162:6803/34930776] exists,up 52d0e57f-cfca-447a-8a57-b1d5364cb4d4 2024-09-21T03:54:42.480 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 up in weight 1 up_from 25 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.46:6810/1355580104,v1:172.21.15.46:6811/1355580104] [v2:172.21.15.46:6812/1355580104,v1:172.21.15.46:6813/1355580104] exists,up 6f25f721-fc50-4b80-944b-d3df28e7a2a5 2024-09-21T03:54:42.480 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 up in weight 1 up_from 31 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.105:6808/3566174660,v1:172.21.15.105:6809/3566174660] [v2:172.21.15.105:6810/3566174660,v1:172.21.15.105:6811/3566174660] exists,up c2f41084-e5a1-4b5f-b799-a84b38da63a4 2024-09-21T03:54:42.480 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 up in weight 1 up_from 36 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.162:6808/3043419818,v1:172.21.15.162:6809/3043419818] [v2:172.21.15.162:6810/3043419818,v1:172.21.15.162:6811/3043419818] exists,up b433d03b-fae8-4ece-b967-a8af91bc3ab6 2024-09-21T03:54:42.480 INFO:teuthology.orchestra.run.smithi046.stdout:osd.6 up in weight 1 up_from 42 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.46:6818/1615361645,v1:172.21.15.46:6819/1615361645] [v2:172.21.15.46:6820/1615361645,v1:172.21.15.46:6821/1615361645] exists,up e6b5ce54-69aa-4811-9ca3-cab50525a175 2024-09-21T03:54:42.480 INFO:teuthology.orchestra.run.smithi046.stdout:osd.7 up in weight 1 up_from 47 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.105:6816/1015687379,v1:172.21.15.105:6817/1015687379] [v2:172.21.15.105:6818/1015687379,v1:172.21.15.105:6819/1015687379] exists,up a6e89d5d-ce31-4e0c-9019-5eb13b134feb 2024-09-21T03:54:42.480 INFO:teuthology.orchestra.run.smithi046.stdout:osd.8 up in weight 1 up_from 52 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.162:6816/3441747512,v1:172.21.15.162:6817/3441747512] [v2:172.21.15.162:6818/3441747512,v1:172.21.15.162:6819/3441747512] exists,up 27b2ccec-65be-47b3-a924-c5939ba1cb5d 2024-09-21T03:54:42.480 INFO:teuthology.orchestra.run.smithi046.stdout:osd.9 up in weight 1 up_from 58 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.46:6826/382230768,v1:172.21.15.46:6827/382230768] [v2:172.21.15.46:6828/382230768,v1:172.21.15.46:6829/382230768] exists,up 3f7cb70c-73c7-48e8-a32b-7445eda2126d 2024-09-21T03:54:42.481 INFO:teuthology.orchestra.run.smithi046.stdout:osd.10 up in weight 1 up_from 63 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.105:6824/1664619099,v1:172.21.15.105:6825/1664619099] [v2:172.21.15.105:6826/1664619099,v1:172.21.15.105:6827/1664619099] exists,up 76c3da87-f3c5-4985-87fd-647717b6af85 2024-09-21T03:54:42.481 INFO:teuthology.orchestra.run.smithi046.stdout:osd.11 up in weight 1 up_from 69 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.162:6824/1014820476,v1:172.21.15.162:6825/1014820476] [v2:172.21.15.162:6826/1014820476,v1:172.21.15.162:6827/1014820476] exists,up 13269da8-5f05-4ce2-9c7a-6dd9c1041cc3 2024-09-21T03:54:42.481 INFO:teuthology.orchestra.run.smithi046.stdout:pg_upmap_items 2.4 [2,11] 2024-09-21T03:54:42.481 INFO:teuthology.orchestra.run.smithi046.stdout:pg_upmap_items 2.a [2,11] 2024-09-21T03:54:42.481 INFO:teuthology.orchestra.run.smithi046.stdout:pg_upmap_items 3.0 [4,8] 2024-09-21T03:54:42.481 INFO:teuthology.orchestra.run.smithi046.stdout:pg_upmap_items 3.1 [4,9] 2024-09-21T03:54:42.481 INFO:teuthology.orchestra.run.smithi046.stdout:pg_upmap_items 3.10 [5,9] 2024-09-21T03:54:42.481 INFO:teuthology.orchestra.run.smithi046.stdout:pg_upmap_items 3.34 [4,9] 2024-09-21T03:54:42.481 INFO:teuthology.orchestra.run.smithi046.stdout:blocklist 172.21.15.46:6801/878116252 expires 2024-09-22T03:46:31.942086+0000 2024-09-21T03:54:42.481 INFO:teuthology.orchestra.run.smithi046.stdout:blocklist 172.21.15.46:6800/878116252 expires 2024-09-22T03:46:31.942086+0000 2024-09-21T03:54:42.481 INFO:teuthology.orchestra.run.smithi046.stdout:blocklist 172.21.15.46:0/3574041742 expires 2024-09-22T03:45:05.097136+0000 2024-09-21T03:54:42.481 INFO:teuthology.orchestra.run.smithi046.stdout:blocklist 172.21.15.46:6801/1185001582 expires 2024-09-22T03:45:05.097136+0000 2024-09-21T03:54:42.481 INFO:teuthology.orchestra.run.smithi046.stdout:blocklist 172.21.15.46:0/2839831446 expires 2024-09-22T03:45:05.097136+0000 2024-09-21T03:54:42.482 INFO:teuthology.orchestra.run.smithi046.stdout:blocklist 172.21.15.46:0/3423884605 expires 2024-09-22T03:45:31.101657+0000 2024-09-21T03:54:42.482 INFO:teuthology.orchestra.run.smithi046.stdout:blocklist 172.21.15.46:0/2761976928 expires 2024-09-22T03:46:31.942086+0000 2024-09-21T03:54:42.482 INFO:teuthology.orchestra.run.smithi046.stdout:blocklist 172.21.15.46:0/1149961133 expires 2024-09-22T03:45:05.097136+0000 2024-09-21T03:54:42.482 INFO:teuthology.orchestra.run.smithi046.stdout:blocklist 172.21.15.46:6800/1185001582 expires 2024-09-22T03:45:05.097136+0000 2024-09-21T03:54:42.482 INFO:teuthology.orchestra.run.smithi046.stdout:blocklist 172.21.15.46:0/641493295 expires 2024-09-22T03:45:31.101657+0000 2024-09-21T03:54:42.482 INFO:teuthology.orchestra.run.smithi046.stdout:blocklist 172.21.15.46:0/4033661287 expires 2024-09-22T03:45:31.101657+0000 2024-09-21T03:54:42.482 INFO:teuthology.orchestra.run.smithi046.stdout:blocklist 172.21.15.46:6800/2733048710 expires 2024-09-22T03:45:31.101657+0000 2024-09-21T03:54:42.482 INFO:teuthology.orchestra.run.smithi046.stdout:blocklist 172.21.15.46:0/3972416280 expires 2024-09-22T03:46:31.942086+0000 2024-09-21T03:54:42.482 INFO:teuthology.orchestra.run.smithi046.stdout:blocklist 172.21.15.46:6801/2733048710 expires 2024-09-22T03:45:31.101657+0000 2024-09-21T03:54:42.482 INFO:teuthology.orchestra.run.smithi046.stdout:blocklist 172.21.15.46:0/1662975018 expires 2024-09-22T03:46:31.942086+0000 2024-09-21T03:54:42.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.478+0000 7fcdc81a0640 1 -- 172.21.15.46:0/3859762085 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fcdac0b65f0 msgr2=0x7fcdac0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:42.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.478+0000 7fcdc81a0640 1 --2- 172.21.15.46:0/3859762085 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fcdac0b65f0 0x7fcdac0b8b00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0100d20 tx=0x7fcdb000a250 comp rx=0 tx=0).stop 2024-09-21T03:54:42.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.478+0000 7fcdc81a0640 1 -- 172.21.15.46:0/3859762085 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdc0102a60 msgr2=0x7fcdc019a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:42.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.478+0000 7fcdc81a0640 1 --2- 172.21.15.46:0/3859762085 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdc0102a60 0x7fcdc019a480 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc005940 tx=0x7fcdbc0042f0 comp rx=0 tx=0).stop 2024-09-21T03:54:42.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.479+0000 7fcdc81a0640 1 -- 172.21.15.46:0/3859762085 shutdown_connections 2024-09-21T03:54:42.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.479+0000 7fcdc81a0640 1 --2- 172.21.15.46:0/3859762085 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fcdac0b65f0 0x7fcdac0b8b00 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:42.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.479+0000 7fcdc81a0640 1 --2- 172.21.15.46:0/3859762085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdc0108cf0 0x7fcdc019fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:42.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.479+0000 7fcdc81a0640 1 --2- 172.21.15.46:0/3859762085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdc01083a0 0x7fcdc019aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:42.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.479+0000 7fcdc81a0640 1 --2- 172.21.15.46:0/3859762085 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdc0102a60 0x7fcdc019a480 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:42.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.479+0000 7fcdc81a0640 1 -- 172.21.15.46:0/3859762085 >> 172.21.15.46:0/3859762085 conn(0x7fcdc0079730 msgr2=0x7fcdc0101b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:42.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.479+0000 7fcdc81a0640 1 -- 172.21.15.46:0/3859762085 shutdown_connections 2024-09-21T03:54:42.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:42.479+0000 7fcdc81a0640 1 -- 172.21.15.46:0/3859762085 wait complete. 2024-09-21T03:54:43.144 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-21T03:54:43.155 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:54:43.417 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:43.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:43 smithi046 ceph-mon[30954]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-09-21T03:54:43.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:43 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3859762085' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T03:54:43.620 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:43 smithi105 ceph-mon[34773]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-09-21T03:54:43.620 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:43 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3859762085' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T03:54:43.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:43 smithi162 ceph-mon[35071]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-09-21T03:54:43.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:43 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3859762085' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T03:54:43.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.879+0000 7faf5d44f640 1 -- 172.21.15.46:0/3312591876 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf58108cf0 msgr2=0x7faf5810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:43.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.879+0000 7faf5d44f640 1 --2- 172.21.15.46:0/3312591876 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf58108cf0 0x7faf5810f520 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7faf50009ca0 tx=0x7faf5002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:54:43.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.879+0000 7faf5d44f640 1 -- 172.21.15.46:0/3312591876 shutdown_connections 2024-09-21T03:54:43.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.879+0000 7faf5d44f640 1 --2- 172.21.15.46:0/3312591876 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf58108cf0 0x7faf5810f520 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:43.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.879+0000 7faf5d44f640 1 --2- 172.21.15.46:0/3312591876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf581083a0 0x7faf581087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:43.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.879+0000 7faf5d44f640 1 --2- 172.21.15.46:0/3312591876 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf58102a60 0x7faf58102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:43.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.879+0000 7faf5d44f640 1 -- 172.21.15.46:0/3312591876 >> 172.21.15.46:0/3312591876 conn(0x7faf58079730 msgr2=0x7faf58079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:43.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.879+0000 7faf5d44f640 1 -- 172.21.15.46:0/3312591876 shutdown_connections 2024-09-21T03:54:43.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.879+0000 7faf5d44f640 1 -- 172.21.15.46:0/3312591876 wait complete. 2024-09-21T03:54:43.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.880+0000 7faf5d44f640 1 Processor -- start 2024-09-21T03:54:43.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.880+0000 7faf5d44f640 1 -- start start 2024-09-21T03:54:43.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.880+0000 7faf5d44f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf58102a60 0x7faf580ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:43.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.880+0000 7faf5d44f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf581083a0 0x7faf580ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:43.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.880+0000 7faf5d44f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf58108cf0 0x7faf581000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:43.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.880+0000 7faf5d44f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7faf58112960 con 0x7faf58108cf0 2024-09-21T03:54:43.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.880+0000 7faf5d44f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7faf581127e0 con 0x7faf581083a0 2024-09-21T03:54:43.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.880+0000 7faf5d44f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faf58112ae0 con 0x7faf58102a60 2024-09-21T03:54:43.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.881+0000 7faf577fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf58108cf0 0x7faf581000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:43.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.881+0000 7faf577fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf58108cf0 0x7faf581000f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60724/0 (socket says 172.21.15.46:60724) 2024-09-21T03:54:43.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.881+0000 7faf577fe640 1 -- 172.21.15.46:0/1071194040 learned_addr learned my addr 172.21.15.46:0/1071194040 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:43.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.881+0000 7faf56ffd640 1 --2- 172.21.15.46:0/1071194040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf58102a60 0x7faf580ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:43.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.881+0000 7faf567fc640 1 --2- 172.21.15.46:0/1071194040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf581083a0 0x7faf580ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:43.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.881+0000 7faf577fe640 1 -- 172.21.15.46:0/1071194040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf58102a60 msgr2=0x7faf580ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:43.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.881+0000 7faf577fe640 1 --2- 172.21.15.46:0/1071194040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf58102a60 0x7faf580ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:43.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.881+0000 7faf577fe640 1 -- 172.21.15.46:0/1071194040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf581083a0 msgr2=0x7faf580ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:43.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.881+0000 7faf577fe640 1 --2- 172.21.15.46:0/1071194040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf581083a0 0x7faf580ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:43.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.881+0000 7faf577fe640 1 -- 172.21.15.46:0/1071194040 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf581a8760 con 0x7faf58108cf0 2024-09-21T03:54:43.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.881+0000 7faf577fe640 1 --2- 172.21.15.46:0/1071194040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf58108cf0 0x7faf581000f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7faf500098d0 tx=0x7faf500317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:43.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.881+0000 7faf3ffff640 1 -- 172.21.15.46:0/1071194040 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf50003b70 con 0x7faf58108cf0 2024-09-21T03:54:43.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.881+0000 7faf5d44f640 1 -- 172.21.15.46:0/1071194040 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf581a89f0 con 0x7faf58108cf0 2024-09-21T03:54:43.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.881+0000 7faf3ffff640 1 -- 172.21.15.46:0/1071194040 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf50003d10 con 0x7faf58108cf0 2024-09-21T03:54:43.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.881+0000 7faf3ffff640 1 -- 172.21.15.46:0/1071194040 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5002fa20 con 0x7faf58108cf0 2024-09-21T03:54:43.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.881+0000 7faf5d44f640 1 -- 172.21.15.46:0/1071194040 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf581a8f80 con 0x7faf58108cf0 2024-09-21T03:54:43.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.882+0000 7faf5d44f640 1 -- 172.21.15.46:0/1071194040 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf58102e70 con 0x7faf58108cf0 2024-09-21T03:54:43.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.884+0000 7faf3ffff640 1 -- 172.21.15.46:0/1071194040 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7faf5002fbe0 con 0x7faf58108cf0 2024-09-21T03:54:43.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.885+0000 7faf3ffff640 1 --2- 172.21.15.46:0/1071194040 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7faf400b65f0 0x7faf400b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:43.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.885+0000 7faf56ffd640 1 --2- 172.21.15.46:0/1071194040 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7faf400b65f0 0x7faf400b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:43.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.885+0000 7faf3ffff640 1 -- 172.21.15.46:0/1071194040 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7faf50108a40 con 0x7faf58108cf0 2024-09-21T03:54:43.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.886+0000 7faf56ffd640 1 --2- 172.21.15.46:0/1071194040 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7faf400b65f0 0x7faf400b8b00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faf480058c0 tx=0x7faf4800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:43.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:43.888+0000 7faf3ffff640 1 -- 172.21.15.46:0/1071194040 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faf500cf0b0 con 0x7faf58108cf0 2024-09-21T03:54:44.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:44.115+0000 7faf5d44f640 1 -- 172.21.15.46:0/1071194040 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf5802e640 con 0x7faf58108cf0 2024-09-21T03:54:44.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:44.116+0000 7faf3ffff640 1 -- 172.21.15.46:0/1071194040 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7faf500d3490 con 0x7faf58108cf0 2024-09-21T03:54:44.119 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:54:44.119 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"btime":"2024-09-21T03:53:23:865820+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1766354184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1766354184},{"type":"v1","addr":"172.21.15.46:6839","nonce":1766354184}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/1901774207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":1901774207},{"type":"v1","addr":"172.21.15.46:6841","nonce":1901774207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3548633196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":3548633196},{"type":"v1","addr":"172.21.15.105:6837","nonce":3548633196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24652,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3551934241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3551934241},{"type":"v1","addr":"172.21.15.162:6835","nonce":3551934241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/48949822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":48949822},{"type":"v1","addr":"172.21.15.162:6837","nonce":48949822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:53:14.452819+0000","modified":"2024-09-21T03:53:23.593278+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24680},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/2196053213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2196053213},{"type":"v1","addr":"172.21.15.162:6839","nonce":2196053213}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.105:6839/3911438406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":3911438406},{"type":"v1","addr":"172.21.15.105:6839","nonce":3911438406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24680,"qdb_cluster":[24680]},"id":1}]} 2024-09-21T03:54:44.119 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T03:54:44.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:44.119+0000 7faf5d44f640 1 -- 172.21.15.46:0/1071194040 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7faf400b65f0 msgr2=0x7faf400b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:44.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:44.119+0000 7faf5d44f640 1 --2- 172.21.15.46:0/1071194040 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7faf400b65f0 0x7faf400b8b00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faf480058c0 tx=0x7faf4800a2d0 comp rx=0 tx=0).stop 2024-09-21T03:54:44.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:44.119+0000 7faf5d44f640 1 -- 172.21.15.46:0/1071194040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf58108cf0 msgr2=0x7faf581000f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:44.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:44.119+0000 7faf5d44f640 1 --2- 172.21.15.46:0/1071194040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf58108cf0 0x7faf581000f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7faf500098d0 tx=0x7faf500317b0 comp rx=0 tx=0).stop 2024-09-21T03:54:44.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:44.119+0000 7faf5d44f640 1 -- 172.21.15.46:0/1071194040 shutdown_connections 2024-09-21T03:54:44.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:44.119+0000 7faf5d44f640 1 --2- 172.21.15.46:0/1071194040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf58108cf0 0x7faf581000f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:44.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:44.119+0000 7faf5d44f640 1 --2- 172.21.15.46:0/1071194040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf581083a0 0x7faf580ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:44.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:44.119+0000 7faf5d44f640 1 --2- 172.21.15.46:0/1071194040 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7faf400b65f0 0x7faf400b8b00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:44.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:44.119+0000 7faf5d44f640 1 --2- 172.21.15.46:0/1071194040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf58102a60 0x7faf580ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:44.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:44.119+0000 7faf5d44f640 1 -- 172.21.15.46:0/1071194040 >> 172.21.15.46:0/1071194040 conn(0x7faf58079730 msgr2=0x7faf5806b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:44.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:44.119+0000 7faf5d44f640 1 -- 172.21.15.46:0/1071194040 shutdown_connections 2024-09-21T03:54:44.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:44.119+0000 7faf5d44f640 1 -- 172.21.15.46:0/1071194040 wait complete. 2024-09-21T03:54:44.486 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:44 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/1071194040' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:54:44.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:44 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/1071194040' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:54:44.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:44 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/1071194040' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:54:44.909 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:54:45.166 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:45.583 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:45 smithi046 ceph-mon[30954]: pgmap v311: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:54:45.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:45 smithi162 ceph-mon[35071]: pgmap v311: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:54:45.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.673+0000 7fb4aa5dc640 1 -- 172.21.15.46:0/2886044596 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4a41083c0 msgr2=0x7fb4a41087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:45.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.673+0000 7fb4aa5dc640 1 --2- 172.21.15.46:0/2886044596 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4a41083c0 0x7fb4a41087d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb498009900 tx=0x7fb49802a410 comp rx=0 tx=0).stop 2024-09-21T03:54:45.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.673+0000 7fb4aa5dc640 1 -- 172.21.15.46:0/2886044596 shutdown_connections 2024-09-21T03:54:45.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.673+0000 7fb4aa5dc640 1 --2- 172.21.15.46:0/2886044596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4a4108d10 0x7fb4a410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:45.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.673+0000 7fb4aa5dc640 1 --2- 172.21.15.46:0/2886044596 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4a41083c0 0x7fb4a41087d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:45.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.673+0000 7fb4aa5dc640 1 --2- 172.21.15.46:0/2886044596 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4a4102a80 0x7fb4a4102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:45.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.673+0000 7fb4aa5dc640 1 -- 172.21.15.46:0/2886044596 >> 172.21.15.46:0/2886044596 conn(0x7fb4a4079740 msgr2=0x7fb4a4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:45.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.673+0000 7fb4aa5dc640 1 -- 172.21.15.46:0/2886044596 shutdown_connections 2024-09-21T03:54:45.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.673+0000 7fb4aa5dc640 1 -- 172.21.15.46:0/2886044596 wait complete. 2024-09-21T03:54:45.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.674+0000 7fb4aa5dc640 1 Processor -- start 2024-09-21T03:54:45.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.674+0000 7fb4aa5dc640 1 -- start start 2024-09-21T03:54:45.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.674+0000 7fb4aa5dc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4a4102a80 0x7fb4a419a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:45.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.674+0000 7fb4aa5dc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4a41083c0 0x7fb4a419aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:45.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.674+0000 7fb4aa5dc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4a4108d10 0x7fb4a419fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:45.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.674+0000 7fb4aa5dc640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a41129e0 con 0x7fb4a41083c0 2024-09-21T03:54:45.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.674+0000 7fb4aa5dc640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a4112860 con 0x7fb4a4108d10 2024-09-21T03:54:45.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.674+0000 7fb4aa5dc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a4112b60 con 0x7fb4a4102a80 2024-09-21T03:54:45.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.674+0000 7fb4a37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4a41083c0 0x7fb4a419aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:45.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.674+0000 7fb4a37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4a41083c0 0x7fb4a419aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60742/0 (socket says 172.21.15.46:60742) 2024-09-21T03:54:45.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.674+0000 7fb4a37fe640 1 -- 172.21.15.46:0/3308364458 learned_addr learned my addr 172.21.15.46:0/3308364458 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:45.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.674+0000 7fb4a3fff640 1 --2- 172.21.15.46:0/3308364458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4a4102a80 0x7fb4a419a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:45.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.674+0000 7fb4a8b79640 1 --2- 172.21.15.46:0/3308364458 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4a4108d10 0x7fb4a419fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:45.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.674+0000 7fb4a37fe640 1 -- 172.21.15.46:0/3308364458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4a4102a80 msgr2=0x7fb4a419a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:45.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.675+0000 7fb4a37fe640 1 --2- 172.21.15.46:0/3308364458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4a4102a80 0x7fb4a419a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:45.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.675+0000 7fb4a37fe640 1 -- 172.21.15.46:0/3308364458 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4a4108d10 msgr2=0x7fb4a419fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:45.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.675+0000 7fb4a37fe640 1 --2- 172.21.15.46:0/3308364458 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4a4108d10 0x7fb4a419fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:45.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.675+0000 7fb4a37fe640 1 -- 172.21.15.46:0/3308364458 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4a41a0470 con 0x7fb4a41083c0 2024-09-21T03:54:45.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.675+0000 7fb4a8b79640 1 --2- 172.21.15.46:0/3308364458 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4a4108d10 0x7fb4a419fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:54:45.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.675+0000 7fb4a3fff640 1 --2- 172.21.15.46:0/3308364458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4a4102a80 0x7fb4a419a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:54:45.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.675+0000 7fb4a37fe640 1 --2- 172.21.15.46:0/3308364458 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4a41083c0 0x7fb4a419aaa0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb498032fd0 tx=0x7fb498004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:45.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.675+0000 7fb4a17fa640 1 -- 172.21.15.46:0/3308364458 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49803f030 con 0x7fb4a41083c0 2024-09-21T03:54:45.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.675+0000 7fb4a17fa640 1 -- 172.21.15.46:0/3308364458 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb498004490 con 0x7fb4a41083c0 2024-09-21T03:54:45.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.675+0000 7fb4aa5dc640 1 -- 172.21.15.46:0/3308364458 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4a41a0700 con 0x7fb4a41083c0 2024-09-21T03:54:45.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.675+0000 7fb4a17fa640 1 -- 172.21.15.46:0/3308364458 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb498035070 con 0x7fb4a41083c0 2024-09-21T03:54:45.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.675+0000 7fb4aa5dc640 1 -- 172.21.15.46:0/3308364458 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4a41a6ec0 con 0x7fb4a41083c0 2024-09-21T03:54:45.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.676+0000 7fb4aa5dc640 1 -- 172.21.15.46:0/3308364458 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4a4103d00 con 0x7fb4a41083c0 2024-09-21T03:54:45.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.677+0000 7fb4a17fa640 1 -- 172.21.15.46:0/3308364458 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fb498042030 con 0x7fb4a41083c0 2024-09-21T03:54:45.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.679+0000 7fb4a17fa640 1 --2- 172.21.15.46:0/3308364458 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb48c0b65f0 0x7fb48c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:45.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.679+0000 7fb4a3fff640 1 --2- 172.21.15.46:0/3308364458 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb48c0b65f0 0x7fb48c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:45.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.679+0000 7fb4a17fa640 1 -- 172.21.15.46:0/3308364458 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fb498107f20 con 0x7fb4a41083c0 2024-09-21T03:54:45.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.679+0000 7fb4a3fff640 1 --2- 172.21.15.46:0/3308364458 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb48c0b65f0 0x7fb48c0b8b00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb494006fd0 tx=0x7fb494008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:45.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.682+0000 7fb4a17fa640 1 -- 172.21.15.46:0/3308364458 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb4980ce5d0 con 0x7fb4a41083c0 2024-09-21T03:54:45.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:45 smithi105 ceph-mon[34773]: pgmap v311: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:54:45.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.907+0000 7fb4aa5dc640 1 -- 172.21.15.46:0/3308364458 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb4a4102e90 con 0x7fb4a41083c0 2024-09-21T03:54:45.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.908+0000 7fb4a17fa640 1 -- 172.21.15.46:0/3308364458 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7fb4a4102e90 con 0x7fb4a41083c0 2024-09-21T03:54:45.910 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:54:45.911 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"btime":"2024-09-21T03:53:23:865820+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1766354184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1766354184},{"type":"v1","addr":"172.21.15.46:6839","nonce":1766354184}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/1901774207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":1901774207},{"type":"v1","addr":"172.21.15.46:6841","nonce":1901774207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3548633196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":3548633196},{"type":"v1","addr":"172.21.15.105:6837","nonce":3548633196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24652,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3551934241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3551934241},{"type":"v1","addr":"172.21.15.162:6835","nonce":3551934241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/48949822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":48949822},{"type":"v1","addr":"172.21.15.162:6837","nonce":48949822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:53:14.452819+0000","modified":"2024-09-21T03:53:23.593278+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24680},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/2196053213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2196053213},{"type":"v1","addr":"172.21.15.162:6839","nonce":2196053213}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.105:6839/3911438406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":3911438406},{"type":"v1","addr":"172.21.15.105:6839","nonce":3911438406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24680,"qdb_cluster":[24680]},"id":1}]} 2024-09-21T03:54:45.911 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T03:54:45.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.910+0000 7fb4aa5dc640 1 -- 172.21.15.46:0/3308364458 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb48c0b65f0 msgr2=0x7fb48c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:45.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.910+0000 7fb4aa5dc640 1 --2- 172.21.15.46:0/3308364458 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb48c0b65f0 0x7fb48c0b8b00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb494006fd0 tx=0x7fb494008040 comp rx=0 tx=0).stop 2024-09-21T03:54:45.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.910+0000 7fb4aa5dc640 1 -- 172.21.15.46:0/3308364458 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4a41083c0 msgr2=0x7fb4a419aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:45.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.910+0000 7fb4aa5dc640 1 --2- 172.21.15.46:0/3308364458 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4a41083c0 0x7fb4a419aaa0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb498032fd0 tx=0x7fb498004270 comp rx=0 tx=0).stop 2024-09-21T03:54:45.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.910+0000 7fb4aa5dc640 1 -- 172.21.15.46:0/3308364458 shutdown_connections 2024-09-21T03:54:45.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.910+0000 7fb4aa5dc640 1 --2- 172.21.15.46:0/3308364458 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4a4108d10 0x7fb4a419fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:45.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.910+0000 7fb4aa5dc640 1 --2- 172.21.15.46:0/3308364458 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4a41083c0 0x7fb4a419aaa0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:45.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.910+0000 7fb4aa5dc640 1 --2- 172.21.15.46:0/3308364458 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb48c0b65f0 0x7fb48c0b8b00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:45.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.910+0000 7fb4aa5dc640 1 --2- 172.21.15.46:0/3308364458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4a4102a80 0x7fb4a419a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:45.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.910+0000 7fb4aa5dc640 1 -- 172.21.15.46:0/3308364458 >> 172.21.15.46:0/3308364458 conn(0x7fb4a4079740 msgr2=0x7fb4a406bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:45.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.911+0000 7fb4aa5dc640 1 -- 172.21.15.46:0/3308364458 shutdown_connections 2024-09-21T03:54:45.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:45.911+0000 7fb4aa5dc640 1 -- 172.21.15.46:0/3308364458 wait complete. 2024-09-21T03:54:46.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:46 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3308364458' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:54:46.665 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:46 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3308364458' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:54:46.695 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T03:54:46.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:46 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3308364458' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:54:46.953 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:47.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.460+0000 7f526c393640 1 -- 172.21.15.46:0/3096058349 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52641087a0 msgr2=0x7f5264108bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:47.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.460+0000 7f526c393640 1 --2- 172.21.15.46:0/3096058349 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52641087a0 0x7f5264108bb0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5260009900 tx=0x7f526002a410 comp rx=0 tx=0).stop 2024-09-21T03:54:47.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.460+0000 7f526c393640 1 -- 172.21.15.46:0/3096058349 shutdown_connections 2024-09-21T03:54:47.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.460+0000 7f526c393640 1 --2- 172.21.15.46:0/3096058349 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52641027e0 0x7f5264110610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:47.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.460+0000 7f526c393640 1 --2- 172.21.15.46:0/3096058349 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5264101e90 0x7f52641022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:47.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.460+0000 7f526c393640 1 --2- 172.21.15.46:0/3096058349 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52641087a0 0x7f5264108bb0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:47.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.460+0000 7f526c393640 1 -- 172.21.15.46:0/3096058349 >> 172.21.15.46:0/3096058349 conn(0x7f5264079ec0 msgr2=0x7f526407a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:47.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.460+0000 7f526c393640 1 -- 172.21.15.46:0/3096058349 shutdown_connections 2024-09-21T03:54:47.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.460+0000 7f526c393640 1 -- 172.21.15.46:0/3096058349 wait complete. 2024-09-21T03:54:47.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.461+0000 7f526c393640 1 Processor -- start 2024-09-21T03:54:47.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.461+0000 7f526c393640 1 -- start start 2024-09-21T03:54:47.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.461+0000 7f526c393640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5264101e90 0x7f526419a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:47.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.461+0000 7f526c393640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52641027e0 0x7f526419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:47.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.461+0000 7f526c393640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52641087a0 0x7f526419fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:47.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.461+0000 7f526c393640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5264113c30 con 0x7f52641087a0 2024-09-21T03:54:47.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.461+0000 7f526c393640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5264113ab0 con 0x7f5264101e90 2024-09-21T03:54:47.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.461+0000 7f526c393640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5264113db0 con 0x7f52641027e0 2024-09-21T03:54:47.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.461+0000 7f526a930640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52641087a0 0x7f526419fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:47.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.461+0000 7f526a930640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52641087a0 0x7f526419fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60760/0 (socket says 172.21.15.46:60760) 2024-09-21T03:54:47.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.461+0000 7f526a12f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5264101e90 0x7f526419a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:47.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.461+0000 7f526a930640 1 -- 172.21.15.46:0/4287854394 learned_addr learned my addr 172.21.15.46:0/4287854394 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:47.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.461+0000 7f526992e640 1 --2- 172.21.15.46:0/4287854394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52641027e0 0x7f526419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:47.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.462+0000 7f526a930640 1 -- 172.21.15.46:0/4287854394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52641027e0 msgr2=0x7f526419ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:47.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.462+0000 7f526a930640 1 --2- 172.21.15.46:0/4287854394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52641027e0 0x7f526419ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:47.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.462+0000 7f526a930640 1 -- 172.21.15.46:0/4287854394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5264101e90 msgr2=0x7f526419a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:47.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.462+0000 7f526a930640 1 --2- 172.21.15.46:0/4287854394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5264101e90 0x7f526419a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:47.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.462+0000 7f526a930640 1 -- 172.21.15.46:0/4287854394 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52641a04f0 con 0x7f52641087a0 2024-09-21T03:54:47.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.462+0000 7f526a930640 1 --2- 172.21.15.46:0/4287854394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52641087a0 0x7f526419fdc0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f525c00b970 tx=0x7f525c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:47.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.462+0000 7f525b7fe640 1 -- 172.21.15.46:0/4287854394 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c019070 con 0x7f52641087a0 2024-09-21T03:54:47.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.462+0000 7f526c393640 1 -- 172.21.15.46:0/4287854394 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52641a07e0 con 0x7f52641087a0 2024-09-21T03:54:47.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.462+0000 7f525b7fe640 1 -- 172.21.15.46:0/4287854394 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f525c014440 con 0x7f52641087a0 2024-09-21T03:54:47.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.462+0000 7f525b7fe640 1 -- 172.21.15.46:0/4287854394 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c0075d0 con 0x7f52641087a0 2024-09-21T03:54:47.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.462+0000 7f526c393640 1 -- 172.21.15.46:0/4287854394 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52641a6f40 con 0x7f52641087a0 2024-09-21T03:54:47.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.463+0000 7f526c393640 1 -- 172.21.15.46:0/4287854394 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52641022a0 con 0x7f52641087a0 2024-09-21T03:54:47.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.465+0000 7f525b7fe640 1 -- 172.21.15.46:0/4287854394 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f525c01c070 con 0x7f52641087a0 2024-09-21T03:54:47.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.466+0000 7f525b7fe640 1 --2- 172.21.15.46:0/4287854394 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f52500b65f0 0x7f52500b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:47.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.466+0000 7f526a12f640 1 --2- 172.21.15.46:0/4287854394 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f52500b65f0 0x7f52500b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:47.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.466+0000 7f525b7fe640 1 -- 172.21.15.46:0/4287854394 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f525c0e6e50 con 0x7f52641087a0 2024-09-21T03:54:47.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.466+0000 7f526a12f640 1 --2- 172.21.15.46:0/4287854394 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f52500b65f0 0x7f52500b8b00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5260031440 tx=0x7f5260005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:47.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.469+0000 7f525b7fe640 1 -- 172.21.15.46:0/4287854394 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f525c0b18e0 con 0x7f52641087a0 2024-09-21T03:54:47.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:47 smithi162 ceph-mon[35071]: pgmap v312: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:54:47.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.656+0000 7f526c393640 1 -- 172.21.15.46:0/4287854394 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f526419b6b0 con 0x7f52641087a0 2024-09-21T03:54:47.659 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:47 smithi046 ceph-mon[30954]: pgmap v312: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:54:47.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.658+0000 7f525b7fe640 1 -- 172.21.15.46:0/4287854394 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22876 (secure 0 0 0) 0x7f525c086e20 con 0x7f52641087a0 2024-09-21T03:54:47.660 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:54:47.660 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":77,"fsid":"a82de5ec-77cb-11ef-baf5-efdc52797490","created":"2024-09-21T03:44:31.512271+0000","modified":"2024-09-21T03:53:33.028150+0000","last_up_change":"2024-09-21T03:52:22.609789+0000","last_in_change":"2024-09-21T03:51:58.812316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:48:30.407205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:53:09.943833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:53:12.521980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ff9e1a8-fec7-422c-b594-880efe4684f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6803","nonce":791989880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6805","nonce":791989880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6809","nonce":791989880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6807","nonce":791989880}]},"public_addr":"172.21.15.46:6803/791989880","cluster_addr":"172.21.15.46:6805/791989880","heartbeat_back_addr":"172.21.15.46:6809/791989880","heartbeat_front_addr":"172.21.15.46:6807/791989880","state":["exists","up"]},{"osd":1,"uuid":"3df1bee7-615e-44d0-bd43-2370db6cd06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6801","nonce":1123652172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6803","nonce":1123652172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6807","nonce":1123652172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6805","nonce":1123652172}]},"public_addr":"172.21.15.105:6801/1123652172","cluster_addr":"172.21.15.105:6803/1123652172","heartbeat_back_addr":"172.21.15.105:6807/1123652172","heartbeat_front_addr":"172.21.15.105:6805/1123652172","state":["exists","up"]},{"osd":2,"uuid":"52d0e57f-cfca-447a-8a57-b1d5364cb4d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6801","nonce":34930776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6803","nonce":34930776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6807","nonce":34930776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6805","nonce":34930776}]},"public_addr":"172.21.15.162:6801/34930776","cluster_addr":"172.21.15.162:6803/34930776","heartbeat_back_addr":"172.21.15.162:6807/34930776","heartbeat_front_addr":"172.21.15.162:6805/34930776","state":["exists","up"]},{"osd":3,"uuid":"6f25f721-fc50-4b80-944b-d3df28e7a2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6811","nonce":1355580104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6813","nonce":1355580104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6817","nonce":1355580104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6815","nonce":1355580104}]},"public_addr":"172.21.15.46:6811/1355580104","cluster_addr":"172.21.15.46:6813/1355580104","heartbeat_back_addr":"172.21.15.46:6817/1355580104","heartbeat_front_addr":"172.21.15.46:6815/1355580104","state":["exists","up"]},{"osd":4,"uuid":"c2f41084-e5a1-4b5f-b799-a84b38da63a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6809","nonce":3566174660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6811","nonce":3566174660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6815","nonce":3566174660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6813","nonce":3566174660}]},"public_addr":"172.21.15.105:6809/3566174660","cluster_addr":"172.21.15.105:6811/3566174660","heartbeat_back_addr":"172.21.15.105:6815/3566174660","heartbeat_front_addr":"172.21.15.105:6813/3566174660","state":["exists","up"]},{"osd":5,"uuid":"b433d03b-fae8-4ece-b967-a8af91bc3ab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6809","nonce":3043419818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6811","nonce":3043419818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6815","nonce":3043419818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6813","nonce":3043419818}]},"public_addr":"172.21.15.162:6809/3043419818","cluster_addr":"172.21.15.162:6811/3043419818","heartbeat_back_addr":"172.21.15.162:6815/3043419818","heartbeat_front_addr":"172.21.15.162:6813/3043419818","state":["exists","up"]},{"osd":6,"uuid":"e6b5ce54-69aa-4811-9ca3-cab50525a175","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6819","nonce":1615361645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6821","nonce":1615361645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6825","nonce":1615361645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6823","nonce":1615361645}]},"public_addr":"172.21.15.46:6819/1615361645","cluster_addr":"172.21.15.46:6821/1615361645","heartbeat_back_addr":"172.21.15.46:6825/1615361645","heartbeat_front_addr":"172.21.15.46:6823/1615361645","state":["exists","up"]},{"osd":7,"uuid":"a6e89d5d-ce31-4e0c-9019-5eb13b134feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6817","nonce":1015687379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6819","nonce":1015687379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6823","nonce":1015687379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6821","nonce":1015687379}]},"public_addr":"172.21.15.105:6817/1015687379","cluster_addr":"172.21.15.105:6819/1015687379","heartbeat_back_addr":"172.21.15.105:6823/1015687379","heartbeat_front_addr":"172.21.15.105:6821/1015687379","state":["exists","up"]},{"osd":8,"uuid":"27b2ccec-65be-47b3-a924-c5939ba1cb5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6817","nonce":3441747512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6819","nonce":3441747512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6823","nonce":3441747512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6821","nonce":3441747512}]},"public_addr":"172.21.15.162:6817/3441747512","cluster_addr":"172.21.15.162:6819/3441747512","heartbeat_back_addr":"172.21.15.162:6823/3441747512","heartbeat_front_addr":"172.21.15.162:6821/3441747512","state":["exists","up"]},{"osd":9,"uuid":"3f7cb70c-73c7-48e8-a32b-7445eda2126d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6827","nonce":382230768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6829","nonce":382230768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6833","nonce":382230768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6831","nonce":382230768}]},"public_addr":"172.21.15.46:6827/382230768","cluster_addr":"172.21.15.46:6829/382230768","heartbeat_back_addr":"172.21.15.46:6833/382230768","heartbeat_front_addr":"172.21.15.46:6831/382230768","state":["exists","up"]},{"osd":10,"uuid":"76c3da87-f3c5-4985-87fd-647717b6af85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6825","nonce":1664619099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6827","nonce":1664619099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6831","nonce":1664619099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6829","nonce":1664619099}]},"public_addr":"172.21.15.105:6825/1664619099","cluster_addr":"172.21.15.105:6827/1664619099","heartbeat_back_addr":"172.21.15.105:6831/1664619099","heartbeat_front_addr":"172.21.15.105:6829/1664619099","state":["exists","up"]},{"osd":11,"uuid":"13269da8-5f05-4ce2-9c7a-6dd9c1041cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6825","nonce":1014820476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6827","nonce":1014820476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6831","nonce":1014820476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6829","nonce":1014820476}]},"public_addr":"172.21.15.162:6825/1014820476","cluster_addr":"172.21.15.162:6827/1014820476","heartbeat_back_addr":"172.21.15.162:6831/1014820476","heartbeat_front_addr":"172.21.15.162:6829/1014820476","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:47:38.630436+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:03.441596+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:28.647341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:54.270316+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:49:19.783873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:49:45.344485+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:50:12.165326+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:50:38.095996+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:03.814612+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:29.469718+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:55.407340+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:52:20.360243+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:6801/878116252":"2024-09-22T03:46:31.942086+0000","172.21.15.46:6800/878116252":"2024-09-22T03:46:31.942086+0000","172.21.15.46:0/3574041742":"2024-09-22T03:45:05.097136+0000","172.21.15.46:6801/1185001582":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/2839831446":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/3423884605":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/2761976928":"2024-09-22T03:46:31.942086+0000","172.21.15.46:0/1149961133":"2024-09-22T03:45:05.097136+0000","172.21.15.46:6800/1185001582":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/641493295":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/4033661287":"2024-09-22T03:45:31.101657+0000","172.21.15.46:6800/2733048710":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/3972416280":"2024-09-22T03:46:31.942086+0000","172.21.15.46:6801/2733048710":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/1662975018":"2024-09-22T03:46:31.942086+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:54:47.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.660+0000 7f526c393640 1 -- 172.21.15.46:0/4287854394 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f52500b65f0 msgr2=0x7f52500b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:47.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.660+0000 7f526c393640 1 --2- 172.21.15.46:0/4287854394 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f52500b65f0 0x7f52500b8b00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5260031440 tx=0x7f5260005e80 comp rx=0 tx=0).stop 2024-09-21T03:54:47.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.660+0000 7f526c393640 1 -- 172.21.15.46:0/4287854394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52641087a0 msgr2=0x7f526419fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:47.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.660+0000 7f526c393640 1 --2- 172.21.15.46:0/4287854394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52641087a0 0x7f526419fdc0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f525c00b970 tx=0x7f525c00bd70 comp rx=0 tx=0).stop 2024-09-21T03:54:47.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.660+0000 7f526c393640 1 -- 172.21.15.46:0/4287854394 shutdown_connections 2024-09-21T03:54:47.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.660+0000 7f526c393640 1 --2- 172.21.15.46:0/4287854394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52641087a0 0x7f526419fdc0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:47.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.660+0000 7f526c393640 1 --2- 172.21.15.46:0/4287854394 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f52500b65f0 0x7f52500b8b00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:47.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.660+0000 7f526c393640 1 --2- 172.21.15.46:0/4287854394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52641027e0 0x7f526419ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:47.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.660+0000 7f526c393640 1 --2- 172.21.15.46:0/4287854394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5264101e90 0x7f526419a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:47.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.660+0000 7f526c393640 1 -- 172.21.15.46:0/4287854394 >> 172.21.15.46:0/4287854394 conn(0x7f5264079ec0 msgr2=0x7f5264107520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:47.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.661+0000 7f526c393640 1 -- 172.21.15.46:0/4287854394 shutdown_connections 2024-09-21T03:54:47.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:47.661+0000 7f526c393640 1 -- 172.21.15.46:0/4287854394 wait complete. 2024-09-21T03:54:47.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:47 smithi105 ceph-mon[34773]: pgmap v312: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:54:48.422 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T03:53:14.452819+0000', 'modified': '2024-09-21T03:53:23.593278+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24680}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24673': {'gid': 24673, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.162:6839/2196053213', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6838', 'nonce': 2196053213}, {'type': 'v1', 'addr': '172.21.15.162:6839', 'nonce': 2196053213}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24680': {'gid': 24680, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.105:6839/3911438406', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6838', 'nonce': 3911438406}, {'type': 'v1', 'addr': '172.21.15.105:6839', 'nonce': 3911438406}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24680, 'qdb_cluster': [24680]} 2024-09-21T03:54:48.422 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T03:54:48.422 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T03:54:48.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:48 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/4287854394' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:54:48.680 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:48.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:48 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/4287854394' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:54:48.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:48 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/4287854394' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:54:49.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.144+0000 7fac389f8640 1 -- 172.21.15.46:0/4279713957 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac341083a0 msgr2=0x7fac341087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:49.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.144+0000 7fac389f8640 1 --2- 172.21.15.46:0/4279713957 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac341083a0 0x7fac341087b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fac1c009900 tx=0x7fac1c02a410 comp rx=0 tx=0).stop 2024-09-21T03:54:49.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.144+0000 7fac389f8640 1 -- 172.21.15.46:0/4279713957 shutdown_connections 2024-09-21T03:54:49.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.144+0000 7fac389f8640 1 --2- 172.21.15.46:0/4279713957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac34108cf0 0x7fac3410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:49.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.144+0000 7fac389f8640 1 --2- 172.21.15.46:0/4279713957 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac341083a0 0x7fac341087b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:49.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.144+0000 7fac389f8640 1 --2- 172.21.15.46:0/4279713957 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac34102a60 0x7fac34102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:49.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.144+0000 7fac389f8640 1 -- 172.21.15.46:0/4279713957 >> 172.21.15.46:0/4279713957 conn(0x7fac34079730 msgr2=0x7fac34079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:49.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.144+0000 7fac389f8640 1 -- 172.21.15.46:0/4279713957 shutdown_connections 2024-09-21T03:54:49.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.144+0000 7fac389f8640 1 -- 172.21.15.46:0/4279713957 wait complete. 2024-09-21T03:54:49.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.145+0000 7fac389f8640 1 Processor -- start 2024-09-21T03:54:49.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.145+0000 7fac389f8640 1 -- start start 2024-09-21T03:54:49.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.145+0000 7fac389f8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac34102a60 0x7fac3419b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:49.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.145+0000 7fac389f8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac341083a0 0x7fac3419b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:49.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.145+0000 7fac389f8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac34108cf0 0x7fac3419bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:49.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.145+0000 7fac389f8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fac34112960 con 0x7fac34108cf0 2024-09-21T03:54:49.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.145+0000 7fac389f8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fac341127e0 con 0x7fac341083a0 2024-09-21T03:54:49.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.145+0000 7fac389f8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fac34112ae0 con 0x7fac34102a60 2024-09-21T03:54:49.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.145+0000 7fac32d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac34108cf0 0x7fac3419bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:49.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.145+0000 7fac32d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac34108cf0 0x7fac3419bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60776/0 (socket says 172.21.15.46:60776) 2024-09-21T03:54:49.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.146+0000 7fac32d9d640 1 -- 172.21.15.46:0/198273569 learned_addr learned my addr 172.21.15.46:0/198273569 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:49.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.146+0000 7fac3259c640 1 --2- 172.21.15.46:0/198273569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac34102a60 0x7fac3419b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:49.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.146+0000 7fac31d9b640 1 --2- 172.21.15.46:0/198273569 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac341083a0 0x7fac3419b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:49.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.146+0000 7fac32d9d640 1 -- 172.21.15.46:0/198273569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac34102a60 msgr2=0x7fac3419b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:49.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.146+0000 7fac32d9d640 1 --2- 172.21.15.46:0/198273569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac34102a60 0x7fac3419b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:49.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.146+0000 7fac32d9d640 1 -- 172.21.15.46:0/198273569 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac341083a0 msgr2=0x7fac3419b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:49.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.146+0000 7fac32d9d640 1 --2- 172.21.15.46:0/198273569 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac341083a0 0x7fac3419b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:49.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.146+0000 7fac32d9d640 1 -- 172.21.15.46:0/198273569 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac341a6520 con 0x7fac34108cf0 2024-09-21T03:54:49.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.146+0000 7fac31d9b640 1 --2- 172.21.15.46:0/198273569 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac341083a0 0x7fac3419b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:54:49.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.146+0000 7fac32d9d640 1 --2- 172.21.15.46:0/198273569 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac34108cf0 0x7fac3419bc90 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fac2c00eaa0 tx=0x7fac2c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:49.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.146+0000 7fac2b7fe640 1 -- 172.21.15.46:0/198273569 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2c00cdb0 con 0x7fac34108cf0 2024-09-21T03:54:49.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.146+0000 7fac389f8640 1 -- 172.21.15.46:0/198273569 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac341a6810 con 0x7fac34108cf0 2024-09-21T03:54:49.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.146+0000 7fac2b7fe640 1 -- 172.21.15.46:0/198273569 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac2c005020 con 0x7fac34108cf0 2024-09-21T03:54:49.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.146+0000 7fac2b7fe640 1 -- 172.21.15.46:0/198273569 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2c0116d0 con 0x7fac34108cf0 2024-09-21T03:54:49.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.146+0000 7fac389f8640 1 -- 172.21.15.46:0/198273569 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac341a6d50 con 0x7fac34108cf0 2024-09-21T03:54:49.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.149+0000 7fac3ef6c740 1 Processor -- start 2024-09-21T03:54:49.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.150+0000 7fac2b7fe640 1 -- 172.21.15.46:0/198273569 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fac2c004b20 con 0x7fac34108cf0 2024-09-21T03:54:49.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.150+0000 7fac3ef6c740 1 -- start start 2024-09-21T03:54:49.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.150+0000 7fac3ef6c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5bd0c6f60 0x55f5bd46cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:49.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.150+0000 7fac3ef6c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f5bd09e0a0 0x55f5bd46d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:49.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.150+0000 7fac3ef6c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f5bd0a6280 0x55f5bd46d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:49.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.150+0000 7fac3ef6c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55f5bd3e4c10 con 0x55f5bd0a6280 2024-09-21T03:54:49.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.150+0000 7fac3ef6c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55f5bd3d4040 con 0x55f5bd09e0a0 2024-09-21T03:54:49.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.150+0000 7fac3ef6c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f5bd3d7e50 con 0x55f5bd0c6f60 2024-09-21T03:54:49.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.150+0000 7fac31d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f5bd0a6280 0x55f5bd46d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:49.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.150+0000 7fac31d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f5bd0a6280 0x55f5bd46d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60782/0 (socket says 172.21.15.46:60782) 2024-09-21T03:54:49.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.150+0000 7fac31d9b640 1 -- 172.21.15.46:0/116094167 learned_addr learned my addr 172.21.15.46:0/116094167 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:49.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.151+0000 7fac31d9b640 1 --2- 172.21.15.46:0/116094167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5bd0c6f60 0x55f5bd46cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:49.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.151+0000 7fac3259c640 1 --2- 172.21.15.46:0/116094167 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f5bd09e0a0 0x55f5bd46d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:49.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.151+0000 7fac31d9b640 1 -- 172.21.15.46:0/116094167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5bd0c6f60 msgr2=0x55f5bd46cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:54:49.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.151+0000 7fac31d9b640 1 --2- 172.21.15.46:0/116094167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5bd0c6f60 0x55f5bd46cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:49.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.151+0000 7fac31d9b640 1 -- 172.21.15.46:0/116094167 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f5bd09e0a0 msgr2=0x55f5bd46d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:54:49.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.151+0000 7fac31d9b640 1 --2- 172.21.15.46:0/116094167 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f5bd09e0a0 0x55f5bd46d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:49.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.151+0000 7fac31d9b640 1 -- 172.21.15.46:0/116094167 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5bd132540 con 0x55f5bd0a6280 2024-09-21T03:54:49.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.151+0000 7fac2b7fe640 1 --2- 172.21.15.46:0/198273569 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fac200b65f0 0x7fac200b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:49.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.151+0000 7fac3259c640 1 --2- 172.21.15.46:0/198273569 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fac200b65f0 0x7fac200b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:49.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.151+0000 7fac31d9b640 1 --2- 172.21.15.46:0/116094167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f5bd0a6280 0x55f5bd46d980 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fac1c033000 tx=0x7fac1c031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f91eb090b7491c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:49.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.151+0000 7fac2b7fe640 1 -- 172.21.15.46:0/198273569 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fac2c0e7750 con 0x7fac34108cf0 2024-09-21T03:54:49.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.151+0000 7fac28ff9640 1 -- 172.21.15.46:0/116094167 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1c035040 con 0x55f5bd0a6280 2024-09-21T03:54:49.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.151+0000 7fac28ff9640 1 -- 172.21.15.46:0/116094167 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac1c005050 con 0x55f5bd0a6280 2024-09-21T03:54:49.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.151+0000 7fac28ff9640 1 -- 172.21.15.46:0/116094167 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1c0044e0 con 0x55f5bd0a6280 2024-09-21T03:54:49.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.152+0000 7fac3ef6c740 1 -- 172.21.15.46:0/116094167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f5bd0a6280 msgr2=0x55f5bd46d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:49.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.152+0000 7fac3259c640 1 --2- 172.21.15.46:0/198273569 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fac200b65f0 0x7fac200b8b00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55f5bd46bb80 tx=0x7fac2400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:49.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.152+0000 7fac3ef6c740 1 --2- 172.21.15.46:0/116094167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f5bd0a6280 0x55f5bd46d980 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fac1c033000 tx=0x7fac1c031400 comp rx=0 tx=0).stop 2024-09-21T03:54:49.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.152+0000 7fac3ef6c740 1 -- 172.21.15.46:0/116094167 shutdown_connections 2024-09-21T03:54:49.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.152+0000 7fac3ef6c740 1 --2- 172.21.15.46:0/116094167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f5bd0a6280 0x55f5bd46d980 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:49.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.152+0000 7fac3ef6c740 1 --2- 172.21.15.46:0/116094167 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f5bd09e0a0 0x55f5bd46d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:49.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.152+0000 7fac3ef6c740 1 --2- 172.21.15.46:0/116094167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5bd0c6f60 0x55f5bd46cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:49.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.152+0000 7fac3ef6c740 1 -- 172.21.15.46:0/116094167 >> 172.21.15.46:0/116094167 conn(0x55f5bd0bb350 msgr2=0x55f5bd46adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:49.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.152+0000 7fac3ef6c740 1 -- 172.21.15.46:0/116094167 shutdown_connections 2024-09-21T03:54:49.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.152+0000 7fac3ef6c740 1 -- 172.21.15.46:0/116094167 wait complete. 2024-09-21T03:54:49.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.153+0000 7fac3ef6c740 1 -- start start 2024-09-21T03:54:49.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.153+0000 7fac3ef6c740 1 Processor -- start 2024-09-21T03:54:49.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.153+0000 7fac3ef6c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5bd09e0a0 0x55f5bd478aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:49.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.153+0000 7fac3ef6c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f5bd0a6280 0x55f5bd478fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:49.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.153+0000 7fac3ef6c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f5bd0c6f60 0x55f5bd484970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:49.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.153+0000 7fac3ef6c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55f5bd2355f0 con 0x55f5bd0c6f60 2024-09-21T03:54:49.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.153+0000 7fac3ef6c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55f5bd36f010 con 0x55f5bd0a6280 2024-09-21T03:54:49.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.153+0000 7fac3ef6c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f5bd47b680 con 0x55f5bd09e0a0 2024-09-21T03:54:49.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.153+0000 7fac3ef6c740 10 client.0 _ll_register_callbacks cb 0x55f5bd3ce340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:54:49.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.153+0000 7fac32d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f5bd0c6f60 0x55f5bd484970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:49.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.153+0000 7fac32d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f5bd0c6f60 0x55f5bd484970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60794/0 (socket says 172.21.15.46:60794) 2024-09-21T03:54:49.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.154+0000 7fac32d9d640 1 -- 172.21.15.46:0/3614155674 learned_addr learned my addr 172.21.15.46:0/3614155674 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:49.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.154+0000 7fac31d9b640 1 --2- 172.21.15.46:0/3614155674 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f5bd0a6280 0x55f5bd478fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:49.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.154+0000 7fac3259c640 1 --2- 172.21.15.46:0/3614155674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5bd09e0a0 0x55f5bd478aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:49.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.154+0000 7fac32d9d640 1 -- 172.21.15.46:0/3614155674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5bd09e0a0 msgr2=0x55f5bd478aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:54:49.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.154+0000 7fac32d9d640 1 --2- 172.21.15.46:0/3614155674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5bd09e0a0 0x55f5bd478aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:49.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.154+0000 7fac32d9d640 1 -- 172.21.15.46:0/3614155674 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f5bd0a6280 msgr2=0x55f5bd478fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:54:49.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.154+0000 7fac32d9d640 1 --2- 172.21.15.46:0/3614155674 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f5bd0a6280 0x55f5bd478fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:49.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.154+0000 7fac32d9d640 1 -- 172.21.15.46:0/3614155674 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5bd39ca00 con 0x55f5bd0c6f60 2024-09-21T03:54:49.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.154+0000 7fac32d9d640 1 --2- 172.21.15.46:0/3614155674 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f5bd0c6f60 0x55f5bd484970 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0ad400 tx=0x7fac2c005400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5c8ee9bde329b58 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:49.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.154+0000 7fac19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:54:49.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.154+0000 7fac19ffb640 1 -- 172.21.15.46:0/3614155674 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2c01f030 con 0x55f5bd0c6f60 2024-09-21T03:54:49.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.154+0000 7fac19ffb640 1 -- 172.21.15.46:0/3614155674 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fac2c004e10 con 0x55f5bd0c6f60 2024-09-21T03:54:49.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.154+0000 7fac3ef6c740 1 -- 172.21.15.46:0/3614155674 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac1c005050 con 0x55f5bd0c6f60 2024-09-21T03:54:49.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.154+0000 7fac19ffb640 1 -- 172.21.15.46:0/3614155674 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fac2c0b21e0 con 0x55f5bd0c6f60 2024-09-21T03:54:49.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.154+0000 7fac3ef6c740 10 client.15273 fetch_fsmap learned FSMap version 20 2024-09-21T03:54:49.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.154+0000 7fac3ef6c740 1 -- 172.21.15.46:0/3614155674 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55f5bd487680 con 0x55f5bd0c6f60 2024-09-21T03:54:49.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.155+0000 7fac19ffb640 1 -- 172.21.15.46:0/3614155674 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac1c005050 con 0x55f5bd0c6f60 2024-09-21T03:54:49.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.155+0000 7fac19ffb640 1 -- 172.21.15.46:0/3614155674 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fac2c00f040 con 0x55f5bd0c6f60 2024-09-21T03:54:49.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.155+0000 7fac3ef6c740 10 client.15273 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:54:49.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.155+0000 7fac3ef6c740 10 client.15273 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T03:54:49.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.155+0000 7fac3ef6c740 20 client.15273 populate_metadata read hostname 'smithi046' 2024-09-21T03:54:49.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.155+0000 7fac3ef6c740 1 --2- 172.21.15.46:0/3614155674 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55f5bd0858e0 0x55f5bd48b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:49.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.155+0000 7fac3ef6c740 4 client.15273 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:54:49.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.155+0000 7fac3ef6c740 1 -- 172.21.15.46:0/3614155674 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f5bd3e6b60 con 0x55f5bd0858e0 2024-09-21T03:54:49.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.155+0000 7fac3259c640 1 --2- 172.21.15.46:0/3614155674 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55f5bd0858e0 0x55f5bd48b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:49.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.155+0000 7fac19ffb640 10 client.15273 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:54:49.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.155+0000 7fac3259c640 1 --2- 172.21.15.46:0/3614155674 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55f5bd0858e0 0x55f5bd48b130 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18c5ffc67b1eddf1 server_cookie=e4f723c2a6c09ab8 in_seq=0 out_seq=0 2024-09-21T03:54:49.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.156+0000 7fac19ffb640 1 -- 172.21.15.46:0/3614155674 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f5bd3e6b60 con 0x55f5bd0858e0 2024-09-21T03:54:49.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.156+0000 7fac19ffb640 10 client.15273 handle_command_reply: tid=0 2024-09-21T03:54:49.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.156+0000 7fac3ef6c740 1 client.15273 shutdown 2024-09-21T03:54:49.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.156+0000 7fac3ef6c740 1 -- 172.21.15.46:0/3614155674 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f5bd0c6f60 msgr2=0x55f5bd484970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:49.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.156+0000 7fac3ef6c740 1 --2- 172.21.15.46:0/3614155674 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f5bd0c6f60 0x55f5bd484970 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0ad400 tx=0x7fac2c005400 comp rx=0 tx=0).stop 2024-09-21T03:54:49.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.156+0000 7fac3ef6c740 1 -- 172.21.15.46:0/3614155674 shutdown_connections 2024-09-21T03:54:49.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.156+0000 7fac3ef6c740 1 --2- 172.21.15.46:0/3614155674 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55f5bd0858e0 0x55f5bd48b130 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:49.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.156+0000 7fac3ef6c740 1 --2- 172.21.15.46:0/3614155674 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f5bd0c6f60 0x55f5bd484970 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:49.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.156+0000 7fac3ef6c740 1 --2- 172.21.15.46:0/3614155674 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f5bd0a6280 0x55f5bd478fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:49.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.156+0000 7fac19ffb640 0 client.15273 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:54:49.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.156+0000 7fac3ef6c740 1 --2- 172.21.15.46:0/3614155674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5bd09e0a0 0x55f5bd478aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:49.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.156+0000 7fac3ef6c740 1 -- 172.21.15.46:0/3614155674 >> 172.21.15.46:0/3614155674 conn(0x55f5bd0bb350 msgr2=0x55f5bd470090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:49.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.157+0000 7fac3ef6c740 1 -- 172.21.15.46:0/3614155674 shutdown_connections 2024-09-21T03:54:49.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.157+0000 7fac3ef6c740 1 -- 172.21.15.46:0/3614155674 wait complete. 2024-09-21T03:54:49.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.157+0000 7fac3ef6c740 20 client.15273 trim_cache size 0 max 16384 2024-09-21T03:54:49.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.175+0000 7fac3ef6c740 1 Processor -- start 2024-09-21T03:54:49.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.175+0000 7fac3ef6c740 1 -- start start 2024-09-21T03:54:49.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.175+0000 7fac3ef6c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f5bd09e0a0 0x55f5bd488b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:49.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.175+0000 7fac3ef6c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f5bd0a6280 0x55f5bd477120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:49.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.175+0000 7fac3ef6c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5bd0c6f60 0x55f5bd477660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:49.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.175+0000 7fac3ef6c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55f5bd489470 con 0x55f5bd09e0a0 2024-09-21T03:54:49.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.175+0000 7fac3ef6c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55f5bd489b40 con 0x55f5bd0a6280 2024-09-21T03:54:49.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.175+0000 7fac3ef6c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f5bd48a210 con 0x55f5bd0c6f60 2024-09-21T03:54:49.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.175+0000 7fac3259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f5bd09e0a0 0x55f5bd488b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:49.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.175+0000 7fac3259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f5bd09e0a0 0x55f5bd488b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60804/0 (socket says 172.21.15.46:60804) 2024-09-21T03:54:49.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.175+0000 7fac3259c640 1 -- 172.21.15.46:0/2682124412 learned_addr learned my addr 172.21.15.46:0/2682124412 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:49.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.175+0000 7fac31d9b640 1 --2- 172.21.15.46:0/2682124412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f5bd0a6280 0x55f5bd477120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:49.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.176+0000 7fac3259c640 1 -- 172.21.15.46:0/2682124412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5bd0c6f60 msgr2=0x55f5bd477660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:54:49.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.176+0000 7fac3259c640 1 --2- 172.21.15.46:0/2682124412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5bd0c6f60 0x55f5bd477660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:49.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.176+0000 7fac3259c640 1 -- 172.21.15.46:0/2682124412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f5bd0a6280 msgr2=0x55f5bd477120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:54:49.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.176+0000 7fac3259c640 1 --2- 172.21.15.46:0/2682124412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f5bd0a6280 0x55f5bd477120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:49.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.176+0000 7fac3259c640 1 -- 172.21.15.46:0/2682124412 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5bd46f790 con 0x55f5bd09e0a0 2024-09-21T03:54:49.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.176+0000 7fac31d9b640 1 --2- 172.21.15.46:0/2682124412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f5bd0a6280 0x55f5bd477120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:54:49.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.176+0000 7fac3259c640 1 --2- 172.21.15.46:0/2682124412 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f5bd09e0a0 0x55f5bd488b40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fac240104b0 tx=0x7fac24015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824622720be89c20 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:49.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.176+0000 7fac1bfff640 1 -- 172.21.15.46:0/2682124412 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac24005220 con 0x55f5bd09e0a0 2024-09-21T03:54:49.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.176+0000 7fac1bfff640 1 -- 172.21.15.46:0/2682124412 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac2402c070 con 0x55f5bd09e0a0 2024-09-21T03:54:49.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.176+0000 7fac1bfff640 1 -- 172.21.15.46:0/2682124412 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac240206a0 con 0x55f5bd09e0a0 2024-09-21T03:54:49.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.177+0000 7fac3ef6c740 1 -- 172.21.15.46:0/2682124412 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f5bd09e0a0 msgr2=0x55f5bd488b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:49.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.177+0000 7fac3ef6c740 1 --2- 172.21.15.46:0/2682124412 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f5bd09e0a0 0x55f5bd488b40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fac240104b0 tx=0x7fac24015000 comp rx=0 tx=0).stop 2024-09-21T03:54:49.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.177+0000 7fac3ef6c740 1 -- 172.21.15.46:0/2682124412 shutdown_connections 2024-09-21T03:54:49.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.177+0000 7fac3ef6c740 1 --2- 172.21.15.46:0/2682124412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5bd0c6f60 0x55f5bd477660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:49.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.177+0000 7fac3ef6c740 1 --2- 172.21.15.46:0/2682124412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f5bd0a6280 0x55f5bd477120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:49.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.177+0000 7fac3ef6c740 1 --2- 172.21.15.46:0/2682124412 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f5bd09e0a0 0x55f5bd488b40 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:49.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.177+0000 7fac3ef6c740 1 -- 172.21.15.46:0/2682124412 >> 172.21.15.46:0/2682124412 conn(0x55f5bd0bb350 msgr2=0x55f5bd4739e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:49.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.177+0000 7fac3ef6c740 1 -- 172.21.15.46:0/2682124412 shutdown_connections 2024-09-21T03:54:49.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.177+0000 7fac3ef6c740 1 -- 172.21.15.46:0/2682124412 wait complete. 2024-09-21T03:54:49.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.177+0000 7fac3ef6c740 1 -- start start 2024-09-21T03:54:49.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.178+0000 7fac3ef6c740 1 Processor -- start 2024-09-21T03:54:49.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.178+0000 7fac3ef6c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5bd09e0a0 0x55f5bd48d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:49.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.178+0000 7fac3ef6c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f5bd0a6280 0x55f5bd48dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:49.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.178+0000 7fac3ef6c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f5bd0c6f60 0x55f5bd492f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:49.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.178+0000 7fac3ef6c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55f5bd48afb0 con 0x55f5bd0c6f60 2024-09-21T03:54:49.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.178+0000 7fac3ef6c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55f5bd48a8e0 con 0x55f5bd0a6280 2024-09-21T03:54:49.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.178+0000 7fac3ef6c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f5bd48b680 con 0x55f5bd09e0a0 2024-09-21T03:54:49.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.178+0000 7fac3ef6c740 10 client.0 _ll_register_callbacks cb 0x7fac2c004a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:54:49.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.178+0000 7fac32d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f5bd0c6f60 0x55f5bd492f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:49.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.178+0000 7fac32d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f5bd0c6f60 0x55f5bd492f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60816/0 (socket says 172.21.15.46:60816) 2024-09-21T03:54:49.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.178+0000 7fac32d9d640 1 -- 172.21.15.46:0/4263213315 learned_addr learned my addr 172.21.15.46:0/4263213315 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:49.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.178+0000 7fac31d9b640 1 --2- 172.21.15.46:0/4263213315 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f5bd0a6280 0x55f5bd48dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:49.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.178+0000 7fac3259c640 1 --2- 172.21.15.46:0/4263213315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5bd09e0a0 0x55f5bd48d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:49.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.178+0000 7fac32d9d640 1 -- 172.21.15.46:0/4263213315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5bd09e0a0 msgr2=0x55f5bd48d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:54:49.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.178+0000 7fac32d9d640 1 --2- 172.21.15.46:0/4263213315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5bd09e0a0 0x55f5bd48d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:49.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.178+0000 7fac32d9d640 1 -- 172.21.15.46:0/4263213315 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f5bd0a6280 msgr2=0x55f5bd48dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:54:49.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.178+0000 7fac32d9d640 1 --2- 172.21.15.46:0/4263213315 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f5bd0a6280 0x55f5bd48dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:49.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.178+0000 7fac32d9d640 1 -- 172.21.15.46:0/4263213315 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5bd493480 con 0x55f5bd0c6f60 2024-09-21T03:54:49.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.179+0000 7fac32d9d640 1 --2- 172.21.15.46:0/4263213315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f5bd0c6f60 0x55f5bd492f40 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0aa970 tx=0x7fac2c0acd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17ca12e44814bd9b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:49.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.179+0000 7fac19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:54:49.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.179+0000 7fac19ffb640 1 -- 172.21.15.46:0/4263213315 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2c01f030 con 0x55f5bd0c6f60 2024-09-21T03:54:49.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.179+0000 7fac19ffb640 1 -- 172.21.15.46:0/4263213315 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fac2c0e4fc0 con 0x55f5bd0c6f60 2024-09-21T03:54:49.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.179+0000 7fac3ef6c740 1 -- 172.21.15.46:0/4263213315 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac2402c070 con 0x55f5bd0c6f60 2024-09-21T03:54:49.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.179+0000 7fac19ffb640 1 -- 172.21.15.46:0/4263213315 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fac2c0a9d50 con 0x55f5bd0c6f60 2024-09-21T03:54:49.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.179+0000 7fac3ef6c740 10 client.15279 fetch_fsmap learned FSMap version 20 2024-09-21T03:54:49.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.179+0000 7fac3ef6c740 1 -- 172.21.15.46:0/4263213315 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55f5bd4f6ca0 con 0x55f5bd0c6f60 2024-09-21T03:54:49.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.179+0000 7fac19ffb640 1 -- 172.21.15.46:0/4263213315 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac2402c070 con 0x55f5bd0c6f60 2024-09-21T03:54:49.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.179+0000 7fac19ffb640 1 -- 172.21.15.46:0/4263213315 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fac2c0b6660 con 0x55f5bd0c6f60 2024-09-21T03:54:49.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.179+0000 7fac3ef6c740 10 client.15279 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:54:49.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.179+0000 7fac3ef6c740 10 client.15279 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T03:54:49.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.179+0000 7fac3ef6c740 20 client.15279 populate_metadata read hostname 'smithi046' 2024-09-21T03:54:49.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.179+0000 7fac3ef6c740 1 --2- 172.21.15.46:0/4263213315 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55f5bd05ac90 0x55f5bd4fa490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:49.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.179+0000 7fac3ef6c740 4 client.15279 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:54:49.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.179+0000 7fac3ef6c740 1 -- 172.21.15.46:0/4263213315 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "status"}) -- 0x55f5bd3e2610 con 0x55f5bd05ac90 2024-09-21T03:54:49.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.180+0000 7fac3259c640 1 --2- 172.21.15.46:0/4263213315 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55f5bd05ac90 0x55f5bd4fa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:49.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.180+0000 7fac3259c640 1 --2- 172.21.15.46:0/4263213315 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55f5bd05ac90 0x55f5bd4fa490 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d580ce10a0b3bca server_cookie=62819de1cd43b4f8 in_seq=0 out_seq=0 2024-09-21T03:54:49.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.180+0000 7fac19ffb640 10 client.15279 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:54:49.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.180+0000 7fac19ffb640 1 -- 172.21.15.46:0/4263213315 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55f5bd3e2610 con 0x55f5bd05ac90 2024-09-21T03:54:49.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.180+0000 7fac19ffb640 10 client.15279 handle_command_reply: tid=0 2024-09-21T03:54:49.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.180+0000 7fac3ef6c740 1 client.15279 shutdown 2024-09-21T03:54:49.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.181+0000 7fac3ef6c740 1 -- 172.21.15.46:0/4263213315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f5bd0c6f60 msgr2=0x55f5bd492f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:49.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.181+0000 7fac3ef6c740 1 --2- 172.21.15.46:0/4263213315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f5bd0c6f60 0x55f5bd492f40 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0aa970 tx=0x7fac2c0acd30 comp rx=0 tx=0).stop 2024-09-21T03:54:49.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.181+0000 7fac3ef6c740 1 -- 172.21.15.46:0/4263213315 shutdown_connections 2024-09-21T03:54:49.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.181+0000 7fac3ef6c740 1 --2- 172.21.15.46:0/4263213315 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55f5bd05ac90 0x55f5bd4fa490 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:49.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.181+0000 7fac3ef6c740 1 --2- 172.21.15.46:0/4263213315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f5bd0c6f60 0x55f5bd492f40 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:49.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.181+0000 7fac3ef6c740 1 --2- 172.21.15.46:0/4263213315 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f5bd0a6280 0x55f5bd48dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:49.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.181+0000 7fac3ef6c740 1 --2- 172.21.15.46:0/4263213315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f5bd09e0a0 0x55f5bd48d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:49.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.181+0000 7fac3ef6c740 1 -- 172.21.15.46:0/4263213315 >> 172.21.15.46:0/4263213315 conn(0x55f5bd0bb350 msgr2=0x55f5bd476d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:49.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.181+0000 7fac19ffb640 0 client.15279 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:54:49.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.181+0000 7fac3ef6c740 1 -- 172.21.15.46:0/4263213315 shutdown_connections 2024-09-21T03:54:49.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.181+0000 7fac3ef6c740 1 -- 172.21.15.46:0/4263213315 wait complete. 2024-09-21T03:54:49.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.181+0000 7fac3ef6c740 20 client.15279 trim_cache size 0 max 16384 2024-09-21T03:54:49.202 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T03:54:49.202 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "a82de5ec-77cb-11ef-baf5-efdc52797490", 2024-09-21T03:54:49.202 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2024-09-21T03:54:49.202 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 24680, 2024-09-21T03:54:49.202 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-09-21T03:54:49.202 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-09-21T03:54:49.202 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-09-21T03:54:49.202 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 94.36228715, 2024-09-21T03:54:49.203 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 20, 2024-09-21T03:54:49.203 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 77, 2024-09-21T03:54:49.203 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 75, 2024-09-21T03:54:49.203 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 105.81587975399999 2024-09-21T03:54:49.203 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T03:54:49.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.181+0000 7fac389f8640 1 -- 172.21.15.46:0/198273569 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fac200b65f0 msgr2=0x7fac200b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:49.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.181+0000 7fac389f8640 1 --2- 172.21.15.46:0/198273569 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fac200b65f0 0x7fac200b8b00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55f5bd46bb80 tx=0x7fac2400b390 comp rx=0 tx=0).stop 2024-09-21T03:54:49.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.181+0000 7fac389f8640 1 -- 172.21.15.46:0/198273569 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac34108cf0 msgr2=0x7fac3419bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:49.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.181+0000 7fac389f8640 1 --2- 172.21.15.46:0/198273569 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac34108cf0 0x7fac3419bc90 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fac2c00eaa0 tx=0x7fac2c00ef60 comp rx=0 tx=0).stop 2024-09-21T03:54:49.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.181+0000 7fac389f8640 1 -- 172.21.15.46:0/198273569 shutdown_connections 2024-09-21T03:54:49.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.181+0000 7fac389f8640 1 --2- 172.21.15.46:0/198273569 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac34108cf0 0x7fac3419bc90 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:49.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.181+0000 7fac389f8640 1 --2- 172.21.15.46:0/198273569 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac341083a0 0x7fac3419b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:49.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.181+0000 7fac389f8640 1 --2- 172.21.15.46:0/198273569 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fac200b65f0 0x7fac200b8b00 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:49.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.181+0000 7fac389f8640 1 --2- 172.21.15.46:0/198273569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac34102a60 0x7fac3419b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:49.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.181+0000 7fac389f8640 1 -- 172.21.15.46:0/198273569 >> 172.21.15.46:0/198273569 conn(0x7fac34079730 msgr2=0x7fac341043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:49.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.182+0000 7fac389f8640 1 -- 172.21.15.46:0/198273569 shutdown_connections 2024-09-21T03:54:49.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:49.182+0000 7fac389f8640 1 -- 172.21.15.46:0/198273569 wait complete. 2024-09-21T03:54:49.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:49 smithi162 ceph-mon[35071]: pgmap v313: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:54:49.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:49 smithi046 ceph-mon[30954]: pgmap v313: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:54:49.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:49 smithi105 ceph-mon[34773]: pgmap v313: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:54:49.873 INFO:teuthology.run_tasks:Running task kclient... 2024-09-21T03:54:49.902 INFO:tasks.kclient:Mounting kernel clients... 2024-09-21T03:54:49.903 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-21T03:54:49.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:54:49.903 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-09-21T03:54:49.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:54:49.920 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2024-09-21T03:54:49.989 INFO:teuthology.orchestra.run.smithi046.stderr:Cannot find device "ceph-brx" 2024-09-21T03:54:49.990 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:54:49.991 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-21T03:54:49.991 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T03:54:49.991 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T03:54:49.991 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T03:54:50.288 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:50.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.753+0000 7fc9988ff640 1 -- 172.21.15.46:0/2029461253 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9941094a0 msgr2=0x7fc9941098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:50.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.753+0000 7fc9988ff640 1 --2- 172.21.15.46:0/2029461253 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9941094a0 0x7fc9941098b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc988009900 tx=0x7fc98802a410 comp rx=0 tx=0).stop 2024-09-21T03:54:50.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.753+0000 7fc9988ff640 1 -- 172.21.15.46:0/2029461253 shutdown_connections 2024-09-21T03:54:50.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.753+0000 7fc9988ff640 1 --2- 172.21.15.46:0/2029461253 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc994109df0 0x7fc994110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:50.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.753+0000 7fc9988ff640 1 --2- 172.21.15.46:0/2029461253 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9941094a0 0x7fc9941098b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:50.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.753+0000 7fc9988ff640 1 --2- 172.21.15.46:0/2029461253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc994103b60 0x7fc994103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:50.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.753+0000 7fc9988ff640 1 -- 172.21.15.46:0/2029461253 >> 172.21.15.46:0/2029461253 conn(0x7fc99407b850 msgr2=0x7fc99407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:50.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.753+0000 7fc9988ff640 1 -- 172.21.15.46:0/2029461253 shutdown_connections 2024-09-21T03:54:50.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.753+0000 7fc9988ff640 1 -- 172.21.15.46:0/2029461253 wait complete. 2024-09-21T03:54:50.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.754+0000 7fc9988ff640 1 Processor -- start 2024-09-21T03:54:50.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.754+0000 7fc9988ff640 1 -- start start 2024-09-21T03:54:50.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.755+0000 7fc9988ff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc994103b60 0x7fc99419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:50.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.755+0000 7fc9988ff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9941094a0 0x7fc99419aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:50.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.755+0000 7fc9988ff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc994109df0 0x7fc99419fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:50.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.755+0000 7fc9988ff640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc994113b00 con 0x7fc994103b60 2024-09-21T03:54:50.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.755+0000 7fc9988ff640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc994113980 con 0x7fc9941094a0 2024-09-21T03:54:50.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.755+0000 7fc9988ff640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc994113c80 con 0x7fc994109df0 2024-09-21T03:54:50.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.755+0000 7fc99259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc994103b60 0x7fc99419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:50.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.755+0000 7fc99259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc994103b60 0x7fc99419a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60830/0 (socket says 172.21.15.46:60830) 2024-09-21T03:54:50.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.755+0000 7fc99259c640 1 -- 172.21.15.46:0/809443146 learned_addr learned my addr 172.21.15.46:0/809443146 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:50.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.755+0000 7fc992d9d640 1 --2- 172.21.15.46:0/809443146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc994109df0 0x7fc99419fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:50.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.755+0000 7fc991d9b640 1 --2- 172.21.15.46:0/809443146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9941094a0 0x7fc99419aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:50.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.755+0000 7fc99259c640 1 -- 172.21.15.46:0/809443146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc994109df0 msgr2=0x7fc99419fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:50.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.755+0000 7fc99259c640 1 --2- 172.21.15.46:0/809443146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc994109df0 0x7fc99419fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:50.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.755+0000 7fc99259c640 1 -- 172.21.15.46:0/809443146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9941094a0 msgr2=0x7fc99419aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:50.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.755+0000 7fc99259c640 1 --2- 172.21.15.46:0/809443146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9941094a0 0x7fc99419aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:50.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.755+0000 7fc99259c640 1 -- 172.21.15.46:0/809443146 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9941a0400 con 0x7fc994103b60 2024-09-21T03:54:50.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.755+0000 7fc99259c640 1 --2- 172.21.15.46:0/809443146 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc994103b60 0x7fc99419a490 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc98400d770 tx=0x7fc98400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:50.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.756+0000 7fc9837fe640 1 -- 172.21.15.46:0/809443146 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc984017070 con 0x7fc994103b60 2024-09-21T03:54:50.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.756+0000 7fc9988ff640 1 -- 172.21.15.46:0/809443146 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9941a06f0 con 0x7fc994103b60 2024-09-21T03:54:50.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.756+0000 7fc9837fe640 1 -- 172.21.15.46:0/809443146 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9840054d0 con 0x7fc994103b60 2024-09-21T03:54:50.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.756+0000 7fc9837fe640 1 -- 172.21.15.46:0/809443146 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc984004c30 con 0x7fc994103b60 2024-09-21T03:54:50.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.756+0000 7fc9988ff640 1 -- 172.21.15.46:0/809443146 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9941a6e50 con 0x7fc994103b60 2024-09-21T03:54:50.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.757+0000 7fc9988ff640 1 -- 172.21.15.46:0/809443146 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc994103f70 con 0x7fc994103b60 2024-09-21T03:54:50.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.758+0000 7fc9837fe640 1 -- 172.21.15.46:0/809443146 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fc984004dd0 con 0x7fc994103b60 2024-09-21T03:54:50.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.759+0000 7fc9837fe640 1 --2- 172.21.15.46:0/809443146 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc97c0b65f0 0x7fc97c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:50.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.760+0000 7fc991d9b640 1 --2- 172.21.15.46:0/809443146 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc97c0b65f0 0x7fc97c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:50.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.760+0000 7fc9837fe640 1 -- 172.21.15.46:0/809443146 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fc9840e7370 con 0x7fc994103b60 2024-09-21T03:54:50.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.760+0000 7fc991d9b640 1 --2- 172.21.15.46:0/809443146 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc97c0b65f0 0x7fc97c0b8b00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc98802aa00 tx=0x7fc988005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:50.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.763+0000 7fc9837fe640 1 -- 172.21.15.46:0/809443146 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc9840b1e00 con 0x7fc994103b60 2024-09-21T03:54:50.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.991+0000 7fc9988ff640 1 -- 172.21.15.46:0/809443146 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc99410bbf0 con 0x7fc994103b60 2024-09-21T03:54:50.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.992+0000 7fc9837fe640 1 -- 172.21.15.46:0/809443146 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) ==== 53+0+73 (secure 0 0 0) 0x7fc9840b6d40 con 0x7fc994103b60 2024-09-21T03:54:50.994 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T03:54:50.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.994+0000 7fc9988ff640 1 -- 172.21.15.46:0/809443146 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc97c0b65f0 msgr2=0x7fc97c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:50.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.994+0000 7fc9988ff640 1 --2- 172.21.15.46:0/809443146 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc97c0b65f0 0x7fc97c0b8b00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc98802aa00 tx=0x7fc988005a20 comp rx=0 tx=0).stop 2024-09-21T03:54:50.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.994+0000 7fc9988ff640 1 -- 172.21.15.46:0/809443146 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc994103b60 msgr2=0x7fc99419a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:50.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.994+0000 7fc9988ff640 1 --2- 172.21.15.46:0/809443146 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc994103b60 0x7fc99419a490 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc98400d770 tx=0x7fc98400dc30 comp rx=0 tx=0).stop 2024-09-21T03:54:50.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.994+0000 7fc9988ff640 1 -- 172.21.15.46:0/809443146 shutdown_connections 2024-09-21T03:54:50.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.994+0000 7fc9988ff640 1 --2- 172.21.15.46:0/809443146 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc97c0b65f0 0x7fc97c0b8b00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:50.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.994+0000 7fc9988ff640 1 --2- 172.21.15.46:0/809443146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc994109df0 0x7fc99419fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:50.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.994+0000 7fc9988ff640 1 --2- 172.21.15.46:0/809443146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9941094a0 0x7fc99419aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:50.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.994+0000 7fc9988ff640 1 --2- 172.21.15.46:0/809443146 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc994103b60 0x7fc99419a490 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:50.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.994+0000 7fc9988ff640 1 -- 172.21.15.46:0/809443146 >> 172.21.15.46:0/809443146 conn(0x7fc99407b850 msgr2=0x7fc994105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:50.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.994+0000 7fc9988ff640 1 -- 172.21.15.46:0/809443146 shutdown_connections 2024-09-21T03:54:50.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:50.994+0000 7fc9988ff640 1 -- 172.21.15.46:0/809443146 wait complete. 2024-09-21T03:54:51.704 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:51 smithi046 ceph-mon[30954]: pgmap v314: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:54:51.704 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:51 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/809443146' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T03:54:51.733 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T03:54:51.733 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T03:54:51.733 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2024-09-21T03:54:51.733 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T03:54:51.733 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T03:54:51.733 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T03:54:51.733 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T03:54:51.733 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T03:54:51.733 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:54:51.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:54:51.734 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2024-09-21T03:54:51.751 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T03:54:51.751 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T03:54:51.751 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T03:54:51.751 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:54:51.751 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2024-09-21T03:54:51.751 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:54:51.751 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:54:51.751 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:54:51.751 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2024-09-21T03:54:51.751 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:54:51.751 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:54:51.751 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2024-09-21T03:54:51.752 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T03:54:51.752 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:54:51.752 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2024-09-21T03:54:51.752 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-21T03:54:51.752 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42160sec preferred_lft 42160sec 2024-09-21T03:54:51.752 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link 2024-09-21T03:54:51.752 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:54:51.752 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:54:51.752 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:54:51.752 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2024-09-21T03:54:51.752 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T03:54:51.753 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:54:52.547 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-09-21T03:54:52.548 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add name ceph-brx type bridge 2024-09-21T03:54:52.548 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr flush dev ceph-brx 2024-09-21T03:54:52.548 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set ceph-brx up 2024-09-21T03:54:52.548 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T03:54:52.548 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-09-21T03:54:52.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:51 smithi162 ceph-mon[35071]: pgmap v314: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:54:52.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:51 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/809443146' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T03:54:52.549 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:51 smithi105 ceph-mon[34773]: pgmap v314: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:54:52.550 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:51 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/809443146' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T03:54:52.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:54:52.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:54:52.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:54:52.725 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T03:54:52.752 INFO:teuthology.orchestra.run.smithi046.stdout:1 2024-09-21T03:54:52.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:54:52.754 DEBUG:teuthology.orchestra.run.smithi046:> route 2024-09-21T03:54:52.826 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2024-09-21T03:54:52.826 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T03:54:52.826 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-21T03:54:52.826 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-21T03:54:52.826 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T03:54:52.827 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:54:52.827 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-09-21T03:54:52.827 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-21T03:54:52.827 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-21T03:54:52.827 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-21T03:54:52.827 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-09-21T03:54:52.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:54:53.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:54:53.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:54:53.167 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-09-21T03:54:53.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:54:53.184 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list-id 2024-09-21T03:54:53.240 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:54:53.240 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-09-21T03:54:53.240 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T03:54:53.240 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T03:54:53.240 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-09-21T03:54:53.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:54:53.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:54:53.359 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T03:54:53.359 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:54:53.359 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-09-21T03:54:53.359 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T03:54:53.360 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T03:54:53.360 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T03:54:53.360 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T03:54:53.360 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T03:54:53.360 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-09-21T03:54:53.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:54:53.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:54:53.500 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:54:53.500 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-09-21T03:54:53.500 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2024-09-21T03:54:53.500 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T03:54:53.500 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-09-21T03:54:53.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:54:53.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:54:53.579 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:54:53.579 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T03:54:53.595 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:54:53.595 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:54:53.595 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T03:54:53.650 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-21T03:54:53.651 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-21T03:54:53.651 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/efeca3cd-c7ed-440d-b824-950247d10374 2024-09-21T03:54:53.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:54:53.651 DEBUG:teuthology.orchestra.run.smithi046:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/efeca3cd-c7ed-440d-b824-950247d10374 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-21T03:54:53.767 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-21T03:54:53.767 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-09-21T03:54:53.962 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-21T03:54:53.962 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-09-21T03:54:53.962 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.105:3300,172.21.15.162:3300" 2024-09-21T03:54:53.962 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with new device syntax: 0@a82de5ec-77cb-11ef-baf5-efdc52797490.cephfs=/volumes/qa/sv_1/efeca3cd-c7ed-440d-b824-950247d10374 2024-09-21T03:54:53.962 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync,name=0,key=0,mon_addr=172.21.15.46:3300/172.21.15.105:3300/172.21.15.162:3300" will pass to kernel 2024-09-21T03:54:53.963 INFO:teuthology.orchestra.run.smithi046.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T03:54:53.963 INFO:teuthology.orchestra.run.smithi046.stdout: You just mounted a file system that supports labels which does not 2024-09-21T03:54:53.963 INFO:teuthology.orchestra.run.smithi046.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T03:54:53.963 INFO:teuthology.orchestra.run.smithi046.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T03:54:53.963 INFO:teuthology.orchestra.run.smithi046.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T03:54:53.963 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:53 smithi046 ceph-mon[30954]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:54:53.965 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T03:54:53.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:54:53.965 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T03:54:53.994 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:54:54.070 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:53 smithi105 ceph-mon[34773]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:54:54.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:54:54.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:54:54.104 INFO:teuthology.orchestra.run.smithi046.stdout:client25048 2024-09-21T03:54:54.104 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T03:54:54.104 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:54:54.121 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:54:54.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:53 smithi162 ceph-mon[35071]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:54:54.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:54:54.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:54:54.227 INFO:teuthology.orchestra.run.smithi046.stdout:client25048 2024-09-21T03:54:54.228 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:54:54.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:54:54.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:54:54.294 INFO:teuthology.orchestra.run.smithi046.stdout:client25048 2024-09-21T03:54:54.294 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490.client25048/status') 2024-09-21T03:54:54.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:54:54.361 INFO:teuthology.orchestra.run.smithi046.stdout:instance: client.25048 (3)172.21.15.46:0/798461641 2024-09-21T03:54:54.361 INFO:teuthology.orchestra.run.smithi046.stdout:blocklisted: false 2024-09-21T03:54:54.362 INFO:teuthology.orchestra.run.smithi046.stderr:0+1 records in 2024-09-21T03:54:54.362 INFO:teuthology.orchestra.run.smithi046.stderr:0+1 records out 2024-09-21T03:54:54.362 INFO:teuthology.orchestra.run.smithi046.stderr:70 bytes copied, 2.4729e-05 s, 2.8 MB/s 2024-09-21T03:54:54.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:54:54.369 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-21T03:54:54.379 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-21T03:54:54.441 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:54:54.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.554+0000 7fedf0a94640 1 -- 172.21.15.46:0/1553563436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedec108c00 msgr2=0x7fedec10f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:54.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.554+0000 7fedf0a94640 1 --2- 172.21.15.46:0/1553563436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedec108c00 0x7fedec10f430 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fede4009ca0 tx=0x7fede402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:54:54.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.554+0000 7fedf0a94640 1 -- 172.21.15.46:0/1553563436 shutdown_connections 2024-09-21T03:54:54.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.554+0000 7fedf0a94640 1 --2- 172.21.15.46:0/1553563436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedec108c00 0x7fedec10f430 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:54.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.554+0000 7fedf0a94640 1 --2- 172.21.15.46:0/1553563436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fedec1082b0 0x7fedec1086c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:54.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.554+0000 7fedf0a94640 1 --2- 172.21.15.46:0/1553563436 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fedec102980 0x7fedec102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:54.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.554+0000 7fedf0a94640 1 -- 172.21.15.46:0/1553563436 >> 172.21.15.46:0/1553563436 conn(0x7fedec0fe380 msgr2=0x7fedec1007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:54.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.554+0000 7fedf0a94640 1 -- 172.21.15.46:0/1553563436 shutdown_connections 2024-09-21T03:54:54.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.554+0000 7fedf0a94640 1 -- 172.21.15.46:0/1553563436 wait complete. 2024-09-21T03:54:54.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.555+0000 7fedf0a94640 1 Processor -- start 2024-09-21T03:54:54.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.555+0000 7fedf0a94640 1 -- start start 2024-09-21T03:54:54.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.555+0000 7fedf0a94640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fedec102980 0x7fedec199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:54.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.555+0000 7fedf0a94640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedec1082b0 0x7fedec199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:54.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.555+0000 7fedf0a94640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fedec108c00 0x7fedec19ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:54.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.555+0000 7fedf0a94640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fedec1128c0 con 0x7fedec1082b0 2024-09-21T03:54:54.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.555+0000 7fedf0a94640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fedec112740 con 0x7fedec102980 2024-09-21T03:54:54.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.555+0000 7fedf0a94640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fedec112a40 con 0x7fedec108c00 2024-09-21T03:54:54.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.555+0000 7fede9d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedec1082b0 0x7fedec199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:54.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.555+0000 7fede9d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedec1082b0 0x7fedec199800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58556/0 (socket says 172.21.15.46:58556) 2024-09-21T03:54:54.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.555+0000 7fede9d9b640 1 -- 172.21.15.46:0/2357920388 learned_addr learned my addr 172.21.15.46:0/2357920388 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:54.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.555+0000 7fedea59c640 1 --2- 172.21.15.46:0/2357920388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fedec102980 0x7fedec199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:54.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.555+0000 7fedead9d640 1 --2- 172.21.15.46:0/2357920388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fedec108c00 0x7fedec19ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:54.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.556+0000 7fede9d9b640 1 -- 172.21.15.46:0/2357920388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fedec108c00 msgr2=0x7fedec19ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:54.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.556+0000 7fede9d9b640 1 --2- 172.21.15.46:0/2357920388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fedec108c00 0x7fedec19ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:54.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.556+0000 7fede9d9b640 1 -- 172.21.15.46:0/2357920388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fedec102980 msgr2=0x7fedec199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:54.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.556+0000 7fede9d9b640 1 --2- 172.21.15.46:0/2357920388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fedec102980 0x7fedec199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:54.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.556+0000 7fede9d9b640 1 -- 172.21.15.46:0/2357920388 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedec19f100 con 0x7fedec1082b0 2024-09-21T03:54:54.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.556+0000 7fedea59c640 1 --2- 172.21.15.46:0/2357920388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fedec102980 0x7fedec199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:54:54.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.556+0000 7fede9d9b640 1 --2- 172.21.15.46:0/2357920388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedec1082b0 0x7fedec199800 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fedd400c8c0 tx=0x7fedd400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:54.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.556+0000 7fede37fe640 1 -- 172.21.15.46:0/2357920388 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd4007bb0 con 0x7fedec1082b0 2024-09-21T03:54:54.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.556+0000 7fede37fe640 1 -- 172.21.15.46:0/2357920388 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedd4007d50 con 0x7fedec1082b0 2024-09-21T03:54:54.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.556+0000 7fedf0a94640 1 -- 172.21.15.46:0/2357920388 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedec19f3f0 con 0x7fedec1082b0 2024-09-21T03:54:54.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.556+0000 7fede37fe640 1 -- 172.21.15.46:0/2357920388 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd40187c0 con 0x7fedec1082b0 2024-09-21T03:54:54.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.556+0000 7fedf0a94640 1 -- 172.21.15.46:0/2357920388 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedec1a5c10 con 0x7fedec1082b0 2024-09-21T03:54:54.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.557+0000 7fedf0a94640 1 -- 172.21.15.46:0/2357920388 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedec103bf0 con 0x7fedec1082b0 2024-09-21T03:54:54.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.559+0000 7fede37fe640 1 -- 172.21.15.46:0/2357920388 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fedd400fa20 con 0x7fedec1082b0 2024-09-21T03:54:54.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.559+0000 7fede37fe640 1 --2- 172.21.15.46:0/2357920388 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fedd80b6670 0x7fedd80b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:54.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.559+0000 7fedea59c640 1 --2- 172.21.15.46:0/2357920388 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fedd80b6670 0x7fedd80b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:54.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.559+0000 7fede37fe640 1 -- 172.21.15.46:0/2357920388 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fedd40e7550 con 0x7fedec1082b0 2024-09-21T03:54:54.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.560+0000 7fedea59c640 1 --2- 172.21.15.46:0/2357920388 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fedd80b6670 0x7fedd80b8b80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7feddc0058c0 tx=0x7feddc00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:54.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.564+0000 7fede37fe640 1 -- 172.21.15.46:0/2357920388 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fedd4014030 con 0x7fedec1082b0 2024-09-21T03:54:54.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.755+0000 7fedf0a94640 1 -- 172.21.15.46:0/2357920388 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fedec10a460 con 0x7fedec1082b0 2024-09-21T03:54:54.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.756+0000 7fede37fe640 1 -- 172.21.15.46:0/2357920388 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22876 (secure 0 0 0) 0x7fedd40adc00 con 0x7fedec1082b0 2024-09-21T03:54:54.758 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:54:54.759 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":77,"fsid":"a82de5ec-77cb-11ef-baf5-efdc52797490","created":"2024-09-21T03:44:31.512271+0000","modified":"2024-09-21T03:53:33.028150+0000","last_up_change":"2024-09-21T03:52:22.609789+0000","last_in_change":"2024-09-21T03:51:58.812316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:48:30.407205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:53:09.943833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:53:12.521980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ff9e1a8-fec7-422c-b594-880efe4684f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6803","nonce":791989880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6805","nonce":791989880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6809","nonce":791989880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6807","nonce":791989880}]},"public_addr":"172.21.15.46:6803/791989880","cluster_addr":"172.21.15.46:6805/791989880","heartbeat_back_addr":"172.21.15.46:6809/791989880","heartbeat_front_addr":"172.21.15.46:6807/791989880","state":["exists","up"]},{"osd":1,"uuid":"3df1bee7-615e-44d0-bd43-2370db6cd06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6801","nonce":1123652172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6803","nonce":1123652172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6807","nonce":1123652172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6805","nonce":1123652172}]},"public_addr":"172.21.15.105:6801/1123652172","cluster_addr":"172.21.15.105:6803/1123652172","heartbeat_back_addr":"172.21.15.105:6807/1123652172","heartbeat_front_addr":"172.21.15.105:6805/1123652172","state":["exists","up"]},{"osd":2,"uuid":"52d0e57f-cfca-447a-8a57-b1d5364cb4d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6801","nonce":34930776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6803","nonce":34930776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6807","nonce":34930776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6805","nonce":34930776}]},"public_addr":"172.21.15.162:6801/34930776","cluster_addr":"172.21.15.162:6803/34930776","heartbeat_back_addr":"172.21.15.162:6807/34930776","heartbeat_front_addr":"172.21.15.162:6805/34930776","state":["exists","up"]},{"osd":3,"uuid":"6f25f721-fc50-4b80-944b-d3df28e7a2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6811","nonce":1355580104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6813","nonce":1355580104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6817","nonce":1355580104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6815","nonce":1355580104}]},"public_addr":"172.21.15.46:6811/1355580104","cluster_addr":"172.21.15.46:6813/1355580104","heartbeat_back_addr":"172.21.15.46:6817/1355580104","heartbeat_front_addr":"172.21.15.46:6815/1355580104","state":["exists","up"]},{"osd":4,"uuid":"c2f41084-e5a1-4b5f-b799-a84b38da63a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6809","nonce":3566174660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6811","nonce":3566174660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6815","nonce":3566174660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6813","nonce":3566174660}]},"public_addr":"172.21.15.105:6809/3566174660","cluster_addr":"172.21.15.105:6811/3566174660","heartbeat_back_addr":"172.21.15.105:6815/3566174660","heartbeat_front_addr":"172.21.15.105:6813/3566174660","state":["exists","up"]},{"osd":5,"uuid":"b433d03b-fae8-4ece-b967-a8af91bc3ab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6809","nonce":3043419818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6811","nonce":3043419818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6815","nonce":3043419818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6813","nonce":3043419818}]},"public_addr":"172.21.15.162:6809/3043419818","cluster_addr":"172.21.15.162:6811/3043419818","heartbeat_back_addr":"172.21.15.162:6815/3043419818","heartbeat_front_addr":"172.21.15.162:6813/3043419818","state":["exists","up"]},{"osd":6,"uuid":"e6b5ce54-69aa-4811-9ca3-cab50525a175","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6819","nonce":1615361645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6821","nonce":1615361645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6825","nonce":1615361645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6823","nonce":1615361645}]},"public_addr":"172.21.15.46:6819/1615361645","cluster_addr":"172.21.15.46:6821/1615361645","heartbeat_back_addr":"172.21.15.46:6825/1615361645","heartbeat_front_addr":"172.21.15.46:6823/1615361645","state":["exists","up"]},{"osd":7,"uuid":"a6e89d5d-ce31-4e0c-9019-5eb13b134feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6817","nonce":1015687379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6819","nonce":1015687379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6823","nonce":1015687379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6821","nonce":1015687379}]},"public_addr":"172.21.15.105:6817/1015687379","cluster_addr":"172.21.15.105:6819/1015687379","heartbeat_back_addr":"172.21.15.105:6823/1015687379","heartbeat_front_addr":"172.21.15.105:6821/1015687379","state":["exists","up"]},{"osd":8,"uuid":"27b2ccec-65be-47b3-a924-c5939ba1cb5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6817","nonce":3441747512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6819","nonce":3441747512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6823","nonce":3441747512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6821","nonce":3441747512}]},"public_addr":"172.21.15.162:6817/3441747512","cluster_addr":"172.21.15.162:6819/3441747512","heartbeat_back_addr":"172.21.15.162:6823/3441747512","heartbeat_front_addr":"172.21.15.162:6821/3441747512","state":["exists","up"]},{"osd":9,"uuid":"3f7cb70c-73c7-48e8-a32b-7445eda2126d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6827","nonce":382230768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6829","nonce":382230768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6833","nonce":382230768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6831","nonce":382230768}]},"public_addr":"172.21.15.46:6827/382230768","cluster_addr":"172.21.15.46:6829/382230768","heartbeat_back_addr":"172.21.15.46:6833/382230768","heartbeat_front_addr":"172.21.15.46:6831/382230768","state":["exists","up"]},{"osd":10,"uuid":"76c3da87-f3c5-4985-87fd-647717b6af85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6825","nonce":1664619099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6827","nonce":1664619099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6831","nonce":1664619099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6829","nonce":1664619099}]},"public_addr":"172.21.15.105:6825/1664619099","cluster_addr":"172.21.15.105:6827/1664619099","heartbeat_back_addr":"172.21.15.105:6831/1664619099","heartbeat_front_addr":"172.21.15.105:6829/1664619099","state":["exists","up"]},{"osd":11,"uuid":"13269da8-5f05-4ce2-9c7a-6dd9c1041cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6825","nonce":1014820476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6827","nonce":1014820476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6831","nonce":1014820476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6829","nonce":1014820476}]},"public_addr":"172.21.15.162:6825/1014820476","cluster_addr":"172.21.15.162:6827/1014820476","heartbeat_back_addr":"172.21.15.162:6831/1014820476","heartbeat_front_addr":"172.21.15.162:6829/1014820476","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:47:38.630436+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:03.441596+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:28.647341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:54.270316+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:49:19.783873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:49:45.344485+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:50:12.165326+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:50:38.095996+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:03.814612+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:29.469718+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:55.407340+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:52:20.360243+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:6801/878116252":"2024-09-22T03:46:31.942086+0000","172.21.15.46:6800/878116252":"2024-09-22T03:46:31.942086+0000","172.21.15.46:0/3574041742":"2024-09-22T03:45:05.097136+0000","172.21.15.46:6801/1185001582":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/2839831446":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/3423884605":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/2761976928":"2024-09-22T03:46:31.942086+0000","172.21.15.46:0/1149961133":"2024-09-22T03:45:05.097136+0000","172.21.15.46:6800/1185001582":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/641493295":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/4033661287":"2024-09-22T03:45:31.101657+0000","172.21.15.46:6800/2733048710":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/3972416280":"2024-09-22T03:46:31.942086+0000","172.21.15.46:6801/2733048710":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/1662975018":"2024-09-22T03:46:31.942086+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:54:54.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.758+0000 7fedf0a94640 1 -- 172.21.15.46:0/2357920388 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fedd80b6670 msgr2=0x7fedd80b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:54.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.758+0000 7fedf0a94640 1 --2- 172.21.15.46:0/2357920388 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fedd80b6670 0x7fedd80b8b80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7feddc0058c0 tx=0x7feddc00a2d0 comp rx=0 tx=0).stop 2024-09-21T03:54:54.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.758+0000 7fedf0a94640 1 -- 172.21.15.46:0/2357920388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedec1082b0 msgr2=0x7fedec199800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:54.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.758+0000 7fedf0a94640 1 --2- 172.21.15.46:0/2357920388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedec1082b0 0x7fedec199800 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fedd400c8c0 tx=0x7fedd400cd80 comp rx=0 tx=0).stop 2024-09-21T03:54:54.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.758+0000 7fedf0a94640 1 -- 172.21.15.46:0/2357920388 shutdown_connections 2024-09-21T03:54:54.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.758+0000 7fedf0a94640 1 --2- 172.21.15.46:0/2357920388 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fedd80b6670 0x7fedd80b8b80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:54.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.758+0000 7fedf0a94640 1 --2- 172.21.15.46:0/2357920388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fedec108c00 0x7fedec19ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:54.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.758+0000 7fedf0a94640 1 --2- 172.21.15.46:0/2357920388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedec1082b0 0x7fedec199800 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:54.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.758+0000 7fedf0a94640 1 --2- 172.21.15.46:0/2357920388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fedec102980 0x7fedec199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:54.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.758+0000 7fedf0a94640 1 -- 172.21.15.46:0/2357920388 >> 172.21.15.46:0/2357920388 conn(0x7fedec0fe380 msgr2=0x7fedec105800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:54.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.758+0000 7fedf0a94640 1 -- 172.21.15.46:0/2357920388 shutdown_connections 2024-09-21T03:54:54.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.758+0000 7fedf0a94640 1 -- 172.21.15.46:0/2357920388 wait complete. 2024-09-21T03:54:54.772 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T03:48:30.407205+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T03:53:09.943833+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T03:53:12.521980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T03:54:54.773 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T03:54:54.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.887+0000 7f10072be640 1 -- 172.21.15.46:0/2914842898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1000103030 msgr2=0x7f1000107550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:54.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.887+0000 7f10072be640 1 --2- 172.21.15.46:0/2914842898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1000103030 0x7f1000107550 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0009900 tx=0x7f0ff002a410 comp rx=0 tx=0).stop 2024-09-21T03:54:54.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.887+0000 7f10072be640 1 -- 172.21.15.46:0/2914842898 shutdown_connections 2024-09-21T03:54:54.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.887+0000 7f10072be640 1 --2- 172.21.15.46:0/2914842898 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1000107ba0 0x7f1000108010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:54.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.887+0000 7f10072be640 1 --2- 172.21.15.46:0/2914842898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1000103030 0x7f1000107550 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:54.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.887+0000 7f10072be640 1 --2- 172.21.15.46:0/2914842898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10001026e0 0x7f1000102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:54.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.887+0000 7f10072be640 1 -- 172.21.15.46:0/2914842898 >> 172.21.15.46:0/2914842898 conn(0x7f10000fe3c0 msgr2=0x7f1000100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:54.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.887+0000 7f10072be640 1 -- 172.21.15.46:0/2914842898 shutdown_connections 2024-09-21T03:54:54.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.887+0000 7f10072be640 1 -- 172.21.15.46:0/2914842898 wait complete. 2024-09-21T03:54:54.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.888+0000 7f10072be640 1 Processor -- start 2024-09-21T03:54:54.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.888+0000 7f10072be640 1 -- start start 2024-09-21T03:54:54.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.888+0000 7f10072be640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10001026e0 0x7f10001a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:54.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.888+0000 7f10072be640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1000103030 0x7f10001a0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:54.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.888+0000 7f10072be640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1000107ba0 0x7f10001a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:54.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.888+0000 7f10072be640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1000119fd0 con 0x7f1000103030 2024-09-21T03:54:54.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.888+0000 7f10072be640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1000119e50 con 0x7f10001026e0 2024-09-21T03:54:54.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.888+0000 7f10072be640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f100011a150 con 0x7f1000107ba0 2024-09-21T03:54:54.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.888+0000 7f1004859640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1000103030 0x7f10001a0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:54.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.888+0000 7f1004859640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1000103030 0x7f10001a0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58588/0 (socket says 172.21.15.46:58588) 2024-09-21T03:54:54.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.888+0000 7f1004859640 1 -- 172.21.15.46:0/3248541182 learned_addr learned my addr 172.21.15.46:0/3248541182 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:54.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.888+0000 7f100585b640 1 --2- 172.21.15.46:0/3248541182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1000107ba0 0x7f10001a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:54.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.888+0000 7f100505a640 1 --2- 172.21.15.46:0/3248541182 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10001026e0 0x7f10001a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:54.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.888+0000 7f1004859640 1 -- 172.21.15.46:0/3248541182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1000107ba0 msgr2=0x7f10001a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:54.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.889+0000 7f1004859640 1 --2- 172.21.15.46:0/3248541182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1000107ba0 0x7f10001a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:54.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.889+0000 7f1004859640 1 -- 172.21.15.46:0/3248541182 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10001026e0 msgr2=0x7f10001a0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:54.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.889+0000 7f1004859640 1 --2- 172.21.15.46:0/3248541182 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10001026e0 0x7f10001a0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:54.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.889+0000 7f1004859640 1 -- 172.21.15.46:0/3248541182 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10001a6960 con 0x7f1000103030 2024-09-21T03:54:54.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.889+0000 7f100505a640 1 --2- 172.21.15.46:0/3248541182 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10001026e0 0x7f10001a0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:54:54.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.889+0000 7f1004859640 1 --2- 172.21.15.46:0/3248541182 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1000103030 0x7f10001a0fd0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0ff002a930 tx=0x7f0ff0031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:54.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.889+0000 7f0ff67fc640 1 -- 172.21.15.46:0/3248541182 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff003f030 con 0x7f1000103030 2024-09-21T03:54:54.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.889+0000 7f0ff67fc640 1 -- 172.21.15.46:0/3248541182 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ff0004490 con 0x7f1000103030 2024-09-21T03:54:54.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.889+0000 7f10072be640 1 -- 172.21.15.46:0/3248541182 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10001a6bf0 con 0x7f1000103030 2024-09-21T03:54:54.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.889+0000 7f0ff67fc640 1 -- 172.21.15.46:0/3248541182 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0035070 con 0x7f1000103030 2024-09-21T03:54:54.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.889+0000 7f10072be640 1 -- 172.21.15.46:0/3248541182 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10001ad3e0 con 0x7f1000103030 2024-09-21T03:54:54.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.890+0000 7f10072be640 1 -- 172.21.15.46:0/3248541182 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f100006bfa0 con 0x7f1000103030 2024-09-21T03:54:54.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.892+0000 7f0ff67fc640 1 -- 172.21.15.46:0/3248541182 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f0ff0042030 con 0x7f1000103030 2024-09-21T03:54:54.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.893+0000 7f0ff67fc640 1 --2- 172.21.15.46:0/3248541182 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f0fec0b65f0 0x7f0fec0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:54.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.893+0000 7f100505a640 1 --2- 172.21.15.46:0/3248541182 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f0fec0b65f0 0x7f0fec0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:54.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.893+0000 7f0ff67fc640 1 -- 172.21.15.46:0/3248541182 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f0ff0107de0 con 0x7f1000103030 2024-09-21T03:54:54.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.893+0000 7f100505a640 1 --2- 172.21.15.46:0/3248541182 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f0fec0b65f0 0x7f0fec0b8b00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc009c20 tx=0x7f0ffc005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:54.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:54.896+0000 7f0ff67fc640 1 -- 172.21.15.46:0/3248541182 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0ff00ce450 con 0x7f1000103030 2024-09-21T03:54:55.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.083+0000 7f10072be640 1 -- 172.21.15.46:0/3248541182 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f10001ad610 con 0x7f1000103030 2024-09-21T03:54:55.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.083+0000 7f0ff67fc640 1 -- 172.21.15.46:0/3248541182 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) ==== 93+0+10 (secure 0 0 0) 0x7f0ff00d2830 con 0x7f1000103030 2024-09-21T03:54:55.086 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-09-21T03:54:55.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.085+0000 7f10072be640 1 -- 172.21.15.46:0/3248541182 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f0fec0b65f0 msgr2=0x7f0fec0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:55.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.085+0000 7f10072be640 1 --2- 172.21.15.46:0/3248541182 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f0fec0b65f0 0x7f0fec0b8b00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc009c20 tx=0x7f0ffc005f90 comp rx=0 tx=0).stop 2024-09-21T03:54:55.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.085+0000 7f10072be640 1 -- 172.21.15.46:0/3248541182 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1000103030 msgr2=0x7f10001a0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:55.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.085+0000 7f10072be640 1 --2- 172.21.15.46:0/3248541182 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1000103030 0x7f10001a0fd0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0ff002a930 tx=0x7f0ff0031a20 comp rx=0 tx=0).stop 2024-09-21T03:54:55.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.086+0000 7f10072be640 1 -- 172.21.15.46:0/3248541182 shutdown_connections 2024-09-21T03:54:55.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.086+0000 7f10072be640 1 --2- 172.21.15.46:0/3248541182 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f0fec0b65f0 0x7f0fec0b8b00 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:55.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.086+0000 7f10072be640 1 --2- 172.21.15.46:0/3248541182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1000107ba0 0x7f10001a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:55.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.086+0000 7f10072be640 1 --2- 172.21.15.46:0/3248541182 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1000103030 0x7f10001a0fd0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:55.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.086+0000 7f10072be640 1 --2- 172.21.15.46:0/3248541182 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10001026e0 0x7f10001a0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:55.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.086+0000 7f10072be640 1 -- 172.21.15.46:0/3248541182 >> 172.21.15.46:0/3248541182 conn(0x7f10000fe3c0 msgr2=0x7f1000105520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:55.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.086+0000 7f10072be640 1 -- 172.21.15.46:0/3248541182 shutdown_connections 2024-09-21T03:54:55.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.086+0000 7f10072be640 1 -- 172.21.15.46:0/3248541182 wait complete. 2024-09-21T03:54:55.100 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T03:54:55.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.214+0000 7f5e05513640 1 -- 172.21.15.46:0/784239953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e001029a0 msgr2=0x7f5e00102db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:55.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.214+0000 7f5e05513640 1 --2- 172.21.15.46:0/784239953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e001029a0 0x7f5e00102db0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5df0009900 tx=0x7f5df002a410 comp rx=0 tx=0).stop 2024-09-21T03:54:55.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.214+0000 7f5e05513640 1 -- 172.21.15.46:0/784239953 shutdown_connections 2024-09-21T03:54:55.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.214+0000 7f5e05513640 1 --2- 172.21.15.46:0/784239953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e00108c20 0x7f5e0010f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:55.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.214+0000 7f5e05513640 1 --2- 172.21.15.46:0/784239953 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e001082d0 0x7f5e001086e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:55.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.214+0000 7f5e05513640 1 --2- 172.21.15.46:0/784239953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e001029a0 0x7f5e00102db0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:55.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.214+0000 7f5e05513640 1 -- 172.21.15.46:0/784239953 >> 172.21.15.46:0/784239953 conn(0x7f5e000fe3c0 msgr2=0x7f5e00100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:55.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.214+0000 7f5e05513640 1 -- 172.21.15.46:0/784239953 shutdown_connections 2024-09-21T03:54:55.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.214+0000 7f5e05513640 1 -- 172.21.15.46:0/784239953 wait complete. 2024-09-21T03:54:55.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.215+0000 7f5e05513640 1 Processor -- start 2024-09-21T03:54:55.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.215+0000 7f5e05513640 1 -- start start 2024-09-21T03:54:55.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.215+0000 7f5e05513640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e001029a0 0x7f5e0019a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:55.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.215+0000 7f5e05513640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e001082d0 0x7f5e0019a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:55.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.215+0000 7f5e05513640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e00108c20 0x7f5e0019fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:55.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.215+0000 7f5e05513640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5e00113a00 con 0x7f5e001082d0 2024-09-21T03:54:55.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.215+0000 7f5e05513640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5e00113880 con 0x7f5e001029a0 2024-09-21T03:54:55.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.215+0000 7f5e05513640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5e00113b80 con 0x7f5e00108c20 2024-09-21T03:54:55.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.215+0000 7f5dfe7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e001082d0 0x7f5e0019a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:55.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.215+0000 7f5dfe7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e001082d0 0x7f5e0019a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58608/0 (socket says 172.21.15.46:58608) 2024-09-21T03:54:55.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.215+0000 7f5dfe7fc640 1 -- 172.21.15.46:0/1211899797 learned_addr learned my addr 172.21.15.46:0/1211899797 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:55.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.216+0000 7f5dff7fe640 1 --2- 172.21.15.46:0/1211899797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e00108c20 0x7f5e0019fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:55.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.216+0000 7f5dfeffd640 1 --2- 172.21.15.46:0/1211899797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e001029a0 0x7f5e0019a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:55.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.216+0000 7f5dfe7fc640 1 -- 172.21.15.46:0/1211899797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e00108c20 msgr2=0x7f5e0019fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:55.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.216+0000 7f5dfe7fc640 1 --2- 172.21.15.46:0/1211899797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e00108c20 0x7f5e0019fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:55.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.216+0000 7f5dfe7fc640 1 -- 172.21.15.46:0/1211899797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e001029a0 msgr2=0x7f5e0019a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:55.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.216+0000 7f5dfe7fc640 1 --2- 172.21.15.46:0/1211899797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e001029a0 0x7f5e0019a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:55.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.216+0000 7f5dfe7fc640 1 -- 172.21.15.46:0/1211899797 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e001a0330 con 0x7f5e001082d0 2024-09-21T03:54:55.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.216+0000 7f5dff7fe640 1 --2- 172.21.15.46:0/1211899797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e00108c20 0x7f5e0019fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:54:55.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.216+0000 7f5dfe7fc640 1 --2- 172.21.15.46:0/1211899797 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e001082d0 0x7f5e0019a9a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5df400d950 tx=0x7f5df400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:55.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.216+0000 7f5de7fff640 1 -- 172.21.15.46:0/1211899797 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df4017070 con 0x7f5e001082d0 2024-09-21T03:54:55.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.216+0000 7f5e05513640 1 -- 172.21.15.46:0/1211899797 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e001a0620 con 0x7f5e001082d0 2024-09-21T03:54:55.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.216+0000 7f5de7fff640 1 -- 172.21.15.46:0/1211899797 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5df4009c30 con 0x7f5e001082d0 2024-09-21T03:54:55.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.216+0000 7f5de7fff640 1 -- 172.21.15.46:0/1211899797 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df40047a0 con 0x7f5e001082d0 2024-09-21T03:54:55.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.216+0000 7f5e05513640 1 -- 172.21.15.46:0/1211899797 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e001a6db0 con 0x7f5e001082d0 2024-09-21T03:54:55.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.217+0000 7f5e05513640 1 -- 172.21.15.46:0/1211899797 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e00103c10 con 0x7f5e001082d0 2024-09-21T03:54:55.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.220+0000 7f5de7fff640 1 -- 172.21.15.46:0/1211899797 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f5df4004020 con 0x7f5e001082d0 2024-09-21T03:54:55.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.221+0000 7f5de7fff640 1 --2- 172.21.15.46:0/1211899797 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f5de80b65f0 0x7f5de80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:55.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.221+0000 7f5dfeffd640 1 --2- 172.21.15.46:0/1211899797 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f5de80b65f0 0x7f5de80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:55.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.221+0000 7f5de7fff640 1 -- 172.21.15.46:0/1211899797 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f5df40e77d0 con 0x7f5e001082d0 2024-09-21T03:54:55.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.221+0000 7f5dfeffd640 1 --2- 172.21.15.46:0/1211899797 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f5de80b65f0 0x7f5de80b8b00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5df0031440 tx=0x7f5df0005d50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:55.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.224+0000 7f5de7fff640 1 -- 172.21.15.46:0/1211899797 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5df4020020 con 0x7f5e001082d0 2024-09-21T03:54:55.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.414+0000 7f5e05513640 1 -- 172.21.15.46:0/1211899797 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f5e0019b520 con 0x7f5e001082d0 2024-09-21T03:54:55.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.415+0000 7f5de7fff640 1 -- 172.21.15.46:0/1211899797 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v77) ==== 104+0+11 (secure 0 0 0) 0x7f5e0019b520 con 0x7f5e001082d0 2024-09-21T03:54:55.417 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-09-21T03:54:55.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.417+0000 7f5e05513640 1 -- 172.21.15.46:0/1211899797 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f5de80b65f0 msgr2=0x7f5de80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:55.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.417+0000 7f5e05513640 1 --2- 172.21.15.46:0/1211899797 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f5de80b65f0 0x7f5de80b8b00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5df0031440 tx=0x7f5df0005d50 comp rx=0 tx=0).stop 2024-09-21T03:54:55.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.417+0000 7f5e05513640 1 -- 172.21.15.46:0/1211899797 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e001082d0 msgr2=0x7f5e0019a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:55.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.417+0000 7f5e05513640 1 --2- 172.21.15.46:0/1211899797 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e001082d0 0x7f5e0019a9a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5df400d950 tx=0x7f5df400de10 comp rx=0 tx=0).stop 2024-09-21T03:54:55.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.417+0000 7f5e05513640 1 -- 172.21.15.46:0/1211899797 shutdown_connections 2024-09-21T03:54:55.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.417+0000 7f5e05513640 1 --2- 172.21.15.46:0/1211899797 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f5de80b65f0 0x7f5de80b8b00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:55.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.417+0000 7f5e05513640 1 --2- 172.21.15.46:0/1211899797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e00108c20 0x7f5e0019fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:55.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.417+0000 7f5e05513640 1 --2- 172.21.15.46:0/1211899797 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e001082d0 0x7f5e0019a9a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:55.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.417+0000 7f5e05513640 1 --2- 172.21.15.46:0/1211899797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e001029a0 0x7f5e0019a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:55.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.417+0000 7f5e05513640 1 -- 172.21.15.46:0/1211899797 >> 172.21.15.46:0/1211899797 conn(0x7f5e000fe3c0 msgr2=0x7f5e001007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:55.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.417+0000 7f5e05513640 1 -- 172.21.15.46:0/1211899797 shutdown_connections 2024-09-21T03:54:55.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.417+0000 7f5e05513640 1 -- 172.21.15.46:0/1211899797 wait complete. 2024-09-21T03:54:55.431 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T03:54:55.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.546+0000 7fc2d9427640 1 -- 172.21.15.46:0/2062479440 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2d4102990 msgr2=0x7fc2d4102da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:55.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.546+0000 7fc2d9427640 1 --2- 172.21.15.46:0/2062479440 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2d4102990 0x7fc2d4102da0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4009900 tx=0x7fc2c402a410 comp rx=0 tx=0).stop 2024-09-21T03:54:55.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.546+0000 7fc2d9427640 1 -- 172.21.15.46:0/2062479440 shutdown_connections 2024-09-21T03:54:55.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.546+0000 7fc2d9427640 1 --2- 172.21.15.46:0/2062479440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2d4108c10 0x7fc2d410f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:55.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.546+0000 7fc2d9427640 1 --2- 172.21.15.46:0/2062479440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2d41082c0 0x7fc2d41086d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:55.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.546+0000 7fc2d9427640 1 --2- 172.21.15.46:0/2062479440 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2d4102990 0x7fc2d4102da0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:55.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.546+0000 7fc2d9427640 1 -- 172.21.15.46:0/2062479440 >> 172.21.15.46:0/2062479440 conn(0x7fc2d40fe3b0 msgr2=0x7fc2d4100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:55.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.546+0000 7fc2d9427640 1 -- 172.21.15.46:0/2062479440 shutdown_connections 2024-09-21T03:54:55.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.546+0000 7fc2d9427640 1 -- 172.21.15.46:0/2062479440 wait complete. 2024-09-21T03:54:55.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.546+0000 7fc2d9427640 1 Processor -- start 2024-09-21T03:54:55.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.547+0000 7fc2d9427640 1 -- start start 2024-09-21T03:54:55.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.547+0000 7fc2d9427640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2d4102990 0x7fc2d410ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:55.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.547+0000 7fc2d9427640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2d41082c0 0x7fc2d4110460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:55.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.547+0000 7fc2d9427640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2d4108c10 0x7fc2d41109a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:55.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.547+0000 7fc2d9427640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d41139f0 con 0x7fc2d4102990 2024-09-21T03:54:55.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.547+0000 7fc2d9427640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d4113870 con 0x7fc2d4108c10 2024-09-21T03:54:55.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.547+0000 7fc2d9427640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d4113b70 con 0x7fc2d41082c0 2024-09-21T03:54:55.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.547+0000 7fc2d2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2d4102990 0x7fc2d410ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:55.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.547+0000 7fc2d2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2d4102990 0x7fc2d410ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58626/0 (socket says 172.21.15.46:58626) 2024-09-21T03:54:55.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.547+0000 7fc2d2ffd640 1 -- 172.21.15.46:0/2632339254 learned_addr learned my addr 172.21.15.46:0/2632339254 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:55.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.547+0000 7fc2d37fe640 1 --2- 172.21.15.46:0/2632339254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2d4108c10 0x7fc2d41109a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:55.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.547+0000 7fc2d27fc640 1 --2- 172.21.15.46:0/2632339254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2d41082c0 0x7fc2d4110460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:55.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.547+0000 7fc2d2ffd640 1 -- 172.21.15.46:0/2632339254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2d41082c0 msgr2=0x7fc2d4110460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:55.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.547+0000 7fc2d2ffd640 1 --2- 172.21.15.46:0/2632339254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2d41082c0 0x7fc2d4110460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:55.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.547+0000 7fc2d2ffd640 1 -- 172.21.15.46:0/2632339254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2d4108c10 msgr2=0x7fc2d41109a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:55.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.547+0000 7fc2d2ffd640 1 --2- 172.21.15.46:0/2632339254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2d4108c10 0x7fc2d41109a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:55.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.547+0000 7fc2d2ffd640 1 -- 172.21.15.46:0/2632339254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d41a86c0 con 0x7fc2d4102990 2024-09-21T03:54:55.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.547+0000 7fc2d37fe640 1 --2- 172.21.15.46:0/2632339254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2d4108c10 0x7fc2d41109a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:54:55.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.548+0000 7fc2d2ffd640 1 --2- 172.21.15.46:0/2632339254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2d4102990 0x7fc2d410ff20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4005940 tx=0x7fc2c40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:55.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.548+0000 7fc2bbfff640 1 -- 172.21.15.46:0/2632339254 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c403f030 con 0x7fc2d4102990 2024-09-21T03:54:55.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.548+0000 7fc2bbfff640 1 -- 172.21.15.46:0/2632339254 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2c4003cb0 con 0x7fc2d4102990 2024-09-21T03:54:55.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.548+0000 7fc2d9427640 1 -- 172.21.15.46:0/2632339254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2d41a8950 con 0x7fc2d4102990 2024-09-21T03:54:55.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.548+0000 7fc2bbfff640 1 -- 172.21.15.46:0/2632339254 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4035070 con 0x7fc2d4102990 2024-09-21T03:54:55.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.548+0000 7fc2d9427640 1 -- 172.21.15.46:0/2632339254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2d41a8e90 con 0x7fc2d4102990 2024-09-21T03:54:55.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.549+0000 7fc2d9427640 1 -- 172.21.15.46:0/2632339254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2d4102da0 con 0x7fc2d4102990 2024-09-21T03:54:55.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.552+0000 7fc2bbfff640 1 -- 172.21.15.46:0/2632339254 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fc2c4042030 con 0x7fc2d4102990 2024-09-21T03:54:55.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.552+0000 7fc2bbfff640 1 --2- 172.21.15.46:0/2632339254 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc2bc0b66a0 0x7fc2bc0b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:55.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.552+0000 7fc2d27fc640 1 --2- 172.21.15.46:0/2632339254 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc2bc0b66a0 0x7fc2bc0b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:55.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.552+0000 7fc2bbfff640 1 -- 172.21.15.46:0/2632339254 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fc2c4107d80 con 0x7fc2d4102990 2024-09-21T03:54:55.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.553+0000 7fc2d27fc640 1 --2- 172.21.15.46:0/2632339254 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc2bc0b66a0 0x7fc2bc0b8bb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8005fd0 tx=0x7fc2c8005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:55.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.556+0000 7fc2bbfff640 1 -- 172.21.15.46:0/2632339254 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc2c40ce3f0 con 0x7fc2d4102990 2024-09-21T03:54:55.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.747+0000 7fc2d9427640 1 -- 172.21.15.46:0/2632339254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc2d402e640 con 0x7fc2d4102990 2024-09-21T03:54:55.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.747+0000 7fc2bbfff640 1 -- 172.21.15.46:0/2632339254 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v77) ==== 100+0+11 (secure 0 0 0) 0x7fc2c40d27d0 con 0x7fc2d4102990 2024-09-21T03:54:55.750 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-09-21T03:54:55.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.750+0000 7fc2d9427640 1 -- 172.21.15.46:0/2632339254 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc2bc0b66a0 msgr2=0x7fc2bc0b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:55.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.750+0000 7fc2d9427640 1 --2- 172.21.15.46:0/2632339254 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc2bc0b66a0 0x7fc2bc0b8bb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8005fd0 tx=0x7fc2c8005850 comp rx=0 tx=0).stop 2024-09-21T03:54:55.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.750+0000 7fc2d9427640 1 -- 172.21.15.46:0/2632339254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2d4102990 msgr2=0x7fc2d410ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:55.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.750+0000 7fc2d9427640 1 --2- 172.21.15.46:0/2632339254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2d4102990 0x7fc2d410ff20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4005940 tx=0x7fc2c40042f0 comp rx=0 tx=0).stop 2024-09-21T03:54:55.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.750+0000 7fc2d9427640 1 -- 172.21.15.46:0/2632339254 shutdown_connections 2024-09-21T03:54:55.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.750+0000 7fc2d9427640 1 --2- 172.21.15.46:0/2632339254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2d4108c10 0x7fc2d41109a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:55.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.750+0000 7fc2d9427640 1 --2- 172.21.15.46:0/2632339254 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc2bc0b66a0 0x7fc2bc0b8bb0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:55.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.750+0000 7fc2d9427640 1 --2- 172.21.15.46:0/2632339254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2d41082c0 0x7fc2d4110460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:55.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.750+0000 7fc2d9427640 1 --2- 172.21.15.46:0/2632339254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2d4102990 0x7fc2d410ff20 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:55.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.750+0000 7fc2d9427640 1 -- 172.21.15.46:0/2632339254 >> 172.21.15.46:0/2632339254 conn(0x7fc2d40fe3b0 msgr2=0x7fc2d41007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:55.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.750+0000 7fc2d9427640 1 -- 172.21.15.46:0/2632339254 shutdown_connections 2024-09-21T03:54:55.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:55.750+0000 7fc2d9427640 1 -- 172.21.15.46:0/2632339254 wait complete. 2024-09-21T03:54:55.764 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-21T03:54:55.764 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:54:56.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:55 smithi046 ceph-mon[30954]: pgmap v316: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:54:56.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:55 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/2357920388' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:54:56.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:55 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3248541182' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T03:54:56.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:55 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/1211899797' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T03:54:56.023 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:56.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:55 smithi105 ceph-mon[34773]: pgmap v316: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:54:56.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:55 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/2357920388' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:54:56.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:55 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3248541182' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T03:54:56.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:55 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/1211899797' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T03:54:56.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:55 smithi162 ceph-mon[35071]: pgmap v316: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:54:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:55 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/2357920388' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:54:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:55 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3248541182' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T03:54:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:55 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/1211899797' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T03:54:56.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.524+0000 7f4efff2b640 1 -- 172.21.15.46:0/3702257599 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ef8103b60 msgr2=0x7f4ef8103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:56.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.524+0000 7f4efff2b640 1 --2- 172.21.15.46:0/3702257599 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ef8103b60 0x7f4ef8103f70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4009900 tx=0x7f4ef402a410 comp rx=0 tx=0).stop 2024-09-21T03:54:56.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.524+0000 7f4efff2b640 1 -- 172.21.15.46:0/3702257599 shutdown_connections 2024-09-21T03:54:56.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.524+0000 7f4efff2b640 1 --2- 172.21.15.46:0/3702257599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ef8109df0 0x7f4ef8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:56.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.524+0000 7f4efff2b640 1 --2- 172.21.15.46:0/3702257599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ef81094a0 0x7f4ef81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:56.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.524+0000 7f4efff2b640 1 --2- 172.21.15.46:0/3702257599 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ef8103b60 0x7f4ef8103f70 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:56.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.524+0000 7f4efff2b640 1 -- 172.21.15.46:0/3702257599 >> 172.21.15.46:0/3702257599 conn(0x7f4ef807b850 msgr2=0x7f4ef807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:56.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.524+0000 7f4efff2b640 1 -- 172.21.15.46:0/3702257599 shutdown_connections 2024-09-21T03:54:56.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.524+0000 7f4efff2b640 1 -- 172.21.15.46:0/3702257599 wait complete. 2024-09-21T03:54:56.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.525+0000 7f4efff2b640 1 Processor -- start 2024-09-21T03:54:56.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.525+0000 7f4efff2b640 1 -- start start 2024-09-21T03:54:56.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.525+0000 7f4efff2b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ef8103b60 0x7f4ef8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:56.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.525+0000 7f4efff2b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ef81094a0 0x7f4ef8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:56.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.525+0000 7f4efff2b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ef8109df0 0x7f4ef8076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:56.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.525+0000 7f4efff2b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef8113b40 con 0x7f4ef81094a0 2024-09-21T03:54:56.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.525+0000 7f4efff2b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef81139c0 con 0x7f4ef8109df0 2024-09-21T03:54:56.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.525+0000 7f4efff2b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef8113cc0 con 0x7f4ef8103b60 2024-09-21T03:54:56.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.525+0000 7f4efd4c6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ef81094a0 0x7f4ef8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:56.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.525+0000 7f4efd4c6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ef81094a0 0x7f4ef8075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58654/0 (socket says 172.21.15.46:58654) 2024-09-21T03:54:56.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.525+0000 7f4efd4c6640 1 -- 172.21.15.46:0/1352370494 learned_addr learned my addr 172.21.15.46:0/1352370494 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:56.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.525+0000 7f4efdcc7640 1 --2- 172.21.15.46:0/1352370494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ef8103b60 0x7f4ef8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:56.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.525+0000 7f4efe4c8640 1 --2- 172.21.15.46:0/1352370494 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ef8109df0 0x7f4ef8076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:56.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.525+0000 7f4efd4c6640 1 -- 172.21.15.46:0/1352370494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ef8103b60 msgr2=0x7f4ef8075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:56.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.525+0000 7f4efd4c6640 1 --2- 172.21.15.46:0/1352370494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ef8103b60 0x7f4ef8075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:56.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.525+0000 7f4efd4c6640 1 -- 172.21.15.46:0/1352370494 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ef8109df0 msgr2=0x7f4ef8076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:56.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.525+0000 7f4efd4c6640 1 --2- 172.21.15.46:0/1352370494 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ef8109df0 0x7f4ef8076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:56.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.525+0000 7f4efd4c6640 1 -- 172.21.15.46:0/1352370494 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef81a87f0 con 0x7f4ef81094a0 2024-09-21T03:54:56.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.526+0000 7f4efd4c6640 1 --2- 172.21.15.46:0/1352370494 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ef81094a0 0x7f4ef8075c50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8006fd0 tx=0x7f4ee800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:56.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.526+0000 7f4eeeffd640 1 -- 172.21.15.46:0/1352370494 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8011830 con 0x7f4ef81094a0 2024-09-21T03:54:56.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.526+0000 7f4eeeffd640 1 -- 172.21.15.46:0/1352370494 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ee8016070 con 0x7f4ef81094a0 2024-09-21T03:54:56.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.526+0000 7f4efff2b640 1 -- 172.21.15.46:0/1352370494 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ef81a8ae0 con 0x7f4ef81094a0 2024-09-21T03:54:56.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.526+0000 7f4eeeffd640 1 -- 172.21.15.46:0/1352370494 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8010e00 con 0x7f4ef81094a0 2024-09-21T03:54:56.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.526+0000 7f4efff2b640 1 -- 172.21.15.46:0/1352370494 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ef81a9070 con 0x7f4ef81094a0 2024-09-21T03:54:56.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.527+0000 7f4efff2b640 1 -- 172.21.15.46:0/1352370494 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ef8103f70 con 0x7f4ef81094a0 2024-09-21T03:54:56.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.529+0000 7f4eeeffd640 1 -- 172.21.15.46:0/1352370494 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f4ee801b460 con 0x7f4ef81094a0 2024-09-21T03:54:56.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.529+0000 7f4eeeffd640 1 --2- 172.21.15.46:0/1352370494 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4ee40b65f0 0x7f4ee40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:56.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.529+0000 7f4efdcc7640 1 --2- 172.21.15.46:0/1352370494 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4ee40b65f0 0x7f4ee40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:56.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.529+0000 7f4eeeffd640 1 -- 172.21.15.46:0/1352370494 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f4ee80e70b0 con 0x7f4ef81094a0 2024-09-21T03:54:56.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.530+0000 7f4efdcc7640 1 --2- 172.21.15.46:0/1352370494 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4ee40b65f0 0x7f4ee40b8b00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4005ab0 tx=0x7f4ef4005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:56.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.533+0000 7f4eeeffd640 1 -- 172.21.15.46:0/1352370494 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4ee80ad760 con 0x7f4ef81094a0 2024-09-21T03:54:56.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.761+0000 7f4efff2b640 1 -- 172.21.15.46:0/1352370494 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ef8076a10 con 0x7f4ef81094a0 2024-09-21T03:54:56.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.761+0000 7f4eeeffd640 1 -- 172.21.15.46:0/1352370494 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f4ee80b1b40 con 0x7f4ef81094a0 2024-09-21T03:54:56.764 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:54:56.764 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"btime":"2024-09-21T03:53:23:865820+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1766354184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1766354184},{"type":"v1","addr":"172.21.15.46:6839","nonce":1766354184}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/1901774207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":1901774207},{"type":"v1","addr":"172.21.15.46:6841","nonce":1901774207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3548633196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":3548633196},{"type":"v1","addr":"172.21.15.105:6837","nonce":3548633196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24652,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3551934241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3551934241},{"type":"v1","addr":"172.21.15.162:6835","nonce":3551934241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/48949822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":48949822},{"type":"v1","addr":"172.21.15.162:6837","nonce":48949822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:53:14.452819+0000","modified":"2024-09-21T03:53:23.593278+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24680},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/2196053213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2196053213},{"type":"v1","addr":"172.21.15.162:6839","nonce":2196053213}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.105:6839/3911438406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":3911438406},{"type":"v1","addr":"172.21.15.105:6839","nonce":3911438406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24680,"qdb_cluster":[24680]},"id":1}]} 2024-09-21T03:54:56.764 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T03:54:56.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.764+0000 7f4efff2b640 1 -- 172.21.15.46:0/1352370494 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4ee40b65f0 msgr2=0x7f4ee40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:56.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.764+0000 7f4efff2b640 1 --2- 172.21.15.46:0/1352370494 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4ee40b65f0 0x7f4ee40b8b00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4005ab0 tx=0x7f4ef4005a20 comp rx=0 tx=0).stop 2024-09-21T03:54:56.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.764+0000 7f4efff2b640 1 -- 172.21.15.46:0/1352370494 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ef81094a0 msgr2=0x7f4ef8075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:56.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.764+0000 7f4efff2b640 1 --2- 172.21.15.46:0/1352370494 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ef81094a0 0x7f4ef8075c50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8006fd0 tx=0x7f4ee800b8e0 comp rx=0 tx=0).stop 2024-09-21T03:54:56.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.764+0000 7f4efff2b640 1 -- 172.21.15.46:0/1352370494 shutdown_connections 2024-09-21T03:54:56.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.764+0000 7f4efff2b640 1 --2- 172.21.15.46:0/1352370494 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ef8109df0 0x7f4ef8076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:56.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.764+0000 7f4efff2b640 1 --2- 172.21.15.46:0/1352370494 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ef81094a0 0x7f4ef8075c50 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:56.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.764+0000 7f4efff2b640 1 --2- 172.21.15.46:0/1352370494 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4ee40b65f0 0x7f4ee40b8b00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:56.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.764+0000 7f4efff2b640 1 --2- 172.21.15.46:0/1352370494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ef8103b60 0x7f4ef8075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:56.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.764+0000 7f4efff2b640 1 -- 172.21.15.46:0/1352370494 >> 172.21.15.46:0/1352370494 conn(0x7f4ef807b850 msgr2=0x7f4ef8107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:56.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.764+0000 7f4efff2b640 1 -- 172.21.15.46:0/1352370494 shutdown_connections 2024-09-21T03:54:56.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:56.764+0000 7f4efff2b640 1 -- 172.21.15.46:0/1352370494 wait complete. 2024-09-21T03:54:57.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:56 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/2632339254' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T03:54:57.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:56 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/2632339254' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T03:54:57.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:56 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/2632339254' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T03:54:57.527 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-21T03:54:57.527 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-21T03:54:57.527 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:54:57.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.651+0000 7f5356ef2640 1 -- 172.21.15.46:0/2840050767 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5350109d50 msgr2=0x7f5350110580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:57.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.651+0000 7f5356ef2640 1 --2- 172.21.15.46:0/2840050767 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5350109d50 0x7f5350110580 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f5348009ca0 tx=0x7f534802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:54:57.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.651+0000 7f5356ef2640 1 -- 172.21.15.46:0/2840050767 shutdown_connections 2024-09-21T03:54:57.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.651+0000 7f5356ef2640 1 --2- 172.21.15.46:0/2840050767 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5350109d50 0x7f5350110580 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:57.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.651+0000 7f5356ef2640 1 --2- 172.21.15.46:0/2840050767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5350109400 0x7f5350109810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:57.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.651+0000 7f5356ef2640 1 --2- 172.21.15.46:0/2840050767 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5350103ad0 0x7f5350103ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:57.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.651+0000 7f5356ef2640 1 -- 172.21.15.46:0/2840050767 >> 172.21.15.46:0/2840050767 conn(0x7f53500ff510 msgr2=0x7f5350101960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:57.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.651+0000 7f5356ef2640 1 -- 172.21.15.46:0/2840050767 shutdown_connections 2024-09-21T03:54:57.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.651+0000 7f5356ef2640 1 -- 172.21.15.46:0/2840050767 wait complete. 2024-09-21T03:54:57.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.651+0000 7f5356ef2640 1 Processor -- start 2024-09-21T03:54:57.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.652+0000 7f5356ef2640 1 -- start start 2024-09-21T03:54:57.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.652+0000 7f5356ef2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5350103ad0 0x7f5350075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:57.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.652+0000 7f5356ef2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5350109400 0x7f5350075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:57.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.652+0000 7f5356ef2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5350109d50 0x7f5350076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:57.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.652+0000 7f5356ef2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5350113a10 con 0x7f5350109400 2024-09-21T03:54:57.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.652+0000 7f5356ef2640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5350113890 con 0x7f5350103ad0 2024-09-21T03:54:57.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.652+0000 7f5356ef2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5350113b90 con 0x7f5350109d50 2024-09-21T03:54:57.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.652+0000 7f534ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5350109400 0x7f5350075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:57.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.652+0000 7f534ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5350109400 0x7f5350075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58676/0 (socket says 172.21.15.46:58676) 2024-09-21T03:54:57.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.652+0000 7f534ffff640 1 -- 172.21.15.46:0/3398329047 learned_addr learned my addr 172.21.15.46:0/3398329047 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:57.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.652+0000 7f5354c8e640 1 --2- 172.21.15.46:0/3398329047 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5350103ad0 0x7f5350075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:57.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.652+0000 7f535548f640 1 --2- 172.21.15.46:0/3398329047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5350109d50 0x7f5350076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:57.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.652+0000 7f534ffff640 1 -- 172.21.15.46:0/3398329047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5350109d50 msgr2=0x7f5350076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:57.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.652+0000 7f534ffff640 1 --2- 172.21.15.46:0/3398329047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5350109d50 0x7f5350076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:57.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.652+0000 7f534ffff640 1 -- 172.21.15.46:0/3398329047 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5350103ad0 msgr2=0x7f5350075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:57.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.652+0000 7f534ffff640 1 --2- 172.21.15.46:0/3398329047 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5350103ad0 0x7f5350075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:57.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.652+0000 7f534ffff640 1 -- 172.21.15.46:0/3398329047 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53501a8700 con 0x7f5350109400 2024-09-21T03:54:57.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.652+0000 7f535548f640 1 --2- 172.21.15.46:0/3398329047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5350109d50 0x7f5350076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:54:57.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.653+0000 7f534ffff640 1 --2- 172.21.15.46:0/3398329047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5350109400 0x7f5350075c50 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f533c00d750 tx=0x7f533c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:57.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.653+0000 7f534dffb640 1 -- 172.21.15.46:0/3398329047 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c017070 con 0x7f5350109400 2024-09-21T03:54:57.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.653+0000 7f534dffb640 1 -- 172.21.15.46:0/3398329047 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f533c0054d0 con 0x7f5350109400 2024-09-21T03:54:57.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.653+0000 7f5356ef2640 1 -- 172.21.15.46:0/3398329047 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53501a89f0 con 0x7f5350109400 2024-09-21T03:54:57.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.653+0000 7f534dffb640 1 -- 172.21.15.46:0/3398329047 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c004c30 con 0x7f5350109400 2024-09-21T03:54:57.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.653+0000 7f5356ef2640 1 -- 172.21.15.46:0/3398329047 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53501a8ef0 con 0x7f5350109400 2024-09-21T03:54:57.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.654+0000 7f5356ef2640 1 -- 172.21.15.46:0/3398329047 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5350104d40 con 0x7f5350109400 2024-09-21T03:54:57.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.655+0000 7f534dffb640 1 -- 172.21.15.46:0/3398329047 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f533c004dd0 con 0x7f5350109400 2024-09-21T03:54:57.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.656+0000 7f534dffb640 1 --2- 172.21.15.46:0/3398329047 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f53400b6620 0x7f53400b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:57.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.656+0000 7f5354c8e640 1 --2- 172.21.15.46:0/3398329047 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f53400b6620 0x7f53400b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:57.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.656+0000 7f534dffb640 1 -- 172.21.15.46:0/3398329047 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f533c0e6f50 con 0x7f5350109400 2024-09-21T03:54:57.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.657+0000 7f5354c8e640 1 --2- 172.21.15.46:0/3398329047 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f53400b6620 0x7f53400b8b30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5350077160 tx=0x7f534400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:57.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.660+0000 7f534dffb640 1 -- 172.21.15.46:0/3398329047 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f533c0ad5c0 con 0x7f5350109400 2024-09-21T03:54:57.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:57 smithi046 ceph-mon[30954]: pgmap v317: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:54:57.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:57 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/1352370494' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:54:57.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.850+0000 7f5356ef2640 1 -- 172.21.15.46:0/3398329047 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5350063800 con 0x7f53400b6620 2024-09-21T03:54:57.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.854+0000 7f534dffb640 1 -- 172.21.15.46:0/3398329047 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258883 (secure 0 0 0) 0x7f5350063800 con 0x7f53400b6620 2024-09-21T03:54:57.859 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:54:57.860 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-09-21T03:54:57.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.858+0000 7f5356ef2640 1 -- 172.21.15.46:0/3398329047 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f53400b6620 msgr2=0x7f53400b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:57.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.858+0000 7f5356ef2640 1 --2- 172.21.15.46:0/3398329047 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f53400b6620 0x7f53400b8b30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5350077160 tx=0x7f534400b410 comp rx=0 tx=0).stop 2024-09-21T03:54:57.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.858+0000 7f5356ef2640 1 -- 172.21.15.46:0/3398329047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5350109400 msgr2=0x7f5350075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:57.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.858+0000 7f5356ef2640 1 --2- 172.21.15.46:0/3398329047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5350109400 0x7f5350075c50 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f533c00d750 tx=0x7f533c00dc10 comp rx=0 tx=0).stop 2024-09-21T03:54:57.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.858+0000 7f5356ef2640 1 -- 172.21.15.46:0/3398329047 shutdown_connections 2024-09-21T03:54:57.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.858+0000 7f5356ef2640 1 --2- 172.21.15.46:0/3398329047 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f53400b6620 0x7f53400b8b30 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:57.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.858+0000 7f5356ef2640 1 --2- 172.21.15.46:0/3398329047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5350109d50 0x7f5350076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:57.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.858+0000 7f5356ef2640 1 --2- 172.21.15.46:0/3398329047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5350109400 0x7f5350075c50 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:57.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.858+0000 7f5356ef2640 1 --2- 172.21.15.46:0/3398329047 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5350103ad0 0x7f5350075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:57.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.858+0000 7f5356ef2640 1 -- 172.21.15.46:0/3398329047 >> 172.21.15.46:0/3398329047 conn(0x7f53500ff510 msgr2=0x7f5350108a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:57.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.858+0000 7f5356ef2640 1 -- 172.21.15.46:0/3398329047 shutdown_connections 2024-09-21T03:54:57.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:57.858+0000 7f5356ef2640 1 -- 172.21.15.46:0/3398329047 wait complete. 2024-09-21T03:54:57.872 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":317,"stamp":"2024-09-21T03:54:56.069530+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658357,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":278,"num_read_kb":235,"num_write":210,"num_write_kb":2246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":380292,"kb_used_data":10200,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124561532,"statfs":{"total":1151940427776,"available":1151551008768,"internally_reserved":0,"allocated":10444800,"data_stored":6974303,"data_compressed":177972,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002913"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034971+0000","last_change":"2024-09-21T03:53:13.835177+0000","last_active":"2024-09-21T03:53:33.034971+0000","last_peered":"2024-09-21T03:53:33.034971+0000","last_clean":"2024-09-21T03:53:33.034971+0000","last_became_active":"2024-09-21T03:53:13.834779+0000","last_became_peered":"2024-09-21T03:53:13.834779+0000","last_unstale":"2024-09-21T03:53:33.034971+0000","last_undegraded":"2024-09-21T03:53:33.034971+0000","last_fullsized":"2024-09-21T03:53:33.034971+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:10.632059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123205+0000","last_change":"2024-09-21T03:53:13.829689+0000","last_active":"2024-09-21T03:53:33.123205+0000","last_peered":"2024-09-21T03:53:33.123205+0000","last_clean":"2024-09-21T03:53:33.123205+0000","last_became_active":"2024-09-21T03:53:13.828732+0000","last_became_peered":"2024-09-21T03:53:13.828732+0000","last_unstale":"2024-09-21T03:53:33.123205+0000","last_undegraded":"2024-09-21T03:53:33.123205+0000","last_fullsized":"2024-09-21T03:53:33.123205+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:35.270218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123057+0000","last_change":"2024-09-21T03:53:13.836545+0000","last_active":"2024-09-21T03:53:33.123057+0000","last_peered":"2024-09-21T03:53:33.123057+0000","last_clean":"2024-09-21T03:53:33.123057+0000","last_became_active":"2024-09-21T03:53:13.835781+0000","last_became_peered":"2024-09-21T03:53:13.835781+0000","last_unstale":"2024-09-21T03:53:33.123057+0000","last_undegraded":"2024-09-21T03:53:33.123057+0000","last_fullsized":"2024-09-21T03:53:33.123057+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:13.130016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123786+0000","last_change":"2024-09-21T03:53:13.832292+0000","last_active":"2024-09-21T03:53:33.123786+0000","last_peered":"2024-09-21T03:53:33.123786+0000","last_clean":"2024-09-21T03:53:33.123786+0000","last_became_active":"2024-09-21T03:53:13.831311+0000","last_became_peered":"2024-09-21T03:53:13.831311+0000","last_unstale":"2024-09-21T03:53:33.123786+0000","last_undegraded":"2024-09-21T03:53:33.123786+0000","last_fullsized":"2024-09-21T03:53:33.123786+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:38:49.425261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123152+0000","last_change":"2024-09-21T03:53:13.825130+0000","last_active":"2024-09-21T03:53:33.123152+0000","last_peered":"2024-09-21T03:53:33.123152+0000","last_clean":"2024-09-21T03:53:33.123152+0000","last_became_active":"2024-09-21T03:53:13.824795+0000","last_became_peered":"2024-09-21T03:53:13.824795+0000","last_unstale":"2024-09-21T03:53:33.123152+0000","last_undegraded":"2024-09-21T03:53:33.123152+0000","last_fullsized":"2024-09-21T03:53:33.123152+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:22.653270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123230+0000","last_change":"2024-09-21T03:53:13.834449+0000","last_active":"2024-09-21T03:53:33.123230+0000","last_peered":"2024-09-21T03:53:33.123230+0000","last_clean":"2024-09-21T03:53:33.123230+0000","last_became_active":"2024-09-21T03:53:13.832727+0000","last_became_peered":"2024-09-21T03:53:13.832727+0000","last_unstale":"2024-09-21T03:53:33.123230+0000","last_undegraded":"2024-09-21T03:53:33.123230+0000","last_fullsized":"2024-09-21T03:53:33.123230+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:36.479962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035845+0000","last_change":"2024-09-21T03:53:13.821938+0000","last_active":"2024-09-21T03:53:33.035845+0000","last_peered":"2024-09-21T03:53:33.035845+0000","last_clean":"2024-09-21T03:53:33.035845+0000","last_became_active":"2024-09-21T03:53:13.821569+0000","last_became_peered":"2024-09-21T03:53:13.821569+0000","last_unstale":"2024-09-21T03:53:33.035845+0000","last_undegraded":"2024-09-21T03:53:33.035845+0000","last_fullsized":"2024-09-21T03:53:33.035845+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:04.309212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122491+0000","last_change":"2024-09-21T03:53:13.833471+0000","last_active":"2024-09-21T03:53:33.122491+0000","last_peered":"2024-09-21T03:53:33.122491+0000","last_clean":"2024-09-21T03:53:33.122491+0000","last_became_active":"2024-09-21T03:53:13.832779+0000","last_became_peered":"2024-09-21T03:53:13.832779+0000","last_unstale":"2024-09-21T03:53:33.122491+0000","last_undegraded":"2024-09-21T03:53:33.122491+0000","last_fullsized":"2024-09-21T03:53:33.122491+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:15.402265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032934+0000","last_change":"2024-09-21T03:53:13.833077+0000","last_active":"2024-09-21T03:53:33.032934+0000","last_peered":"2024-09-21T03:53:33.032934+0000","last_clean":"2024-09-21T03:53:33.032934+0000","last_became_active":"2024-09-21T03:53:13.832625+0000","last_became_peered":"2024-09-21T03:53:13.832625+0000","last_unstale":"2024-09-21T03:53:33.032934+0000","last_undegraded":"2024-09-21T03:53:33.032934+0000","last_fullsized":"2024-09-21T03:53:33.032934+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:13.158754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124857+0000","last_change":"2024-09-21T03:53:13.835417+0000","last_active":"2024-09-21T03:53:33.124857+0000","last_peered":"2024-09-21T03:53:33.124857+0000","last_clean":"2024-09-21T03:53:33.124857+0000","last_became_active":"2024-09-21T03:53:13.835081+0000","last_became_peered":"2024-09-21T03:53:13.835081+0000","last_unstale":"2024-09-21T03:53:33.124857+0000","last_undegraded":"2024-09-21T03:53:33.124857+0000","last_fullsized":"2024-09-21T03:53:33.124857+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:29.239879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036187+0000","last_change":"2024-09-21T03:53:13.836575+0000","last_active":"2024-09-21T03:53:33.036187+0000","last_peered":"2024-09-21T03:53:33.036187+0000","last_clean":"2024-09-21T03:53:33.036187+0000","last_became_active":"2024-09-21T03:53:13.836184+0000","last_became_peered":"2024-09-21T03:53:13.836184+0000","last_unstale":"2024-09-21T03:53:33.036187+0000","last_undegraded":"2024-09-21T03:53:33.036187+0000","last_fullsized":"2024-09-21T03:53:33.036187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:06.602354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.126314+0000","last_change":"2024-09-21T03:53:33.125896+0000","last_active":"2024-09-21T03:53:33.126314+0000","last_peered":"2024-09-21T03:53:33.126314+0000","last_clean":"2024-09-21T03:53:33.126314+0000","last_became_active":"2024-09-21T03:53:33.125488+0000","last_became_peered":"2024-09-21T03:53:33.125488+0000","last_unstale":"2024-09-21T03:53:33.126314+0000","last_undegraded":"2024-09-21T03:53:33.126314+0000","last_fullsized":"2024-09-21T03:53:33.126314+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:09.742892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031708+0000","last_change":"2024-09-21T03:53:13.814729+0000","last_active":"2024-09-21T03:53:33.031708+0000","last_peered":"2024-09-21T03:53:33.031708+0000","last_clean":"2024-09-21T03:53:33.031708+0000","last_became_active":"2024-09-21T03:53:13.814317+0000","last_became_peered":"2024-09-21T03:53:13.814317+0000","last_unstale":"2024-09-21T03:53:33.031708+0000","last_undegraded":"2024-09-21T03:53:33.031708+0000","last_fullsized":"2024-09-21T03:53:33.031708+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:30.779754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122847+0000","last_change":"2024-09-21T03:53:13.833280+0000","last_active":"2024-09-21T03:53:33.122847+0000","last_peered":"2024-09-21T03:53:33.122847+0000","last_clean":"2024-09-21T03:53:33.122847+0000","last_became_active":"2024-09-21T03:53:13.831799+0000","last_became_peered":"2024-09-21T03:53:13.831799+0000","last_unstale":"2024-09-21T03:53:33.122847+0000","last_undegraded":"2024-09-21T03:53:33.122847+0000","last_fullsized":"2024-09-21T03:53:33.122847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:33.923946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122733+0000","last_change":"2024-09-21T03:53:13.832142+0000","last_active":"2024-09-21T03:53:33.122733+0000","last_peered":"2024-09-21T03:53:33.122733+0000","last_clean":"2024-09-21T03:53:33.122733+0000","last_became_active":"2024-09-21T03:53:13.831756+0000","last_became_peered":"2024-09-21T03:53:13.831756+0000","last_unstale":"2024-09-21T03:53:33.122733+0000","last_undegraded":"2024-09-21T03:53:33.122733+0000","last_fullsized":"2024-09-21T03:53:33.122733+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:43.941161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032362+0000","last_change":"2024-09-21T03:53:13.834085+0000","last_active":"2024-09-21T03:53:33.032362+0000","last_peered":"2024-09-21T03:53:33.032362+0000","last_clean":"2024-09-21T03:53:33.032362+0000","last_became_active":"2024-09-21T03:53:13.833668+0000","last_became_peered":"2024-09-21T03:53:13.833668+0000","last_unstale":"2024-09-21T03:53:33.032362+0000","last_undegraded":"2024-09-21T03:53:33.032362+0000","last_fullsized":"2024-09-21T03:53:33.032362+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:08:26.939873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035098+0000","last_change":"2024-09-21T03:53:13.836133+0000","last_active":"2024-09-21T03:53:33.035098+0000","last_peered":"2024-09-21T03:53:33.035098+0000","last_clean":"2024-09-21T03:53:33.035098+0000","last_became_active":"2024-09-21T03:53:13.835681+0000","last_became_peered":"2024-09-21T03:53:13.835681+0000","last_unstale":"2024-09-21T03:53:33.035098+0000","last_undegraded":"2024-09-21T03:53:33.035098+0000","last_fullsized":"2024-09-21T03:53:33.035098+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:02.691622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035103+0000","last_change":"2024-09-21T03:53:13.834069+0000","last_active":"2024-09-21T03:53:33.035103+0000","last_peered":"2024-09-21T03:53:33.035103+0000","last_clean":"2024-09-21T03:53:33.035103+0000","last_became_active":"2024-09-21T03:53:13.833714+0000","last_became_peered":"2024-09-21T03:53:13.833714+0000","last_unstale":"2024-09-21T03:53:33.035103+0000","last_undegraded":"2024-09-21T03:53:33.035103+0000","last_fullsized":"2024-09-21T03:53:33.035103+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:12.479790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.095236+0000","last_change":"2024-09-21T03:53:13.827788+0000","last_active":"2024-09-21T03:53:33.095236+0000","last_peered":"2024-09-21T03:53:33.095236+0000","last_clean":"2024-09-21T03:53:33.095236+0000","last_became_active":"2024-09-21T03:53:13.827461+0000","last_became_peered":"2024-09-21T03:53:13.827461+0000","last_unstale":"2024-09-21T03:53:33.095236+0000","last_undegraded":"2024-09-21T03:53:33.095236+0000","last_fullsized":"2024-09-21T03:53:33.095236+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:38.003243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034635+0000","last_change":"2024-09-21T03:53:13.836880+0000","last_active":"2024-09-21T03:53:33.034635+0000","last_peered":"2024-09-21T03:53:33.034635+0000","last_clean":"2024-09-21T03:53:33.034635+0000","last_became_active":"2024-09-21T03:53:13.836531+0000","last_became_peered":"2024-09-21T03:53:13.836531+0000","last_unstale":"2024-09-21T03:53:33.034635+0000","last_undegraded":"2024-09-21T03:53:33.034635+0000","last_fullsized":"2024-09-21T03:53:33.034635+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:52.825826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031827+0000","last_change":"2024-09-21T03:53:13.823160+0000","last_active":"2024-09-21T03:53:33.031827+0000","last_peered":"2024-09-21T03:53:33.031827+0000","last_clean":"2024-09-21T03:53:33.031827+0000","last_became_active":"2024-09-21T03:53:13.822076+0000","last_became_peered":"2024-09-21T03:53:13.822076+0000","last_unstale":"2024-09-21T03:53:33.031827+0000","last_undegraded":"2024-09-21T03:53:33.031827+0000","last_fullsized":"2024-09-21T03:53:33.031827+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:26.277249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032827+0000","last_change":"2024-09-21T03:53:13.831822+0000","last_active":"2024-09-21T03:53:33.032827+0000","last_peered":"2024-09-21T03:53:33.032827+0000","last_clean":"2024-09-21T03:53:33.032827+0000","last_became_active":"2024-09-21T03:53:13.831395+0000","last_became_peered":"2024-09-21T03:53:13.831395+0000","last_unstale":"2024-09-21T03:53:33.032827+0000","last_undegraded":"2024-09-21T03:53:33.032827+0000","last_fullsized":"2024-09-21T03:53:33.032827+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:48.541339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122588+0000","last_change":"2024-09-21T03:53:13.834576+0000","last_active":"2024-09-21T03:53:33.122588+0000","last_peered":"2024-09-21T03:53:33.122588+0000","last_clean":"2024-09-21T03:53:33.122588+0000","last_became_active":"2024-09-21T03:53:13.834229+0000","last_became_peered":"2024-09-21T03:53:13.834229+0000","last_unstale":"2024-09-21T03:53:33.122588+0000","last_undegraded":"2024-09-21T03:53:33.122588+0000","last_fullsized":"2024-09-21T03:53:33.122588+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:36.101399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040298+0000","last_change":"2024-09-21T03:53:13.824049+0000","last_active":"2024-09-21T03:53:33.040298+0000","last_peered":"2024-09-21T03:53:33.040298+0000","last_clean":"2024-09-21T03:53:33.040298+0000","last_became_active":"2024-09-21T03:53:13.823510+0000","last_became_peered":"2024-09-21T03:53:13.823510+0000","last_unstale":"2024-09-21T03:53:33.040298+0000","last_undegraded":"2024-09-21T03:53:33.040298+0000","last_fullsized":"2024-09-21T03:53:33.040298+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:36.615951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123804+0000","last_change":"2024-09-21T03:53:13.837327+0000","last_active":"2024-09-21T03:53:33.123804+0000","last_peered":"2024-09-21T03:53:33.123804+0000","last_clean":"2024-09-21T03:53:33.123804+0000","last_became_active":"2024-09-21T03:53:13.836940+0000","last_became_peered":"2024-09-21T03:53:13.836940+0000","last_unstale":"2024-09-21T03:53:33.123804+0000","last_undegraded":"2024-09-21T03:53:33.123804+0000","last_fullsized":"2024-09-21T03:53:33.123804+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:49.248838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.095260+0000","last_change":"2024-09-21T03:53:13.829540+0000","last_active":"2024-09-21T03:53:33.095260+0000","last_peered":"2024-09-21T03:53:33.095260+0000","last_clean":"2024-09-21T03:53:33.095260+0000","last_became_active":"2024-09-21T03:53:13.828953+0000","last_became_peered":"2024-09-21T03:53:13.828953+0000","last_unstale":"2024-09-21T03:53:33.095260+0000","last_undegraded":"2024-09-21T03:53:33.095260+0000","last_fullsized":"2024-09-21T03:53:33.095260+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:07.631226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034762+0000","last_change":"2024-09-21T03:53:13.835009+0000","last_active":"2024-09-21T03:53:33.034762+0000","last_peered":"2024-09-21T03:53:33.034762+0000","last_clean":"2024-09-21T03:53:33.034762+0000","last_became_active":"2024-09-21T03:53:13.834454+0000","last_became_peered":"2024-09-21T03:53:13.834454+0000","last_unstale":"2024-09-21T03:53:33.034762+0000","last_undegraded":"2024-09-21T03:53:33.034762+0000","last_fullsized":"2024-09-21T03:53:33.034762+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:34:06.114394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031624+0000","last_change":"2024-09-21T03:53:13.826846+0000","last_active":"2024-09-21T03:53:33.031624+0000","last_peered":"2024-09-21T03:53:33.031624+0000","last_clean":"2024-09-21T03:53:33.031624+0000","last_became_active":"2024-09-21T03:53:13.826460+0000","last_became_peered":"2024-09-21T03:53:13.826460+0000","last_unstale":"2024-09-21T03:53:33.031624+0000","last_undegraded":"2024-09-21T03:53:33.031624+0000","last_fullsized":"2024-09-21T03:53:33.031624+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:24.081091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123429+0000","last_change":"2024-09-21T03:53:13.837134+0000","last_active":"2024-09-21T03:53:33.123429+0000","last_peered":"2024-09-21T03:53:33.123429+0000","last_clean":"2024-09-21T03:53:33.123429+0000","last_became_active":"2024-09-21T03:53:13.836729+0000","last_became_peered":"2024-09-21T03:53:13.836729+0000","last_unstale":"2024-09-21T03:53:33.123429+0000","last_undegraded":"2024-09-21T03:53:33.123429+0000","last_fullsized":"2024-09-21T03:53:33.123429+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:08.677375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.094680+0000","last_change":"2024-09-21T03:53:13.838100+0000","last_active":"2024-09-21T03:53:33.094680+0000","last_peered":"2024-09-21T03:53:33.094680+0000","last_clean":"2024-09-21T03:53:33.094680+0000","last_became_active":"2024-09-21T03:53:13.833495+0000","last_became_peered":"2024-09-21T03:53:13.833495+0000","last_unstale":"2024-09-21T03:53:33.094680+0000","last_undegraded":"2024-09-21T03:53:33.094680+0000","last_fullsized":"2024-09-21T03:53:33.094680+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:52:00.705434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.095021+0000","last_change":"2024-09-21T03:53:13.835806+0000","last_active":"2024-09-21T03:53:33.095021+0000","last_peered":"2024-09-21T03:53:33.095021+0000","last_clean":"2024-09-21T03:53:33.095021+0000","last_became_active":"2024-09-21T03:53:13.835453+0000","last_became_peered":"2024-09-21T03:53:13.835453+0000","last_unstale":"2024-09-21T03:53:33.095021+0000","last_undegraded":"2024-09-21T03:53:33.095021+0000","last_fullsized":"2024-09-21T03:53:33.095021+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:56:16.296808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034530+0000","last_change":"2024-09-21T03:53:13.831171+0000","last_active":"2024-09-21T03:53:33.034530+0000","last_peered":"2024-09-21T03:53:33.034530+0000","last_clean":"2024-09-21T03:53:33.034530+0000","last_became_active":"2024-09-21T03:53:13.830734+0000","last_became_peered":"2024-09-21T03:53:13.830734+0000","last_unstale":"2024-09-21T03:53:33.034530+0000","last_undegraded":"2024-09-21T03:53:33.034530+0000","last_fullsized":"2024-09-21T03:53:33.034530+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:00:56.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123100+0000","last_change":"2024-09-21T03:53:13.820580+0000","last_active":"2024-09-21T03:53:33.123100+0000","last_peered":"2024-09-21T03:53:33.123100+0000","last_clean":"2024-09-21T03:53:33.123100+0000","last_became_active":"2024-09-21T03:53:13.820237+0000","last_became_peered":"2024-09-21T03:53:13.820237+0000","last_unstale":"2024-09-21T03:53:33.123100+0000","last_undegraded":"2024-09-21T03:53:33.123100+0000","last_fullsized":"2024-09-21T03:53:33.123100+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:15.067629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040549+0000","last_change":"2024-09-21T03:53:11.804667+0000","last_active":"2024-09-21T03:53:33.040549+0000","last_peered":"2024-09-21T03:53:33.040549+0000","last_clean":"2024-09-21T03:53:33.040549+0000","last_became_active":"2024-09-21T03:53:11.804231+0000","last_became_peered":"2024-09-21T03:53:11.804231+0000","last_unstale":"2024-09-21T03:53:33.040549+0000","last_undegraded":"2024-09-21T03:53:33.040549+0000","last_fullsized":"2024-09-21T03:53:33.040549+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:36.425699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040361+0000","last_change":"2024-09-21T03:53:13.831602+0000","last_active":"2024-09-21T03:53:33.040361+0000","last_peered":"2024-09-21T03:53:33.040361+0000","last_clean":"2024-09-21T03:53:33.040361+0000","last_became_active":"2024-09-21T03:53:13.831274+0000","last_became_peered":"2024-09-21T03:53:13.831274+0000","last_unstale":"2024-09-21T03:53:33.040361+0000","last_undegraded":"2024-09-21T03:53:33.040361+0000","last_fullsized":"2024-09-21T03:53:33.040361+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:33.603025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123276+0000","last_change":"2024-09-21T03:53:11.807722+0000","last_active":"2024-09-21T03:53:33.123276+0000","last_peered":"2024-09-21T03:53:33.123276+0000","last_clean":"2024-09-21T03:53:33.123276+0000","last_became_active":"2024-09-21T03:53:11.807294+0000","last_became_peered":"2024-09-21T03:53:11.807294+0000","last_unstale":"2024-09-21T03:53:33.123276+0000","last_undegraded":"2024-09-21T03:53:33.123276+0000","last_fullsized":"2024-09-21T03:53:33.123276+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:59.696572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031405+0000","last_change":"2024-09-21T03:53:11.803680+0000","last_active":"2024-09-21T03:53:33.031405+0000","last_peered":"2024-09-21T03:53:33.031405+0000","last_clean":"2024-09-21T03:53:33.031405+0000","last_became_active":"2024-09-21T03:53:11.803310+0000","last_became_peered":"2024-09-21T03:53:11.803310+0000","last_unstale":"2024-09-21T03:53:33.031405+0000","last_undegraded":"2024-09-21T03:53:33.031405+0000","last_fullsized":"2024-09-21T03:53:33.031405+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:25.276545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122501+0000","last_change":"2024-09-21T03:53:13.834847+0000","last_active":"2024-09-21T03:53:33.122501+0000","last_peered":"2024-09-21T03:53:33.122501+0000","last_clean":"2024-09-21T03:53:33.122501+0000","last_became_active":"2024-09-21T03:53:13.834448+0000","last_became_peered":"2024-09-21T03:53:13.834448+0000","last_unstale":"2024-09-21T03:53:33.122501+0000","last_undegraded":"2024-09-21T03:53:33.122501+0000","last_fullsized":"2024-09-21T03:53:33.122501+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:47:39.213364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040606+0000","last_change":"2024-09-21T03:53:11.807372+0000","last_active":"2024-09-21T03:53:33.040606+0000","last_peered":"2024-09-21T03:53:33.040606+0000","last_clean":"2024-09-21T03:53:33.040606+0000","last_became_active":"2024-09-21T03:53:11.807064+0000","last_became_peered":"2024-09-21T03:53:11.807064+0000","last_unstale":"2024-09-21T03:53:33.040606+0000","last_undegraded":"2024-09-21T03:53:33.040606+0000","last_fullsized":"2024-09-21T03:53:33.040606+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:00.743039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034954+0000","last_change":"2024-09-21T03:53:13.821169+0000","last_active":"2024-09-21T03:53:33.034954+0000","last_peered":"2024-09-21T03:53:33.034954+0000","last_clean":"2024-09-21T03:53:33.034954+0000","last_became_active":"2024-09-21T03:53:13.820810+0000","last_became_peered":"2024-09-21T03:53:13.820810+0000","last_unstale":"2024-09-21T03:53:33.034954+0000","last_undegraded":"2024-09-21T03:53:33.034954+0000","last_fullsized":"2024-09-21T03:53:33.034954+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:54.568383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124708+0000","last_change":"2024-09-21T03:53:11.805663+0000","last_active":"2024-09-21T03:53:33.124708+0000","last_peered":"2024-09-21T03:53:33.124708+0000","last_clean":"2024-09-21T03:53:33.124708+0000","last_became_active":"2024-09-21T03:53:11.805099+0000","last_became_peered":"2024-09-21T03:53:11.805099+0000","last_unstale":"2024-09-21T03:53:33.124708+0000","last_undegraded":"2024-09-21T03:53:33.124708+0000","last_fullsized":"2024-09-21T03:53:33.124708+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:47.306589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032728+0000","last_change":"2024-09-21T03:53:13.827745+0000","last_active":"2024-09-21T03:53:33.032728+0000","last_peered":"2024-09-21T03:53:33.032728+0000","last_clean":"2024-09-21T03:53:33.032728+0000","last_became_active":"2024-09-21T03:53:13.827229+0000","last_became_peered":"2024-09-21T03:53:13.827229+0000","last_unstale":"2024-09-21T03:53:33.032728+0000","last_undegraded":"2024-09-21T03:53:33.032728+0000","last_fullsized":"2024-09-21T03:53:33.032728+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:53.760919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036288+0000","last_change":"2024-09-21T03:53:11.803697+0000","last_active":"2024-09-21T03:53:33.036288+0000","last_peered":"2024-09-21T03:53:33.036288+0000","last_clean":"2024-09-21T03:53:33.036288+0000","last_became_active":"2024-09-21T03:53:11.801539+0000","last_became_peered":"2024-09-21T03:53:11.801539+0000","last_unstale":"2024-09-21T03:53:33.036288+0000","last_undegraded":"2024-09-21T03:53:33.036288+0000","last_fullsized":"2024-09-21T03:53:33.036288+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:53.096622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123637+0000","last_change":"2024-09-21T03:53:13.832771+0000","last_active":"2024-09-21T03:53:33.123637+0000","last_peered":"2024-09-21T03:53:33.123637+0000","last_clean":"2024-09-21T03:53:33.123637+0000","last_became_active":"2024-09-21T03:53:13.832414+0000","last_became_peered":"2024-09-21T03:53:13.832414+0000","last_unstale":"2024-09-21T03:53:33.123637+0000","last_undegraded":"2024-09-21T03:53:33.123637+0000","last_fullsized":"2024-09-21T03:53:33.123637+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:58:42.287731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.041017+0000","last_change":"2024-09-21T03:53:12.604482+0000","last_active":"2024-09-21T03:53:33.041017+0000","last_peered":"2024-09-21T03:53:33.041017+0000","last_clean":"2024-09-21T03:53:33.041017+0000","last_became_active":"2024-09-21T03:53:12.603973+0000","last_became_peered":"2024-09-21T03:53:12.603973+0000","last_unstale":"2024-09-21T03:53:33.041017+0000","last_undegraded":"2024-09-21T03:53:33.041017+0000","last_fullsized":"2024-09-21T03:53:33.041017+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:11.932329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032506+0000","last_change":"2024-09-21T03:53:13.842106+0000","last_active":"2024-09-21T03:53:33.032506+0000","last_peered":"2024-09-21T03:53:33.032506+0000","last_clean":"2024-09-21T03:53:33.032506+0000","last_became_active":"2024-09-21T03:53:13.841758+0000","last_became_peered":"2024-09-21T03:53:13.841758+0000","last_unstale":"2024-09-21T03:53:33.032506+0000","last_undegraded":"2024-09-21T03:53:33.032506+0000","last_fullsized":"2024-09-21T03:53:33.032506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:37.045045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'28","reported_seq":242,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:54:52.035282+0000","last_change":"2024-09-21T03:53:11.805385+0000","last_active":"2024-09-21T03:54:52.035282+0000","last_peered":"2024-09-21T03:54:52.035282+0000","last_clean":"2024-09-21T03:54:52.035282+0000","last_became_active":"2024-09-21T03:53:11.804958+0000","last_became_peered":"2024-09-21T03:53:11.804958+0000","last_unstale":"2024-09-21T03:54:52.035282+0000","last_undegraded":"2024-09-21T03:54:52.035282+0000","last_fullsized":"2024-09-21T03:54:52.035282+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:59.197216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66957,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":191,"num_read_kb":160,"num_write":28,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123691+0000","last_change":"2024-09-21T03:53:13.828095+0000","last_active":"2024-09-21T03:53:33.123691+0000","last_peered":"2024-09-21T03:53:33.123691+0000","last_clean":"2024-09-21T03:53:33.123691+0000","last_became_active":"2024-09-21T03:53:13.827761+0000","last_became_peered":"2024-09-21T03:53:13.827761+0000","last_unstale":"2024-09-21T03:53:33.123691+0000","last_undegraded":"2024-09-21T03:53:33.123691+0000","last_fullsized":"2024-09-21T03:53:33.123691+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:42:28.981463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.094939+0000","last_change":"2024-09-21T03:53:11.801611+0000","last_active":"2024-09-21T03:53:33.094939+0000","last_peered":"2024-09-21T03:53:33.094939+0000","last_clean":"2024-09-21T03:53:33.094939+0000","last_became_active":"2024-09-21T03:53:11.801185+0000","last_became_peered":"2024-09-21T03:53:11.801185+0000","last_unstale":"2024-09-21T03:53:33.094939+0000","last_undegraded":"2024-09-21T03:53:33.094939+0000","last_fullsized":"2024-09-21T03:53:33.094939+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:16.990963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031447+0000","last_change":"2024-09-21T03:53:13.827393+0000","last_active":"2024-09-21T03:53:33.031447+0000","last_peered":"2024-09-21T03:53:33.031447+0000","last_clean":"2024-09-21T03:53:33.031447+0000","last_became_active":"2024-09-21T03:53:13.826912+0000","last_became_peered":"2024-09-21T03:53:13.826912+0000","last_unstale":"2024-09-21T03:53:33.031447+0000","last_undegraded":"2024-09-21T03:53:33.031447+0000","last_fullsized":"2024-09-21T03:53:33.031447+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:52.313989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040555+0000","last_change":"2024-09-21T03:53:11.805437+0000","last_active":"2024-09-21T03:53:33.040555+0000","last_peered":"2024-09-21T03:53:33.040555+0000","last_clean":"2024-09-21T03:53:33.040555+0000","last_became_active":"2024-09-21T03:53:11.805048+0000","last_became_peered":"2024-09-21T03:53:11.805048+0000","last_unstale":"2024-09-21T03:53:33.040555+0000","last_undegraded":"2024-09-21T03:53:33.040555+0000","last_fullsized":"2024-09-21T03:53:33.040555+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:03.288694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036034+0000","last_change":"2024-09-21T03:53:13.836917+0000","last_active":"2024-09-21T03:53:33.036034+0000","last_peered":"2024-09-21T03:53:33.036034+0000","last_clean":"2024-09-21T03:53:33.036034+0000","last_became_active":"2024-09-21T03:53:13.836514+0000","last_became_peered":"2024-09-21T03:53:13.836514+0000","last_unstale":"2024-09-21T03:53:33.036034+0000","last_undegraded":"2024-09-21T03:53:33.036034+0000","last_fullsized":"2024-09-21T03:53:33.036034+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:17.512017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123559+0000","last_change":"2024-09-21T03:53:11.808403+0000","last_active":"2024-09-21T03:53:33.123559+0000","last_peered":"2024-09-21T03:53:33.123559+0000","last_clean":"2024-09-21T03:53:33.123559+0000","last_became_active":"2024-09-21T03:53:11.807895+0000","last_became_peered":"2024-09-21T03:53:11.807895+0000","last_unstale":"2024-09-21T03:53:33.123559+0000","last_undegraded":"2024-09-21T03:53:33.123559+0000","last_fullsized":"2024-09-21T03:53:33.123559+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:33.548683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.125777+0000","last_change":"2024-09-21T03:53:33.125556+0000","last_active":"2024-09-21T03:53:33.125777+0000","last_peered":"2024-09-21T03:53:33.125777+0000","last_clean":"2024-09-21T03:53:33.125777+0000","last_became_active":"2024-09-21T03:53:33.125084+0000","last_became_peered":"2024-09-21T03:53:33.125084+0000","last_unstale":"2024-09-21T03:53:33.125777+0000","last_undegraded":"2024-09-21T03:53:33.125777+0000","last_fullsized":"2024-09-21T03:53:33.125777+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:40:23.997329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'8","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123320+0000","last_change":"2024-09-21T03:53:12.605672+0000","last_active":"2024-09-21T03:53:33.123320+0000","last_peered":"2024-09-21T03:53:33.123320+0000","last_clean":"2024-09-21T03:53:33.123320+0000","last_became_active":"2024-09-21T03:53:12.604644+0000","last_became_peered":"2024-09-21T03:53:12.604644+0000","last_unstale":"2024-09-21T03:53:33.123320+0000","last_undegraded":"2024-09-21T03:53:33.123320+0000","last_fullsized":"2024-09-21T03:53:33.123320+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:44.810762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040395+0000","last_change":"2024-09-21T03:53:13.833861+0000","last_active":"2024-09-21T03:53:33.040395+0000","last_peered":"2024-09-21T03:53:33.040395+0000","last_clean":"2024-09-21T03:53:33.040395+0000","last_became_active":"2024-09-21T03:53:13.832900+0000","last_became_peered":"2024-09-21T03:53:13.832900+0000","last_unstale":"2024-09-21T03:53:33.040395+0000","last_undegraded":"2024-09-21T03:53:33.040395+0000","last_fullsized":"2024-09-21T03:53:33.040395+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:12.047171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124020+0000","last_change":"2024-09-21T03:53:11.799844+0000","last_active":"2024-09-21T03:53:33.124020+0000","last_peered":"2024-09-21T03:53:33.124020+0000","last_clean":"2024-09-21T03:53:33.124020+0000","last_became_active":"2024-09-21T03:53:11.799412+0000","last_became_peered":"2024-09-21T03:53:11.799412+0000","last_unstale":"2024-09-21T03:53:33.124020+0000","last_undegraded":"2024-09-21T03:53:33.124020+0000","last_fullsized":"2024-09-21T03:53:33.124020+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:49.826500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034751+0000","last_change":"2024-09-21T03:53:13.836690+0000","last_active":"2024-09-21T03:53:33.034751+0000","last_peered":"2024-09-21T03:53:33.034751+0000","last_clean":"2024-09-21T03:53:33.034751+0000","last_became_active":"2024-09-21T03:53:13.836337+0000","last_became_peered":"2024-09-21T03:53:13.836337+0000","last_unstale":"2024-09-21T03:53:33.034751+0000","last_undegraded":"2024-09-21T03:53:33.034751+0000","last_fullsized":"2024-09-21T03:53:33.034751+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:15.999869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031625+0000","last_change":"2024-09-21T03:53:11.799597+0000","last_active":"2024-09-21T03:53:33.031625+0000","last_peered":"2024-09-21T03:53:33.031625+0000","last_clean":"2024-09-21T03:53:33.031625+0000","last_became_active":"2024-09-21T03:53:11.799175+0000","last_became_peered":"2024-09-21T03:53:11.799175+0000","last_unstale":"2024-09-21T03:53:33.031625+0000","last_undegraded":"2024-09-21T03:53:33.031625+0000","last_fullsized":"2024-09-21T03:53:33.031625+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:41.668587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036592+0000","last_change":"2024-09-21T03:53:13.831228+0000","last_active":"2024-09-21T03:53:33.036592+0000","last_peered":"2024-09-21T03:53:33.036592+0000","last_clean":"2024-09-21T03:53:33.036592+0000","last_became_active":"2024-09-21T03:53:13.830880+0000","last_became_peered":"2024-09-21T03:53:13.830880+0000","last_unstale":"2024-09-21T03:53:33.036592+0000","last_undegraded":"2024-09-21T03:53:33.036592+0000","last_fullsized":"2024-09-21T03:53:33.036592+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:45.770622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.041069+0000","last_change":"2024-09-21T03:53:11.803560+0000","last_active":"2024-09-21T03:53:33.041069+0000","last_peered":"2024-09-21T03:53:33.041069+0000","last_clean":"2024-09-21T03:53:33.041069+0000","last_became_active":"2024-09-21T03:53:11.803090+0000","last_became_peered":"2024-09-21T03:53:11.803090+0000","last_unstale":"2024-09-21T03:53:33.041069+0000","last_undegraded":"2024-09-21T03:53:33.041069+0000","last_fullsized":"2024-09-21T03:53:33.041069+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:23.993694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036373+0000","last_change":"2024-09-21T03:53:13.825907+0000","last_active":"2024-09-21T03:53:33.036373+0000","last_peered":"2024-09-21T03:53:33.036373+0000","last_clean":"2024-09-21T03:53:33.036373+0000","last_became_active":"2024-09-21T03:53:13.825485+0000","last_became_peered":"2024-09-21T03:53:13.825485+0000","last_unstale":"2024-09-21T03:53:33.036373+0000","last_undegraded":"2024-09-21T03:53:33.036373+0000","last_fullsized":"2024-09-21T03:53:33.036373+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:39.166215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.095338+0000","last_change":"2024-09-21T03:53:12.605947+0000","last_active":"2024-09-21T03:53:33.095338+0000","last_peered":"2024-09-21T03:53:33.095338+0000","last_clean":"2024-09-21T03:53:33.095338+0000","last_became_active":"2024-09-21T03:53:12.604516+0000","last_became_peered":"2024-09-21T03:53:12.604516+0000","last_unstale":"2024-09-21T03:53:33.095338+0000","last_undegraded":"2024-09-21T03:53:33.095338+0000","last_fullsized":"2024-09-21T03:53:33.095338+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:42.500174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036503+0000","last_change":"2024-09-21T03:53:13.834108+0000","last_active":"2024-09-21T03:53:33.036503+0000","last_peered":"2024-09-21T03:53:33.036503+0000","last_clean":"2024-09-21T03:53:33.036503+0000","last_became_active":"2024-09-21T03:53:13.833734+0000","last_became_peered":"2024-09-21T03:53:13.833734+0000","last_unstale":"2024-09-21T03:53:33.036503+0000","last_undegraded":"2024-09-21T03:53:33.036503+0000","last_fullsized":"2024-09-21T03:53:33.036503+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:39.032450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":98,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036220+0000","last_change":"2024-09-21T03:51:59.139085+0000","last_active":"2024-09-21T03:53:33.036220+0000","last_peered":"2024-09-21T03:53:33.036220+0000","last_clean":"2024-09-21T03:53:33.036220+0000","last_became_active":"2024-09-21T03:51:59.026450+0000","last_became_peered":"2024-09-21T03:51:59.026450+0000","last_unstale":"2024-09-21T03:53:33.036220+0000","last_undegraded":"2024-09-21T03:53:33.036220+0000","last_fullsized":"2024-09-21T03:53:33.036220+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:48:31.139457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:48:31.139457+0000","last_clean_scrub_stamp":"2024-09-21T03:48:31.139457+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:54.047170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123454+0000","last_change":"2024-09-21T03:53:11.805792+0000","last_active":"2024-09-21T03:53:33.123454+0000","last_peered":"2024-09-21T03:53:33.123454+0000","last_clean":"2024-09-21T03:53:33.123454+0000","last_became_active":"2024-09-21T03:53:11.805375+0000","last_became_peered":"2024-09-21T03:53:11.805375+0000","last_unstale":"2024-09-21T03:53:33.123454+0000","last_undegraded":"2024-09-21T03:53:33.123454+0000","last_fullsized":"2024-09-21T03:53:33.123454+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:55.466187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122971+0000","last_change":"2024-09-21T03:53:13.835211+0000","last_active":"2024-09-21T03:53:33.122971+0000","last_peered":"2024-09-21T03:53:33.122971+0000","last_clean":"2024-09-21T03:53:33.122971+0000","last_became_active":"2024-09-21T03:53:13.833649+0000","last_became_peered":"2024-09-21T03:53:13.833649+0000","last_unstale":"2024-09-21T03:53:33.122971+0000","last_undegraded":"2024-09-21T03:53:33.122971+0000","last_fullsized":"2024-09-21T03:53:33.122971+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:57.962287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035996+0000","last_change":"2024-09-21T03:53:11.801670+0000","last_active":"2024-09-21T03:53:33.035996+0000","last_peered":"2024-09-21T03:53:33.035996+0000","last_clean":"2024-09-21T03:53:33.035996+0000","last_became_active":"2024-09-21T03:53:11.801291+0000","last_became_peered":"2024-09-21T03:53:11.801291+0000","last_unstale":"2024-09-21T03:53:33.035996+0000","last_undegraded":"2024-09-21T03:53:33.035996+0000","last_fullsized":"2024-09-21T03:53:33.035996+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:37.450592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.096813+0000","last_change":"2024-09-21T03:53:33.096727+0000","last_active":"2024-09-21T03:53:33.096813+0000","last_peered":"2024-09-21T03:53:33.096813+0000","last_clean":"2024-09-21T03:53:33.096813+0000","last_became_active":"2024-09-21T03:53:33.096234+0000","last_became_peered":"2024-09-21T03:53:33.096234+0000","last_unstale":"2024-09-21T03:53:33.096813+0000","last_undegraded":"2024-09-21T03:53:33.096813+0000","last_fullsized":"2024-09-21T03:53:33.096813+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:56:24.375992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031550+0000","last_change":"2024-09-21T03:53:12.604170+0000","last_active":"2024-09-21T03:53:33.031550+0000","last_peered":"2024-09-21T03:53:33.031550+0000","last_clean":"2024-09-21T03:53:33.031550+0000","last_became_active":"2024-09-21T03:53:12.603765+0000","last_became_peered":"2024-09-21T03:53:12.603765+0000","last_unstale":"2024-09-21T03:53:33.031550+0000","last_undegraded":"2024-09-21T03:53:33.031550+0000","last_fullsized":"2024-09-21T03:53:33.031550+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:08.606037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.125077+0000","last_change":"2024-09-21T03:53:33.124969+0000","last_active":"2024-09-21T03:53:33.125077+0000","last_peered":"2024-09-21T03:53:33.125077+0000","last_clean":"2024-09-21T03:53:33.125077+0000","last_became_active":"2024-09-21T03:53:33.124496+0000","last_became_peered":"2024-09-21T03:53:33.124496+0000","last_unstale":"2024-09-21T03:53:33.125077+0000","last_undegraded":"2024-09-21T03:53:33.125077+0000","last_fullsized":"2024-09-21T03:53:33.125077+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:56.730146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036128+0000","last_change":"2024-09-21T03:53:11.803316+0000","last_active":"2024-09-21T03:53:33.036128+0000","last_peered":"2024-09-21T03:53:33.036128+0000","last_clean":"2024-09-21T03:53:33.036128+0000","last_became_active":"2024-09-21T03:53:11.801976+0000","last_became_peered":"2024-09-21T03:53:11.801976+0000","last_unstale":"2024-09-21T03:53:33.036128+0000","last_undegraded":"2024-09-21T03:53:33.036128+0000","last_fullsized":"2024-09-21T03:53:33.036128+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:43.596037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124177+0000","last_change":"2024-09-21T03:53:13.838006+0000","last_active":"2024-09-21T03:53:33.124177+0000","last_peered":"2024-09-21T03:53:33.124177+0000","last_clean":"2024-09-21T03:53:33.124177+0000","last_became_active":"2024-09-21T03:53:13.835903+0000","last_became_peered":"2024-09-21T03:53:13.835903+0000","last_unstale":"2024-09-21T03:53:33.124177+0000","last_undegraded":"2024-09-21T03:53:33.124177+0000","last_fullsized":"2024-09-21T03:53:33.124177+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:54:56.730044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124836+0000","last_change":"2024-09-21T03:53:33.124720+0000","last_active":"2024-09-21T03:53:33.124836+0000","last_peered":"2024-09-21T03:53:33.124836+0000","last_clean":"2024-09-21T03:53:33.124836+0000","last_became_active":"2024-09-21T03:53:33.124232+0000","last_became_peered":"2024-09-21T03:53:33.124232+0000","last_unstale":"2024-09-21T03:53:33.124836+0000","last_undegraded":"2024-09-21T03:53:33.124836+0000","last_fullsized":"2024-09-21T03:53:33.124836+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:23.810493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124631+0000","last_change":"2024-09-21T03:53:13.827805+0000","last_active":"2024-09-21T03:53:33.124631+0000","last_peered":"2024-09-21T03:53:33.124631+0000","last_clean":"2024-09-21T03:53:33.124631+0000","last_became_active":"2024-09-21T03:53:13.827368+0000","last_became_peered":"2024-09-21T03:53:13.827368+0000","last_unstale":"2024-09-21T03:53:33.124631+0000","last_undegraded":"2024-09-21T03:53:33.124631+0000","last_fullsized":"2024-09-21T03:53:33.124631+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:24.539396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123881+0000","last_change":"2024-09-21T03:53:12.605032+0000","last_active":"2024-09-21T03:53:33.123881+0000","last_peered":"2024-09-21T03:53:33.123881+0000","last_clean":"2024-09-21T03:53:33.123881+0000","last_became_active":"2024-09-21T03:53:12.604561+0000","last_became_peered":"2024-09-21T03:53:12.604561+0000","last_unstale":"2024-09-21T03:53:33.123881+0000","last_undegraded":"2024-09-21T03:53:33.123881+0000","last_fullsized":"2024-09-21T03:53:33.123881+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:20.361768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031744+0000","last_change":"2024-09-21T03:53:13.821539+0000","last_active":"2024-09-21T03:53:33.031744+0000","last_peered":"2024-09-21T03:53:33.031744+0000","last_clean":"2024-09-21T03:53:33.031744+0000","last_became_active":"2024-09-21T03:53:13.821196+0000","last_became_peered":"2024-09-21T03:53:13.821196+0000","last_unstale":"2024-09-21T03:53:33.031744+0000","last_undegraded":"2024-09-21T03:53:33.031744+0000","last_fullsized":"2024-09-21T03:53:33.031744+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:00.627993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'10","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:36.828012+0000","last_change":"2024-09-21T03:53:11.799669+0000","last_active":"2024-09-21T03:53:36.828012+0000","last_peered":"2024-09-21T03:53:36.828012+0000","last_clean":"2024-09-21T03:53:36.828012+0000","last_became_active":"2024-09-21T03:53:11.799355+0000","last_became_peered":"2024-09-21T03:53:11.799355+0000","last_unstale":"2024-09-21T03:53:36.828012+0000","last_undegraded":"2024-09-21T03:53:36.828012+0000","last_fullsized":"2024-09-21T03:53:36.828012+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:33.032206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123797+0000","last_change":"2024-09-21T03:53:13.828551+0000","last_active":"2024-09-21T03:53:33.123797+0000","last_peered":"2024-09-21T03:53:33.123797+0000","last_clean":"2024-09-21T03:53:33.123797+0000","last_became_active":"2024-09-21T03:53:13.828185+0000","last_became_peered":"2024-09-21T03:53:13.828185+0000","last_unstale":"2024-09-21T03:53:33.123797+0000","last_undegraded":"2024-09-21T03:53:33.123797+0000","last_fullsized":"2024-09-21T03:53:33.123797+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:31.852755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124078+0000","last_change":"2024-09-21T03:53:12.279823+0000","last_active":"2024-09-21T03:53:33.124078+0000","last_peered":"2024-09-21T03:53:33.124078+0000","last_clean":"2024-09-21T03:53:33.124078+0000","last_became_active":"2024-09-21T03:53:12.279384+0000","last_became_peered":"2024-09-21T03:53:12.279384+0000","last_unstale":"2024-09-21T03:53:33.124078+0000","last_undegraded":"2024-09-21T03:53:33.124078+0000","last_fullsized":"2024-09-21T03:53:33.124078+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:42.568690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123319+0000","last_change":"2024-09-21T03:53:13.831041+0000","last_active":"2024-09-21T03:53:33.123319+0000","last_peered":"2024-09-21T03:53:33.123319+0000","last_clean":"2024-09-21T03:53:33.123319+0000","last_became_active":"2024-09-21T03:53:13.830654+0000","last_became_peered":"2024-09-21T03:53:13.830654+0000","last_unstale":"2024-09-21T03:53:33.123319+0000","last_undegraded":"2024-09-21T03:53:33.123319+0000","last_fullsized":"2024-09-21T03:53:33.123319+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:04.815719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032478+0000","last_change":"2024-09-21T03:53:12.604949+0000","last_active":"2024-09-21T03:53:33.032478+0000","last_peered":"2024-09-21T03:53:33.032478+0000","last_clean":"2024-09-21T03:53:33.032478+0000","last_became_active":"2024-09-21T03:53:12.604516+0000","last_became_peered":"2024-09-21T03:53:12.604516+0000","last_unstale":"2024-09-21T03:53:33.032478+0000","last_undegraded":"2024-09-21T03:53:33.032478+0000","last_fullsized":"2024-09-21T03:53:33.032478+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:33.964125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123050+0000","last_change":"2024-09-21T03:53:13.834813+0000","last_active":"2024-09-21T03:53:33.123050+0000","last_peered":"2024-09-21T03:53:33.123050+0000","last_clean":"2024-09-21T03:53:33.123050+0000","last_became_active":"2024-09-21T03:53:13.834436+0000","last_became_peered":"2024-09-21T03:53:13.834436+0000","last_unstale":"2024-09-21T03:53:33.123050+0000","last_undegraded":"2024-09-21T03:53:33.123050+0000","last_fullsized":"2024-09-21T03:53:33.123050+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:42:40.990668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122665+0000","last_change":"2024-09-21T03:53:11.801828+0000","last_active":"2024-09-21T03:53:33.122665+0000","last_peered":"2024-09-21T03:53:33.122665+0000","last_clean":"2024-09-21T03:53:33.122665+0000","last_became_active":"2024-09-21T03:53:11.800969+0000","last_became_peered":"2024-09-21T03:53:11.800969+0000","last_unstale":"2024-09-21T03:53:33.122665+0000","last_undegraded":"2024-09-21T03:53:33.122665+0000","last_fullsized":"2024-09-21T03:53:33.122665+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:36.117523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034772+0000","last_change":"2024-09-21T03:53:13.835393+0000","last_active":"2024-09-21T03:53:33.034772+0000","last_peered":"2024-09-21T03:53:33.034772+0000","last_clean":"2024-09-21T03:53:33.034772+0000","last_became_active":"2024-09-21T03:53:13.834541+0000","last_became_peered":"2024-09-21T03:53:13.834541+0000","last_unstale":"2024-09-21T03:53:33.034772+0000","last_undegraded":"2024-09-21T03:53:33.034772+0000","last_fullsized":"2024-09-21T03:53:33.034772+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:40.140004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.125328+0000","last_change":"2024-09-21T03:53:33.124524+0000","last_active":"2024-09-21T03:53:33.125328+0000","last_peered":"2024-09-21T03:53:33.125328+0000","last_clean":"2024-09-21T03:53:33.125328+0000","last_became_active":"2024-09-21T03:53:33.123945+0000","last_became_peered":"2024-09-21T03:53:33.123945+0000","last_unstale":"2024-09-21T03:53:33.125328+0000","last_undegraded":"2024-09-21T03:53:33.125328+0000","last_fullsized":"2024-09-21T03:53:33.125328+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:50.967123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122926+0000","last_change":"2024-09-21T03:53:13.832597+0000","last_active":"2024-09-21T03:53:33.122926+0000","last_peered":"2024-09-21T03:53:33.122926+0000","last_clean":"2024-09-21T03:53:33.122926+0000","last_became_active":"2024-09-21T03:53:13.832237+0000","last_became_peered":"2024-09-21T03:53:13.832237+0000","last_unstale":"2024-09-21T03:53:33.122926+0000","last_undegraded":"2024-09-21T03:53:33.122926+0000","last_fullsized":"2024-09-21T03:53:33.122926+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:31.907478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123185+0000","last_change":"2024-09-21T03:53:11.804875+0000","last_active":"2024-09-21T03:53:33.123185+0000","last_peered":"2024-09-21T03:53:33.123185+0000","last_clean":"2024-09-21T03:53:33.123185+0000","last_became_active":"2024-09-21T03:53:11.804320+0000","last_became_peered":"2024-09-21T03:53:11.804320+0000","last_unstale":"2024-09-21T03:53:33.123185+0000","last_undegraded":"2024-09-21T03:53:33.123185+0000","last_fullsized":"2024-09-21T03:53:33.123185+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:37:58.747573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035965+0000","last_change":"2024-09-21T03:53:13.837804+0000","last_active":"2024-09-21T03:53:33.035965+0000","last_peered":"2024-09-21T03:53:33.035965+0000","last_clean":"2024-09-21T03:53:33.035965+0000","last_became_active":"2024-09-21T03:53:13.837440+0000","last_became_peered":"2024-09-21T03:53:13.837440+0000","last_unstale":"2024-09-21T03:53:33.035965+0000","last_undegraded":"2024-09-21T03:53:33.035965+0000","last_fullsized":"2024-09-21T03:53:33.035965+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:15.471544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040923+0000","last_change":"2024-09-21T03:53:13.833231+0000","last_active":"2024-09-21T03:53:33.040923+0000","last_peered":"2024-09-21T03:53:33.040923+0000","last_clean":"2024-09-21T03:53:33.040923+0000","last_became_active":"2024-09-21T03:53:13.832908+0000","last_became_peered":"2024-09-21T03:53:13.832908+0000","last_unstale":"2024-09-21T03:53:33.040923+0000","last_undegraded":"2024-09-21T03:53:33.040923+0000","last_fullsized":"2024-09-21T03:53:33.040923+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:40.191231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123570+0000","last_change":"2024-09-21T03:53:11.802237+0000","last_active":"2024-09-21T03:53:33.123570+0000","last_peered":"2024-09-21T03:53:33.123570+0000","last_clean":"2024-09-21T03:53:33.123570+0000","last_became_active":"2024-09-21T03:53:11.801845+0000","last_became_peered":"2024-09-21T03:53:11.801845+0000","last_unstale":"2024-09-21T03:53:33.123570+0000","last_undegraded":"2024-09-21T03:53:33.123570+0000","last_fullsized":"2024-09-21T03:53:33.123570+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:34.714908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032488+0000","last_change":"2024-09-21T03:53:13.831495+0000","last_active":"2024-09-21T03:53:33.032488+0000","last_peered":"2024-09-21T03:53:33.032488+0000","last_clean":"2024-09-21T03:53:33.032488+0000","last_became_active":"2024-09-21T03:53:13.831107+0000","last_became_peered":"2024-09-21T03:53:13.831107+0000","last_unstale":"2024-09-21T03:53:33.032488+0000","last_undegraded":"2024-09-21T03:53:33.032488+0000","last_fullsized":"2024-09-21T03:53:33.032488+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:12:09.751036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123850+0000","last_change":"2024-09-21T03:53:11.805910+0000","last_active":"2024-09-21T03:53:33.123850+0000","last_peered":"2024-09-21T03:53:33.123850+0000","last_clean":"2024-09-21T03:53:33.123850+0000","last_became_active":"2024-09-21T03:53:11.805461+0000","last_became_peered":"2024-09-21T03:53:11.805461+0000","last_unstale":"2024-09-21T03:53:33.123850+0000","last_undegraded":"2024-09-21T03:53:33.123850+0000","last_fullsized":"2024-09-21T03:53:33.123850+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:36:56.132055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123607+0000","last_change":"2024-09-21T03:53:13.834930+0000","last_active":"2024-09-21T03:53:33.123607+0000","last_peered":"2024-09-21T03:53:33.123607+0000","last_clean":"2024-09-21T03:53:33.123607+0000","last_became_active":"2024-09-21T03:53:13.834368+0000","last_became_peered":"2024-09-21T03:53:13.834368+0000","last_unstale":"2024-09-21T03:53:33.123607+0000","last_undegraded":"2024-09-21T03:53:33.123607+0000","last_fullsized":"2024-09-21T03:53:33.123607+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:53.798811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123728+0000","last_change":"2024-09-21T03:53:12.604827+0000","last_active":"2024-09-21T03:53:33.123728+0000","last_peered":"2024-09-21T03:53:33.123728+0000","last_clean":"2024-09-21T03:53:33.123728+0000","last_became_active":"2024-09-21T03:53:12.604406+0000","last_became_peered":"2024-09-21T03:53:12.604406+0000","last_unstale":"2024-09-21T03:53:33.123728+0000","last_undegraded":"2024-09-21T03:53:33.123728+0000","last_fullsized":"2024-09-21T03:53:33.123728+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:03:12.942354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123562+0000","last_change":"2024-09-21T03:53:13.830482+0000","last_active":"2024-09-21T03:53:33.123562+0000","last_peered":"2024-09-21T03:53:33.123562+0000","last_clean":"2024-09-21T03:53:33.123562+0000","last_became_active":"2024-09-21T03:53:13.829970+0000","last_became_peered":"2024-09-21T03:53:13.829970+0000","last_unstale":"2024-09-21T03:53:33.123562+0000","last_undegraded":"2024-09-21T03:53:33.123562+0000","last_fullsized":"2024-09-21T03:53:33.123562+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:21.617459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035213+0000","last_change":"2024-09-21T03:53:11.801931+0000","last_active":"2024-09-21T03:53:33.035213+0000","last_peered":"2024-09-21T03:53:33.035213+0000","last_clean":"2024-09-21T03:53:33.035213+0000","last_became_active":"2024-09-21T03:53:11.801587+0000","last_became_peered":"2024-09-21T03:53:11.801587+0000","last_unstale":"2024-09-21T03:53:33.035213+0000","last_undegraded":"2024-09-21T03:53:33.035213+0000","last_fullsized":"2024-09-21T03:53:33.035213+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:47.329060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67755,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":197,"num_read_kb":166,"num_write":85,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":203573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70,"ondisk_log_size":70,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285514,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743458,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":831488,"data_stored":416577,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939687,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":1074213,"data_compressed":42053,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103212,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":835584,"data_stored":417159,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299441,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":839680,"data_stored":417181,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462967,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":888832,"data_stored":1007644,"data_compressed":42053,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626492,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":835584,"data_stored":416694,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822721,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":897024,"data_stored":1007244,"data_compressed":42053,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986246,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":835584,"data_stored":416599,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182473,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36172,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708980,"statfs":{"total":95995035648,"available":95957995520,"internally_reserved":0,"allocated":847872,"data_stored":416915,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378704,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":483568,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542230,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":483842,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705755,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":835584,"data_stored":416667,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34678,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34678,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34678,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36296,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36296,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36296,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36296,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36296,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":67265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":66991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":67151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:54:57.876 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:54:58.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.024+0000 7fcdf359d640 1 -- 172.21.15.46:0/2994231528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdec10dba0 msgr2=0x7fcdec110090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:58.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.024+0000 7fcdf359d640 1 --2- 172.21.15.46:0/2994231528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdec10dba0 0x7fcdec110090 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fcde4009ca0 tx=0x7fcde402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:54:58.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.024+0000 7fcdf359d640 1 -- 172.21.15.46:0/2994231528 shutdown_connections 2024-09-21T03:54:58.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.024+0000 7fcdf359d640 1 --2- 172.21.15.46:0/2994231528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdec10dba0 0x7fcdec110090 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:58.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.024+0000 7fcdf359d640 1 --2- 172.21.15.46:0/2994231528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdec105090 0x7fcdec10d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:58.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.024+0000 7fcdf359d640 1 --2- 172.21.15.46:0/2994231528 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdec104740 0x7fcdec104b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:58.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.024+0000 7fcdf359d640 1 -- 172.21.15.46:0/2994231528 >> 172.21.15.46:0/2994231528 conn(0x7fcdec0fe210 msgr2=0x7fcdec100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:58.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.024+0000 7fcdf359d640 1 -- 172.21.15.46:0/2994231528 shutdown_connections 2024-09-21T03:54:58.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.024+0000 7fcdf359d640 1 -- 172.21.15.46:0/2994231528 wait complete. 2024-09-21T03:54:58.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.025+0000 7fcdf359d640 1 Processor -- start 2024-09-21T03:54:58.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.025+0000 7fcdf359d640 1 -- start start 2024-09-21T03:54:58.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.025+0000 7fcdf359d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdec104740 0x7fcdec19a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:58.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.025+0000 7fcdf359d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdec105090 0x7fcdec19a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:58.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.025+0000 7fcdf359d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdec10dba0 0x7fcdec19fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:58.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.025+0000 7fcdf359d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fcdec113830 con 0x7fcdec104740 2024-09-21T03:54:58.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.025+0000 7fcdf359d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcdec1136b0 con 0x7fcdec10dba0 2024-09-21T03:54:58.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.025+0000 7fcdf359d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcdec1139b0 con 0x7fcdec105090 2024-09-21T03:54:58.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.025+0000 7fcdf259b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdec104740 0x7fcdec19a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:58.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.025+0000 7fcdf259b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdec104740 0x7fcdec19a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58696/0 (socket says 172.21.15.46:58696) 2024-09-21T03:54:58.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.025+0000 7fcdf259b640 1 -- 172.21.15.46:0/325836407 learned_addr learned my addr 172.21.15.46:0/325836407 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:58.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.025+0000 7fcdf1d9a640 1 --2- 172.21.15.46:0/325836407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdec105090 0x7fcdec19a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:58.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.025+0000 7fcdf2d9c640 1 --2- 172.21.15.46:0/325836407 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdec10dba0 0x7fcdec19fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:58.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.025+0000 7fcdf259b640 1 -- 172.21.15.46:0/325836407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdec105090 msgr2=0x7fcdec19a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:58.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.025+0000 7fcdf259b640 1 --2- 172.21.15.46:0/325836407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdec105090 0x7fcdec19a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:58.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.025+0000 7fcdf259b640 1 -- 172.21.15.46:0/325836407 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdec10dba0 msgr2=0x7fcdec19fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:58.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.025+0000 7fcdf259b640 1 --2- 172.21.15.46:0/325836407 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdec10dba0 0x7fcdec19fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:58.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.025+0000 7fcdf259b640 1 -- 172.21.15.46:0/325836407 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdec1a0140 con 0x7fcdec104740 2024-09-21T03:54:58.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.025+0000 7fcdf2d9c640 1 --2- 172.21.15.46:0/325836407 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdec10dba0 0x7fcdec19fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:54:58.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.026+0000 7fcdf259b640 1 --2- 172.21.15.46:0/325836407 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdec104740 0x7fcdec19a210 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fcde800d950 tx=0x7fcde800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:58.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.026+0000 7fcde37fe640 1 -- 172.21.15.46:0/325836407 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde8017070 con 0x7fcdec104740 2024-09-21T03:54:58.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.026+0000 7fcde37fe640 1 -- 172.21.15.46:0/325836407 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcde8009c30 con 0x7fcdec104740 2024-09-21T03:54:58.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.026+0000 7fcdf359d640 1 -- 172.21.15.46:0/325836407 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdec1a0430 con 0x7fcdec104740 2024-09-21T03:54:58.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.026+0000 7fcde37fe640 1 -- 172.21.15.46:0/325836407 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde800f620 con 0x7fcdec104740 2024-09-21T03:54:58.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.026+0000 7fcdf359d640 1 -- 172.21.15.46:0/325836407 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdec1a6bc0 con 0x7fcdec104740 2024-09-21T03:54:58.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.027+0000 7fcdf359d640 1 -- 172.21.15.46:0/325836407 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdec104b50 con 0x7fcdec104740 2024-09-21T03:54:58.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.028+0000 7fcde37fe640 1 -- 172.21.15.46:0/325836407 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fcde8010460 con 0x7fcdec104740 2024-09-21T03:54:58.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.029+0000 7fcde37fe640 1 --2- 172.21.15.46:0/325836407 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fcdd80b65f0 0x7fcdd80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:58.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.029+0000 7fcde37fe640 1 -- 172.21.15.46:0/325836407 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fcde80e7290 con 0x7fcdec104740 2024-09-21T03:54:58.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.029+0000 7fcdf1d9a640 1 --2- 172.21.15.46:0/325836407 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fcdd80b65f0 0x7fcdd80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:58.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.030+0000 7fcdf1d9a640 1 --2- 172.21.15.46:0/325836407 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fcdd80b65f0 0x7fcdd80b8b00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fcdec0ff170 tx=0x7fcddc005c60 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:58.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.033+0000 7fcde37fe640 1 -- 172.21.15.46:0/325836407 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcde80ad940 con 0x7fcdec104740 2024-09-21T03:54:58.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:57 smithi105 ceph-mon[34773]: pgmap v317: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:54:58.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:57 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/1352370494' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:54:58.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:57 smithi162 ceph-mon[35071]: pgmap v317: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:54:58.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:57 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/1352370494' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:54:58.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.218+0000 7fcdf359d640 1 -- 172.21.15.46:0/325836407 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcdec107d30 con 0x7fcdd80b65f0 2024-09-21T03:54:58.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.222+0000 7fcde37fe640 1 -- 172.21.15.46:0/325836407 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258885 (secure 0 0 0) 0x7fcdec107d30 con 0x7fcdd80b65f0 2024-09-21T03:54:58.226 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:54:58.231 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-09-21T03:54:58.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.225+0000 7fcdf359d640 1 -- 172.21.15.46:0/325836407 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fcdd80b65f0 msgr2=0x7fcdd80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:58.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.225+0000 7fcdf359d640 1 --2- 172.21.15.46:0/325836407 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fcdd80b65f0 0x7fcdd80b8b00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fcdec0ff170 tx=0x7fcddc005c60 comp rx=0 tx=0).stop 2024-09-21T03:54:58.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.225+0000 7fcdf359d640 1 -- 172.21.15.46:0/325836407 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdec104740 msgr2=0x7fcdec19a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:58.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.225+0000 7fcdf359d640 1 --2- 172.21.15.46:0/325836407 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdec104740 0x7fcdec19a210 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fcde800d950 tx=0x7fcde800de10 comp rx=0 tx=0).stop 2024-09-21T03:54:58.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.225+0000 7fcdf359d640 1 -- 172.21.15.46:0/325836407 shutdown_connections 2024-09-21T03:54:58.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.225+0000 7fcdf359d640 1 --2- 172.21.15.46:0/325836407 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdec10dba0 0x7fcdec19fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:58.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.225+0000 7fcdf359d640 1 --2- 172.21.15.46:0/325836407 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fcdd80b65f0 0x7fcdd80b8b00 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:58.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.226+0000 7fcdf359d640 1 --2- 172.21.15.46:0/325836407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdec105090 0x7fcdec19a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:58.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.226+0000 7fcdf359d640 1 --2- 172.21.15.46:0/325836407 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdec104740 0x7fcdec19a210 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:58.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.226+0000 7fcdf359d640 1 -- 172.21.15.46:0/325836407 >> 172.21.15.46:0/325836407 conn(0x7fcdec0fe210 msgr2=0x7fcdec107620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:58.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.226+0000 7fcdf359d640 1 -- 172.21.15.46:0/325836407 shutdown_connections 2024-09-21T03:54:58.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.226+0000 7fcdf359d640 1 -- 172.21.15.46:0/325836407 wait complete. 2024-09-21T03:54:58.240 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":318,"stamp":"2024-09-21T03:54:58.070012+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658665,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":289,"num_read_kb":241,"num_write":212,"num_write_kb":2248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":166,"ondisk_log_size":166,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":380292,"kb_used_data":10200,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124561532,"statfs":{"total":1151940427776,"available":1151551008768,"internally_reserved":0,"allocated":10444800,"data_stored":6974919,"data_compressed":177972,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":308,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":16,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002901"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034971+0000","last_change":"2024-09-21T03:53:13.835177+0000","last_active":"2024-09-21T03:53:33.034971+0000","last_peered":"2024-09-21T03:53:33.034971+0000","last_clean":"2024-09-21T03:53:33.034971+0000","last_became_active":"2024-09-21T03:53:13.834779+0000","last_became_peered":"2024-09-21T03:53:13.834779+0000","last_unstale":"2024-09-21T03:53:33.034971+0000","last_undegraded":"2024-09-21T03:53:33.034971+0000","last_fullsized":"2024-09-21T03:53:33.034971+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:10.632059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123205+0000","last_change":"2024-09-21T03:53:13.829689+0000","last_active":"2024-09-21T03:53:33.123205+0000","last_peered":"2024-09-21T03:53:33.123205+0000","last_clean":"2024-09-21T03:53:33.123205+0000","last_became_active":"2024-09-21T03:53:13.828732+0000","last_became_peered":"2024-09-21T03:53:13.828732+0000","last_unstale":"2024-09-21T03:53:33.123205+0000","last_undegraded":"2024-09-21T03:53:33.123205+0000","last_fullsized":"2024-09-21T03:53:33.123205+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:35.270218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123057+0000","last_change":"2024-09-21T03:53:13.836545+0000","last_active":"2024-09-21T03:53:33.123057+0000","last_peered":"2024-09-21T03:53:33.123057+0000","last_clean":"2024-09-21T03:53:33.123057+0000","last_became_active":"2024-09-21T03:53:13.835781+0000","last_became_peered":"2024-09-21T03:53:13.835781+0000","last_unstale":"2024-09-21T03:53:33.123057+0000","last_undegraded":"2024-09-21T03:53:33.123057+0000","last_fullsized":"2024-09-21T03:53:33.123057+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:13.130016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123786+0000","last_change":"2024-09-21T03:53:13.832292+0000","last_active":"2024-09-21T03:53:33.123786+0000","last_peered":"2024-09-21T03:53:33.123786+0000","last_clean":"2024-09-21T03:53:33.123786+0000","last_became_active":"2024-09-21T03:53:13.831311+0000","last_became_peered":"2024-09-21T03:53:13.831311+0000","last_unstale":"2024-09-21T03:53:33.123786+0000","last_undegraded":"2024-09-21T03:53:33.123786+0000","last_fullsized":"2024-09-21T03:53:33.123786+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:38:49.425261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123152+0000","last_change":"2024-09-21T03:53:13.825130+0000","last_active":"2024-09-21T03:53:33.123152+0000","last_peered":"2024-09-21T03:53:33.123152+0000","last_clean":"2024-09-21T03:53:33.123152+0000","last_became_active":"2024-09-21T03:53:13.824795+0000","last_became_peered":"2024-09-21T03:53:13.824795+0000","last_unstale":"2024-09-21T03:53:33.123152+0000","last_undegraded":"2024-09-21T03:53:33.123152+0000","last_fullsized":"2024-09-21T03:53:33.123152+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:22.653270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123230+0000","last_change":"2024-09-21T03:53:13.834449+0000","last_active":"2024-09-21T03:53:33.123230+0000","last_peered":"2024-09-21T03:53:33.123230+0000","last_clean":"2024-09-21T03:53:33.123230+0000","last_became_active":"2024-09-21T03:53:13.832727+0000","last_became_peered":"2024-09-21T03:53:13.832727+0000","last_unstale":"2024-09-21T03:53:33.123230+0000","last_undegraded":"2024-09-21T03:53:33.123230+0000","last_fullsized":"2024-09-21T03:53:33.123230+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:36.479962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035845+0000","last_change":"2024-09-21T03:53:13.821938+0000","last_active":"2024-09-21T03:53:33.035845+0000","last_peered":"2024-09-21T03:53:33.035845+0000","last_clean":"2024-09-21T03:53:33.035845+0000","last_became_active":"2024-09-21T03:53:13.821569+0000","last_became_peered":"2024-09-21T03:53:13.821569+0000","last_unstale":"2024-09-21T03:53:33.035845+0000","last_undegraded":"2024-09-21T03:53:33.035845+0000","last_fullsized":"2024-09-21T03:53:33.035845+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:04.309212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122491+0000","last_change":"2024-09-21T03:53:13.833471+0000","last_active":"2024-09-21T03:53:33.122491+0000","last_peered":"2024-09-21T03:53:33.122491+0000","last_clean":"2024-09-21T03:53:33.122491+0000","last_became_active":"2024-09-21T03:53:13.832779+0000","last_became_peered":"2024-09-21T03:53:13.832779+0000","last_unstale":"2024-09-21T03:53:33.122491+0000","last_undegraded":"2024-09-21T03:53:33.122491+0000","last_fullsized":"2024-09-21T03:53:33.122491+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:15.402265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032934+0000","last_change":"2024-09-21T03:53:13.833077+0000","last_active":"2024-09-21T03:53:33.032934+0000","last_peered":"2024-09-21T03:53:33.032934+0000","last_clean":"2024-09-21T03:53:33.032934+0000","last_became_active":"2024-09-21T03:53:13.832625+0000","last_became_peered":"2024-09-21T03:53:13.832625+0000","last_unstale":"2024-09-21T03:53:33.032934+0000","last_undegraded":"2024-09-21T03:53:33.032934+0000","last_fullsized":"2024-09-21T03:53:33.032934+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:13.158754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124857+0000","last_change":"2024-09-21T03:53:13.835417+0000","last_active":"2024-09-21T03:53:33.124857+0000","last_peered":"2024-09-21T03:53:33.124857+0000","last_clean":"2024-09-21T03:53:33.124857+0000","last_became_active":"2024-09-21T03:53:13.835081+0000","last_became_peered":"2024-09-21T03:53:13.835081+0000","last_unstale":"2024-09-21T03:53:33.124857+0000","last_undegraded":"2024-09-21T03:53:33.124857+0000","last_fullsized":"2024-09-21T03:53:33.124857+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:29.239879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036187+0000","last_change":"2024-09-21T03:53:13.836575+0000","last_active":"2024-09-21T03:53:33.036187+0000","last_peered":"2024-09-21T03:53:33.036187+0000","last_clean":"2024-09-21T03:53:33.036187+0000","last_became_active":"2024-09-21T03:53:13.836184+0000","last_became_peered":"2024-09-21T03:53:13.836184+0000","last_unstale":"2024-09-21T03:53:33.036187+0000","last_undegraded":"2024-09-21T03:53:33.036187+0000","last_fullsized":"2024-09-21T03:53:33.036187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:06.602354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.126314+0000","last_change":"2024-09-21T03:53:33.125896+0000","last_active":"2024-09-21T03:53:33.126314+0000","last_peered":"2024-09-21T03:53:33.126314+0000","last_clean":"2024-09-21T03:53:33.126314+0000","last_became_active":"2024-09-21T03:53:33.125488+0000","last_became_peered":"2024-09-21T03:53:33.125488+0000","last_unstale":"2024-09-21T03:53:33.126314+0000","last_undegraded":"2024-09-21T03:53:33.126314+0000","last_fullsized":"2024-09-21T03:53:33.126314+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:09.742892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031708+0000","last_change":"2024-09-21T03:53:13.814729+0000","last_active":"2024-09-21T03:53:33.031708+0000","last_peered":"2024-09-21T03:53:33.031708+0000","last_clean":"2024-09-21T03:53:33.031708+0000","last_became_active":"2024-09-21T03:53:13.814317+0000","last_became_peered":"2024-09-21T03:53:13.814317+0000","last_unstale":"2024-09-21T03:53:33.031708+0000","last_undegraded":"2024-09-21T03:53:33.031708+0000","last_fullsized":"2024-09-21T03:53:33.031708+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:30.779754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122847+0000","last_change":"2024-09-21T03:53:13.833280+0000","last_active":"2024-09-21T03:53:33.122847+0000","last_peered":"2024-09-21T03:53:33.122847+0000","last_clean":"2024-09-21T03:53:33.122847+0000","last_became_active":"2024-09-21T03:53:13.831799+0000","last_became_peered":"2024-09-21T03:53:13.831799+0000","last_unstale":"2024-09-21T03:53:33.122847+0000","last_undegraded":"2024-09-21T03:53:33.122847+0000","last_fullsized":"2024-09-21T03:53:33.122847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:33.923946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122733+0000","last_change":"2024-09-21T03:53:13.832142+0000","last_active":"2024-09-21T03:53:33.122733+0000","last_peered":"2024-09-21T03:53:33.122733+0000","last_clean":"2024-09-21T03:53:33.122733+0000","last_became_active":"2024-09-21T03:53:13.831756+0000","last_became_peered":"2024-09-21T03:53:13.831756+0000","last_unstale":"2024-09-21T03:53:33.122733+0000","last_undegraded":"2024-09-21T03:53:33.122733+0000","last_fullsized":"2024-09-21T03:53:33.122733+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:43.941161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032362+0000","last_change":"2024-09-21T03:53:13.834085+0000","last_active":"2024-09-21T03:53:33.032362+0000","last_peered":"2024-09-21T03:53:33.032362+0000","last_clean":"2024-09-21T03:53:33.032362+0000","last_became_active":"2024-09-21T03:53:13.833668+0000","last_became_peered":"2024-09-21T03:53:13.833668+0000","last_unstale":"2024-09-21T03:53:33.032362+0000","last_undegraded":"2024-09-21T03:53:33.032362+0000","last_fullsized":"2024-09-21T03:53:33.032362+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:08:26.939873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035098+0000","last_change":"2024-09-21T03:53:13.836133+0000","last_active":"2024-09-21T03:53:33.035098+0000","last_peered":"2024-09-21T03:53:33.035098+0000","last_clean":"2024-09-21T03:53:33.035098+0000","last_became_active":"2024-09-21T03:53:13.835681+0000","last_became_peered":"2024-09-21T03:53:13.835681+0000","last_unstale":"2024-09-21T03:53:33.035098+0000","last_undegraded":"2024-09-21T03:53:33.035098+0000","last_fullsized":"2024-09-21T03:53:33.035098+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:02.691622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035103+0000","last_change":"2024-09-21T03:53:13.834069+0000","last_active":"2024-09-21T03:53:33.035103+0000","last_peered":"2024-09-21T03:53:33.035103+0000","last_clean":"2024-09-21T03:53:33.035103+0000","last_became_active":"2024-09-21T03:53:13.833714+0000","last_became_peered":"2024-09-21T03:53:13.833714+0000","last_unstale":"2024-09-21T03:53:33.035103+0000","last_undegraded":"2024-09-21T03:53:33.035103+0000","last_fullsized":"2024-09-21T03:53:33.035103+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:12.479790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.095236+0000","last_change":"2024-09-21T03:53:13.827788+0000","last_active":"2024-09-21T03:53:33.095236+0000","last_peered":"2024-09-21T03:53:33.095236+0000","last_clean":"2024-09-21T03:53:33.095236+0000","last_became_active":"2024-09-21T03:53:13.827461+0000","last_became_peered":"2024-09-21T03:53:13.827461+0000","last_unstale":"2024-09-21T03:53:33.095236+0000","last_undegraded":"2024-09-21T03:53:33.095236+0000","last_fullsized":"2024-09-21T03:53:33.095236+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:38.003243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034635+0000","last_change":"2024-09-21T03:53:13.836880+0000","last_active":"2024-09-21T03:53:33.034635+0000","last_peered":"2024-09-21T03:53:33.034635+0000","last_clean":"2024-09-21T03:53:33.034635+0000","last_became_active":"2024-09-21T03:53:13.836531+0000","last_became_peered":"2024-09-21T03:53:13.836531+0000","last_unstale":"2024-09-21T03:53:33.034635+0000","last_undegraded":"2024-09-21T03:53:33.034635+0000","last_fullsized":"2024-09-21T03:53:33.034635+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:52.825826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031827+0000","last_change":"2024-09-21T03:53:13.823160+0000","last_active":"2024-09-21T03:53:33.031827+0000","last_peered":"2024-09-21T03:53:33.031827+0000","last_clean":"2024-09-21T03:53:33.031827+0000","last_became_active":"2024-09-21T03:53:13.822076+0000","last_became_peered":"2024-09-21T03:53:13.822076+0000","last_unstale":"2024-09-21T03:53:33.031827+0000","last_undegraded":"2024-09-21T03:53:33.031827+0000","last_fullsized":"2024-09-21T03:53:33.031827+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:26.277249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032827+0000","last_change":"2024-09-21T03:53:13.831822+0000","last_active":"2024-09-21T03:53:33.032827+0000","last_peered":"2024-09-21T03:53:33.032827+0000","last_clean":"2024-09-21T03:53:33.032827+0000","last_became_active":"2024-09-21T03:53:13.831395+0000","last_became_peered":"2024-09-21T03:53:13.831395+0000","last_unstale":"2024-09-21T03:53:33.032827+0000","last_undegraded":"2024-09-21T03:53:33.032827+0000","last_fullsized":"2024-09-21T03:53:33.032827+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:48.541339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122588+0000","last_change":"2024-09-21T03:53:13.834576+0000","last_active":"2024-09-21T03:53:33.122588+0000","last_peered":"2024-09-21T03:53:33.122588+0000","last_clean":"2024-09-21T03:53:33.122588+0000","last_became_active":"2024-09-21T03:53:13.834229+0000","last_became_peered":"2024-09-21T03:53:13.834229+0000","last_unstale":"2024-09-21T03:53:33.122588+0000","last_undegraded":"2024-09-21T03:53:33.122588+0000","last_fullsized":"2024-09-21T03:53:33.122588+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:36.101399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040298+0000","last_change":"2024-09-21T03:53:13.824049+0000","last_active":"2024-09-21T03:53:33.040298+0000","last_peered":"2024-09-21T03:53:33.040298+0000","last_clean":"2024-09-21T03:53:33.040298+0000","last_became_active":"2024-09-21T03:53:13.823510+0000","last_became_peered":"2024-09-21T03:53:13.823510+0000","last_unstale":"2024-09-21T03:53:33.040298+0000","last_undegraded":"2024-09-21T03:53:33.040298+0000","last_fullsized":"2024-09-21T03:53:33.040298+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:36.615951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123804+0000","last_change":"2024-09-21T03:53:13.837327+0000","last_active":"2024-09-21T03:53:33.123804+0000","last_peered":"2024-09-21T03:53:33.123804+0000","last_clean":"2024-09-21T03:53:33.123804+0000","last_became_active":"2024-09-21T03:53:13.836940+0000","last_became_peered":"2024-09-21T03:53:13.836940+0000","last_unstale":"2024-09-21T03:53:33.123804+0000","last_undegraded":"2024-09-21T03:53:33.123804+0000","last_fullsized":"2024-09-21T03:53:33.123804+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:49.248838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.095260+0000","last_change":"2024-09-21T03:53:13.829540+0000","last_active":"2024-09-21T03:53:33.095260+0000","last_peered":"2024-09-21T03:53:33.095260+0000","last_clean":"2024-09-21T03:53:33.095260+0000","last_became_active":"2024-09-21T03:53:13.828953+0000","last_became_peered":"2024-09-21T03:53:13.828953+0000","last_unstale":"2024-09-21T03:53:33.095260+0000","last_undegraded":"2024-09-21T03:53:33.095260+0000","last_fullsized":"2024-09-21T03:53:33.095260+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:07.631226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034762+0000","last_change":"2024-09-21T03:53:13.835009+0000","last_active":"2024-09-21T03:53:33.034762+0000","last_peered":"2024-09-21T03:53:33.034762+0000","last_clean":"2024-09-21T03:53:33.034762+0000","last_became_active":"2024-09-21T03:53:13.834454+0000","last_became_peered":"2024-09-21T03:53:13.834454+0000","last_unstale":"2024-09-21T03:53:33.034762+0000","last_undegraded":"2024-09-21T03:53:33.034762+0000","last_fullsized":"2024-09-21T03:53:33.034762+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:34:06.114394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031624+0000","last_change":"2024-09-21T03:53:13.826846+0000","last_active":"2024-09-21T03:53:33.031624+0000","last_peered":"2024-09-21T03:53:33.031624+0000","last_clean":"2024-09-21T03:53:33.031624+0000","last_became_active":"2024-09-21T03:53:13.826460+0000","last_became_peered":"2024-09-21T03:53:13.826460+0000","last_unstale":"2024-09-21T03:53:33.031624+0000","last_undegraded":"2024-09-21T03:53:33.031624+0000","last_fullsized":"2024-09-21T03:53:33.031624+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:24.081091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123429+0000","last_change":"2024-09-21T03:53:13.837134+0000","last_active":"2024-09-21T03:53:33.123429+0000","last_peered":"2024-09-21T03:53:33.123429+0000","last_clean":"2024-09-21T03:53:33.123429+0000","last_became_active":"2024-09-21T03:53:13.836729+0000","last_became_peered":"2024-09-21T03:53:13.836729+0000","last_unstale":"2024-09-21T03:53:33.123429+0000","last_undegraded":"2024-09-21T03:53:33.123429+0000","last_fullsized":"2024-09-21T03:53:33.123429+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:08.677375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.094680+0000","last_change":"2024-09-21T03:53:13.838100+0000","last_active":"2024-09-21T03:53:33.094680+0000","last_peered":"2024-09-21T03:53:33.094680+0000","last_clean":"2024-09-21T03:53:33.094680+0000","last_became_active":"2024-09-21T03:53:13.833495+0000","last_became_peered":"2024-09-21T03:53:13.833495+0000","last_unstale":"2024-09-21T03:53:33.094680+0000","last_undegraded":"2024-09-21T03:53:33.094680+0000","last_fullsized":"2024-09-21T03:53:33.094680+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:52:00.705434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.095021+0000","last_change":"2024-09-21T03:53:13.835806+0000","last_active":"2024-09-21T03:53:33.095021+0000","last_peered":"2024-09-21T03:53:33.095021+0000","last_clean":"2024-09-21T03:53:33.095021+0000","last_became_active":"2024-09-21T03:53:13.835453+0000","last_became_peered":"2024-09-21T03:53:13.835453+0000","last_unstale":"2024-09-21T03:53:33.095021+0000","last_undegraded":"2024-09-21T03:53:33.095021+0000","last_fullsized":"2024-09-21T03:53:33.095021+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:56:16.296808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034530+0000","last_change":"2024-09-21T03:53:13.831171+0000","last_active":"2024-09-21T03:53:33.034530+0000","last_peered":"2024-09-21T03:53:33.034530+0000","last_clean":"2024-09-21T03:53:33.034530+0000","last_became_active":"2024-09-21T03:53:13.830734+0000","last_became_peered":"2024-09-21T03:53:13.830734+0000","last_unstale":"2024-09-21T03:53:33.034530+0000","last_undegraded":"2024-09-21T03:53:33.034530+0000","last_fullsized":"2024-09-21T03:53:33.034530+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:00:56.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123100+0000","last_change":"2024-09-21T03:53:13.820580+0000","last_active":"2024-09-21T03:53:33.123100+0000","last_peered":"2024-09-21T03:53:33.123100+0000","last_clean":"2024-09-21T03:53:33.123100+0000","last_became_active":"2024-09-21T03:53:13.820237+0000","last_became_peered":"2024-09-21T03:53:13.820237+0000","last_unstale":"2024-09-21T03:53:33.123100+0000","last_undegraded":"2024-09-21T03:53:33.123100+0000","last_fullsized":"2024-09-21T03:53:33.123100+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:15.067629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040549+0000","last_change":"2024-09-21T03:53:11.804667+0000","last_active":"2024-09-21T03:53:33.040549+0000","last_peered":"2024-09-21T03:53:33.040549+0000","last_clean":"2024-09-21T03:53:33.040549+0000","last_became_active":"2024-09-21T03:53:11.804231+0000","last_became_peered":"2024-09-21T03:53:11.804231+0000","last_unstale":"2024-09-21T03:53:33.040549+0000","last_undegraded":"2024-09-21T03:53:33.040549+0000","last_fullsized":"2024-09-21T03:53:33.040549+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:36.425699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040361+0000","last_change":"2024-09-21T03:53:13.831602+0000","last_active":"2024-09-21T03:53:33.040361+0000","last_peered":"2024-09-21T03:53:33.040361+0000","last_clean":"2024-09-21T03:53:33.040361+0000","last_became_active":"2024-09-21T03:53:13.831274+0000","last_became_peered":"2024-09-21T03:53:13.831274+0000","last_unstale":"2024-09-21T03:53:33.040361+0000","last_undegraded":"2024-09-21T03:53:33.040361+0000","last_fullsized":"2024-09-21T03:53:33.040361+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:33.603025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123276+0000","last_change":"2024-09-21T03:53:11.807722+0000","last_active":"2024-09-21T03:53:33.123276+0000","last_peered":"2024-09-21T03:53:33.123276+0000","last_clean":"2024-09-21T03:53:33.123276+0000","last_became_active":"2024-09-21T03:53:11.807294+0000","last_became_peered":"2024-09-21T03:53:11.807294+0000","last_unstale":"2024-09-21T03:53:33.123276+0000","last_undegraded":"2024-09-21T03:53:33.123276+0000","last_fullsized":"2024-09-21T03:53:33.123276+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:59.696572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031405+0000","last_change":"2024-09-21T03:53:11.803680+0000","last_active":"2024-09-21T03:53:33.031405+0000","last_peered":"2024-09-21T03:53:33.031405+0000","last_clean":"2024-09-21T03:53:33.031405+0000","last_became_active":"2024-09-21T03:53:11.803310+0000","last_became_peered":"2024-09-21T03:53:11.803310+0000","last_unstale":"2024-09-21T03:53:33.031405+0000","last_undegraded":"2024-09-21T03:53:33.031405+0000","last_fullsized":"2024-09-21T03:53:33.031405+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:25.276545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122501+0000","last_change":"2024-09-21T03:53:13.834847+0000","last_active":"2024-09-21T03:53:33.122501+0000","last_peered":"2024-09-21T03:53:33.122501+0000","last_clean":"2024-09-21T03:53:33.122501+0000","last_became_active":"2024-09-21T03:53:13.834448+0000","last_became_peered":"2024-09-21T03:53:13.834448+0000","last_unstale":"2024-09-21T03:53:33.122501+0000","last_undegraded":"2024-09-21T03:53:33.122501+0000","last_fullsized":"2024-09-21T03:53:33.122501+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:47:39.213364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040606+0000","last_change":"2024-09-21T03:53:11.807372+0000","last_active":"2024-09-21T03:53:33.040606+0000","last_peered":"2024-09-21T03:53:33.040606+0000","last_clean":"2024-09-21T03:53:33.040606+0000","last_became_active":"2024-09-21T03:53:11.807064+0000","last_became_peered":"2024-09-21T03:53:11.807064+0000","last_unstale":"2024-09-21T03:53:33.040606+0000","last_undegraded":"2024-09-21T03:53:33.040606+0000","last_fullsized":"2024-09-21T03:53:33.040606+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:00.743039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034954+0000","last_change":"2024-09-21T03:53:13.821169+0000","last_active":"2024-09-21T03:53:33.034954+0000","last_peered":"2024-09-21T03:53:33.034954+0000","last_clean":"2024-09-21T03:53:33.034954+0000","last_became_active":"2024-09-21T03:53:13.820810+0000","last_became_peered":"2024-09-21T03:53:13.820810+0000","last_unstale":"2024-09-21T03:53:33.034954+0000","last_undegraded":"2024-09-21T03:53:33.034954+0000","last_fullsized":"2024-09-21T03:53:33.034954+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:54.568383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124708+0000","last_change":"2024-09-21T03:53:11.805663+0000","last_active":"2024-09-21T03:53:33.124708+0000","last_peered":"2024-09-21T03:53:33.124708+0000","last_clean":"2024-09-21T03:53:33.124708+0000","last_became_active":"2024-09-21T03:53:11.805099+0000","last_became_peered":"2024-09-21T03:53:11.805099+0000","last_unstale":"2024-09-21T03:53:33.124708+0000","last_undegraded":"2024-09-21T03:53:33.124708+0000","last_fullsized":"2024-09-21T03:53:33.124708+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:47.306589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032728+0000","last_change":"2024-09-21T03:53:13.827745+0000","last_active":"2024-09-21T03:53:33.032728+0000","last_peered":"2024-09-21T03:53:33.032728+0000","last_clean":"2024-09-21T03:53:33.032728+0000","last_became_active":"2024-09-21T03:53:13.827229+0000","last_became_peered":"2024-09-21T03:53:13.827229+0000","last_unstale":"2024-09-21T03:53:33.032728+0000","last_undegraded":"2024-09-21T03:53:33.032728+0000","last_fullsized":"2024-09-21T03:53:33.032728+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:53.760919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036288+0000","last_change":"2024-09-21T03:53:11.803697+0000","last_active":"2024-09-21T03:53:33.036288+0000","last_peered":"2024-09-21T03:53:33.036288+0000","last_clean":"2024-09-21T03:53:33.036288+0000","last_became_active":"2024-09-21T03:53:11.801539+0000","last_became_peered":"2024-09-21T03:53:11.801539+0000","last_unstale":"2024-09-21T03:53:33.036288+0000","last_undegraded":"2024-09-21T03:53:33.036288+0000","last_fullsized":"2024-09-21T03:53:33.036288+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:53.096622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123637+0000","last_change":"2024-09-21T03:53:13.832771+0000","last_active":"2024-09-21T03:53:33.123637+0000","last_peered":"2024-09-21T03:53:33.123637+0000","last_clean":"2024-09-21T03:53:33.123637+0000","last_became_active":"2024-09-21T03:53:13.832414+0000","last_became_peered":"2024-09-21T03:53:13.832414+0000","last_unstale":"2024-09-21T03:53:33.123637+0000","last_undegraded":"2024-09-21T03:53:33.123637+0000","last_fullsized":"2024-09-21T03:53:33.123637+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:58:42.287731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.041017+0000","last_change":"2024-09-21T03:53:12.604482+0000","last_active":"2024-09-21T03:53:33.041017+0000","last_peered":"2024-09-21T03:53:33.041017+0000","last_clean":"2024-09-21T03:53:33.041017+0000","last_became_active":"2024-09-21T03:53:12.603973+0000","last_became_peered":"2024-09-21T03:53:12.603973+0000","last_unstale":"2024-09-21T03:53:33.041017+0000","last_undegraded":"2024-09-21T03:53:33.041017+0000","last_fullsized":"2024-09-21T03:53:33.041017+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:11.932329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032506+0000","last_change":"2024-09-21T03:53:13.842106+0000","last_active":"2024-09-21T03:53:33.032506+0000","last_peered":"2024-09-21T03:53:33.032506+0000","last_clean":"2024-09-21T03:53:33.032506+0000","last_became_active":"2024-09-21T03:53:13.841758+0000","last_became_peered":"2024-09-21T03:53:13.841758+0000","last_unstale":"2024-09-21T03:53:33.032506+0000","last_undegraded":"2024-09-21T03:53:33.032506+0000","last_fullsized":"2024-09-21T03:53:33.032506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:37.045045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'30","reported_seq":255,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:54:57.044797+0000","last_change":"2024-09-21T03:53:11.805385+0000","last_active":"2024-09-21T03:54:57.044797+0000","last_peered":"2024-09-21T03:54:57.044797+0000","last_clean":"2024-09-21T03:54:57.044797+0000","last_became_active":"2024-09-21T03:53:11.804958+0000","last_became_peered":"2024-09-21T03:53:11.804958+0000","last_unstale":"2024-09-21T03:54:57.044797+0000","last_undegraded":"2024-09-21T03:54:57.044797+0000","last_fullsized":"2024-09-21T03:54:57.044797+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:59.197216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67265,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":202,"num_read_kb":166,"num_write":30,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123691+0000","last_change":"2024-09-21T03:53:13.828095+0000","last_active":"2024-09-21T03:53:33.123691+0000","last_peered":"2024-09-21T03:53:33.123691+0000","last_clean":"2024-09-21T03:53:33.123691+0000","last_became_active":"2024-09-21T03:53:13.827761+0000","last_became_peered":"2024-09-21T03:53:13.827761+0000","last_unstale":"2024-09-21T03:53:33.123691+0000","last_undegraded":"2024-09-21T03:53:33.123691+0000","last_fullsized":"2024-09-21T03:53:33.123691+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:42:28.981463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.094939+0000","last_change":"2024-09-21T03:53:11.801611+0000","last_active":"2024-09-21T03:53:33.094939+0000","last_peered":"2024-09-21T03:53:33.094939+0000","last_clean":"2024-09-21T03:53:33.094939+0000","last_became_active":"2024-09-21T03:53:11.801185+0000","last_became_peered":"2024-09-21T03:53:11.801185+0000","last_unstale":"2024-09-21T03:53:33.094939+0000","last_undegraded":"2024-09-21T03:53:33.094939+0000","last_fullsized":"2024-09-21T03:53:33.094939+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:16.990963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031447+0000","last_change":"2024-09-21T03:53:13.827393+0000","last_active":"2024-09-21T03:53:33.031447+0000","last_peered":"2024-09-21T03:53:33.031447+0000","last_clean":"2024-09-21T03:53:33.031447+0000","last_became_active":"2024-09-21T03:53:13.826912+0000","last_became_peered":"2024-09-21T03:53:13.826912+0000","last_unstale":"2024-09-21T03:53:33.031447+0000","last_undegraded":"2024-09-21T03:53:33.031447+0000","last_fullsized":"2024-09-21T03:53:33.031447+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:52.313989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040555+0000","last_change":"2024-09-21T03:53:11.805437+0000","last_active":"2024-09-21T03:53:33.040555+0000","last_peered":"2024-09-21T03:53:33.040555+0000","last_clean":"2024-09-21T03:53:33.040555+0000","last_became_active":"2024-09-21T03:53:11.805048+0000","last_became_peered":"2024-09-21T03:53:11.805048+0000","last_unstale":"2024-09-21T03:53:33.040555+0000","last_undegraded":"2024-09-21T03:53:33.040555+0000","last_fullsized":"2024-09-21T03:53:33.040555+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:03.288694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036034+0000","last_change":"2024-09-21T03:53:13.836917+0000","last_active":"2024-09-21T03:53:33.036034+0000","last_peered":"2024-09-21T03:53:33.036034+0000","last_clean":"2024-09-21T03:53:33.036034+0000","last_became_active":"2024-09-21T03:53:13.836514+0000","last_became_peered":"2024-09-21T03:53:13.836514+0000","last_unstale":"2024-09-21T03:53:33.036034+0000","last_undegraded":"2024-09-21T03:53:33.036034+0000","last_fullsized":"2024-09-21T03:53:33.036034+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:17.512017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123559+0000","last_change":"2024-09-21T03:53:11.808403+0000","last_active":"2024-09-21T03:53:33.123559+0000","last_peered":"2024-09-21T03:53:33.123559+0000","last_clean":"2024-09-21T03:53:33.123559+0000","last_became_active":"2024-09-21T03:53:11.807895+0000","last_became_peered":"2024-09-21T03:53:11.807895+0000","last_unstale":"2024-09-21T03:53:33.123559+0000","last_undegraded":"2024-09-21T03:53:33.123559+0000","last_fullsized":"2024-09-21T03:53:33.123559+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:33.548683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.125777+0000","last_change":"2024-09-21T03:53:33.125556+0000","last_active":"2024-09-21T03:53:33.125777+0000","last_peered":"2024-09-21T03:53:33.125777+0000","last_clean":"2024-09-21T03:53:33.125777+0000","last_became_active":"2024-09-21T03:53:33.125084+0000","last_became_peered":"2024-09-21T03:53:33.125084+0000","last_unstale":"2024-09-21T03:53:33.125777+0000","last_undegraded":"2024-09-21T03:53:33.125777+0000","last_fullsized":"2024-09-21T03:53:33.125777+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:40:23.997329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'8","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123320+0000","last_change":"2024-09-21T03:53:12.605672+0000","last_active":"2024-09-21T03:53:33.123320+0000","last_peered":"2024-09-21T03:53:33.123320+0000","last_clean":"2024-09-21T03:53:33.123320+0000","last_became_active":"2024-09-21T03:53:12.604644+0000","last_became_peered":"2024-09-21T03:53:12.604644+0000","last_unstale":"2024-09-21T03:53:33.123320+0000","last_undegraded":"2024-09-21T03:53:33.123320+0000","last_fullsized":"2024-09-21T03:53:33.123320+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:44.810762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040395+0000","last_change":"2024-09-21T03:53:13.833861+0000","last_active":"2024-09-21T03:53:33.040395+0000","last_peered":"2024-09-21T03:53:33.040395+0000","last_clean":"2024-09-21T03:53:33.040395+0000","last_became_active":"2024-09-21T03:53:13.832900+0000","last_became_peered":"2024-09-21T03:53:13.832900+0000","last_unstale":"2024-09-21T03:53:33.040395+0000","last_undegraded":"2024-09-21T03:53:33.040395+0000","last_fullsized":"2024-09-21T03:53:33.040395+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:12.047171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124020+0000","last_change":"2024-09-21T03:53:11.799844+0000","last_active":"2024-09-21T03:53:33.124020+0000","last_peered":"2024-09-21T03:53:33.124020+0000","last_clean":"2024-09-21T03:53:33.124020+0000","last_became_active":"2024-09-21T03:53:11.799412+0000","last_became_peered":"2024-09-21T03:53:11.799412+0000","last_unstale":"2024-09-21T03:53:33.124020+0000","last_undegraded":"2024-09-21T03:53:33.124020+0000","last_fullsized":"2024-09-21T03:53:33.124020+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:49.826500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034751+0000","last_change":"2024-09-21T03:53:13.836690+0000","last_active":"2024-09-21T03:53:33.034751+0000","last_peered":"2024-09-21T03:53:33.034751+0000","last_clean":"2024-09-21T03:53:33.034751+0000","last_became_active":"2024-09-21T03:53:13.836337+0000","last_became_peered":"2024-09-21T03:53:13.836337+0000","last_unstale":"2024-09-21T03:53:33.034751+0000","last_undegraded":"2024-09-21T03:53:33.034751+0000","last_fullsized":"2024-09-21T03:53:33.034751+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:15.999869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031625+0000","last_change":"2024-09-21T03:53:11.799597+0000","last_active":"2024-09-21T03:53:33.031625+0000","last_peered":"2024-09-21T03:53:33.031625+0000","last_clean":"2024-09-21T03:53:33.031625+0000","last_became_active":"2024-09-21T03:53:11.799175+0000","last_became_peered":"2024-09-21T03:53:11.799175+0000","last_unstale":"2024-09-21T03:53:33.031625+0000","last_undegraded":"2024-09-21T03:53:33.031625+0000","last_fullsized":"2024-09-21T03:53:33.031625+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:41.668587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036592+0000","last_change":"2024-09-21T03:53:13.831228+0000","last_active":"2024-09-21T03:53:33.036592+0000","last_peered":"2024-09-21T03:53:33.036592+0000","last_clean":"2024-09-21T03:53:33.036592+0000","last_became_active":"2024-09-21T03:53:13.830880+0000","last_became_peered":"2024-09-21T03:53:13.830880+0000","last_unstale":"2024-09-21T03:53:33.036592+0000","last_undegraded":"2024-09-21T03:53:33.036592+0000","last_fullsized":"2024-09-21T03:53:33.036592+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:45.770622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.041069+0000","last_change":"2024-09-21T03:53:11.803560+0000","last_active":"2024-09-21T03:53:33.041069+0000","last_peered":"2024-09-21T03:53:33.041069+0000","last_clean":"2024-09-21T03:53:33.041069+0000","last_became_active":"2024-09-21T03:53:11.803090+0000","last_became_peered":"2024-09-21T03:53:11.803090+0000","last_unstale":"2024-09-21T03:53:33.041069+0000","last_undegraded":"2024-09-21T03:53:33.041069+0000","last_fullsized":"2024-09-21T03:53:33.041069+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:23.993694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036373+0000","last_change":"2024-09-21T03:53:13.825907+0000","last_active":"2024-09-21T03:53:33.036373+0000","last_peered":"2024-09-21T03:53:33.036373+0000","last_clean":"2024-09-21T03:53:33.036373+0000","last_became_active":"2024-09-21T03:53:13.825485+0000","last_became_peered":"2024-09-21T03:53:13.825485+0000","last_unstale":"2024-09-21T03:53:33.036373+0000","last_undegraded":"2024-09-21T03:53:33.036373+0000","last_fullsized":"2024-09-21T03:53:33.036373+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:39.166215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.095338+0000","last_change":"2024-09-21T03:53:12.605947+0000","last_active":"2024-09-21T03:53:33.095338+0000","last_peered":"2024-09-21T03:53:33.095338+0000","last_clean":"2024-09-21T03:53:33.095338+0000","last_became_active":"2024-09-21T03:53:12.604516+0000","last_became_peered":"2024-09-21T03:53:12.604516+0000","last_unstale":"2024-09-21T03:53:33.095338+0000","last_undegraded":"2024-09-21T03:53:33.095338+0000","last_fullsized":"2024-09-21T03:53:33.095338+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:42.500174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036503+0000","last_change":"2024-09-21T03:53:13.834108+0000","last_active":"2024-09-21T03:53:33.036503+0000","last_peered":"2024-09-21T03:53:33.036503+0000","last_clean":"2024-09-21T03:53:33.036503+0000","last_became_active":"2024-09-21T03:53:13.833734+0000","last_became_peered":"2024-09-21T03:53:13.833734+0000","last_unstale":"2024-09-21T03:53:33.036503+0000","last_undegraded":"2024-09-21T03:53:33.036503+0000","last_fullsized":"2024-09-21T03:53:33.036503+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:39.032450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":98,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036220+0000","last_change":"2024-09-21T03:51:59.139085+0000","last_active":"2024-09-21T03:53:33.036220+0000","last_peered":"2024-09-21T03:53:33.036220+0000","last_clean":"2024-09-21T03:53:33.036220+0000","last_became_active":"2024-09-21T03:51:59.026450+0000","last_became_peered":"2024-09-21T03:51:59.026450+0000","last_unstale":"2024-09-21T03:53:33.036220+0000","last_undegraded":"2024-09-21T03:53:33.036220+0000","last_fullsized":"2024-09-21T03:53:33.036220+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:48:31.139457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:48:31.139457+0000","last_clean_scrub_stamp":"2024-09-21T03:48:31.139457+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:54.047170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123454+0000","last_change":"2024-09-21T03:53:11.805792+0000","last_active":"2024-09-21T03:53:33.123454+0000","last_peered":"2024-09-21T03:53:33.123454+0000","last_clean":"2024-09-21T03:53:33.123454+0000","last_became_active":"2024-09-21T03:53:11.805375+0000","last_became_peered":"2024-09-21T03:53:11.805375+0000","last_unstale":"2024-09-21T03:53:33.123454+0000","last_undegraded":"2024-09-21T03:53:33.123454+0000","last_fullsized":"2024-09-21T03:53:33.123454+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:55.466187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122971+0000","last_change":"2024-09-21T03:53:13.835211+0000","last_active":"2024-09-21T03:53:33.122971+0000","last_peered":"2024-09-21T03:53:33.122971+0000","last_clean":"2024-09-21T03:53:33.122971+0000","last_became_active":"2024-09-21T03:53:13.833649+0000","last_became_peered":"2024-09-21T03:53:13.833649+0000","last_unstale":"2024-09-21T03:53:33.122971+0000","last_undegraded":"2024-09-21T03:53:33.122971+0000","last_fullsized":"2024-09-21T03:53:33.122971+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:57.962287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035996+0000","last_change":"2024-09-21T03:53:11.801670+0000","last_active":"2024-09-21T03:53:33.035996+0000","last_peered":"2024-09-21T03:53:33.035996+0000","last_clean":"2024-09-21T03:53:33.035996+0000","last_became_active":"2024-09-21T03:53:11.801291+0000","last_became_peered":"2024-09-21T03:53:11.801291+0000","last_unstale":"2024-09-21T03:53:33.035996+0000","last_undegraded":"2024-09-21T03:53:33.035996+0000","last_fullsized":"2024-09-21T03:53:33.035996+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:37.450592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.096813+0000","last_change":"2024-09-21T03:53:33.096727+0000","last_active":"2024-09-21T03:53:33.096813+0000","last_peered":"2024-09-21T03:53:33.096813+0000","last_clean":"2024-09-21T03:53:33.096813+0000","last_became_active":"2024-09-21T03:53:33.096234+0000","last_became_peered":"2024-09-21T03:53:33.096234+0000","last_unstale":"2024-09-21T03:53:33.096813+0000","last_undegraded":"2024-09-21T03:53:33.096813+0000","last_fullsized":"2024-09-21T03:53:33.096813+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:56:24.375992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031550+0000","last_change":"2024-09-21T03:53:12.604170+0000","last_active":"2024-09-21T03:53:33.031550+0000","last_peered":"2024-09-21T03:53:33.031550+0000","last_clean":"2024-09-21T03:53:33.031550+0000","last_became_active":"2024-09-21T03:53:12.603765+0000","last_became_peered":"2024-09-21T03:53:12.603765+0000","last_unstale":"2024-09-21T03:53:33.031550+0000","last_undegraded":"2024-09-21T03:53:33.031550+0000","last_fullsized":"2024-09-21T03:53:33.031550+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:08.606037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.125077+0000","last_change":"2024-09-21T03:53:33.124969+0000","last_active":"2024-09-21T03:53:33.125077+0000","last_peered":"2024-09-21T03:53:33.125077+0000","last_clean":"2024-09-21T03:53:33.125077+0000","last_became_active":"2024-09-21T03:53:33.124496+0000","last_became_peered":"2024-09-21T03:53:33.124496+0000","last_unstale":"2024-09-21T03:53:33.125077+0000","last_undegraded":"2024-09-21T03:53:33.125077+0000","last_fullsized":"2024-09-21T03:53:33.125077+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:56.730146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036128+0000","last_change":"2024-09-21T03:53:11.803316+0000","last_active":"2024-09-21T03:53:33.036128+0000","last_peered":"2024-09-21T03:53:33.036128+0000","last_clean":"2024-09-21T03:53:33.036128+0000","last_became_active":"2024-09-21T03:53:11.801976+0000","last_became_peered":"2024-09-21T03:53:11.801976+0000","last_unstale":"2024-09-21T03:53:33.036128+0000","last_undegraded":"2024-09-21T03:53:33.036128+0000","last_fullsized":"2024-09-21T03:53:33.036128+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:43.596037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124177+0000","last_change":"2024-09-21T03:53:13.838006+0000","last_active":"2024-09-21T03:53:33.124177+0000","last_peered":"2024-09-21T03:53:33.124177+0000","last_clean":"2024-09-21T03:53:33.124177+0000","last_became_active":"2024-09-21T03:53:13.835903+0000","last_became_peered":"2024-09-21T03:53:13.835903+0000","last_unstale":"2024-09-21T03:53:33.124177+0000","last_undegraded":"2024-09-21T03:53:33.124177+0000","last_fullsized":"2024-09-21T03:53:33.124177+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:54:56.730044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124836+0000","last_change":"2024-09-21T03:53:33.124720+0000","last_active":"2024-09-21T03:53:33.124836+0000","last_peered":"2024-09-21T03:53:33.124836+0000","last_clean":"2024-09-21T03:53:33.124836+0000","last_became_active":"2024-09-21T03:53:33.124232+0000","last_became_peered":"2024-09-21T03:53:33.124232+0000","last_unstale":"2024-09-21T03:53:33.124836+0000","last_undegraded":"2024-09-21T03:53:33.124836+0000","last_fullsized":"2024-09-21T03:53:33.124836+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:23.810493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124631+0000","last_change":"2024-09-21T03:53:13.827805+0000","last_active":"2024-09-21T03:53:33.124631+0000","last_peered":"2024-09-21T03:53:33.124631+0000","last_clean":"2024-09-21T03:53:33.124631+0000","last_became_active":"2024-09-21T03:53:13.827368+0000","last_became_peered":"2024-09-21T03:53:13.827368+0000","last_unstale":"2024-09-21T03:53:33.124631+0000","last_undegraded":"2024-09-21T03:53:33.124631+0000","last_fullsized":"2024-09-21T03:53:33.124631+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:24.539396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123881+0000","last_change":"2024-09-21T03:53:12.605032+0000","last_active":"2024-09-21T03:53:33.123881+0000","last_peered":"2024-09-21T03:53:33.123881+0000","last_clean":"2024-09-21T03:53:33.123881+0000","last_became_active":"2024-09-21T03:53:12.604561+0000","last_became_peered":"2024-09-21T03:53:12.604561+0000","last_unstale":"2024-09-21T03:53:33.123881+0000","last_undegraded":"2024-09-21T03:53:33.123881+0000","last_fullsized":"2024-09-21T03:53:33.123881+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:20.361768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031744+0000","last_change":"2024-09-21T03:53:13.821539+0000","last_active":"2024-09-21T03:53:33.031744+0000","last_peered":"2024-09-21T03:53:33.031744+0000","last_clean":"2024-09-21T03:53:33.031744+0000","last_became_active":"2024-09-21T03:53:13.821196+0000","last_became_peered":"2024-09-21T03:53:13.821196+0000","last_unstale":"2024-09-21T03:53:33.031744+0000","last_undegraded":"2024-09-21T03:53:33.031744+0000","last_fullsized":"2024-09-21T03:53:33.031744+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:00.627993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'10","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:36.828012+0000","last_change":"2024-09-21T03:53:11.799669+0000","last_active":"2024-09-21T03:53:36.828012+0000","last_peered":"2024-09-21T03:53:36.828012+0000","last_clean":"2024-09-21T03:53:36.828012+0000","last_became_active":"2024-09-21T03:53:11.799355+0000","last_became_peered":"2024-09-21T03:53:11.799355+0000","last_unstale":"2024-09-21T03:53:36.828012+0000","last_undegraded":"2024-09-21T03:53:36.828012+0000","last_fullsized":"2024-09-21T03:53:36.828012+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:33.032206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123797+0000","last_change":"2024-09-21T03:53:13.828551+0000","last_active":"2024-09-21T03:53:33.123797+0000","last_peered":"2024-09-21T03:53:33.123797+0000","last_clean":"2024-09-21T03:53:33.123797+0000","last_became_active":"2024-09-21T03:53:13.828185+0000","last_became_peered":"2024-09-21T03:53:13.828185+0000","last_unstale":"2024-09-21T03:53:33.123797+0000","last_undegraded":"2024-09-21T03:53:33.123797+0000","last_fullsized":"2024-09-21T03:53:33.123797+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:31.852755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124078+0000","last_change":"2024-09-21T03:53:12.279823+0000","last_active":"2024-09-21T03:53:33.124078+0000","last_peered":"2024-09-21T03:53:33.124078+0000","last_clean":"2024-09-21T03:53:33.124078+0000","last_became_active":"2024-09-21T03:53:12.279384+0000","last_became_peered":"2024-09-21T03:53:12.279384+0000","last_unstale":"2024-09-21T03:53:33.124078+0000","last_undegraded":"2024-09-21T03:53:33.124078+0000","last_fullsized":"2024-09-21T03:53:33.124078+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:42.568690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123319+0000","last_change":"2024-09-21T03:53:13.831041+0000","last_active":"2024-09-21T03:53:33.123319+0000","last_peered":"2024-09-21T03:53:33.123319+0000","last_clean":"2024-09-21T03:53:33.123319+0000","last_became_active":"2024-09-21T03:53:13.830654+0000","last_became_peered":"2024-09-21T03:53:13.830654+0000","last_unstale":"2024-09-21T03:53:33.123319+0000","last_undegraded":"2024-09-21T03:53:33.123319+0000","last_fullsized":"2024-09-21T03:53:33.123319+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:04.815719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032478+0000","last_change":"2024-09-21T03:53:12.604949+0000","last_active":"2024-09-21T03:53:33.032478+0000","last_peered":"2024-09-21T03:53:33.032478+0000","last_clean":"2024-09-21T03:53:33.032478+0000","last_became_active":"2024-09-21T03:53:12.604516+0000","last_became_peered":"2024-09-21T03:53:12.604516+0000","last_unstale":"2024-09-21T03:53:33.032478+0000","last_undegraded":"2024-09-21T03:53:33.032478+0000","last_fullsized":"2024-09-21T03:53:33.032478+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:33.964125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123050+0000","last_change":"2024-09-21T03:53:13.834813+0000","last_active":"2024-09-21T03:53:33.123050+0000","last_peered":"2024-09-21T03:53:33.123050+0000","last_clean":"2024-09-21T03:53:33.123050+0000","last_became_active":"2024-09-21T03:53:13.834436+0000","last_became_peered":"2024-09-21T03:53:13.834436+0000","last_unstale":"2024-09-21T03:53:33.123050+0000","last_undegraded":"2024-09-21T03:53:33.123050+0000","last_fullsized":"2024-09-21T03:53:33.123050+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:42:40.990668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122665+0000","last_change":"2024-09-21T03:53:11.801828+0000","last_active":"2024-09-21T03:53:33.122665+0000","last_peered":"2024-09-21T03:53:33.122665+0000","last_clean":"2024-09-21T03:53:33.122665+0000","last_became_active":"2024-09-21T03:53:11.800969+0000","last_became_peered":"2024-09-21T03:53:11.800969+0000","last_unstale":"2024-09-21T03:53:33.122665+0000","last_undegraded":"2024-09-21T03:53:33.122665+0000","last_fullsized":"2024-09-21T03:53:33.122665+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:36.117523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034772+0000","last_change":"2024-09-21T03:53:13.835393+0000","last_active":"2024-09-21T03:53:33.034772+0000","last_peered":"2024-09-21T03:53:33.034772+0000","last_clean":"2024-09-21T03:53:33.034772+0000","last_became_active":"2024-09-21T03:53:13.834541+0000","last_became_peered":"2024-09-21T03:53:13.834541+0000","last_unstale":"2024-09-21T03:53:33.034772+0000","last_undegraded":"2024-09-21T03:53:33.034772+0000","last_fullsized":"2024-09-21T03:53:33.034772+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:40.140004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.125328+0000","last_change":"2024-09-21T03:53:33.124524+0000","last_active":"2024-09-21T03:53:33.125328+0000","last_peered":"2024-09-21T03:53:33.125328+0000","last_clean":"2024-09-21T03:53:33.125328+0000","last_became_active":"2024-09-21T03:53:33.123945+0000","last_became_peered":"2024-09-21T03:53:33.123945+0000","last_unstale":"2024-09-21T03:53:33.125328+0000","last_undegraded":"2024-09-21T03:53:33.125328+0000","last_fullsized":"2024-09-21T03:53:33.125328+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:50.967123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122926+0000","last_change":"2024-09-21T03:53:13.832597+0000","last_active":"2024-09-21T03:53:33.122926+0000","last_peered":"2024-09-21T03:53:33.122926+0000","last_clean":"2024-09-21T03:53:33.122926+0000","last_became_active":"2024-09-21T03:53:13.832237+0000","last_became_peered":"2024-09-21T03:53:13.832237+0000","last_unstale":"2024-09-21T03:53:33.122926+0000","last_undegraded":"2024-09-21T03:53:33.122926+0000","last_fullsized":"2024-09-21T03:53:33.122926+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:31.907478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123185+0000","last_change":"2024-09-21T03:53:11.804875+0000","last_active":"2024-09-21T03:53:33.123185+0000","last_peered":"2024-09-21T03:53:33.123185+0000","last_clean":"2024-09-21T03:53:33.123185+0000","last_became_active":"2024-09-21T03:53:11.804320+0000","last_became_peered":"2024-09-21T03:53:11.804320+0000","last_unstale":"2024-09-21T03:53:33.123185+0000","last_undegraded":"2024-09-21T03:53:33.123185+0000","last_fullsized":"2024-09-21T03:53:33.123185+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:37:58.747573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035965+0000","last_change":"2024-09-21T03:53:13.837804+0000","last_active":"2024-09-21T03:53:33.035965+0000","last_peered":"2024-09-21T03:53:33.035965+0000","last_clean":"2024-09-21T03:53:33.035965+0000","last_became_active":"2024-09-21T03:53:13.837440+0000","last_became_peered":"2024-09-21T03:53:13.837440+0000","last_unstale":"2024-09-21T03:53:33.035965+0000","last_undegraded":"2024-09-21T03:53:33.035965+0000","last_fullsized":"2024-09-21T03:53:33.035965+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:15.471544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040923+0000","last_change":"2024-09-21T03:53:13.833231+0000","last_active":"2024-09-21T03:53:33.040923+0000","last_peered":"2024-09-21T03:53:33.040923+0000","last_clean":"2024-09-21T03:53:33.040923+0000","last_became_active":"2024-09-21T03:53:13.832908+0000","last_became_peered":"2024-09-21T03:53:13.832908+0000","last_unstale":"2024-09-21T03:53:33.040923+0000","last_undegraded":"2024-09-21T03:53:33.040923+0000","last_fullsized":"2024-09-21T03:53:33.040923+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:40.191231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123570+0000","last_change":"2024-09-21T03:53:11.802237+0000","last_active":"2024-09-21T03:53:33.123570+0000","last_peered":"2024-09-21T03:53:33.123570+0000","last_clean":"2024-09-21T03:53:33.123570+0000","last_became_active":"2024-09-21T03:53:11.801845+0000","last_became_peered":"2024-09-21T03:53:11.801845+0000","last_unstale":"2024-09-21T03:53:33.123570+0000","last_undegraded":"2024-09-21T03:53:33.123570+0000","last_fullsized":"2024-09-21T03:53:33.123570+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:34.714908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032488+0000","last_change":"2024-09-21T03:53:13.831495+0000","last_active":"2024-09-21T03:53:33.032488+0000","last_peered":"2024-09-21T03:53:33.032488+0000","last_clean":"2024-09-21T03:53:33.032488+0000","last_became_active":"2024-09-21T03:53:13.831107+0000","last_became_peered":"2024-09-21T03:53:13.831107+0000","last_unstale":"2024-09-21T03:53:33.032488+0000","last_undegraded":"2024-09-21T03:53:33.032488+0000","last_fullsized":"2024-09-21T03:53:33.032488+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:12:09.751036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123850+0000","last_change":"2024-09-21T03:53:11.805910+0000","last_active":"2024-09-21T03:53:33.123850+0000","last_peered":"2024-09-21T03:53:33.123850+0000","last_clean":"2024-09-21T03:53:33.123850+0000","last_became_active":"2024-09-21T03:53:11.805461+0000","last_became_peered":"2024-09-21T03:53:11.805461+0000","last_unstale":"2024-09-21T03:53:33.123850+0000","last_undegraded":"2024-09-21T03:53:33.123850+0000","last_fullsized":"2024-09-21T03:53:33.123850+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:36:56.132055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123607+0000","last_change":"2024-09-21T03:53:13.834930+0000","last_active":"2024-09-21T03:53:33.123607+0000","last_peered":"2024-09-21T03:53:33.123607+0000","last_clean":"2024-09-21T03:53:33.123607+0000","last_became_active":"2024-09-21T03:53:13.834368+0000","last_became_peered":"2024-09-21T03:53:13.834368+0000","last_unstale":"2024-09-21T03:53:33.123607+0000","last_undegraded":"2024-09-21T03:53:33.123607+0000","last_fullsized":"2024-09-21T03:53:33.123607+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:53.798811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123728+0000","last_change":"2024-09-21T03:53:12.604827+0000","last_active":"2024-09-21T03:53:33.123728+0000","last_peered":"2024-09-21T03:53:33.123728+0000","last_clean":"2024-09-21T03:53:33.123728+0000","last_became_active":"2024-09-21T03:53:12.604406+0000","last_became_peered":"2024-09-21T03:53:12.604406+0000","last_unstale":"2024-09-21T03:53:33.123728+0000","last_undegraded":"2024-09-21T03:53:33.123728+0000","last_fullsized":"2024-09-21T03:53:33.123728+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:03:12.942354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123562+0000","last_change":"2024-09-21T03:53:13.830482+0000","last_active":"2024-09-21T03:53:33.123562+0000","last_peered":"2024-09-21T03:53:33.123562+0000","last_clean":"2024-09-21T03:53:33.123562+0000","last_became_active":"2024-09-21T03:53:13.829970+0000","last_became_peered":"2024-09-21T03:53:13.829970+0000","last_unstale":"2024-09-21T03:53:33.123562+0000","last_undegraded":"2024-09-21T03:53:33.123562+0000","last_fullsized":"2024-09-21T03:53:33.123562+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:21.617459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035213+0000","last_change":"2024-09-21T03:53:11.801931+0000","last_active":"2024-09-21T03:53:33.035213+0000","last_peered":"2024-09-21T03:53:33.035213+0000","last_clean":"2024-09-21T03:53:33.035213+0000","last_became_active":"2024-09-21T03:53:11.801587+0000","last_became_peered":"2024-09-21T03:53:11.801587+0000","last_unstale":"2024-09-21T03:53:33.035213+0000","last_undegraded":"2024-09-21T03:53:33.035213+0000","last_fullsized":"2024-09-21T03:53:33.035213+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:47.329060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68063,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":208,"num_read_kb":172,"num_write":87,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":204189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285514,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743458,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":831488,"data_stored":416577,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939688,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":1074521,"data_compressed":42053,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103213,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":835584,"data_stored":417159,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299442,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":839680,"data_stored":417181,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462967,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":888832,"data_stored":1007644,"data_compressed":42053,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626492,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":835584,"data_stored":416694,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822722,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":897024,"data_stored":1007244,"data_compressed":42053,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986247,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":835584,"data_stored":416599,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182474,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36172,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708980,"statfs":{"total":95995035648,"available":95957995520,"internally_reserved":0,"allocated":847872,"data_stored":416915,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378705,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":483876,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542230,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":483842,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705755,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":835584,"data_stored":416667,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34678,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34678,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34678,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36296,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36296,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36296,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36296,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36296,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":67265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":67299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":67459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:54:58.244 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-21T03:54:58.244 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:54:58.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.397+0000 7f364b9b0640 1 -- 172.21.15.46:0/2158856565 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36441082f0 msgr2=0x7f3644108700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:58.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.397+0000 7f364b9b0640 1 --2- 172.21.15.46:0/2158856565 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36441082f0 0x7f3644108700 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3634009900 tx=0x7f363402a410 comp rx=0 tx=0).stop 2024-09-21T03:54:58.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.397+0000 7f364b9b0640 1 -- 172.21.15.46:0/2158856565 shutdown_connections 2024-09-21T03:54:58.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.397+0000 7f364b9b0640 1 --2- 172.21.15.46:0/2158856565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3644108c40 0x7f364410f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:58.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.397+0000 7f364b9b0640 1 --2- 172.21.15.46:0/2158856565 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36441082f0 0x7f3644108700 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:58.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.397+0000 7f364b9b0640 1 --2- 172.21.15.46:0/2158856565 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36441029c0 0x7f3644102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:58.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.397+0000 7f364b9b0640 1 -- 172.21.15.46:0/2158856565 >> 172.21.15.46:0/2158856565 conn(0x7f36440fe3c0 msgr2=0x7f3644100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:58.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.397+0000 7f364b9b0640 1 -- 172.21.15.46:0/2158856565 shutdown_connections 2024-09-21T03:54:58.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.397+0000 7f364b9b0640 1 -- 172.21.15.46:0/2158856565 wait complete. 2024-09-21T03:54:58.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.397+0000 7f364b9b0640 1 Processor -- start 2024-09-21T03:54:58.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.398+0000 7f364b9b0640 1 -- start start 2024-09-21T03:54:58.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.398+0000 7f364b9b0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36441029c0 0x7f364419b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:58.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.398+0000 7f364b9b0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36441082f0 0x7f364419b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:58.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.398+0000 7f364b9b0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3644108c40 0x7f364419bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:58.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.398+0000 7f364b9b0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3644112900 con 0x7f36441082f0 2024-09-21T03:54:58.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.398+0000 7f364b9b0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3644112780 con 0x7f3644108c40 2024-09-21T03:54:58.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.398+0000 7f364b9b0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3644112a80 con 0x7f36441029c0 2024-09-21T03:54:58.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.398+0000 7f3648f4b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36441082f0 0x7f364419b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:58.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.398+0000 7f3648f4b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36441082f0 0x7f364419b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58726/0 (socket says 172.21.15.46:58726) 2024-09-21T03:54:58.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.398+0000 7f3648f4b640 1 -- 172.21.15.46:0/2368399007 learned_addr learned my addr 172.21.15.46:0/2368399007 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:58.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.398+0000 7f364974c640 1 --2- 172.21.15.46:0/2368399007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36441029c0 0x7f364419b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:58.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.398+0000 7f3649f4d640 1 --2- 172.21.15.46:0/2368399007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3644108c40 0x7f364419bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:58.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.398+0000 7f3648f4b640 1 -- 172.21.15.46:0/2368399007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36441029c0 msgr2=0x7f364419b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:58.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.398+0000 7f3648f4b640 1 --2- 172.21.15.46:0/2368399007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36441029c0 0x7f364419b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:58.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.398+0000 7f3648f4b640 1 -- 172.21.15.46:0/2368399007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3644108c40 msgr2=0x7f364419bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:58.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.398+0000 7f3648f4b640 1 --2- 172.21.15.46:0/2368399007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3644108c40 0x7f364419bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:58.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.398+0000 7f3648f4b640 1 -- 172.21.15.46:0/2368399007 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36441a6450 con 0x7f36441082f0 2024-09-21T03:54:58.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.399+0000 7f3648f4b640 1 --2- 172.21.15.46:0/2368399007 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36441082f0 0x7f364419b790 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f363402a930 tx=0x7f3634004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:58.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.399+0000 7f363a7fc640 1 -- 172.21.15.46:0/2368399007 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363403f030 con 0x7f36441082f0 2024-09-21T03:54:58.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.399+0000 7f364b9b0640 1 -- 172.21.15.46:0/2368399007 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36441a66e0 con 0x7f36441082f0 2024-09-21T03:54:58.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.399+0000 7f363a7fc640 1 -- 172.21.15.46:0/2368399007 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3634003aa0 con 0x7f36441082f0 2024-09-21T03:54:58.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.399+0000 7f363a7fc640 1 -- 172.21.15.46:0/2368399007 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3634035070 con 0x7f36441082f0 2024-09-21T03:54:58.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.399+0000 7f364b9b0640 1 -- 172.21.15.46:0/2368399007 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36441a6c20 con 0x7f36441082f0 2024-09-21T03:54:58.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.400+0000 7f364b9b0640 1 -- 172.21.15.46:0/2368399007 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3644102dd0 con 0x7f36441082f0 2024-09-21T03:54:58.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.402+0000 7f363a7fc640 1 -- 172.21.15.46:0/2368399007 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f3634042030 con 0x7f36441082f0 2024-09-21T03:54:58.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.403+0000 7f363a7fc640 1 --2- 172.21.15.46:0/2368399007 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f36300b65f0 0x7f36300b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:58.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.403+0000 7f364974c640 1 --2- 172.21.15.46:0/2368399007 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f36300b65f0 0x7f36300b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:58.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.403+0000 7f363a7fc640 1 -- 172.21.15.46:0/2368399007 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f36341080b0 con 0x7f36441082f0 2024-09-21T03:54:58.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.403+0000 7f364974c640 1 --2- 172.21.15.46:0/2368399007 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f36300b65f0 0x7f36300b8b00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f364406c470 tx=0x7f364000a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:58.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.405+0000 7f363a7fc640 1 -- 172.21.15.46:0/2368399007 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f36340ce760 con 0x7f36441082f0 2024-09-21T03:54:58.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.593+0000 7f364b9b0640 1 -- 172.21.15.46:0/2368399007 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3644063800 con 0x7f36300b65f0 2024-09-21T03:54:58.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.598+0000 7f363a7fc640 1 -- 172.21.15.46:0/2368399007 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258885 (secure 0 0 0) 0x7f3644063800 con 0x7f36300b65f0 2024-09-21T03:54:58.600 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:54:58.603 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-09-21T03:54:58.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.601+0000 7f364b9b0640 1 -- 172.21.15.46:0/2368399007 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f36300b65f0 msgr2=0x7f36300b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:58.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.601+0000 7f364b9b0640 1 --2- 172.21.15.46:0/2368399007 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f36300b65f0 0x7f36300b8b00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f364406c470 tx=0x7f364000a2d0 comp rx=0 tx=0).stop 2024-09-21T03:54:58.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.601+0000 7f364b9b0640 1 -- 172.21.15.46:0/2368399007 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36441082f0 msgr2=0x7f364419b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:58.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.601+0000 7f364b9b0640 1 --2- 172.21.15.46:0/2368399007 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36441082f0 0x7f364419b790 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f363402a930 tx=0x7f3634004270 comp rx=0 tx=0).stop 2024-09-21T03:54:58.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.601+0000 7f364b9b0640 1 -- 172.21.15.46:0/2368399007 shutdown_connections 2024-09-21T03:54:58.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.601+0000 7f364b9b0640 1 --2- 172.21.15.46:0/2368399007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3644108c40 0x7f364419bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:58.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.601+0000 7f364b9b0640 1 --2- 172.21.15.46:0/2368399007 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36441082f0 0x7f364419b790 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:58.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.601+0000 7f364b9b0640 1 --2- 172.21.15.46:0/2368399007 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f36300b65f0 0x7f36300b8b00 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:58.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.601+0000 7f364b9b0640 1 --2- 172.21.15.46:0/2368399007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36441029c0 0x7f364419b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:58.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.601+0000 7f364b9b0640 1 -- 172.21.15.46:0/2368399007 >> 172.21.15.46:0/2368399007 conn(0x7f36440fe3c0 msgr2=0x7f36441079a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:58.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.601+0000 7f364b9b0640 1 -- 172.21.15.46:0/2368399007 shutdown_connections 2024-09-21T03:54:58.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:58.601+0000 7f364b9b0640 1 -- 172.21.15.46:0/2368399007 wait complete. 2024-09-21T03:54:58.615 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":318,"stamp":"2024-09-21T03:54:58.070012+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658665,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":289,"num_read_kb":241,"num_write":212,"num_write_kb":2248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":166,"ondisk_log_size":166,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":380292,"kb_used_data":10200,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124561532,"statfs":{"total":1151940427776,"available":1151551008768,"internally_reserved":0,"allocated":10444800,"data_stored":6974919,"data_compressed":177972,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":308,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":16,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002901"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034971+0000","last_change":"2024-09-21T03:53:13.835177+0000","last_active":"2024-09-21T03:53:33.034971+0000","last_peered":"2024-09-21T03:53:33.034971+0000","last_clean":"2024-09-21T03:53:33.034971+0000","last_became_active":"2024-09-21T03:53:13.834779+0000","last_became_peered":"2024-09-21T03:53:13.834779+0000","last_unstale":"2024-09-21T03:53:33.034971+0000","last_undegraded":"2024-09-21T03:53:33.034971+0000","last_fullsized":"2024-09-21T03:53:33.034971+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:10.632059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123205+0000","last_change":"2024-09-21T03:53:13.829689+0000","last_active":"2024-09-21T03:53:33.123205+0000","last_peered":"2024-09-21T03:53:33.123205+0000","last_clean":"2024-09-21T03:53:33.123205+0000","last_became_active":"2024-09-21T03:53:13.828732+0000","last_became_peered":"2024-09-21T03:53:13.828732+0000","last_unstale":"2024-09-21T03:53:33.123205+0000","last_undegraded":"2024-09-21T03:53:33.123205+0000","last_fullsized":"2024-09-21T03:53:33.123205+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:35.270218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123057+0000","last_change":"2024-09-21T03:53:13.836545+0000","last_active":"2024-09-21T03:53:33.123057+0000","last_peered":"2024-09-21T03:53:33.123057+0000","last_clean":"2024-09-21T03:53:33.123057+0000","last_became_active":"2024-09-21T03:53:13.835781+0000","last_became_peered":"2024-09-21T03:53:13.835781+0000","last_unstale":"2024-09-21T03:53:33.123057+0000","last_undegraded":"2024-09-21T03:53:33.123057+0000","last_fullsized":"2024-09-21T03:53:33.123057+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:13.130016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123786+0000","last_change":"2024-09-21T03:53:13.832292+0000","last_active":"2024-09-21T03:53:33.123786+0000","last_peered":"2024-09-21T03:53:33.123786+0000","last_clean":"2024-09-21T03:53:33.123786+0000","last_became_active":"2024-09-21T03:53:13.831311+0000","last_became_peered":"2024-09-21T03:53:13.831311+0000","last_unstale":"2024-09-21T03:53:33.123786+0000","last_undegraded":"2024-09-21T03:53:33.123786+0000","last_fullsized":"2024-09-21T03:53:33.123786+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:38:49.425261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123152+0000","last_change":"2024-09-21T03:53:13.825130+0000","last_active":"2024-09-21T03:53:33.123152+0000","last_peered":"2024-09-21T03:53:33.123152+0000","last_clean":"2024-09-21T03:53:33.123152+0000","last_became_active":"2024-09-21T03:53:13.824795+0000","last_became_peered":"2024-09-21T03:53:13.824795+0000","last_unstale":"2024-09-21T03:53:33.123152+0000","last_undegraded":"2024-09-21T03:53:33.123152+0000","last_fullsized":"2024-09-21T03:53:33.123152+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:22.653270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123230+0000","last_change":"2024-09-21T03:53:13.834449+0000","last_active":"2024-09-21T03:53:33.123230+0000","last_peered":"2024-09-21T03:53:33.123230+0000","last_clean":"2024-09-21T03:53:33.123230+0000","last_became_active":"2024-09-21T03:53:13.832727+0000","last_became_peered":"2024-09-21T03:53:13.832727+0000","last_unstale":"2024-09-21T03:53:33.123230+0000","last_undegraded":"2024-09-21T03:53:33.123230+0000","last_fullsized":"2024-09-21T03:53:33.123230+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:36.479962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035845+0000","last_change":"2024-09-21T03:53:13.821938+0000","last_active":"2024-09-21T03:53:33.035845+0000","last_peered":"2024-09-21T03:53:33.035845+0000","last_clean":"2024-09-21T03:53:33.035845+0000","last_became_active":"2024-09-21T03:53:13.821569+0000","last_became_peered":"2024-09-21T03:53:13.821569+0000","last_unstale":"2024-09-21T03:53:33.035845+0000","last_undegraded":"2024-09-21T03:53:33.035845+0000","last_fullsized":"2024-09-21T03:53:33.035845+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:04.309212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122491+0000","last_change":"2024-09-21T03:53:13.833471+0000","last_active":"2024-09-21T03:53:33.122491+0000","last_peered":"2024-09-21T03:53:33.122491+0000","last_clean":"2024-09-21T03:53:33.122491+0000","last_became_active":"2024-09-21T03:53:13.832779+0000","last_became_peered":"2024-09-21T03:53:13.832779+0000","last_unstale":"2024-09-21T03:53:33.122491+0000","last_undegraded":"2024-09-21T03:53:33.122491+0000","last_fullsized":"2024-09-21T03:53:33.122491+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:15.402265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032934+0000","last_change":"2024-09-21T03:53:13.833077+0000","last_active":"2024-09-21T03:53:33.032934+0000","last_peered":"2024-09-21T03:53:33.032934+0000","last_clean":"2024-09-21T03:53:33.032934+0000","last_became_active":"2024-09-21T03:53:13.832625+0000","last_became_peered":"2024-09-21T03:53:13.832625+0000","last_unstale":"2024-09-21T03:53:33.032934+0000","last_undegraded":"2024-09-21T03:53:33.032934+0000","last_fullsized":"2024-09-21T03:53:33.032934+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:13.158754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124857+0000","last_change":"2024-09-21T03:53:13.835417+0000","last_active":"2024-09-21T03:53:33.124857+0000","last_peered":"2024-09-21T03:53:33.124857+0000","last_clean":"2024-09-21T03:53:33.124857+0000","last_became_active":"2024-09-21T03:53:13.835081+0000","last_became_peered":"2024-09-21T03:53:13.835081+0000","last_unstale":"2024-09-21T03:53:33.124857+0000","last_undegraded":"2024-09-21T03:53:33.124857+0000","last_fullsized":"2024-09-21T03:53:33.124857+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:29.239879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036187+0000","last_change":"2024-09-21T03:53:13.836575+0000","last_active":"2024-09-21T03:53:33.036187+0000","last_peered":"2024-09-21T03:53:33.036187+0000","last_clean":"2024-09-21T03:53:33.036187+0000","last_became_active":"2024-09-21T03:53:13.836184+0000","last_became_peered":"2024-09-21T03:53:13.836184+0000","last_unstale":"2024-09-21T03:53:33.036187+0000","last_undegraded":"2024-09-21T03:53:33.036187+0000","last_fullsized":"2024-09-21T03:53:33.036187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:06.602354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.126314+0000","last_change":"2024-09-21T03:53:33.125896+0000","last_active":"2024-09-21T03:53:33.126314+0000","last_peered":"2024-09-21T03:53:33.126314+0000","last_clean":"2024-09-21T03:53:33.126314+0000","last_became_active":"2024-09-21T03:53:33.125488+0000","last_became_peered":"2024-09-21T03:53:33.125488+0000","last_unstale":"2024-09-21T03:53:33.126314+0000","last_undegraded":"2024-09-21T03:53:33.126314+0000","last_fullsized":"2024-09-21T03:53:33.126314+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:09.742892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031708+0000","last_change":"2024-09-21T03:53:13.814729+0000","last_active":"2024-09-21T03:53:33.031708+0000","last_peered":"2024-09-21T03:53:33.031708+0000","last_clean":"2024-09-21T03:53:33.031708+0000","last_became_active":"2024-09-21T03:53:13.814317+0000","last_became_peered":"2024-09-21T03:53:13.814317+0000","last_unstale":"2024-09-21T03:53:33.031708+0000","last_undegraded":"2024-09-21T03:53:33.031708+0000","last_fullsized":"2024-09-21T03:53:33.031708+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:30.779754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122847+0000","last_change":"2024-09-21T03:53:13.833280+0000","last_active":"2024-09-21T03:53:33.122847+0000","last_peered":"2024-09-21T03:53:33.122847+0000","last_clean":"2024-09-21T03:53:33.122847+0000","last_became_active":"2024-09-21T03:53:13.831799+0000","last_became_peered":"2024-09-21T03:53:13.831799+0000","last_unstale":"2024-09-21T03:53:33.122847+0000","last_undegraded":"2024-09-21T03:53:33.122847+0000","last_fullsized":"2024-09-21T03:53:33.122847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:33.923946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122733+0000","last_change":"2024-09-21T03:53:13.832142+0000","last_active":"2024-09-21T03:53:33.122733+0000","last_peered":"2024-09-21T03:53:33.122733+0000","last_clean":"2024-09-21T03:53:33.122733+0000","last_became_active":"2024-09-21T03:53:13.831756+0000","last_became_peered":"2024-09-21T03:53:13.831756+0000","last_unstale":"2024-09-21T03:53:33.122733+0000","last_undegraded":"2024-09-21T03:53:33.122733+0000","last_fullsized":"2024-09-21T03:53:33.122733+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:43.941161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032362+0000","last_change":"2024-09-21T03:53:13.834085+0000","last_active":"2024-09-21T03:53:33.032362+0000","last_peered":"2024-09-21T03:53:33.032362+0000","last_clean":"2024-09-21T03:53:33.032362+0000","last_became_active":"2024-09-21T03:53:13.833668+0000","last_became_peered":"2024-09-21T03:53:13.833668+0000","last_unstale":"2024-09-21T03:53:33.032362+0000","last_undegraded":"2024-09-21T03:53:33.032362+0000","last_fullsized":"2024-09-21T03:53:33.032362+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:08:26.939873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035098+0000","last_change":"2024-09-21T03:53:13.836133+0000","last_active":"2024-09-21T03:53:33.035098+0000","last_peered":"2024-09-21T03:53:33.035098+0000","last_clean":"2024-09-21T03:53:33.035098+0000","last_became_active":"2024-09-21T03:53:13.835681+0000","last_became_peered":"2024-09-21T03:53:13.835681+0000","last_unstale":"2024-09-21T03:53:33.035098+0000","last_undegraded":"2024-09-21T03:53:33.035098+0000","last_fullsized":"2024-09-21T03:53:33.035098+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:58:02.691622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035103+0000","last_change":"2024-09-21T03:53:13.834069+0000","last_active":"2024-09-21T03:53:33.035103+0000","last_peered":"2024-09-21T03:53:33.035103+0000","last_clean":"2024-09-21T03:53:33.035103+0000","last_became_active":"2024-09-21T03:53:13.833714+0000","last_became_peered":"2024-09-21T03:53:13.833714+0000","last_unstale":"2024-09-21T03:53:33.035103+0000","last_undegraded":"2024-09-21T03:53:33.035103+0000","last_fullsized":"2024-09-21T03:53:33.035103+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:12.479790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.095236+0000","last_change":"2024-09-21T03:53:13.827788+0000","last_active":"2024-09-21T03:53:33.095236+0000","last_peered":"2024-09-21T03:53:33.095236+0000","last_clean":"2024-09-21T03:53:33.095236+0000","last_became_active":"2024-09-21T03:53:13.827461+0000","last_became_peered":"2024-09-21T03:53:13.827461+0000","last_unstale":"2024-09-21T03:53:33.095236+0000","last_undegraded":"2024-09-21T03:53:33.095236+0000","last_fullsized":"2024-09-21T03:53:33.095236+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:38.003243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034635+0000","last_change":"2024-09-21T03:53:13.836880+0000","last_active":"2024-09-21T03:53:33.034635+0000","last_peered":"2024-09-21T03:53:33.034635+0000","last_clean":"2024-09-21T03:53:33.034635+0000","last_became_active":"2024-09-21T03:53:13.836531+0000","last_became_peered":"2024-09-21T03:53:13.836531+0000","last_unstale":"2024-09-21T03:53:33.034635+0000","last_undegraded":"2024-09-21T03:53:33.034635+0000","last_fullsized":"2024-09-21T03:53:33.034635+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:52.825826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031827+0000","last_change":"2024-09-21T03:53:13.823160+0000","last_active":"2024-09-21T03:53:33.031827+0000","last_peered":"2024-09-21T03:53:33.031827+0000","last_clean":"2024-09-21T03:53:33.031827+0000","last_became_active":"2024-09-21T03:53:13.822076+0000","last_became_peered":"2024-09-21T03:53:13.822076+0000","last_unstale":"2024-09-21T03:53:33.031827+0000","last_undegraded":"2024-09-21T03:53:33.031827+0000","last_fullsized":"2024-09-21T03:53:33.031827+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:26.277249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032827+0000","last_change":"2024-09-21T03:53:13.831822+0000","last_active":"2024-09-21T03:53:33.032827+0000","last_peered":"2024-09-21T03:53:33.032827+0000","last_clean":"2024-09-21T03:53:33.032827+0000","last_became_active":"2024-09-21T03:53:13.831395+0000","last_became_peered":"2024-09-21T03:53:13.831395+0000","last_unstale":"2024-09-21T03:53:33.032827+0000","last_undegraded":"2024-09-21T03:53:33.032827+0000","last_fullsized":"2024-09-21T03:53:33.032827+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:48.541339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122588+0000","last_change":"2024-09-21T03:53:13.834576+0000","last_active":"2024-09-21T03:53:33.122588+0000","last_peered":"2024-09-21T03:53:33.122588+0000","last_clean":"2024-09-21T03:53:33.122588+0000","last_became_active":"2024-09-21T03:53:13.834229+0000","last_became_peered":"2024-09-21T03:53:13.834229+0000","last_unstale":"2024-09-21T03:53:33.122588+0000","last_undegraded":"2024-09-21T03:53:33.122588+0000","last_fullsized":"2024-09-21T03:53:33.122588+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:36.101399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040298+0000","last_change":"2024-09-21T03:53:13.824049+0000","last_active":"2024-09-21T03:53:33.040298+0000","last_peered":"2024-09-21T03:53:33.040298+0000","last_clean":"2024-09-21T03:53:33.040298+0000","last_became_active":"2024-09-21T03:53:13.823510+0000","last_became_peered":"2024-09-21T03:53:13.823510+0000","last_unstale":"2024-09-21T03:53:33.040298+0000","last_undegraded":"2024-09-21T03:53:33.040298+0000","last_fullsized":"2024-09-21T03:53:33.040298+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:36.615951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123804+0000","last_change":"2024-09-21T03:53:13.837327+0000","last_active":"2024-09-21T03:53:33.123804+0000","last_peered":"2024-09-21T03:53:33.123804+0000","last_clean":"2024-09-21T03:53:33.123804+0000","last_became_active":"2024-09-21T03:53:13.836940+0000","last_became_peered":"2024-09-21T03:53:13.836940+0000","last_unstale":"2024-09-21T03:53:33.123804+0000","last_undegraded":"2024-09-21T03:53:33.123804+0000","last_fullsized":"2024-09-21T03:53:33.123804+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:49.248838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.095260+0000","last_change":"2024-09-21T03:53:13.829540+0000","last_active":"2024-09-21T03:53:33.095260+0000","last_peered":"2024-09-21T03:53:33.095260+0000","last_clean":"2024-09-21T03:53:33.095260+0000","last_became_active":"2024-09-21T03:53:13.828953+0000","last_became_peered":"2024-09-21T03:53:13.828953+0000","last_unstale":"2024-09-21T03:53:33.095260+0000","last_undegraded":"2024-09-21T03:53:33.095260+0000","last_fullsized":"2024-09-21T03:53:33.095260+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:07.631226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034762+0000","last_change":"2024-09-21T03:53:13.835009+0000","last_active":"2024-09-21T03:53:33.034762+0000","last_peered":"2024-09-21T03:53:33.034762+0000","last_clean":"2024-09-21T03:53:33.034762+0000","last_became_active":"2024-09-21T03:53:13.834454+0000","last_became_peered":"2024-09-21T03:53:13.834454+0000","last_unstale":"2024-09-21T03:53:33.034762+0000","last_undegraded":"2024-09-21T03:53:33.034762+0000","last_fullsized":"2024-09-21T03:53:33.034762+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:34:06.114394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031624+0000","last_change":"2024-09-21T03:53:13.826846+0000","last_active":"2024-09-21T03:53:33.031624+0000","last_peered":"2024-09-21T03:53:33.031624+0000","last_clean":"2024-09-21T03:53:33.031624+0000","last_became_active":"2024-09-21T03:53:13.826460+0000","last_became_peered":"2024-09-21T03:53:13.826460+0000","last_unstale":"2024-09-21T03:53:33.031624+0000","last_undegraded":"2024-09-21T03:53:33.031624+0000","last_fullsized":"2024-09-21T03:53:33.031624+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:24.081091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123429+0000","last_change":"2024-09-21T03:53:13.837134+0000","last_active":"2024-09-21T03:53:33.123429+0000","last_peered":"2024-09-21T03:53:33.123429+0000","last_clean":"2024-09-21T03:53:33.123429+0000","last_became_active":"2024-09-21T03:53:13.836729+0000","last_became_peered":"2024-09-21T03:53:13.836729+0000","last_unstale":"2024-09-21T03:53:33.123429+0000","last_undegraded":"2024-09-21T03:53:33.123429+0000","last_fullsized":"2024-09-21T03:53:33.123429+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:08.677375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.094680+0000","last_change":"2024-09-21T03:53:13.838100+0000","last_active":"2024-09-21T03:53:33.094680+0000","last_peered":"2024-09-21T03:53:33.094680+0000","last_clean":"2024-09-21T03:53:33.094680+0000","last_became_active":"2024-09-21T03:53:13.833495+0000","last_became_peered":"2024-09-21T03:53:13.833495+0000","last_unstale":"2024-09-21T03:53:33.094680+0000","last_undegraded":"2024-09-21T03:53:33.094680+0000","last_fullsized":"2024-09-21T03:53:33.094680+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:52:00.705434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.095021+0000","last_change":"2024-09-21T03:53:13.835806+0000","last_active":"2024-09-21T03:53:33.095021+0000","last_peered":"2024-09-21T03:53:33.095021+0000","last_clean":"2024-09-21T03:53:33.095021+0000","last_became_active":"2024-09-21T03:53:13.835453+0000","last_became_peered":"2024-09-21T03:53:13.835453+0000","last_unstale":"2024-09-21T03:53:33.095021+0000","last_undegraded":"2024-09-21T03:53:33.095021+0000","last_fullsized":"2024-09-21T03:53:33.095021+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:56:16.296808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034530+0000","last_change":"2024-09-21T03:53:13.831171+0000","last_active":"2024-09-21T03:53:33.034530+0000","last_peered":"2024-09-21T03:53:33.034530+0000","last_clean":"2024-09-21T03:53:33.034530+0000","last_became_active":"2024-09-21T03:53:13.830734+0000","last_became_peered":"2024-09-21T03:53:13.830734+0000","last_unstale":"2024-09-21T03:53:33.034530+0000","last_undegraded":"2024-09-21T03:53:33.034530+0000","last_fullsized":"2024-09-21T03:53:33.034530+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:00:56.033435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123100+0000","last_change":"2024-09-21T03:53:13.820580+0000","last_active":"2024-09-21T03:53:33.123100+0000","last_peered":"2024-09-21T03:53:33.123100+0000","last_clean":"2024-09-21T03:53:33.123100+0000","last_became_active":"2024-09-21T03:53:13.820237+0000","last_became_peered":"2024-09-21T03:53:13.820237+0000","last_unstale":"2024-09-21T03:53:33.123100+0000","last_undegraded":"2024-09-21T03:53:33.123100+0000","last_fullsized":"2024-09-21T03:53:33.123100+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:15.067629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040549+0000","last_change":"2024-09-21T03:53:11.804667+0000","last_active":"2024-09-21T03:53:33.040549+0000","last_peered":"2024-09-21T03:53:33.040549+0000","last_clean":"2024-09-21T03:53:33.040549+0000","last_became_active":"2024-09-21T03:53:11.804231+0000","last_became_peered":"2024-09-21T03:53:11.804231+0000","last_unstale":"2024-09-21T03:53:33.040549+0000","last_undegraded":"2024-09-21T03:53:33.040549+0000","last_fullsized":"2024-09-21T03:53:33.040549+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:36.425699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040361+0000","last_change":"2024-09-21T03:53:13.831602+0000","last_active":"2024-09-21T03:53:33.040361+0000","last_peered":"2024-09-21T03:53:33.040361+0000","last_clean":"2024-09-21T03:53:33.040361+0000","last_became_active":"2024-09-21T03:53:13.831274+0000","last_became_peered":"2024-09-21T03:53:13.831274+0000","last_unstale":"2024-09-21T03:53:33.040361+0000","last_undegraded":"2024-09-21T03:53:33.040361+0000","last_fullsized":"2024-09-21T03:53:33.040361+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:33.603025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123276+0000","last_change":"2024-09-21T03:53:11.807722+0000","last_active":"2024-09-21T03:53:33.123276+0000","last_peered":"2024-09-21T03:53:33.123276+0000","last_clean":"2024-09-21T03:53:33.123276+0000","last_became_active":"2024-09-21T03:53:11.807294+0000","last_became_peered":"2024-09-21T03:53:11.807294+0000","last_unstale":"2024-09-21T03:53:33.123276+0000","last_undegraded":"2024-09-21T03:53:33.123276+0000","last_fullsized":"2024-09-21T03:53:33.123276+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:59.696572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031405+0000","last_change":"2024-09-21T03:53:11.803680+0000","last_active":"2024-09-21T03:53:33.031405+0000","last_peered":"2024-09-21T03:53:33.031405+0000","last_clean":"2024-09-21T03:53:33.031405+0000","last_became_active":"2024-09-21T03:53:11.803310+0000","last_became_peered":"2024-09-21T03:53:11.803310+0000","last_unstale":"2024-09-21T03:53:33.031405+0000","last_undegraded":"2024-09-21T03:53:33.031405+0000","last_fullsized":"2024-09-21T03:53:33.031405+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:25.276545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122501+0000","last_change":"2024-09-21T03:53:13.834847+0000","last_active":"2024-09-21T03:53:33.122501+0000","last_peered":"2024-09-21T03:53:33.122501+0000","last_clean":"2024-09-21T03:53:33.122501+0000","last_became_active":"2024-09-21T03:53:13.834448+0000","last_became_peered":"2024-09-21T03:53:13.834448+0000","last_unstale":"2024-09-21T03:53:33.122501+0000","last_undegraded":"2024-09-21T03:53:33.122501+0000","last_fullsized":"2024-09-21T03:53:33.122501+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:47:39.213364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040606+0000","last_change":"2024-09-21T03:53:11.807372+0000","last_active":"2024-09-21T03:53:33.040606+0000","last_peered":"2024-09-21T03:53:33.040606+0000","last_clean":"2024-09-21T03:53:33.040606+0000","last_became_active":"2024-09-21T03:53:11.807064+0000","last_became_peered":"2024-09-21T03:53:11.807064+0000","last_unstale":"2024-09-21T03:53:33.040606+0000","last_undegraded":"2024-09-21T03:53:33.040606+0000","last_fullsized":"2024-09-21T03:53:33.040606+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:00.743039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034954+0000","last_change":"2024-09-21T03:53:13.821169+0000","last_active":"2024-09-21T03:53:33.034954+0000","last_peered":"2024-09-21T03:53:33.034954+0000","last_clean":"2024-09-21T03:53:33.034954+0000","last_became_active":"2024-09-21T03:53:13.820810+0000","last_became_peered":"2024-09-21T03:53:13.820810+0000","last_unstale":"2024-09-21T03:53:33.034954+0000","last_undegraded":"2024-09-21T03:53:33.034954+0000","last_fullsized":"2024-09-21T03:53:33.034954+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:54.568383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124708+0000","last_change":"2024-09-21T03:53:11.805663+0000","last_active":"2024-09-21T03:53:33.124708+0000","last_peered":"2024-09-21T03:53:33.124708+0000","last_clean":"2024-09-21T03:53:33.124708+0000","last_became_active":"2024-09-21T03:53:11.805099+0000","last_became_peered":"2024-09-21T03:53:11.805099+0000","last_unstale":"2024-09-21T03:53:33.124708+0000","last_undegraded":"2024-09-21T03:53:33.124708+0000","last_fullsized":"2024-09-21T03:53:33.124708+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:47.306589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032728+0000","last_change":"2024-09-21T03:53:13.827745+0000","last_active":"2024-09-21T03:53:33.032728+0000","last_peered":"2024-09-21T03:53:33.032728+0000","last_clean":"2024-09-21T03:53:33.032728+0000","last_became_active":"2024-09-21T03:53:13.827229+0000","last_became_peered":"2024-09-21T03:53:13.827229+0000","last_unstale":"2024-09-21T03:53:33.032728+0000","last_undegraded":"2024-09-21T03:53:33.032728+0000","last_fullsized":"2024-09-21T03:53:33.032728+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:53.760919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036288+0000","last_change":"2024-09-21T03:53:11.803697+0000","last_active":"2024-09-21T03:53:33.036288+0000","last_peered":"2024-09-21T03:53:33.036288+0000","last_clean":"2024-09-21T03:53:33.036288+0000","last_became_active":"2024-09-21T03:53:11.801539+0000","last_became_peered":"2024-09-21T03:53:11.801539+0000","last_unstale":"2024-09-21T03:53:33.036288+0000","last_undegraded":"2024-09-21T03:53:33.036288+0000","last_fullsized":"2024-09-21T03:53:33.036288+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:53.096622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123637+0000","last_change":"2024-09-21T03:53:13.832771+0000","last_active":"2024-09-21T03:53:33.123637+0000","last_peered":"2024-09-21T03:53:33.123637+0000","last_clean":"2024-09-21T03:53:33.123637+0000","last_became_active":"2024-09-21T03:53:13.832414+0000","last_became_peered":"2024-09-21T03:53:13.832414+0000","last_unstale":"2024-09-21T03:53:33.123637+0000","last_undegraded":"2024-09-21T03:53:33.123637+0000","last_fullsized":"2024-09-21T03:53:33.123637+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:58:42.287731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.041017+0000","last_change":"2024-09-21T03:53:12.604482+0000","last_active":"2024-09-21T03:53:33.041017+0000","last_peered":"2024-09-21T03:53:33.041017+0000","last_clean":"2024-09-21T03:53:33.041017+0000","last_became_active":"2024-09-21T03:53:12.603973+0000","last_became_peered":"2024-09-21T03:53:12.603973+0000","last_unstale":"2024-09-21T03:53:33.041017+0000","last_undegraded":"2024-09-21T03:53:33.041017+0000","last_fullsized":"2024-09-21T03:53:33.041017+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:11.932329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032506+0000","last_change":"2024-09-21T03:53:13.842106+0000","last_active":"2024-09-21T03:53:33.032506+0000","last_peered":"2024-09-21T03:53:33.032506+0000","last_clean":"2024-09-21T03:53:33.032506+0000","last_became_active":"2024-09-21T03:53:13.841758+0000","last_became_peered":"2024-09-21T03:53:13.841758+0000","last_unstale":"2024-09-21T03:53:33.032506+0000","last_undegraded":"2024-09-21T03:53:33.032506+0000","last_fullsized":"2024-09-21T03:53:33.032506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:37.045045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'30","reported_seq":255,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:54:57.044797+0000","last_change":"2024-09-21T03:53:11.805385+0000","last_active":"2024-09-21T03:54:57.044797+0000","last_peered":"2024-09-21T03:54:57.044797+0000","last_clean":"2024-09-21T03:54:57.044797+0000","last_became_active":"2024-09-21T03:53:11.804958+0000","last_became_peered":"2024-09-21T03:53:11.804958+0000","last_unstale":"2024-09-21T03:54:57.044797+0000","last_undegraded":"2024-09-21T03:54:57.044797+0000","last_fullsized":"2024-09-21T03:54:57.044797+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:59.197216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67265,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":202,"num_read_kb":166,"num_write":30,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123691+0000","last_change":"2024-09-21T03:53:13.828095+0000","last_active":"2024-09-21T03:53:33.123691+0000","last_peered":"2024-09-21T03:53:33.123691+0000","last_clean":"2024-09-21T03:53:33.123691+0000","last_became_active":"2024-09-21T03:53:13.827761+0000","last_became_peered":"2024-09-21T03:53:13.827761+0000","last_unstale":"2024-09-21T03:53:33.123691+0000","last_undegraded":"2024-09-21T03:53:33.123691+0000","last_fullsized":"2024-09-21T03:53:33.123691+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:42:28.981463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.094939+0000","last_change":"2024-09-21T03:53:11.801611+0000","last_active":"2024-09-21T03:53:33.094939+0000","last_peered":"2024-09-21T03:53:33.094939+0000","last_clean":"2024-09-21T03:53:33.094939+0000","last_became_active":"2024-09-21T03:53:11.801185+0000","last_became_peered":"2024-09-21T03:53:11.801185+0000","last_unstale":"2024-09-21T03:53:33.094939+0000","last_undegraded":"2024-09-21T03:53:33.094939+0000","last_fullsized":"2024-09-21T03:53:33.094939+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:16.990963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031447+0000","last_change":"2024-09-21T03:53:13.827393+0000","last_active":"2024-09-21T03:53:33.031447+0000","last_peered":"2024-09-21T03:53:33.031447+0000","last_clean":"2024-09-21T03:53:33.031447+0000","last_became_active":"2024-09-21T03:53:13.826912+0000","last_became_peered":"2024-09-21T03:53:13.826912+0000","last_unstale":"2024-09-21T03:53:33.031447+0000","last_undegraded":"2024-09-21T03:53:33.031447+0000","last_fullsized":"2024-09-21T03:53:33.031447+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:52.313989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040555+0000","last_change":"2024-09-21T03:53:11.805437+0000","last_active":"2024-09-21T03:53:33.040555+0000","last_peered":"2024-09-21T03:53:33.040555+0000","last_clean":"2024-09-21T03:53:33.040555+0000","last_became_active":"2024-09-21T03:53:11.805048+0000","last_became_peered":"2024-09-21T03:53:11.805048+0000","last_unstale":"2024-09-21T03:53:33.040555+0000","last_undegraded":"2024-09-21T03:53:33.040555+0000","last_fullsized":"2024-09-21T03:53:33.040555+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:03.288694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036034+0000","last_change":"2024-09-21T03:53:13.836917+0000","last_active":"2024-09-21T03:53:33.036034+0000","last_peered":"2024-09-21T03:53:33.036034+0000","last_clean":"2024-09-21T03:53:33.036034+0000","last_became_active":"2024-09-21T03:53:13.836514+0000","last_became_peered":"2024-09-21T03:53:13.836514+0000","last_unstale":"2024-09-21T03:53:33.036034+0000","last_undegraded":"2024-09-21T03:53:33.036034+0000","last_fullsized":"2024-09-21T03:53:33.036034+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:17.512017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123559+0000","last_change":"2024-09-21T03:53:11.808403+0000","last_active":"2024-09-21T03:53:33.123559+0000","last_peered":"2024-09-21T03:53:33.123559+0000","last_clean":"2024-09-21T03:53:33.123559+0000","last_became_active":"2024-09-21T03:53:11.807895+0000","last_became_peered":"2024-09-21T03:53:11.807895+0000","last_unstale":"2024-09-21T03:53:33.123559+0000","last_undegraded":"2024-09-21T03:53:33.123559+0000","last_fullsized":"2024-09-21T03:53:33.123559+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:33.548683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.125777+0000","last_change":"2024-09-21T03:53:33.125556+0000","last_active":"2024-09-21T03:53:33.125777+0000","last_peered":"2024-09-21T03:53:33.125777+0000","last_clean":"2024-09-21T03:53:33.125777+0000","last_became_active":"2024-09-21T03:53:33.125084+0000","last_became_peered":"2024-09-21T03:53:33.125084+0000","last_unstale":"2024-09-21T03:53:33.125777+0000","last_undegraded":"2024-09-21T03:53:33.125777+0000","last_fullsized":"2024-09-21T03:53:33.125777+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:40:23.997329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'8","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123320+0000","last_change":"2024-09-21T03:53:12.605672+0000","last_active":"2024-09-21T03:53:33.123320+0000","last_peered":"2024-09-21T03:53:33.123320+0000","last_clean":"2024-09-21T03:53:33.123320+0000","last_became_active":"2024-09-21T03:53:12.604644+0000","last_became_peered":"2024-09-21T03:53:12.604644+0000","last_unstale":"2024-09-21T03:53:33.123320+0000","last_undegraded":"2024-09-21T03:53:33.123320+0000","last_fullsized":"2024-09-21T03:53:33.123320+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:44.810762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040395+0000","last_change":"2024-09-21T03:53:13.833861+0000","last_active":"2024-09-21T03:53:33.040395+0000","last_peered":"2024-09-21T03:53:33.040395+0000","last_clean":"2024-09-21T03:53:33.040395+0000","last_became_active":"2024-09-21T03:53:13.832900+0000","last_became_peered":"2024-09-21T03:53:13.832900+0000","last_unstale":"2024-09-21T03:53:33.040395+0000","last_undegraded":"2024-09-21T03:53:33.040395+0000","last_fullsized":"2024-09-21T03:53:33.040395+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:12.047171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124020+0000","last_change":"2024-09-21T03:53:11.799844+0000","last_active":"2024-09-21T03:53:33.124020+0000","last_peered":"2024-09-21T03:53:33.124020+0000","last_clean":"2024-09-21T03:53:33.124020+0000","last_became_active":"2024-09-21T03:53:11.799412+0000","last_became_peered":"2024-09-21T03:53:11.799412+0000","last_unstale":"2024-09-21T03:53:33.124020+0000","last_undegraded":"2024-09-21T03:53:33.124020+0000","last_fullsized":"2024-09-21T03:53:33.124020+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:49.826500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034751+0000","last_change":"2024-09-21T03:53:13.836690+0000","last_active":"2024-09-21T03:53:33.034751+0000","last_peered":"2024-09-21T03:53:33.034751+0000","last_clean":"2024-09-21T03:53:33.034751+0000","last_became_active":"2024-09-21T03:53:13.836337+0000","last_became_peered":"2024-09-21T03:53:13.836337+0000","last_unstale":"2024-09-21T03:53:33.034751+0000","last_undegraded":"2024-09-21T03:53:33.034751+0000","last_fullsized":"2024-09-21T03:53:33.034751+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:15.999869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031625+0000","last_change":"2024-09-21T03:53:11.799597+0000","last_active":"2024-09-21T03:53:33.031625+0000","last_peered":"2024-09-21T03:53:33.031625+0000","last_clean":"2024-09-21T03:53:33.031625+0000","last_became_active":"2024-09-21T03:53:11.799175+0000","last_became_peered":"2024-09-21T03:53:11.799175+0000","last_unstale":"2024-09-21T03:53:33.031625+0000","last_undegraded":"2024-09-21T03:53:33.031625+0000","last_fullsized":"2024-09-21T03:53:33.031625+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:41.668587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036592+0000","last_change":"2024-09-21T03:53:13.831228+0000","last_active":"2024-09-21T03:53:33.036592+0000","last_peered":"2024-09-21T03:53:33.036592+0000","last_clean":"2024-09-21T03:53:33.036592+0000","last_became_active":"2024-09-21T03:53:13.830880+0000","last_became_peered":"2024-09-21T03:53:13.830880+0000","last_unstale":"2024-09-21T03:53:33.036592+0000","last_undegraded":"2024-09-21T03:53:33.036592+0000","last_fullsized":"2024-09-21T03:53:33.036592+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:45.770622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.041069+0000","last_change":"2024-09-21T03:53:11.803560+0000","last_active":"2024-09-21T03:53:33.041069+0000","last_peered":"2024-09-21T03:53:33.041069+0000","last_clean":"2024-09-21T03:53:33.041069+0000","last_became_active":"2024-09-21T03:53:11.803090+0000","last_became_peered":"2024-09-21T03:53:11.803090+0000","last_unstale":"2024-09-21T03:53:33.041069+0000","last_undegraded":"2024-09-21T03:53:33.041069+0000","last_fullsized":"2024-09-21T03:53:33.041069+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:23.993694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036373+0000","last_change":"2024-09-21T03:53:13.825907+0000","last_active":"2024-09-21T03:53:33.036373+0000","last_peered":"2024-09-21T03:53:33.036373+0000","last_clean":"2024-09-21T03:53:33.036373+0000","last_became_active":"2024-09-21T03:53:13.825485+0000","last_became_peered":"2024-09-21T03:53:13.825485+0000","last_unstale":"2024-09-21T03:53:33.036373+0000","last_undegraded":"2024-09-21T03:53:33.036373+0000","last_fullsized":"2024-09-21T03:53:33.036373+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:39.166215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.095338+0000","last_change":"2024-09-21T03:53:12.605947+0000","last_active":"2024-09-21T03:53:33.095338+0000","last_peered":"2024-09-21T03:53:33.095338+0000","last_clean":"2024-09-21T03:53:33.095338+0000","last_became_active":"2024-09-21T03:53:12.604516+0000","last_became_peered":"2024-09-21T03:53:12.604516+0000","last_unstale":"2024-09-21T03:53:33.095338+0000","last_undegraded":"2024-09-21T03:53:33.095338+0000","last_fullsized":"2024-09-21T03:53:33.095338+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:42.500174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036503+0000","last_change":"2024-09-21T03:53:13.834108+0000","last_active":"2024-09-21T03:53:33.036503+0000","last_peered":"2024-09-21T03:53:33.036503+0000","last_clean":"2024-09-21T03:53:33.036503+0000","last_became_active":"2024-09-21T03:53:13.833734+0000","last_became_peered":"2024-09-21T03:53:13.833734+0000","last_unstale":"2024-09-21T03:53:33.036503+0000","last_undegraded":"2024-09-21T03:53:33.036503+0000","last_fullsized":"2024-09-21T03:53:33.036503+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:39.032450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":98,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036220+0000","last_change":"2024-09-21T03:51:59.139085+0000","last_active":"2024-09-21T03:53:33.036220+0000","last_peered":"2024-09-21T03:53:33.036220+0000","last_clean":"2024-09-21T03:53:33.036220+0000","last_became_active":"2024-09-21T03:51:59.026450+0000","last_became_peered":"2024-09-21T03:51:59.026450+0000","last_unstale":"2024-09-21T03:53:33.036220+0000","last_undegraded":"2024-09-21T03:53:33.036220+0000","last_fullsized":"2024-09-21T03:53:33.036220+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:48:31.139457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:48:31.139457+0000","last_clean_scrub_stamp":"2024-09-21T03:48:31.139457+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:54.047170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123454+0000","last_change":"2024-09-21T03:53:11.805792+0000","last_active":"2024-09-21T03:53:33.123454+0000","last_peered":"2024-09-21T03:53:33.123454+0000","last_clean":"2024-09-21T03:53:33.123454+0000","last_became_active":"2024-09-21T03:53:11.805375+0000","last_became_peered":"2024-09-21T03:53:11.805375+0000","last_unstale":"2024-09-21T03:53:33.123454+0000","last_undegraded":"2024-09-21T03:53:33.123454+0000","last_fullsized":"2024-09-21T03:53:33.123454+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:55.466187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122971+0000","last_change":"2024-09-21T03:53:13.835211+0000","last_active":"2024-09-21T03:53:33.122971+0000","last_peered":"2024-09-21T03:53:33.122971+0000","last_clean":"2024-09-21T03:53:33.122971+0000","last_became_active":"2024-09-21T03:53:13.833649+0000","last_became_peered":"2024-09-21T03:53:13.833649+0000","last_unstale":"2024-09-21T03:53:33.122971+0000","last_undegraded":"2024-09-21T03:53:33.122971+0000","last_fullsized":"2024-09-21T03:53:33.122971+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:57.962287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035996+0000","last_change":"2024-09-21T03:53:11.801670+0000","last_active":"2024-09-21T03:53:33.035996+0000","last_peered":"2024-09-21T03:53:33.035996+0000","last_clean":"2024-09-21T03:53:33.035996+0000","last_became_active":"2024-09-21T03:53:11.801291+0000","last_became_peered":"2024-09-21T03:53:11.801291+0000","last_unstale":"2024-09-21T03:53:33.035996+0000","last_undegraded":"2024-09-21T03:53:33.035996+0000","last_fullsized":"2024-09-21T03:53:33.035996+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:37.450592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.096813+0000","last_change":"2024-09-21T03:53:33.096727+0000","last_active":"2024-09-21T03:53:33.096813+0000","last_peered":"2024-09-21T03:53:33.096813+0000","last_clean":"2024-09-21T03:53:33.096813+0000","last_became_active":"2024-09-21T03:53:33.096234+0000","last_became_peered":"2024-09-21T03:53:33.096234+0000","last_unstale":"2024-09-21T03:53:33.096813+0000","last_undegraded":"2024-09-21T03:53:33.096813+0000","last_fullsized":"2024-09-21T03:53:33.096813+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:56:24.375992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031550+0000","last_change":"2024-09-21T03:53:12.604170+0000","last_active":"2024-09-21T03:53:33.031550+0000","last_peered":"2024-09-21T03:53:33.031550+0000","last_clean":"2024-09-21T03:53:33.031550+0000","last_became_active":"2024-09-21T03:53:12.603765+0000","last_became_peered":"2024-09-21T03:53:12.603765+0000","last_unstale":"2024-09-21T03:53:33.031550+0000","last_undegraded":"2024-09-21T03:53:33.031550+0000","last_fullsized":"2024-09-21T03:53:33.031550+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:08.606037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.125077+0000","last_change":"2024-09-21T03:53:33.124969+0000","last_active":"2024-09-21T03:53:33.125077+0000","last_peered":"2024-09-21T03:53:33.125077+0000","last_clean":"2024-09-21T03:53:33.125077+0000","last_became_active":"2024-09-21T03:53:33.124496+0000","last_became_peered":"2024-09-21T03:53:33.124496+0000","last_unstale":"2024-09-21T03:53:33.125077+0000","last_undegraded":"2024-09-21T03:53:33.125077+0000","last_fullsized":"2024-09-21T03:53:33.125077+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:56.730146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.036128+0000","last_change":"2024-09-21T03:53:11.803316+0000","last_active":"2024-09-21T03:53:33.036128+0000","last_peered":"2024-09-21T03:53:33.036128+0000","last_clean":"2024-09-21T03:53:33.036128+0000","last_became_active":"2024-09-21T03:53:11.801976+0000","last_became_peered":"2024-09-21T03:53:11.801976+0000","last_unstale":"2024-09-21T03:53:33.036128+0000","last_undegraded":"2024-09-21T03:53:33.036128+0000","last_fullsized":"2024-09-21T03:53:33.036128+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:43.596037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124177+0000","last_change":"2024-09-21T03:53:13.838006+0000","last_active":"2024-09-21T03:53:33.124177+0000","last_peered":"2024-09-21T03:53:33.124177+0000","last_clean":"2024-09-21T03:53:33.124177+0000","last_became_active":"2024-09-21T03:53:13.835903+0000","last_became_peered":"2024-09-21T03:53:13.835903+0000","last_unstale":"2024-09-21T03:53:33.124177+0000","last_undegraded":"2024-09-21T03:53:33.124177+0000","last_fullsized":"2024-09-21T03:53:33.124177+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:54:56.730044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124836+0000","last_change":"2024-09-21T03:53:33.124720+0000","last_active":"2024-09-21T03:53:33.124836+0000","last_peered":"2024-09-21T03:53:33.124836+0000","last_clean":"2024-09-21T03:53:33.124836+0000","last_became_active":"2024-09-21T03:53:33.124232+0000","last_became_peered":"2024-09-21T03:53:33.124232+0000","last_unstale":"2024-09-21T03:53:33.124836+0000","last_undegraded":"2024-09-21T03:53:33.124836+0000","last_fullsized":"2024-09-21T03:53:33.124836+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:23.810493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124631+0000","last_change":"2024-09-21T03:53:13.827805+0000","last_active":"2024-09-21T03:53:33.124631+0000","last_peered":"2024-09-21T03:53:33.124631+0000","last_clean":"2024-09-21T03:53:33.124631+0000","last_became_active":"2024-09-21T03:53:13.827368+0000","last_became_peered":"2024-09-21T03:53:13.827368+0000","last_unstale":"2024-09-21T03:53:33.124631+0000","last_undegraded":"2024-09-21T03:53:33.124631+0000","last_fullsized":"2024-09-21T03:53:33.124631+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:24.539396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123881+0000","last_change":"2024-09-21T03:53:12.605032+0000","last_active":"2024-09-21T03:53:33.123881+0000","last_peered":"2024-09-21T03:53:33.123881+0000","last_clean":"2024-09-21T03:53:33.123881+0000","last_became_active":"2024-09-21T03:53:12.604561+0000","last_became_peered":"2024-09-21T03:53:12.604561+0000","last_unstale":"2024-09-21T03:53:33.123881+0000","last_undegraded":"2024-09-21T03:53:33.123881+0000","last_fullsized":"2024-09-21T03:53:33.123881+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:20.361768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.031744+0000","last_change":"2024-09-21T03:53:13.821539+0000","last_active":"2024-09-21T03:53:33.031744+0000","last_peered":"2024-09-21T03:53:33.031744+0000","last_clean":"2024-09-21T03:53:33.031744+0000","last_became_active":"2024-09-21T03:53:13.821196+0000","last_became_peered":"2024-09-21T03:53:13.821196+0000","last_unstale":"2024-09-21T03:53:33.031744+0000","last_undegraded":"2024-09-21T03:53:33.031744+0000","last_fullsized":"2024-09-21T03:53:33.031744+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:00.627993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'10","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:36.828012+0000","last_change":"2024-09-21T03:53:11.799669+0000","last_active":"2024-09-21T03:53:36.828012+0000","last_peered":"2024-09-21T03:53:36.828012+0000","last_clean":"2024-09-21T03:53:36.828012+0000","last_became_active":"2024-09-21T03:53:11.799355+0000","last_became_peered":"2024-09-21T03:53:11.799355+0000","last_unstale":"2024-09-21T03:53:36.828012+0000","last_undegraded":"2024-09-21T03:53:36.828012+0000","last_fullsized":"2024-09-21T03:53:36.828012+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:33.032206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123797+0000","last_change":"2024-09-21T03:53:13.828551+0000","last_active":"2024-09-21T03:53:33.123797+0000","last_peered":"2024-09-21T03:53:33.123797+0000","last_clean":"2024-09-21T03:53:33.123797+0000","last_became_active":"2024-09-21T03:53:13.828185+0000","last_became_peered":"2024-09-21T03:53:13.828185+0000","last_unstale":"2024-09-21T03:53:33.123797+0000","last_undegraded":"2024-09-21T03:53:33.123797+0000","last_fullsized":"2024-09-21T03:53:33.123797+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:31.852755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.124078+0000","last_change":"2024-09-21T03:53:12.279823+0000","last_active":"2024-09-21T03:53:33.124078+0000","last_peered":"2024-09-21T03:53:33.124078+0000","last_clean":"2024-09-21T03:53:33.124078+0000","last_became_active":"2024-09-21T03:53:12.279384+0000","last_became_peered":"2024-09-21T03:53:12.279384+0000","last_unstale":"2024-09-21T03:53:33.124078+0000","last_undegraded":"2024-09-21T03:53:33.124078+0000","last_fullsized":"2024-09-21T03:53:33.124078+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:42.568690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123319+0000","last_change":"2024-09-21T03:53:13.831041+0000","last_active":"2024-09-21T03:53:33.123319+0000","last_peered":"2024-09-21T03:53:33.123319+0000","last_clean":"2024-09-21T03:53:33.123319+0000","last_became_active":"2024-09-21T03:53:13.830654+0000","last_became_peered":"2024-09-21T03:53:13.830654+0000","last_unstale":"2024-09-21T03:53:33.123319+0000","last_undegraded":"2024-09-21T03:53:33.123319+0000","last_fullsized":"2024-09-21T03:53:33.123319+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:04.815719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032478+0000","last_change":"2024-09-21T03:53:12.604949+0000","last_active":"2024-09-21T03:53:33.032478+0000","last_peered":"2024-09-21T03:53:33.032478+0000","last_clean":"2024-09-21T03:53:33.032478+0000","last_became_active":"2024-09-21T03:53:12.604516+0000","last_became_peered":"2024-09-21T03:53:12.604516+0000","last_unstale":"2024-09-21T03:53:33.032478+0000","last_undegraded":"2024-09-21T03:53:33.032478+0000","last_fullsized":"2024-09-21T03:53:33.032478+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:33.964125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123050+0000","last_change":"2024-09-21T03:53:13.834813+0000","last_active":"2024-09-21T03:53:33.123050+0000","last_peered":"2024-09-21T03:53:33.123050+0000","last_clean":"2024-09-21T03:53:33.123050+0000","last_became_active":"2024-09-21T03:53:13.834436+0000","last_became_peered":"2024-09-21T03:53:13.834436+0000","last_unstale":"2024-09-21T03:53:33.123050+0000","last_undegraded":"2024-09-21T03:53:33.123050+0000","last_fullsized":"2024-09-21T03:53:33.123050+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:42:40.990668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122665+0000","last_change":"2024-09-21T03:53:11.801828+0000","last_active":"2024-09-21T03:53:33.122665+0000","last_peered":"2024-09-21T03:53:33.122665+0000","last_clean":"2024-09-21T03:53:33.122665+0000","last_became_active":"2024-09-21T03:53:11.800969+0000","last_became_peered":"2024-09-21T03:53:11.800969+0000","last_unstale":"2024-09-21T03:53:33.122665+0000","last_undegraded":"2024-09-21T03:53:33.122665+0000","last_fullsized":"2024-09-21T03:53:33.122665+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:36.117523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.034772+0000","last_change":"2024-09-21T03:53:13.835393+0000","last_active":"2024-09-21T03:53:33.034772+0000","last_peered":"2024-09-21T03:53:33.034772+0000","last_clean":"2024-09-21T03:53:33.034772+0000","last_became_active":"2024-09-21T03:53:13.834541+0000","last_became_peered":"2024-09-21T03:53:13.834541+0000","last_unstale":"2024-09-21T03:53:33.034772+0000","last_undegraded":"2024-09-21T03:53:33.034772+0000","last_fullsized":"2024-09-21T03:53:33.034772+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:40.140004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.125328+0000","last_change":"2024-09-21T03:53:33.124524+0000","last_active":"2024-09-21T03:53:33.125328+0000","last_peered":"2024-09-21T03:53:33.125328+0000","last_clean":"2024-09-21T03:53:33.125328+0000","last_became_active":"2024-09-21T03:53:33.123945+0000","last_became_peered":"2024-09-21T03:53:33.123945+0000","last_unstale":"2024-09-21T03:53:33.125328+0000","last_undegraded":"2024-09-21T03:53:33.125328+0000","last_fullsized":"2024-09-21T03:53:33.125328+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:50.967123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.122926+0000","last_change":"2024-09-21T03:53:13.832597+0000","last_active":"2024-09-21T03:53:33.122926+0000","last_peered":"2024-09-21T03:53:33.122926+0000","last_clean":"2024-09-21T03:53:33.122926+0000","last_became_active":"2024-09-21T03:53:13.832237+0000","last_became_peered":"2024-09-21T03:53:13.832237+0000","last_unstale":"2024-09-21T03:53:33.122926+0000","last_undegraded":"2024-09-21T03:53:33.122926+0000","last_fullsized":"2024-09-21T03:53:33.122926+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:31.907478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123185+0000","last_change":"2024-09-21T03:53:11.804875+0000","last_active":"2024-09-21T03:53:33.123185+0000","last_peered":"2024-09-21T03:53:33.123185+0000","last_clean":"2024-09-21T03:53:33.123185+0000","last_became_active":"2024-09-21T03:53:11.804320+0000","last_became_peered":"2024-09-21T03:53:11.804320+0000","last_unstale":"2024-09-21T03:53:33.123185+0000","last_undegraded":"2024-09-21T03:53:33.123185+0000","last_fullsized":"2024-09-21T03:53:33.123185+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:37:58.747573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035965+0000","last_change":"2024-09-21T03:53:13.837804+0000","last_active":"2024-09-21T03:53:33.035965+0000","last_peered":"2024-09-21T03:53:33.035965+0000","last_clean":"2024-09-21T03:53:33.035965+0000","last_became_active":"2024-09-21T03:53:13.837440+0000","last_became_peered":"2024-09-21T03:53:13.837440+0000","last_unstale":"2024-09-21T03:53:33.035965+0000","last_undegraded":"2024-09-21T03:53:33.035965+0000","last_fullsized":"2024-09-21T03:53:33.035965+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:15.471544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.040923+0000","last_change":"2024-09-21T03:53:13.833231+0000","last_active":"2024-09-21T03:53:33.040923+0000","last_peered":"2024-09-21T03:53:33.040923+0000","last_clean":"2024-09-21T03:53:33.040923+0000","last_became_active":"2024-09-21T03:53:13.832908+0000","last_became_peered":"2024-09-21T03:53:13.832908+0000","last_unstale":"2024-09-21T03:53:33.040923+0000","last_undegraded":"2024-09-21T03:53:33.040923+0000","last_fullsized":"2024-09-21T03:53:33.040923+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:40.191231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123570+0000","last_change":"2024-09-21T03:53:11.802237+0000","last_active":"2024-09-21T03:53:33.123570+0000","last_peered":"2024-09-21T03:53:33.123570+0000","last_clean":"2024-09-21T03:53:33.123570+0000","last_became_active":"2024-09-21T03:53:11.801845+0000","last_became_peered":"2024-09-21T03:53:11.801845+0000","last_unstale":"2024-09-21T03:53:33.123570+0000","last_undegraded":"2024-09-21T03:53:33.123570+0000","last_fullsized":"2024-09-21T03:53:33.123570+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:34.714908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.032488+0000","last_change":"2024-09-21T03:53:13.831495+0000","last_active":"2024-09-21T03:53:33.032488+0000","last_peered":"2024-09-21T03:53:33.032488+0000","last_clean":"2024-09-21T03:53:33.032488+0000","last_became_active":"2024-09-21T03:53:13.831107+0000","last_became_peered":"2024-09-21T03:53:13.831107+0000","last_unstale":"2024-09-21T03:53:33.032488+0000","last_undegraded":"2024-09-21T03:53:33.032488+0000","last_fullsized":"2024-09-21T03:53:33.032488+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:12:09.751036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123850+0000","last_change":"2024-09-21T03:53:11.805910+0000","last_active":"2024-09-21T03:53:33.123850+0000","last_peered":"2024-09-21T03:53:33.123850+0000","last_clean":"2024-09-21T03:53:33.123850+0000","last_became_active":"2024-09-21T03:53:11.805461+0000","last_became_peered":"2024-09-21T03:53:11.805461+0000","last_unstale":"2024-09-21T03:53:33.123850+0000","last_undegraded":"2024-09-21T03:53:33.123850+0000","last_fullsized":"2024-09-21T03:53:33.123850+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:36:56.132055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123607+0000","last_change":"2024-09-21T03:53:13.834930+0000","last_active":"2024-09-21T03:53:33.123607+0000","last_peered":"2024-09-21T03:53:33.123607+0000","last_clean":"2024-09-21T03:53:33.123607+0000","last_became_active":"2024-09-21T03:53:13.834368+0000","last_became_peered":"2024-09-21T03:53:13.834368+0000","last_unstale":"2024-09-21T03:53:33.123607+0000","last_undegraded":"2024-09-21T03:53:33.123607+0000","last_fullsized":"2024-09-21T03:53:33.123607+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:53.798811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123728+0000","last_change":"2024-09-21T03:53:12.604827+0000","last_active":"2024-09-21T03:53:33.123728+0000","last_peered":"2024-09-21T03:53:33.123728+0000","last_clean":"2024-09-21T03:53:33.123728+0000","last_became_active":"2024-09-21T03:53:12.604406+0000","last_became_peered":"2024-09-21T03:53:12.604406+0000","last_unstale":"2024-09-21T03:53:33.123728+0000","last_undegraded":"2024-09-21T03:53:33.123728+0000","last_fullsized":"2024-09-21T03:53:33.123728+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:03:12.942354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.123562+0000","last_change":"2024-09-21T03:53:13.830482+0000","last_active":"2024-09-21T03:53:33.123562+0000","last_peered":"2024-09-21T03:53:33.123562+0000","last_clean":"2024-09-21T03:53:33.123562+0000","last_became_active":"2024-09-21T03:53:13.829970+0000","last_became_peered":"2024-09-21T03:53:13.829970+0000","last_unstale":"2024-09-21T03:53:33.123562+0000","last_undegraded":"2024-09-21T03:53:33.123562+0000","last_fullsized":"2024-09-21T03:53:33.123562+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:12.796933+0000","last_clean_scrub_stamp":"2024-09-21T03:53:12.796933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:21.617459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:53:33.035213+0000","last_change":"2024-09-21T03:53:11.801931+0000","last_active":"2024-09-21T03:53:33.035213+0000","last_peered":"2024-09-21T03:53:33.035213+0000","last_clean":"2024-09-21T03:53:33.035213+0000","last_became_active":"2024-09-21T03:53:11.801587+0000","last_became_peered":"2024-09-21T03:53:11.801587+0000","last_unstale":"2024-09-21T03:53:33.035213+0000","last_undegraded":"2024-09-21T03:53:33.035213+0000","last_fullsized":"2024-09-21T03:53:33.035213+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:53:10.779331+0000","last_clean_scrub_stamp":"2024-09-21T03:53:10.779331+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:01:47.329060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68063,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":208,"num_read_kb":172,"num_write":87,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":204189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285514,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743458,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":831488,"data_stored":416577,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939688,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":1074521,"data_compressed":42053,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103213,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":835584,"data_stored":417159,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299442,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":839680,"data_stored":417181,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462967,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":888832,"data_stored":1007644,"data_compressed":42053,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626492,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":835584,"data_stored":416694,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822722,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":897024,"data_stored":1007244,"data_compressed":42053,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986247,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":835584,"data_stored":416599,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182474,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36172,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708980,"statfs":{"total":95995035648,"available":95957995520,"internally_reserved":0,"allocated":847872,"data_stored":416915,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378705,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":483876,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542230,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":483842,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705755,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":835584,"data_stored":416667,"data_compressed":5757,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34678,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34678,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34678,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36296,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36296,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36296,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36296,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36296,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":67265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":67299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":67459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:54:58.619 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:54:58.916 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:59.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:58 smithi046 ceph-mon[30954]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:54:59.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:58 smithi105 ceph-mon[34773]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:54:59.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:58 smithi162 ceph-mon[35071]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:54:59.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.416+0000 7fd695dc4640 1 -- 172.21.15.46:0/1659529983 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6901094b0 msgr2=0x7fd6901098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:59.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.416+0000 7fd695dc4640 1 --2- 172.21.15.46:0/1659529983 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6901094b0 0x7fd6901098c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd684009900 tx=0x7fd68402a3f0 comp rx=0 tx=0).stop 2024-09-21T03:54:59.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.416+0000 7fd695dc4640 1 -- 172.21.15.46:0/1659529983 shutdown_connections 2024-09-21T03:54:59.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.416+0000 7fd695dc4640 1 --2- 172.21.15.46:0/1659529983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd690109e00 0x7fd690110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:59.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.416+0000 7fd695dc4640 1 --2- 172.21.15.46:0/1659529983 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6901094b0 0x7fd6901098c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:59.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.416+0000 7fd695dc4640 1 --2- 172.21.15.46:0/1659529983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd690103bc0 0x7fd690103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:59.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.416+0000 7fd695dc4640 1 -- 172.21.15.46:0/1659529983 >> 172.21.15.46:0/1659529983 conn(0x7fd69007b910 msgr2=0x7fd69007bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:59.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.416+0000 7fd695dc4640 1 -- 172.21.15.46:0/1659529983 shutdown_connections 2024-09-21T03:54:59.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.416+0000 7fd695dc4640 1 -- 172.21.15.46:0/1659529983 wait complete. 2024-09-21T03:54:59.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.417+0000 7fd695dc4640 1 Processor -- start 2024-09-21T03:54:59.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.417+0000 7fd695dc4640 1 -- start start 2024-09-21T03:54:59.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.417+0000 7fd695dc4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd690103bc0 0x7fd69019a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:59.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.417+0000 7fd695dc4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6901094b0 0x7fd69019aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:59.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.417+0000 7fd695dc4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd690109e00 0x7fd69019fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:59.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.417+0000 7fd695dc4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd690113ac0 con 0x7fd690103bc0 2024-09-21T03:54:59.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.417+0000 7fd695dc4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd690113940 con 0x7fd690109e00 2024-09-21T03:54:59.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.417+0000 7fd695dc4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd690113c40 con 0x7fd6901094b0 2024-09-21T03:54:59.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.417+0000 7fd68f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd690103bc0 0x7fd69019a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:59.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.417+0000 7fd68f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd690103bc0 0x7fd69019a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58732/0 (socket says 172.21.15.46:58732) 2024-09-21T03:54:59.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.417+0000 7fd68f7fe640 1 -- 172.21.15.46:0/2641871002 learned_addr learned my addr 172.21.15.46:0/2641871002 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:54:59.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.418+0000 7fd68effd640 1 --2- 172.21.15.46:0/2641871002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6901094b0 0x7fd69019aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:59.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.418+0000 7fd68ffff640 1 --2- 172.21.15.46:0/2641871002 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd690109e00 0x7fd69019fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:59.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.418+0000 7fd68f7fe640 1 -- 172.21.15.46:0/2641871002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6901094b0 msgr2=0x7fd69019aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:59.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.418+0000 7fd68f7fe640 1 --2- 172.21.15.46:0/2641871002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6901094b0 0x7fd69019aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:59.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.418+0000 7fd68f7fe640 1 -- 172.21.15.46:0/2641871002 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd690109e00 msgr2=0x7fd69019fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:59.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.418+0000 7fd68f7fe640 1 --2- 172.21.15.46:0/2641871002 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd690109e00 0x7fd69019fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:59.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.418+0000 7fd68f7fe640 1 -- 172.21.15.46:0/2641871002 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6901a0380 con 0x7fd690103bc0 2024-09-21T03:54:59.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.418+0000 7fd68ffff640 1 --2- 172.21.15.46:0/2641871002 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd690109e00 0x7fd69019fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:54:59.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.418+0000 7fd68f7fe640 1 --2- 172.21.15.46:0/2641871002 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd690103bc0 0x7fd69019a4d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd68000c920 tx=0x7fd68000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:59.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.418+0000 7fd68cff9640 1 -- 172.21.15.46:0/2641871002 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd680007c70 con 0x7fd690103bc0 2024-09-21T03:54:59.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.418+0000 7fd68cff9640 1 -- 172.21.15.46:0/2641871002 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd680007e10 con 0x7fd690103bc0 2024-09-21T03:54:59.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.418+0000 7fd68cff9640 1 -- 172.21.15.46:0/2641871002 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd680018820 con 0x7fd690103bc0 2024-09-21T03:54:59.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.418+0000 7fd695dc4640 1 -- 172.21.15.46:0/2641871002 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6901a0670 con 0x7fd690103bc0 2024-09-21T03:54:59.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.418+0000 7fd695dc4640 1 -- 172.21.15.46:0/2641871002 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6901a6e90 con 0x7fd690103bc0 2024-09-21T03:54:59.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.419+0000 7fd695dc4640 1 -- 172.21.15.46:0/2641871002 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd690103fd0 con 0x7fd690103bc0 2024-09-21T03:54:59.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.421+0000 7fd68cff9640 1 -- 172.21.15.46:0/2641871002 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fd68000f450 con 0x7fd690103bc0 2024-09-21T03:54:59.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.422+0000 7fd68cff9640 1 --2- 172.21.15.46:0/2641871002 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fd6780b6620 0x7fd6780b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:59.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.422+0000 7fd68effd640 1 --2- 172.21.15.46:0/2641871002 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fd6780b6620 0x7fd6780b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:59.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.422+0000 7fd68cff9640 1 -- 172.21.15.46:0/2641871002 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fd6800e7a40 con 0x7fd690103bc0 2024-09-21T03:54:59.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.422+0000 7fd68effd640 1 --2- 172.21.15.46:0/2641871002 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fd6780b6620 0x7fd6780b8b30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd684009230 tx=0x7fd684031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:59.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.425+0000 7fd68cff9640 1 -- 172.21.15.46:0/2641871002 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd680014030 con 0x7fd690103bc0 2024-09-21T03:54:59.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.652+0000 7fd695dc4640 1 -- 172.21.15.46:0/2641871002 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd69010bc50 con 0x7fd690103bc0 2024-09-21T03:54:59.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.653+0000 7fd68cff9640 1 -- 172.21.15.46:0/2641871002 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7fd6800ae140 con 0x7fd690103bc0 2024-09-21T03:54:59.655 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:54:59.655 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"btime":"2024-09-21T03:53:23:865820+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1766354184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1766354184},{"type":"v1","addr":"172.21.15.46:6839","nonce":1766354184}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/1901774207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":1901774207},{"type":"v1","addr":"172.21.15.46:6841","nonce":1901774207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3548633196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":3548633196},{"type":"v1","addr":"172.21.15.105:6837","nonce":3548633196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24652,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3551934241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3551934241},{"type":"v1","addr":"172.21.15.162:6835","nonce":3551934241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/48949822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":48949822},{"type":"v1","addr":"172.21.15.162:6837","nonce":48949822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:53:14.452819+0000","modified":"2024-09-21T03:53:23.593278+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24680},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/2196053213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2196053213},{"type":"v1","addr":"172.21.15.162:6839","nonce":2196053213}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.105:6839/3911438406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":3911438406},{"type":"v1","addr":"172.21.15.105:6839","nonce":3911438406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24680,"qdb_cluster":[24680]},"id":1}]} 2024-09-21T03:54:59.655 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T03:54:59.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.655+0000 7fd695dc4640 1 -- 172.21.15.46:0/2641871002 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fd6780b6620 msgr2=0x7fd6780b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:59.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.655+0000 7fd695dc4640 1 --2- 172.21.15.46:0/2641871002 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fd6780b6620 0x7fd6780b8b30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd684009230 tx=0x7fd684031400 comp rx=0 tx=0).stop 2024-09-21T03:54:59.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.655+0000 7fd695dc4640 1 -- 172.21.15.46:0/2641871002 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd690103bc0 msgr2=0x7fd69019a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:59.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.655+0000 7fd695dc4640 1 --2- 172.21.15.46:0/2641871002 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd690103bc0 0x7fd69019a4d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd68000c920 tx=0x7fd68000cde0 comp rx=0 tx=0).stop 2024-09-21T03:54:59.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.655+0000 7fd695dc4640 1 -- 172.21.15.46:0/2641871002 shutdown_connections 2024-09-21T03:54:59.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.655+0000 7fd695dc4640 1 --2- 172.21.15.46:0/2641871002 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd690109e00 0x7fd69019fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:59.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.655+0000 7fd695dc4640 1 --2- 172.21.15.46:0/2641871002 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fd6780b6620 0x7fd6780b8b30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:59.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.655+0000 7fd695dc4640 1 --2- 172.21.15.46:0/2641871002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6901094b0 0x7fd69019aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:59.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.655+0000 7fd695dc4640 1 --2- 172.21.15.46:0/2641871002 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd690103bc0 0x7fd69019a4d0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:59.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.655+0000 7fd695dc4640 1 -- 172.21.15.46:0/2641871002 >> 172.21.15.46:0/2641871002 conn(0x7fd69007b910 msgr2=0x7fd6901075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:59.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.655+0000 7fd695dc4640 1 -- 172.21.15.46:0/2641871002 shutdown_connections 2024-09-21T03:54:59.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:54:59.656+0000 7fd695dc4640 1 -- 172.21.15.46:0/2641871002 wait complete. 2024-09-21T03:55:00.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:59 smithi046 ceph-mon[30954]: pgmap v318: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T03:55:00.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:59 smithi046 ceph-mon[30954]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:55:00.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:59 smithi046 ceph-mon[30954]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:55:00.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:54:59 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/2641871002' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:55:00.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:59 smithi105 ceph-mon[34773]: pgmap v318: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T03:55:00.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:59 smithi105 ceph-mon[34773]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:55:00.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:59 smithi105 ceph-mon[34773]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:55:00.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:54:59 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/2641871002' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:55:00.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:59 smithi162 ceph-mon[35071]: pgmap v318: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T03:55:00.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:59 smithi162 ceph-mon[35071]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:55:00.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:59 smithi162 ceph-mon[35071]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:55:00.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:54:59 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/2641871002' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:55:00.398 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T03:55:00.661 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:55:01.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.176+0000 7f14975f6640 1 -- 172.21.15.46:0/783312085 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1490110180 msgr2=0x7f14901125a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:01.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.176+0000 7f14975f6640 1 --2- 172.21.15.46:0/783312085 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1490110180 0x7f14901125a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1488009ca0 tx=0x7f148802a950 comp rx=0 tx=0).stop 2024-09-21T03:55:01.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.176+0000 7f14975f6640 1 -- 172.21.15.46:0/783312085 shutdown_connections 2024-09-21T03:55:01.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.176+0000 7f14975f6640 1 --2- 172.21.15.46:0/783312085 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1490110180 0x7f14901125a0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:01.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.176+0000 7f14975f6640 1 --2- 172.21.15.46:0/783312085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1490102f20 0x7f149010fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:01.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.176+0000 7f14975f6640 1 --2- 172.21.15.46:0/783312085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14901025d0 0x7f14901029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:01.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.176+0000 7f14975f6640 1 -- 172.21.15.46:0/783312085 >> 172.21.15.46:0/783312085 conn(0x7f1490079730 msgr2=0x7f1490079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:01.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.176+0000 7f14975f6640 1 -- 172.21.15.46:0/783312085 shutdown_connections 2024-09-21T03:55:01.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.176+0000 7f14975f6640 1 -- 172.21.15.46:0/783312085 wait complete. 2024-09-21T03:55:01.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.177+0000 7f14975f6640 1 Processor -- start 2024-09-21T03:55:01.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.177+0000 7f14975f6640 1 -- start start 2024-09-21T03:55:01.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.177+0000 7f14975f6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14901025d0 0x7f149019c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:01.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.177+0000 7f14975f6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1490102f20 0x7f149019cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:01.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.177+0000 7f14975f6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1490110180 0x7f14901a1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:01.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.177+0000 7f14975f6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1490115cc0 con 0x7f14901025d0 2024-09-21T03:55:01.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.177+0000 7f14975f6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1490115b40 con 0x7f1490102f20 2024-09-21T03:55:01.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.177+0000 7f14975f6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1490115e40 con 0x7f1490110180 2024-09-21T03:55:01.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.177+0000 7f1495392640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14901025d0 0x7f149019c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:01.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.177+0000 7f1495392640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14901025d0 0x7f149019c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58742/0 (socket says 172.21.15.46:58742) 2024-09-21T03:55:01.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.177+0000 7f1495392640 1 -- 172.21.15.46:0/3202932794 learned_addr learned my addr 172.21.15.46:0/3202932794 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:01.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.178+0000 7f1494b91640 1 --2- 172.21.15.46:0/3202932794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1490102f20 0x7f149019cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:01.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.178+0000 7f1495b93640 1 --2- 172.21.15.46:0/3202932794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1490110180 0x7f14901a1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:01.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.178+0000 7f1495392640 1 -- 172.21.15.46:0/3202932794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1490110180 msgr2=0x7f14901a1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:01.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.178+0000 7f1495392640 1 --2- 172.21.15.46:0/3202932794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1490110180 0x7f14901a1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:01.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.178+0000 7f1495392640 1 -- 172.21.15.46:0/3202932794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1490102f20 msgr2=0x7f149019cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:01.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.178+0000 7f1495392640 1 --2- 172.21.15.46:0/3202932794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1490102f20 0x7f149019cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:01.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.178+0000 7f1495392640 1 -- 172.21.15.46:0/3202932794 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14901a2560 con 0x7f14901025d0 2024-09-21T03:55:01.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.178+0000 7f1495392640 1 --2- 172.21.15.46:0/3202932794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14901025d0 0x7f149019c5f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f148c00d950 tx=0x7f148c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:01.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.178+0000 7f14867fc640 1 -- 172.21.15.46:0/3202932794 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f148c017070 con 0x7f14901025d0 2024-09-21T03:55:01.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.178+0000 7f14867fc640 1 -- 172.21.15.46:0/3202932794 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f148c009c30 con 0x7f14901025d0 2024-09-21T03:55:01.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.178+0000 7f14975f6640 1 -- 172.21.15.46:0/3202932794 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14901a2850 con 0x7f14901025d0 2024-09-21T03:55:01.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.178+0000 7f14867fc640 1 -- 172.21.15.46:0/3202932794 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f148c00f620 con 0x7f14901025d0 2024-09-21T03:55:01.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.178+0000 7f14975f6640 1 -- 172.21.15.46:0/3202932794 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14901a8fb0 con 0x7f14901025d0 2024-09-21T03:55:01.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.179+0000 7f14975f6640 1 -- 172.21.15.46:0/3202932794 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14901029e0 con 0x7f14901025d0 2024-09-21T03:55:01.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.181+0000 7f14867fc640 1 -- 172.21.15.46:0/3202932794 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f148c005030 con 0x7f14901025d0 2024-09-21T03:55:01.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.181+0000 7f14867fc640 1 --2- 172.21.15.46:0/3202932794 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f147c0b6670 0x7f147c0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:01.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.182+0000 7f1494b91640 1 --2- 172.21.15.46:0/3202932794 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f147c0b6670 0x7f147c0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:01.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.182+0000 7f14867fc640 1 -- 172.21.15.46:0/3202932794 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f148c0e7100 con 0x7f14901025d0 2024-09-21T03:55:01.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.182+0000 7f1494b91640 1 --2- 172.21.15.46:0/3202932794 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f147c0b6670 0x7f147c0b8b80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1490103ec0 tx=0x7f148000a250 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:01.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.185+0000 7f14867fc640 1 -- 172.21.15.46:0/3202932794 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f148c0ad830 con 0x7f14901025d0 2024-09-21T03:55:01.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.375+0000 7f14975f6640 1 -- 172.21.15.46:0/3202932794 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f14901a9360 con 0x7f14901025d0 2024-09-21T03:55:01.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.377+0000 7f14867fc640 1 -- 172.21.15.46:0/3202932794 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22876 (secure 0 0 0) 0x7f148c009de0 con 0x7f14901025d0 2024-09-21T03:55:01.379 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:55:01.379 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":77,"fsid":"a82de5ec-77cb-11ef-baf5-efdc52797490","created":"2024-09-21T03:44:31.512271+0000","modified":"2024-09-21T03:53:33.028150+0000","last_up_change":"2024-09-21T03:52:22.609789+0000","last_in_change":"2024-09-21T03:51:58.812316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:48:30.407205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:53:09.943833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:53:12.521980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ff9e1a8-fec7-422c-b594-880efe4684f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6803","nonce":791989880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6805","nonce":791989880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6809","nonce":791989880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6807","nonce":791989880}]},"public_addr":"172.21.15.46:6803/791989880","cluster_addr":"172.21.15.46:6805/791989880","heartbeat_back_addr":"172.21.15.46:6809/791989880","heartbeat_front_addr":"172.21.15.46:6807/791989880","state":["exists","up"]},{"osd":1,"uuid":"3df1bee7-615e-44d0-bd43-2370db6cd06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6801","nonce":1123652172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6803","nonce":1123652172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6807","nonce":1123652172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6805","nonce":1123652172}]},"public_addr":"172.21.15.105:6801/1123652172","cluster_addr":"172.21.15.105:6803/1123652172","heartbeat_back_addr":"172.21.15.105:6807/1123652172","heartbeat_front_addr":"172.21.15.105:6805/1123652172","state":["exists","up"]},{"osd":2,"uuid":"52d0e57f-cfca-447a-8a57-b1d5364cb4d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6801","nonce":34930776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6803","nonce":34930776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6807","nonce":34930776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6805","nonce":34930776}]},"public_addr":"172.21.15.162:6801/34930776","cluster_addr":"172.21.15.162:6803/34930776","heartbeat_back_addr":"172.21.15.162:6807/34930776","heartbeat_front_addr":"172.21.15.162:6805/34930776","state":["exists","up"]},{"osd":3,"uuid":"6f25f721-fc50-4b80-944b-d3df28e7a2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6811","nonce":1355580104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6813","nonce":1355580104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6817","nonce":1355580104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6815","nonce":1355580104}]},"public_addr":"172.21.15.46:6811/1355580104","cluster_addr":"172.21.15.46:6813/1355580104","heartbeat_back_addr":"172.21.15.46:6817/1355580104","heartbeat_front_addr":"172.21.15.46:6815/1355580104","state":["exists","up"]},{"osd":4,"uuid":"c2f41084-e5a1-4b5f-b799-a84b38da63a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6809","nonce":3566174660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6811","nonce":3566174660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6815","nonce":3566174660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6813","nonce":3566174660}]},"public_addr":"172.21.15.105:6809/3566174660","cluster_addr":"172.21.15.105:6811/3566174660","heartbeat_back_addr":"172.21.15.105:6815/3566174660","heartbeat_front_addr":"172.21.15.105:6813/3566174660","state":["exists","up"]},{"osd":5,"uuid":"b433d03b-fae8-4ece-b967-a8af91bc3ab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6809","nonce":3043419818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6811","nonce":3043419818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6815","nonce":3043419818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6813","nonce":3043419818}]},"public_addr":"172.21.15.162:6809/3043419818","cluster_addr":"172.21.15.162:6811/3043419818","heartbeat_back_addr":"172.21.15.162:6815/3043419818","heartbeat_front_addr":"172.21.15.162:6813/3043419818","state":["exists","up"]},{"osd":6,"uuid":"e6b5ce54-69aa-4811-9ca3-cab50525a175","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6819","nonce":1615361645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6821","nonce":1615361645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6825","nonce":1615361645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6823","nonce":1615361645}]},"public_addr":"172.21.15.46:6819/1615361645","cluster_addr":"172.21.15.46:6821/1615361645","heartbeat_back_addr":"172.21.15.46:6825/1615361645","heartbeat_front_addr":"172.21.15.46:6823/1615361645","state":["exists","up"]},{"osd":7,"uuid":"a6e89d5d-ce31-4e0c-9019-5eb13b134feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6817","nonce":1015687379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6819","nonce":1015687379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6823","nonce":1015687379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6821","nonce":1015687379}]},"public_addr":"172.21.15.105:6817/1015687379","cluster_addr":"172.21.15.105:6819/1015687379","heartbeat_back_addr":"172.21.15.105:6823/1015687379","heartbeat_front_addr":"172.21.15.105:6821/1015687379","state":["exists","up"]},{"osd":8,"uuid":"27b2ccec-65be-47b3-a924-c5939ba1cb5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6817","nonce":3441747512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6819","nonce":3441747512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6823","nonce":3441747512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6821","nonce":3441747512}]},"public_addr":"172.21.15.162:6817/3441747512","cluster_addr":"172.21.15.162:6819/3441747512","heartbeat_back_addr":"172.21.15.162:6823/3441747512","heartbeat_front_addr":"172.21.15.162:6821/3441747512","state":["exists","up"]},{"osd":9,"uuid":"3f7cb70c-73c7-48e8-a32b-7445eda2126d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6827","nonce":382230768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6829","nonce":382230768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6833","nonce":382230768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6831","nonce":382230768}]},"public_addr":"172.21.15.46:6827/382230768","cluster_addr":"172.21.15.46:6829/382230768","heartbeat_back_addr":"172.21.15.46:6833/382230768","heartbeat_front_addr":"172.21.15.46:6831/382230768","state":["exists","up"]},{"osd":10,"uuid":"76c3da87-f3c5-4985-87fd-647717b6af85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6825","nonce":1664619099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6827","nonce":1664619099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6831","nonce":1664619099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6829","nonce":1664619099}]},"public_addr":"172.21.15.105:6825/1664619099","cluster_addr":"172.21.15.105:6827/1664619099","heartbeat_back_addr":"172.21.15.105:6831/1664619099","heartbeat_front_addr":"172.21.15.105:6829/1664619099","state":["exists","up"]},{"osd":11,"uuid":"13269da8-5f05-4ce2-9c7a-6dd9c1041cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6825","nonce":1014820476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6827","nonce":1014820476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6831","nonce":1014820476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6829","nonce":1014820476}]},"public_addr":"172.21.15.162:6825/1014820476","cluster_addr":"172.21.15.162:6827/1014820476","heartbeat_back_addr":"172.21.15.162:6831/1014820476","heartbeat_front_addr":"172.21.15.162:6829/1014820476","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:47:38.630436+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:03.441596+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:28.647341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:54.270316+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:49:19.783873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:49:45.344485+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:50:12.165326+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:50:38.095996+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:03.814612+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:29.469718+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:55.407340+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:52:20.360243+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:6801/878116252":"2024-09-22T03:46:31.942086+0000","172.21.15.46:6800/878116252":"2024-09-22T03:46:31.942086+0000","172.21.15.46:0/3574041742":"2024-09-22T03:45:05.097136+0000","172.21.15.46:6801/1185001582":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/2839831446":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/3423884605":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/2761976928":"2024-09-22T03:46:31.942086+0000","172.21.15.46:0/1149961133":"2024-09-22T03:45:05.097136+0000","172.21.15.46:6800/1185001582":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/641493295":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/4033661287":"2024-09-22T03:45:31.101657+0000","172.21.15.46:6800/2733048710":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/3972416280":"2024-09-22T03:46:31.942086+0000","172.21.15.46:6801/2733048710":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/1662975018":"2024-09-22T03:46:31.942086+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:55:01.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.380+0000 7f14975f6640 1 -- 172.21.15.46:0/3202932794 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f147c0b6670 msgr2=0x7f147c0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:01.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.380+0000 7f14975f6640 1 --2- 172.21.15.46:0/3202932794 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f147c0b6670 0x7f147c0b8b80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1490103ec0 tx=0x7f148000a250 comp rx=0 tx=0).stop 2024-09-21T03:55:01.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.380+0000 7f14975f6640 1 -- 172.21.15.46:0/3202932794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14901025d0 msgr2=0x7f149019c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:01.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.380+0000 7f14975f6640 1 --2- 172.21.15.46:0/3202932794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14901025d0 0x7f149019c5f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f148c00d950 tx=0x7f148c00de10 comp rx=0 tx=0).stop 2024-09-21T03:55:01.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.380+0000 7f14975f6640 1 -- 172.21.15.46:0/3202932794 shutdown_connections 2024-09-21T03:55:01.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.380+0000 7f14975f6640 1 --2- 172.21.15.46:0/3202932794 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f147c0b6670 0x7f147c0b8b80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:01.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.380+0000 7f14975f6640 1 --2- 172.21.15.46:0/3202932794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1490110180 0x7f14901a1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:01.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.380+0000 7f14975f6640 1 --2- 172.21.15.46:0/3202932794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1490102f20 0x7f149019cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:01.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.380+0000 7f14975f6640 1 --2- 172.21.15.46:0/3202932794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14901025d0 0x7f149019c5f0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:01.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.380+0000 7f14975f6640 1 -- 172.21.15.46:0/3202932794 >> 172.21.15.46:0/3202932794 conn(0x7f1490079730 msgr2=0x7f1490109d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:01.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.380+0000 7f14975f6640 1 -- 172.21.15.46:0/3202932794 shutdown_connections 2024-09-21T03:55:01.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:01.380+0000 7f14975f6640 1 -- 172.21.15.46:0/3202932794 wait complete. 2024-09-21T03:55:02.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:01 smithi046 ceph-mon[30954]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T03:55:02.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:01 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3202932794' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:55:02.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:01 smithi105 ceph-mon[34773]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T03:55:02.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:01 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3202932794' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:55:02.096 DEBUG:tasks.fwd_scrub:Yielding 2024-09-21T03:55:02.096 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T03:55:02.106 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T03:55:02.106 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi046.front.sepia.ceph.com 2024-09-21T03:55:02.107 DEBUG:teuthology.orchestra.run.smithi046:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-21T03:55:02.107 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-21T03:55:02.107 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:55:02.107 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:55:02.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:01 smithi162 ceph-mon[35071]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T03:55:02.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:01 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3202932794' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:55:02.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.226+0000 7f888f84d640 1 -- 172.21.15.46:0/3689145019 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88881029b0 msgr2=0x7f8888102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:02.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.226+0000 7f888f84d640 1 --2- 172.21.15.46:0/3689145019 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88881029b0 0x7f8888102dc0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8884009900 tx=0x7f888402a3f0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.226+0000 7f888f84d640 1 -- 172.21.15.46:0/3689145019 shutdown_connections 2024-09-21T03:55:02.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.226+0000 7f888f84d640 1 --2- 172.21.15.46:0/3689145019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8888108c30 0x7f888810f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.226+0000 7f888f84d640 1 --2- 172.21.15.46:0/3689145019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88881082e0 0x7f88881086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.226+0000 7f888f84d640 1 --2- 172.21.15.46:0/3689145019 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88881029b0 0x7f8888102dc0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.226+0000 7f888f84d640 1 -- 172.21.15.46:0/3689145019 >> 172.21.15.46:0/3689145019 conn(0x7f888807a740 msgr2=0x7f888807ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:02.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.226+0000 7f888f84d640 1 -- 172.21.15.46:0/3689145019 shutdown_connections 2024-09-21T03:55:02.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.226+0000 7f888f84d640 1 -- 172.21.15.46:0/3689145019 wait complete. 2024-09-21T03:55:02.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.227+0000 7f888f84d640 1 Processor -- start 2024-09-21T03:55:02.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.227+0000 7f888f84d640 1 -- start start 2024-09-21T03:55:02.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.227+0000 7f888f84d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88881029b0 0x7f8888199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:02.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.228+0000 7f888f84d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88881082e0 0x7f88881998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:02.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.228+0000 7f888f84d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8888108c30 0x7f888819eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:02.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.228+0000 7f888f84d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f88881128f0 con 0x7f8888108c30 2024-09-21T03:55:02.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.228+0000 7f888f84d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8888112770 con 0x7f88881082e0 2024-09-21T03:55:02.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.228+0000 7f888f84d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8888112a70 con 0x7f88881029b0 2024-09-21T03:55:02.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.228+0000 7f888ddea640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8888108c30 0x7f888819eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:02.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.228+0000 7f888ddea640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8888108c30 0x7f888819eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41060/0 (socket says 172.21.15.46:41060) 2024-09-21T03:55:02.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.228+0000 7f888ddea640 1 -- 172.21.15.46:0/798041748 learned_addr learned my addr 172.21.15.46:0/798041748 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:02.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.228+0000 7f888d5e9640 1 --2- 172.21.15.46:0/798041748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88881029b0 0x7f8888199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:02.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.228+0000 7f888cde8640 1 --2- 172.21.15.46:0/798041748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88881082e0 0x7f88881998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:02.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.228+0000 7f888ddea640 1 -- 172.21.15.46:0/798041748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88881029b0 msgr2=0x7f8888199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:02.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.228+0000 7f888ddea640 1 --2- 172.21.15.46:0/798041748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88881029b0 0x7f8888199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.228+0000 7f888ddea640 1 -- 172.21.15.46:0/798041748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88881082e0 msgr2=0x7f88881998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:02.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.228+0000 7f888ddea640 1 --2- 172.21.15.46:0/798041748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88881082e0 0x7f88881998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.228+0000 7f888ddea640 1 -- 172.21.15.46:0/798041748 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f888819f1f0 con 0x7f8888108c30 2024-09-21T03:55:02.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.228+0000 7f888ddea640 1 --2- 172.21.15.46:0/798041748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8888108c30 0x7f888819eb80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f888000cce0 tx=0x7f888000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:02.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.228+0000 7f887a7fc640 1 -- 172.21.15.46:0/798041748 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888000f450 con 0x7f8888108c30 2024-09-21T03:55:02.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.228+0000 7f887a7fc640 1 -- 172.21.15.46:0/798041748 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f888000faa0 con 0x7f8888108c30 2024-09-21T03:55:02.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.228+0000 7f887a7fc640 1 -- 172.21.15.46:0/798041748 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8880018b70 con 0x7f8888108c30 2024-09-21T03:55:02.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.228+0000 7f888f84d640 1 -- 172.21.15.46:0/798041748 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f888819f4e0 con 0x7f8888108c30 2024-09-21T03:55:02.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.229+0000 7f888f84d640 1 -- 172.21.15.46:0/798041748 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88881a5d00 con 0x7f8888108c30 2024-09-21T03:55:02.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.230+0000 7f888f84d640 1 -- 172.21.15.46:0/798041748 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8888102dc0 con 0x7f8888108c30 2024-09-21T03:55:02.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.231+0000 7f887a7fc640 1 -- 172.21.15.46:0/798041748 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f8880018d10 con 0x7f8888108c30 2024-09-21T03:55:02.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.232+0000 7f887a7fc640 1 --2- 172.21.15.46:0/798041748 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f88740b65f0 0x7f88740b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:02.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.232+0000 7f888d5e9640 1 --2- 172.21.15.46:0/798041748 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f88740b65f0 0x7f88740b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:02.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.232+0000 7f887a7fc640 1 -- 172.21.15.46:0/798041748 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f88800e79a0 con 0x7f8888108c30 2024-09-21T03:55:02.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.233+0000 7f888d5e9640 1 --2- 172.21.15.46:0/798041748 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f88740b65f0 0x7f88740b8b00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8884031440 tx=0x7f8884009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:02.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.237+0000 7f887a7fc640 1 -- 172.21.15.46:0/798041748 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8880014030 con 0x7f8888108c30 2024-09-21T03:55:02.383 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:55:02.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.497+0000 7f888f84d640 1 -- 172.21.15.46:0/798041748 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f8888063800 con 0x7f88740b65f0 2024-09-21T03:55:02.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.648+0000 7f887a7fc640 1 -- 172.21.15.46:0/798041748 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f8888063800 con 0x7f88740b65f0 2024-09-21T03:55:02.651 INFO:teuthology.orchestra.run.smithi046.stdout:Schedule set for path / 2024-09-21T03:55:02.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.651+0000 7f888f84d640 1 -- 172.21.15.46:0/798041748 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f88740b65f0 msgr2=0x7f88740b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:02.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.651+0000 7f888f84d640 1 --2- 172.21.15.46:0/798041748 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f88740b65f0 0x7f88740b8b00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8884031440 tx=0x7f8884009560 comp rx=0 tx=0).stop 2024-09-21T03:55:02.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.651+0000 7f888f84d640 1 -- 172.21.15.46:0/798041748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8888108c30 msgr2=0x7f888819eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:02.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.651+0000 7f888f84d640 1 --2- 172.21.15.46:0/798041748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8888108c30 0x7f888819eb80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f888000cce0 tx=0x7f888000a620 comp rx=0 tx=0).stop 2024-09-21T03:55:02.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.651+0000 7f888f84d640 1 -- 172.21.15.46:0/798041748 shutdown_connections 2024-09-21T03:55:02.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.651+0000 7f888f84d640 1 --2- 172.21.15.46:0/798041748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8888108c30 0x7f888819eb80 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.651+0000 7f888f84d640 1 --2- 172.21.15.46:0/798041748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88881082e0 0x7f88881998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.651+0000 7f888f84d640 1 --2- 172.21.15.46:0/798041748 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f88740b65f0 0x7f88740b8b00 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.651+0000 7f888f84d640 1 --2- 172.21.15.46:0/798041748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88881029b0 0x7f8888199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.651+0000 7f888f84d640 1 -- 172.21.15.46:0/798041748 >> 172.21.15.46:0/798041748 conn(0x7f888807a740 msgr2=0x7f8888106420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:02.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.651+0000 7f888f84d640 1 -- 172.21.15.46:0/798041748 shutdown_connections 2024-09-21T03:55:02.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.651+0000 7f888f84d640 1 -- 172.21.15.46:0/798041748 wait complete. 2024-09-21T03:55:02.666 DEBUG:teuthology.orchestra.run.smithi046:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-21T03:55:02.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.785+0000 7f458bc69640 1 -- 172.21.15.46:0/2530869309 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4584108c60 msgr2=0x7f458410f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:02.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.785+0000 7f458bc69640 1 --2- 172.21.15.46:0/2530869309 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4584108c60 0x7f458410f490 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f457c009ca0 tx=0x7f457c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.785+0000 7f458bc69640 1 -- 172.21.15.46:0/2530869309 shutdown_connections 2024-09-21T03:55:02.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.785+0000 7f458bc69640 1 --2- 172.21.15.46:0/2530869309 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4584108c60 0x7f458410f490 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.785+0000 7f458bc69640 1 --2- 172.21.15.46:0/2530869309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4584108310 0x7f4584108720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.785+0000 7f458bc69640 1 --2- 172.21.15.46:0/2530869309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45841029e0 0x7f4584102df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.785+0000 7f458bc69640 1 -- 172.21.15.46:0/2530869309 >> 172.21.15.46:0/2530869309 conn(0x7f45840fe3e0 msgr2=0x7f4584100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:02.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.785+0000 7f458bc69640 1 -- 172.21.15.46:0/2530869309 shutdown_connections 2024-09-21T03:55:02.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.785+0000 7f458bc69640 1 -- 172.21.15.46:0/2530869309 wait complete. 2024-09-21T03:55:02.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.786+0000 7f458bc69640 1 Processor -- start 2024-09-21T03:55:02.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.786+0000 7f458bc69640 1 -- start start 2024-09-21T03:55:02.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.786+0000 7f458bc69640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45841029e0 0x7f458419b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:02.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.786+0000 7f458bc69640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4584108310 0x7f458419b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:02.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.786+0000 7f458bc69640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4584108c60 0x7f458419bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:02.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.786+0000 7f458bc69640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4584112920 con 0x7f4584108310 2024-09-21T03:55:02.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.786+0000 7f458bc69640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f45841127a0 con 0x7f45841029e0 2024-09-21T03:55:02.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.786+0000 7f458bc69640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4584112aa0 con 0x7f4584108c60 2024-09-21T03:55:02.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.786+0000 7f4589204640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4584108310 0x7f458419b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:02.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.786+0000 7f4589204640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4584108310 0x7f458419b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41096/0 (socket says 172.21.15.46:41096) 2024-09-21T03:55:02.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.786+0000 7f4589204640 1 -- 172.21.15.46:0/176075625 learned_addr learned my addr 172.21.15.46:0/176075625 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:02.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.787+0000 7f458a206640 1 --2- 172.21.15.46:0/176075625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4584108c60 0x7f458419bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:02.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.787+0000 7f4589a05640 1 --2- 172.21.15.46:0/176075625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45841029e0 0x7f458419b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:02.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.787+0000 7f4589204640 1 -- 172.21.15.46:0/176075625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4584108c60 msgr2=0x7f458419bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:02.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.787+0000 7f4589204640 1 --2- 172.21.15.46:0/176075625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4584108c60 0x7f458419bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.787+0000 7f4589204640 1 -- 172.21.15.46:0/176075625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45841029e0 msgr2=0x7f458419b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:02.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.787+0000 7f4589204640 1 --2- 172.21.15.46:0/176075625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45841029e0 0x7f458419b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.787+0000 7f4589204640 1 -- 172.21.15.46:0/176075625 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45841a64b0 con 0x7f4584108310 2024-09-21T03:55:02.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.787+0000 7f4589204640 1 --2- 172.21.15.46:0/176075625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4584108310 0x7f458419b730 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f457400d750 tx=0x7f457400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:02.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.787+0000 7f457affd640 1 -- 172.21.15.46:0/176075625 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4574017070 con 0x7f4584108310 2024-09-21T03:55:02.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.787+0000 7f457affd640 1 -- 172.21.15.46:0/176075625 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45740054d0 con 0x7f4584108310 2024-09-21T03:55:02.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.787+0000 7f458bc69640 1 -- 172.21.15.46:0/176075625 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45841a67a0 con 0x7f4584108310 2024-09-21T03:55:02.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.787+0000 7f457affd640 1 -- 172.21.15.46:0/176075625 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4574004c30 con 0x7f4584108310 2024-09-21T03:55:02.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.787+0000 7f458bc69640 1 -- 172.21.15.46:0/176075625 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45841a6cf0 con 0x7f4584108310 2024-09-21T03:55:02.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.788+0000 7f458bc69640 1 -- 172.21.15.46:0/176075625 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4584102df0 con 0x7f4584108310 2024-09-21T03:55:02.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.790+0000 7f457affd640 1 -- 172.21.15.46:0/176075625 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f4574004dd0 con 0x7f4584108310 2024-09-21T03:55:02.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.791+0000 7f457affd640 1 --2- 172.21.15.46:0/176075625 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f45700b6670 0x7f45700b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:02.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.791+0000 7f457affd640 1 -- 172.21.15.46:0/176075625 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f45740e7400 con 0x7f4584108310 2024-09-21T03:55:02.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.791+0000 7f4589a05640 1 --2- 172.21.15.46:0/176075625 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f45700b6670 0x7f45700b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:02.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.791+0000 7f4589a05640 1 --2- 172.21.15.46:0/176075625 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f45700b6670 0x7f45700b8b80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f458406c500 tx=0x7f4580005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:02.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.794+0000 7f457affd640 1 -- 172.21.15.46:0/176075625 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f45740adb30 con 0x7f4584108310 2024-09-21T03:55:02.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.899+0000 7f6bea227640 1 -- 172.21.15.46:0/993023263 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6be41049b0 msgr2=0x7f6be4104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:02.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.899+0000 7f6bea227640 1 --2- 172.21.15.46:0/993023263 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6be41049b0 0x7f6be4104dc0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4009900 tx=0x7f6bd402a410 comp rx=0 tx=0).stop 2024-09-21T03:55:02.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.899+0000 7f6bea227640 1 -- 172.21.15.46:0/993023263 shutdown_connections 2024-09-21T03:55:02.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.899+0000 7f6bea227640 1 --2- 172.21.15.46:0/993023263 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6be410de10 0x7f6be4110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.899+0000 7f6bea227640 1 --2- 172.21.15.46:0/993023263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6be4105300 0x7f6be410d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.899+0000 7f6bea227640 1 --2- 172.21.15.46:0/993023263 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6be41049b0 0x7f6be4104dc0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.899+0000 7f6bea227640 1 -- 172.21.15.46:0/993023263 >> 172.21.15.46:0/993023263 conn(0x7f6be4079730 msgr2=0x7f6be4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:02.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.899+0000 7f6bea227640 1 -- 172.21.15.46:0/993023263 shutdown_connections 2024-09-21T03:55:02.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.899+0000 7f6bea227640 1 -- 172.21.15.46:0/993023263 wait complete. 2024-09-21T03:55:02.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.900+0000 7f6bea227640 1 Processor -- start 2024-09-21T03:55:02.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.900+0000 7f6bea227640 1 -- start start 2024-09-21T03:55:02.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.900+0000 7f6bea227640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6be41049b0 0x7f6be419a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:02.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.900+0000 7f6bea227640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6be4105300 0x7f6be419aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:02.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.900+0000 7f6bea227640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6be410de10 0x7f6be419fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:02.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.900+0000 7f6bea227640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6be4113a70 con 0x7f6be410de10 2024-09-21T03:55:02.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.900+0000 7f6bea227640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6be41138f0 con 0x7f6be4105300 2024-09-21T03:55:02.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.900+0000 7f6bea227640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6be4113bf0 con 0x7f6be41049b0 2024-09-21T03:55:02.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.901+0000 7f6be3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6be410de10 0x7f6be419fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:02.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.901+0000 7f6be3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6be410de10 0x7f6be419fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41120/0 (socket says 172.21.15.46:41120) 2024-09-21T03:55:02.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.901+0000 7f6be3fff640 1 -- 172.21.15.46:0/16758338 learned_addr learned my addr 172.21.15.46:0/16758338 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:02.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.901+0000 7f6be37fe640 1 --2- 172.21.15.46:0/16758338 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6be41049b0 0x7f6be419a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:02.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.901+0000 7f6be2ffd640 1 --2- 172.21.15.46:0/16758338 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6be4105300 0x7f6be419aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:02.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.901+0000 7f6be3fff640 1 -- 172.21.15.46:0/16758338 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6be41049b0 msgr2=0x7f6be419a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:02.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.901+0000 7f6be3fff640 1 --2- 172.21.15.46:0/16758338 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6be41049b0 0x7f6be419a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.901+0000 7f6be3fff640 1 -- 172.21.15.46:0/16758338 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6be4105300 msgr2=0x7f6be419aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:02.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.901+0000 7f6be3fff640 1 --2- 172.21.15.46:0/16758338 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6be4105300 0x7f6be419aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.901+0000 7f6be3fff640 1 -- 172.21.15.46:0/16758338 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be41a04b0 con 0x7f6be410de10 2024-09-21T03:55:02.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.901+0000 7f6be37fe640 1 --2- 172.21.15.46:0/16758338 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6be41049b0 0x7f6be419a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:55:02.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.901+0000 7f6be3fff640 1 --2- 172.21.15.46:0/16758338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6be410de10 0x7f6be419fd80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc00d750 tx=0x7f6bdc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:02.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.901+0000 7f6be0ff9640 1 -- 172.21.15.46:0/16758338 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc017070 con 0x7f6be410de10 2024-09-21T03:55:02.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.901+0000 7f6be0ff9640 1 -- 172.21.15.46:0/16758338 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bdc0054d0 con 0x7f6be410de10 2024-09-21T03:55:02.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.901+0000 7f6be0ff9640 1 -- 172.21.15.46:0/16758338 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc004c60 con 0x7f6be410de10 2024-09-21T03:55:02.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.901+0000 7f6bea227640 1 -- 172.21.15.46:0/16758338 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6be41a07a0 con 0x7f6be410de10 2024-09-21T03:55:02.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.902+0000 7f6bea227640 1 -- 172.21.15.46:0/16758338 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6be41a6f00 con 0x7f6be410de10 2024-09-21T03:55:02.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.904+0000 7f6bf079b740 1 Processor -- start 2024-09-21T03:55:02.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.904+0000 7f6be0ff9640 1 -- 172.21.15.46:0/16758338 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f6bdc009bd0 con 0x7f6be410de10 2024-09-21T03:55:02.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.905+0000 7f6bf079b740 1 -- start start 2024-09-21T03:55:02.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.905+0000 7f6bf079b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f33485350 0x564f3382c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:02.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.905+0000 7f6bf079b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564f3345c490 0x564f3382c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:02.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.905+0000 7f6bf079b740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f33464670 0x564f3382ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:02.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.905+0000 7f6bf079b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x564f337a2e60 con 0x564f3345c490 2024-09-21T03:55:02.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.905+0000 7f6bf079b740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x564f33792290 con 0x564f33464670 2024-09-21T03:55:02.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.905+0000 7f6bf079b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564f337960a0 con 0x564f33485350 2024-09-21T03:55:02.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.905+0000 7f6be37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564f3345c490 0x564f3382c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:02.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.905+0000 7f6be37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564f3345c490 0x564f3382c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41126/0 (socket says 172.21.15.46:41126) 2024-09-21T03:55:02.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.905+0000 7f6be37fe640 1 -- 172.21.15.46:0/1395473127 learned_addr learned my addr 172.21.15.46:0/1395473127 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:02.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.905+0000 7f6be2ffd640 1 --2- 172.21.15.46:0/1395473127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f33485350 0x564f3382c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:02.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.905+0000 7f6be2ffd640 1 --2- 172.21.15.46:0/1395473127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f33464670 0x564f3382ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:02.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.906+0000 7f6be0ff9640 1 --2- 172.21.15.46:0/16758338 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f6bcc0b65f0 0x7f6bcc0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:02.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.906+0000 7f6be37fe640 1 -- 172.21.15.46:0/1395473127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f33485350 msgr2=0x564f3382c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:02.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.906+0000 7f6be37fe640 1 --2- 172.21.15.46:0/1395473127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f33485350 0x564f3382c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.906+0000 7f6be37fe640 1 -- 172.21.15.46:0/1395473127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f33464670 msgr2=0x564f3382ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:02.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.906+0000 7f6be37fe640 1 --2- 172.21.15.46:0/1395473127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f33464670 0x564f3382ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.906+0000 7f6be37fe640 1 -- 172.21.15.46:0/1395473127 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f334f0930 con 0x564f3345c490 2024-09-21T03:55:02.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.906+0000 7f6be3fff640 1 --2- 172.21.15.46:0/16758338 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f6bcc0b65f0 0x7f6bcc0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:02.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.906+0000 7f6be0ff9640 1 -- 172.21.15.46:0/16758338 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f6bdc0e6f90 con 0x7f6be410de10 2024-09-21T03:55:02.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.906+0000 7f6be37fe640 1 --2- 172.21.15.46:0/1395473127 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564f3345c490 0x564f3382c970 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4031440 tx=0x7f6bd4032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5252cfd82c8147d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:02.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.906+0000 7f6bc9ffb640 1 -- 172.21.15.46:0/1395473127 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd403f070 con 0x564f3345c490 2024-09-21T03:55:02.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.906+0000 7f6bc9ffb640 1 -- 172.21.15.46:0/1395473127 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bd40316a0 con 0x564f3345c490 2024-09-21T03:55:02.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.906+0000 7f6bc9ffb640 1 -- 172.21.15.46:0/1395473127 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd4035070 con 0x564f3345c490 2024-09-21T03:55:02.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.908+0000 7f6bf079b740 1 -- 172.21.15.46:0/1395473127 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564f3345c490 msgr2=0x564f3382c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:02.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.908+0000 7f6be3fff640 1 --2- 172.21.15.46:0/16758338 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f6bcc0b65f0 0x7f6bcc0b8b00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc0acc40 tx=0x7f6bdc0a17a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:02.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.908+0000 7f6bf079b740 1 --2- 172.21.15.46:0/1395473127 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564f3345c490 0x564f3382c970 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4031440 tx=0x7f6bd4032d00 comp rx=0 tx=0).stop 2024-09-21T03:55:02.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.908+0000 7f6bf079b740 1 -- 172.21.15.46:0/1395473127 shutdown_connections 2024-09-21T03:55:02.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.908+0000 7f6bf079b740 1 --2- 172.21.15.46:0/1395473127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f33464670 0x564f3382ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.908+0000 7f6bf079b740 1 --2- 172.21.15.46:0/1395473127 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564f3345c490 0x564f3382c970 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.908+0000 7f6bf079b740 1 --2- 172.21.15.46:0/1395473127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f33485350 0x564f3382c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.908+0000 7f6bf079b740 1 -- 172.21.15.46:0/1395473127 >> 172.21.15.46:0/1395473127 conn(0x564f33479740 msgr2=0x564f3382a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:02.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.908+0000 7f6bf079b740 1 -- 172.21.15.46:0/1395473127 shutdown_connections 2024-09-21T03:55:02.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.908+0000 7f6bf079b740 1 -- 172.21.15.46:0/1395473127 wait complete. 2024-09-21T03:55:02.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.908+0000 7f6bf079b740 1 -- start start 2024-09-21T03:55:02.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.908+0000 7f6bf079b740 1 Processor -- start 2024-09-21T03:55:02.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.909+0000 7f6bf079b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f3345c490 0x564f33837fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:02.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.909+0000 7f6bf079b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564f33464670 0x564f338384f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:02.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.909+0000 7f6bf079b740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f33485350 0x564f338482b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:02.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.909+0000 7f6bf079b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x564f335f3890 con 0x564f33464670 2024-09-21T03:55:02.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.909+0000 7f6bf079b740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x564f3372cd40 con 0x564f33485350 2024-09-21T03:55:02.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.909+0000 7f6bf079b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564f3383efc0 con 0x564f3345c490 2024-09-21T03:55:02.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.909+0000 7f6bf079b740 10 client.0 _ll_register_callbacks cb 0x564f33790c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:55:02.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.909+0000 7f6be37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564f33464670 0x564f338384f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:02.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.909+0000 7f6be37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564f33464670 0x564f338384f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41134/0 (socket says 172.21.15.46:41134) 2024-09-21T03:55:02.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.909+0000 7f6be37fe640 1 -- 172.21.15.46:0/2641694542 learned_addr learned my addr 172.21.15.46:0/2641694542 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:02.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.909+0000 7f6be2ffd640 1 --2- 172.21.15.46:0/2641694542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f33485350 0x564f338482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:02.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.909+0000 7f6be2ffd640 1 --2- 172.21.15.46:0/2641694542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f3345c490 0x564f33837fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:02.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.909+0000 7f6be37fe640 1 -- 172.21.15.46:0/2641694542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f3345c490 msgr2=0x564f33837fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:02.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.909+0000 7f6be37fe640 1 --2- 172.21.15.46:0/2641694542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f3345c490 0x564f33837fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.909+0000 7f6be37fe640 1 -- 172.21.15.46:0/2641694542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f33485350 msgr2=0x564f338482b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:02.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.909+0000 7f6be37fe640 1 --2- 172.21.15.46:0/2641694542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f33485350 0x564f338482b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.909+0000 7f6be37fe640 1 -- 172.21.15.46:0/2641694542 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f33848840 con 0x564f33464670 2024-09-21T03:55:02.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.909+0000 7f6be2ffd640 1 --2- 172.21.15.46:0/2641694542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f33485350 0x564f338482b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:55:02.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.910+0000 7f6be37fe640 1 --2- 172.21.15.46:0/2641694542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564f33464670 0x564f338384f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6bd402a930 tx=0x7f6bd4005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac98fb7d2cec675d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:02.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.910+0000 7f6bc2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:55:02.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.910+0000 7f6bc2ffd640 1 -- 172.21.15.46:0/2641694542 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd403f040 con 0x564f33464670 2024-09-21T03:55:02.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.910+0000 7f6bf079b740 1 -- 172.21.15.46:0/2641694542 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bd40316a0 con 0x564f33464670 2024-09-21T03:55:02.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.910+0000 7f6bc2ffd640 1 -- 172.21.15.46:0/2641694542 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f6bd4004250 con 0x564f33464670 2024-09-21T03:55:02.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.910+0000 7f6bc2ffd640 1 -- 172.21.15.46:0/2641694542 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6bd4035040 con 0x564f33464670 2024-09-21T03:55:02.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.910+0000 7f6bf079b740 10 client.15375 fetch_fsmap learned FSMap version 20 2024-09-21T03:55:02.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.910+0000 7f6bf079b740 1 -- 172.21.15.46:0/2641694542 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564f3384b170 con 0x564f33464670 2024-09-21T03:55:02.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.910+0000 7f6bc2ffd640 1 -- 172.21.15.46:0/2641694542 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bd40316a0 con 0x564f33464670 2024-09-21T03:55:02.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.911+0000 7f6bc2ffd640 1 -- 172.21.15.46:0/2641694542 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f6bd403b430 con 0x564f33464670 2024-09-21T03:55:02.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.911+0000 7f6bf079b740 10 client.15375 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:55:02.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.911+0000 7f6bf079b740 10 client.15375 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:55:02.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.911+0000 7f6bf079b740 20 client.15375 populate_metadata read hostname 'smithi046' 2024-09-21T03:55:02.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.911+0000 7f6bf079b740 1 --2- 172.21.15.46:0/2641694542 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x564f33443cd0 0x564f3384e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:02.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.911+0000 7f6bf079b740 4 client.15375 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:55:02.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.911+0000 7f6bf079b740 1 -- 172.21.15.46:0/2641694542 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f337a4db0 con 0x564f33443cd0 2024-09-21T03:55:02.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.911+0000 7f6be2ffd640 1 --2- 172.21.15.46:0/2641694542 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x564f33443cd0 0x564f3384e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:02.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.911+0000 7f6be2ffd640 1 --2- 172.21.15.46:0/2641694542 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x564f33443cd0 0x564f3384e4d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7843e5b182656eb server_cookie=e9f023f581d4c790 in_seq=0 out_seq=0 2024-09-21T03:55:02.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.911+0000 7f6bc2ffd640 10 client.15375 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:02.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.912+0000 7f6bc2ffd640 1 -- 172.21.15.46:0/2641694542 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564f337a4db0 con 0x564f33443cd0 2024-09-21T03:55:02.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.912+0000 7f6bc2ffd640 10 client.15375 handle_command_reply: tid=0 2024-09-21T03:55:02.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.912+0000 7f6bf079b740 1 client.15375 shutdown 2024-09-21T03:55:02.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.912+0000 7f6bf079b740 1 -- 172.21.15.46:0/2641694542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564f33464670 msgr2=0x564f338384f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:02.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.912+0000 7f6bf079b740 1 --2- 172.21.15.46:0/2641694542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564f33464670 0x564f338384f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6bd402a930 tx=0x7f6bd4005760 comp rx=0 tx=0).stop 2024-09-21T03:55:02.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.913+0000 7f6bf079b740 1 -- 172.21.15.46:0/2641694542 shutdown_connections 2024-09-21T03:55:02.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.913+0000 7f6bf079b740 1 --2- 172.21.15.46:0/2641694542 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x564f33443cd0 0x564f3384e4d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.913+0000 7f6bf079b740 1 --2- 172.21.15.46:0/2641694542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f33485350 0x564f338482b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.913+0000 7f6bf079b740 1 --2- 172.21.15.46:0/2641694542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564f33464670 0x564f338384f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.913+0000 7f6bf079b740 1 --2- 172.21.15.46:0/2641694542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f3345c490 0x564f33837fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.913+0000 7f6bf079b740 1 -- 172.21.15.46:0/2641694542 >> 172.21.15.46:0/2641694542 conn(0x564f33479740 msgr2=0x564f3382f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:02.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.913+0000 7f6bc2ffd640 0 client.15375 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:02.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.913+0000 7f6bf079b740 1 -- 172.21.15.46:0/2641694542 shutdown_connections 2024-09-21T03:55:02.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.913+0000 7f6bf079b740 1 -- 172.21.15.46:0/2641694542 wait complete. 2024-09-21T03:55:02.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.913+0000 7f6bf079b740 20 client.15375 trim_cache size 0 max 16384 2024-09-21T03:55:02.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.931+0000 7f6bf079b740 1 Processor -- start 2024-09-21T03:55:02.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.931+0000 7f6bf079b740 1 -- start start 2024-09-21T03:55:02.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.931+0000 7f6bf079b740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f3345c490 0x564f33848220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:02.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.931+0000 7f6bf079b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564f33464670 0x564f33832550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:02.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.931+0000 7f6bf079b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f33485350 0x564f33834fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:02.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.931+0000 7f6bf079b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6be41ab2d0 con 0x564f33464670 2024-09-21T03:55:02.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.931+0000 7f6bf079b740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6be41adb70 con 0x564f3345c490 2024-09-21T03:55:02.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.931+0000 7f6bf079b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6be41ab960 con 0x564f33485350 2024-09-21T03:55:02.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.931+0000 7f6be37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564f33464670 0x564f33832550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:02.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.931+0000 7f6be37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564f33464670 0x564f33832550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41144/0 (socket says 172.21.15.46:41144) 2024-09-21T03:55:02.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.931+0000 7f6be37fe640 1 -- 172.21.15.46:0/4279328286 learned_addr learned my addr 172.21.15.46:0/4279328286 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:02.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.931+0000 7f6be2ffd640 1 --2- 172.21.15.46:0/4279328286 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f3345c490 0x564f33848220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:02.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.931+0000 7f6be2ffd640 1 --2- 172.21.15.46:0/4279328286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f33485350 0x564f33834fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:02.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.932+0000 7f6be37fe640 1 -- 172.21.15.46:0/4279328286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f33485350 msgr2=0x564f33834fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:02.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.932+0000 7f6be37fe640 1 --2- 172.21.15.46:0/4279328286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f33485350 0x564f33834fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.932+0000 7f6be37fe640 1 -- 172.21.15.46:0/4279328286 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f3345c490 msgr2=0x564f33848220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:02.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.932+0000 7f6be37fe640 1 --2- 172.21.15.46:0/4279328286 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f3345c490 0x564f33848220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.932+0000 7f6be37fe640 1 -- 172.21.15.46:0/4279328286 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f33839070 con 0x564f33464670 2024-09-21T03:55:02.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.932+0000 7f6be2ffd640 1 --2- 172.21.15.46:0/4279328286 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f3345c490 0x564f33848220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:55:02.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.932+0000 7f6be37fe640 1 --2- 172.21.15.46:0/4279328286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564f33464670 0x564f33832550 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6bd403b850 tx=0x7f6bd402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4810bfa566eaa89 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:02.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.932+0000 7f6bc97fa640 1 -- 172.21.15.46:0/4279328286 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd40316a0 con 0x564f33464670 2024-09-21T03:55:02.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.932+0000 7f6bc97fa640 1 -- 172.21.15.46:0/4279328286 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bd403bac0 con 0x564f33464670 2024-09-21T03:55:02.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.932+0000 7f6bc97fa640 1 -- 172.21.15.46:0/4279328286 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd40044b0 con 0x564f33464670 2024-09-21T03:55:02.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.933+0000 7f6bf079b740 1 -- 172.21.15.46:0/4279328286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564f33464670 msgr2=0x564f33832550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:02.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.933+0000 7f6bf079b740 1 --2- 172.21.15.46:0/4279328286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564f33464670 0x564f33832550 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6bd403b850 tx=0x7f6bd402a410 comp rx=0 tx=0).stop 2024-09-21T03:55:02.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.933+0000 7f6bf079b740 1 -- 172.21.15.46:0/4279328286 shutdown_connections 2024-09-21T03:55:02.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.933+0000 7f6bf079b740 1 --2- 172.21.15.46:0/4279328286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f33485350 0x564f33834fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.933+0000 7f6bf079b740 1 --2- 172.21.15.46:0/4279328286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564f33464670 0x564f33832550 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.933+0000 7f6bf079b740 1 --2- 172.21.15.46:0/4279328286 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f3345c490 0x564f33848220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.933+0000 7f6bf079b740 1 -- 172.21.15.46:0/4279328286 >> 172.21.15.46:0/4279328286 conn(0x564f33479740 msgr2=0x564f33836630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:02.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.933+0000 7f6bf079b740 1 -- 172.21.15.46:0/4279328286 shutdown_connections 2024-09-21T03:55:02.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.933+0000 7f6bf079b740 1 -- 172.21.15.46:0/4279328286 wait complete. 2024-09-21T03:55:02.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.934+0000 7f6bf079b740 1 -- start start 2024-09-21T03:55:02.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.934+0000 7f6bf079b740 1 Processor -- start 2024-09-21T03:55:02.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.934+0000 7f6bf079b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564f3345c490 0x564f3384f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:02.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.934+0000 7f6bf079b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f33464670 0x564f3384fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:02.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.934+0000 7f6bf079b740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f33485350 0x564f338b7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:02.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.934+0000 7f6bf079b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6be41ac030 con 0x564f3345c490 2024-09-21T03:55:02.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.934+0000 7f6bf079b740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6be41ad4a0 con 0x564f33485350 2024-09-21T03:55:02.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.934+0000 7f6bf079b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6be41ac700 con 0x564f33464670 2024-09-21T03:55:02.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.934+0000 7f6bf079b740 10 client.0 _ll_register_callbacks cb 0x7f6bd8014600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:55:02.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.934+0000 7f6be2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564f3345c490 0x564f3384f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:02.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.934+0000 7f6be2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564f3345c490 0x564f3384f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41148/0 (socket says 172.21.15.46:41148) 2024-09-21T03:55:02.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.934+0000 7f6be2ffd640 1 -- 172.21.15.46:0/1114042233 learned_addr learned my addr 172.21.15.46:0/1114042233 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:02.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.935+0000 7f6be37fe640 1 --2- 172.21.15.46:0/1114042233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f33464670 0x564f3384fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:02.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.935+0000 7f6be2ffd640 1 -- 172.21.15.46:0/1114042233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f33464670 msgr2=0x564f3384fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:02.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.935+0000 7f6be2ffd640 1 --2- 172.21.15.46:0/1114042233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f33464670 0x564f3384fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.935+0000 7f6be2ffd640 1 -- 172.21.15.46:0/1114042233 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f33485350 msgr2=0x564f338b7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:02.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.935+0000 7f6be2ffd640 1 --2- 172.21.15.46:0/1114042233 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f33485350 0x564f338b7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.935+0000 7f6be2ffd640 1 -- 172.21.15.46:0/1114042233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f338b8190 con 0x564f3345c490 2024-09-21T03:55:02.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.935+0000 7f6be37fe640 1 --2- 172.21.15.46:0/1114042233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f33464670 0x564f3384fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:55:02.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.935+0000 7f6be2ffd640 1 --2- 172.21.15.46:0/1114042233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564f3345c490 0x564f3384f910 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6be406ad30 tx=0x7f6bd8005ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d77e0385c6626e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:02.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.935+0000 7f6bc2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:55:02.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.935+0000 7f6bc2ffd640 1 -- 172.21.15.46:0/1114042233 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd8013da0 con 0x564f3345c490 2024-09-21T03:55:02.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.935+0000 7f6bc2ffd640 1 -- 172.21.15.46:0/1114042233 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f6bd8005040 con 0x564f3345c490 2024-09-21T03:55:02.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.935+0000 7f6bf079b740 1 -- 172.21.15.46:0/1114042233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bd403bac0 con 0x564f3345c490 2024-09-21T03:55:02.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.936+0000 7f6bc2ffd640 1 -- 172.21.15.46:0/1114042233 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6bd8005240 con 0x564f3345c490 2024-09-21T03:55:02.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.936+0000 7f6bf079b740 10 client.15381 fetch_fsmap learned FSMap version 20 2024-09-21T03:55:02.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.936+0000 7f6bf079b740 1 -- 172.21.15.46:0/1114042233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564f338b93b0 con 0x564f3345c490 2024-09-21T03:55:02.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.936+0000 7f6bc2ffd640 1 -- 172.21.15.46:0/1114042233 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bd403bac0 con 0x564f3345c490 2024-09-21T03:55:02.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.936+0000 7f6bc2ffd640 1 -- 172.21.15.46:0/1114042233 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f6bd80246b0 con 0x564f3345c490 2024-09-21T03:55:02.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.936+0000 7f6bf079b740 10 client.15381 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:55:02.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.936+0000 7f6bf079b740 10 client.15381 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:55:02.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.936+0000 7f6bf079b740 20 client.15381 populate_metadata read hostname 'smithi046' 2024-09-21T03:55:02.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.936+0000 7f6bf079b740 1 --2- 172.21.15.46:0/1114042233 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x564f33419080 0x564f338bbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:02.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.936+0000 7f6bf079b740 4 client.15381 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:55:02.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.936+0000 7f6bf079b740 1 -- 172.21.15.46:0/1114042233 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564f337a0860 con 0x564f33419080 2024-09-21T03:55:02.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.936+0000 7f6be37fe640 1 --2- 172.21.15.46:0/1114042233 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x564f33419080 0x564f338bbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:02.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.937+0000 7f6be37fe640 1 --2- 172.21.15.46:0/1114042233 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x564f33419080 0x564f338bbbd0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88e834e1e631474e server_cookie=2debeffa0200feab in_seq=0 out_seq=0 2024-09-21T03:55:02.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.937+0000 7f6bc2ffd640 10 client.15381 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:02.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.938+0000 7f6bc2ffd640 1 -- 172.21.15.46:0/1114042233 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564f337a0860 con 0x564f33419080 2024-09-21T03:55:02.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.938+0000 7f6bc2ffd640 10 client.15381 handle_command_reply: tid=0 2024-09-21T03:55:02.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.938+0000 7f6bf079b740 1 client.15381 shutdown 2024-09-21T03:55:02.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.939+0000 7f6bf079b740 1 -- 172.21.15.46:0/1114042233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564f3345c490 msgr2=0x564f3384f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:02.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.939+0000 7f6bf079b740 1 --2- 172.21.15.46:0/1114042233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564f3345c490 0x564f3384f910 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6be406ad30 tx=0x7f6bd8005ee0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.939+0000 7f6bf079b740 1 -- 172.21.15.46:0/1114042233 shutdown_connections 2024-09-21T03:55:02.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.939+0000 7f6bf079b740 1 --2- 172.21.15.46:0/1114042233 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x564f33419080 0x564f338bbbd0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.939+0000 7f6bf079b740 1 --2- 172.21.15.46:0/1114042233 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f33485350 0x564f338b7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.939+0000 7f6bc2ffd640 0 client.15381 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:02.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.939+0000 7f6bf079b740 1 --2- 172.21.15.46:0/1114042233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564f33464670 0x564f3384fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.939+0000 7f6bf079b740 1 --2- 172.21.15.46:0/1114042233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564f3345c490 0x564f3384f910 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.939+0000 7f6bf079b740 1 -- 172.21.15.46:0/1114042233 >> 172.21.15.46:0/1114042233 conn(0x564f33479740 msgr2=0x564f33839240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:02.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.939+0000 7f6bf079b740 1 -- 172.21.15.46:0/1114042233 shutdown_connections 2024-09-21T03:55:02.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.939+0000 7f6bf079b740 1 -- 172.21.15.46:0/1114042233 wait complete. 2024-09-21T03:55:02.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.939+0000 7f6bf079b740 20 client.15381 trim_cache size 0 max 16384 2024-09-21T03:55:02.944 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T03:55:02.944 INFO:teuthology.orchestra.run.smithi046.stdout: "return_code": 0, 2024-09-21T03:55:02.944 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_tag": "08f0c962-df1a-4129-a1a2-b916240d9803", 2024-09-21T03:55:02.944 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": "asynchronous" 2024-09-21T03:55:02.944 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T03:55:02.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.940+0000 7f6bea227640 1 -- 172.21.15.46:0/16758338 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f6bcc0b65f0 msgr2=0x7f6bcc0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:02.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.940+0000 7f6bea227640 1 --2- 172.21.15.46:0/16758338 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f6bcc0b65f0 0x7f6bcc0b8b00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc0acc40 tx=0x7f6bdc0a17a0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.940+0000 7f6bea227640 1 -- 172.21.15.46:0/16758338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6be410de10 msgr2=0x7f6be419fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:02.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.940+0000 7f6bea227640 1 --2- 172.21.15.46:0/16758338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6be410de10 0x7f6be419fd80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc00d750 tx=0x7f6bdc00dc10 comp rx=0 tx=0).stop 2024-09-21T03:55:02.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.940+0000 7f6bea227640 1 -- 172.21.15.46:0/16758338 shutdown_connections 2024-09-21T03:55:02.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.940+0000 7f6bea227640 1 --2- 172.21.15.46:0/16758338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6be410de10 0x7f6be419fd80 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.940+0000 7f6bea227640 1 --2- 172.21.15.46:0/16758338 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6be4105300 0x7f6be419aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.940+0000 7f6bea227640 1 --2- 172.21.15.46:0/16758338 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f6bcc0b65f0 0x7f6bcc0b8b00 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.940+0000 7f6bea227640 1 --2- 172.21.15.46:0/16758338 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6be41049b0 0x7f6be419a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:02.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.940+0000 7f6bea227640 1 -- 172.21.15.46:0/16758338 >> 172.21.15.46:0/16758338 conn(0x7f6be4079730 msgr2=0x7f6be40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:02.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.940+0000 7f6bea227640 1 -- 172.21.15.46:0/16758338 shutdown_connections 2024-09-21T03:55:02.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:02.940+0000 7f6bea227640 1 -- 172.21.15.46:0/16758338 wait complete. 2024-09-21T03:55:03.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.018+0000 7f458bc69640 1 -- 172.21.15.46:0/176075625 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f4584063800 con 0x7f45700b6670 2024-09-21T03:55:03.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.076+0000 7f457affd640 1 -- 172.21.15.46:0/176075625 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f4584063800 con 0x7f45700b6670 2024-09-21T03:55:03.078 INFO:teuthology.orchestra.run.smithi046.stdout:Retention added to path / 2024-09-21T03:55:03.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.078+0000 7f458bc69640 1 -- 172.21.15.46:0/176075625 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f45700b6670 msgr2=0x7f45700b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:03.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.078+0000 7f458bc69640 1 --2- 172.21.15.46:0/176075625 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f45700b6670 0x7f45700b8b80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f458406c500 tx=0x7f4580005f90 comp rx=0 tx=0).stop 2024-09-21T03:55:03.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.078+0000 7f458bc69640 1 -- 172.21.15.46:0/176075625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4584108310 msgr2=0x7f458419b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:03.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.078+0000 7f458bc69640 1 --2- 172.21.15.46:0/176075625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4584108310 0x7f458419b730 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f457400d750 tx=0x7f457400dc10 comp rx=0 tx=0).stop 2024-09-21T03:55:03.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.078+0000 7f458bc69640 1 -- 172.21.15.46:0/176075625 shutdown_connections 2024-09-21T03:55:03.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.078+0000 7f458bc69640 1 --2- 172.21.15.46:0/176075625 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f45700b6670 0x7f45700b8b80 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:03.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.078+0000 7f458bc69640 1 --2- 172.21.15.46:0/176075625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4584108c60 0x7f458419bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:03.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.078+0000 7f458bc69640 1 --2- 172.21.15.46:0/176075625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4584108310 0x7f458419b730 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:03.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.078+0000 7f458bc69640 1 --2- 172.21.15.46:0/176075625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45841029e0 0x7f458419b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:03.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.078+0000 7f458bc69640 1 -- 172.21.15.46:0/176075625 >> 172.21.15.46:0/176075625 conn(0x7f45840fe3e0 msgr2=0x7f45841068d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:03.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.078+0000 7f458bc69640 1 -- 172.21.15.46:0/176075625 shutdown_connections 2024-09-21T03:55:03.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.078+0000 7f458bc69640 1 -- 172.21.15.46:0/176075625 wait complete. 2024-09-21T03:55:03.092 DEBUG:teuthology.orchestra.run.smithi046:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-21T03:55:03.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.206+0000 7f9f99877640 1 -- 172.21.15.46:0/1814050653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f94108300 msgr2=0x7f9f94108710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:03.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.206+0000 7f9f99877640 1 --2- 172.21.15.46:0/1814050653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f94108300 0x7f9f94108710 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c009900 tx=0x7f9f7c02a410 comp rx=0 tx=0).stop 2024-09-21T03:55:03.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.206+0000 7f9f99877640 1 -- 172.21.15.46:0/1814050653 shutdown_connections 2024-09-21T03:55:03.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.206+0000 7f9f99877640 1 --2- 172.21.15.46:0/1814050653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f94108c50 0x7f9f9410f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:03.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.206+0000 7f9f99877640 1 --2- 172.21.15.46:0/1814050653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f94108300 0x7f9f94108710 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:03.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.206+0000 7f9f99877640 1 --2- 172.21.15.46:0/1814050653 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f941029d0 0x7f9f94102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:03.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.206+0000 7f9f99877640 1 -- 172.21.15.46:0/1814050653 >> 172.21.15.46:0/1814050653 conn(0x7f9f9407a6f0 msgr2=0x7f9f9407ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:03.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.206+0000 7f9f99877640 1 -- 172.21.15.46:0/1814050653 shutdown_connections 2024-09-21T03:55:03.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.206+0000 7f9f99877640 1 -- 172.21.15.46:0/1814050653 wait complete. 2024-09-21T03:55:03.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.207+0000 7f9f99877640 1 Processor -- start 2024-09-21T03:55:03.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.207+0000 7f9f99877640 1 -- start start 2024-09-21T03:55:03.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.207+0000 7f9f99877640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f941029d0 0x7f9f9419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:03.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.207+0000 7f9f99877640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f94108c50 0x7f9f9419ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:03.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.207+0000 7f9f99877640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f9419fd60 0x7f9f941a0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:03.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.207+0000 7f9f99877640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9f94113a30 con 0x7f9f94108c50 2024-09-21T03:55:03.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.208+0000 7f9f99877640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9f941138b0 con 0x7f9f941029d0 2024-09-21T03:55:03.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.208+0000 7f9f99877640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9f94113bb0 con 0x7f9f9419fd60 2024-09-21T03:55:03.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.208+0000 7f9f927fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f94108c50 0x7f9f9419ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:03.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.208+0000 7f9f927fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f94108c50 0x7f9f9419ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41172/0 (socket says 172.21.15.46:41172) 2024-09-21T03:55:03.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.208+0000 7f9f927fc640 1 -- 172.21.15.46:0/2824598628 learned_addr learned my addr 172.21.15.46:0/2824598628 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:03.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.208+0000 7f9f937fe640 1 --2- 172.21.15.46:0/2824598628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f9419fd60 0x7f9f941a0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:03.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.208+0000 7f9f92ffd640 1 --2- 172.21.15.46:0/2824598628 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f941029d0 0x7f9f9419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:03.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.208+0000 7f9f927fc640 1 -- 172.21.15.46:0/2824598628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f9419fd60 msgr2=0x7f9f941a0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:03.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.208+0000 7f9f927fc640 1 --2- 172.21.15.46:0/2824598628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f9419fd60 0x7f9f941a0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:03.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.208+0000 7f9f927fc640 1 -- 172.21.15.46:0/2824598628 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f941029d0 msgr2=0x7f9f9419a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:03.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.208+0000 7f9f927fc640 1 --2- 172.21.15.46:0/2824598628 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f941029d0 0x7f9f9419a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:03.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.208+0000 7f9f927fc640 1 -- 172.21.15.46:0/2824598628 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f941a0940 con 0x7f9f94108c50 2024-09-21T03:55:03.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.208+0000 7f9f927fc640 1 --2- 172.21.15.46:0/2824598628 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f94108c50 0x7f9f9419ab90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c006010 tx=0x7f9f7c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:03.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.208+0000 7f9f98875640 1 -- 172.21.15.46:0/2824598628 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c03f070 con 0x7f9f94108c50 2024-09-21T03:55:03.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.209+0000 7f9f98875640 1 -- 172.21.15.46:0/2824598628 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f7c0044c0 con 0x7f9f94108c50 2024-09-21T03:55:03.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.209+0000 7f9f99877640 1 -- 172.21.15.46:0/2824598628 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f941a6ee0 con 0x7f9f94108c50 2024-09-21T03:55:03.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.209+0000 7f9f98875640 1 -- 172.21.15.46:0/2824598628 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c035070 con 0x7f9f94108c50 2024-09-21T03:55:03.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.209+0000 7f9f99877640 1 -- 172.21.15.46:0/2824598628 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f941a7290 con 0x7f9f94108c50 2024-09-21T03:55:03.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.210+0000 7f9f99877640 1 -- 172.21.15.46:0/2824598628 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f94103c40 con 0x7f9f94108c50 2024-09-21T03:55:03.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.212+0000 7f9f98875640 1 -- 172.21.15.46:0/2824598628 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f9f7c03b460 con 0x7f9f94108c50 2024-09-21T03:55:03.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.212+0000 7f9f98875640 1 --2- 172.21.15.46:0/2824598628 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f9f800b6670 0x7f9f800b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:03.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.213+0000 7f9f92ffd640 1 --2- 172.21.15.46:0/2824598628 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f9f800b6670 0x7f9f800b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:03.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.213+0000 7f9f98875640 1 -- 172.21.15.46:0/2824598628 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f9f7c107cb0 con 0x7f9f94108c50 2024-09-21T03:55:03.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.213+0000 7f9f92ffd640 1 --2- 172.21.15.46:0/2824598628 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f9f800b6670 0x7f9f800b8b80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9f840095f0 tx=0x7f9f84005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:03.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.215+0000 7f9f98875640 1 -- 172.21.15.46:0/2824598628 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9f7c0d2700 con 0x7f9f94108c50 2024-09-21T03:55:03.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.423+0000 7f9f99877640 1 -- 172.21.15.46:0/2824598628 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f9f94063800 con 0x7f9f800b6670 2024-09-21T03:55:03.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.430+0000 7f9f98875640 1 -- 172.21.15.46:0/2824598628 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f9f94063800 con 0x7f9f800b6670 2024-09-21T03:55:03.450 INFO:teuthology.orchestra.run.smithi046.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-21T00:00:00", "created": "2024-09-21T03:55:02", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-21T03:55:03.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.433+0000 7f9f99877640 1 -- 172.21.15.46:0/2824598628 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f9f800b6670 msgr2=0x7f9f800b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:03.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.433+0000 7f9f99877640 1 --2- 172.21.15.46:0/2824598628 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f9f800b6670 0x7f9f800b8b80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9f840095f0 tx=0x7f9f84005f90 comp rx=0 tx=0).stop 2024-09-21T03:55:03.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.433+0000 7f9f99877640 1 -- 172.21.15.46:0/2824598628 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f94108c50 msgr2=0x7f9f9419ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:03.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.433+0000 7f9f99877640 1 --2- 172.21.15.46:0/2824598628 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f94108c50 0x7f9f9419ab90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c006010 tx=0x7f9f7c0040c0 comp rx=0 tx=0).stop 2024-09-21T03:55:03.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.433+0000 7f9f99877640 1 -- 172.21.15.46:0/2824598628 shutdown_connections 2024-09-21T03:55:03.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.433+0000 7f9f99877640 1 --2- 172.21.15.46:0/2824598628 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f9f800b6670 0x7f9f800b8b80 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:03.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.433+0000 7f9f99877640 1 --2- 172.21.15.46:0/2824598628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f9419fd60 0x7f9f941a0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:03.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.433+0000 7f9f99877640 1 --2- 172.21.15.46:0/2824598628 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f94108c50 0x7f9f9419ab90 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:03.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.433+0000 7f9f99877640 1 --2- 172.21.15.46:0/2824598628 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f941029d0 0x7f9f9419a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:03.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.433+0000 7f9f99877640 1 -- 172.21.15.46:0/2824598628 >> 172.21.15.46:0/2824598628 conn(0x7f9f9407a6f0 msgr2=0x7f9f941064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:03.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.433+0000 7f9f99877640 1 -- 172.21.15.46:0/2824598628 shutdown_connections 2024-09-21T03:55:03.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.433+0000 7f9f99877640 1 -- 172.21.15.46:0/2824598628 wait complete. 2024-09-21T03:55:03.452 DEBUG:teuthology.orchestra.run.smithi046:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-21T03:55:03.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.565+0000 7f9481dad640 1 -- 172.21.15.46:0/2586013196 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f947c10ddc0 msgr2=0x7f947c110290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:03.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.565+0000 7f9481dad640 1 --2- 172.21.15.46:0/2586013196 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f947c10ddc0 0x7f947c110290 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9474009ca0 tx=0x7f947402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:55:03.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.566+0000 7f9481dad640 1 -- 172.21.15.46:0/2586013196 shutdown_connections 2024-09-21T03:55:03.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.566+0000 7f9481dad640 1 --2- 172.21.15.46:0/2586013196 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f947c10ddc0 0x7f947c110290 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:03.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.566+0000 7f9481dad640 1 --2- 172.21.15.46:0/2586013196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f947c1051f0 0x7f947c10d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:03.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.566+0000 7f9481dad640 1 --2- 172.21.15.46:0/2586013196 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f947c104810 0x7f947c104c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:03.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.566+0000 7f9481dad640 1 -- 172.21.15.46:0/2586013196 >> 172.21.15.46:0/2586013196 conn(0x7f947c0fe3c0 msgr2=0x7f947c100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:03.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.566+0000 7f9481dad640 1 -- 172.21.15.46:0/2586013196 shutdown_connections 2024-09-21T03:55:03.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.566+0000 7f9481dad640 1 -- 172.21.15.46:0/2586013196 wait complete. 2024-09-21T03:55:03.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.566+0000 7f9481dad640 1 Processor -- start 2024-09-21T03:55:03.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.566+0000 7f9481dad640 1 -- start start 2024-09-21T03:55:03.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.567+0000 7f9481dad640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f947c104810 0x7f947c102720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:03.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.567+0000 7f9481dad640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f947c1051f0 0x7f947c102c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:03.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.567+0000 7f9481dad640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f947c10ddc0 0x7f947c1031a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:03.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.567+0000 7f9481dad640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f947c113a20 con 0x7f947c10ddc0 2024-09-21T03:55:03.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.567+0000 7f9481dad640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f947c1138a0 con 0x7f947c104810 2024-09-21T03:55:03.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.567+0000 7f9481dad640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f947c113ba0 con 0x7f947c1051f0 2024-09-21T03:55:03.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.567+0000 7f947bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f947c10ddc0 0x7f947c1031a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:03.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.567+0000 7f947bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f947c10ddc0 0x7f947c1031a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41186/0 (socket says 172.21.15.46:41186) 2024-09-21T03:55:03.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.567+0000 7f947bfff640 1 -- 172.21.15.46:0/1354108021 learned_addr learned my addr 172.21.15.46:0/1354108021 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:03.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.567+0000 7f947b7fe640 1 --2- 172.21.15.46:0/1354108021 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f947c104810 0x7f947c102720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:03.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.567+0000 7f947affd640 1 --2- 172.21.15.46:0/1354108021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f947c1051f0 0x7f947c102c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:03.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.567+0000 7f947bfff640 1 -- 172.21.15.46:0/1354108021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f947c1051f0 msgr2=0x7f947c102c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:03.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.567+0000 7f947bfff640 1 --2- 172.21.15.46:0/1354108021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f947c1051f0 0x7f947c102c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:03.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.567+0000 7f947bfff640 1 -- 172.21.15.46:0/1354108021 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f947c104810 msgr2=0x7f947c102720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:03.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.567+0000 7f947bfff640 1 --2- 172.21.15.46:0/1354108021 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f947c104810 0x7f947c102720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:03.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.567+0000 7f947bfff640 1 -- 172.21.15.46:0/1354108021 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f947c1a86b0 con 0x7f947c10ddc0 2024-09-21T03:55:03.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.567+0000 7f947affd640 1 --2- 172.21.15.46:0/1354108021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f947c1051f0 0x7f947c102c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:55:03.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.567+0000 7f947bfff640 1 --2- 172.21.15.46:0/1354108021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f947c10ddc0 0x7f947c1031a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f94740098d0 tx=0x7f94740317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:03.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.568+0000 7f9478ff9640 1 -- 172.21.15.46:0/1354108021 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9474003b70 con 0x7f947c10ddc0 2024-09-21T03:55:03.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.568+0000 7f9478ff9640 1 -- 172.21.15.46:0/1354108021 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9474003d10 con 0x7f947c10ddc0 2024-09-21T03:55:03.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.568+0000 7f9481dad640 1 -- 172.21.15.46:0/1354108021 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f947c1a8940 con 0x7f947c10ddc0 2024-09-21T03:55:03.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.568+0000 7f9478ff9640 1 -- 172.21.15.46:0/1354108021 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947402fa20 con 0x7f947c10ddc0 2024-09-21T03:55:03.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.568+0000 7f9481dad640 1 -- 172.21.15.46:0/1354108021 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f947c1a8e90 con 0x7f947c10ddc0 2024-09-21T03:55:03.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.569+0000 7f9481dad640 1 -- 172.21.15.46:0/1354108021 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f947c104c20 con 0x7f947c10ddc0 2024-09-21T03:55:03.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.570+0000 7f9478ff9640 1 -- 172.21.15.46:0/1354108021 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f947402fbc0 con 0x7f947c10ddc0 2024-09-21T03:55:03.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.571+0000 7f9478ff9640 1 --2- 172.21.15.46:0/1354108021 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f94640b6620 0x7f94640b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:03.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.571+0000 7f947b7fe640 1 --2- 172.21.15.46:0/1354108021 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f94640b6620 0x7f94640b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:03.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.571+0000 7f9478ff9640 1 -- 172.21.15.46:0/1354108021 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f9474108a00 con 0x7f947c10ddc0 2024-09-21T03:55:03.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.572+0000 7f947b7fe640 1 --2- 172.21.15.46:0/1354108021 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f94640b6620 0x7f94640b8b30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f947c104170 tx=0x7f946c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:03.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.574+0000 7f9478ff9640 1 -- 172.21.15.46:0/1354108021 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f94740cf070 con 0x7f947c10ddc0 2024-09-21T03:55:03.762 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:55:03.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.791+0000 7f9481dad640 1 -- 172.21.15.46:0/1354108021 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f947c108020 con 0x7f94640b6620 2024-09-21T03:55:03.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.798+0000 7f9478ff9640 1 -- 172.21.15.46:0/1354108021 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f947c108020 con 0x7f94640b6620 2024-09-21T03:55:03.800 INFO:teuthology.orchestra.run.smithi046.stdout:/ 1m 6m3h 2024-09-21T03:55:03.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.801+0000 7f9481dad640 1 -- 172.21.15.46:0/1354108021 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f94640b6620 msgr2=0x7f94640b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:03.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.801+0000 7f9481dad640 1 --2- 172.21.15.46:0/1354108021 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f94640b6620 0x7f94640b8b30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f947c104170 tx=0x7f946c00b390 comp rx=0 tx=0).stop 2024-09-21T03:55:03.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.801+0000 7f9481dad640 1 -- 172.21.15.46:0/1354108021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f947c10ddc0 msgr2=0x7f947c1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:03.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.801+0000 7f9481dad640 1 --2- 172.21.15.46:0/1354108021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f947c10ddc0 0x7f947c1031a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f94740098d0 tx=0x7f94740317b0 comp rx=0 tx=0).stop 2024-09-21T03:55:03.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.801+0000 7f9481dad640 1 -- 172.21.15.46:0/1354108021 shutdown_connections 2024-09-21T03:55:03.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.801+0000 7f9481dad640 1 --2- 172.21.15.46:0/1354108021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f947c10ddc0 0x7f947c1031a0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:03.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.801+0000 7f9481dad640 1 --2- 172.21.15.46:0/1354108021 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f94640b6620 0x7f94640b8b30 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:03.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.801+0000 7f9481dad640 1 --2- 172.21.15.46:0/1354108021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f947c1051f0 0x7f947c102c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:03.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.801+0000 7f9481dad640 1 --2- 172.21.15.46:0/1354108021 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f947c104810 0x7f947c102720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:03.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.801+0000 7f9481dad640 1 -- 172.21.15.46:0/1354108021 >> 172.21.15.46:0/1354108021 conn(0x7f947c0fe3c0 msgr2=0x7f947c107910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:03.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.801+0000 7f9481dad640 1 -- 172.21.15.46:0/1354108021 shutdown_connections 2024-09-21T03:55:03.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:03.801+0000 7f9481dad640 1 -- 172.21.15.46:0/1354108021 wait complete. 2024-09-21T03:55:03.815 DEBUG:teuthology.orchestra.run.smithi046:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-21T03:55:03.883 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-21T03:55:03.894 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-21T03:55:03.923 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi046.front.sepia.ceph.com 2024-09-21T03:55:03.924 DEBUG:teuthology.orchestra.run.smithi046:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-21T03:55:03.926 INFO:teuthology.run_tasks:Running task workunit... 2024-09-21T03:55:03.961 INFO:tasks.workunit:Pulling workunits from ref 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:55:03.961 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T03:55:03.961 INFO:tasks.workunit:timeout=3h 2024-09-21T03:55:03.962 INFO:tasks.workunit:cleanup=True 2024-09-21T03:55:03.962 DEBUG:teuthology.orchestra.run.smithi046:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-21T03:55:03.979 INFO:teuthology.orchestra.run.smithi046.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-21T03:55:03.980 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-21T03:55:03.980 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-21T03:55:03.980 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:55:03.980 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-21T03:55:03.980 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-09-21 03:53:30.838927810 +0000 2024-09-21T03:55:03.980 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-09-21 03:53:30.838927810 +0000 2024-09-21T03:55:03.980 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-09-21 03:54:53.988666873 +0000 2024-09-21T03:55:03.980 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-09-21 03:53:30.838927810 +0000 2024-09-21T03:55:03.980 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-21T03:55:03.980 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-21T03:55:04.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:03 smithi046 ceph-mon[30954]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T03:55:04.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:03 smithi046 ceph-mon[30954]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:04.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:03 smithi046 ceph-mon[30954]: scrub queued for path: / 2024-09-21T03:55:04.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:03 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T03:55:04.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:03 smithi046 ceph-mon[30954]: scrub summary: active paths [/] 2024-09-21T03:55:04.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:03 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T03:55:04.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:03 smithi046 ceph-mon[30954]: scrub summary: idle 2024-09-21T03:55:04.029 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:55:04.035 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:55:04.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:03 smithi105 ceph-mon[34773]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T03:55:04.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:03 smithi105 ceph-mon[34773]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:04.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:03 smithi105 ceph-mon[34773]: scrub queued for path: / 2024-09-21T03:55:04.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:03 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T03:55:04.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:03 smithi105 ceph-mon[34773]: scrub summary: active paths [/] 2024-09-21T03:55:04.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:03 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T03:55:04.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:03 smithi105 ceph-mon[34773]: scrub summary: idle 2024-09-21T03:55:04.093 INFO:tasks.workunit.client.0.smithi046.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-21T03:55:04.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:03 smithi162 ceph-mon[35071]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T03:55:04.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:03 smithi162 ceph-mon[35071]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:04.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:03 smithi162 ceph-mon[35071]: scrub queued for path: / 2024-09-21T03:55:04.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:03 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T03:55:04.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:03 smithi162 ceph-mon[35071]: scrub summary: active paths [/] 2024-09-21T03:55:04.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:03 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T03:55:04.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:03 smithi162 ceph-mon[35071]: scrub summary: idle 2024-09-21T03:55:04.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.533+0000 7f288d61a640 1 -- 172.21.15.46:0/695332479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2888105230 msgr2=0x7f288810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:04.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.533+0000 7f288d61a640 1 --2- 172.21.15.46:0/695332479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2888105230 0x7f288810d950 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f2870009900 tx=0x7f287002a410 comp rx=0 tx=0).stop 2024-09-21T03:55:04.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.533+0000 7f288d61a640 1 -- 172.21.15.46:0/695332479 shutdown_connections 2024-09-21T03:55:04.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.533+0000 7f288d61a640 1 --2- 172.21.15.46:0/695332479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f288810de90 0x7f2888110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:04.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.533+0000 7f288d61a640 1 --2- 172.21.15.46:0/695332479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2888105230 0x7f288810d950 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:04.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.533+0000 7f288d61a640 1 --2- 172.21.15.46:0/695332479 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28881048e0 0x7f2888104cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:04.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.533+0000 7f288d61a640 1 -- 172.21.15.46:0/695332479 >> 172.21.15.46:0/695332479 conn(0x7f2888079790 msgr2=0x7f2888079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:04.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.533+0000 7f288d61a640 1 -- 172.21.15.46:0/695332479 shutdown_connections 2024-09-21T03:55:04.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.533+0000 7f288d61a640 1 -- 172.21.15.46:0/695332479 wait complete. 2024-09-21T03:55:04.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.534+0000 7f288d61a640 1 Processor -- start 2024-09-21T03:55:04.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.534+0000 7f288d61a640 1 -- start start 2024-09-21T03:55:04.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.534+0000 7f288d61a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28881048e0 0x7f288819a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:04.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.534+0000 7f288d61a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2888105230 0x7f288819aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:04.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.534+0000 7f288d61a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f288810de90 0x7f288819fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:04.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.534+0000 7f288d61a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2888113ac0 con 0x7f28881048e0 2024-09-21T03:55:04.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.534+0000 7f288d61a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2888113940 con 0x7f288810de90 2024-09-21T03:55:04.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.534+0000 7f288d61a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2888113c40 con 0x7f2888105230 2024-09-21T03:55:04.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.534+0000 7f2886ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28881048e0 0x7f288819a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:04.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.534+0000 7f2886ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28881048e0 0x7f288819a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41190/0 (socket says 172.21.15.46:41190) 2024-09-21T03:55:04.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.534+0000 7f2886ffd640 1 -- 172.21.15.46:0/2253654306 learned_addr learned my addr 172.21.15.46:0/2253654306 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:04.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.534+0000 7f28867fc640 1 --2- 172.21.15.46:0/2253654306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2888105230 0x7f288819aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:04.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.535+0000 7f28877fe640 1 --2- 172.21.15.46:0/2253654306 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f288810de90 0x7f288819fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:04.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.535+0000 7f2886ffd640 1 -- 172.21.15.46:0/2253654306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2888105230 msgr2=0x7f288819aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:04.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.535+0000 7f2886ffd640 1 --2- 172.21.15.46:0/2253654306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2888105230 0x7f288819aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:04.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.535+0000 7f2886ffd640 1 -- 172.21.15.46:0/2253654306 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f288810de90 msgr2=0x7f288819fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:04.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.535+0000 7f2886ffd640 1 --2- 172.21.15.46:0/2253654306 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f288810de90 0x7f288819fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:04.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.535+0000 7f2886ffd640 1 -- 172.21.15.46:0/2253654306 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28881a04c0 con 0x7f28881048e0 2024-09-21T03:55:04.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.535+0000 7f28877fe640 1 --2- 172.21.15.46:0/2253654306 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f288810de90 0x7f288819fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:55:04.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.535+0000 7f2886ffd640 1 --2- 172.21.15.46:0/2253654306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28881048e0 0x7f288819a550 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f287800ba50 tx=0x7f287800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:04.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.535+0000 7f287ffff640 1 -- 172.21.15.46:0/2253654306 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2878019070 con 0x7f28881048e0 2024-09-21T03:55:04.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.535+0000 7f287ffff640 1 -- 172.21.15.46:0/2253654306 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f287800cbe0 con 0x7f28881048e0 2024-09-21T03:55:04.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.535+0000 7f288d61a640 1 -- 172.21.15.46:0/2253654306 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28881a07b0 con 0x7f28881048e0 2024-09-21T03:55:04.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.535+0000 7f287ffff640 1 -- 172.21.15.46:0/2253654306 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28780075d0 con 0x7f28881048e0 2024-09-21T03:55:04.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.535+0000 7f288d61a640 1 -- 172.21.15.46:0/2253654306 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28881a6f10 con 0x7f28881048e0 2024-09-21T03:55:04.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.538+0000 7f2893b8e740 1 Processor -- start 2024-09-21T03:55:04.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.538+0000 7f2893b8e740 1 -- start start 2024-09-21T03:55:04.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.538+0000 7f287ffff640 1 -- 172.21.15.46:0/2253654306 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f287801c070 con 0x7f28881048e0 2024-09-21T03:55:04.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.538+0000 7f2893b8e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ff3679c070 0x55ff36b43270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:04.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.538+0000 7f2893b8e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff367731b0 0x55ff36b437b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:04.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.538+0000 7f2893b8e740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff3677b390 0x55ff36b43cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:04.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.538+0000 7f2893b8e740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55ff36ab9e50 con 0x55ff3677b390 2024-09-21T03:55:04.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.538+0000 7f2893b8e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55ff36aa9280 con 0x55ff3679c070 2024-09-21T03:55:04.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.538+0000 7f2893b8e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ff36aad090 con 0x55ff367731b0 2024-09-21T03:55:04.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.539+0000 7f28867fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff3677b390 0x55ff36b43cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:04.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.539+0000 7f28877fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ff3679c070 0x55ff36b43270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:04.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.539+0000 7f28867fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff3677b390 0x55ff36b43cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41206/0 (socket says 172.21.15.46:41206) 2024-09-21T03:55:04.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.539+0000 7f28867fc640 1 -- 172.21.15.46:0/3749396167 learned_addr learned my addr 172.21.15.46:0/3749396167 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:04.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.539+0000 7f2886ffd640 1 --2- 172.21.15.46:0/3749396167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff367731b0 0x55ff36b437b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:04.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.539+0000 7f28877fe640 1 -- 172.21.15.46:0/3749396167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff367731b0 msgr2=0x55ff36b437b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:04.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.539+0000 7f28877fe640 1 --2- 172.21.15.46:0/3749396167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff367731b0 0x55ff36b437b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:04.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.539+0000 7f28877fe640 1 -- 172.21.15.46:0/3749396167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff3677b390 msgr2=0x55ff36b43cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:04.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.539+0000 7f28877fe640 1 --2- 172.21.15.46:0/3749396167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff3677b390 0x55ff36b43cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:04.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.539+0000 7f28877fe640 1 -- 172.21.15.46:0/3749396167 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff36807650 con 0x55ff3679c070 2024-09-21T03:55:04.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.539+0000 7f2886ffd640 1 --2- 172.21.15.46:0/3749396167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff367731b0 0x55ff36b437b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:55:04.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.539+0000 7f28867fc640 1 --2- 172.21.15.46:0/3749396167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff3677b390 0x55ff36b43cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:55:04.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.539+0000 7f287ffff640 1 --2- 172.21.15.46:0/2253654306 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f28740b65f0 0x7f28740b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:04.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.539+0000 7f28877fe640 1 --2- 172.21.15.46:0/3749396167 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ff3679c070 0x55ff36b43270 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f288000bc20 tx=0x7f288000f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab67f9b7c0dc217 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:04.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.539+0000 7f2886ffd640 1 --2- 172.21.15.46:0/2253654306 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f28740b65f0 0x7f28740b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:04.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.540+0000 7f287d7fa640 1 -- 172.21.15.46:0/3749396167 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2880015070 con 0x55ff3679c070 2024-09-21T03:55:04.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.540+0000 7f287ffff640 1 -- 172.21.15.46:0/2253654306 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f28780e6a50 con 0x7f28881048e0 2024-09-21T03:55:04.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.540+0000 7f287d7fa640 1 -- 172.21.15.46:0/3749396167 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f288001a910 con 0x55ff3679c070 2024-09-21T03:55:04.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.540+0000 7f287d7fa640 1 -- 172.21.15.46:0/3749396167 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28800118a0 con 0x55ff3679c070 2024-09-21T03:55:04.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.541+0000 7f2893b8e740 1 -- 172.21.15.46:0/3749396167 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ff3679c070 msgr2=0x55ff36b43270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:04.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.541+0000 7f2886ffd640 1 --2- 172.21.15.46:0/2253654306 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f28740b65f0 0x7f28740b8b00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55ff36b41ef0 tx=0x7f2878094040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:04.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.541+0000 7f2893b8e740 1 --2- 172.21.15.46:0/3749396167 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ff3679c070 0x55ff36b43270 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f288000bc20 tx=0x7f288000f730 comp rx=0 tx=0).stop 2024-09-21T03:55:04.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.541+0000 7f2893b8e740 1 -- 172.21.15.46:0/3749396167 shutdown_connections 2024-09-21T03:55:04.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.541+0000 7f2893b8e740 1 --2- 172.21.15.46:0/3749396167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff3677b390 0x55ff36b43cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:04.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.541+0000 7f2893b8e740 1 --2- 172.21.15.46:0/3749396167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff367731b0 0x55ff36b437b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:04.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.541+0000 7f2893b8e740 1 --2- 172.21.15.46:0/3749396167 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ff3679c070 0x55ff36b43270 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:04.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.541+0000 7f2893b8e740 1 -- 172.21.15.46:0/3749396167 >> 172.21.15.46:0/3749396167 conn(0x55ff36790460 msgr2=0x55ff36b41160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:04.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.541+0000 7f2893b8e740 1 -- 172.21.15.46:0/3749396167 shutdown_connections 2024-09-21T03:55:04.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.541+0000 7f2893b8e740 1 -- 172.21.15.46:0/3749396167 wait complete. 2024-09-21T03:55:04.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.541+0000 7f2893b8e740 1 -- start start 2024-09-21T03:55:04.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.541+0000 7f2893b8e740 1 Processor -- start 2024-09-21T03:55:04.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.542+0000 7f2893b8e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff367731b0 0x55ff36b4e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:04.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.542+0000 7f2893b8e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ff3677b390 0x55ff36b4eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:04.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.542+0000 7f2893b8e740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff3679c070 0x55ff36b5ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:04.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.542+0000 7f2893b8e740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55ff3690a700 con 0x55ff3679c070 2024-09-21T03:55:04.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.542+0000 7f2893b8e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55ff36a44110 con 0x55ff3677b390 2024-09-21T03:55:04.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.542+0000 7f2893b8e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ff36b51a50 con 0x55ff367731b0 2024-09-21T03:55:04.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.542+0000 7f2893b8e740 10 client.0 _ll_register_callbacks cb 0x55ff36a5d990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:55:04.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.542+0000 7f28877fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff3679c070 0x55ff36b5ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:04.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.542+0000 7f28877fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff3679c070 0x55ff36b5ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41218/0 (socket says 172.21.15.46:41218) 2024-09-21T03:55:04.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.542+0000 7f28867fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ff3677b390 0x55ff36b4eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:04.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.542+0000 7f28877fe640 1 -- 172.21.15.46:0/1675974244 learned_addr learned my addr 172.21.15.46:0/1675974244 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:04.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.542+0000 7f28877fe640 1 --2- 172.21.15.46:0/1675974244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff367731b0 0x55ff36b4e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:04.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.542+0000 7f28867fc640 1 -- 172.21.15.46:0/1675974244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff367731b0 msgr2=0x55ff36b4e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:04.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.542+0000 7f28867fc640 1 --2- 172.21.15.46:0/1675974244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff367731b0 0x55ff36b4e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:04.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.542+0000 7f28867fc640 1 -- 172.21.15.46:0/1675974244 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff3679c070 msgr2=0x55ff36b5ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:04.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.542+0000 7f28867fc640 1 --2- 172.21.15.46:0/1675974244 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff3679c070 0x55ff36b5ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:04.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.542+0000 7f28867fc640 1 -- 172.21.15.46:0/1675974244 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff36a71c40 con 0x55ff3677b390 2024-09-21T03:55:04.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.542+0000 7f28877fe640 1 --2- 172.21.15.46:0/1675974244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff367731b0 0x55ff36b4e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:55:04.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.542+0000 7f28867fc640 1 --2- 172.21.15.46:0/1675974244 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ff3677b390 0x55ff36b4eea0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2870006010 tx=0x7f28700316d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91b3d2e3a2e7c142 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:04.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.542+0000 7f286e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-21T03:55:04.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.543+0000 7f286e7fc640 1 -- 172.21.15.46:0/1675974244 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2870035040 con 0x55ff3677b390 2024-09-21T03:55:04.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.543+0000 7f2893b8e740 1 -- 172.21.15.46:0/1675974244 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f288001a910 con 0x55ff3677b390 2024-09-21T03:55:04.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.543+0000 7f286e7fc640 1 -- 172.21.15.46:0/1675974244 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f2870004040 con 0x55ff3677b390 2024-09-21T03:55:04.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.543+0000 7f286e7fc640 1 -- 172.21.15.46:0/1675974244 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f287004b020 con 0x55ff3677b390 2024-09-21T03:55:04.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.543+0000 7f2893b8e740 10 client.25109 fetch_fsmap learned FSMap version 20 2024-09-21T03:55:04.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.543+0000 7f2893b8e740 1 -- 172.21.15.46:0/1675974244 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55ff36b5d810 con 0x55ff3677b390 2024-09-21T03:55:04.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.543+0000 7f286e7fc640 1 -- 172.21.15.46:0/1675974244 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f288001a910 con 0x55ff3677b390 2024-09-21T03:55:04.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.543+0000 7f286e7fc640 1 -- 172.21.15.46:0/1675974244 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f2870004770 con 0x55ff3677b390 2024-09-21T03:55:04.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.543+0000 7f2893b8e740 10 client.25109 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:55:04.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.543+0000 7f2893b8e740 10 client.25109 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:55:04.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.543+0000 7f2893b8e740 20 client.25109 populate_metadata read hostname 'smithi046' 2024-09-21T03:55:04.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.543+0000 7f2893b8e740 1 --2- 172.21.15.46:0/1675974244 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55ff3675a9f0 0x55ff36b60c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:04.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.543+0000 7f2893b8e740 4 client.25109 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:55:04.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.543+0000 7f2893b8e740 1 -- 172.21.15.46:0/1675974244 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff36abbda0 con 0x55ff3675a9f0 2024-09-21T03:55:04.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.544+0000 7f28877fe640 1 --2- 172.21.15.46:0/1675974244 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55ff3675a9f0 0x55ff36b60c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:04.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.544+0000 7f286e7fc640 10 client.25109 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:04.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.544+0000 7f28877fe640 1 --2- 172.21.15.46:0/1675974244 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55ff3675a9f0 0x55ff36b60c30 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=173f08a6f9a64ec5 server_cookie=15ae913698c5b88 in_seq=0 out_seq=0 2024-09-21T03:55:04.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.545+0000 7f286e7fc640 1 -- 172.21.15.46:0/1675974244 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ff36abbda0 con 0x55ff3675a9f0 2024-09-21T03:55:04.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.545+0000 7f286e7fc640 10 client.25109 handle_command_reply: tid=0 2024-09-21T03:55:04.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.545+0000 7f2893b8e740 1 client.25109 shutdown 2024-09-21T03:55:04.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.545+0000 7f2893b8e740 1 -- 172.21.15.46:0/1675974244 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ff3677b390 msgr2=0x55ff36b4eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:04.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.545+0000 7f2893b8e740 1 --2- 172.21.15.46:0/1675974244 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ff3677b390 0x55ff36b4eea0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2870006010 tx=0x7f28700316d0 comp rx=0 tx=0).stop 2024-09-21T03:55:04.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.545+0000 7f2893b8e740 1 -- 172.21.15.46:0/1675974244 shutdown_connections 2024-09-21T03:55:04.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.545+0000 7f2893b8e740 1 --2- 172.21.15.46:0/1675974244 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55ff3675a9f0 0x55ff36b60c30 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:04.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.545+0000 7f2893b8e740 1 --2- 172.21.15.46:0/1675974244 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff3679c070 0x55ff36b5ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:04.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.545+0000 7f2893b8e740 1 --2- 172.21.15.46:0/1675974244 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ff3677b390 0x55ff36b4eea0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:04.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.545+0000 7f2893b8e740 1 --2- 172.21.15.46:0/1675974244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff367731b0 0x55ff36b4e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:04.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.545+0000 7f286e7fc640 0 client.25109 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:04.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.545+0000 7f2893b8e740 1 -- 172.21.15.46:0/1675974244 >> 172.21.15.46:0/1675974244 conn(0x55ff36790460 msgr2=0x55ff36b46400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:04.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.545+0000 7f2893b8e740 1 -- 172.21.15.46:0/1675974244 shutdown_connections 2024-09-21T03:55:04.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.545+0000 7f2893b8e740 1 -- 172.21.15.46:0/1675974244 wait complete. 2024-09-21T03:55:04.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.545+0000 7f2893b8e740 20 client.25109 trim_cache size 0 max 16384 2024-09-21T03:55:04.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.563+0000 7f2893b8e740 1 Processor -- start 2024-09-21T03:55:04.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.563+0000 7f2893b8e740 1 -- start start 2024-09-21T03:55:04.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.563+0000 7f2893b8e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff367731b0 0x55ff36b449b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:04.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.563+0000 7f2893b8e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ff3677b390 0x55ff36b5ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:04.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.563+0000 7f2893b8e740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff3679c070 0x55ff36b4bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:04.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.563+0000 7f2893b8e740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f28881ad4d0 con 0x55ff3679c070 2024-09-21T03:55:04.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.563+0000 7f2893b8e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f28881afd70 con 0x55ff3677b390 2024-09-21T03:55:04.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.563+0000 7f2893b8e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f28881adb60 con 0x55ff367731b0 2024-09-21T03:55:04.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.564+0000 7f28877fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff3679c070 0x55ff36b4bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:04.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.564+0000 7f28877fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff3679c070 0x55ff36b4bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41232/0 (socket says 172.21.15.46:41232) 2024-09-21T03:55:04.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.564+0000 7f28877fe640 1 -- 172.21.15.46:0/2302411734 learned_addr learned my addr 172.21.15.46:0/2302411734 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:04.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.564+0000 7f28877fe640 1 --2- 172.21.15.46:0/2302411734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff367731b0 0x55ff36b449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:04.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.564+0000 7f28867fc640 1 --2- 172.21.15.46:0/2302411734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ff3677b390 0x55ff36b5ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:04.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.564+0000 7f28877fe640 1 -- 172.21.15.46:0/2302411734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff367731b0 msgr2=0x55ff36b449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:04.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.564+0000 7f28877fe640 1 --2- 172.21.15.46:0/2302411734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff367731b0 0x55ff36b449b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:04.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.564+0000 7f28877fe640 1 -- 172.21.15.46:0/2302411734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ff3677b390 msgr2=0x55ff36b5ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:04.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.564+0000 7f28877fe640 1 --2- 172.21.15.46:0/2302411734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ff3677b390 0x55ff36b5ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:04.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.564+0000 7f28877fe640 1 -- 172.21.15.46:0/2302411734 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff36b460d0 con 0x55ff3679c070 2024-09-21T03:55:04.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.564+0000 7f28877fe640 1 --2- 172.21.15.46:0/2302411734 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff3679c070 0x55ff36b4bb50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f288000bc20 tx=0x7f28800114e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3df08619fc51660 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:04.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.564+0000 7f287cff9640 1 -- 172.21.15.46:0/2302411734 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2880015040 con 0x55ff3679c070 2024-09-21T03:55:04.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.564+0000 7f287cff9640 1 -- 172.21.15.46:0/2302411734 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2880005040 con 0x55ff3679c070 2024-09-21T03:55:04.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.564+0000 7f287cff9640 1 -- 172.21.15.46:0/2302411734 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28800048c0 con 0x55ff3679c070 2024-09-21T03:55:04.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.565+0000 7f2893b8e740 1 -- 172.21.15.46:0/2302411734 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff3679c070 msgr2=0x55ff36b4bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:04.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.565+0000 7f2893b8e740 1 --2- 172.21.15.46:0/2302411734 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff3679c070 0x55ff36b4bb50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f288000bc20 tx=0x7f28800114e0 comp rx=0 tx=0).stop 2024-09-21T03:55:04.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.565+0000 7f2893b8e740 1 -- 172.21.15.46:0/2302411734 shutdown_connections 2024-09-21T03:55:04.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.565+0000 7f2893b8e740 1 --2- 172.21.15.46:0/2302411734 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff3679c070 0x55ff36b4bb50 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:04.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.565+0000 7f2893b8e740 1 --2- 172.21.15.46:0/2302411734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ff3677b390 0x55ff36b5ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:04.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.565+0000 7f2893b8e740 1 --2- 172.21.15.46:0/2302411734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff367731b0 0x55ff36b449b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:04.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.565+0000 7f2893b8e740 1 -- 172.21.15.46:0/2302411734 >> 172.21.15.46:0/2302411734 conn(0x55ff36790460 msgr2=0x55ff36b442a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:04.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.565+0000 7f2893b8e740 1 -- 172.21.15.46:0/2302411734 shutdown_connections 2024-09-21T03:55:04.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.565+0000 7f2893b8e740 1 -- 172.21.15.46:0/2302411734 wait complete. 2024-09-21T03:55:04.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.566+0000 7f2893b8e740 1 -- start start 2024-09-21T03:55:04.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.566+0000 7f2893b8e740 1 Processor -- start 2024-09-21T03:55:04.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.566+0000 7f2893b8e740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff367731b0 0x55ff36b535c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:04.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.566+0000 7f2893b8e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ff3677b390 0x55ff36b53ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:04.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.566+0000 7f2893b8e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff3679c070 0x55ff36bc89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:04.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.566+0000 7f2893b8e740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f28881ae230 con 0x55ff367731b0 2024-09-21T03:55:04.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.566+0000 7f2893b8e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f28881af6a0 con 0x55ff3677b390 2024-09-21T03:55:04.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.566+0000 7f2893b8e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f28881ae900 con 0x55ff3679c070 2024-09-21T03:55:04.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.566+0000 7f2893b8e740 10 client.0 _ll_register_callbacks cb 0x7f2870032d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:55:04.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.567+0000 7f28877fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff367731b0 0x55ff36b535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:04.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.567+0000 7f28877fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff367731b0 0x55ff36b535c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41244/0 (socket says 172.21.15.46:41244) 2024-09-21T03:55:04.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.567+0000 7f28877fe640 1 -- 172.21.15.46:0/1253023412 learned_addr learned my addr 172.21.15.46:0/1253023412 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:04.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.567+0000 7f28867fc640 1 --2- 172.21.15.46:0/1253023412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ff3677b390 0x55ff36b53ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:04.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.567+0000 7f28877fe640 1 --2- 172.21.15.46:0/1253023412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff3679c070 0x55ff36bc89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:04.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.567+0000 7f28877fe640 1 -- 172.21.15.46:0/1253023412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff3679c070 msgr2=0x55ff36bc89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:04.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.567+0000 7f28877fe640 1 --2- 172.21.15.46:0/1253023412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff3679c070 0x55ff36bc89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:04.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.567+0000 7f28877fe640 1 -- 172.21.15.46:0/1253023412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ff3677b390 msgr2=0x55ff36b53ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:04.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.567+0000 7f28877fe640 1 --2- 172.21.15.46:0/1253023412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ff3677b390 0x55ff36b53ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:04.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.567+0000 7f28877fe640 1 -- 172.21.15.46:0/1253023412 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff36bc9060 con 0x55ff367731b0 2024-09-21T03:55:04.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.567+0000 7f28877fe640 1 --2- 172.21.15.46:0/1253023412 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff367731b0 0x55ff36b535c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f28800059f0 tx=0x7f288000b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=647d1ae690ef6973 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:04.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.567+0000 7f286e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:55:04.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.567+0000 7f286e7fc640 1 -- 172.21.15.46:0/1253023412 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288003d070 con 0x55ff367731b0 2024-09-21T03:55:04.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.568+0000 7f286e7fc640 1 -- 172.21.15.46:0/1253023412 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f2880011c50 con 0x55ff367731b0 2024-09-21T03:55:04.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.568+0000 7f2893b8e740 1 -- 172.21.15.46:0/1253023412 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2880005040 con 0x55ff367731b0 2024-09-21T03:55:04.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.568+0000 7f286e7fc640 1 -- 172.21.15.46:0/1253023412 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2880015040 con 0x55ff367731b0 2024-09-21T03:55:04.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.568+0000 7f2893b8e740 10 client.15411 fetch_fsmap learned FSMap version 20 2024-09-21T03:55:04.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.568+0000 7f2893b8e740 1 -- 172.21.15.46:0/1253023412 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55ff36bd03b0 con 0x55ff367731b0 2024-09-21T03:55:04.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.568+0000 7f286e7fc640 1 -- 172.21.15.46:0/1253023412 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2880005040 con 0x55ff367731b0 2024-09-21T03:55:04.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.568+0000 7f286e7fc640 1 -- 172.21.15.46:0/1253023412 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f2880004b70 con 0x55ff367731b0 2024-09-21T03:55:04.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.568+0000 7f2893b8e740 10 client.15411 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:55:04.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.568+0000 7f2893b8e740 10 client.15411 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:55:04.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.568+0000 7f2893b8e740 20 client.15411 populate_metadata read hostname 'smithi046' 2024-09-21T03:55:04.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.568+0000 7f2893b8e740 1 --2- 172.21.15.46:0/1253023412 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55ff3672fda0 0x55ff36bd2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:04.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.568+0000 7f2893b8e740 4 client.15411 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:55:04.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.568+0000 7f2893b8e740 1 -- 172.21.15.46:0/1253023412 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ff36ab7850 con 0x55ff3672fda0 2024-09-21T03:55:04.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.569+0000 7f28867fc640 1 --2- 172.21.15.46:0/1253023412 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55ff3672fda0 0x55ff36bd2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:04.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.569+0000 7f286e7fc640 10 client.15411 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:04.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.569+0000 7f28867fc640 1 --2- 172.21.15.46:0/1253023412 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55ff3672fda0 0x55ff36bd2870 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=102970bf60ace816 server_cookie=e89f4c1cc202567c in_seq=0 out_seq=0 2024-09-21T03:55:04.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.570+0000 7f286e7fc640 1 -- 172.21.15.46:0/1253023412 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x55ff36ab7850 con 0x55ff3672fda0 2024-09-21T03:55:04.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.570+0000 7f286e7fc640 10 client.15411 handle_command_reply: tid=0 2024-09-21T03:55:04.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.570+0000 7f2893b8e740 1 client.15411 shutdown 2024-09-21T03:55:04.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.570+0000 7f2893b8e740 1 -- 172.21.15.46:0/1253023412 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff367731b0 msgr2=0x55ff36b535c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:04.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.570+0000 7f2893b8e740 1 --2- 172.21.15.46:0/1253023412 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff367731b0 0x55ff36b535c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f28800059f0 tx=0x7f288000b830 comp rx=0 tx=0).stop 2024-09-21T03:55:04.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.570+0000 7f2893b8e740 1 -- 172.21.15.46:0/1253023412 shutdown_connections 2024-09-21T03:55:04.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.570+0000 7f2893b8e740 1 --2- 172.21.15.46:0/1253023412 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55ff3672fda0 0x55ff36bd2870 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:04.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.570+0000 7f2893b8e740 1 --2- 172.21.15.46:0/1253023412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ff3679c070 0x55ff36bc89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:04.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.570+0000 7f2893b8e740 1 --2- 172.21.15.46:0/1253023412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ff3677b390 0x55ff36b53ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:04.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.570+0000 7f2893b8e740 1 --2- 172.21.15.46:0/1253023412 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ff367731b0 0x55ff36b535c0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:04.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.570+0000 7f2893b8e740 1 -- 172.21.15.46:0/1253023412 >> 172.21.15.46:0/1253023412 conn(0x55ff36790460 msgr2=0x55ff36b48380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:04.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.570+0000 7f286e7fc640 0 client.15411 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:04.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.570+0000 7f2893b8e740 1 -- 172.21.15.46:0/1253023412 shutdown_connections 2024-09-21T03:55:04.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.570+0000 7f2893b8e740 1 -- 172.21.15.46:0/1253023412 wait complete. 2024-09-21T03:55:04.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.570+0000 7f2893b8e740 20 client.15411 trim_cache size 0 max 16384 2024-09-21T03:55:04.576 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T03:55:04.576 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "no active scrubs running", 2024-09-21T03:55:04.576 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": {}, 2024-09-21T03:55:04.576 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_stats": { 2024-09-21T03:55:04.576 INFO:teuthology.orchestra.run.smithi046.stdout: "08f0c962-df1a-4129-a1a2-b916240d9803": { 2024-09-21T03:55:04.577 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:02.937596+0000", 2024-09-21T03:55:04.577 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:55:04.577 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:55:04.577 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:55:04.577 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:55:04.577 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:55:04.577 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:55:04.577 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:55:04.577 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T03:55:04.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.571+0000 7f288d61a640 1 -- 172.21.15.46:0/2253654306 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f28740b65f0 msgr2=0x7f28740b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:04.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.571+0000 7f288d61a640 1 --2- 172.21.15.46:0/2253654306 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f28740b65f0 0x7f28740b8b00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55ff36b41ef0 tx=0x7f2878094040 comp rx=0 tx=0).stop 2024-09-21T03:55:04.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.571+0000 7f288d61a640 1 -- 172.21.15.46:0/2253654306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28881048e0 msgr2=0x7f288819a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:04.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.571+0000 7f288d61a640 1 --2- 172.21.15.46:0/2253654306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28881048e0 0x7f288819a550 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f287800ba50 tx=0x7f287800bf10 comp rx=0 tx=0).stop 2024-09-21T03:55:04.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.571+0000 7f288d61a640 1 -- 172.21.15.46:0/2253654306 shutdown_connections 2024-09-21T03:55:04.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.571+0000 7f288d61a640 1 --2- 172.21.15.46:0/2253654306 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f288810de90 0x7f288819fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:04.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.571+0000 7f288d61a640 1 --2- 172.21.15.46:0/2253654306 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f28740b65f0 0x7f28740b8b00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:04.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.571+0000 7f288d61a640 1 --2- 172.21.15.46:0/2253654306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2888105230 0x7f288819aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:04.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.571+0000 7f288d61a640 1 --2- 172.21.15.46:0/2253654306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28881048e0 0x7f288819a550 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:04.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.571+0000 7f288d61a640 1 -- 172.21.15.46:0/2253654306 >> 172.21.15.46:0/2253654306 conn(0x7f2888079790 msgr2=0x7f2888106a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:04.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.571+0000 7f288d61a640 1 -- 172.21.15.46:0/2253654306 shutdown_connections 2024-09-21T03:55:04.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:04.571+0000 7f288d61a640 1 -- 172.21.15.46:0/2253654306 wait complete. 2024-09-21T03:55:04.955 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:04 smithi046 ceph-mon[30954]: from='client.15363 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:04.955 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:04 smithi046 ceph-mon[30954]: from='client.15387 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:04.955 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:04 smithi046 ceph-mon[30954]: from='client.15393 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:05.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:04 smithi105 ceph-mon[34773]: from='client.15363 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:05.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:04 smithi105 ceph-mon[34773]: from='client.15387 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:05.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:04 smithi105 ceph-mon[34773]: from='client.15393 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:05.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:04 smithi162 ceph-mon[35071]: from='client.15363 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:05.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:04 smithi162 ceph-mon[35071]: from='client.15387 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:05.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:04 smithi162 ceph-mon[35071]: from='client.15393 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:05.307 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:55:05.307 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:55:05.610 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:55:06.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:05 smithi046 ceph-mon[30954]: pgmap v321: 97 pgs: 97 active+clean; 1.0 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 62 KiB/s wr, 9 op/s 2024-09-21T03:55:06.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:05 smithi046 ceph-mon[30954]: mgrmap e22: x(active, since 8m), standbys: y, z 2024-09-21T03:55:06.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:05 smithi105 ceph-mon[34773]: pgmap v321: 97 pgs: 97 active+clean; 1.0 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 62 KiB/s wr, 9 op/s 2024-09-21T03:55:06.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:05 smithi105 ceph-mon[34773]: mgrmap e22: x(active, since 8m), standbys: y, z 2024-09-21T03:55:06.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.107+0000 7f97e2f77640 1 -- 172.21.15.46:0/2334737600 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97dc103b60 msgr2=0x7f97dc103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:06.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.107+0000 7f97e2f77640 1 --2- 172.21.15.46:0/2334737600 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97dc103b60 0x7f97dc103f70 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009900 tx=0x7f97cc02a3f0 comp rx=0 tx=0).stop 2024-09-21T03:55:06.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.107+0000 7f97e2f77640 1 -- 172.21.15.46:0/2334737600 shutdown_connections 2024-09-21T03:55:06.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.107+0000 7f97e2f77640 1 --2- 172.21.15.46:0/2334737600 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97dc109df0 0x7f97dc110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:06.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.107+0000 7f97e2f77640 1 --2- 172.21.15.46:0/2334737600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97dc1094a0 0x7f97dc1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:06.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.107+0000 7f97e2f77640 1 --2- 172.21.15.46:0/2334737600 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97dc103b60 0x7f97dc103f70 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:06.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.107+0000 7f97e2f77640 1 -- 172.21.15.46:0/2334737600 >> 172.21.15.46:0/2334737600 conn(0x7f97dc07b850 msgr2=0x7f97dc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:06.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.107+0000 7f97e2f77640 1 -- 172.21.15.46:0/2334737600 shutdown_connections 2024-09-21T03:55:06.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.107+0000 7f97e2f77640 1 -- 172.21.15.46:0/2334737600 wait complete. 2024-09-21T03:55:06.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.108+0000 7f97e2f77640 1 Processor -- start 2024-09-21T03:55:06.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.109+0000 7f97e2f77640 1 -- start start 2024-09-21T03:55:06.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.109+0000 7f97e2f77640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97dc103b60 0x7f97dc19a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:06.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.109+0000 7f97e2f77640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97dc1094a0 0x7f97dc19aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:06.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.109+0000 7f97e2f77640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97dc109df0 0x7f97dc19fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:06.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.109+0000 7f97e2f77640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc113ab0 con 0x7f97dc103b60 2024-09-21T03:55:06.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.109+0000 7f97e2f77640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc113930 con 0x7f97dc109df0 2024-09-21T03:55:06.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.109+0000 7f97e2f77640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc113c30 con 0x7f97dc1094a0 2024-09-21T03:55:06.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.109+0000 7f97e0d13640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97dc103b60 0x7f97dc19a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:06.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.109+0000 7f97e0d13640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97dc103b60 0x7f97dc19a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41258/0 (socket says 172.21.15.46:41258) 2024-09-21T03:55:06.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.109+0000 7f97e0d13640 1 -- 172.21.15.46:0/4102518618 learned_addr learned my addr 172.21.15.46:0/4102518618 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:06.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.109+0000 7f97e1514640 1 --2- 172.21.15.46:0/4102518618 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97dc109df0 0x7f97dc19fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:06.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.109+0000 7f97dbfff640 1 --2- 172.21.15.46:0/4102518618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97dc1094a0 0x7f97dc19aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:06.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.109+0000 7f97e0d13640 1 -- 172.21.15.46:0/4102518618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97dc1094a0 msgr2=0x7f97dc19aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:06.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.109+0000 7f97e0d13640 1 --2- 172.21.15.46:0/4102518618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97dc1094a0 0x7f97dc19aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:06.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.110+0000 7f97e0d13640 1 -- 172.21.15.46:0/4102518618 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97dc109df0 msgr2=0x7f97dc19fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:06.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.110+0000 7f97e0d13640 1 --2- 172.21.15.46:0/4102518618 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97dc109df0 0x7f97dc19fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:06.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.110+0000 7f97e0d13640 1 -- 172.21.15.46:0/4102518618 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97dc1a03d0 con 0x7f97dc103b60 2024-09-21T03:55:06.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.110+0000 7f97dbfff640 1 --2- 172.21.15.46:0/4102518618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97dc1094a0 0x7f97dc19aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:55:06.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.110+0000 7f97e1514640 1 --2- 172.21.15.46:0/4102518618 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97dc109df0 0x7f97dc19fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:55:06.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.110+0000 7f97e0d13640 1 --2- 172.21.15.46:0/4102518618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97dc103b60 0x7f97dc19a520 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f97cc006010 tx=0x7f97cc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:06.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.110+0000 7f97d9ffb640 1 -- 172.21.15.46:0/4102518618 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97cc03f030 con 0x7f97dc103b60 2024-09-21T03:55:06.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.110+0000 7f97d9ffb640 1 -- 172.21.15.46:0/4102518618 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97cc003800 con 0x7f97dc103b60 2024-09-21T03:55:06.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.110+0000 7f97e2f77640 1 -- 172.21.15.46:0/4102518618 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97dc1a0660 con 0x7f97dc103b60 2024-09-21T03:55:06.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.110+0000 7f97d9ffb640 1 -- 172.21.15.46:0/4102518618 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97cc035070 con 0x7f97dc103b60 2024-09-21T03:55:06.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.110+0000 7f97e2f77640 1 -- 172.21.15.46:0/4102518618 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97dc1a0b40 con 0x7f97dc103b60 2024-09-21T03:55:06.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.111+0000 7f97e2f77640 1 -- 172.21.15.46:0/4102518618 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97dc103f70 con 0x7f97dc103b60 2024-09-21T03:55:06.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.113+0000 7f97d9ffb640 1 -- 172.21.15.46:0/4102518618 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 22) ==== 154586+0+0 (secure 0 0 0) 0x7f97cc003cb0 con 0x7f97dc103b60 2024-09-21T03:55:06.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.114+0000 7f97d9ffb640 1 --2- 172.21.15.46:0/4102518618 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f97c40b6620 0x7f97c40b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:06.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.114+0000 7f97dbfff640 1 --2- 172.21.15.46:0/4102518618 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f97c40b6620 0x7f97c40b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:06.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.114+0000 7f97d9ffb640 1 -- 172.21.15.46:0/4102518618 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f97cc108150 con 0x7f97dc103b60 2024-09-21T03:55:06.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.114+0000 7f97dbfff640 1 --2- 172.21.15.46:0/4102518618 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f97c40b6620 0x7f97c40b8b30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f97d0005fd0 tx=0x7f97d0005ea0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:06.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.117+0000 7f97d9ffb640 1 -- 172.21.15.46:0/4102518618 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f97cc0ce7c0 con 0x7f97dc103b60 2024-09-21T03:55:06.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:05 smithi162 ceph-mon[35071]: pgmap v321: 97 pgs: 97 active+clean; 1.0 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 62 KiB/s wr, 9 op/s 2024-09-21T03:55:06.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:05 smithi162 ceph-mon[35071]: mgrmap e22: x(active, since 8m), standbys: y, z 2024-09-21T03:55:06.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.343+0000 7f97e2f77640 1 -- 172.21.15.46:0/4102518618 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f97dc19b650 con 0x7f97dc103b60 2024-09-21T03:55:06.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.343+0000 7f97d9ffb640 1 -- 172.21.15.46:0/4102518618 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f97cc0d2ba0 con 0x7f97dc103b60 2024-09-21T03:55:06.346 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:55:06.346 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"btime":"2024-09-21T03:53:23:865820+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1766354184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1766354184},{"type":"v1","addr":"172.21.15.46:6839","nonce":1766354184}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/1901774207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":1901774207},{"type":"v1","addr":"172.21.15.46:6841","nonce":1901774207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3548633196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":3548633196},{"type":"v1","addr":"172.21.15.105:6837","nonce":3548633196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24652,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3551934241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3551934241},{"type":"v1","addr":"172.21.15.162:6835","nonce":3551934241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/48949822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":48949822},{"type":"v1","addr":"172.21.15.162:6837","nonce":48949822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:53:14.452819+0000","modified":"2024-09-21T03:53:23.593278+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24680},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/2196053213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2196053213},{"type":"v1","addr":"172.21.15.162:6839","nonce":2196053213}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.105:6839/3911438406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":3911438406},{"type":"v1","addr":"172.21.15.105:6839","nonce":3911438406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24680,"qdb_cluster":[24680]},"id":1}]} 2024-09-21T03:55:06.346 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T03:55:06.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.346+0000 7f97e2f77640 1 -- 172.21.15.46:0/4102518618 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f97c40b6620 msgr2=0x7f97c40b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:06.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.346+0000 7f97e2f77640 1 --2- 172.21.15.46:0/4102518618 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f97c40b6620 0x7f97c40b8b30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f97d0005fd0 tx=0x7f97d0005ea0 comp rx=0 tx=0).stop 2024-09-21T03:55:06.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.346+0000 7f97e2f77640 1 -- 172.21.15.46:0/4102518618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97dc103b60 msgr2=0x7f97dc19a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:06.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.346+0000 7f97e2f77640 1 --2- 172.21.15.46:0/4102518618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97dc103b60 0x7f97dc19a520 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f97cc006010 tx=0x7f97cc0042f0 comp rx=0 tx=0).stop 2024-09-21T03:55:06.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.346+0000 7f97e2f77640 1 -- 172.21.15.46:0/4102518618 shutdown_connections 2024-09-21T03:55:06.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.346+0000 7f97e2f77640 1 --2- 172.21.15.46:0/4102518618 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97dc109df0 0x7f97dc19fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:06.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.346+0000 7f97e2f77640 1 --2- 172.21.15.46:0/4102518618 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f97c40b6620 0x7f97c40b8b30 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:06.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.346+0000 7f97e2f77640 1 --2- 172.21.15.46:0/4102518618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97dc1094a0 0x7f97dc19aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:06.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.346+0000 7f97e2f77640 1 --2- 172.21.15.46:0/4102518618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97dc103b60 0x7f97dc19a520 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:06.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.346+0000 7f97e2f77640 1 -- 172.21.15.46:0/4102518618 >> 172.21.15.46:0/4102518618 conn(0x7f97dc07b850 msgr2=0x7f97dc1075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:06.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.346+0000 7f97e2f77640 1 -- 172.21.15.46:0/4102518618 shutdown_connections 2024-09-21T03:55:06.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:06.346+0000 7f97e2f77640 1 -- 172.21.15.46:0/4102518618 wait complete. 2024-09-21T03:55:07.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:06 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/4102518618' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:55:07.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:06 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/4102518618' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:55:07.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:06 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/4102518618' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:55:07.194 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:55:07.461 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:55:07.937 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:07 smithi046 ceph-mon[30954]: pgmap v322: 97 pgs: 97 active+clean; 1.0 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-09-21T03:55:08.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.028+0000 7faa11fad640 1 -- 172.21.15.46:0/2283564786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa0c1094a0 msgr2=0x7faa0c1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:08.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.028+0000 7faa11fad640 1 --2- 172.21.15.46:0/2283564786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa0c1094a0 0x7faa0c1098b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7faa00009900 tx=0x7faa0002a410 comp rx=0 tx=0).stop 2024-09-21T03:55:08.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.028+0000 7faa11fad640 1 -- 172.21.15.46:0/2283564786 shutdown_connections 2024-09-21T03:55:08.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.028+0000 7faa11fad640 1 --2- 172.21.15.46:0/2283564786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa0c109df0 0x7faa0c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:08.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.028+0000 7faa11fad640 1 --2- 172.21.15.46:0/2283564786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa0c1094a0 0x7faa0c1098b0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:08.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.028+0000 7faa11fad640 1 --2- 172.21.15.46:0/2283564786 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa0c103b60 0x7faa0c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:08.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.028+0000 7faa11fad640 1 -- 172.21.15.46:0/2283564786 >> 172.21.15.46:0/2283564786 conn(0x7faa0c07b850 msgr2=0x7faa0c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:08.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.028+0000 7faa11fad640 1 -- 172.21.15.46:0/2283564786 shutdown_connections 2024-09-21T03:55:08.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.028+0000 7faa11fad640 1 -- 172.21.15.46:0/2283564786 wait complete. 2024-09-21T03:55:08.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.029+0000 7faa11fad640 1 Processor -- start 2024-09-21T03:55:08.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.029+0000 7faa11fad640 1 -- start start 2024-09-21T03:55:08.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.030+0000 7faa11fad640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa0c103b60 0x7faa0c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:08.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.030+0000 7faa11fad640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa0c1094a0 0x7faa0c19aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:08.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.030+0000 7faa11fad640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa0c109df0 0x7faa0c19fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:08.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.030+0000 7faa11fad640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c113ad0 con 0x7faa0c1094a0 2024-09-21T03:55:08.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.030+0000 7faa11fad640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c113950 con 0x7faa0c103b60 2024-09-21T03:55:08.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.030+0000 7faa11fad640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c113c50 con 0x7faa0c109df0 2024-09-21T03:55:08.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.030+0000 7faa0affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa0c1094a0 0x7faa0c19aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:08.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.030+0000 7faa0affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa0c1094a0 0x7faa0c19aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41272/0 (socket says 172.21.15.46:41272) 2024-09-21T03:55:08.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.030+0000 7faa0affd640 1 -- 172.21.15.46:0/2792346345 learned_addr learned my addr 172.21.15.46:0/2792346345 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:08.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.030+0000 7faa0b7fe640 1 --2- 172.21.15.46:0/2792346345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa0c103b60 0x7faa0c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:08.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.030+0000 7faa0bfff640 1 --2- 172.21.15.46:0/2792346345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa0c109df0 0x7faa0c19fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:08.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.030+0000 7faa0affd640 1 -- 172.21.15.46:0/2792346345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa0c109df0 msgr2=0x7faa0c19fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:08.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.030+0000 7faa0affd640 1 --2- 172.21.15.46:0/2792346345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa0c109df0 0x7faa0c19fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:08.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.030+0000 7faa0affd640 1 -- 172.21.15.46:0/2792346345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa0c103b60 msgr2=0x7faa0c19a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:08.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.030+0000 7faa0affd640 1 --2- 172.21.15.46:0/2792346345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa0c103b60 0x7faa0c19a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:08.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.030+0000 7faa0affd640 1 -- 172.21.15.46:0/2792346345 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa0c1a04b0 con 0x7faa0c1094a0 2024-09-21T03:55:08.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.031+0000 7faa0affd640 1 --2- 172.21.15.46:0/2792346345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa0c1094a0 0x7faa0c19aba0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7faa0002a930 tx=0x7faa00004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:08.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.031+0000 7faa08ff9640 1 -- 172.21.15.46:0/2792346345 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0003f030 con 0x7faa0c1094a0 2024-09-21T03:55:08.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.031+0000 7faa11fad640 1 -- 172.21.15.46:0/2792346345 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa0c1a0740 con 0x7faa0c1094a0 2024-09-21T03:55:08.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.031+0000 7faa08ff9640 1 -- 172.21.15.46:0/2792346345 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa00003cb0 con 0x7faa0c1094a0 2024-09-21T03:55:08.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.031+0000 7faa08ff9640 1 -- 172.21.15.46:0/2792346345 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa00035070 con 0x7faa0c1094a0 2024-09-21T03:55:08.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.031+0000 7faa11fad640 1 -- 172.21.15.46:0/2792346345 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa0c1a0c20 con 0x7faa0c1094a0 2024-09-21T03:55:08.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.034+0000 7faa18521740 1 Processor -- start 2024-09-21T03:55:08.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.034+0000 7faa18521740 1 -- start start 2024-09-21T03:55:08.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.035+0000 7faa08ff9640 1 -- 172.21.15.46:0/2792346345 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 22) ==== 154586+0+0 (secure 0 0 0) 0x7faa00042030 con 0x7faa0c1094a0 2024-09-21T03:55:08.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.035+0000 7faa18521740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558360e65070 0x55836120c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:08.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.035+0000 7faa18521740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558360e3c1b0 0x55836120cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:08.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.035+0000 7faa18521740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558360e44390 0x55836120d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:08.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.035+0000 7faa18521740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x558361182ea0 con 0x558360e65070 2024-09-21T03:55:08.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.035+0000 7faa18521740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5583611722d0 con 0x558360e3c1b0 2024-09-21T03:55:08.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.035+0000 7faa18521740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5583611760e0 con 0x558360e44390 2024-09-21T03:55:08.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.035+0000 7faa0bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558360e65070 0x55836120c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:08.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.035+0000 7faa0bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558360e65070 0x55836120c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41288/0 (socket says 172.21.15.46:41288) 2024-09-21T03:55:08.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.035+0000 7faa0bfff640 1 -- 172.21.15.46:0/2807339235 learned_addr learned my addr 172.21.15.46:0/2807339235 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:08.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.035+0000 7faa0b7fe640 1 --2- 172.21.15.46:0/2807339235 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558360e3c1b0 0x55836120cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:08.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.035+0000 7faa0affd640 1 --2- 172.21.15.46:0/2807339235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558360e44390 0x55836120d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:08.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.035+0000 7faa0bfff640 1 -- 172.21.15.46:0/2807339235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558360e44390 msgr2=0x55836120d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:08.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.035+0000 7faa0bfff640 1 --2- 172.21.15.46:0/2807339235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558360e44390 0x55836120d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:08.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.035+0000 7faa0bfff640 1 -- 172.21.15.46:0/2807339235 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558360e3c1b0 msgr2=0x55836120cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:08.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.035+0000 7faa0bfff640 1 --2- 172.21.15.46:0/2807339235 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558360e3c1b0 0x55836120cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:08.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.035+0000 7faa0bfff640 1 -- 172.21.15.46:0/2807339235 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558360ed0650 con 0x558360e65070 2024-09-21T03:55:08.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.035+0000 7faa0affd640 1 --2- 172.21.15.46:0/2807339235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558360e44390 0x55836120d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:55:08.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.035+0000 7faa0bfff640 1 --2- 172.21.15.46:0/2807339235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558360e65070 0x55836120c6a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7faa040099e0 tx=0x7faa04009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6565ad78572a3cf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:08.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.036+0000 7faa08ff9640 1 --2- 172.21.15.46:0/2792346345 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa9f40b6620 0x7fa9f40b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:08.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.036+0000 7fa9f1ffb640 1 -- 172.21.15.46:0/2807339235 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa04017070 con 0x558360e65070 2024-09-21T03:55:08.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.036+0000 7faa0b7fe640 1 --2- 172.21.15.46:0/2792346345 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa9f40b6620 0x7fa9f40b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:08.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.036+0000 7faa08ff9640 1 -- 172.21.15.46:0/2792346345 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7faa00107ad0 con 0x7faa0c1094a0 2024-09-21T03:55:08.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.036+0000 7fa9f1ffb640 1 -- 172.21.15.46:0/2807339235 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa04013470 con 0x558360e65070 2024-09-21T03:55:08.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.036+0000 7fa9f1ffb640 1 -- 172.21.15.46:0/2807339235 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa04012630 con 0x558360e65070 2024-09-21T03:55:08.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.037+0000 7faa18521740 1 -- 172.21.15.46:0/2807339235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558360e65070 msgr2=0x55836120c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:08.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.037+0000 7faa18521740 1 --2- 172.21.15.46:0/2807339235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558360e65070 0x55836120c6a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7faa040099e0 tx=0x7faa04009ea0 comp rx=0 tx=0).stop 2024-09-21T03:55:08.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.037+0000 7faa0b7fe640 1 --2- 172.21.15.46:0/2792346345 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa9f40b6620 0x7fa9f40b8b30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55836120b320 tx=0x7fa9fc0075b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:08.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.037+0000 7faa18521740 1 -- 172.21.15.46:0/2807339235 shutdown_connections 2024-09-21T03:55:08.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.037+0000 7faa18521740 1 --2- 172.21.15.46:0/2807339235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558360e44390 0x55836120d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:08.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.037+0000 7faa18521740 1 --2- 172.21.15.46:0/2807339235 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558360e3c1b0 0x55836120cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:08.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.037+0000 7faa18521740 1 --2- 172.21.15.46:0/2807339235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558360e65070 0x55836120c6a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:08.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.037+0000 7faa18521740 1 -- 172.21.15.46:0/2807339235 >> 172.21.15.46:0/2807339235 conn(0x558360e59460 msgr2=0x55836120a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:08.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.037+0000 7faa18521740 1 -- 172.21.15.46:0/2807339235 shutdown_connections 2024-09-21T03:55:08.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.037+0000 7faa18521740 1 -- 172.21.15.46:0/2807339235 wait complete. 2024-09-21T03:55:08.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.037+0000 7faa18521740 1 -- start start 2024-09-21T03:55:08.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.038+0000 7faa18521740 1 Processor -- start 2024-09-21T03:55:08.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.038+0000 7faa18521740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558360e3c1b0 0x558361217cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:08.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.038+0000 7faa18521740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558360e44390 0x558361218210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:08.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.038+0000 7faa18521740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558360e65070 0x558361218750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:08.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.038+0000 7faa18521740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x558360fd3700 con 0x558360e44390 2024-09-21T03:55:08.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.038+0000 7faa18521740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55836110d160 con 0x558360e3c1b0 2024-09-21T03:55:08.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.038+0000 7faa18521740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55836121ae80 con 0x558360e65070 2024-09-21T03:55:08.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.038+0000 7faa18521740 10 client.0 _ll_register_callbacks cb 0x5583611269e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:55:08.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.038+0000 7faa0affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558360e44390 0x558361218210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:08.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.038+0000 7faa0affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558360e44390 0x558361218210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41304/0 (socket says 172.21.15.46:41304) 2024-09-21T03:55:08.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.038+0000 7faa0affd640 1 -- 172.21.15.46:0/4045206031 learned_addr learned my addr 172.21.15.46:0/4045206031 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:08.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.038+0000 7faa0bfff640 1 --2- 172.21.15.46:0/4045206031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558360e65070 0x558361218750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:08.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.038+0000 7faa0b7fe640 1 --2- 172.21.15.46:0/4045206031 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558360e3c1b0 0x558361217cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:08.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.038+0000 7faa0affd640 1 -- 172.21.15.46:0/4045206031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558360e65070 msgr2=0x558361218750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:08.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.038+0000 7faa0affd640 1 --2- 172.21.15.46:0/4045206031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558360e65070 0x558361218750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:08.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.038+0000 7faa0affd640 1 -- 172.21.15.46:0/4045206031 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558360e3c1b0 msgr2=0x558361217cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:08.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.038+0000 7faa0affd640 1 --2- 172.21.15.46:0/4045206031 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558360e3c1b0 0x558361217cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:08.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.038+0000 7faa0affd640 1 -- 172.21.15.46:0/4045206031 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55836113ac90 con 0x558360e44390 2024-09-21T03:55:08.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.038+0000 7faa0b7fe640 1 --2- 172.21.15.46:0/4045206031 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558360e3c1b0 0x558361217cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:55:08.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.039+0000 7faa0affd640 1 --2- 172.21.15.46:0/4045206031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558360e44390 0x558361218210 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7faa000ca100 tx=0x7faa000c99d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7dadc4183fbe8cd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:08.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.039+0000 7fa9eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:55:08.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.039+0000 7fa9eaffd640 1 -- 172.21.15.46:0/4045206031 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa00049030 con 0x558360e44390 2024-09-21T03:55:08.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.039+0000 7fa9eaffd640 1 -- 172.21.15.46:0/4045206031 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7faa0003bbe0 con 0x558360e44390 2024-09-21T03:55:08.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.039+0000 7faa18521740 1 -- 172.21.15.46:0/4045206031 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa04013470 con 0x558360e44390 2024-09-21T03:55:08.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.039+0000 7fa9eaffd640 1 -- 172.21.15.46:0/4045206031 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7faa000cd2a0 con 0x558360e44390 2024-09-21T03:55:08.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.039+0000 7faa18521740 10 client.15429 fetch_fsmap learned FSMap version 20 2024-09-21T03:55:08.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.039+0000 7faa18521740 1 -- 172.21.15.46:0/4045206031 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x558361226a50 con 0x558360e44390 2024-09-21T03:55:08.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.039+0000 7fa9eaffd640 1 -- 172.21.15.46:0/4045206031 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa04013470 con 0x558360e44390 2024-09-21T03:55:08.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.039+0000 7fa9eaffd640 1 -- 172.21.15.46:0/4045206031 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7faa000d7010 con 0x558360e44390 2024-09-21T03:55:08.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.039+0000 7faa18521740 10 client.15429 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:55:08.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.039+0000 7faa18521740 10 client.15429 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:55:08.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.040+0000 7faa18521740 20 client.15429 populate_metadata read hostname 'smithi046' 2024-09-21T03:55:08.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.040+0000 7faa18521740 1 --2- 172.21.15.46:0/4045206031 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558360e239f0 0x558361229e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:08.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.040+0000 7faa18521740 4 client.15429 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:55:08.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.040+0000 7faa18521740 1 -- 172.21.15.46:0/4045206031 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558361184df0 con 0x558360e239f0 2024-09-21T03:55:08.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.040+0000 7faa0b7fe640 1 --2- 172.21.15.46:0/4045206031 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558360e239f0 0x558361229e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:08.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.040+0000 7fa9eaffd640 10 client.15429 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:08.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.040+0000 7faa0b7fe640 1 --2- 172.21.15.46:0/4045206031 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558360e239f0 0x558361229e70 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fec067c998be35d7 server_cookie=56c1f22f52ffafd2 in_seq=0 out_seq=0 2024-09-21T03:55:08.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.041+0000 7fa9eaffd640 1 -- 172.21.15.46:0/4045206031 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558361184df0 con 0x558360e239f0 2024-09-21T03:55:08.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.041+0000 7fa9eaffd640 10 client.15429 handle_command_reply: tid=0 2024-09-21T03:55:08.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.041+0000 7faa18521740 1 client.15429 shutdown 2024-09-21T03:55:08.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.041+0000 7faa18521740 1 -- 172.21.15.46:0/4045206031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558360e44390 msgr2=0x558361218210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:08.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.041+0000 7faa18521740 1 --2- 172.21.15.46:0/4045206031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558360e44390 0x558361218210 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7faa000ca100 tx=0x7faa000c99d0 comp rx=0 tx=0).stop 2024-09-21T03:55:08.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.041+0000 7faa18521740 1 -- 172.21.15.46:0/4045206031 shutdown_connections 2024-09-21T03:55:08.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.041+0000 7faa18521740 1 --2- 172.21.15.46:0/4045206031 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558360e239f0 0x558361229e70 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:08.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.041+0000 7faa18521740 1 --2- 172.21.15.46:0/4045206031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558360e65070 0x558361218750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:08.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.041+0000 7faa18521740 1 --2- 172.21.15.46:0/4045206031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558360e44390 0x558361218210 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:08.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.041+0000 7faa18521740 1 --2- 172.21.15.46:0/4045206031 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558360e3c1b0 0x558361217cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:08.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.041+0000 7faa18521740 1 -- 172.21.15.46:0/4045206031 >> 172.21.15.46:0/4045206031 conn(0x558360e59460 msgr2=0x55836120f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:08.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.041+0000 7fa9eaffd640 0 client.15429 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:08.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.041+0000 7faa18521740 1 -- 172.21.15.46:0/4045206031 shutdown_connections 2024-09-21T03:55:08.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.041+0000 7faa18521740 1 -- 172.21.15.46:0/4045206031 wait complete. 2024-09-21T03:55:08.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.042+0000 7faa18521740 20 client.15429 trim_cache size 0 max 16384 2024-09-21T03:55:08.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.055+0000 7faa18521740 1 Processor -- start 2024-09-21T03:55:08.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.055+0000 7faa18521740 1 -- start start 2024-09-21T03:55:08.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.055+0000 7faa18521740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558360e3c1b0 0x55836120e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:08.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.055+0000 7faa18521740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558360e44390 0x558361219900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:08.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.055+0000 7faa18521740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558360e65070 0x558361214ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:08.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.055+0000 7faa18521740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c1ad5e0 con 0x558360e65070 2024-09-21T03:55:08.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.055+0000 7faa18521740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c1afe60 con 0x558360e44390 2024-09-21T03:55:08.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.055+0000 7faa18521740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c1adc50 con 0x558360e3c1b0 2024-09-21T03:55:08.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.055+0000 7faa0bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558360e65070 0x558361214ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:08.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.055+0000 7faa0bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558360e65070 0x558361214ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41312/0 (socket says 172.21.15.46:41312) 2024-09-21T03:55:08.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.055+0000 7faa0bfff640 1 -- 172.21.15.46:0/1949071951 learned_addr learned my addr 172.21.15.46:0/1949071951 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:08.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.055+0000 7faa0affd640 1 --2- 172.21.15.46:0/1949071951 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558360e44390 0x558361219900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:08.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.055+0000 7faa0b7fe640 1 --2- 172.21.15.46:0/1949071951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558360e3c1b0 0x55836120e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:08.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.055+0000 7faa0bfff640 1 -- 172.21.15.46:0/1949071951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558360e3c1b0 msgr2=0x55836120e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:08.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.055+0000 7faa0bfff640 1 --2- 172.21.15.46:0/1949071951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558360e3c1b0 0x55836120e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:08.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.055+0000 7faa0bfff640 1 -- 172.21.15.46:0/1949071951 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558360e44390 msgr2=0x558361219900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:08.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.055+0000 7faa0bfff640 1 --2- 172.21.15.46:0/1949071951 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558360e44390 0x558361219900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:08.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.055+0000 7faa0bfff640 1 -- 172.21.15.46:0/1949071951 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558361218f90 con 0x558360e65070 2024-09-21T03:55:08.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.056+0000 7faa0bfff640 1 --2- 172.21.15.46:0/1949071951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558360e65070 0x558361214ec0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7faa040099e0 tx=0x7faa04009910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90b8ccf0664ebc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:08.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.056+0000 7fa9f17fa640 1 -- 172.21.15.46:0/1949071951 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa04017040 con 0x558360e65070 2024-09-21T03:55:08.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.056+0000 7fa9f17fa640 1 -- 172.21.15.46:0/1949071951 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa0400ee30 con 0x558360e65070 2024-09-21T03:55:08.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.056+0000 7fa9f17fa640 1 -- 172.21.15.46:0/1949071951 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0401c9f0 con 0x558360e65070 2024-09-21T03:55:08.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.057+0000 7faa18521740 1 -- 172.21.15.46:0/1949071951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558360e65070 msgr2=0x558361214ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:08.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.057+0000 7faa18521740 1 --2- 172.21.15.46:0/1949071951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558360e65070 0x558361214ec0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7faa040099e0 tx=0x7faa04009910 comp rx=0 tx=0).stop 2024-09-21T03:55:08.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.057+0000 7faa18521740 1 -- 172.21.15.46:0/1949071951 shutdown_connections 2024-09-21T03:55:08.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.057+0000 7faa18521740 1 --2- 172.21.15.46:0/1949071951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558360e65070 0x558361214ec0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:08.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.057+0000 7faa18521740 1 --2- 172.21.15.46:0/1949071951 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558360e44390 0x558361219900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:08.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.057+0000 7faa18521740 1 --2- 172.21.15.46:0/1949071951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558360e3c1b0 0x55836120e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:08.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.057+0000 7faa18521740 1 -- 172.21.15.46:0/1949071951 >> 172.21.15.46:0/1949071951 conn(0x558360e59460 msgr2=0x5583612191f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:08.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.057+0000 7faa18521740 1 -- 172.21.15.46:0/1949071951 shutdown_connections 2024-09-21T03:55:08.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.057+0000 7faa18521740 1 -- 172.21.15.46:0/1949071951 wait complete. 2024-09-21T03:55:08.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.057+0000 7faa18521740 1 -- start start 2024-09-21T03:55:08.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.057+0000 7faa18521740 1 Processor -- start 2024-09-21T03:55:08.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.058+0000 7faa18521740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558360e3c1b0 0x558361220b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:08.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.058+0000 7faa18521740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558360e44390 0x55836121e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:08.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.058+0000 7faa18521740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558360e65070 0x55836121e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:08.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.058+0000 7faa18521740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c1ae320 con 0x558360e3c1b0 2024-09-21T03:55:08.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.058+0000 7faa18521740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c1af790 con 0x558360e65070 2024-09-21T03:55:08.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.058+0000 7faa18521740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c1ae9f0 con 0x558360e44390 2024-09-21T03:55:08.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.058+0000 7faa18521740 10 client.0 _ll_register_callbacks cb 0x7faa00005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:55:08.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.058+0000 7faa0b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558360e3c1b0 0x558361220b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:08.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.058+0000 7faa0b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558360e3c1b0 0x558361220b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41326/0 (socket says 172.21.15.46:41326) 2024-09-21T03:55:08.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.058+0000 7faa0b7fe640 1 -- 172.21.15.46:0/2684013226 learned_addr learned my addr 172.21.15.46:0/2684013226 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:08.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.058+0000 7faa0affd640 1 --2- 172.21.15.46:0/2684013226 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558360e44390 0x55836121e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:08.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.058+0000 7faa0bfff640 1 --2- 172.21.15.46:0/2684013226 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558360e65070 0x55836121e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:08.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.058+0000 7faa0b7fe640 1 -- 172.21.15.46:0/2684013226 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558360e44390 msgr2=0x55836121e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:08.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.058+0000 7faa0b7fe640 1 --2- 172.21.15.46:0/2684013226 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558360e44390 0x55836121e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:08.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.058+0000 7faa0b7fe640 1 -- 172.21.15.46:0/2684013226 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558360e65070 msgr2=0x55836121e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:08.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.058+0000 7faa0b7fe640 1 --2- 172.21.15.46:0/2684013226 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558360e65070 0x55836121e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:08.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.058+0000 7faa0b7fe640 1 -- 172.21.15.46:0/2684013226 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558361293810 con 0x558360e3c1b0 2024-09-21T03:55:08.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.058+0000 7faa0affd640 1 --2- 172.21.15.46:0/2684013226 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558360e44390 0x55836121e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:55:08.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.059+0000 7faa0b7fe640 1 --2- 172.21.15.46:0/2684013226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558360e3c1b0 0x558361220b40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00faa0 tx=0x7fa9fc013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f75c883cda7a6880 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:08.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.059+0000 7fa9eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:55:08.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.059+0000 7fa9eaffd640 1 -- 172.21.15.46:0/2684013226 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc02a070 con 0x558360e3c1b0 2024-09-21T03:55:08.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.059+0000 7fa9eaffd640 1 -- 172.21.15.46:0/2684013226 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fa9fc01cc90 con 0x558360e3c1b0 2024-09-21T03:55:08.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.059+0000 7faa18521740 1 -- 172.21.15.46:0/2684013226 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa0400ee30 con 0x558360e3c1b0 2024-09-21T03:55:08.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.059+0000 7fa9eaffd640 1 -- 172.21.15.46:0/2684013226 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa9fc036050 con 0x558360e3c1b0 2024-09-21T03:55:08.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.059+0000 7faa18521740 10 client.15435 fetch_fsmap learned FSMap version 20 2024-09-21T03:55:08.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.059+0000 7faa18521740 1 -- 172.21.15.46:0/2684013226 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x558361294a30 con 0x558360e3c1b0 2024-09-21T03:55:08.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.060+0000 7fa9eaffd640 1 -- 172.21.15.46:0/2684013226 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa0400ee30 con 0x558360e3c1b0 2024-09-21T03:55:08.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.060+0000 7fa9eaffd640 1 -- 172.21.15.46:0/2684013226 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa9fc01b3f0 con 0x558360e3c1b0 2024-09-21T03:55:08.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.060+0000 7faa18521740 10 client.15435 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:55:08.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.060+0000 7faa18521740 10 client.15435 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:55:08.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.060+0000 7faa18521740 20 client.15435 populate_metadata read hostname 'smithi046' 2024-09-21T03:55:08.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.060+0000 7faa18521740 1 --2- 172.21.15.46:0/2684013226 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558360df8da0 0x558361297250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:08.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.060+0000 7faa18521740 4 client.15435 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:55:08.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.060+0000 7faa18521740 1 -- 172.21.15.46:0/2684013226 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5583611808a0 con 0x558360df8da0 2024-09-21T03:55:08.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.060+0000 7faa0affd640 1 --2- 172.21.15.46:0/2684013226 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558360df8da0 0x558361297250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:08.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.061+0000 7fa9eaffd640 10 client.15435 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:08.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.061+0000 7faa0affd640 1 --2- 172.21.15.46:0/2684013226 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558360df8da0 0x558361297250 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7db6dc24e9845ae4 server_cookie=e2509ae6aa947468 in_seq=0 out_seq=0 2024-09-21T03:55:08.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.061+0000 7fa9eaffd640 1 -- 172.21.15.46:0/2684013226 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5583611808a0 con 0x558360df8da0 2024-09-21T03:55:08.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.061+0000 7fa9eaffd640 10 client.15435 handle_command_reply: tid=0 2024-09-21T03:55:08.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.061+0000 7faa18521740 1 client.15435 shutdown 2024-09-21T03:55:08.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.061+0000 7faa18521740 1 -- 172.21.15.46:0/2684013226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558360e3c1b0 msgr2=0x558361220b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:08.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.061+0000 7faa18521740 1 --2- 172.21.15.46:0/2684013226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558360e3c1b0 0x558361220b40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00faa0 tx=0x7fa9fc013040 comp rx=0 tx=0).stop 2024-09-21T03:55:08.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.061+0000 7faa18521740 1 -- 172.21.15.46:0/2684013226 shutdown_connections 2024-09-21T03:55:08.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.061+0000 7faa18521740 1 --2- 172.21.15.46:0/2684013226 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558360df8da0 0x558361297250 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:08.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.061+0000 7faa18521740 1 --2- 172.21.15.46:0/2684013226 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558360e65070 0x55836121e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:08.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.061+0000 7faa18521740 1 --2- 172.21.15.46:0/2684013226 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558360e44390 0x55836121e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:08.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.061+0000 7faa18521740 1 --2- 172.21.15.46:0/2684013226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558360e3c1b0 0x558361220b40 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:08.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.061+0000 7faa18521740 1 -- 172.21.15.46:0/2684013226 >> 172.21.15.46:0/2684013226 conn(0x558360e59460 msgr2=0x55836120ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:08.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.061+0000 7fa9eaffd640 0 client.15435 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:08.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.061+0000 7faa18521740 1 -- 172.21.15.46:0/2684013226 shutdown_connections 2024-09-21T03:55:08.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.061+0000 7faa18521740 1 -- 172.21.15.46:0/2684013226 wait complete. 2024-09-21T03:55:08.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.061+0000 7faa18521740 20 client.15435 trim_cache size 0 max 16384 2024-09-21T03:55:08.068 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-21T03:55:08.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.062+0000 7faa11fad640 1 -- 172.21.15.46:0/2792346345 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa9f40b6620 msgr2=0x7fa9f40b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:08.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.062+0000 7faa11fad640 1 --2- 172.21.15.46:0/2792346345 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa9f40b6620 0x7fa9f40b8b30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55836120b320 tx=0x7fa9fc0075b0 comp rx=0 tx=0).stop 2024-09-21T03:55:08.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.062+0000 7faa11fad640 1 -- 172.21.15.46:0/2792346345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa0c1094a0 msgr2=0x7faa0c19aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:08.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.062+0000 7faa11fad640 1 --2- 172.21.15.46:0/2792346345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa0c1094a0 0x7faa0c19aba0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7faa0002a930 tx=0x7faa00004270 comp rx=0 tx=0).stop 2024-09-21T03:55:08.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.062+0000 7faa11fad640 1 -- 172.21.15.46:0/2792346345 shutdown_connections 2024-09-21T03:55:08.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.062+0000 7faa11fad640 1 --2- 172.21.15.46:0/2792346345 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa9f40b6620 0x7fa9f40b8b30 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:08.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.062+0000 7faa11fad640 1 --2- 172.21.15.46:0/2792346345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa0c109df0 0x7faa0c19fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:08.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.062+0000 7faa11fad640 1 --2- 172.21.15.46:0/2792346345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa0c1094a0 0x7faa0c19aba0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:08.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.062+0000 7faa11fad640 1 --2- 172.21.15.46:0/2792346345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa0c103b60 0x7faa0c19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:08.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.062+0000 7faa11fad640 1 -- 172.21.15.46:0/2792346345 >> 172.21.15.46:0/2792346345 conn(0x7faa0c07b850 msgr2=0x7faa0c107600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:08.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.062+0000 7faa11fad640 1 -- 172.21.15.46:0/2792346345 shutdown_connections 2024-09-21T03:55:08.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:08.062+0000 7faa11fad640 1 -- 172.21.15.46:0/2792346345 wait complete. 2024-09-21T03:55:08.071 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:07 smithi105 ceph-mon[34773]: pgmap v322: 97 pgs: 97 active+clean; 1.0 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-09-21T03:55:08.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:07 smithi162 ceph-mon[35071]: pgmap v322: 97 pgs: 97 active+clean; 1.0 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-09-21T03:55:09.857 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:55:09.857 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:55:10.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:09 smithi046 ceph-mon[30954]: pgmap v323: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 175 KiB/s wr, 50 op/s 2024-09-21T03:55:10.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:09 smithi105 ceph-mon[34773]: pgmap v323: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 175 KiB/s wr, 50 op/s 2024-09-21T03:55:10.122 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:55:10.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:09 smithi162 ceph-mon[35071]: pgmap v323: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 175 KiB/s wr, 50 op/s 2024-09-21T03:55:10.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.625+0000 7f8abe3a5640 1 -- 172.21.15.46:0/1636369449 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ab81083a0 msgr2=0x7f8ab81087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:10.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.625+0000 7f8abe3a5640 1 --2- 172.21.15.46:0/1636369449 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ab81083a0 0x7f8ab81087b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8aac009900 tx=0x7f8aac02a410 comp rx=0 tx=0).stop 2024-09-21T03:55:10.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.625+0000 7f8abe3a5640 1 -- 172.21.15.46:0/1636369449 shutdown_connections 2024-09-21T03:55:10.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.625+0000 7f8abe3a5640 1 --2- 172.21.15.46:0/1636369449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ab8108cf0 0x7f8ab810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:10.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.625+0000 7f8abe3a5640 1 --2- 172.21.15.46:0/1636369449 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ab81083a0 0x7f8ab81087b0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:10.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.625+0000 7f8abe3a5640 1 --2- 172.21.15.46:0/1636369449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ab8102a60 0x7f8ab8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:10.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.625+0000 7f8abe3a5640 1 -- 172.21.15.46:0/1636369449 >> 172.21.15.46:0/1636369449 conn(0x7f8ab8079730 msgr2=0x7f8ab8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:10.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.625+0000 7f8abe3a5640 1 -- 172.21.15.46:0/1636369449 shutdown_connections 2024-09-21T03:55:10.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.625+0000 7f8abe3a5640 1 -- 172.21.15.46:0/1636369449 wait complete. 2024-09-21T03:55:10.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.626+0000 7f8abe3a5640 1 Processor -- start 2024-09-21T03:55:10.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.626+0000 7f8abe3a5640 1 -- start start 2024-09-21T03:55:10.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.627+0000 7f8abe3a5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ab8102a60 0x7f8ab819a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:10.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.627+0000 7f8abe3a5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ab81083a0 0x7f8ab819aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:10.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.627+0000 7f8abe3a5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ab8108cf0 0x7f8ab819fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:10.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.627+0000 7f8abe3a5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab8113a80 con 0x7f8ab8108cf0 2024-09-21T03:55:10.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.627+0000 7f8abe3a5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab8113900 con 0x7f8ab8102a60 2024-09-21T03:55:10.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.627+0000 7f8abe3a5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab8113c00 con 0x7f8ab81083a0 2024-09-21T03:55:10.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.627+0000 7f8abc942640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ab8108cf0 0x7f8ab819fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:10.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.627+0000 7f8abc942640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ab8108cf0 0x7f8ab819fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41344/0 (socket says 172.21.15.46:41344) 2024-09-21T03:55:10.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.627+0000 7f8abc942640 1 -- 172.21.15.46:0/446938728 learned_addr learned my addr 172.21.15.46:0/446938728 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:10.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.627+0000 7f8ab77fe640 1 --2- 172.21.15.46:0/446938728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ab81083a0 0x7f8ab819aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:10.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.627+0000 7f8ab7fff640 1 --2- 172.21.15.46:0/446938728 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ab8102a60 0x7f8ab819a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:10.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.627+0000 7f8abc942640 1 -- 172.21.15.46:0/446938728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ab81083a0 msgr2=0x7f8ab819aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:10.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.627+0000 7f8abc942640 1 --2- 172.21.15.46:0/446938728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ab81083a0 0x7f8ab819aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:10.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.627+0000 7f8abc942640 1 -- 172.21.15.46:0/446938728 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ab8102a60 msgr2=0x7f8ab819a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:10.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.627+0000 7f8abc942640 1 --2- 172.21.15.46:0/446938728 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ab8102a60 0x7f8ab819a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:10.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.627+0000 7f8abc942640 1 -- 172.21.15.46:0/446938728 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab81a0480 con 0x7f8ab8108cf0 2024-09-21T03:55:10.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.627+0000 7f8abc942640 1 --2- 172.21.15.46:0/446938728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ab8108cf0 0x7f8ab819fd50 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8ab000cad0 tx=0x7f8ab000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:10.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.627+0000 7f8ab57fa640 1 -- 172.21.15.46:0/446938728 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab000ae20 con 0x7f8ab8108cf0 2024-09-21T03:55:10.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.628+0000 7f8abe3a5640 1 -- 172.21.15.46:0/446938728 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ab81a0770 con 0x7f8ab8108cf0 2024-09-21T03:55:10.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.628+0000 7f8ab57fa640 1 -- 172.21.15.46:0/446938728 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ab0005020 con 0x7f8ab8108cf0 2024-09-21T03:55:10.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.628+0000 7f8ab57fa640 1 -- 172.21.15.46:0/446938728 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab000f6b0 con 0x7f8ab8108cf0 2024-09-21T03:55:10.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.628+0000 7f8abe3a5640 1 -- 172.21.15.46:0/446938728 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ab81a6ed0 con 0x7f8ab8108cf0 2024-09-21T03:55:10.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.631+0000 7f8ab57fa640 1 -- 172.21.15.46:0/446938728 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 22) ==== 154586+0+0 (secure 0 0 0) 0x7f8ab00051d0 con 0x7f8ab8108cf0 2024-09-21T03:55:10.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.631+0000 7f8ac4919740 1 Processor -- start 2024-09-21T03:55:10.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.631+0000 7f8ac4919740 1 -- start start 2024-09-21T03:55:10.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.631+0000 7f8ac4919740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555794dc0350 0x555795167430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:10.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.631+0000 7f8ac4919740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555794d97490 0x555795167970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:10.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.631+0000 7f8ac4919740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555794d9f670 0x555795167eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:10.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.631+0000 7f8ac4919740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5557950dde60 con 0x555794d9f670 2024-09-21T03:55:10.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.631+0000 7f8ac4919740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5557950cd290 con 0x555794dc0350 2024-09-21T03:55:10.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.631+0000 7f8ac4919740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5557950d10a0 con 0x555794d97490 2024-09-21T03:55:10.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.631+0000 7f8ab77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555794d9f670 0x555795167eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:10.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.631+0000 7f8ab77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555794d9f670 0x555795167eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41346/0 (socket says 172.21.15.46:41346) 2024-09-21T03:55:10.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.631+0000 7f8ab77fe640 1 -- 172.21.15.46:0/1130202835 learned_addr learned my addr 172.21.15.46:0/1130202835 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:10.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.631+0000 7f8ab7fff640 1 --2- 172.21.15.46:0/1130202835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555794d97490 0x555795167970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:10.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.631+0000 7f8ab77fe640 1 --2- 172.21.15.46:0/1130202835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555794dc0350 0x555795167430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:10.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.632+0000 7f8ab77fe640 1 -- 172.21.15.46:0/1130202835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555794d97490 msgr2=0x555795167970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:10.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.632+0000 7f8ab77fe640 1 --2- 172.21.15.46:0/1130202835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555794d97490 0x555795167970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:10.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.632+0000 7f8ab77fe640 1 -- 172.21.15.46:0/1130202835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555794dc0350 msgr2=0x555795167430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:10.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.632+0000 7f8ab77fe640 1 --2- 172.21.15.46:0/1130202835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555794dc0350 0x555795167430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:10.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.632+0000 7f8ab77fe640 1 -- 172.21.15.46:0/1130202835 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555794e2b930 con 0x555794d9f670 2024-09-21T03:55:10.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.632+0000 7f8ab7fff640 1 --2- 172.21.15.46:0/1130202835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555794d97490 0x555795167970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:55:10.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.632+0000 7f8ab57fa640 1 --2- 172.21.15.46:0/446938728 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f8aa00b65f0 0x7f8aa00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:10.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.632+0000 7f8ab77fe640 1 --2- 172.21.15.46:0/1130202835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555794d9f670 0x555795167eb0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0096c0 tx=0x7f8aac009610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac20fd5ea3335691 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:10.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.632+0000 7f8ab7fff640 1 --2- 172.21.15.46:0/446938728 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f8aa00b65f0 0x7f8aa00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:10.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.632+0000 7f8ab57fa640 1 -- 172.21.15.46:0/446938728 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f8ab00e7460 con 0x7f8ab8108cf0 2024-09-21T03:55:10.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.632+0000 7f8a9e7fc640 1 -- 172.21.15.46:0/1130202835 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aac035070 con 0x555794d9f670 2024-09-21T03:55:10.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.632+0000 7f8a9e7fc640 1 -- 172.21.15.46:0/1130202835 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8aac0316f0 con 0x555794d9f670 2024-09-21T03:55:10.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.632+0000 7f8a9e7fc640 1 -- 172.21.15.46:0/1130202835 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aac0047a0 con 0x555794d9f670 2024-09-21T03:55:10.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.633+0000 7f8ac4919740 1 -- 172.21.15.46:0/1130202835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555794d9f670 msgr2=0x555795167eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:10.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.633+0000 7f8ab7fff640 1 --2- 172.21.15.46:0/446938728 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f8aa00b65f0 0x7f8aa00b8b00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x5557951660b0 tx=0x7f8aa800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:10.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.633+0000 7f8ac4919740 1 --2- 172.21.15.46:0/1130202835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555794d9f670 0x555795167eb0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0096c0 tx=0x7f8aac009610 comp rx=0 tx=0).stop 2024-09-21T03:55:10.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.633+0000 7f8ac4919740 1 -- 172.21.15.46:0/1130202835 shutdown_connections 2024-09-21T03:55:10.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.633+0000 7f8ac4919740 1 --2- 172.21.15.46:0/1130202835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555794d9f670 0x555795167eb0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:10.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.633+0000 7f8ac4919740 1 --2- 172.21.15.46:0/1130202835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555794d97490 0x555795167970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:10.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.633+0000 7f8ac4919740 1 --2- 172.21.15.46:0/1130202835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555794dc0350 0x555795167430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:10.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.633+0000 7f8ac4919740 1 -- 172.21.15.46:0/1130202835 >> 172.21.15.46:0/1130202835 conn(0x555794db4740 msgr2=0x555795165320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:10.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.633+0000 7f8ac4919740 1 -- 172.21.15.46:0/1130202835 shutdown_connections 2024-09-21T03:55:10.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.633+0000 7f8ac4919740 1 -- 172.21.15.46:0/1130202835 wait complete. 2024-09-21T03:55:10.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.633+0000 7f8ac4919740 1 -- start start 2024-09-21T03:55:10.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.634+0000 7f8ac4919740 1 Processor -- start 2024-09-21T03:55:10.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.634+0000 7f8ac4919740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555794d97490 0x555795172fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:10.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.634+0000 7f8ac4919740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555794d9f670 0x555795173510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:10.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.634+0000 7f8ac4919740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555794dc0350 0x55579517eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:10.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.634+0000 7f8ac4919740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x555794f2e890 con 0x555794d9f670 2024-09-21T03:55:10.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.634+0000 7f8ac4919740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x555795067d40 con 0x555794d97490 2024-09-21T03:55:10.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.634+0000 7f8ac4919740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555795175bb0 con 0x555794dc0350 2024-09-21T03:55:10.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.634+0000 7f8ac4919740 10 client.0 _ll_register_callbacks cb 0x5557950cbc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:55:10.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.634+0000 7f8ab77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555794d9f670 0x555795173510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:10.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.634+0000 7f8ab77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555794d9f670 0x555795173510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41360/0 (socket says 172.21.15.46:41360) 2024-09-21T03:55:10.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.634+0000 7f8ab77fe640 1 -- 172.21.15.46:0/3762999183 learned_addr learned my addr 172.21.15.46:0/3762999183 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:10.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.634+0000 7f8abc942640 1 --2- 172.21.15.46:0/3762999183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555794dc0350 0x55579517eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:10.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.635+0000 7f8ab7fff640 1 --2- 172.21.15.46:0/3762999183 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555794d97490 0x555795172fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:10.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.635+0000 7f8ab77fe640 1 -- 172.21.15.46:0/3762999183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555794dc0350 msgr2=0x55579517eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:10.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.635+0000 7f8ab77fe640 1 --2- 172.21.15.46:0/3762999183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555794dc0350 0x55579517eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:10.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.635+0000 7f8ab77fe640 1 -- 172.21.15.46:0/3762999183 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555794d97490 msgr2=0x555795172fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:10.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.635+0000 7f8ab77fe640 1 --2- 172.21.15.46:0/3762999183 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555794d97490 0x555795172fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:10.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.635+0000 7f8ab77fe640 1 -- 172.21.15.46:0/3762999183 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55579517f460 con 0x555794d9f670 2024-09-21T03:55:10.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.635+0000 7f8abc942640 1 --2- 172.21.15.46:0/3762999183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555794dc0350 0x55579517eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:55:10.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.635+0000 7f8ab77fe640 1 --2- 172.21.15.46:0/3762999183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555794d9f670 0x555795173510 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f8aac046040 tx=0x7f8aac02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d8b45216ea2d233 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:10.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.635+0000 7f8a977fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:55:10.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.635+0000 7f8a977fe640 1 -- 172.21.15.46:0/3762999183 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aac035040 con 0x555794d9f670 2024-09-21T03:55:10.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.635+0000 7f8a977fe640 1 -- 172.21.15.46:0/3762999183 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f8aac004040 con 0x555794d9f670 2024-09-21T03:55:10.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.635+0000 7f8ac4919740 1 -- 172.21.15.46:0/3762999183 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8aac0316f0 con 0x555794d9f670 2024-09-21T03:55:10.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.635+0000 7f8a977fe640 1 -- 172.21.15.46:0/3762999183 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8aac058020 con 0x555794d9f670 2024-09-21T03:55:10.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.635+0000 7f8ac4919740 10 client.15447 fetch_fsmap learned FSMap version 20 2024-09-21T03:55:10.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.635+0000 7f8ac4919740 1 -- 172.21.15.46:0/3762999183 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x555795181d90 con 0x555794d9f670 2024-09-21T03:55:10.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.635+0000 7f8a977fe640 1 -- 172.21.15.46:0/3762999183 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8aac0316f0 con 0x555794d9f670 2024-09-21T03:55:10.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.636+0000 7f8a977fe640 1 -- 172.21.15.46:0/3762999183 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f8aac0035f0 con 0x555794d9f670 2024-09-21T03:55:10.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.636+0000 7f8ac4919740 10 client.15447 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:55:10.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.636+0000 7f8ac4919740 10 client.15447 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:55:10.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.636+0000 7f8ac4919740 20 client.15447 populate_metadata read hostname 'smithi046' 2024-09-21T03:55:10.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.636+0000 7f8ac4919740 1 --2- 172.21.15.46:0/3762999183 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x555794d7ecd0 0x5557951850f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:10.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.636+0000 7f8ac4919740 4 client.15447 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:55:10.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.636+0000 7f8ac4919740 1 -- 172.21.15.46:0/3762999183 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5557950dfdb0 con 0x555794d7ecd0 2024-09-21T03:55:10.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.636+0000 7f8ab7fff640 1 --2- 172.21.15.46:0/3762999183 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x555794d7ecd0 0x5557951850f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:10.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.637+0000 7f8a977fe640 10 client.15447 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:10.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.637+0000 7f8ab7fff640 1 --2- 172.21.15.46:0/3762999183 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x555794d7ecd0 0x5557951850f0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6ab23ff20e75165 server_cookie=e81f171081cddc81 in_seq=0 out_seq=0 2024-09-21T03:55:10.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.637+0000 7f8a977fe640 1 -- 172.21.15.46:0/3762999183 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5557950dfdb0 con 0x555794d7ecd0 2024-09-21T03:55:10.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.637+0000 7f8a977fe640 10 client.15447 handle_command_reply: tid=0 2024-09-21T03:55:10.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.637+0000 7f8ac4919740 1 client.15447 shutdown 2024-09-21T03:55:10.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.638+0000 7f8ac4919740 1 -- 172.21.15.46:0/3762999183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555794d9f670 msgr2=0x555795173510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:10.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.638+0000 7f8ac4919740 1 --2- 172.21.15.46:0/3762999183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555794d9f670 0x555795173510 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f8aac046040 tx=0x7f8aac02a410 comp rx=0 tx=0).stop 2024-09-21T03:55:10.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.638+0000 7f8ac4919740 1 -- 172.21.15.46:0/3762999183 shutdown_connections 2024-09-21T03:55:10.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.638+0000 7f8ac4919740 1 --2- 172.21.15.46:0/3762999183 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x555794d7ecd0 0x5557951850f0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:10.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.638+0000 7f8ac4919740 1 --2- 172.21.15.46:0/3762999183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555794dc0350 0x55579517eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:10.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.638+0000 7f8ac4919740 1 --2- 172.21.15.46:0/3762999183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555794d9f670 0x555795173510 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:10.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.638+0000 7f8ac4919740 1 --2- 172.21.15.46:0/3762999183 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555794d97490 0x555795172fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:10.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.638+0000 7f8ac4919740 1 -- 172.21.15.46:0/3762999183 >> 172.21.15.46:0/3762999183 conn(0x555794db4740 msgr2=0x55579516a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:10.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.638+0000 7f8a977fe640 0 client.15447 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:10.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.638+0000 7f8ac4919740 1 -- 172.21.15.46:0/3762999183 shutdown_connections 2024-09-21T03:55:10.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.638+0000 7f8ac4919740 1 -- 172.21.15.46:0/3762999183 wait complete. 2024-09-21T03:55:10.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.638+0000 7f8ac4919740 20 client.15447 trim_cache size 0 max 16384 2024-09-21T03:55:10.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.656+0000 7f8ac4919740 1 Processor -- start 2024-09-21T03:55:10.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.656+0000 7f8ac4919740 1 -- start start 2024-09-21T03:55:10.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.656+0000 7f8ac4919740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555794d97490 0x55579517ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:10.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.656+0000 7f8ac4919740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555794d9f670 0x55579516d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:10.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.656+0000 7f8ac4919740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555794dc0350 0x55579516ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:10.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.656+0000 7f8ac4919740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab81ad570 con 0x555794d9f670 2024-09-21T03:55:10.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.656+0000 7f8ac4919740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab81afe10 con 0x555794d97490 2024-09-21T03:55:10.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.656+0000 7f8ac4919740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab81adc00 con 0x555794dc0350 2024-09-21T03:55:10.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.656+0000 7f8ab77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555794d9f670 0x55579516d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:10.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.656+0000 7f8ab77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555794d9f670 0x55579516d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41362/0 (socket says 172.21.15.46:41362) 2024-09-21T03:55:10.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.656+0000 7f8ab77fe640 1 -- 172.21.15.46:0/3916034865 learned_addr learned my addr 172.21.15.46:0/3916034865 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:10.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.657+0000 7f8ab7fff640 1 --2- 172.21.15.46:0/3916034865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555794d97490 0x55579517ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:10.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.657+0000 7f8ab77fe640 1 -- 172.21.15.46:0/3916034865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555794dc0350 msgr2=0x55579516ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:10.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.657+0000 7f8abc942640 1 --2- 172.21.15.46:0/3916034865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555794dc0350 0x55579516ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:10.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.657+0000 7f8ab77fe640 1 --2- 172.21.15.46:0/3916034865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555794dc0350 0x55579516ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:10.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.657+0000 7f8ab77fe640 1 -- 172.21.15.46:0/3916034865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555794d97490 msgr2=0x55579517ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:10.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.657+0000 7f8ab77fe640 1 --2- 172.21.15.46:0/3916034865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555794d97490 0x55579517ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:10.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.657+0000 7f8ab77fe640 1 -- 172.21.15.46:0/3916034865 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555795174090 con 0x555794d9f670 2024-09-21T03:55:10.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.657+0000 7f8ab7fff640 1 --2- 172.21.15.46:0/3916034865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555794d97490 0x55579517ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:55:10.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.657+0000 7f8ab77fe640 1 --2- 172.21.15.46:0/3916034865 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555794d9f670 0x55579516d550 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8aac003ac0 tx=0x7f8aac009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc754b6c3f83c57d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:10.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.657+0000 7f8a9dffb640 1 -- 172.21.15.46:0/3916034865 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aac062030 con 0x555794d9f670 2024-09-21T03:55:10.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.657+0000 7f8a9dffb640 1 -- 172.21.15.46:0/3916034865 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8aac032e50 con 0x555794d9f670 2024-09-21T03:55:10.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.657+0000 7f8a9dffb640 1 -- 172.21.15.46:0/3916034865 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aac035070 con 0x555794d9f670 2024-09-21T03:55:10.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.658+0000 7f8ac4919740 1 -- 172.21.15.46:0/3916034865 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555794d9f670 msgr2=0x55579516d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:10.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.658+0000 7f8ac4919740 1 --2- 172.21.15.46:0/3916034865 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555794d9f670 0x55579516d550 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8aac003ac0 tx=0x7f8aac009880 comp rx=0 tx=0).stop 2024-09-21T03:55:10.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.658+0000 7f8ac4919740 1 -- 172.21.15.46:0/3916034865 shutdown_connections 2024-09-21T03:55:10.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.658+0000 7f8ac4919740 1 --2- 172.21.15.46:0/3916034865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555794dc0350 0x55579516ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:10.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.658+0000 7f8ac4919740 1 --2- 172.21.15.46:0/3916034865 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555794d9f670 0x55579516d550 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:10.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.658+0000 7f8ac4919740 1 --2- 172.21.15.46:0/3916034865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555794d97490 0x55579517ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:10.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.658+0000 7f8ac4919740 1 -- 172.21.15.46:0/3916034865 >> 172.21.15.46:0/3916034865 conn(0x555794db4740 msgr2=0x555795171650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:10.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.658+0000 7f8ac4919740 1 -- 172.21.15.46:0/3916034865 shutdown_connections 2024-09-21T03:55:10.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.658+0000 7f8ac4919740 1 -- 172.21.15.46:0/3916034865 wait complete. 2024-09-21T03:55:10.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.658+0000 7f8ac4919740 1 -- start start 2024-09-21T03:55:10.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.659+0000 7f8ac4919740 1 Processor -- start 2024-09-21T03:55:10.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.659+0000 7f8ac4919740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555794d97490 0x555795186070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:10.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.659+0000 7f8ac4919740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555794d9f670 0x5557951865b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:10.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.659+0000 7f8ac4919740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555794dc0350 0x555795186af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:10.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.659+0000 7f8ac4919740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab81ae2d0 con 0x555794dc0350 2024-09-21T03:55:10.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.659+0000 7f8ac4919740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab81af740 con 0x555794d97490 2024-09-21T03:55:10.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.659+0000 7f8ac4919740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab81ae9a0 con 0x555794d9f670 2024-09-21T03:55:10.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.659+0000 7f8ac4919740 10 client.0 _ll_register_callbacks cb 0x7f8aa800a590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:55:10.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.659+0000 7f8abc942640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555794dc0350 0x555795186af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:10.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.659+0000 7f8abc942640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555794dc0350 0x555795186af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41374/0 (socket says 172.21.15.46:41374) 2024-09-21T03:55:10.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.659+0000 7f8abc942640 1 -- 172.21.15.46:0/3449011637 learned_addr learned my addr 172.21.15.46:0/3449011637 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:10.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.659+0000 7f8ab7fff640 1 --2- 172.21.15.46:0/3449011637 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555794d97490 0x555795186070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:10.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.659+0000 7f8ab77fe640 1 --2- 172.21.15.46:0/3449011637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555794d9f670 0x5557951865b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:10.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.659+0000 7f8abc942640 1 -- 172.21.15.46:0/3449011637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555794d9f670 msgr2=0x5557951865b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:10.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.660+0000 7f8abc942640 1 --2- 172.21.15.46:0/3449011637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555794d9f670 0x5557951865b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:10.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.660+0000 7f8abc942640 1 -- 172.21.15.46:0/3449011637 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555794d97490 msgr2=0x555795186070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:10.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.660+0000 7f8abc942640 1 --2- 172.21.15.46:0/3449011637 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555794d97490 0x555795186070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:10.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.660+0000 7f8abc942640 1 -- 172.21.15.46:0/3449011637 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557951ee870 con 0x555794dc0350 2024-09-21T03:55:10.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.660+0000 7f8ab7fff640 1 --2- 172.21.15.46:0/3449011637 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555794d97490 0x555795186070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:55:10.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.660+0000 7f8abc942640 1 --2- 172.21.15.46:0/3449011637 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555794dc0350 0x555795186af0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0007640 tx=0x7f8ab00acfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ebaf54bad924426 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:10.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.660+0000 7f8a977fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:55:10.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.660+0000 7f8a977fe640 1 -- 172.21.15.46:0/3449011637 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab0098030 con 0x555794dc0350 2024-09-21T03:55:10.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.660+0000 7f8a977fe640 1 -- 172.21.15.46:0/3449011637 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f8ab00e7020 con 0x555794dc0350 2024-09-21T03:55:10.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.660+0000 7f8ac4919740 1 -- 172.21.15.46:0/3449011637 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8aac032e50 con 0x555794dc0350 2024-09-21T03:55:10.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.660+0000 7f8a977fe640 1 -- 172.21.15.46:0/3449011637 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8ab001d040 con 0x555794dc0350 2024-09-21T03:55:10.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.660+0000 7f8ac4919740 10 client.15453 fetch_fsmap learned FSMap version 20 2024-09-21T03:55:10.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.660+0000 7f8ac4919740 1 -- 172.21.15.46:0/3449011637 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5557951efa60 con 0x555794dc0350 2024-09-21T03:55:10.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.660+0000 7f8a977fe640 1 -- 172.21.15.46:0/3449011637 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8aac032e50 con 0x555794dc0350 2024-09-21T03:55:10.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.661+0000 7f8a977fe640 1 -- 172.21.15.46:0/3449011637 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f8ab00ac220 con 0x555794dc0350 2024-09-21T03:55:10.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.661+0000 7f8ac4919740 10 client.15453 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:55:10.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.661+0000 7f8ac4919740 10 client.15453 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:55:10.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.661+0000 7f8ac4919740 20 client.15453 populate_metadata read hostname 'smithi046' 2024-09-21T03:55:10.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.661+0000 7f8ac4919740 1 --2- 172.21.15.46:0/3449011637 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x555794d54080 0x5557951f21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:10.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.661+0000 7f8ac4919740 4 client.15453 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:55:10.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.661+0000 7f8ac4919740 1 -- 172.21.15.46:0/3449011637 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5557950db860 con 0x555794d54080 2024-09-21T03:55:10.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.661+0000 7f8ab7fff640 1 --2- 172.21.15.46:0/3449011637 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x555794d54080 0x5557951f21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:10.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.661+0000 7f8a977fe640 10 client.15453 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:10.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.661+0000 7f8ab7fff640 1 --2- 172.21.15.46:0/3449011637 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x555794d54080 0x5557951f21f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54549cf52cc81aeb server_cookie=95fbc0d92e7770c3 in_seq=0 out_seq=0 2024-09-21T03:55:10.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.663+0000 7f8a977fe640 1 -- 172.21.15.46:0/3449011637 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5557950db860 con 0x555794d54080 2024-09-21T03:55:10.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.663+0000 7f8a977fe640 10 client.15453 handle_command_reply: tid=0 2024-09-21T03:55:10.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.663+0000 7f8ac4919740 1 client.15453 shutdown 2024-09-21T03:55:10.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.664+0000 7f8ac4919740 1 -- 172.21.15.46:0/3449011637 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555794dc0350 msgr2=0x555795186af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:10.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.664+0000 7f8ac4919740 1 --2- 172.21.15.46:0/3449011637 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555794dc0350 0x555795186af0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0007640 tx=0x7f8ab00acfd0 comp rx=0 tx=0).stop 2024-09-21T03:55:10.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.664+0000 7f8ac4919740 1 -- 172.21.15.46:0/3449011637 shutdown_connections 2024-09-21T03:55:10.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.664+0000 7f8ac4919740 1 --2- 172.21.15.46:0/3449011637 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x555794d54080 0x5557951f21f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:10.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.664+0000 7f8ac4919740 1 --2- 172.21.15.46:0/3449011637 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555794dc0350 0x555795186af0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:10.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.664+0000 7f8ac4919740 1 --2- 172.21.15.46:0/3449011637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555794d9f670 0x5557951865b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:10.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.664+0000 7f8ac4919740 1 --2- 172.21.15.46:0/3449011637 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555794d97490 0x555795186070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:10.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.664+0000 7f8a977fe640 0 client.15453 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:10.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.664+0000 7f8ac4919740 1 -- 172.21.15.46:0/3449011637 >> 172.21.15.46:0/3449011637 conn(0x555794db4740 msgr2=0x555795174260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:10.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.664+0000 7f8ac4919740 1 -- 172.21.15.46:0/3449011637 shutdown_connections 2024-09-21T03:55:10.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.664+0000 7f8ac4919740 1 -- 172.21.15.46:0/3449011637 wait complete. 2024-09-21T03:55:10.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.664+0000 7f8ac4919740 20 client.15453 trim_cache size 0 max 16384 2024-09-21T03:55:10.670 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T03:55:10.670 INFO:teuthology.orchestra.run.smithi046.stdout: "return_code": 0, 2024-09-21T03:55:10.670 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_tag": "3bbf7097-70d7-4743-bbce-41465502b35b", 2024-09-21T03:55:10.670 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": "asynchronous" 2024-09-21T03:55:10.670 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T03:55:10.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.664+0000 7f8abe3a5640 1 -- 172.21.15.46:0/446938728 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f8aa00b65f0 msgr2=0x7f8aa00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:10.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.664+0000 7f8abe3a5640 1 --2- 172.21.15.46:0/446938728 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f8aa00b65f0 0x7f8aa00b8b00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x5557951660b0 tx=0x7f8aa800a2d0 comp rx=0 tx=0).stop 2024-09-21T03:55:10.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.665+0000 7f8abe3a5640 1 -- 172.21.15.46:0/446938728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ab8108cf0 msgr2=0x7f8ab819fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:10.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.665+0000 7f8abe3a5640 1 --2- 172.21.15.46:0/446938728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ab8108cf0 0x7f8ab819fd50 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8ab000cad0 tx=0x7f8ab000cf90 comp rx=0 tx=0).stop 2024-09-21T03:55:10.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.665+0000 7f8abe3a5640 1 -- 172.21.15.46:0/446938728 shutdown_connections 2024-09-21T03:55:10.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.665+0000 7f8abe3a5640 1 --2- 172.21.15.46:0/446938728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ab8108cf0 0x7f8ab819fd50 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:10.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.665+0000 7f8abe3a5640 1 --2- 172.21.15.46:0/446938728 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f8aa00b65f0 0x7f8aa00b8b00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:10.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.665+0000 7f8abe3a5640 1 --2- 172.21.15.46:0/446938728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ab81083a0 0x7f8ab819aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:10.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.665+0000 7f8abe3a5640 1 --2- 172.21.15.46:0/446938728 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ab8102a60 0x7f8ab819a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:10.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.665+0000 7f8abe3a5640 1 -- 172.21.15.46:0/446938728 >> 172.21.15.46:0/446938728 conn(0x7f8ab8079730 msgr2=0x7f8ab81044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:10.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.665+0000 7f8abe3a5640 1 -- 172.21.15.46:0/446938728 shutdown_connections 2024-09-21T03:55:10.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:10.665+0000 7f8abe3a5640 1 -- 172.21.15.46:0/446938728 wait complete. 2024-09-21T03:55:11.526 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:55:11.785 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:55:11.907 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:11 smithi046 ceph-mon[30954]: pgmap v324: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 175 KiB/s wr, 49 op/s 2024-09-21T03:55:11.907 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:11 smithi046 ceph-mon[30954]: scrub queued for path: / 2024-09-21T03:55:11.907 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:11 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T03:55:11.907 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:11 smithi046 ceph-mon[30954]: scrub summary: active paths [/] 2024-09-21T03:55:11.907 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:11 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T03:55:12.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:11 smithi105 ceph-mon[34773]: pgmap v324: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 175 KiB/s wr, 49 op/s 2024-09-21T03:55:12.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:11 smithi105 ceph-mon[34773]: scrub queued for path: / 2024-09-21T03:55:12.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:11 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T03:55:12.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:11 smithi105 ceph-mon[34773]: scrub summary: active paths [/] 2024-09-21T03:55:12.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:11 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T03:55:12.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:11 smithi162 ceph-mon[35071]: pgmap v324: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 175 KiB/s wr, 49 op/s 2024-09-21T03:55:12.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:11 smithi162 ceph-mon[35071]: scrub queued for path: / 2024-09-21T03:55:12.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:11 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T03:55:12.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:11 smithi162 ceph-mon[35071]: scrub summary: active paths [/] 2024-09-21T03:55:12.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:11 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T03:55:12.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.283+0000 7fa4cb75e640 1 -- 172.21.15.46:0/2046478077 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4c4108d10 msgr2=0x7fa4c410f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:12.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.283+0000 7fa4cb75e640 1 --2- 172.21.15.46:0/2046478077 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4c4108d10 0x7fa4c410f540 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc009ca0 tx=0x7fa4bc02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:55:12.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.283+0000 7fa4cb75e640 1 -- 172.21.15.46:0/2046478077 shutdown_connections 2024-09-21T03:55:12.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.283+0000 7fa4cb75e640 1 --2- 172.21.15.46:0/2046478077 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4c4108d10 0x7fa4c410f540 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:12.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.283+0000 7fa4cb75e640 1 --2- 172.21.15.46:0/2046478077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4c41083c0 0x7fa4c41087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:12.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.283+0000 7fa4cb75e640 1 --2- 172.21.15.46:0/2046478077 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4c4102a80 0x7fa4c4102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:12.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.283+0000 7fa4cb75e640 1 -- 172.21.15.46:0/2046478077 >> 172.21.15.46:0/2046478077 conn(0x7fa4c4079740 msgr2=0x7fa4c4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:12.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.283+0000 7fa4cb75e640 1 -- 172.21.15.46:0/2046478077 shutdown_connections 2024-09-21T03:55:12.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.283+0000 7fa4cb75e640 1 -- 172.21.15.46:0/2046478077 wait complete. 2024-09-21T03:55:12.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.284+0000 7fa4cb75e640 1 Processor -- start 2024-09-21T03:55:12.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.284+0000 7fa4cb75e640 1 -- start start 2024-09-21T03:55:12.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.284+0000 7fa4cb75e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4c4102a80 0x7fa4c4199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:12.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.284+0000 7fa4cb75e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4c41083c0 0x7fa4c41998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:12.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.284+0000 7fa4cb75e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4c4108d10 0x7fa4c419eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:12.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.284+0000 7fa4cb75e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c4112980 con 0x7fa4c4108d10 2024-09-21T03:55:12.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.284+0000 7fa4cb75e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c4112800 con 0x7fa4c41083c0 2024-09-21T03:55:12.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.284+0000 7fa4cb75e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c4112b00 con 0x7fa4c4102a80 2024-09-21T03:55:12.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.284+0000 7fa4c9cfb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4c4108d10 0x7fa4c419eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:12.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.284+0000 7fa4c9cfb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4c4108d10 0x7fa4c419eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52106/0 (socket says 172.21.15.46:52106) 2024-09-21T03:55:12.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.284+0000 7fa4c9cfb640 1 -- 172.21.15.46:0/1953258392 learned_addr learned my addr 172.21.15.46:0/1953258392 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:12.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.284+0000 7fa4c8cf9640 1 --2- 172.21.15.46:0/1953258392 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4c41083c0 0x7fa4c41998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:12.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.284+0000 7fa4c94fa640 1 --2- 172.21.15.46:0/1953258392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4c4102a80 0x7fa4c4199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:12.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.284+0000 7fa4c9cfb640 1 -- 172.21.15.46:0/1953258392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4c4102a80 msgr2=0x7fa4c4199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:12.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.284+0000 7fa4c9cfb640 1 --2- 172.21.15.46:0/1953258392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4c4102a80 0x7fa4c4199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:12.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.284+0000 7fa4c9cfb640 1 -- 172.21.15.46:0/1953258392 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4c41083c0 msgr2=0x7fa4c41998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:12.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.284+0000 7fa4c9cfb640 1 --2- 172.21.15.46:0/1953258392 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4c41083c0 0x7fa4c41998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:12.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.284+0000 7fa4c9cfb640 1 -- 172.21.15.46:0/1953258392 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c419f1e0 con 0x7fa4c4108d10 2024-09-21T03:55:12.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.285+0000 7fa4c9cfb640 1 --2- 172.21.15.46:0/1953258392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4c4108d10 0x7fa4c419eb70 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc005cc0 tx=0x7fa4bc02f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:12.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.285+0000 7fa4ba7fc640 1 -- 172.21.15.46:0/1953258392 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc003cf0 con 0x7fa4c4108d10 2024-09-21T03:55:12.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.285+0000 7fa4ba7fc640 1 -- 172.21.15.46:0/1953258392 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4bc0044f0 con 0x7fa4c4108d10 2024-09-21T03:55:12.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.285+0000 7fa4cb75e640 1 -- 172.21.15.46:0/1953258392 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4c419f470 con 0x7fa4c4108d10 2024-09-21T03:55:12.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.285+0000 7fa4ba7fc640 1 -- 172.21.15.46:0/1953258392 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc02fc30 con 0x7fa4c4108d10 2024-09-21T03:55:12.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.285+0000 7fa4cb75e640 1 -- 172.21.15.46:0/1953258392 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4c419f9b0 con 0x7fa4c4108d10 2024-09-21T03:55:12.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.288+0000 7fa4d1cd2740 1 Processor -- start 2024-09-21T03:55:12.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.288+0000 7fa4ba7fc640 1 -- 172.21.15.46:0/1953258392 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 22) ==== 154586+0+0 (secure 0 0 0) 0x7fa4bc0046a0 con 0x7fa4c4108d10 2024-09-21T03:55:12.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.289+0000 7fa4d1cd2740 1 -- start start 2024-09-21T03:55:12.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.289+0000 7fa4d1cd2740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556c1ab2b070 0x556c1aed2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:12.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.289+0000 7fa4d1cd2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c1ab021b0 0x556c1aed2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:12.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.289+0000 7fa4d1cd2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c1ab0a390 0x556c1aed30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:12.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.289+0000 7fa4d1cd2740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x556c1ae48e50 con 0x556c1ab2b070 2024-09-21T03:55:12.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.289+0000 7fa4d1cd2740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x556c1ae38280 con 0x556c1ab021b0 2024-09-21T03:55:12.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.289+0000 7fa4d1cd2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556c1ae3c090 con 0x556c1ab0a390 2024-09-21T03:55:12.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.289+0000 7fa4c8cf9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556c1ab2b070 0x556c1aed2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:12.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.289+0000 7fa4c8cf9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556c1ab2b070 0x556c1aed2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52118/0 (socket says 172.21.15.46:52118) 2024-09-21T03:55:12.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.289+0000 7fa4c8cf9640 1 -- 172.21.15.46:0/2405711233 learned_addr learned my addr 172.21.15.46:0/2405711233 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:12.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.289+0000 7fa4c8cf9640 1 --2- 172.21.15.46:0/2405711233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c1ab0a390 0x556c1aed30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:12.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.289+0000 7fa4c94fa640 1 --2- 172.21.15.46:0/2405711233 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c1ab021b0 0x556c1aed2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:12.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.289+0000 7fa4c8cf9640 1 -- 172.21.15.46:0/2405711233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c1ab0a390 msgr2=0x556c1aed30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:12.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.289+0000 7fa4c8cf9640 1 --2- 172.21.15.46:0/2405711233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c1ab0a390 0x556c1aed30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:12.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.289+0000 7fa4ba7fc640 1 --2- 172.21.15.46:0/1953258392 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa4b00b6620 0x7fa4b00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:12.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.289+0000 7fa4c8cf9640 1 -- 172.21.15.46:0/2405711233 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c1ab021b0 msgr2=0x556c1aed2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:12.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.289+0000 7fa4c8cf9640 1 --2- 172.21.15.46:0/2405711233 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c1ab021b0 0x556c1aed2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:12.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.289+0000 7fa4c8cf9640 1 -- 172.21.15.46:0/2405711233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c1ab96650 con 0x556c1ab2b070 2024-09-21T03:55:12.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.290+0000 7fa4c9cfb640 1 --2- 172.21.15.46:0/1953258392 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa4b00b6620 0x7fa4b00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:12.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.290+0000 7fa4c8cf9640 1 --2- 172.21.15.46:0/2405711233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556c1ab2b070 0x556c1aed2650 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4013900 tx=0x7fa4b400a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188b1dec488706b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:12.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.290+0000 7fa4ba7fc640 1 -- 172.21.15.46:0/1953258392 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fa4bc108a10 con 0x7fa4c4108d10 2024-09-21T03:55:12.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.290+0000 7fa4af7fe640 1 -- 172.21.15.46:0/2405711233 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b40119e0 con 0x556c1ab2b070 2024-09-21T03:55:12.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.290+0000 7fa4af7fe640 1 -- 172.21.15.46:0/2405711233 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4b400e3b0 con 0x556c1ab2b070 2024-09-21T03:55:12.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.290+0000 7fa4af7fe640 1 -- 172.21.15.46:0/2405711233 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b401e600 con 0x556c1ab2b070 2024-09-21T03:55:12.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.291+0000 7fa4d1cd2740 1 -- 172.21.15.46:0/2405711233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556c1ab2b070 msgr2=0x556c1aed2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:12.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.291+0000 7fa4c9cfb640 1 --2- 172.21.15.46:0/1953258392 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa4b00b6620 0x7fa4b00b8b30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc031a90 tx=0x7fa4bc037830 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:12.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.291+0000 7fa4d1cd2740 1 --2- 172.21.15.46:0/2405711233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556c1ab2b070 0x556c1aed2650 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4013900 tx=0x7fa4b400a780 comp rx=0 tx=0).stop 2024-09-21T03:55:12.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.291+0000 7fa4d1cd2740 1 -- 172.21.15.46:0/2405711233 shutdown_connections 2024-09-21T03:55:12.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.291+0000 7fa4d1cd2740 1 --2- 172.21.15.46:0/2405711233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c1ab0a390 0x556c1aed30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:12.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.291+0000 7fa4d1cd2740 1 --2- 172.21.15.46:0/2405711233 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c1ab021b0 0x556c1aed2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:12.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.291+0000 7fa4d1cd2740 1 --2- 172.21.15.46:0/2405711233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556c1ab2b070 0x556c1aed2650 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:12.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.291+0000 7fa4d1cd2740 1 -- 172.21.15.46:0/2405711233 >> 172.21.15.46:0/2405711233 conn(0x556c1ab1f460 msgr2=0x556c1aed0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:12.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.291+0000 7fa4d1cd2740 1 -- 172.21.15.46:0/2405711233 shutdown_connections 2024-09-21T03:55:12.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.291+0000 7fa4d1cd2740 1 -- 172.21.15.46:0/2405711233 wait complete. 2024-09-21T03:55:12.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.291+0000 7fa4d1cd2740 1 -- start start 2024-09-21T03:55:12.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.292+0000 7fa4d1cd2740 1 Processor -- start 2024-09-21T03:55:12.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.292+0000 7fa4d1cd2740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556c1ab021b0 0x556c1aedfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:12.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.292+0000 7fa4d1cd2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c1ab0a390 0x556c1aee03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:12.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.292+0000 7fa4d1cd2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c1ab2b070 0x556c1aee0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:12.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.292+0000 7fa4d1cd2740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x556c1ac99700 con 0x556c1ab021b0 2024-09-21T03:55:12.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.292+0000 7fa4d1cd2740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x556c1add3110 con 0x556c1ab0a390 2024-09-21T03:55:12.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.292+0000 7fa4d1cd2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556c1aee2f90 con 0x556c1ab2b070 2024-09-21T03:55:12.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.292+0000 7fa4d1cd2740 10 client.0 _ll_register_callbacks cb 0x556c1adec990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:55:12.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.292+0000 7fa4c8cf9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556c1ab021b0 0x556c1aedfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:12.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.292+0000 7fa4c8cf9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556c1ab021b0 0x556c1aedfeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52126/0 (socket says 172.21.15.46:52126) 2024-09-21T03:55:12.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.292+0000 7fa4c8cf9640 1 -- 172.21.15.46:0/112441576 learned_addr learned my addr 172.21.15.46:0/112441576 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:12.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.292+0000 7fa4c94fa640 1 --2- 172.21.15.46:0/112441576 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c1ab0a390 0x556c1aee03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:12.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.292+0000 7fa4c8cf9640 1 --2- 172.21.15.46:0/112441576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c1ab2b070 0x556c1aee0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:12.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.293+0000 7fa4c8cf9640 1 -- 172.21.15.46:0/112441576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c1ab2b070 msgr2=0x556c1aee0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:12.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.293+0000 7fa4c8cf9640 1 --2- 172.21.15.46:0/112441576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c1ab2b070 0x556c1aee0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:12.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.293+0000 7fa4c8cf9640 1 -- 172.21.15.46:0/112441576 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c1ab0a390 msgr2=0x556c1aee03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:12.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.293+0000 7fa4c8cf9640 1 --2- 172.21.15.46:0/112441576 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c1ab0a390 0x556c1aee03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:12.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.293+0000 7fa4c8cf9640 1 -- 172.21.15.46:0/112441576 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c1ae00c40 con 0x556c1ab021b0 2024-09-21T03:55:12.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.293+0000 7fa4c8cf9640 1 --2- 172.21.15.46:0/112441576 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556c1ab021b0 0x556c1aedfeb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4005bd0 tx=0x7fa4b400ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31bf690dd4173e60 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:12.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.293+0000 7fa4acff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:55:12.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.293+0000 7fa4acff9640 1 -- 172.21.15.46:0/112441576 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4028040 con 0x556c1ab021b0 2024-09-21T03:55:12.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.293+0000 7fa4d1cd2740 1 -- 172.21.15.46:0/112441576 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4b400e3b0 con 0x556c1ab021b0 2024-09-21T03:55:12.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.293+0000 7fa4acff9640 1 -- 172.21.15.46:0/112441576 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fa4b4011e20 con 0x556c1ab021b0 2024-09-21T03:55:12.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.293+0000 7fa4acff9640 1 -- 172.21.15.46:0/112441576 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa4b4034050 con 0x556c1ab021b0 2024-09-21T03:55:12.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.293+0000 7fa4d1cd2740 10 client.15465 fetch_fsmap learned FSMap version 20 2024-09-21T03:55:12.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.293+0000 7fa4d1cd2740 1 -- 172.21.15.46:0/112441576 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x556c1aeeec50 con 0x556c1ab021b0 2024-09-21T03:55:12.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.294+0000 7fa4acff9640 1 -- 172.21.15.46:0/112441576 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4b400e3b0 con 0x556c1ab021b0 2024-09-21T03:55:12.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.294+0000 7fa4acff9640 1 -- 172.21.15.46:0/112441576 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa4b40046c0 con 0x556c1ab021b0 2024-09-21T03:55:12.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.294+0000 7fa4d1cd2740 10 client.15465 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:55:12.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.294+0000 7fa4d1cd2740 10 client.15465 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:55:12.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.294+0000 7fa4d1cd2740 20 client.15465 populate_metadata read hostname 'smithi046' 2024-09-21T03:55:12.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.294+0000 7fa4d1cd2740 1 --2- 172.21.15.46:0/112441576 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x556c1aae99f0 0x556c1aef1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:12.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.294+0000 7fa4d1cd2740 4 client.15465 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:55:12.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.294+0000 7fa4d1cd2740 1 -- 172.21.15.46:0/112441576 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c1ae4ada0 con 0x556c1aae99f0 2024-09-21T03:55:12.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.294+0000 7fa4c94fa640 1 --2- 172.21.15.46:0/112441576 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x556c1aae99f0 0x556c1aef1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:12.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.295+0000 7fa4acff9640 10 client.15465 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:12.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.295+0000 7fa4c94fa640 1 --2- 172.21.15.46:0/112441576 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x556c1aae99f0 0x556c1aef1fb0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8c7c5bc63f20cd7 server_cookie=774a006e599e6e0c in_seq=0 out_seq=0 2024-09-21T03:55:12.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.295+0000 7fa4acff9640 1 -- 172.21.15.46:0/112441576 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556c1ae4ada0 con 0x556c1aae99f0 2024-09-21T03:55:12.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.295+0000 7fa4acff9640 10 client.15465 handle_command_reply: tid=0 2024-09-21T03:55:12.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.295+0000 7fa4d1cd2740 1 client.15465 shutdown 2024-09-21T03:55:12.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.295+0000 7fa4d1cd2740 1 -- 172.21.15.46:0/112441576 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556c1ab021b0 msgr2=0x556c1aedfeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:12.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.295+0000 7fa4d1cd2740 1 --2- 172.21.15.46:0/112441576 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556c1ab021b0 0x556c1aedfeb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4005bd0 tx=0x7fa4b400ac20 comp rx=0 tx=0).stop 2024-09-21T03:55:12.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.296+0000 7fa4d1cd2740 1 -- 172.21.15.46:0/112441576 shutdown_connections 2024-09-21T03:55:12.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.296+0000 7fa4d1cd2740 1 --2- 172.21.15.46:0/112441576 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x556c1aae99f0 0x556c1aef1fb0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:12.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.296+0000 7fa4d1cd2740 1 --2- 172.21.15.46:0/112441576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c1ab2b070 0x556c1aee0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:12.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.296+0000 7fa4d1cd2740 1 --2- 172.21.15.46:0/112441576 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c1ab0a390 0x556c1aee03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:12.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.296+0000 7fa4d1cd2740 1 --2- 172.21.15.46:0/112441576 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556c1ab021b0 0x556c1aedfeb0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:12.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.296+0000 7fa4acff9640 0 client.15465 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:12.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.296+0000 7fa4d1cd2740 1 -- 172.21.15.46:0/112441576 >> 172.21.15.46:0/112441576 conn(0x556c1ab1f460 msgr2=0x556c1aed4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:12.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.296+0000 7fa4d1cd2740 1 -- 172.21.15.46:0/112441576 shutdown_connections 2024-09-21T03:55:12.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.296+0000 7fa4d1cd2740 1 -- 172.21.15.46:0/112441576 wait complete. 2024-09-21T03:55:12.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.296+0000 7fa4d1cd2740 20 client.15465 trim_cache size 0 max 16384 2024-09-21T03:55:12.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.313+0000 7fa4d1cd2740 1 Processor -- start 2024-09-21T03:55:12.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.313+0000 7fa4d1cd2740 1 -- start start 2024-09-21T03:55:12.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.314+0000 7fa4d1cd2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c1ab021b0 0x556c1aedb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:12.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.314+0000 7fa4d1cd2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c1ab0a390 0x556c1aed3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:12.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.314+0000 7fa4d1cd2740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556c1ab2b070 0x556c1aedd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:12.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.314+0000 7fa4d1cd2740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c41ab1c0 con 0x556c1ab2b070 2024-09-21T03:55:12.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.314+0000 7fa4d1cd2740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c41ada40 con 0x556c1ab0a390 2024-09-21T03:55:12.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.314+0000 7fa4d1cd2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c41ab830 con 0x556c1ab021b0 2024-09-21T03:55:12.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.314+0000 7fa4c8cf9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556c1ab2b070 0x556c1aedd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:12.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.314+0000 7fa4c8cf9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556c1ab2b070 0x556c1aedd0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52136/0 (socket says 172.21.15.46:52136) 2024-09-21T03:55:12.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.314+0000 7fa4c8cf9640 1 -- 172.21.15.46:0/990310835 learned_addr learned my addr 172.21.15.46:0/990310835 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:12.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.314+0000 7fa4c94fa640 1 --2- 172.21.15.46:0/990310835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c1ab0a390 0x556c1aed3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:12.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.314+0000 7fa4c8cf9640 1 --2- 172.21.15.46:0/990310835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c1ab021b0 0x556c1aedb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:12.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.314+0000 7fa4c8cf9640 1 -- 172.21.15.46:0/990310835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c1ab021b0 msgr2=0x556c1aedb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:12.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.314+0000 7fa4c8cf9640 1 --2- 172.21.15.46:0/990310835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c1ab021b0 0x556c1aedb660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:12.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.314+0000 7fa4c8cf9640 1 -- 172.21.15.46:0/990310835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c1ab0a390 msgr2=0x556c1aed3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:12.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.314+0000 7fa4c8cf9640 1 --2- 172.21.15.46:0/990310835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c1ab0a390 0x556c1aed3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:12.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.314+0000 7fa4c8cf9640 1 -- 172.21.15.46:0/990310835 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c1aed1220 con 0x556c1ab2b070 2024-09-21T03:55:12.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.314+0000 7fa4c8cf9640 1 --2- 172.21.15.46:0/990310835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556c1ab2b070 0x556c1aedd0a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa4b400ad10 tx=0x7fa4b4005e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ccc62c8a9a3315c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:12.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.315+0000 7fa4aeffd640 1 -- 172.21.15.46:0/990310835 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b400a630 con 0x556c1ab2b070 2024-09-21T03:55:12.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.315+0000 7fa4aeffd640 1 -- 172.21.15.46:0/990310835 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4b400eb50 con 0x556c1ab2b070 2024-09-21T03:55:12.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.315+0000 7fa4aeffd640 1 -- 172.21.15.46:0/990310835 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4011e80 con 0x556c1ab2b070 2024-09-21T03:55:12.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.315+0000 7fa4d1cd2740 1 -- 172.21.15.46:0/990310835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556c1ab2b070 msgr2=0x556c1aedd0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:12.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.315+0000 7fa4d1cd2740 1 --2- 172.21.15.46:0/990310835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556c1ab2b070 0x556c1aedd0a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa4b400ad10 tx=0x7fa4b4005e40 comp rx=0 tx=0).stop 2024-09-21T03:55:12.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.315+0000 7fa4d1cd2740 1 -- 172.21.15.46:0/990310835 shutdown_connections 2024-09-21T03:55:12.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.315+0000 7fa4d1cd2740 1 --2- 172.21.15.46:0/990310835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556c1ab2b070 0x556c1aedd0a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:12.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.315+0000 7fa4d1cd2740 1 --2- 172.21.15.46:0/990310835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c1ab0a390 0x556c1aed3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:12.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.315+0000 7fa4d1cd2740 1 --2- 172.21.15.46:0/990310835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c1ab021b0 0x556c1aedb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:12.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.315+0000 7fa4d1cd2740 1 -- 172.21.15.46:0/990310835 >> 172.21.15.46:0/990310835 conn(0x556c1ab1f460 msgr2=0x556c1aed3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:12.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.316+0000 7fa4d1cd2740 1 -- 172.21.15.46:0/990310835 shutdown_connections 2024-09-21T03:55:12.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.316+0000 7fa4d1cd2740 1 -- 172.21.15.46:0/990310835 wait complete. 2024-09-21T03:55:12.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.316+0000 7fa4d1cd2740 1 -- start start 2024-09-21T03:55:12.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.316+0000 7fa4d1cd2740 1 Processor -- start 2024-09-21T03:55:12.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.316+0000 7fa4d1cd2740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556c1ab021b0 0x556c1aee8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:12.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.316+0000 7fa4d1cd2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c1ab0a390 0x556c1aee5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:12.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.316+0000 7fa4d1cd2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c1ab2b070 0x556c1aee6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:12.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.316+0000 7fa4d1cd2740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c41abf00 con 0x556c1ab021b0 2024-09-21T03:55:12.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.316+0000 7fa4d1cd2740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c41ad370 con 0x556c1ab0a390 2024-09-21T03:55:12.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.316+0000 7fa4d1cd2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c41ac5d0 con 0x556c1ab2b070 2024-09-21T03:55:12.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.317+0000 7fa4d1cd2740 10 client.0 _ll_register_callbacks cb 0x7fa4b400adc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:55:12.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.317+0000 7fa4c8cf9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556c1ab021b0 0x556c1aee8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:12.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.317+0000 7fa4c8cf9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556c1ab021b0 0x556c1aee8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52146/0 (socket says 172.21.15.46:52146) 2024-09-21T03:55:12.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.317+0000 7fa4c8cf9640 1 -- 172.21.15.46:0/2189951120 learned_addr learned my addr 172.21.15.46:0/2189951120 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:12.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.317+0000 7fa4c94fa640 1 --2- 172.21.15.46:0/2189951120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c1ab0a390 0x556c1aee5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:12.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.317+0000 7fa4c8cf9640 1 --2- 172.21.15.46:0/2189951120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c1ab2b070 0x556c1aee6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:12.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.317+0000 7fa4c94fa640 1 -- 172.21.15.46:0/2189951120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c1ab2b070 msgr2=0x556c1aee6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:12.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.317+0000 7fa4c94fa640 1 --2- 172.21.15.46:0/2189951120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c1ab2b070 0x556c1aee6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:12.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.317+0000 7fa4c94fa640 1 -- 172.21.15.46:0/2189951120 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556c1ab021b0 msgr2=0x556c1aee8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:12.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.317+0000 7fa4c94fa640 1 --2- 172.21.15.46:0/2189951120 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556c1ab021b0 0x556c1aee8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:12.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.317+0000 7fa4c94fa640 1 -- 172.21.15.46:0/2189951120 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c1aee6d70 con 0x556c1ab0a390 2024-09-21T03:55:12.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.317+0000 7fa4c8cf9640 1 --2- 172.21.15.46:0/2189951120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c1ab2b070 0x556c1aee6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:55:12.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.317+0000 7fa4c94fa640 1 --2- 172.21.15.46:0/2189951120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c1ab0a390 0x556c1aee5f90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa4c00044e0 tx=0x7fa4c00039c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7679954f768e9940 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:12.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.317+0000 7fa4acff9640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-21T03:55:12.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.317+0000 7fa4acff9640 1 -- 172.21.15.46:0/2189951120 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c0028060 con 0x556c1ab0a390 2024-09-21T03:55:12.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.318+0000 7fa4d1cd2740 1 -- 172.21.15.46:0/2189951120 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556c1ae46850 con 0x556c1ab0a390 2024-09-21T03:55:12.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.318+0000 7fa4acff9640 1 -- 172.21.15.46:0/2189951120 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fa4c0005240 con 0x556c1ab0a390 2024-09-21T03:55:12.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.318+0000 7fa4acff9640 1 -- 172.21.15.46:0/2189951120 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa4c0005440 con 0x556c1ab0a390 2024-09-21T03:55:12.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.318+0000 7fa4d1cd2740 10 client.25154 fetch_fsmap learned FSMap version 20 2024-09-21T03:55:12.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.318+0000 7fa4d1cd2740 1 -- 172.21.15.46:0/2189951120 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x556c1af5c7f0 con 0x556c1ab0a390 2024-09-21T03:55:12.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.318+0000 7fa4acff9640 1 -- 172.21.15.46:0/2189951120 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x556c1ae46850 con 0x556c1ab0a390 2024-09-21T03:55:12.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.318+0000 7fa4acff9640 1 -- 172.21.15.46:0/2189951120 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa4c0023680 con 0x556c1ab0a390 2024-09-21T03:55:12.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.318+0000 7fa4d1cd2740 10 client.25154 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:55:12.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.318+0000 7fa4d1cd2740 10 client.25154 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:55:12.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.318+0000 7fa4d1cd2740 20 client.25154 populate_metadata read hostname 'smithi046' 2024-09-21T03:55:12.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.318+0000 7fa4d1cd2740 1 --2- 172.21.15.46:0/2189951120 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x556c1aabeda0 0x556c1af5ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:12.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.318+0000 7fa4d1cd2740 4 client.25154 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:55:12.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.318+0000 7fa4d1cd2740 1 -- 172.21.15.46:0/2189951120 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556c1ae43c80 con 0x556c1aabeda0 2024-09-21T03:55:12.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.319+0000 7fa4c8cf9640 1 --2- 172.21.15.46:0/2189951120 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x556c1aabeda0 0x556c1af5ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:12.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.319+0000 7fa4c8cf9640 1 --2- 172.21.15.46:0/2189951120 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x556c1aabeda0 0x556c1af5ef90 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94054f2c810f0bbd server_cookie=60eff8fdd1c95d74 in_seq=0 out_seq=0 2024-09-21T03:55:12.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.319+0000 7fa4acff9640 10 client.25154 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:12.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.319+0000 7fa4acff9640 1 -- 172.21.15.46:0/2189951120 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+854 (crc 0 0 0) 0x556c1ae43c80 con 0x556c1aabeda0 2024-09-21T03:55:12.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.319+0000 7fa4acff9640 10 client.25154 handle_command_reply: tid=0 2024-09-21T03:55:12.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.319+0000 7fa4d1cd2740 1 client.25154 shutdown 2024-09-21T03:55:12.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.319+0000 7fa4d1cd2740 1 -- 172.21.15.46:0/2189951120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c1ab0a390 msgr2=0x556c1aee5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:12.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.319+0000 7fa4d1cd2740 1 --2- 172.21.15.46:0/2189951120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c1ab0a390 0x556c1aee5f90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa4c00044e0 tx=0x7fa4c00039c0 comp rx=0 tx=0).stop 2024-09-21T03:55:12.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.320+0000 7fa4d1cd2740 1 -- 172.21.15.46:0/2189951120 shutdown_connections 2024-09-21T03:55:12.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.320+0000 7fa4d1cd2740 1 --2- 172.21.15.46:0/2189951120 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x556c1aabeda0 0x556c1af5ef90 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:12.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.320+0000 7fa4d1cd2740 1 --2- 172.21.15.46:0/2189951120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c1ab2b070 0x556c1aee6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:12.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.320+0000 7fa4acff9640 0 client.25154 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:12.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.320+0000 7fa4d1cd2740 1 --2- 172.21.15.46:0/2189951120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c1ab0a390 0x556c1aee5f90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:12.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.320+0000 7fa4d1cd2740 1 --2- 172.21.15.46:0/2189951120 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556c1ab021b0 0x556c1aee8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:12.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.320+0000 7fa4d1cd2740 1 -- 172.21.15.46:0/2189951120 >> 172.21.15.46:0/2189951120 conn(0x556c1ab1f460 msgr2=0x556c1aed34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:12.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.320+0000 7fa4d1cd2740 1 -- 172.21.15.46:0/2189951120 shutdown_connections 2024-09-21T03:55:12.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.320+0000 7fa4d1cd2740 1 -- 172.21.15.46:0/2189951120 wait complete. 2024-09-21T03:55:12.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.320+0000 7fa4d1cd2740 20 client.25154 trim_cache size 0 max 16384 2024-09-21T03:55:12.327 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T03:55:12.327 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T03:55:12.327 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2024-09-21T03:55:12.327 INFO:teuthology.orchestra.run.smithi046.stdout: "3bbf7097-70d7-4743-bbce-41465502b35b": { 2024-09-21T03:55:12.327 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:55:12.327 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "3bbf7097-70d7-4743-bbce-41465502b35b", 2024-09-21T03:55:12.327 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2024-09-21T03:55:12.327 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:55:12.327 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:55:12.328 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_stats": { 2024-09-21T03:55:12.328 INFO:teuthology.orchestra.run.smithi046.stdout: "3bbf7097-70d7-4743-bbce-41465502b35b": { 2024-09-21T03:55:12.328 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:10.661441+0000", 2024-09-21T03:55:12.328 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:55:12.328 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:55:12.328 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:55:12.328 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:55:12.328 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:55:12.328 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:55:12.328 INFO:teuthology.orchestra.run.smithi046.stdout: "08f0c962-df1a-4129-a1a2-b916240d9803": { 2024-09-21T03:55:12.328 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:02.937596+0000", 2024-09-21T03:55:12.328 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:55:12.328 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:55:12.328 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:55:12.328 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:55:12.329 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:55:12.329 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:55:12.329 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:55:12.329 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T03:55:12.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.320+0000 7fa4cb75e640 1 -- 172.21.15.46:0/1953258392 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa4b00b6620 msgr2=0x7fa4b00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:12.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.320+0000 7fa4cb75e640 1 --2- 172.21.15.46:0/1953258392 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa4b00b6620 0x7fa4b00b8b30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc031a90 tx=0x7fa4bc037830 comp rx=0 tx=0).stop 2024-09-21T03:55:12.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.320+0000 7fa4cb75e640 1 -- 172.21.15.46:0/1953258392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4c4108d10 msgr2=0x7fa4c419eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:12.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.320+0000 7fa4cb75e640 1 --2- 172.21.15.46:0/1953258392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4c4108d10 0x7fa4c419eb70 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc005cc0 tx=0x7fa4bc02f470 comp rx=0 tx=0).stop 2024-09-21T03:55:12.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.320+0000 7fa4cb75e640 1 -- 172.21.15.46:0/1953258392 shutdown_connections 2024-09-21T03:55:12.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.320+0000 7fa4cb75e640 1 --2- 172.21.15.46:0/1953258392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4c4108d10 0x7fa4c419eb70 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:12.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.320+0000 7fa4cb75e640 1 --2- 172.21.15.46:0/1953258392 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4c41083c0 0x7fa4c41998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:12.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.320+0000 7fa4cb75e640 1 --2- 172.21.15.46:0/1953258392 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa4b00b6620 0x7fa4b00b8b30 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:12.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.320+0000 7fa4cb75e640 1 --2- 172.21.15.46:0/1953258392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4c4102a80 0x7fa4c4199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:12.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.320+0000 7fa4cb75e640 1 -- 172.21.15.46:0/1953258392 >> 172.21.15.46:0/1953258392 conn(0x7fa4c4079740 msgr2=0x7fa4c4104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:12.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.320+0000 7fa4cb75e640 1 -- 172.21.15.46:0/1953258392 shutdown_connections 2024-09-21T03:55:12.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:12.321+0000 7fa4cb75e640 1 -- 172.21.15.46:0/1953258392 wait complete. 2024-09-21T03:55:13.133 INFO:tasks.cephfs.filesystem:scrub status for tag:3bbf7097-70d7-4743-bbce-41465502b35b - {'path': '/', 'tag': '3bbf7097-70d7-4743-bbce-41465502b35b', 'options': 'recursive,force'} 2024-09-21T03:55:14.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:13 smithi046 ceph-mon[30954]: pgmap v325: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 175 KiB/s wr, 49 op/s 2024-09-21T03:55:14.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:13 smithi046 ceph-mon[30954]: scrub summary: idle 2024-09-21T03:55:14.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:13 smithi105 ceph-mon[34773]: pgmap v325: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 175 KiB/s wr, 49 op/s 2024-09-21T03:55:14.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:13 smithi105 ceph-mon[34773]: scrub summary: idle 2024-09-21T03:55:14.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:13 smithi162 ceph-mon[35071]: pgmap v325: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 175 KiB/s wr, 49 op/s 2024-09-21T03:55:14.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:13 smithi162 ceph-mon[35071]: scrub summary: idle 2024-09-21T03:55:16.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:15 smithi046 ceph-mon[30954]: pgmap v326: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 175 KiB/s wr, 50 op/s 2024-09-21T03:55:16.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:15 smithi105 ceph-mon[34773]: pgmap v326: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 175 KiB/s wr, 50 op/s 2024-09-21T03:55:16.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:15 smithi162 ceph-mon[35071]: pgmap v326: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 175 KiB/s wr, 50 op/s 2024-09-21T03:55:17.086 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.083+0000 7f5214dc6640 1 -- 172.21.15.46:0/3137775763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5210106200 msgr2=0x7f5210106610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:17.086 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.083+0000 7f5214dc6640 1 --2- 172.21.15.46:0/3137775763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5210106200 0x7f5210106610 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f51f8009900 tx=0x7f51f802a410 comp rx=0 tx=0).stop 2024-09-21T03:55:17.086 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.083+0000 7f5214dc6640 1 -- 172.21.15.46:0/3137775763 shutdown_connections 2024-09-21T03:55:17.086 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.083+0000 7f5214dc6640 1 --2- 172.21.15.46:0/3137775763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5210106b50 0x7f5210110590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:17.086 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.083+0000 7f5214dc6640 1 --2- 172.21.15.46:0/3137775763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5210106200 0x7f5210106610 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:17.086 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.083+0000 7f5214dc6640 1 --2- 172.21.15.46:0/3137775763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5210102090 0x7f52101024a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:17.087 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.083+0000 7f5214dc6640 1 -- 172.21.15.46:0/3137775763 >> 172.21.15.46:0/3137775763 conn(0x7f5210079ec0 msgr2=0x7f521007a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:17.087 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.083+0000 7f5214dc6640 1 -- 172.21.15.46:0/3137775763 shutdown_connections 2024-09-21T03:55:17.087 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.084+0000 7f5214dc6640 1 -- 172.21.15.46:0/3137775763 wait complete. 2024-09-21T03:55:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.084+0000 7f5214dc6640 1 Processor -- start 2024-09-21T03:55:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.084+0000 7f5214dc6640 1 -- start start 2024-09-21T03:55:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.085+0000 7f5214dc6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5210102090 0x7f521019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.085+0000 7f5214dc6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5210106200 0x7f521019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.085+0000 7f5214dc6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5210106b50 0x7f521019fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.085+0000 7f5214dc6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5210113a20 con 0x7f5210102090 2024-09-21T03:55:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.085+0000 7f5214dc6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f52101138a0 con 0x7f5210106200 2024-09-21T03:55:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.085+0000 7f5214dc6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5210113ba0 con 0x7f5210106b50 2024-09-21T03:55:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.085+0000 7f520e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5210102090 0x7f521019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.085+0000 7f520e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5210102090 0x7f521019a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52152/0 (socket says 172.21.15.46:52152) 2024-09-21T03:55:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.085+0000 7f520e59c640 1 -- 172.21.15.46:0/189287723 learned_addr learned my addr 172.21.15.46:0/189287723 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.085+0000 7f520ed9d640 1 --2- 172.21.15.46:0/189287723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5210106b50 0x7f521019fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.085+0000 7f520dd9b640 1 --2- 172.21.15.46:0/189287723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5210106200 0x7f521019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.085+0000 7f520e59c640 1 -- 172.21.15.46:0/189287723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5210106b50 msgr2=0x7f521019fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.085+0000 7f520e59c640 1 --2- 172.21.15.46:0/189287723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5210106b50 0x7f521019fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.085+0000 7f520e59c640 1 -- 172.21.15.46:0/189287723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5210106200 msgr2=0x7f521019aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.085+0000 7f520e59c640 1 --2- 172.21.15.46:0/189287723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5210106200 0x7f521019aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.085+0000 7f520e59c640 1 -- 172.21.15.46:0/189287723 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52101a03f0 con 0x7f5210102090 2024-09-21T03:55:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.085+0000 7f520dd9b640 1 --2- 172.21.15.46:0/189287723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5210106200 0x7f521019aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:55:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.086+0000 7f520e59c640 1 --2- 172.21.15.46:0/189287723 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5210102090 0x7f521019a4c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f520800e9f0 tx=0x7f520800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.086+0000 7f52077fe640 1 -- 172.21.15.46:0/189287723 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520800cd80 con 0x7f5210102090 2024-09-21T03:55:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.086+0000 7f52077fe640 1 -- 172.21.15.46:0/189287723 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52080108e0 con 0x7f5210102090 2024-09-21T03:55:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.086+0000 7f52077fe640 1 -- 172.21.15.46:0/189287723 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5208018980 con 0x7f5210102090 2024-09-21T03:55:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.086+0000 7f5214dc6640 1 -- 172.21.15.46:0/189287723 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52101a06e0 con 0x7f5210102090 2024-09-21T03:55:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.086+0000 7f5214dc6640 1 -- 172.21.15.46:0/189287723 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52101a6e70 con 0x7f5210102090 2024-09-21T03:55:17.093 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.089+0000 7f52077fe640 1 -- 172.21.15.46:0/189287723 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 22) ==== 154586+0+0 (secure 0 0 0) 0x7f5208010430 con 0x7f5210102090 2024-09-21T03:55:17.093 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.089+0000 7f521be1a740 1 Processor -- start 2024-09-21T03:55:17.093 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.089+0000 7f521be1a740 1 -- start start 2024-09-21T03:55:17.093 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.089+0000 7f521be1a740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a8441b0 0x559c9abe99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:17.093 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.089+0000 7f521be1a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c9a81b2f0 0x559c9abe9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:17.093 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.089+0000 7f521be1a740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c9a8234d0 0x559c9abea430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:17.093 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.089+0000 7f521be1a740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x559c9ab5e6f0 con 0x559c9a8234d0 2024-09-21T03:55:17.093 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.089+0000 7f521be1a740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x559c9ab4db20 con 0x559c9a8441b0 2024-09-21T03:55:17.093 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.089+0000 7f521be1a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559c9ab51930 con 0x559c9a81b2f0 2024-09-21T03:55:17.093 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.089+0000 7f520dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c9a8234d0 0x559c9abea430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:17.093 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.090+0000 7f520dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c9a8234d0 0x559c9abea430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52158/0 (socket says 172.21.15.46:52158) 2024-09-21T03:55:17.093 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.090+0000 7f520dd9b640 1 -- 172.21.15.46:0/3374783140 learned_addr learned my addr 172.21.15.46:0/3374783140 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:17.093 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.090+0000 7f520e59c640 1 --2- 172.21.15.46:0/3374783140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c9a81b2f0 0x559c9abe9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.090+0000 7f520ed9d640 1 --2- 172.21.15.46:0/3374783140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a8441b0 0x559c9abe99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.090+0000 7f52077fe640 1 --2- 172.21.15.46:0/189287723 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f51fc0b65f0 0x7f51fc0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.090+0000 7f520dd9b640 1 -- 172.21.15.46:0/3374783140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c9a81b2f0 msgr2=0x559c9abe9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.090+0000 7f520dd9b640 1 --2- 172.21.15.46:0/3374783140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c9a81b2f0 0x559c9abe9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.090+0000 7f520dd9b640 1 -- 172.21.15.46:0/3374783140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a8441b0 msgr2=0x559c9abe99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.090+0000 7f520dd9b640 1 --2- 172.21.15.46:0/3374783140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a8441b0 0x559c9abe99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.090+0000 7f520dd9b640 1 -- 172.21.15.46:0/3374783140 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c9ab13530 con 0x559c9a8234d0 2024-09-21T03:55:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.090+0000 7f520ed9d640 1 --2- 172.21.15.46:0/189287723 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f51fc0b65f0 0x7f51fc0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.090+0000 7f52077fe640 1 -- 172.21.15.46:0/189287723 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f52080e7960 con 0x7f5210102090 2024-09-21T03:55:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.090+0000 7f520dd9b640 1 --2- 172.21.15.46:0/3374783140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c9a8234d0 0x559c9abea430 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f51f8031440 tx=0x7f51f8032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e9af84d65dc326b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.090+0000 7f5204ff9640 1 -- 172.21.15.46:0/3374783140 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f803f070 con 0x559c9a8234d0 2024-09-21T03:55:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.091+0000 7f5204ff9640 1 -- 172.21.15.46:0/3374783140 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51f80316a0 con 0x559c9a8234d0 2024-09-21T03:55:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.091+0000 7f5204ff9640 1 -- 172.21.15.46:0/3374783140 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f8035070 con 0x559c9a8234d0 2024-09-21T03:55:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.091+0000 7f521be1a740 1 -- 172.21.15.46:0/3374783140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c9a8234d0 msgr2=0x559c9abea430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.091+0000 7f521be1a740 1 --2- 172.21.15.46:0/3374783140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c9a8234d0 0x559c9abea430 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f51f8031440 tx=0x7f51f8032c50 comp rx=0 tx=0).stop 2024-09-21T03:55:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.091+0000 7f520ed9d640 1 --2- 172.21.15.46:0/189287723 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f51fc0b65f0 0x7f51fc0b8b00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5200005c40 tx=0x7f5200004a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.091+0000 7f521be1a740 1 -- 172.21.15.46:0/3374783140 shutdown_connections 2024-09-21T03:55:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.091+0000 7f521be1a740 1 --2- 172.21.15.46:0/3374783140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c9a8234d0 0x559c9abea430 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.091+0000 7f521be1a740 1 --2- 172.21.15.46:0/3374783140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c9a81b2f0 0x559c9abe9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.091+0000 7f521be1a740 1 --2- 172.21.15.46:0/3374783140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a8441b0 0x559c9abe99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.091+0000 7f521be1a740 1 -- 172.21.15.46:0/3374783140 >> 172.21.15.46:0/3374783140 conn(0x559c9a838300 msgr2=0x559c9abe78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.092+0000 7f521be1a740 1 -- 172.21.15.46:0/3374783140 shutdown_connections 2024-09-21T03:55:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.092+0000 7f521be1a740 1 -- 172.21.15.46:0/3374783140 wait complete. 2024-09-21T03:55:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.092+0000 7f521be1a740 1 -- start start 2024-09-21T03:55:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.092+0000 7f521be1a740 1 Processor -- start 2024-09-21T03:55:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.092+0000 7f521be1a740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a81b2f0 0x559c9abf9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.092+0000 7f521be1a740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c9a8234d0 0x559c9abf9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:17.100 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.092+0000 7f521be1a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c9a8441b0 0x559c9ac057e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:17.100 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.092+0000 7f521be1a740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x559c9aa85ab0 con 0x559c9a8234d0 2024-09-21T03:55:17.100 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.092+0000 7f521be1a740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x559c9aaf3730 con 0x559c9a81b2f0 2024-09-21T03:55:17.100 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.092+0000 7f521be1a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559c9abfc4b0 con 0x559c9a8441b0 2024-09-21T03:55:17.100 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.093+0000 7f520dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c9a8234d0 0x559c9abf9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:17.100 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.093+0000 7f521be1a740 10 client.0 _ll_register_callbacks cb 0x559c9ab476b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:55:17.100 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.093+0000 7f520dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c9a8234d0 0x559c9abf9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52162/0 (socket says 172.21.15.46:52162) 2024-09-21T03:55:17.100 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.093+0000 7f520dd9b640 1 -- 172.21.15.46:0/701916381 learned_addr learned my addr 172.21.15.46:0/701916381 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:17.100 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.093+0000 7f520ed9d640 1 --2- 172.21.15.46:0/701916381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c9a8441b0 0x559c9ac057e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:17.100 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.093+0000 7f520e59c640 1 --2- 172.21.15.46:0/701916381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a81b2f0 0x559c9abf9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:17.100 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.093+0000 7f520dd9b640 1 -- 172.21.15.46:0/701916381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c9a8441b0 msgr2=0x559c9ac057e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:17.100 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.093+0000 7f520dd9b640 1 --2- 172.21.15.46:0/701916381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c9a8441b0 0x559c9ac057e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:17.100 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.093+0000 7f520dd9b640 1 -- 172.21.15.46:0/701916381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a81b2f0 msgr2=0x559c9abf9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:17.100 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.093+0000 7f520dd9b640 1 --2- 172.21.15.46:0/701916381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a81b2f0 0x559c9abf9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:17.101 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.093+0000 7f520dd9b640 1 -- 172.21.15.46:0/701916381 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c9a8af790 con 0x559c9a8234d0 2024-09-21T03:55:17.101 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.093+0000 7f520dd9b640 1 --2- 172.21.15.46:0/701916381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c9a8234d0 0x559c9abf9970 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f51f8032f80 tx=0x7f51f80314a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=561116e81faab5f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:17.101 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.093+0000 7f51f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:55:17.101 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.093+0000 7f51f5ffb640 1 -- 172.21.15.46:0/701916381 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f804b060 con 0x559c9a8234d0 2024-09-21T03:55:17.101 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.093+0000 7f51f5ffb640 1 -- 172.21.15.46:0/701916381 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f51f8004230 con 0x559c9a8234d0 2024-09-21T03:55:17.101 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.093+0000 7f521be1a740 1 -- 172.21.15.46:0/701916381 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51f80316a0 con 0x559c9a8234d0 2024-09-21T03:55:17.101 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.094+0000 7f51f5ffb640 1 -- 172.21.15.46:0/701916381 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f51f803f070 con 0x559c9a8234d0 2024-09-21T03:55:17.101 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.094+0000 7f521be1a740 10 client.15483 fetch_fsmap learned FSMap version 20 2024-09-21T03:55:17.101 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.094+0000 7f521be1a740 1 -- 172.21.15.46:0/701916381 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x559c9a928620 con 0x559c9a8234d0 2024-09-21T03:55:17.101 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.094+0000 7f51f5ffb640 1 -- 172.21.15.46:0/701916381 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51f80316a0 con 0x559c9a8234d0 2024-09-21T03:55:17.101 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.094+0000 7f51f5ffb640 1 -- 172.21.15.46:0/701916381 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f51f8003680 con 0x559c9a8234d0 2024-09-21T03:55:17.101 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.094+0000 7f521be1a740 10 client.15483 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:55:17.101 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.094+0000 7f521be1a740 10 client.15483 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:55:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.094+0000 7f521be1a740 20 client.15483 populate_metadata read hostname 'smithi046' 2024-09-21T03:55:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.094+0000 7f521be1a740 1 --2- 172.21.15.46:0/701916381 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x559c9a802d80 0x559c9ac0b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.094+0000 7f521be1a740 4 client.15483 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:55:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.094+0000 7f521be1a740 1 -- 172.21.15.46:0/701916381 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c9ab60640 con 0x559c9a802d80 2024-09-21T03:55:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.094+0000 7f520e59c640 1 --2- 172.21.15.46:0/701916381 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x559c9a802d80 0x559c9ac0b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.095+0000 7f520e59c640 1 --2- 172.21.15.46:0/701916381 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x559c9a802d80 0x559c9ac0b350 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77de14d94adf1692 server_cookie=6ef525ba052ccfd3 in_seq=0 out_seq=0 2024-09-21T03:55:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.095+0000 7f51f5ffb640 10 client.15483 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.096+0000 7f51f5ffb640 1 -- 172.21.15.46:0/701916381 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559c9ab60640 con 0x559c9a802d80 2024-09-21T03:55:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.096+0000 7f51f5ffb640 10 client.15483 handle_command_reply: tid=0 2024-09-21T03:55:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.096+0000 7f521be1a740 1 client.15483 shutdown 2024-09-21T03:55:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.096+0000 7f521be1a740 1 -- 172.21.15.46:0/701916381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c9a8234d0 msgr2=0x559c9abf9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.096+0000 7f521be1a740 1 --2- 172.21.15.46:0/701916381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c9a8234d0 0x559c9abf9970 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f51f8032f80 tx=0x7f51f80314a0 comp rx=0 tx=0).stop 2024-09-21T03:55:17.102 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.096+0000 7f521be1a740 1 -- 172.21.15.46:0/701916381 shutdown_connections 2024-09-21T03:55:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.096+0000 7f521be1a740 1 --2- 172.21.15.46:0/701916381 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x559c9a802d80 0x559c9ac0b350 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.096+0000 7f521be1a740 1 --2- 172.21.15.46:0/701916381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c9a8441b0 0x559c9ac057e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.096+0000 7f51f5ffb640 0 client.15483 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.096+0000 7f521be1a740 1 --2- 172.21.15.46:0/701916381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c9a8234d0 0x559c9abf9970 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.096+0000 7f521be1a740 1 --2- 172.21.15.46:0/701916381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a81b2f0 0x559c9abf9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.096+0000 7f521be1a740 1 -- 172.21.15.46:0/701916381 >> 172.21.15.46:0/701916381 conn(0x559c9a838300 msgr2=0x559c9abeb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.096+0000 7f521be1a740 1 -- 172.21.15.46:0/701916381 shutdown_connections 2024-09-21T03:55:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.096+0000 7f521be1a740 1 -- 172.21.15.46:0/701916381 wait complete. 2024-09-21T03:55:17.103 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.096+0000 7f521be1a740 20 client.15483 trim_cache size 0 max 16384 2024-09-21T03:55:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.111+0000 7f521be1a740 1 Processor -- start 2024-09-21T03:55:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.111+0000 7f521be1a740 1 -- start start 2024-09-21T03:55:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.111+0000 7f521be1a740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c9a81b2f0 0x559c9abf4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.111+0000 7f521be1a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c9a8234d0 0x559c9ac05750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:17.114 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.111+0000 7f521be1a740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a8441b0 0x559c9abe6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:17.115 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.111+0000 7f521be1a740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f52101ab2d0 con 0x559c9a81b2f0 2024-09-21T03:55:17.115 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.111+0000 7f521be1a740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f52101adb50 con 0x559c9a8441b0 2024-09-21T03:55:17.115 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.111+0000 7f521be1a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f52101ab940 con 0x559c9a8234d0 2024-09-21T03:55:17.115 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.111+0000 7f520e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c9a81b2f0 0x559c9abf4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:17.115 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.111+0000 7f520e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c9a81b2f0 0x559c9abf4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52168/0 (socket says 172.21.15.46:52168) 2024-09-21T03:55:17.115 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.111+0000 7f520e59c640 1 -- 172.21.15.46:0/4145157643 learned_addr learned my addr 172.21.15.46:0/4145157643 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:17.115 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.111+0000 7f520dd9b640 1 --2- 172.21.15.46:0/4145157643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c9a8234d0 0x559c9ac05750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:17.115 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.111+0000 7f520ed9d640 1 --2- 172.21.15.46:0/4145157643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a8441b0 0x559c9abe6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:17.115 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.112+0000 7f520e59c640 1 -- 172.21.15.46:0/4145157643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c9a8234d0 msgr2=0x559c9ac05750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:17.115 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.112+0000 7f520e59c640 1 --2- 172.21.15.46:0/4145157643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c9a8234d0 0x559c9ac05750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:17.115 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.112+0000 7f520e59c640 1 -- 172.21.15.46:0/4145157643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a8441b0 msgr2=0x559c9abe6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:17.115 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.112+0000 7f520e59c640 1 --2- 172.21.15.46:0/4145157643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a8441b0 0x559c9abe6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:17.116 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.112+0000 7f520e59c640 1 -- 172.21.15.46:0/4145157643 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c9abec250 con 0x559c9a81b2f0 2024-09-21T03:55:17.116 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.112+0000 7f520ed9d640 1 --2- 172.21.15.46:0/4145157643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a8441b0 0x559c9abe6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:55:17.116 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.112+0000 7f520e59c640 1 --2- 172.21.15.46:0/4145157643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c9a81b2f0 0x559c9abf4ab0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f52080a9ee0 tx=0x7f5208000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aaaa3b7a71bef33 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:17.116 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.112+0000 7f51f7fff640 1 -- 172.21.15.46:0/4145157643 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52080ad260 con 0x559c9a81b2f0 2024-09-21T03:55:17.116 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.112+0000 7f51f7fff640 1 -- 172.21.15.46:0/4145157643 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5208010720 con 0x559c9a81b2f0 2024-09-21T03:55:17.116 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.112+0000 7f51f7fff640 1 -- 172.21.15.46:0/4145157643 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52080a9080 con 0x559c9a81b2f0 2024-09-21T03:55:17.119 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.113+0000 7f521be1a740 1 -- 172.21.15.46:0/4145157643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c9a81b2f0 msgr2=0x559c9abf4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:17.119 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.113+0000 7f521be1a740 1 --2- 172.21.15.46:0/4145157643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c9a81b2f0 0x559c9abf4ab0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f52080a9ee0 tx=0x7f5208000bc0 comp rx=0 tx=0).stop 2024-09-21T03:55:17.119 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.113+0000 7f521be1a740 1 -- 172.21.15.46:0/4145157643 shutdown_connections 2024-09-21T03:55:17.120 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.113+0000 7f521be1a740 1 --2- 172.21.15.46:0/4145157643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a8441b0 0x559c9abe6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:17.120 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.113+0000 7f521be1a740 1 --2- 172.21.15.46:0/4145157643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c9a8234d0 0x559c9ac05750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:17.120 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.113+0000 7f521be1a740 1 --2- 172.21.15.46:0/4145157643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c9a81b2f0 0x559c9abf4ab0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:17.120 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.113+0000 7f521be1a740 1 -- 172.21.15.46:0/4145157643 >> 172.21.15.46:0/4145157643 conn(0x559c9a838300 msgr2=0x559c9abf7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:17.120 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.113+0000 7f521be1a740 1 -- 172.21.15.46:0/4145157643 shutdown_connections 2024-09-21T03:55:17.120 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.113+0000 7f521be1a740 1 -- 172.21.15.46:0/4145157643 wait complete. 2024-09-21T03:55:17.120 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.113+0000 7f521be1a740 1 -- start start 2024-09-21T03:55:17.120 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.113+0000 7f521be1a740 1 Processor -- start 2024-09-21T03:55:17.120 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.114+0000 7f521be1a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c9a81b2f0 0x559c9ac0ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:17.120 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.114+0000 7f521be1a740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c9a8234d0 0x559c9ac0c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:17.120 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.114+0000 7f521be1a740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a8441b0 0x559c9ac0c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:17.120 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.114+0000 7f521be1a740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f52101ac010 con 0x559c9a8234d0 2024-09-21T03:55:17.120 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.114+0000 7f521be1a740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f52101ad480 con 0x559c9a8441b0 2024-09-21T03:55:17.121 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.114+0000 7f521be1a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f52101ac6e0 con 0x559c9a81b2f0 2024-09-21T03:55:17.121 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.114+0000 7f521be1a740 10 client.0 _ll_register_callbacks cb 0x7f5200009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:55:17.121 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.114+0000 7f520dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c9a8234d0 0x559c9ac0c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:17.121 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.114+0000 7f520dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c9a8234d0 0x559c9ac0c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52184/0 (socket says 172.21.15.46:52184) 2024-09-21T03:55:17.121 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.114+0000 7f520dd9b640 1 -- 172.21.15.46:0/2408195792 learned_addr learned my addr 172.21.15.46:0/2408195792 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:17.121 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.114+0000 7f520ed9d640 1 --2- 172.21.15.46:0/2408195792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a8441b0 0x559c9ac0c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:17.121 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.114+0000 7f520e59c640 1 --2- 172.21.15.46:0/2408195792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c9a81b2f0 0x559c9ac0ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:17.121 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.114+0000 7f520dd9b640 1 -- 172.21.15.46:0/2408195792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c9a81b2f0 msgr2=0x559c9ac0ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:17.121 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.114+0000 7f520dd9b640 1 --2- 172.21.15.46:0/2408195792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c9a81b2f0 0x559c9ac0ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:17.121 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.114+0000 7f520dd9b640 1 -- 172.21.15.46:0/2408195792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a8441b0 msgr2=0x559c9ac0c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:17.121 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.114+0000 7f520dd9b640 1 --2- 172.21.15.46:0/2408195792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a8441b0 0x559c9ac0c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:17.121 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.114+0000 7f520dd9b640 1 -- 172.21.15.46:0/2408195792 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c9ac0cf80 con 0x559c9a8234d0 2024-09-21T03:55:17.121 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.114+0000 7f520ed9d640 1 --2- 172.21.15.46:0/2408195792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a8441b0 0x559c9ac0c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:55:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.114+0000 7f520dd9b640 1 --2- 172.21.15.46:0/2408195792 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c9a8234d0 0x559c9ac0c170 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f51f8031440 tx=0x7f51f8005a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=148272dbae7c1e49 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.114+0000 7f51f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:55:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.114+0000 7f51f5ffb640 1 -- 172.21.15.46:0/2408195792 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f804b050 con 0x559c9a8234d0 2024-09-21T03:55:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.114+0000 7f51f5ffb640 1 -- 172.21.15.46:0/2408195792 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f51f8004ce0 con 0x559c9a8234d0 2024-09-21T03:55:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.115+0000 7f521be1a740 1 -- 172.21.15.46:0/2408195792 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559c9ab5c0f0 con 0x559c9a8234d0 2024-09-21T03:55:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.115+0000 7f51f5ffb640 1 -- 172.21.15.46:0/2408195792 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f51f805e020 con 0x559c9a8234d0 2024-09-21T03:55:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.115+0000 7f521be1a740 10 client.15489 fetch_fsmap learned FSMap version 20 2024-09-21T03:55:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.115+0000 7f521be1a740 1 -- 172.21.15.46:0/2408195792 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x559c9ac75ad0 con 0x559c9a8234d0 2024-09-21T03:55:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.115+0000 7f51f5ffb640 1 -- 172.21.15.46:0/2408195792 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x559c9ab5c0f0 con 0x559c9a8234d0 2024-09-21T03:55:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.115+0000 7f51f5ffb640 1 -- 172.21.15.46:0/2408195792 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f51f8004210 con 0x559c9a8234d0 2024-09-21T03:55:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.115+0000 7f521be1a740 10 client.15489 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:55:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.115+0000 7f521be1a740 10 client.15489 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:55:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.115+0000 7f521be1a740 20 client.15489 populate_metadata read hostname 'smithi046' 2024-09-21T03:55:17.123 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.115+0000 7f521be1a740 1 --2- 172.21.15.46:0/2408195792 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x559c9a7d81c0 0x559c9ac781e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:17.123 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.115+0000 7f521be1a740 4 client.15489 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T03:55:17.123 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.115+0000 7f521be1a740 1 -- 172.21.15.46:0/2408195792 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559c9ab59520 con 0x559c9a7d81c0 2024-09-21T03:55:17.123 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.115+0000 7f520e59c640 1 --2- 172.21.15.46:0/2408195792 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x559c9a7d81c0 0x559c9ac781e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:17.123 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.116+0000 7f520e59c640 1 --2- 172.21.15.46:0/2408195792 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x559c9a7d81c0 0x559c9ac781e0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab34cb7101605e78 server_cookie=80be37638d563cdd in_seq=0 out_seq=0 2024-09-21T03:55:17.123 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.116+0000 7f51f5ffb640 10 client.15489 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.127+0000 7f51f5ffb640 1 -- 172.21.15.46:0/2408195792 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559c9ab59520 con 0x559c9a7d81c0 2024-09-21T03:55:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.127+0000 7f51f5ffb640 10 client.15489 handle_command_reply: tid=0 2024-09-21T03:55:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.127+0000 7f521be1a740 1 client.15489 shutdown 2024-09-21T03:55:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.127+0000 7f521be1a740 1 -- 172.21.15.46:0/2408195792 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c9a8234d0 msgr2=0x559c9ac0c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.127+0000 7f521be1a740 1 --2- 172.21.15.46:0/2408195792 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c9a8234d0 0x559c9ac0c170 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f51f8031440 tx=0x7f51f8005a60 comp rx=0 tx=0).stop 2024-09-21T03:55:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.127+0000 7f521be1a740 1 -- 172.21.15.46:0/2408195792 shutdown_connections 2024-09-21T03:55:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.127+0000 7f521be1a740 1 --2- 172.21.15.46:0/2408195792 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x559c9a7d81c0 0x559c9ac781e0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.127+0000 7f521be1a740 1 --2- 172.21.15.46:0/2408195792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a8441b0 0x559c9ac0c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.127+0000 7f51f5ffb640 0 client.15489 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.127+0000 7f521be1a740 1 --2- 172.21.15.46:0/2408195792 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559c9a8234d0 0x559c9ac0c170 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.127+0000 7f521be1a740 1 --2- 172.21.15.46:0/2408195792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559c9a81b2f0 0x559c9ac0ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.127+0000 7f521be1a740 1 -- 172.21.15.46:0/2408195792 >> 172.21.15.46:0/2408195792 conn(0x559c9a838300 msgr2=0x559c9abea9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.127+0000 7f521be1a740 1 -- 172.21.15.46:0/2408195792 shutdown_connections 2024-09-21T03:55:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.128+0000 7f521be1a740 1 -- 172.21.15.46:0/2408195792 wait complete. 2024-09-21T03:55:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.128+0000 7f521be1a740 20 client.15489 trim_cache size 0 max 16384 2024-09-21T03:55:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:{ 2024-09-21T03:55:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "message": "", 2024-09-21T03:55:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "return_code": 0 2024-09-21T03:55:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:} 2024-09-21T03:55:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.128+0000 7f5214dc6640 1 -- 172.21.15.46:0/189287723 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f51fc0b65f0 msgr2=0x7f51fc0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.128+0000 7f5214dc6640 1 --2- 172.21.15.46:0/189287723 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f51fc0b65f0 0x7f51fc0b8b00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5200005c40 tx=0x7f5200004a40 comp rx=0 tx=0).stop 2024-09-21T03:55:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.128+0000 7f5214dc6640 1 -- 172.21.15.46:0/189287723 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5210102090 msgr2=0x7f521019a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.128+0000 7f5214dc6640 1 --2- 172.21.15.46:0/189287723 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5210102090 0x7f521019a4c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f520800e9f0 tx=0x7f520800eeb0 comp rx=0 tx=0).stop 2024-09-21T03:55:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.128+0000 7f5214dc6640 1 -- 172.21.15.46:0/189287723 shutdown_connections 2024-09-21T03:55:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.128+0000 7f5214dc6640 1 --2- 172.21.15.46:0/189287723 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f51fc0b65f0 0x7f51fc0b8b00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.128+0000 7f5214dc6640 1 --2- 172.21.15.46:0/189287723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5210106b50 0x7f521019fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.128+0000 7f5214dc6640 1 --2- 172.21.15.46:0/189287723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5210106200 0x7f521019aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.128+0000 7f5214dc6640 1 --2- 172.21.15.46:0/189287723 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5210102090 0x7f521019a4c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.128+0000 7f5214dc6640 1 -- 172.21.15.46:0/189287723 >> 172.21.15.46:0/189287723 conn(0x7f5210079ec0 msgr2=0x7f5210109650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.128+0000 7f5214dc6640 1 -- 172.21.15.46:0/189287723 shutdown_connections 2024-09-21T03:55:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:17.128+0000 7f5214dc6640 1 -- 172.21.15.46:0/189287723 wait complete. 2024-09-21T03:55:18.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:17 smithi046 ceph-mon[30954]: pgmap v327: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 113 KiB/s wr, 42 op/s 2024-09-21T03:55:18.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:17 smithi105 ceph-mon[34773]: pgmap v327: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 113 KiB/s wr, 42 op/s 2024-09-21T03:55:18.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:17 smithi162 ceph-mon[35071]: pgmap v327: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 113 KiB/s wr, 42 op/s 2024-09-21T03:55:20.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:19 smithi105 ceph-mon[34773]: pgmap v328: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 114 KiB/s wr, 44 op/s 2024-09-21T03:55:20.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:19 smithi162 ceph-mon[35071]: pgmap v328: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 114 KiB/s wr, 44 op/s 2024-09-21T03:55:20.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:19 smithi046 ceph-mon[30954]: pgmap v328: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 114 KiB/s wr, 44 op/s 2024-09-21T03:55:21.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:20 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:55:21.110 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:20 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:55:21.117 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:20 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:55:22.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:21 smithi105 ceph-mon[34773]: pgmap v329: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 767 B/s wr, 3 op/s 2024-09-21T03:55:22.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:21 smithi162 ceph-mon[35071]: pgmap v329: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 767 B/s wr, 3 op/s 2024-09-21T03:55:22.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:21 smithi046 ceph-mon[30954]: pgmap v329: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 767 B/s wr, 3 op/s 2024-09-21T03:55:23.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:22 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:55:23.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:22 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:55:23.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:22 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:55:23.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:22 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:55:23.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:22 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:55:23.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:22 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:55:23.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:22 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:55:23.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:22 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:55:23.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:22 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:55:23.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:22 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:55:23.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:22 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:55:23.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:22 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:55:23.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:22 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:55:23.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:22 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:55:23.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:22 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:55:23.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:22 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:55:23.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:22 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:55:23.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:22 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:55:23.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:22 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:55:23.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:22 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:55:23.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:22 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:55:23.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:22 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:55:23.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:22 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:55:23.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:22 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:55:23.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:22 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:55:23.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:22 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:55:23.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:22 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:55:24.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:23 smithi162 ceph-mon[35071]: pgmap v330: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-21T03:55:24.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:23 smithi046 ceph-mon[30954]: pgmap v330: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-21T03:55:24.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:23 smithi105 ceph-mon[34773]: pgmap v330: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-21T03:55:26.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:25 smithi162 ceph-mon[35071]: pgmap v331: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-21T03:55:26.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:25 smithi046 ceph-mon[30954]: pgmap v331: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-21T03:55:26.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:25 smithi105 ceph-mon[34773]: pgmap v331: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-21T03:55:28.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:27 smithi162 ceph-mon[35071]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-21T03:55:28.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:27 smithi046 ceph-mon[30954]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-21T03:55:28.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:27 smithi105 ceph-mon[34773]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-21T03:55:30.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:29 smithi162 ceph-mon[35071]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-21T03:55:30.236 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.233+0000 7f27078e6640 1 -- 172.21.15.46:0/3629745620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f270010dd80 msgr2=0x7f2700110260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:30.236 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.233+0000 7f27078e6640 1 --2- 172.21.15.46:0/3629745620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f270010dd80 0x7f2700110260 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009ca0 tx=0x7f26f802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:55:30.236 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.233+0000 7f27078e6640 1 -- 172.21.15.46:0/3629745620 shutdown_connections 2024-09-21T03:55:30.236 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.233+0000 7f27078e6640 1 --2- 172.21.15.46:0/3629745620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f270010dd80 0x7f2700110260 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:30.236 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.233+0000 7f27078e6640 1 --2- 172.21.15.46:0/3629745620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27001052b0 0x7f270010d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:30.236 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.233+0000 7f27078e6640 1 --2- 172.21.15.46:0/3629745620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2700104960 0x7f2700104d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:30.236 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.233+0000 7f27078e6640 1 -- 172.21.15.46:0/3629745620 >> 172.21.15.46:0/3629745620 conn(0x7f270007a740 msgr2=0x7f270007ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:30.236 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.233+0000 7f27078e6640 1 -- 172.21.15.46:0/3629745620 shutdown_connections 2024-09-21T03:55:30.236 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.233+0000 7f27078e6640 1 -- 172.21.15.46:0/3629745620 wait complete. 2024-09-21T03:55:30.236 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.234+0000 7f27078e6640 1 Processor -- start 2024-09-21T03:55:30.238 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.234+0000 7f27078e6640 1 -- start start 2024-09-21T03:55:30.238 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.234+0000 7f27078e6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2700104960 0x7f270019a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:30.239 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.234+0000 7f27078e6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27001052b0 0x7f270019a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:30.239 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.234+0000 7f27078e6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f270010dd80 0x7f270019fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:30.239 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.234+0000 7f27078e6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f27001139f0 con 0x7f27001052b0 2024-09-21T03:55:30.239 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.234+0000 7f27078e6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2700113870 con 0x7f2700104960 2024-09-21T03:55:30.239 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.234+0000 7f27078e6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2700113b70 con 0x7f270010dd80 2024-09-21T03:55:30.239 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.234+0000 7f2704e81640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27001052b0 0x7f270019a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:30.239 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.234+0000 7f2704e81640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27001052b0 0x7f270019a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56754/0 (socket says 172.21.15.46:56754) 2024-09-21T03:55:30.239 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.234+0000 7f2704e81640 1 -- 172.21.15.46:0/2903464056 learned_addr learned my addr 172.21.15.46:0/2903464056 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:30.239 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.235+0000 7f2705682640 1 --2- 172.21.15.46:0/2903464056 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2700104960 0x7f270019a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:30.239 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.235+0000 7f2705e83640 1 --2- 172.21.15.46:0/2903464056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f270010dd80 0x7f270019fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:30.239 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.235+0000 7f2704e81640 1 -- 172.21.15.46:0/2903464056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f270010dd80 msgr2=0x7f270019fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:30.240 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.235+0000 7f2704e81640 1 --2- 172.21.15.46:0/2903464056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f270010dd80 0x7f270019fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:30.240 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.235+0000 7f2704e81640 1 -- 172.21.15.46:0/2903464056 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2700104960 msgr2=0x7f270019a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:30.240 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.235+0000 7f2704e81640 1 --2- 172.21.15.46:0/2903464056 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2700104960 0x7f270019a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:30.240 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.235+0000 7f2704e81640 1 -- 172.21.15.46:0/2903464056 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27001a0360 con 0x7f27001052b0 2024-09-21T03:55:30.240 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.235+0000 7f2704e81640 1 --2- 172.21.15.46:0/2903464056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27001052b0 0x7f270019a9d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f26f000d750 tx=0x7f26f000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:30.240 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.235+0000 7f26f67fc640 1 -- 172.21.15.46:0/2903464056 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f0017070 con 0x7f27001052b0 2024-09-21T03:55:30.240 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.235+0000 7f26f67fc640 1 -- 172.21.15.46:0/2903464056 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26f00054d0 con 0x7f27001052b0 2024-09-21T03:55:30.240 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.235+0000 7f26f67fc640 1 -- 172.21.15.46:0/2903464056 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f0004c30 con 0x7f27001052b0 2024-09-21T03:55:30.240 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.235+0000 7f27078e6640 1 -- 172.21.15.46:0/2903464056 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27001a0650 con 0x7f27001052b0 2024-09-21T03:55:30.240 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.235+0000 7f27078e6640 1 -- 172.21.15.46:0/2903464056 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27001a6de0 con 0x7f27001052b0 2024-09-21T03:55:30.243 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.238+0000 7f270e854740 1 Processor -- start 2024-09-21T03:55:30.244 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.238+0000 7f270e854740 1 -- start start 2024-09-21T03:55:30.244 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.238+0000 7f270e854740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e9e12d1b0 0x560e9e4d29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:30.244 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.238+0000 7f270e854740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e9e1042f0 0x560e9e4d2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:30.244 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.238+0000 7f270e854740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e9e10c4d0 0x560e9e4d3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:30.244 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.238+0000 7f270e854740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x560e9e4476f0 con 0x560e9e1042f0 2024-09-21T03:55:30.244 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.238+0000 7f270e854740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x560e9e436b20 con 0x560e9e12d1b0 2024-09-21T03:55:30.244 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.238+0000 7f270e854740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560e9e43a930 con 0x560e9e10c4d0 2024-09-21T03:55:30.244 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.239+0000 7f26f67fc640 1 -- 172.21.15.46:0/2903464056 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 22) ==== 154586+0+0 (secure 0 0 0) 0x7f26f0004dd0 con 0x7f27001052b0 2024-09-21T03:55:30.244 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.239+0000 7f2705682640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e9e1042f0 0x560e9e4d2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:30.244 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.239+0000 7f2705682640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e9e1042f0 0x560e9e4d2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56764/0 (socket says 172.21.15.46:56764) 2024-09-21T03:55:30.245 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.239+0000 7f2705682640 1 -- 172.21.15.46:0/1186827372 learned_addr learned my addr 172.21.15.46:0/1186827372 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:30.245 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.239+0000 7f2705e83640 1 --2- 172.21.15.46:0/1186827372 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e9e12d1b0 0x560e9e4d29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:30.245 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.239+0000 7f2704e81640 1 --2- 172.21.15.46:0/1186827372 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e9e10c4d0 0x560e9e4d3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:30.245 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.239+0000 7f2705682640 1 -- 172.21.15.46:0/1186827372 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e9e10c4d0 msgr2=0x560e9e4d3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:30.245 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.239+0000 7f2705682640 1 --2- 172.21.15.46:0/1186827372 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e9e10c4d0 0x560e9e4d3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:30.245 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.239+0000 7f2705682640 1 -- 172.21.15.46:0/1186827372 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e9e12d1b0 msgr2=0x560e9e4d29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:30.245 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.239+0000 7f2705682640 1 --2- 172.21.15.46:0/1186827372 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e9e12d1b0 0x560e9e4d29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:30.245 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.239+0000 7f2705682640 1 -- 172.21.15.46:0/1186827372 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e9e3fc530 con 0x560e9e1042f0 2024-09-21T03:55:30.245 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.239+0000 7f2705682640 1 --2- 172.21.15.46:0/1186827372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e9e1042f0 0x560e9e4d2ef0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f26fc00bd10 tx=0x7f26fc00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f762a5ff00dcd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:30.245 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.240+0000 7f26eb7fe640 1 -- 172.21.15.46:0/1186827372 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26fc015070 con 0x560e9e1042f0 2024-09-21T03:55:30.245 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.240+0000 7f26eb7fe640 1 -- 172.21.15.46:0/1186827372 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26fc01a910 con 0x560e9e1042f0 2024-09-21T03:55:30.245 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.240+0000 7f26eb7fe640 1 -- 172.21.15.46:0/1186827372 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26fc011980 con 0x560e9e1042f0 2024-09-21T03:55:30.245 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.240+0000 7f26f67fc640 1 --2- 172.21.15.46:0/2903464056 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f26ec0b65f0 0x7f26ec0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:30.246 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.240+0000 7f2705e83640 1 --2- 172.21.15.46:0/2903464056 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f26ec0b65f0 0x7f26ec0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:30.246 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.240+0000 7f26f67fc640 1 -- 172.21.15.46:0/2903464056 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f26f00e7010 con 0x7f27001052b0 2024-09-21T03:55:30.246 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.241+0000 7f270e854740 1 -- 172.21.15.46:0/1186827372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e9e1042f0 msgr2=0x560e9e4d2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:30.246 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.241+0000 7f2705e83640 1 --2- 172.21.15.46:0/2903464056 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f26ec0b65f0 0x7f26ec0b8b00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f26f8006010 tx=0x7f26f8009440 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:30.246 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.241+0000 7f270e854740 1 --2- 172.21.15.46:0/1186827372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e9e1042f0 0x560e9e4d2ef0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f26fc00bd10 tx=0x7f26fc00f730 comp rx=0 tx=0).stop 2024-09-21T03:55:30.246 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.241+0000 7f270e854740 1 -- 172.21.15.46:0/1186827372 shutdown_connections 2024-09-21T03:55:30.246 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.241+0000 7f270e854740 1 --2- 172.21.15.46:0/1186827372 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e9e10c4d0 0x560e9e4d3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:30.246 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.241+0000 7f270e854740 1 --2- 172.21.15.46:0/1186827372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e9e1042f0 0x560e9e4d2ef0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:30.246 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.241+0000 7f270e854740 1 --2- 172.21.15.46:0/1186827372 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e9e12d1b0 0x560e9e4d29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:30.246 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.241+0000 7f270e854740 1 -- 172.21.15.46:0/1186827372 >> 172.21.15.46:0/1186827372 conn(0x560e9e121300 msgr2=0x560e9e4d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:30.246 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.241+0000 7f270e854740 1 -- 172.21.15.46:0/1186827372 shutdown_connections 2024-09-21T03:55:30.246 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.241+0000 7f270e854740 1 -- 172.21.15.46:0/1186827372 wait complete. 2024-09-21T03:55:30.246 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.241+0000 7f270e854740 1 -- start start 2024-09-21T03:55:30.247 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.242+0000 7f270e854740 1 Processor -- start 2024-09-21T03:55:30.250 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.242+0000 7f270e854740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e9e1042f0 0x560e9e4e24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:30.250 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.242+0000 7f270e854740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e9e10c4d0 0x560e9e4e29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:30.250 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.242+0000 7f270e854740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e9e12d1b0 0x560e9e4ee870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:30.250 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.242+0000 7f270e854740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x560e9e36eab0 con 0x560e9e10c4d0 2024-09-21T03:55:30.250 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.242+0000 7f270e854740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x560e9e3dc730 con 0x560e9e12d1b0 2024-09-21T03:55:30.250 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.242+0000 7f270e854740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560e9e4e5510 con 0x560e9e1042f0 2024-09-21T03:55:30.250 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.242+0000 7f270e854740 10 client.0 _ll_register_callbacks cb 0x560e9e4306b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:55:30.250 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.242+0000 7f2704e81640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e9e10c4d0 0x560e9e4e29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.242+0000 7f2704e81640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e9e10c4d0 0x560e9e4e29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56776/0 (socket says 172.21.15.46:56776) 2024-09-21T03:55:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.242+0000 7f2704e81640 1 -- 172.21.15.46:0/2644561791 learned_addr learned my addr 172.21.15.46:0/2644561791 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.242+0000 7f2705682640 1 --2- 172.21.15.46:0/2644561791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e9e1042f0 0x560e9e4e24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.243+0000 7f2705e83640 1 --2- 172.21.15.46:0/2644561791 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e9e12d1b0 0x560e9e4ee870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.243+0000 7f2704e81640 1 -- 172.21.15.46:0/2644561791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e9e1042f0 msgr2=0x560e9e4e24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.243+0000 7f2704e81640 1 --2- 172.21.15.46:0/2644561791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e9e1042f0 0x560e9e4e24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.243+0000 7f2704e81640 1 -- 172.21.15.46:0/2644561791 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e9e12d1b0 msgr2=0x560e9e4ee870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.243+0000 7f2704e81640 1 --2- 172.21.15.46:0/2644561791 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e9e12d1b0 0x560e9e4ee870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.243+0000 7f2704e81640 1 -- 172.21.15.46:0/2644561791 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e9e198790 con 0x560e9e10c4d0 2024-09-21T03:55:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.243+0000 7f2704e81640 1 --2- 172.21.15.46:0/2644561791 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e9e10c4d0 0x560e9e4e29e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f26f00acf50 tx=0x7f26f00ace50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64660ddf3e9aceb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.243+0000 7f26e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:55:30.252 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.243+0000 7f26e8ff9640 1 -- 172.21.15.46:0/2644561791 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f0020070 con 0x560e9e10c4d0 2024-09-21T03:55:30.252 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.243+0000 7f26e8ff9640 1 -- 172.21.15.46:0/2644561791 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f26f00e90d0 con 0x560e9e10c4d0 2024-09-21T03:55:30.252 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.243+0000 7f270e854740 1 -- 172.21.15.46:0/2644561791 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26fc01a910 con 0x560e9e10c4d0 2024-09-21T03:55:30.252 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.243+0000 7f26e8ff9640 1 -- 172.21.15.46:0/2644561791 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f26f00e92d0 con 0x560e9e10c4d0 2024-09-21T03:55:30.252 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.243+0000 7f270e854740 10 client.15501 fetch_fsmap learned FSMap version 20 2024-09-21T03:55:30.252 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.243+0000 7f270e854740 1 -- 172.21.15.46:0/2644561791 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560e9e211620 con 0x560e9e10c4d0 2024-09-21T03:55:30.252 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.244+0000 7f26e8ff9640 1 -- 172.21.15.46:0/2644561791 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26fc01a910 con 0x560e9e10c4d0 2024-09-21T03:55:30.252 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.244+0000 7f26e8ff9640 1 -- 172.21.15.46:0/2644561791 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f26f00af020 con 0x560e9e10c4d0 2024-09-21T03:55:30.252 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.244+0000 7f270e854740 10 client.15501 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:55:30.252 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.244+0000 7f270e854740 10 client.15501 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:55:30.252 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.244+0000 7f270e854740 20 client.15501 populate_metadata read hostname 'smithi046' 2024-09-21T03:55:30.252 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.244+0000 7f270e854740 1 --2- 172.21.15.46:0/2644561791 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560e9e0ebd80 0x560e9e4f4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:30.253 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.244+0000 7f270e854740 4 client.15501 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:55:30.253 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.244+0000 7f270e854740 1 -- 172.21.15.46:0/2644561791 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e9e449640 con 0x560e9e0ebd80 2024-09-21T03:55:30.253 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.244+0000 7f2705682640 1 --2- 172.21.15.46:0/2644561791 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560e9e0ebd80 0x560e9e4f4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:30.253 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.245+0000 7f2705682640 1 --2- 172.21.15.46:0/2644561791 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560e9e0ebd80 0x560e9e4f4610 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abf09dbdd44ba45 server_cookie=8a5e91a563e023d1 in_seq=0 out_seq=0 2024-09-21T03:55:30.253 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.245+0000 7f26e8ff9640 10 client.15501 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:30.253 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.245+0000 7f26e8ff9640 1 -- 172.21.15.46:0/2644561791 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560e9e449640 con 0x560e9e0ebd80 2024-09-21T03:55:30.253 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.245+0000 7f26e8ff9640 10 client.15501 handle_command_reply: tid=0 2024-09-21T03:55:30.253 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.246+0000 7f270e854740 1 client.15501 shutdown 2024-09-21T03:55:30.253 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.246+0000 7f270e854740 1 -- 172.21.15.46:0/2644561791 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e9e10c4d0 msgr2=0x560e9e4e29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:30.253 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.246+0000 7f270e854740 1 --2- 172.21.15.46:0/2644561791 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e9e10c4d0 0x560e9e4e29e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f26f00acf50 tx=0x7f26f00ace50 comp rx=0 tx=0).stop 2024-09-21T03:55:30.253 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.246+0000 7f270e854740 1 -- 172.21.15.46:0/2644561791 shutdown_connections 2024-09-21T03:55:30.253 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.246+0000 7f270e854740 1 --2- 172.21.15.46:0/2644561791 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560e9e0ebd80 0x560e9e4f4610 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:30.253 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.246+0000 7f270e854740 1 --2- 172.21.15.46:0/2644561791 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e9e12d1b0 0x560e9e4ee870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:30.254 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.246+0000 7f26e8ff9640 0 client.15501 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:30.254 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.246+0000 7f270e854740 1 --2- 172.21.15.46:0/2644561791 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e9e10c4d0 0x560e9e4e29e0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:30.254 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.246+0000 7f270e854740 1 --2- 172.21.15.46:0/2644561791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e9e1042f0 0x560e9e4e24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:30.254 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.246+0000 7f270e854740 1 -- 172.21.15.46:0/2644561791 >> 172.21.15.46:0/2644561791 conn(0x560e9e121300 msgr2=0x560e9e4d43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:30.254 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.246+0000 7f270e854740 1 -- 172.21.15.46:0/2644561791 shutdown_connections 2024-09-21T03:55:30.254 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.246+0000 7f270e854740 1 -- 172.21.15.46:0/2644561791 wait complete. 2024-09-21T03:55:30.254 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.246+0000 7f270e854740 20 client.15501 trim_cache size 0 max 16384 2024-09-21T03:55:30.254 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:29 smithi046 ceph-mon[30954]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-21T03:55:30.280 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.276+0000 7f270e854740 1 Processor -- start 2024-09-21T03:55:30.280 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.276+0000 7f270e854740 1 -- start start 2024-09-21T03:55:30.280 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.277+0000 7f270e854740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e9e1042f0 0x560e9e4d40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:30.280 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.277+0000 7f270e854740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e9e10c4d0 0x560e9e4ee770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.277+0000 7f270e854740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e9e12d1b0 0x560e9e4df670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.277+0000 7f270e854740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f27001ab340 con 0x560e9e1042f0 2024-09-21T03:55:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.277+0000 7f270e854740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f27001adbc0 con 0x560e9e12d1b0 2024-09-21T03:55:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.277+0000 7f270e854740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f27001ab9b0 con 0x560e9e10c4d0 2024-09-21T03:55:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.277+0000 7f2705682640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e9e1042f0 0x560e9e4d40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.277+0000 7f2705682640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e9e1042f0 0x560e9e4d40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56782/0 (socket says 172.21.15.46:56782) 2024-09-21T03:55:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.277+0000 7f2705682640 1 -- 172.21.15.46:0/773620288 learned_addr learned my addr 172.21.15.46:0/773620288 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.277+0000 7f2704e81640 1 --2- 172.21.15.46:0/773620288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e9e10c4d0 0x560e9e4ee770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.277+0000 7f2705e83640 1 --2- 172.21.15.46:0/773620288 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e9e12d1b0 0x560e9e4df670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.277+0000 7f2705682640 1 -- 172.21.15.46:0/773620288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e9e10c4d0 msgr2=0x560e9e4ee770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.277+0000 7f2705682640 1 --2- 172.21.15.46:0/773620288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e9e10c4d0 0x560e9e4ee770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.277+0000 7f2705682640 1 -- 172.21.15.46:0/773620288 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e9e12d1b0 msgr2=0x560e9e4df670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:30.281 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.277+0000 7f2705682640 1 --2- 172.21.15.46:0/773620288 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e9e12d1b0 0x560e9e4df670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.277+0000 7f2705682640 1 -- 172.21.15.46:0/773620288 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e9e4f4980 con 0x560e9e1042f0 2024-09-21T03:55:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.277+0000 7f2705e83640 1 --2- 172.21.15.46:0/773620288 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e9e12d1b0 0x560e9e4df670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:55:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.277+0000 7f2705682640 1 --2- 172.21.15.46:0/773620288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e9e1042f0 0x560e9e4d40f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x560e9e4d1630 tx=0x7f26fc011620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d6e9e80fd1830e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.278+0000 7f26eaffd640 1 -- 172.21.15.46:0/773620288 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26fc015040 con 0x560e9e1042f0 2024-09-21T03:55:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.278+0000 7f26eaffd640 1 -- 172.21.15.46:0/773620288 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26fc005580 con 0x560e9e1042f0 2024-09-21T03:55:30.282 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.278+0000 7f26eaffd640 1 -- 172.21.15.46:0/773620288 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26fc0048e0 con 0x560e9e1042f0 2024-09-21T03:55:30.285 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.279+0000 7f270e854740 1 -- 172.21.15.46:0/773620288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e9e1042f0 msgr2=0x560e9e4d40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:30.285 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.279+0000 7f270e854740 1 --2- 172.21.15.46:0/773620288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e9e1042f0 0x560e9e4d40f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x560e9e4d1630 tx=0x7f26fc011620 comp rx=0 tx=0).stop 2024-09-21T03:55:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.279+0000 7f270e854740 1 -- 172.21.15.46:0/773620288 shutdown_connections 2024-09-21T03:55:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.279+0000 7f270e854740 1 --2- 172.21.15.46:0/773620288 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e9e12d1b0 0x560e9e4df670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.279+0000 7f270e854740 1 --2- 172.21.15.46:0/773620288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e9e10c4d0 0x560e9e4ee770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.279+0000 7f270e854740 1 --2- 172.21.15.46:0/773620288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e9e1042f0 0x560e9e4d40f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.279+0000 7f270e854740 1 -- 172.21.15.46:0/773620288 >> 172.21.15.46:0/773620288 conn(0x560e9e121300 msgr2=0x560e9e4d39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.279+0000 7f270e854740 1 -- 172.21.15.46:0/773620288 shutdown_connections 2024-09-21T03:55:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.279+0000 7f270e854740 1 -- 172.21.15.46:0/773620288 wait complete. 2024-09-21T03:55:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.279+0000 7f270e854740 1 -- start start 2024-09-21T03:55:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.280+0000 7f270e854740 1 Processor -- start 2024-09-21T03:55:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.280+0000 7f270e854740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e9e1042f0 0x560e9e4e6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.280+0000 7f270e854740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e9e10c4d0 0x560e9e4e6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:30.286 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.280+0000 7f270e854740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e9e12d1b0 0x560e9e4e71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:30.287 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.280+0000 7f270e854740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f27001ac080 con 0x560e9e1042f0 2024-09-21T03:55:30.287 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.280+0000 7f270e854740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f27001ad4f0 con 0x560e9e10c4d0 2024-09-21T03:55:30.287 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.280+0000 7f270e854740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f27001ac750 con 0x560e9e12d1b0 2024-09-21T03:55:30.287 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.280+0000 7f270e854740 10 client.0 _ll_register_callbacks cb 0x7f26f000d6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:55:30.287 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.280+0000 7f2705682640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e9e1042f0 0x560e9e4e6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:30.287 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.280+0000 7f2705682640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e9e1042f0 0x560e9e4e6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56792/0 (socket says 172.21.15.46:56792) 2024-09-21T03:55:30.287 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.280+0000 7f2705682640 1 -- 172.21.15.46:0/890778743 learned_addr learned my addr 172.21.15.46:0/890778743 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:30.287 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.281+0000 7f2705e83640 1 --2- 172.21.15.46:0/890778743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e9e12d1b0 0x560e9e4e71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:30.287 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.281+0000 7f2704e81640 1 --2- 172.21.15.46:0/890778743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e9e10c4d0 0x560e9e4e6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:30.287 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.281+0000 7f2705682640 1 -- 172.21.15.46:0/890778743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e9e12d1b0 msgr2=0x560e9e4e71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:30.287 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.281+0000 7f2705682640 1 --2- 172.21.15.46:0/890778743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e9e12d1b0 0x560e9e4e71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:30.288 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.281+0000 7f2705682640 1 -- 172.21.15.46:0/890778743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e9e10c4d0 msgr2=0x560e9e4e6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:30.288 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.281+0000 7f2705682640 1 --2- 172.21.15.46:0/890778743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e9e10c4d0 0x560e9e4e6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:30.288 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.281+0000 7f2705682640 1 -- 172.21.15.46:0/890778743 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e9e55df80 con 0x560e9e1042f0 2024-09-21T03:55:30.288 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.281+0000 7f2705682640 1 --2- 172.21.15.46:0/890778743 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e9e1042f0 0x560e9e4e6730 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f26fc00f770 tx=0x7f26fc011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6ddd563c0555835 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:30.288 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.281+0000 7f26e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:55:30.288 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.281+0000 7f26e8ff9640 1 -- 172.21.15.46:0/890778743 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26fc03b060 con 0x560e9e1042f0 2024-09-21T03:55:30.288 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.281+0000 7f26e8ff9640 1 -- 172.21.15.46:0/890778743 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f26fc00b2c0 con 0x560e9e1042f0 2024-09-21T03:55:30.288 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.281+0000 7f270e854740 1 -- 172.21.15.46:0/890778743 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26fc005580 con 0x560e9e1042f0 2024-09-21T03:55:30.288 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.281+0000 7f26e8ff9640 1 -- 172.21.15.46:0/890778743 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f26fc015070 con 0x560e9e1042f0 2024-09-21T03:55:30.288 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.281+0000 7f270e854740 10 client.15507 fetch_fsmap learned FSMap version 20 2024-09-21T03:55:30.288 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.281+0000 7f270e854740 1 -- 172.21.15.46:0/890778743 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560e9e55f110 con 0x560e9e1042f0 2024-09-21T03:55:30.288 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.282+0000 7f26e8ff9640 1 -- 172.21.15.46:0/890778743 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26fc005580 con 0x560e9e1042f0 2024-09-21T03:55:30.288 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.282+0000 7f26e8ff9640 1 -- 172.21.15.46:0/890778743 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f26fc004c00 con 0x560e9e1042f0 2024-09-21T03:55:30.288 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.282+0000 7f270e854740 10 client.15507 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:55:30.289 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.282+0000 7f270e854740 10 client.15507 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:55:30.289 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.282+0000 7f270e854740 20 client.15507 populate_metadata read hostname 'smithi046' 2024-09-21T03:55:30.289 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.282+0000 7f270e854740 1 --2- 172.21.15.46:0/890778743 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560e9e0c11c0 0x560e9e561670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:30.289 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.282+0000 7f270e854740 4 client.15507 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T03:55:30.289 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.282+0000 7f270e854740 1 -- 172.21.15.46:0/890778743 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560e9e4e4e10 con 0x560e9e0c11c0 2024-09-21T03:55:30.289 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.282+0000 7f2704e81640 1 --2- 172.21.15.46:0/890778743 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560e9e0c11c0 0x560e9e561670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:30.289 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.283+0000 7f2704e81640 1 --2- 172.21.15.46:0/890778743 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560e9e0c11c0 0x560e9e561670 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3e46204de2faa29 server_cookie=7c637f8adf08c704 in_seq=0 out_seq=0 2024-09-21T03:55:30.289 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.283+0000 7f26e8ff9640 10 client.15507 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:30.291 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.289+0000 7f26e8ff9640 1 -- 172.21.15.46:0/890778743 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560e9e4e4e10 con 0x560e9e0c11c0 2024-09-21T03:55:30.292 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.289+0000 7f26e8ff9640 10 client.15507 handle_command_reply: tid=0 2024-09-21T03:55:30.292 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.289+0000 7f270e854740 1 client.15507 shutdown 2024-09-21T03:55:30.292 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.289+0000 7f270e854740 1 -- 172.21.15.46:0/890778743 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e9e1042f0 msgr2=0x560e9e4e6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:30.292 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.289+0000 7f270e854740 1 --2- 172.21.15.46:0/890778743 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e9e1042f0 0x560e9e4e6730 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f26fc00f770 tx=0x7f26fc011440 comp rx=0 tx=0).stop 2024-09-21T03:55:30.292 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.289+0000 7f270e854740 1 -- 172.21.15.46:0/890778743 shutdown_connections 2024-09-21T03:55:30.292 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.289+0000 7f270e854740 1 --2- 172.21.15.46:0/890778743 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560e9e0c11c0 0x560e9e561670 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:30.292 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.289+0000 7f270e854740 1 --2- 172.21.15.46:0/890778743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e9e12d1b0 0x560e9e4e71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:30.292 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.289+0000 7f270e854740 1 --2- 172.21.15.46:0/890778743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e9e10c4d0 0x560e9e4e6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:30.292 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.289+0000 7f26e8ff9640 0 client.15507 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:30.292 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.289+0000 7f270e854740 1 --2- 172.21.15.46:0/890778743 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e9e1042f0 0x560e9e4e6730 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:30.292 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.289+0000 7f270e854740 1 -- 172.21.15.46:0/890778743 >> 172.21.15.46:0/890778743 conn(0x560e9e121300 msgr2=0x560e9e4ceea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.289+0000 7f270e854740 1 -- 172.21.15.46:0/890778743 shutdown_connections 2024-09-21T03:55:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.289+0000 7f270e854740 1 -- 172.21.15.46:0/890778743 wait complete. 2024-09-21T03:55:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.289+0000 7f270e854740 20 client.15507 trim_cache size 0 max 16384 2024-09-21T03:55:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:{ 2024-09-21T03:55:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "message": "", 2024-09-21T03:55:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "return_code": 0 2024-09-21T03:55:30.293 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:} 2024-09-21T03:55:30.294 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.290+0000 7f27078e6640 1 -- 172.21.15.46:0/2903464056 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f26ec0b65f0 msgr2=0x7f26ec0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:30.294 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.290+0000 7f27078e6640 1 --2- 172.21.15.46:0/2903464056 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f26ec0b65f0 0x7f26ec0b8b00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f26f8006010 tx=0x7f26f8009440 comp rx=0 tx=0).stop 2024-09-21T03:55:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.290+0000 7f27078e6640 1 -- 172.21.15.46:0/2903464056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27001052b0 msgr2=0x7f270019a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.290+0000 7f27078e6640 1 --2- 172.21.15.46:0/2903464056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27001052b0 0x7f270019a9d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f26f000d750 tx=0x7f26f000dc10 comp rx=0 tx=0).stop 2024-09-21T03:55:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.290+0000 7f27078e6640 1 -- 172.21.15.46:0/2903464056 shutdown_connections 2024-09-21T03:55:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.290+0000 7f27078e6640 1 --2- 172.21.15.46:0/2903464056 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f26ec0b65f0 0x7f26ec0b8b00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.290+0000 7f27078e6640 1 --2- 172.21.15.46:0/2903464056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f270010dd80 0x7f270019fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.290+0000 7f27078e6640 1 --2- 172.21.15.46:0/2903464056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27001052b0 0x7f270019a9d0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.290+0000 7f27078e6640 1 --2- 172.21.15.46:0/2903464056 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2700104960 0x7f270019a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.290+0000 7f27078e6640 1 -- 172.21.15.46:0/2903464056 >> 172.21.15.46:0/2903464056 conn(0x7f270007a740 msgr2=0x7f2700107840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.290+0000 7f27078e6640 1 -- 172.21.15.46:0/2903464056 shutdown_connections 2024-09-21T03:55:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:30.290+0000 7f27078e6640 1 -- 172.21.15.46:0/2903464056 wait complete. 2024-09-21T03:55:30.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:29 smithi105 ceph-mon[34773]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-21T03:55:32.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:31 smithi162 ceph-mon[35071]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 682 B/s wr, 4 op/s 2024-09-21T03:55:32.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:31 smithi046 ceph-mon[30954]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 682 B/s wr, 4 op/s 2024-09-21T03:55:32.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:31 smithi105 ceph-mon[34773]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 682 B/s wr, 4 op/s 2024-09-21T03:55:34.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:33 smithi162 ceph-mon[35071]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 682 B/s wr, 4 op/s 2024-09-21T03:55:34.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:33 smithi046 ceph-mon[30954]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 682 B/s wr, 4 op/s 2024-09-21T03:55:34.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:33 smithi105 ceph-mon[34773]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 682 B/s wr, 4 op/s 2024-09-21T03:55:36.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:35 smithi162 ceph-mon[35071]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T03:55:36.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:35 smithi046 ceph-mon[30954]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T03:55:36.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:35 smithi105 ceph-mon[34773]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T03:55:38.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:37 smithi162 ceph-mon[35071]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T03:55:38.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:37 smithi046 ceph-mon[30954]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T03:55:38.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:37 smithi105 ceph-mon[34773]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T03:55:40.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:39 smithi046 ceph-mon[30954]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T03:55:40.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:39 smithi105 ceph-mon[34773]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T03:55:40.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:39 smithi162 ceph-mon[35071]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T03:55:41.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:40 smithi046 ceph-mon[30954]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T03:55:41.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:40 smithi105 ceph-mon[34773]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T03:55:41.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:40 smithi162 ceph-mon[35071]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T03:55:43.134 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:55:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.418+0000 7fa1ff59e640 1 -- 172.21.15.46:0/3959307503 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1f809bab0 msgr2=0x7fa1f809bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.418+0000 7fa1ff59e640 1 --2- 172.21.15.46:0/3959307503 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1f809bab0 0x7fa1f809bec0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4009900 tx=0x7fa1f402a410 comp rx=0 tx=0).stop 2024-09-21T03:55:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.418+0000 7fa1ff59e640 1 -- 172.21.15.46:0/3959307503 shutdown_connections 2024-09-21T03:55:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.418+0000 7fa1ff59e640 1 --2- 172.21.15.46:0/3959307503 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1f809c400 0x7fa1f80a2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.418+0000 7fa1ff59e640 1 --2- 172.21.15.46:0/3959307503 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1f809bab0 0x7fa1f809bec0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.418+0000 7fa1ff59e640 1 --2- 172.21.15.46:0/3959307503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1f80946e0 0x7fa1f8094af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.418+0000 7fa1ff59e640 1 -- 172.21.15.46:0/3959307503 >> 172.21.15.46:0/3959307503 conn(0x7fa1f800c510 msgr2=0x7fa1f800c920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.419+0000 7fa1ff59e640 1 -- 172.21.15.46:0/3959307503 shutdown_connections 2024-09-21T03:55:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.419+0000 7fa1ff59e640 1 -- 172.21.15.46:0/3959307503 wait complete. 2024-09-21T03:55:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.420+0000 7fa1ff59e640 1 Processor -- start 2024-09-21T03:55:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.420+0000 7fa1ff59e640 1 -- start start 2024-09-21T03:55:43.423 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.421+0000 7fa1ff59e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1f80946e0 0x7fa1f812cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:43.423 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.421+0000 7fa1ff59e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1f809bab0 0x7fa1f812d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:43.423 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.421+0000 7fa1ff59e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1f809c400 0x7fa1f8132310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:43.423 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.421+0000 7fa1fdd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1f809bab0 0x7fa1f812d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:43.424 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.421+0000 7fa1fdd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1f809bab0 0x7fa1f812d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43886/0 (socket says 172.21.15.46:43886) 2024-09-21T03:55:43.424 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.421+0000 7fa1fe59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1f80946e0 0x7fa1f812cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:43.424 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.421+0000 7fa1fdd9b640 1 -- 172.21.15.46:0/519649124 learned_addr learned my addr 172.21.15.46:0/519649124 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:43.424 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.421+0000 7fa1ff59e640 1 -- 172.21.15.46:0/519649124 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f80a60c0 con 0x7fa1f809bab0 2024-09-21T03:55:43.424 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.421+0000 7fa1ff59e640 1 -- 172.21.15.46:0/519649124 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f80a5f40 con 0x7fa1f80946e0 2024-09-21T03:55:43.424 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.421+0000 7fa1ff59e640 1 -- 172.21.15.46:0/519649124 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f80a6240 con 0x7fa1f809c400 2024-09-21T03:55:43.424 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.421+0000 7fa1fed9d640 1 --2- 172.21.15.46:0/519649124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1f809c400 0x7fa1f8132310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:43.425 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.422+0000 7fa1fe59c640 1 -- 172.21.15.46:0/519649124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1f809c400 msgr2=0x7fa1f8132310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:43.425 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.422+0000 7fa1fe59c640 1 --2- 172.21.15.46:0/519649124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1f809c400 0x7fa1f8132310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.425 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.422+0000 7fa1fe59c640 1 -- 172.21.15.46:0/519649124 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1f809bab0 msgr2=0x7fa1f812d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:43.425 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.422+0000 7fa1fe59c640 1 --2- 172.21.15.46:0/519649124 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1f809bab0 0x7fa1f812d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.425 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.422+0000 7fa1fe59c640 1 -- 172.21.15.46:0/519649124 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f8132980 con 0x7fa1f80946e0 2024-09-21T03:55:43.425 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.422+0000 7fa1fdd9b640 1 --2- 172.21.15.46:0/519649124 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1f809bab0 0x7fa1f812d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:55:43.425 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.422+0000 7fa1fe59c640 1 --2- 172.21.15.46:0/519649124 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1f80946e0 0x7fa1f812cae0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa1f000c970 tx=0x7fa1f000ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:43.425 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.423+0000 7fa1ef7fe640 1 -- 172.21.15.46:0/519649124 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0007bb0 con 0x7fa1f80946e0 2024-09-21T03:55:43.425 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.423+0000 7fa1ef7fe640 1 -- 172.21.15.46:0/519649124 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1f0007d50 con 0x7fa1f80946e0 2024-09-21T03:55:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.423+0000 7fa1ef7fe640 1 -- 172.21.15.46:0/519649124 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0018780 con 0x7fa1f80946e0 2024-09-21T03:55:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.423+0000 7fa1ff59e640 1 -- 172.21.15.46:0/519649124 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1f8132c70 con 0x7fa1f80946e0 2024-09-21T03:55:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.423+0000 7fa1ff59e640 1 -- 172.21.15.46:0/519649124 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1f81330e0 con 0x7fa1f80946e0 2024-09-21T03:55:43.429 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.427+0000 7fa20bc3f740 1 Processor -- start 2024-09-21T03:55:43.429 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.427+0000 7fa20bc3f740 1 -- start start 2024-09-21T03:55:43.429 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.427+0000 7fa20bc3f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f860a511b0 0x55f860df6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.427+0000 7fa1ef7fe640 1 -- 172.21.15.46:0/519649124 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 22) ==== 154586+0+0 (secure 0 0 0) 0x7fa1f000f450 con 0x7fa1f80946e0 2024-09-21T03:55:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.427+0000 7fa20bc3f740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f860a282f0 0x55f860df70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.427+0000 7fa20bc3f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f860a304d0 0x55f860df7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.427+0000 7fa20bc3f740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55f860d6b6f0 con 0x55f860a282f0 2024-09-21T03:55:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.427+0000 7fa20bc3f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55f860d5ab20 con 0x55f860a304d0 2024-09-21T03:55:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.427+0000 7fa20bc3f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f860d5e930 con 0x55f860a511b0 2024-09-21T03:55:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.428+0000 7fa1fed9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f860a511b0 0x55f860df6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.428+0000 7fa1fed9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f860a511b0 0x55f860df6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:39044/0 (socket says 172.21.15.46:39044) 2024-09-21T03:55:43.431 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.428+0000 7fa1fed9d640 1 -- 172.21.15.46:0/685187297 learned_addr learned my addr 172.21.15.46:0/685187297 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:43.431 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.428+0000 7fa1fdd9b640 1 --2- 172.21.15.46:0/685187297 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f860a304d0 0x55f860df7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:43.431 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.428+0000 7fa1fe59c640 1 --2- 172.21.15.46:0/685187297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f860a282f0 0x55f860df70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:43.432 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.428+0000 7fa1fdd9b640 1 -- 172.21.15.46:0/685187297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f860a511b0 msgr2=0x55f860df6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:43.432 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.428+0000 7fa1fdd9b640 1 --2- 172.21.15.46:0/685187297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f860a511b0 0x55f860df6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.432 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.428+0000 7fa1fdd9b640 1 -- 172.21.15.46:0/685187297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f860a282f0 msgr2=0x55f860df70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:43.432 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.428+0000 7fa1fdd9b640 1 --2- 172.21.15.46:0/685187297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f860a282f0 0x55f860df70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.432 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.428+0000 7fa1fdd9b640 1 -- 172.21.15.46:0/685187297 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f860d20530 con 0x55f860a304d0 2024-09-21T03:55:43.432 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.428+0000 7fa1fe59c640 1 --2- 172.21.15.46:0/685187297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f860a282f0 0x55f860df70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:55:43.432 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.429+0000 7fa1fdd9b640 1 --2- 172.21.15.46:0/685187297 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f860a304d0 0x55f860df7620 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4005ab0 tx=0x7fa1f4004610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19bbf74e1fe3043e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:43.432 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.429+0000 7fa1ecff9640 1 -- 172.21.15.46:0/685187297 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4040070 con 0x55f860a304d0 2024-09-21T03:55:43.432 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.429+0000 7fa1ecff9640 1 -- 172.21.15.46:0/685187297 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1f4005020 con 0x55f860a304d0 2024-09-21T03:55:43.432 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.429+0000 7fa1ecff9640 1 -- 172.21.15.46:0/685187297 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4035040 con 0x55f860a304d0 2024-09-21T03:55:43.432 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.430+0000 7fa1ef7fe640 1 --2- 172.21.15.46:0/519649124 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa1e80b6670 0x7fa1e80b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.430+0000 7fa1ef7fe640 1 -- 172.21.15.46:0/519649124 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fa1f00e75f0 con 0x7fa1f80946e0 2024-09-21T03:55:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.430+0000 7fa1fed9d640 1 --2- 172.21.15.46:0/519649124 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa1e80b6670 0x7fa1e80b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.431+0000 7fa20bc3f740 1 -- 172.21.15.46:0/685187297 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f860a304d0 msgr2=0x55f860df7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.431+0000 7fa20bc3f740 1 --2- 172.21.15.46:0/685187297 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f860a304d0 0x55f860df7620 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4005ab0 tx=0x7fa1f4004610 comp rx=0 tx=0).stop 2024-09-21T03:55:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.431+0000 7fa1fed9d640 1 --2- 172.21.15.46:0/519649124 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa1e80b6670 0x7fa1e80b8b80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa200066c70 tx=0x7fa20006b040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.431+0000 7fa20bc3f740 1 -- 172.21.15.46:0/685187297 shutdown_connections 2024-09-21T03:55:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.431+0000 7fa20bc3f740 1 --2- 172.21.15.46:0/685187297 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f860a304d0 0x55f860df7620 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.431+0000 7fa20bc3f740 1 --2- 172.21.15.46:0/685187297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f860a282f0 0x55f860df70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.431+0000 7fa20bc3f740 1 --2- 172.21.15.46:0/685187297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f860a511b0 0x55f860df6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.431+0000 7fa20bc3f740 1 -- 172.21.15.46:0/685187297 >> 172.21.15.46:0/685187297 conn(0x55f860a45300 msgr2=0x55f860df4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.431+0000 7fa20bc3f740 1 -- 172.21.15.46:0/685187297 shutdown_connections 2024-09-21T03:55:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.431+0000 7fa20bc3f740 1 -- 172.21.15.46:0/685187297 wait complete. 2024-09-21T03:55:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.432+0000 7fa20bc3f740 1 -- start start 2024-09-21T03:55:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.432+0000 7fa20bc3f740 1 Processor -- start 2024-09-21T03:55:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.432+0000 7fa20bc3f740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f860a282f0 0x55f860e065b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.432+0000 7fa20bc3f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f860a304d0 0x55f860e06af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.432+0000 7fa20bc3f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f860a511b0 0x55f860e07050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.432+0000 7fa20bc3f740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55f860c92ab0 con 0x55f860a282f0 2024-09-21T03:55:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.432+0000 7fa20bc3f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55f860d00730 con 0x55f860a511b0 2024-09-21T03:55:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.432+0000 7fa20bc3f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f860e096a0 con 0x55f860a304d0 2024-09-21T03:55:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.432+0000 7fa20bc3f740 10 client.0 _ll_register_callbacks cb 0x55f860d546b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:55:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.432+0000 7fa1fe59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f860a282f0 0x55f860e065b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.433+0000 7fa1fe59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f860a282f0 0x55f860e065b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43904/0 (socket says 172.21.15.46:43904) 2024-09-21T03:55:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.433+0000 7fa1fe59c640 1 -- 172.21.15.46:0/2151715020 learned_addr learned my addr 172.21.15.46:0/2151715020 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.433+0000 7fa1fdd9b640 1 --2- 172.21.15.46:0/2151715020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f860a304d0 0x55f860e06af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.433+0000 7fa1fed9d640 1 --2- 172.21.15.46:0/2151715020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f860a511b0 0x55f860e07050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.433+0000 7fa1fe59c640 1 -- 172.21.15.46:0/2151715020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f860a304d0 msgr2=0x55f860e06af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.433+0000 7fa1fe59c640 1 --2- 172.21.15.46:0/2151715020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f860a304d0 0x55f860e06af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.433+0000 7fa1fe59c640 1 -- 172.21.15.46:0/2151715020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f860a511b0 msgr2=0x55f860e07050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.433+0000 7fa1fe59c640 1 --2- 172.21.15.46:0/2151715020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f860a511b0 0x55f860e07050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.433+0000 7fa1fe59c640 1 -- 172.21.15.46:0/2151715020 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f860abc790 con 0x55f860a282f0 2024-09-21T03:55:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.433+0000 7fa1e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:55:43.438 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.433+0000 7fa1fe59c640 1 --2- 172.21.15.46:0/2151715020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f860a282f0 0x55f860e065b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa1f001f000 tx=0x7fa1f00aceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c12b25dceaf1ea0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:43.438 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.433+0000 7fa1e5ffb640 1 -- 172.21.15.46:0/2151715020 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f00ead50 con 0x55f860a282f0 2024-09-21T03:55:43.438 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.433+0000 7fa1e5ffb640 1 -- 172.21.15.46:0/2151715020 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fa1f00ac7c0 con 0x55f860a282f0 2024-09-21T03:55:43.438 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.434+0000 7fa20bc3f740 1 -- 172.21.15.46:0/2151715020 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1f4005020 con 0x55f860a282f0 2024-09-21T03:55:43.440 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.435+0000 7fa1e5ffb640 1 -- 172.21.15.46:0/2151715020 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa1f00adc60 con 0x55f860a282f0 2024-09-21T03:55:43.440 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.435+0000 7fa20bc3f740 10 client.15516 fetch_fsmap learned FSMap version 20 2024-09-21T03:55:43.440 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.435+0000 7fa20bc3f740 1 -- 172.21.15.46:0/2151715020 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55f860b35620 con 0x55f860a282f0 2024-09-21T03:55:43.440 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.435+0000 7fa1e5ffb640 1 -- 172.21.15.46:0/2151715020 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1f4005020 con 0x55f860a282f0 2024-09-21T03:55:43.440 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.435+0000 7fa1e5ffb640 1 -- 172.21.15.46:0/2151715020 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa1f00a8fc0 con 0x55f860a282f0 2024-09-21T03:55:43.440 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.435+0000 7fa20bc3f740 10 client.15516 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:55:43.440 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.435+0000 7fa20bc3f740 10 client.15516 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:55:43.440 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.435+0000 7fa20bc3f740 20 client.15516 populate_metadata read hostname 'smithi046' 2024-09-21T03:55:43.440 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.435+0000 7fa20bc3f740 1 --2- 172.21.15.46:0/2151715020 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55f860a0fd80 0x55f860e186b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:43.440 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.435+0000 7fa20bc3f740 4 client.15516 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:55:43.441 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.435+0000 7fa20bc3f740 1 -- 172.21.15.46:0/2151715020 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f860d6d640 con 0x55f860a0fd80 2024-09-21T03:55:43.441 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.436+0000 7fa1fdd9b640 1 --2- 172.21.15.46:0/2151715020 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55f860a0fd80 0x55f860e186b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:43.441 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.436+0000 7fa1e5ffb640 10 client.15516 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:43.441 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.436+0000 7fa1fdd9b640 1 --2- 172.21.15.46:0/2151715020 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55f860a0fd80 0x55f860e186b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9547dce4ed0db14 server_cookie=e62dcecdfa14efca in_seq=0 out_seq=0 2024-09-21T03:55:43.441 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.437+0000 7fa1e5ffb640 1 -- 172.21.15.46:0/2151715020 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f860d6d640 con 0x55f860a0fd80 2024-09-21T03:55:43.441 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.437+0000 7fa1e5ffb640 10 client.15516 handle_command_reply: tid=0 2024-09-21T03:55:43.441 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.437+0000 7fa20bc3f740 1 client.15516 shutdown 2024-09-21T03:55:43.441 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.437+0000 7fa20bc3f740 1 -- 172.21.15.46:0/2151715020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f860a282f0 msgr2=0x55f860e065b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:43.441 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.437+0000 7fa20bc3f740 1 --2- 172.21.15.46:0/2151715020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f860a282f0 0x55f860e065b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa1f001f000 tx=0x7fa1f00aceb0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.441 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.437+0000 7fa20bc3f740 1 -- 172.21.15.46:0/2151715020 shutdown_connections 2024-09-21T03:55:43.441 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.437+0000 7fa20bc3f740 1 --2- 172.21.15.46:0/2151715020 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55f860a0fd80 0x55f860e186b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.441 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.437+0000 7fa20bc3f740 1 --2- 172.21.15.46:0/2151715020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f860a511b0 0x55f860e07050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.441 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.437+0000 7fa1e5ffb640 0 client.15516 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:43.442 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.437+0000 7fa20bc3f740 1 --2- 172.21.15.46:0/2151715020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f860a304d0 0x55f860e06af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.442 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.437+0000 7fa20bc3f740 1 --2- 172.21.15.46:0/2151715020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f860a282f0 0x55f860e065b0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.442 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.438+0000 7fa20bc3f740 1 -- 172.21.15.46:0/2151715020 >> 172.21.15.46:0/2151715020 conn(0x55f860a45300 msgr2=0x55f860df8590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:43.442 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.438+0000 7fa20bc3f740 1 -- 172.21.15.46:0/2151715020 shutdown_connections 2024-09-21T03:55:43.442 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.438+0000 7fa20bc3f740 1 -- 172.21.15.46:0/2151715020 wait complete. 2024-09-21T03:55:43.442 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.438+0000 7fa20bc3f740 20 client.15516 trim_cache size 0 max 16384 2024-09-21T03:55:43.462 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:55:43.465 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.462+0000 7fa20bc3f740 1 Processor -- start 2024-09-21T03:55:43.465 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.462+0000 7fa20bc3f740 1 -- start start 2024-09-21T03:55:43.465 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.463+0000 7fa20bc3f740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f860a0fd80 0x55f860e03780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:43.465 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.463+0000 7fa20bc3f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f860a304d0 0x55f860e03cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:43.465 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.463+0000 7fa20bc3f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f860a511b0 0x55f860e1deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:43.465 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.463+0000 7fa20bc3f740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f813d750 con 0x55f860a0fd80 2024-09-21T03:55:43.465 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.463+0000 7fa20bc3f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f813fff0 con 0x55f860a511b0 2024-09-21T03:55:43.465 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.463+0000 7fa20bc3f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f813dde0 con 0x55f860a304d0 2024-09-21T03:55:43.465 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.463+0000 7fa1fe59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f860a0fd80 0x55f860e03780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:43.466 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.463+0000 7fa1fed9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f860a511b0 0x55f860e1deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:43.466 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.463+0000 7fa1fed9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f860a511b0 0x55f860e1deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.46:55038/0 (socket says 172.21.15.46:55038) 2024-09-21T03:55:43.466 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.463+0000 7fa1fed9d640 1 -- 172.21.15.46:0/1341989445 learned_addr learned my addr 172.21.15.46:0/1341989445 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:43.466 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.463+0000 7fa1fdd9b640 1 --2- 172.21.15.46:0/1341989445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f860a304d0 0x55f860e03cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:43.467 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.463+0000 7fa1fed9d640 1 -- 172.21.15.46:0/1341989445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f860a304d0 msgr2=0x55f860e03cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:43.467 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.463+0000 7fa1fed9d640 1 --2- 172.21.15.46:0/1341989445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f860a304d0 0x55f860e03cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.467 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.463+0000 7fa1fed9d640 1 -- 172.21.15.46:0/1341989445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f860a0fd80 msgr2=0x55f860e03780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:43.467 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.464+0000 7fa1fed9d640 1 --2- 172.21.15.46:0/1341989445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f860a0fd80 0x55f860e03780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.467 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.464+0000 7fa1fed9d640 1 -- 172.21.15.46:0/1341989445 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f860df5390 con 0x55f860a511b0 2024-09-21T03:55:43.467 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.464+0000 7fa1fe59c640 1 --2- 172.21.15.46:0/1341989445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f860a0fd80 0x55f860e03780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:55:43.467 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.464+0000 7fa1fed9d640 1 --2- 172.21.15.46:0/1341989445 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f860a511b0 0x55f860e1deb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa20002ebd0 tx=0x7fa200085000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4632689d161be2fc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:43.467 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.464+0000 7fa1e7fff640 1 -- 172.21.15.46:0/1341989445 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20008ea90 con 0x55f860a511b0 2024-09-21T03:55:43.467 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.464+0000 7fa1e7fff640 1 -- 172.21.15.46:0/1341989445 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa20008ec30 con 0x55f860a511b0 2024-09-21T03:55:43.467 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.464+0000 7fa1e7fff640 1 -- 172.21.15.46:0/1341989445 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa200089400 con 0x55f860a511b0 2024-09-21T03:55:43.469 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.465+0000 7fa20bc3f740 1 -- 172.21.15.46:0/1341989445 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f860a511b0 msgr2=0x55f860e1deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:43.469 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.465+0000 7fa20bc3f740 1 --2- 172.21.15.46:0/1341989445 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f860a511b0 0x55f860e1deb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa20002ebd0 tx=0x7fa200085000 comp rx=0 tx=0).stop 2024-09-21T03:55:43.469 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.465+0000 7fa20bc3f740 1 -- 172.21.15.46:0/1341989445 shutdown_connections 2024-09-21T03:55:43.469 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.465+0000 7fa20bc3f740 1 --2- 172.21.15.46:0/1341989445 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f860a511b0 0x55f860e1deb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.469 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.465+0000 7fa20bc3f740 1 --2- 172.21.15.46:0/1341989445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f860a304d0 0x55f860e03cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.469 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.465+0000 7fa20bc3f740 1 --2- 172.21.15.46:0/1341989445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f860a0fd80 0x55f860e03780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.469 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.465+0000 7fa20bc3f740 1 -- 172.21.15.46:0/1341989445 >> 172.21.15.46:0/1341989445 conn(0x55f860a45300 msgr2=0x55f860dfbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:43.469 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.465+0000 7fa20bc3f740 1 -- 172.21.15.46:0/1341989445 shutdown_connections 2024-09-21T03:55:43.470 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.465+0000 7fa20bc3f740 1 -- 172.21.15.46:0/1341989445 wait complete. 2024-09-21T03:55:43.470 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.466+0000 7fa20bc3f740 1 -- start start 2024-09-21T03:55:43.470 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.466+0000 7fa20bc3f740 1 Processor -- start 2024-09-21T03:55:43.470 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.466+0000 7fa20bc3f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f860a0fd80 0x55f860e0f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:43.470 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.467+0000 7fa20bc3f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f860a304d0 0x55f860e0a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:43.470 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.467+0000 7fa20bc3f740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f860a511b0 0x55f860e0af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:43.470 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.467+0000 7fa20bc3f740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f813e4b0 con 0x55f860a511b0 2024-09-21T03:55:43.470 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.467+0000 7fa1fdd9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f860a304d0 0x55f860e0a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:43.470 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.467+0000 7fa1fe59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f860a0fd80 0x55f860e0f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:43.470 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.467+0000 7fa1fdd9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f860a304d0 0x55f860e0a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:39062/0 (socket says 172.21.15.46:39062) 2024-09-21T03:55:43.470 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.467+0000 7fa1fdd9b640 1 -- 172.21.15.46:0/3660907408 learned_addr learned my addr 172.21.15.46:0/3660907408 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:43.470 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.467+0000 7fa1fed9d640 1 --2- 172.21.15.46:0/3660907408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f860a511b0 0x55f860e0af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:43.470 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.467+0000 7fa20bc3f740 1 -- 172.21.15.46:0/3660907408 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f813f920 con 0x55f860a0fd80 2024-09-21T03:55:43.471 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.467+0000 7fa20bc3f740 1 -- 172.21.15.46:0/3660907408 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f813eb80 con 0x55f860a304d0 2024-09-21T03:55:43.472 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.467+0000 7fa20bc3f740 10 client.0 _ll_register_callbacks cb 0x7fa1f00ad330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:55:43.473 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.467+0000 7fa1fdd9b640 1 -- 172.21.15.46:0/3660907408 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f860a0fd80 msgr2=0x55f860e0f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:43.473 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.467+0000 7fa1fdd9b640 1 --2- 172.21.15.46:0/3660907408 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f860a0fd80 0x55f860e0f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.473 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.467+0000 7fa1fdd9b640 1 -- 172.21.15.46:0/3660907408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f860a511b0 msgr2=0x55f860e0af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:43.473 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.468+0000 7fa1fdd9b640 1 --2- 172.21.15.46:0/3660907408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f860a511b0 0x55f860e0af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.473 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.468+0000 7fa1fdd9b640 1 -- 172.21.15.46:0/3660907408 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f860e820b0 con 0x55f860a304d0 2024-09-21T03:55:43.473 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.468+0000 7fa1fed9d640 1 --2- 172.21.15.46:0/3660907408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f860a511b0 0x55f860e0af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:55:43.473 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.468+0000 7fa1fdd9b640 1 --2- 172.21.15.46:0/3660907408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f860a304d0 0x55f860e0a820 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4009230 tx=0x7fa1f4031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15d1517d6b351ecf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:43.473 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.468+0000 7fa1e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T03:55:43.473 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.468+0000 7fa1e5ffb640 1 -- 172.21.15.46:0/3660907408 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4059020 con 0x55f860a304d0 2024-09-21T03:55:43.473 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.468+0000 7fa1e5ffb640 1 -- 172.21.15.46:0/3660907408 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fa1f4003ab0 con 0x55f860a304d0 2024-09-21T03:55:43.473 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.468+0000 7fa20bc3f740 1 -- 172.21.15.46:0/3660907408 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa20008ec30 con 0x55f860a304d0 2024-09-21T03:55:43.473 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.469+0000 7fa1e5ffb640 1 -- 172.21.15.46:0/3660907408 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa1f4064050 con 0x55f860a304d0 2024-09-21T03:55:43.474 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.469+0000 7fa20bc3f740 10 client.25231 fetch_fsmap learned FSMap version 20 2024-09-21T03:55:43.474 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.469+0000 7fa20bc3f740 1 -- 172.21.15.46:0/3660907408 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55f860e831f0 con 0x55f860a304d0 2024-09-21T03:55:43.474 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.469+0000 7fa1e5ffb640 1 -- 172.21.15.46:0/3660907408 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1f4003cb0 con 0x55f860a304d0 2024-09-21T03:55:43.474 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.469+0000 7fa1e5ffb640 1 -- 172.21.15.46:0/3660907408 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa1f4054030 con 0x55f860a304d0 2024-09-21T03:55:43.474 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.469+0000 7fa20bc3f740 10 client.25231 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:55:43.474 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.469+0000 7fa20bc3f740 10 client.25231 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:55:43.474 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.469+0000 7fa20bc3f740 20 client.25231 populate_metadata read hostname 'smithi046' 2024-09-21T03:55:43.474 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.469+0000 7fa20bc3f740 1 --2- 172.21.15.46:0/3660907408 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55f8609e51c0 0x55f860e855e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:43.474 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.469+0000 7fa20bc3f740 4 client.25231 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T03:55:43.474 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.469+0000 7fa20bc3f740 1 -- 172.21.15.46:0/3660907408 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fa20008ec30 con 0x55f8609e51c0 2024-09-21T03:55:43.474 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.470+0000 7fa1fe59c640 1 --2- 172.21.15.46:0/3660907408 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55f8609e51c0 0x55f860e855e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:43.474 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.470+0000 7fa1e5ffb640 10 client.25231 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:43.474 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.470+0000 7fa1fe59c640 1 --2- 172.21.15.46:0/3660907408 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55f8609e51c0 0x55f860e855e0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62b525533a77f07c server_cookie=7ae792b587050f47 in_seq=0 out_seq=0 2024-09-21T03:55:43.481 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.478+0000 7fa1e5ffb640 1 -- 172.21.15.46:0/3660907408 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fa20008ec30 con 0x55f8609e51c0 2024-09-21T03:55:43.481 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.478+0000 7fa1e5ffb640 10 client.25231 handle_command_reply: tid=0 2024-09-21T03:55:43.481 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.478+0000 7fa20bc3f740 1 client.25231 shutdown 2024-09-21T03:55:43.481 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.479+0000 7fa20bc3f740 1 -- 172.21.15.46:0/3660907408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f860a304d0 msgr2=0x55f860e0a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:43.481 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.479+0000 7fa20bc3f740 1 --2- 172.21.15.46:0/3660907408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f860a304d0 0x55f860e0a820 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4009230 tx=0x7fa1f4031400 comp rx=0 tx=0).stop 2024-09-21T03:55:43.481 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.479+0000 7fa20bc3f740 1 -- 172.21.15.46:0/3660907408 shutdown_connections 2024-09-21T03:55:43.481 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.479+0000 7fa20bc3f740 1 --2- 172.21.15.46:0/3660907408 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55f8609e51c0 0x55f860e855e0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.482 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.479+0000 7fa20bc3f740 1 --2- 172.21.15.46:0/3660907408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f860a511b0 0x55f860e0af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.482 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.479+0000 7fa20bc3f740 1 --2- 172.21.15.46:0/3660907408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f860a304d0 0x55f860e0a820 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.482 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.479+0000 7fa20bc3f740 1 --2- 172.21.15.46:0/3660907408 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f860a0fd80 0x55f860e0f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.482 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.479+0000 7fa20bc3f740 1 -- 172.21.15.46:0/3660907408 >> 172.21.15.46:0/3660907408 conn(0x55f860a45300 msgr2=0x55f860dfbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:43.482 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.479+0000 7fa1e5ffb640 0 client.25231 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:43.482 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.479+0000 7fa20bc3f740 1 -- 172.21.15.46:0/3660907408 shutdown_connections 2024-09-21T03:55:43.482 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.479+0000 7fa20bc3f740 1 -- 172.21.15.46:0/3660907408 wait complete. 2024-09-21T03:55:43.482 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.479+0000 7fa20bc3f740 20 client.25231 trim_cache size 0 max 16384 2024-09-21T03:55:43.482 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:{ 2024-09-21T03:55:43.482 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "message": "", 2024-09-21T03:55:43.482 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "return_code": 0 2024-09-21T03:55:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:} 2024-09-21T03:55:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.480+0000 7fa1ff59e640 1 -- 172.21.15.46:0/519649124 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa1e80b6670 msgr2=0x7fa1e80b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.480+0000 7fa1ff59e640 1 --2- 172.21.15.46:0/519649124 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa1e80b6670 0x7fa1e80b8b80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa200066c70 tx=0x7fa20006b040 comp rx=0 tx=0).stop 2024-09-21T03:55:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.480+0000 7fa1ff59e640 1 -- 172.21.15.46:0/519649124 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1f80946e0 msgr2=0x7fa1f812cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.480+0000 7fa1ff59e640 1 --2- 172.21.15.46:0/519649124 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1f80946e0 0x7fa1f812cae0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa1f000c970 tx=0x7fa1f000ce30 comp rx=0 tx=0).stop 2024-09-21T03:55:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.480+0000 7fa1ff59e640 1 -- 172.21.15.46:0/519649124 shutdown_connections 2024-09-21T03:55:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.480+0000 7fa1ff59e640 1 --2- 172.21.15.46:0/519649124 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa1e80b6670 0x7fa1e80b8b80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.484 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.480+0000 7fa1ff59e640 1 --2- 172.21.15.46:0/519649124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1f809c400 0x7fa1f8132310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.484 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.480+0000 7fa1ff59e640 1 --2- 172.21.15.46:0/519649124 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1f809bab0 0x7fa1f812d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.484 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.480+0000 7fa1ff59e640 1 --2- 172.21.15.46:0/519649124 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1f80946e0 0x7fa1f812cae0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.484 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.480+0000 7fa1ff59e640 1 -- 172.21.15.46:0/519649124 >> 172.21.15.46:0/519649124 conn(0x7fa1f800c510 msgr2=0x7fa1f8099b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:43.484 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.480+0000 7fa1ff59e640 1 -- 172.21.15.46:0/519649124 shutdown_connections 2024-09-21T03:55:43.484 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:43.480+0000 7fa1ff59e640 1 -- 172.21.15.46:0/519649124 wait complete. 2024-09-21T03:55:43.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:43 smithi046 ceph-mon[30954]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T03:55:43.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:43 smithi105 ceph-mon[34773]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T03:55:43.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:43 smithi162 ceph-mon[35071]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T03:55:43.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:43.995+0000 7fde95b36640 1 -- 172.21.15.46:0/364898958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde9010de30 msgr2=0x7fde90110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:43.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:43.995+0000 7fde95b36640 1 --2- 172.21.15.46:0/364898958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde9010de30 0x7fde90110320 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fde88009ca0 tx=0x7fde8802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:43.996+0000 7fde95b36640 1 -- 172.21.15.46:0/364898958 shutdown_connections 2024-09-21T03:55:43.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:43.996+0000 7fde95b36640 1 --2- 172.21.15.46:0/364898958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde9010de30 0x7fde90110320 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:43.996+0000 7fde95b36640 1 --2- 172.21.15.46:0/364898958 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde90105320 0x7fde9010d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:43.996+0000 7fde95b36640 1 --2- 172.21.15.46:0/364898958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde901049d0 0x7fde90104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:43.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:43.996+0000 7fde95b36640 1 -- 172.21.15.46:0/364898958 >> 172.21.15.46:0/364898958 conn(0x7fde90079740 msgr2=0x7fde90079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:43.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:43.996+0000 7fde95b36640 1 -- 172.21.15.46:0/364898958 shutdown_connections 2024-09-21T03:55:44.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:43.996+0000 7fde95b36640 1 -- 172.21.15.46:0/364898958 wait complete. 2024-09-21T03:55:44.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:43.997+0000 7fde95b36640 1 Processor -- start 2024-09-21T03:55:44.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:43.997+0000 7fde95b36640 1 -- start start 2024-09-21T03:55:44.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:43.997+0000 7fde95b36640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde901049d0 0x7fde9019a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:44.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:43.997+0000 7fde95b36640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde90105320 0x7fde9019aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:44.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:43.997+0000 7fde95b36640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde9010de30 0x7fde9019fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:44.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:43.997+0000 7fde87fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde90105320 0x7fde9019aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:44.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:43.997+0000 7fde87fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde90105320 0x7fde9019aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43958/0 (socket says 172.21.15.46:43958) 2024-09-21T03:55:44.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:43.997+0000 7fde87fff640 1 -- 172.21.15.46:0/1944230147 learned_addr learned my addr 172.21.15.46:0/1944230147 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:44.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:43.997+0000 7fde95b36640 1 -- 172.21.15.46:0/1944230147 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fde90113ab0 con 0x7fde90105320 2024-09-21T03:55:44.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:43.997+0000 7fde95b36640 1 -- 172.21.15.46:0/1944230147 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fde90113930 con 0x7fde901049d0 2024-09-21T03:55:44.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:43.997+0000 7fde95b36640 1 -- 172.21.15.46:0/1944230147 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fde90113c30 con 0x7fde9010de30 2024-09-21T03:55:44.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:43.998+0000 7fde8f7fe640 1 --2- 172.21.15.46:0/1944230147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde901049d0 0x7fde9019a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:44.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:43.998+0000 7fde8ffff640 1 --2- 172.21.15.46:0/1944230147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde9010de30 0x7fde9019fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:44.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:43.998+0000 7fde87fff640 1 -- 172.21.15.46:0/1944230147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde9010de30 msgr2=0x7fde9019fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:44.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:43.998+0000 7fde87fff640 1 --2- 172.21.15.46:0/1944230147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde9010de30 0x7fde9019fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:44.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:43.998+0000 7fde87fff640 1 -- 172.21.15.46:0/1944230147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde901049d0 msgr2=0x7fde9019a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:44.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:43.998+0000 7fde87fff640 1 --2- 172.21.15.46:0/1944230147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde901049d0 0x7fde9019a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:44.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:43.998+0000 7fde87fff640 1 -- 172.21.15.46:0/1944230147 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde901a03f0 con 0x7fde90105320 2024-09-21T03:55:44.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:43.998+0000 7fde87fff640 1 --2- 172.21.15.46:0/1944230147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde90105320 0x7fde9019aa20 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fde7800bcd0 tx=0x7fde78009610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:44.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:43.999+0000 7fde8d7fa640 1 -- 172.21.15.46:0/1944230147 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde78004020 con 0x7fde90105320 2024-09-21T03:55:44.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:43.999+0000 7fde95b36640 1 -- 172.21.15.46:0/1944230147 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde901a06e0 con 0x7fde90105320 2024-09-21T03:55:44.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:43.999+0000 7fde8d7fa640 1 -- 172.21.15.46:0/1944230147 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde780054d0 con 0x7fde90105320 2024-09-21T03:55:44.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:43.999+0000 7fde8d7fa640 1 -- 172.21.15.46:0/1944230147 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde78004a90 con 0x7fde90105320 2024-09-21T03:55:44.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:43.999+0000 7fde95b36640 1 -- 172.21.15.46:0/1944230147 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde901025f0 con 0x7fde90105320 2024-09-21T03:55:44.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.002+0000 7fde9c0aa740 1 Processor -- start 2024-09-21T03:55:44.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.002+0000 7fde9c0aa740 1 -- start start 2024-09-21T03:55:44.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.002+0000 7fde9c0aa740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3e6f7070 0x559f3ea9e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:44.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.002+0000 7fde9c0aa740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559f3e6ce1b0 0x559f3ea9e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:44.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.002+0000 7fde9c0aa740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559f3e6d6390 0x559f3ea9ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:44.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.002+0000 7fde9c0aa740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x559f3ea14e50 con 0x559f3e6d6390 2024-09-21T03:55:44.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.002+0000 7fde9c0aa740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x559f3ea04280 con 0x559f3e6ce1b0 2024-09-21T03:55:44.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.002+0000 7fde9c0aa740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559f3ea08090 con 0x559f3e6f7070 2024-09-21T03:55:44.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.003+0000 7fde8f7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559f3e6ce1b0 0x559f3ea9e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:44.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.003+0000 7fde8ffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3e6f7070 0x559f3ea9e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:44.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.003+0000 7fde8f7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559f3e6ce1b0 0x559f3ea9e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.46:55072/0 (socket says 172.21.15.46:55072) 2024-09-21T03:55:44.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.003+0000 7fde8ffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3e6f7070 0x559f3ea9e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:39090/0 (socket says 172.21.15.46:39090) 2024-09-21T03:55:44.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.003+0000 7fde8f7fe640 1 -- 172.21.15.46:0/2815762692 learned_addr learned my addr 172.21.15.46:0/2815762692 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:44.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.003+0000 7fde8d7fa640 1 -- 172.21.15.46:0/1944230147 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 22) ==== 154586+0+0 (secure 0 0 0) 0x7fde78022020 con 0x7fde90105320 2024-09-21T03:55:44.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.003+0000 7fde8ffff640 1 -- 172.21.15.46:0/2815762692 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559f3e6ce1b0 msgr2=0x559f3ea9e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:44.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.003+0000 7fde8ffff640 1 --2- 172.21.15.46:0/2815762692 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559f3e6ce1b0 0x559f3ea9e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:44.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.003+0000 7fde8ffff640 1 -- 172.21.15.46:0/2815762692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559f3e6d6390 msgr2=0x559f3ea9ecf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T03:55:44.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.003+0000 7fde8ffff640 1 --2- 172.21.15.46:0/2815762692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559f3e6d6390 0x559f3ea9ecf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:44.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.003+0000 7fde8ffff640 1 -- 172.21.15.46:0/2815762692 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f3e762650 con 0x559f3e6f7070 2024-09-21T03:55:44.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.003+0000 7fde8f7fe640 1 --2- 172.21.15.46:0/2815762692 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559f3e6ce1b0 0x559f3ea9e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:55:44.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.004+0000 7fde8ffff640 1 --2- 172.21.15.46:0/2815762692 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3e6f7070 0x559f3ea9e270 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fde88005e30 tx=0x7fde880098b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec4c1f00c1e1fc29 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:44.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.004+0000 7fde85ffb640 1 -- 172.21.15.46:0/2815762692 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde88031db0 con 0x559f3e6f7070 2024-09-21T03:55:44.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.004+0000 7fde85ffb640 1 -- 172.21.15.46:0/2815762692 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde88036030 con 0x559f3e6f7070 2024-09-21T03:55:44.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.005+0000 7fde8d7fa640 1 --2- 172.21.15.46:0/1944230147 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fde700b65f0 0x7fde700b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:44.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.005+0000 7fde8d7fa640 1 -- 172.21.15.46:0/1944230147 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fde780eac00 con 0x7fde90105320 2024-09-21T03:55:44.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.005+0000 7fde85ffb640 1 -- 172.21.15.46:0/2815762692 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde880042a0 con 0x559f3e6f7070 2024-09-21T03:55:44.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.005+0000 7fde8f7fe640 1 --2- 172.21.15.46:0/1944230147 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fde700b65f0 0x7fde700b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:44.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.006+0000 7fde9c0aa740 1 -- 172.21.15.46:0/2815762692 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3e6f7070 msgr2=0x559f3ea9e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:44.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.006+0000 7fde9c0aa740 1 --2- 172.21.15.46:0/2815762692 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3e6f7070 0x559f3ea9e270 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fde88005e30 tx=0x7fde880098b0 comp rx=0 tx=0).stop 2024-09-21T03:55:44.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.006+0000 7fde9c0aa740 1 -- 172.21.15.46:0/2815762692 shutdown_connections 2024-09-21T03:55:44.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.006+0000 7fde9c0aa740 1 --2- 172.21.15.46:0/2815762692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559f3e6d6390 0x559f3ea9ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:44.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.006+0000 7fde9c0aa740 1 --2- 172.21.15.46:0/2815762692 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559f3e6ce1b0 0x559f3ea9e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:44.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.006+0000 7fde9c0aa740 1 --2- 172.21.15.46:0/2815762692 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3e6f7070 0x559f3ea9e270 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:44.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.006+0000 7fde9c0aa740 1 -- 172.21.15.46:0/2815762692 >> 172.21.15.46:0/2815762692 conn(0x559f3e6eb460 msgr2=0x559f3ea9c160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:44.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.006+0000 7fde9c0aa740 1 -- 172.21.15.46:0/2815762692 shutdown_connections 2024-09-21T03:55:44.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.006+0000 7fde8f7fe640 1 --2- 172.21.15.46:0/1944230147 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fde700b65f0 0x7fde700b8b00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x559f3ea9cef0 tx=0x7fde8000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:44.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.006+0000 7fde9c0aa740 1 -- 172.21.15.46:0/2815762692 wait complete. 2024-09-21T03:55:44.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.007+0000 7fde9c0aa740 1 -- start start 2024-09-21T03:55:44.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.007+0000 7fde9c0aa740 1 Processor -- start 2024-09-21T03:55:44.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.007+0000 7fde9c0aa740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559f3e6ce1b0 0x559f3eaa9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:44.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.007+0000 7fde9c0aa740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3e6d6390 0x559f3eaa9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:44.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.007+0000 7fde9c0aa740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559f3e6f7070 0x559f3eaaa2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:44.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.008+0000 7fde9c0aa740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x559f3e865700 con 0x559f3e6f7070 2024-09-21T03:55:44.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.008+0000 7fde8ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559f3e6f7070 0x559f3eaaa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:44.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.008+0000 7fde9c0aa740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x559f3e99f110 con 0x559f3e6ce1b0 2024-09-21T03:55:44.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.008+0000 7fde9c0aa740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559f3eaac8c0 con 0x559f3e6d6390 2024-09-21T03:55:44.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.008+0000 7fde8f7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559f3e6ce1b0 0x559f3eaa9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:44.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.008+0000 7fde8f7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559f3e6ce1b0 0x559f3eaa9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.46:55074/0 (socket says 172.21.15.46:55074) 2024-09-21T03:55:44.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.008+0000 7fde8ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559f3e6f7070 0x559f3eaaa2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43964/0 (socket says 172.21.15.46:43964) 2024-09-21T03:55:44.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.008+0000 7fde8f7fe640 1 -- 172.21.15.46:0/3349125840 learned_addr learned my addr 172.21.15.46:0/3349125840 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:44.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.008+0000 7fde9c0aa740 10 client.0 _ll_register_callbacks cb 0x559f3e9b8990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:55:44.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.008+0000 7fde87fff640 1 --2- 172.21.15.46:0/3349125840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3e6d6390 0x559f3eaa9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:44.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.008+0000 7fde87fff640 1 -- 172.21.15.46:0/3349125840 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559f3e6ce1b0 msgr2=0x559f3eaa9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:44.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.008+0000 7fde87fff640 1 --2- 172.21.15.46:0/3349125840 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559f3e6ce1b0 0x559f3eaa9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:44.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.008+0000 7fde87fff640 1 -- 172.21.15.46:0/3349125840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559f3e6f7070 msgr2=0x559f3eaaa2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:44.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.008+0000 7fde87fff640 1 --2- 172.21.15.46:0/3349125840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559f3e6f7070 0x559f3eaaa2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:44.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.008+0000 7fde87fff640 1 -- 172.21.15.46:0/3349125840 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f3e9ccc40 con 0x559f3e6d6390 2024-09-21T03:55:44.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.009+0000 7fde87fff640 1 --2- 172.21.15.46:0/3349125840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3e6d6390 0x559f3eaa9db0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fde780e8530 tx=0x7fde780e89b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=632571f452247a79 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:44.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.009+0000 7fde7effd640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T03:55:44.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.009+0000 7fde7effd640 1 -- 172.21.15.46:0/3349125840 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7801f070 con 0x559f3e6d6390 2024-09-21T03:55:44.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.009+0000 7fde7effd640 1 -- 172.21.15.46:0/3349125840 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fde780d2dc0 con 0x559f3e6d6390 2024-09-21T03:55:44.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.009+0000 7fde9c0aa740 1 -- 172.21.15.46:0/3349125840 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde88036030 con 0x559f3e6d6390 2024-09-21T03:55:44.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.009+0000 7fde7effd640 1 -- 172.21.15.46:0/3349125840 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fde78005680 con 0x559f3e6d6390 2024-09-21T03:55:44.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.009+0000 7fde9c0aa740 10 client.25243 fetch_fsmap learned FSMap version 20 2024-09-21T03:55:44.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.009+0000 7fde9c0aa740 1 -- 172.21.15.46:0/3349125840 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x559f3eab85e0 con 0x559f3e6d6390 2024-09-21T03:55:44.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.009+0000 7fde7effd640 1 -- 172.21.15.46:0/3349125840 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde88036030 con 0x559f3e6d6390 2024-09-21T03:55:44.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.010+0000 7fde7effd640 1 -- 172.21.15.46:0/3349125840 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fde78099050 con 0x559f3e6d6390 2024-09-21T03:55:44.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.010+0000 7fde9c0aa740 10 client.25243 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:55:44.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.010+0000 7fde9c0aa740 10 client.25243 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:55:44.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.010+0000 7fde9c0aa740 20 client.25243 populate_metadata read hostname 'smithi046' 2024-09-21T03:55:44.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.010+0000 7fde9c0aa740 1 --2- 172.21.15.46:0/3349125840 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x559f3e6b59f0 0x559f3eabbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:44.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.010+0000 7fde9c0aa740 4 client.25243 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:55:44.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.010+0000 7fde9c0aa740 1 -- 172.21.15.46:0/3349125840 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f3ea16da0 con 0x559f3e6b59f0 2024-09-21T03:55:44.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.010+0000 7fde8f7fe640 1 --2- 172.21.15.46:0/3349125840 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x559f3e6b59f0 0x559f3eabbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:44.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.011+0000 7fde8f7fe640 1 --2- 172.21.15.46:0/3349125840 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x559f3e6b59f0 0x559f3eabbb80 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c4c00989247dc80 server_cookie=83450909c596cb70 in_seq=0 out_seq=0 2024-09-21T03:55:44.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.011+0000 7fde7effd640 10 client.25243 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:44.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.012+0000 7fde7effd640 1 -- 172.21.15.46:0/3349125840 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559f3ea16da0 con 0x559f3e6b59f0 2024-09-21T03:55:44.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.012+0000 7fde7effd640 10 client.25243 handle_command_reply: tid=0 2024-09-21T03:55:44.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.012+0000 7fde9c0aa740 1 client.25243 shutdown 2024-09-21T03:55:44.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.012+0000 7fde9c0aa740 1 -- 172.21.15.46:0/3349125840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3e6d6390 msgr2=0x559f3eaa9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:44.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.012+0000 7fde9c0aa740 1 --2- 172.21.15.46:0/3349125840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3e6d6390 0x559f3eaa9db0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fde780e8530 tx=0x7fde780e89b0 comp rx=0 tx=0).stop 2024-09-21T03:55:44.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.012+0000 7fde9c0aa740 1 -- 172.21.15.46:0/3349125840 shutdown_connections 2024-09-21T03:55:44.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.012+0000 7fde9c0aa740 1 --2- 172.21.15.46:0/3349125840 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x559f3e6b59f0 0x559f3eabbb80 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:44.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.012+0000 7fde7effd640 0 client.25243 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:44.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.012+0000 7fde9c0aa740 1 --2- 172.21.15.46:0/3349125840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559f3e6f7070 0x559f3eaaa2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:44.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.012+0000 7fde9c0aa740 1 --2- 172.21.15.46:0/3349125840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3e6d6390 0x559f3eaa9db0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:44.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.013+0000 7fde9c0aa740 1 --2- 172.21.15.46:0/3349125840 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559f3e6ce1b0 0x559f3eaa9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:44.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.013+0000 7fde9c0aa740 1 -- 172.21.15.46:0/3349125840 >> 172.21.15.46:0/3349125840 conn(0x559f3e6eb460 msgr2=0x559f3eaa1400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:44.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.013+0000 7fde9c0aa740 1 -- 172.21.15.46:0/3349125840 shutdown_connections 2024-09-21T03:55:44.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.013+0000 7fde9c0aa740 1 -- 172.21.15.46:0/3349125840 wait complete. 2024-09-21T03:55:44.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.013+0000 7fde9c0aa740 20 client.25243 trim_cache size 0 max 16384 2024-09-21T03:55:44.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.048+0000 7fde9c0aa740 1 Processor -- start 2024-09-21T03:55:44.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.048+0000 7fde9c0aa740 1 -- start start 2024-09-21T03:55:44.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.048+0000 7fde9c0aa740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559f3e6b59f0 0x559f3eaab750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:44.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.048+0000 7fde9c0aa740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3e6ce1b0 0x559f3eab5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:44.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.048+0000 7fde9c0aa740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559f3e6d6390 0x559f3eab57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:44.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.048+0000 7fde9c0aa740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fde901ab310 con 0x559f3e6d6390 2024-09-21T03:55:44.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.048+0000 7fde9c0aa740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fde901adb70 con 0x559f3e6b59f0 2024-09-21T03:55:44.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.048+0000 7fde9c0aa740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fde901ab960 con 0x559f3e6ce1b0 2024-09-21T03:55:44.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.049+0000 7fde87fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3e6ce1b0 0x559f3eab5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:44.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.049+0000 7fde8ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559f3e6d6390 0x559f3eab57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:44.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.049+0000 7fde87fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3e6ce1b0 0x559f3eab5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:39122/0 (socket says 172.21.15.46:39122) 2024-09-21T03:55:44.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.049+0000 7fde87fff640 1 -- 172.21.15.46:0/2824426654 learned_addr learned my addr 172.21.15.46:0/2824426654 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:44.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.049+0000 7fde8f7fe640 1 --2- 172.21.15.46:0/2824426654 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559f3e6b59f0 0x559f3eaab750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:44.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.049+0000 7fde87fff640 1 -- 172.21.15.46:0/2824426654 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559f3e6b59f0 msgr2=0x559f3eaab750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:44.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.049+0000 7fde87fff640 1 --2- 172.21.15.46:0/2824426654 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559f3e6b59f0 0x559f3eaab750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:44.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.049+0000 7fde87fff640 1 -- 172.21.15.46:0/2824426654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559f3e6d6390 msgr2=0x559f3eab57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:44.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.049+0000 7fde87fff640 1 --2- 172.21.15.46:0/2824426654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559f3e6d6390 0x559f3eab57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:44.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.049+0000 7fde87fff640 1 -- 172.21.15.46:0/2824426654 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f3eaa0560 con 0x559f3e6ce1b0 2024-09-21T03:55:44.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.050+0000 7fde87fff640 1 --2- 172.21.15.46:0/2824426654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3e6ce1b0 0x559f3eab5280 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fde780ad180 tx=0x7fde780ad330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fc971b5a56d1dff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:44.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.050+0000 7fde857fa640 1 -- 172.21.15.46:0/2824426654 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7801f070 con 0x559f3e6ce1b0 2024-09-21T03:55:44.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.050+0000 7fde857fa640 1 -- 172.21.15.46:0/2824426654 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde780d8170 con 0x559f3e6ce1b0 2024-09-21T03:55:44.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.050+0000 7fde857fa640 1 -- 172.21.15.46:0/2824426654 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde780d2e20 con 0x559f3e6ce1b0 2024-09-21T03:55:44.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.051+0000 7fde9c0aa740 1 -- 172.21.15.46:0/2824426654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3e6ce1b0 msgr2=0x559f3eab5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:44.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.051+0000 7fde9c0aa740 1 --2- 172.21.15.46:0/2824426654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3e6ce1b0 0x559f3eab5280 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fde780ad180 tx=0x7fde780ad330 comp rx=0 tx=0).stop 2024-09-21T03:55:44.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.051+0000 7fde9c0aa740 1 -- 172.21.15.46:0/2824426654 shutdown_connections 2024-09-21T03:55:44.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.051+0000 7fde9c0aa740 1 --2- 172.21.15.46:0/2824426654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559f3e6d6390 0x559f3eab57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:44.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.051+0000 7fde9c0aa740 1 --2- 172.21.15.46:0/2824426654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3e6ce1b0 0x559f3eab5280 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:44.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.051+0000 7fde9c0aa740 1 --2- 172.21.15.46:0/2824426654 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559f3e6b59f0 0x559f3eaab750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:44.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.051+0000 7fde9c0aa740 1 -- 172.21.15.46:0/2824426654 >> 172.21.15.46:0/2824426654 conn(0x559f3e6eb460 msgr2=0x559f3eab4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:44.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.051+0000 7fde9c0aa740 1 -- 172.21.15.46:0/2824426654 shutdown_connections 2024-09-21T03:55:44.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.052+0000 7fde9c0aa740 1 -- 172.21.15.46:0/2824426654 wait complete. 2024-09-21T03:55:44.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.052+0000 7fde9c0aa740 1 -- start start 2024-09-21T03:55:44.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.052+0000 7fde9c0aa740 1 Processor -- start 2024-09-21T03:55:44.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.053+0000 7fde9c0aa740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559f3e6b59f0 0x559f3eaade20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:44.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.053+0000 7fde9c0aa740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3e6ce1b0 0x559f3eaae360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:44.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.053+0000 7fde9c0aa740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559f3e6d6390 0x559f3eb25520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:44.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.053+0000 7fde9c0aa740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fde901ac030 con 0x559f3e6b59f0 2024-09-21T03:55:44.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.053+0000 7fde8f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559f3e6b59f0 0x559f3eaade20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:44.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.053+0000 7fde9c0aa740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fde901ad4a0 con 0x559f3e6d6390 2024-09-21T03:55:44.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.053+0000 7fde9c0aa740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fde901ac700 con 0x559f3e6ce1b0 2024-09-21T03:55:44.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.053+0000 7fde8f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559f3e6b59f0 0x559f3eaade20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43972/0 (socket says 172.21.15.46:43972) 2024-09-21T03:55:44.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.053+0000 7fde8f7fe640 1 -- 172.21.15.46:0/2801973465 learned_addr learned my addr 172.21.15.46:0/2801973465 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:44.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.053+0000 7fde87fff640 1 --2- 172.21.15.46:0/2801973465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3e6ce1b0 0x559f3eaae360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:44.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.053+0000 7fde9c0aa740 10 client.0 _ll_register_callbacks cb 0x7fde78011ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:55:44.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.053+0000 7fde8ffff640 1 --2- 172.21.15.46:0/2801973465 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559f3e6d6390 0x559f3eb25520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:44.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.053+0000 7fde87fff640 1 -- 172.21.15.46:0/2801973465 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559f3e6d6390 msgr2=0x559f3eb25520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:44.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.053+0000 7fde87fff640 1 --2- 172.21.15.46:0/2801973465 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559f3e6d6390 0x559f3eb25520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:44.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.053+0000 7fde87fff640 1 -- 172.21.15.46:0/2801973465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559f3e6b59f0 msgr2=0x559f3eaade20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:44.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.053+0000 7fde87fff640 1 --2- 172.21.15.46:0/2801973465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559f3e6b59f0 0x559f3eaade20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:44.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.053+0000 7fde87fff640 1 -- 172.21.15.46:0/2801973465 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f3eaaeb50 con 0x559f3e6ce1b0 2024-09-21T03:55:44.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.054+0000 7fde87fff640 1 --2- 172.21.15.46:0/2801973465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3e6ce1b0 0x559f3eaae360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fde78005820 tx=0x7fde78011780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80f7f891abe29e64 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:44.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.054+0000 7fde7effd640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T03:55:44.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.054+0000 7fde7effd640 1 -- 172.21.15.46:0/2801973465 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7801f070 con 0x559f3e6ce1b0 2024-09-21T03:55:44.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.054+0000 7fde7effd640 1 -- 172.21.15.46:0/2801973465 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fde780e8d50 con 0x559f3e6ce1b0 2024-09-21T03:55:44.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.054+0000 7fde9c0aa740 1 -- 172.21.15.46:0/2801973465 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde780d8170 con 0x559f3e6ce1b0 2024-09-21T03:55:44.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.055+0000 7fde7effd640 1 -- 172.21.15.46:0/2801973465 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fde780ac320 con 0x559f3e6ce1b0 2024-09-21T03:55:44.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.055+0000 7fde9c0aa740 10 client.25249 fetch_fsmap learned FSMap version 20 2024-09-21T03:55:44.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.055+0000 7fde9c0aa740 1 -- 172.21.15.46:0/2801973465 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x559f3eb2f230 con 0x559f3e6ce1b0 2024-09-21T03:55:44.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.055+0000 7fde7effd640 1 -- 172.21.15.46:0/2801973465 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde780d8170 con 0x559f3e6ce1b0 2024-09-21T03:55:44.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.056+0000 7fde7effd640 1 -- 172.21.15.46:0/2801973465 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fde78099070 con 0x559f3e6ce1b0 2024-09-21T03:55:44.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.056+0000 7fde9c0aa740 10 client.25249 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:55:44.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.056+0000 7fde9c0aa740 10 client.25249 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:55:44.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.056+0000 7fde9c0aa740 20 client.25249 populate_metadata read hostname 'smithi046' 2024-09-21T03:55:44.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.056+0000 7fde9c0aa740 1 --2- 172.21.15.46:0/2801973465 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x559f3e6f7070 0x559f3eb315d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:44.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.056+0000 7fde9c0aa740 4 client.25249 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:55:44.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.056+0000 7fde9c0aa740 1 -- 172.21.15.46:0/2801973465 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559f3ea12850 con 0x559f3e6f7070 2024-09-21T03:55:44.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.057+0000 7fde8f7fe640 1 --2- 172.21.15.46:0/2801973465 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x559f3e6f7070 0x559f3eb315d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:44.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.057+0000 7fde8f7fe640 1 --2- 172.21.15.46:0/2801973465 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x559f3e6f7070 0x559f3eb315d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfd40851738eee04 server_cookie=e3148cbea7f9e5a1 in_seq=0 out_seq=0 2024-09-21T03:55:44.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.057+0000 7fde7effd640 10 client.25249 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:44.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.057+0000 7fde7effd640 1 -- 172.21.15.46:0/2801973465 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x559f3ea12850 con 0x559f3e6f7070 2024-09-21T03:55:44.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.057+0000 7fde7effd640 10 client.25249 handle_command_reply: tid=0 2024-09-21T03:55:44.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.057+0000 7fde9c0aa740 1 client.25249 shutdown 2024-09-21T03:55:44.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.058+0000 7fde9c0aa740 1 -- 172.21.15.46:0/2801973465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3e6ce1b0 msgr2=0x559f3eaae360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:44.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.058+0000 7fde9c0aa740 1 --2- 172.21.15.46:0/2801973465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3e6ce1b0 0x559f3eaae360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fde78005820 tx=0x7fde78011780 comp rx=0 tx=0).stop 2024-09-21T03:55:44.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.058+0000 7fde9c0aa740 1 -- 172.21.15.46:0/2801973465 shutdown_connections 2024-09-21T03:55:44.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.058+0000 7fde9c0aa740 1 --2- 172.21.15.46:0/2801973465 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x559f3e6f7070 0x559f3eb315d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:44.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.058+0000 7fde7effd640 0 client.25249 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:44.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.058+0000 7fde9c0aa740 1 --2- 172.21.15.46:0/2801973465 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559f3e6d6390 0x559f3eb25520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:44.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.058+0000 7fde9c0aa740 1 --2- 172.21.15.46:0/2801973465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f3e6ce1b0 0x559f3eaae360 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:44.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.058+0000 7fde9c0aa740 1 --2- 172.21.15.46:0/2801973465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559f3e6b59f0 0x559f3eaade20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:44.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.058+0000 7fde9c0aa740 1 -- 172.21.15.46:0/2801973465 >> 172.21.15.46:0/2801973465 conn(0x559f3e6eb460 msgr2=0x559f3eaab4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:44.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.058+0000 7fde9c0aa740 1 -- 172.21.15.46:0/2801973465 shutdown_connections 2024-09-21T03:55:44.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.058+0000 7fde9c0aa740 1 -- 172.21.15.46:0/2801973465 wait complete. 2024-09-21T03:55:44.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.058+0000 7fde9c0aa740 20 client.25249 trim_cache size 0 max 16384 2024-09-21T03:55:44.062 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T03:55:44.062 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "no active scrubs running", 2024-09-21T03:55:44.062 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": {}, 2024-09-21T03:55:44.062 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_stats": { 2024-09-21T03:55:44.063 INFO:teuthology.orchestra.run.smithi046.stdout: "3bbf7097-70d7-4743-bbce-41465502b35b": { 2024-09-21T03:55:44.063 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:10.661441+0000", 2024-09-21T03:55:44.063 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:55:44.063 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:55:44.063 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:55:44.063 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:55:44.063 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:55:44.063 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:55:44.063 INFO:teuthology.orchestra.run.smithi046.stdout: "08f0c962-df1a-4129-a1a2-b916240d9803": { 2024-09-21T03:55:44.063 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:02.937596+0000", 2024-09-21T03:55:44.063 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:55:44.063 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:55:44.063 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:55:44.063 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:55:44.064 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:55:44.064 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:55:44.064 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:55:44.064 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T03:55:44.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.059+0000 7fde95b36640 1 -- 172.21.15.46:0/1944230147 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fde700b65f0 msgr2=0x7fde700b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:44.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.059+0000 7fde95b36640 1 --2- 172.21.15.46:0/1944230147 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fde700b65f0 0x7fde700b8b00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x559f3ea9cef0 tx=0x7fde8000b390 comp rx=0 tx=0).stop 2024-09-21T03:55:44.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.059+0000 7fde95b36640 1 -- 172.21.15.46:0/1944230147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde90105320 msgr2=0x7fde9019aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:44.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.059+0000 7fde95b36640 1 --2- 172.21.15.46:0/1944230147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde90105320 0x7fde9019aa20 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fde7800bcd0 tx=0x7fde78009610 comp rx=0 tx=0).stop 2024-09-21T03:55:44.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.059+0000 7fde95b36640 1 -- 172.21.15.46:0/1944230147 shutdown_connections 2024-09-21T03:55:44.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.059+0000 7fde95b36640 1 --2- 172.21.15.46:0/1944230147 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fde700b65f0 0x7fde700b8b00 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:44.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.059+0000 7fde95b36640 1 --2- 172.21.15.46:0/1944230147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde9010de30 0x7fde9019fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:44.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.059+0000 7fde95b36640 1 --2- 172.21.15.46:0/1944230147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde90105320 0x7fde9019aa20 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:44.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.059+0000 7fde95b36640 1 --2- 172.21.15.46:0/1944230147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde901049d0 0x7fde9019a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:44.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.059+0000 7fde95b36640 1 -- 172.21.15.46:0/1944230147 >> 172.21.15.46:0/1944230147 conn(0x7fde90079740 msgr2=0x7fde900ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:44.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.059+0000 7fde95b36640 1 -- 172.21.15.46:0/1944230147 shutdown_connections 2024-09-21T03:55:44.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:44.059+0000 7fde95b36640 1 -- 172.21.15.46:0/1944230147 wait complete. 2024-09-21T03:55:44.743 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:55:44.743 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:55:45.121 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:55:45.416 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:45 smithi046 ceph-mon[30954]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-21T03:55:45.567 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:45 smithi105 ceph-mon[34773]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-21T03:55:45.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:45 smithi162 ceph-mon[35071]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-21T03:55:45.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.714+0000 7fd00fdbb640 1 -- 172.21.15.46:0/358886158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd008109e00 msgr2=0x7fd008110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:45.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.714+0000 7fd00fdbb640 1 --2- 172.21.15.46:0/358886158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd008109e00 0x7fd008110630 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd000009ca0 tx=0x7fd00002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:55:45.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.714+0000 7fd00fdbb640 1 -- 172.21.15.46:0/358886158 shutdown_connections 2024-09-21T03:55:45.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.714+0000 7fd00fdbb640 1 --2- 172.21.15.46:0/358886158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd008109e00 0x7fd008110630 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:45.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.714+0000 7fd00fdbb640 1 --2- 172.21.15.46:0/358886158 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0081094b0 0x7fd0081098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:45.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.714+0000 7fd00fdbb640 1 --2- 172.21.15.46:0/358886158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd008101f70 0x7fd008102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:45.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.714+0000 7fd00fdbb640 1 -- 172.21.15.46:0/358886158 >> 172.21.15.46:0/358886158 conn(0x7fd008077c60 msgr2=0x7fd0080780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:45.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.714+0000 7fd00fdbb640 1 -- 172.21.15.46:0/358886158 shutdown_connections 2024-09-21T03:55:45.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.714+0000 7fd00fdbb640 1 -- 172.21.15.46:0/358886158 wait complete. 2024-09-21T03:55:45.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.715+0000 7fd00fdbb640 1 Processor -- start 2024-09-21T03:55:45.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.715+0000 7fd00fdbb640 1 -- start start 2024-09-21T03:55:45.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.716+0000 7fd00fdbb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd008101f70 0x7fd00819a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:45.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.716+0000 7fd00fdbb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0081094b0 0x7fd00819a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:45.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.716+0000 7fd00fdbb640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd008109e00 0x7fd00819fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:45.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.716+0000 7fd00fdbb640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd008113b70 con 0x7fd008101f70 2024-09-21T03:55:45.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.716+0000 7fd00fdbb640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd0081139f0 con 0x7fd0081094b0 2024-09-21T03:55:45.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.716+0000 7fd00fdbb640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd008113cf0 con 0x7fd008109e00 2024-09-21T03:55:45.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.716+0000 7fd00d356640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0081094b0 0x7fd00819a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:45.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.716+0000 7fd00d356640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0081094b0 0x7fd00819a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.46:55112/0 (socket says 172.21.15.46:55112) 2024-09-21T03:55:45.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.716+0000 7fd00d356640 1 -- 172.21.15.46:0/1040210914 learned_addr learned my addr 172.21.15.46:0/1040210914 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:45.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.716+0000 7fd00e358640 1 --2- 172.21.15.46:0/1040210914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd008109e00 0x7fd00819fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:45.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.717+0000 7fd00db57640 1 --2- 172.21.15.46:0/1040210914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd008101f70 0x7fd00819a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:45.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.717+0000 7fd00d356640 1 -- 172.21.15.46:0/1040210914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd008109e00 msgr2=0x7fd00819fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:45.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.717+0000 7fd00d356640 1 --2- 172.21.15.46:0/1040210914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd008109e00 0x7fd00819fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:45.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.717+0000 7fd00d356640 1 -- 172.21.15.46:0/1040210914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd008101f70 msgr2=0x7fd00819a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:45.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.717+0000 7fd00d356640 1 --2- 172.21.15.46:0/1040210914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd008101f70 0x7fd00819a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:45.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.717+0000 7fd00d356640 1 -- 172.21.15.46:0/1040210914 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0081a0240 con 0x7fd0081094b0 2024-09-21T03:55:45.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.717+0000 7fd00db57640 1 --2- 172.21.15.46:0/1040210914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd008101f70 0x7fd00819a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:55:45.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.717+0000 7fd00d356640 1 --2- 172.21.15.46:0/1040210914 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0081094b0 0x7fd00819a870 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcff800d740 tx=0x7fcff800dc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:45.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.717+0000 7fcffeffd640 1 -- 172.21.15.46:0/1040210914 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff8017070 con 0x7fd0081094b0 2024-09-21T03:55:45.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.717+0000 7fcffeffd640 1 -- 172.21.15.46:0/1040210914 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcff800de50 con 0x7fd0081094b0 2024-09-21T03:55:45.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.717+0000 7fd00fdbb640 1 -- 172.21.15.46:0/1040210914 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0081a0530 con 0x7fd0081094b0 2024-09-21T03:55:45.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.717+0000 7fcffeffd640 1 -- 172.21.15.46:0/1040210914 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff800f620 con 0x7fd0081094b0 2024-09-21T03:55:45.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.718+0000 7fd00fdbb640 1 -- 172.21.15.46:0/1040210914 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0081a6c90 con 0x7fd0081094b0 2024-09-21T03:55:45.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.719+0000 7fd00fdbb640 1 -- 172.21.15.46:0/1040210914 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd00819b400 con 0x7fd0081094b0 2024-09-21T03:55:45.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.721+0000 7fcffeffd640 1 -- 172.21.15.46:0/1040210914 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 22) ==== 154586+0+0 (secure 0 0 0) 0x7fcff801a070 con 0x7fd0081094b0 2024-09-21T03:55:45.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.722+0000 7fcffeffd640 1 --2- 172.21.15.46:0/1040210914 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fcff40b65f0 0x7fcff40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:45.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.723+0000 7fcffeffd640 1 -- 172.21.15.46:0/1040210914 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fcff80e6fa0 con 0x7fd0081094b0 2024-09-21T03:55:45.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.723+0000 7fd00db57640 1 --2- 172.21.15.46:0/1040210914 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fcff40b65f0 0x7fcff40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:45.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.723+0000 7fd00db57640 1 --2- 172.21.15.46:0/1040210914 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fcff40b65f0 0x7fcff40b8b00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd004006fd0 tx=0x7fd004008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:45.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:45.727+0000 7fcffeffd640 1 -- 172.21.15.46:0/1040210914 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcff80ad650 con 0x7fd0081094b0 2024-09-21T03:55:46.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:46.031+0000 7fd00fdbb640 1 -- 172.21.15.46:0/1040210914 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd0081a71c0 con 0x7fd0081094b0 2024-09-21T03:55:46.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:46.032+0000 7fcffeffd640 1 -- 172.21.15.46:0/1040210914 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7fcff80b1a30 con 0x7fd0081094b0 2024-09-21T03:55:46.035 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:55:46.035 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"btime":"2024-09-21T03:53:23:865820+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1766354184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1766354184},{"type":"v1","addr":"172.21.15.46:6839","nonce":1766354184}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/1901774207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":1901774207},{"type":"v1","addr":"172.21.15.46:6841","nonce":1901774207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3548633196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":3548633196},{"type":"v1","addr":"172.21.15.105:6837","nonce":3548633196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24652,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3551934241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3551934241},{"type":"v1","addr":"172.21.15.162:6835","nonce":3551934241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/48949822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":48949822},{"type":"v1","addr":"172.21.15.162:6837","nonce":48949822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:53:14.452819+0000","modified":"2024-09-21T03:53:23.593278+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24680},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/2196053213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2196053213},{"type":"v1","addr":"172.21.15.162:6839","nonce":2196053213}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.105:6839/3911438406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":3911438406},{"type":"v1","addr":"172.21.15.105:6839","nonce":3911438406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24680,"qdb_cluster":[24680]},"id":1}]} 2024-09-21T03:55:46.035 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T03:55:46.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:46.034+0000 7fd00fdbb640 1 -- 172.21.15.46:0/1040210914 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fcff40b65f0 msgr2=0x7fcff40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:46.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:46.034+0000 7fd00fdbb640 1 --2- 172.21.15.46:0/1040210914 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fcff40b65f0 0x7fcff40b8b00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd004006fd0 tx=0x7fd004008040 comp rx=0 tx=0).stop 2024-09-21T03:55:46.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:46.034+0000 7fd00fdbb640 1 -- 172.21.15.46:0/1040210914 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0081094b0 msgr2=0x7fd00819a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:46.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:46.034+0000 7fd00fdbb640 1 --2- 172.21.15.46:0/1040210914 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0081094b0 0x7fd00819a870 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcff800d740 tx=0x7fcff800dc00 comp rx=0 tx=0).stop 2024-09-21T03:55:46.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:46.035+0000 7fd00fdbb640 1 -- 172.21.15.46:0/1040210914 shutdown_connections 2024-09-21T03:55:46.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:46.035+0000 7fd00fdbb640 1 --2- 172.21.15.46:0/1040210914 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fcff40b65f0 0x7fcff40b8b00 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:46.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:46.035+0000 7fd00fdbb640 1 --2- 172.21.15.46:0/1040210914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd008109e00 0x7fd00819fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:46.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:46.035+0000 7fd00fdbb640 1 --2- 172.21.15.46:0/1040210914 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0081094b0 0x7fd00819a870 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:46.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:46.035+0000 7fd00fdbb640 1 --2- 172.21.15.46:0/1040210914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd008101f70 0x7fd00819a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:46.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:46.035+0000 7fd00fdbb640 1 -- 172.21.15.46:0/1040210914 >> 172.21.15.46:0/1040210914 conn(0x7fd008077c60 msgr2=0x7fd008100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:46.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:46.035+0000 7fd00fdbb640 1 -- 172.21.15.46:0/1040210914 shutdown_connections 2024-09-21T03:55:46.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:46.035+0000 7fd00fdbb640 1 -- 172.21.15.46:0/1040210914 wait complete. 2024-09-21T03:55:46.420 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:46 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/1040210914' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:55:46.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:46 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/1040210914' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:55:46.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:46 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/1040210914' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:55:46.774 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:55:47.184 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:55:47.463 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:47 smithi046 ceph-mon[30954]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 938 B/s wr, 1 op/s 2024-09-21T03:55:47.567 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:47 smithi105 ceph-mon[34773]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 938 B/s wr, 1 op/s 2024-09-21T03:55:47.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:47 smithi162 ceph-mon[35071]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 938 B/s wr, 1 op/s 2024-09-21T03:55:47.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.770+0000 7f74f5593640 1 -- 172.21.15.46:0/4142343731 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74f01094b0 msgr2=0x7f74f01098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:47.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.770+0000 7f74f5593640 1 --2- 172.21.15.46:0/4142343731 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74f01094b0 0x7f74f01098c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f74e4009900 tx=0x7f74e402a410 comp rx=0 tx=0).stop 2024-09-21T03:55:47.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.770+0000 7f74f5593640 1 -- 172.21.15.46:0/4142343731 shutdown_connections 2024-09-21T03:55:47.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.770+0000 7f74f5593640 1 --2- 172.21.15.46:0/4142343731 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74f0109e00 0x7f74f0110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:47.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.770+0000 7f74f5593640 1 --2- 172.21.15.46:0/4142343731 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74f01094b0 0x7f74f01098c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:47.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.770+0000 7f74f5593640 1 --2- 172.21.15.46:0/4142343731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74f0103bc0 0x7f74f0103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:47.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.770+0000 7f74f5593640 1 -- 172.21.15.46:0/4142343731 >> 172.21.15.46:0/4142343731 conn(0x7f74f007b910 msgr2=0x7f74f007bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:47.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.771+0000 7f74f5593640 1 -- 172.21.15.46:0/4142343731 shutdown_connections 2024-09-21T03:55:47.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.771+0000 7f74f5593640 1 -- 172.21.15.46:0/4142343731 wait complete. 2024-09-21T03:55:47.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.772+0000 7f74f5593640 1 Processor -- start 2024-09-21T03:55:47.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.772+0000 7f74f5593640 1 -- start start 2024-09-21T03:55:47.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.773+0000 7f74f5593640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74f0103bc0 0x7f74f019a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:47.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.773+0000 7f74f5593640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74f01094b0 0x7f74f019aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:47.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.773+0000 7f74f5593640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74f0109e00 0x7f74f019fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:47.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.773+0000 7f74f5593640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f74f0113b10 con 0x7f74f01094b0 2024-09-21T03:55:47.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.773+0000 7f74f5593640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f74f0113990 con 0x7f74f0109e00 2024-09-21T03:55:47.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.773+0000 7f74f5593640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f74f0113c90 con 0x7f74f0103bc0 2024-09-21T03:55:47.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.773+0000 7f74ef7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74f0109e00 0x7f74f019fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:47.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.773+0000 7f74ef7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74f0109e00 0x7f74f019fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.46:55132/0 (socket says 172.21.15.46:55132) 2024-09-21T03:55:47.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.773+0000 7f74ef7fe640 1 -- 172.21.15.46:0/3039002677 learned_addr learned my addr 172.21.15.46:0/3039002677 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:47.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.774+0000 7f74ee7fc640 1 --2- 172.21.15.46:0/3039002677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74f01094b0 0x7f74f019aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:47.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.774+0000 7f74ef7fe640 1 -- 172.21.15.46:0/3039002677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74f0103bc0 msgr2=0x7f74f019a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:47.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.774+0000 7f74eeffd640 1 --2- 172.21.15.46:0/3039002677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74f0103bc0 0x7f74f019a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:47.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.774+0000 7f74ef7fe640 1 --2- 172.21.15.46:0/3039002677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74f0103bc0 0x7f74f019a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:47.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.774+0000 7f74ef7fe640 1 -- 172.21.15.46:0/3039002677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74f01094b0 msgr2=0x7f74f019aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:47.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.774+0000 7f74ef7fe640 1 --2- 172.21.15.46:0/3039002677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74f01094b0 0x7f74f019aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:47.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.774+0000 7f74ef7fe640 1 -- 172.21.15.46:0/3039002677 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f01a03d0 con 0x7f74f0109e00 2024-09-21T03:55:47.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.774+0000 7f74ee7fc640 1 --2- 172.21.15.46:0/3039002677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74f01094b0 0x7f74f019aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:55:47.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.774+0000 7f74eeffd640 1 --2- 172.21.15.46:0/3039002677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74f0103bc0 0x7f74f019a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:55:47.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.774+0000 7f74ef7fe640 1 --2- 172.21.15.46:0/3039002677 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74f0109e00 0x7f74f019fca0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f74e800eb10 tx=0x7f74e800c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:47.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.775+0000 7f74d7fff640 1 -- 172.21.15.46:0/3039002677 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e8004b20 con 0x7f74f0109e00 2024-09-21T03:55:47.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.775+0000 7f74d7fff640 1 -- 172.21.15.46:0/3039002677 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74e8004cc0 con 0x7f74f0109e00 2024-09-21T03:55:47.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.775+0000 7f74d7fff640 1 -- 172.21.15.46:0/3039002677 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e8010670 con 0x7f74f0109e00 2024-09-21T03:55:47.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.775+0000 7f74f5593640 1 -- 172.21.15.46:0/3039002677 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74f01a06c0 con 0x7f74f0109e00 2024-09-21T03:55:47.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.775+0000 7f74f5593640 1 -- 172.21.15.46:0/3039002677 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74f00755f0 con 0x7f74f0109e00 2024-09-21T03:55:47.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.778+0000 7f74fbb07740 1 Processor -- start 2024-09-21T03:55:47.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.779+0000 7f74d7fff640 1 -- 172.21.15.46:0/3039002677 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 22) ==== 154586+0+0 (secure 0 0 0) 0x7f74e8005020 con 0x7f74f0109e00 2024-09-21T03:55:47.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.779+0000 7f74fbb07740 1 -- start start 2024-09-21T03:55:47.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.779+0000 7f74fbb07740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b317df070 0x556b31b862c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:47.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.779+0000 7f74fbb07740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b317b61b0 0x556b31b86800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:47.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.779+0000 7f74fbb07740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b317be390 0x556b31b86d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:47.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.779+0000 7f74fbb07740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x556b31afcea0 con 0x556b317b61b0 2024-09-21T03:55:47.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.779+0000 7f74fbb07740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x556b31aec2d0 con 0x556b317df070 2024-09-21T03:55:47.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.779+0000 7f74fbb07740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556b31af00e0 con 0x556b317be390 2024-09-21T03:55:47.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.780+0000 7f74eeffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b317b61b0 0x556b31b86800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:47.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.780+0000 7f74ee7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b317be390 0x556b31b86d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:47.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.780+0000 7f74eeffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b317b61b0 0x556b31b86800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44018/0 (socket says 172.21.15.46:44018) 2024-09-21T03:55:47.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.780+0000 7f74eeffd640 1 -- 172.21.15.46:0/2343474631 learned_addr learned my addr 172.21.15.46:0/2343474631 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:47.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.780+0000 7f74ee7fc640 1 --2- 172.21.15.46:0/2343474631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b317df070 0x556b31b862c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:47.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.780+0000 7f74eeffd640 1 -- 172.21.15.46:0/2343474631 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b317be390 msgr2=0x556b31b86d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:47.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.780+0000 7f74eeffd640 1 --2- 172.21.15.46:0/2343474631 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b317be390 0x556b31b86d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:47.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.780+0000 7f74eeffd640 1 -- 172.21.15.46:0/2343474631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b317df070 msgr2=0x556b31b862c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:47.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.780+0000 7f74eeffd640 1 --2- 172.21.15.46:0/2343474631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b317df070 0x556b31b862c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:47.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.780+0000 7f74eeffd640 1 -- 172.21.15.46:0/2343474631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b3184a650 con 0x556b317b61b0 2024-09-21T03:55:47.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.780+0000 7f74ee7fc640 1 --2- 172.21.15.46:0/2343474631 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b317be390 0x556b31b86d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:55:47.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.780+0000 7f74d7fff640 1 --2- 172.21.15.46:0/3039002677 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f74d80b6670 0x7f74d80b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:47.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.780+0000 7f74eeffd640 1 --2- 172.21.15.46:0/2343474631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b317b61b0 0x556b31b86800 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f74e0009c30 tx=0x7f74e0010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d341026dd50c66fb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:47.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.781+0000 7f74d7fff640 1 -- 172.21.15.46:0/3039002677 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f74e80e7c80 con 0x7f74f0109e00 2024-09-21T03:55:47.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.781+0000 7f74d57fa640 1 -- 172.21.15.46:0/2343474631 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e0004020 con 0x556b317b61b0 2024-09-21T03:55:47.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.781+0000 7f74d57fa640 1 -- 172.21.15.46:0/2343474631 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74e00041c0 con 0x556b317b61b0 2024-09-21T03:55:47.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.781+0000 7f74d57fa640 1 -- 172.21.15.46:0/2343474631 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e00126b0 con 0x556b317b61b0 2024-09-21T03:55:47.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.781+0000 7f74ee7fc640 1 --2- 172.21.15.46:0/3039002677 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f74d80b6670 0x7f74d80b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:47.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.782+0000 7f74fbb07740 1 -- 172.21.15.46:0/2343474631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b317b61b0 msgr2=0x556b31b86800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:47.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.782+0000 7f74fbb07740 1 --2- 172.21.15.46:0/2343474631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b317b61b0 0x556b31b86800 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f74e0009c30 tx=0x7f74e0010740 comp rx=0 tx=0).stop 2024-09-21T03:55:47.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.782+0000 7f74ee7fc640 1 --2- 172.21.15.46:0/3039002677 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f74d80b6670 0x7f74d80b8b80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f74e402a930 tx=0x7f74e402a410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:47.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.782+0000 7f74fbb07740 1 -- 172.21.15.46:0/2343474631 shutdown_connections 2024-09-21T03:55:47.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.782+0000 7f74fbb07740 1 --2- 172.21.15.46:0/2343474631 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b317be390 0x556b31b86d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:47.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.782+0000 7f74fbb07740 1 --2- 172.21.15.46:0/2343474631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b317b61b0 0x556b31b86800 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:47.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.782+0000 7f74fbb07740 1 --2- 172.21.15.46:0/2343474631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b317df070 0x556b31b862c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:47.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.782+0000 7f74fbb07740 1 -- 172.21.15.46:0/2343474631 >> 172.21.15.46:0/2343474631 conn(0x556b317d3460 msgr2=0x556b31b841b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:47.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.782+0000 7f74fbb07740 1 -- 172.21.15.46:0/2343474631 shutdown_connections 2024-09-21T03:55:47.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.782+0000 7f74fbb07740 1 -- 172.21.15.46:0/2343474631 wait complete. 2024-09-21T03:55:47.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.783+0000 7f74fbb07740 1 -- start start 2024-09-21T03:55:47.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.783+0000 7f74fbb07740 1 Processor -- start 2024-09-21T03:55:47.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.783+0000 7f74fbb07740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b317b61b0 0x556b31b9a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:47.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.783+0000 7f74fbb07740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b317be390 0x556b31b9a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:47.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.783+0000 7f74fbb07740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b317df070 0x556b31ba6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:47.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.783+0000 7f74fbb07740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x556b3194d700 con 0x556b317b61b0 2024-09-21T03:55:47.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.784+0000 7f74fbb07740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x556b31a87160 con 0x556b317be390 2024-09-21T03:55:47.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.784+0000 7f74fbb07740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556b31b9d1d0 con 0x556b317df070 2024-09-21T03:55:47.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.784+0000 7f74fbb07740 10 client.0 _ll_register_callbacks cb 0x556b31aa09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:55:47.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.784+0000 7f74eeffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b317b61b0 0x556b31b9a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:47.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.784+0000 7f74eeffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b317b61b0 0x556b31b9a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44022/0 (socket says 172.21.15.46:44022) 2024-09-21T03:55:47.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.784+0000 7f74eeffd640 1 -- 172.21.15.46:0/1971626754 learned_addr learned my addr 172.21.15.46:0/1971626754 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:47.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.784+0000 7f74eeffd640 1 -- 172.21.15.46:0/1971626754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b317df070 msgr2=0x556b31ba6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:47.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.784+0000 7f74eeffd640 1 --2- 172.21.15.46:0/1971626754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b317df070 0x556b31ba6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:47.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.784+0000 7f74eeffd640 1 -- 172.21.15.46:0/1971626754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b317be390 msgr2=0x556b31b9a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:47.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.784+0000 7f74ee7fc640 1 --2- 172.21.15.46:0/1971626754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b317be390 0x556b31b9a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:47.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.784+0000 7f74eeffd640 1 --2- 172.21.15.46:0/1971626754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b317be390 0x556b31b9a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:47.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.784+0000 7f74eeffd640 1 -- 172.21.15.46:0/1971626754 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b31ab4c90 con 0x556b317b61b0 2024-09-21T03:55:47.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.784+0000 7f74ee7fc640 1 --2- 172.21.15.46:0/1971626754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b317be390 0x556b31b9a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:55:47.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.785+0000 7f74eeffd640 1 --2- 172.21.15.46:0/1971626754 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b317b61b0 0x556b31b9a180 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f74e0003cf0 tx=0x7f74e0009770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45df298a64c4ee28 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:47.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.785+0000 7f74d2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:55:47.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.785+0000 7f74d2ff5640 1 -- 172.21.15.46:0/1971626754 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e002a060 con 0x556b317b61b0 2024-09-21T03:55:47.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.785+0000 7f74fbb07740 1 -- 172.21.15.46:0/1971626754 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74e00041c0 con 0x556b317b61b0 2024-09-21T03:55:47.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.785+0000 7f74d2ff5640 1 -- 172.21.15.46:0/1971626754 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f74e00037f0 con 0x556b317b61b0 2024-09-21T03:55:47.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.785+0000 7f74d2ff5640 1 -- 172.21.15.46:0/1971626754 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f74e0025470 con 0x556b317b61b0 2024-09-21T03:55:47.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.785+0000 7f74fbb07740 10 client.15549 fetch_fsmap learned FSMap version 20 2024-09-21T03:55:47.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.785+0000 7f74fbb07740 1 -- 172.21.15.46:0/1971626754 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x556b31b8ea40 con 0x556b317b61b0 2024-09-21T03:55:47.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.786+0000 7f74d2ff5640 1 -- 172.21.15.46:0/1971626754 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74e00041c0 con 0x556b317b61b0 2024-09-21T03:55:47.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.786+0000 7f74d2ff5640 1 -- 172.21.15.46:0/1971626754 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f74e000f040 con 0x556b317b61b0 2024-09-21T03:55:47.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.786+0000 7f74fbb07740 10 client.15549 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:55:47.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.786+0000 7f74fbb07740 10 client.15549 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:55:47.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.786+0000 7f74fbb07740 20 client.15549 populate_metadata read hostname 'smithi046' 2024-09-21T03:55:47.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.786+0000 7f74fbb07740 1 --2- 172.21.15.46:0/1971626754 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x556b3179d9f0 0x556b31b91e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:47.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.786+0000 7f74fbb07740 4 client.15549 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:55:47.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.786+0000 7f74fbb07740 1 -- 172.21.15.46:0/1971626754 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b31afedf0 con 0x556b3179d9f0 2024-09-21T03:55:47.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.786+0000 7f74ee7fc640 1 --2- 172.21.15.46:0/1971626754 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x556b3179d9f0 0x556b31b91e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:47.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.787+0000 7f74d2ff5640 10 client.15549 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:47.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.787+0000 7f74ee7fc640 1 --2- 172.21.15.46:0/1971626754 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x556b3179d9f0 0x556b31b91e00 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5996eaf29fdba5bd server_cookie=7b8eb5b93e403b1b in_seq=0 out_seq=0 2024-09-21T03:55:47.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.788+0000 7f74d2ff5640 1 -- 172.21.15.46:0/1971626754 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556b31afedf0 con 0x556b3179d9f0 2024-09-21T03:55:47.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.788+0000 7f74d2ff5640 10 client.15549 handle_command_reply: tid=0 2024-09-21T03:55:47.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.788+0000 7f74fbb07740 1 client.15549 shutdown 2024-09-21T03:55:47.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.788+0000 7f74fbb07740 1 -- 172.21.15.46:0/1971626754 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b317b61b0 msgr2=0x556b31b9a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:47.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.788+0000 7f74fbb07740 1 --2- 172.21.15.46:0/1971626754 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b317b61b0 0x556b31b9a180 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f74e0003cf0 tx=0x7f74e0009770 comp rx=0 tx=0).stop 2024-09-21T03:55:47.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.788+0000 7f74fbb07740 1 -- 172.21.15.46:0/1971626754 shutdown_connections 2024-09-21T03:55:47.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.788+0000 7f74fbb07740 1 --2- 172.21.15.46:0/1971626754 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x556b3179d9f0 0x556b31b91e00 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:47.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.788+0000 7f74fbb07740 1 --2- 172.21.15.46:0/1971626754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b317df070 0x556b31ba6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:47.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.788+0000 7f74fbb07740 1 --2- 172.21.15.46:0/1971626754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b317be390 0x556b31b9a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:47.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.788+0000 7f74d2ff5640 0 client.15549 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:47.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.788+0000 7f74fbb07740 1 --2- 172.21.15.46:0/1971626754 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b317b61b0 0x556b31b9a180 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:47.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.788+0000 7f74fbb07740 1 -- 172.21.15.46:0/1971626754 >> 172.21.15.46:0/1971626754 conn(0x556b317d3460 msgr2=0x556b31b82750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:47.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.788+0000 7f74fbb07740 1 -- 172.21.15.46:0/1971626754 shutdown_connections 2024-09-21T03:55:47.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.789+0000 7f74fbb07740 1 -- 172.21.15.46:0/1971626754 wait complete. 2024-09-21T03:55:47.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.789+0000 7f74fbb07740 20 client.15549 trim_cache size 0 max 16384 2024-09-21T03:55:47.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.815+0000 7f74fbb07740 1 Processor -- start 2024-09-21T03:55:47.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.815+0000 7f74fbb07740 1 -- start start 2024-09-21T03:55:47.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.815+0000 7f74fbb07740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b3179d9f0 0x556b31ba6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:47.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.815+0000 7f74fbb07740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b317b61b0 0x556b31b99f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:47.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.816+0000 7f74fbb07740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b317be390 0x556b31b9a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:47.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.816+0000 7f74fbb07740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f74f01ab3d0 con 0x556b3179d9f0 2024-09-21T03:55:47.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.816+0000 7f74fbb07740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f74f01adc30 con 0x556b317be390 2024-09-21T03:55:47.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.816+0000 7f74fbb07740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f74f01aba20 con 0x556b317b61b0 2024-09-21T03:55:47.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.816+0000 7f74eeffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b3179d9f0 0x556b31ba6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:47.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.816+0000 7f74ef7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b317be390 0x556b31b9a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:47.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.816+0000 7f74ef7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b317be390 0x556b31b9a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.46:55170/0 (socket says 172.21.15.46:55170) 2024-09-21T03:55:47.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.816+0000 7f74ee7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b317b61b0 0x556b31b99f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:47.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.816+0000 7f74ef7fe640 1 -- 172.21.15.46:0/2991141868 learned_addr learned my addr 172.21.15.46:0/2991141868 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:47.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.816+0000 7f74ef7fe640 1 -- 172.21.15.46:0/2991141868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b317b61b0 msgr2=0x556b31b99f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:47.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.816+0000 7f74ef7fe640 1 --2- 172.21.15.46:0/2991141868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b317b61b0 0x556b31b99f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:47.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.816+0000 7f74ef7fe640 1 -- 172.21.15.46:0/2991141868 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b3179d9f0 msgr2=0x556b31ba6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:47.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.816+0000 7f74ef7fe640 1 --2- 172.21.15.46:0/2991141868 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b3179d9f0 0x556b31ba6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:47.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.816+0000 7f74ef7fe640 1 -- 172.21.15.46:0/2991141868 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b31b92260 con 0x556b317be390 2024-09-21T03:55:47.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.817+0000 7f74ef7fe640 1 --2- 172.21.15.46:0/2991141868 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b317be390 0x556b31b9a470 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f74e80ad8f0 tx=0x7f74e80ad9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61763528296081c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:47.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.817+0000 7f74d4ff9640 1 -- 172.21.15.46:0/2991141868 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e80ad360 con 0x556b317be390 2024-09-21T03:55:47.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.817+0000 7f74d4ff9640 1 -- 172.21.15.46:0/2991141868 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74e80ad700 con 0x556b317be390 2024-09-21T03:55:47.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.817+0000 7f74d4ff9640 1 -- 172.21.15.46:0/2991141868 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e80b7180 con 0x556b317be390 2024-09-21T03:55:47.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.818+0000 7f74fbb07740 1 -- 172.21.15.46:0/2991141868 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b317be390 msgr2=0x556b31b9a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:47.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.818+0000 7f74fbb07740 1 --2- 172.21.15.46:0/2991141868 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b317be390 0x556b31b9a470 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f74e80ad8f0 tx=0x7f74e80ad9c0 comp rx=0 tx=0).stop 2024-09-21T03:55:47.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.818+0000 7f74fbb07740 1 -- 172.21.15.46:0/2991141868 shutdown_connections 2024-09-21T03:55:47.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.818+0000 7f74fbb07740 1 --2- 172.21.15.46:0/2991141868 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b317be390 0x556b31b9a470 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:47.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.818+0000 7f74fbb07740 1 --2- 172.21.15.46:0/2991141868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b317b61b0 0x556b31b99f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:47.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.818+0000 7f74fbb07740 1 --2- 172.21.15.46:0/2991141868 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b3179d9f0 0x556b31ba6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:47.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.818+0000 7f74fbb07740 1 -- 172.21.15.46:0/2991141868 >> 172.21.15.46:0/2991141868 conn(0x556b317d3460 msgr2=0x556b31b98a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:47.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.818+0000 7f74fbb07740 1 -- 172.21.15.46:0/2991141868 shutdown_connections 2024-09-21T03:55:47.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.818+0000 7f74fbb07740 1 -- 172.21.15.46:0/2991141868 wait complete. 2024-09-21T03:55:47.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.819+0000 7f74fbb07740 1 -- start start 2024-09-21T03:55:47.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.819+0000 7f74fbb07740 1 Processor -- start 2024-09-21T03:55:47.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.820+0000 7f74fbb07740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b3179d9f0 0x556b31bbbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:47.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.820+0000 7f74fbb07740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b317b61b0 0x556b31bbc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:47.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.820+0000 7f74eeffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b3179d9f0 0x556b31bbbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:47.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.820+0000 7f74eeffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b3179d9f0 0x556b31bbbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44046/0 (socket says 172.21.15.46:44046) 2024-09-21T03:55:47.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.820+0000 7f74eeffd640 1 -- 172.21.15.46:0/2984965561 learned_addr learned my addr 172.21.15.46:0/2984965561 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:47.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.820+0000 7f74fbb07740 1 --2- 172.21.15.46:0/2984965561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b317be390 0x556b31ba1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:47.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.820+0000 7f74fbb07740 1 -- 172.21.15.46:0/2984965561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f74f01ac0f0 con 0x556b3179d9f0 2024-09-21T03:55:47.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.820+0000 7f74fbb07740 1 -- 172.21.15.46:0/2984965561 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f74f01ad560 con 0x556b317be390 2024-09-21T03:55:47.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.820+0000 7f74fbb07740 1 -- 172.21.15.46:0/2984965561 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f74f01ac7c0 con 0x556b317b61b0 2024-09-21T03:55:47.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.820+0000 7f74ee7fc640 1 --2- 172.21.15.46:0/2984965561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b317b61b0 0x556b31bbc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:47.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.821+0000 7f74eeffd640 1 -- 172.21.15.46:0/2984965561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b317b61b0 msgr2=0x556b31bbc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:47.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.821+0000 7f74eeffd640 1 --2- 172.21.15.46:0/2984965561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b317b61b0 0x556b31bbc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:47.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.821+0000 7f74eeffd640 1 -- 172.21.15.46:0/2984965561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b317be390 msgr2=0x556b31ba1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:47.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.821+0000 7f74ef7fe640 1 --2- 172.21.15.46:0/2984965561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b317be390 0x556b31ba1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:47.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.821+0000 7f74eeffd640 1 --2- 172.21.15.46:0/2984965561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b317be390 0x556b31ba1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:47.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.821+0000 7f74eeffd640 1 -- 172.21.15.46:0/2984965561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b31ba19a0 con 0x556b3179d9f0 2024-09-21T03:55:47.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.821+0000 7f74ef7fe640 1 --2- 172.21.15.46:0/2984965561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b317be390 0x556b31ba1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:55:47.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.821+0000 7f74eeffd640 1 --2- 172.21.15.46:0/2984965561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b3179d9f0 0x556b31bbbea0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f74e0003cf0 tx=0x7f74e0009370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69634300c1fc53fd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:47.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.821+0000 7f74d2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:55:47.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.821+0000 7f74fbb07740 10 client.0 _ll_register_callbacks cb 0x7f74e0009ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:55:47.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.821+0000 7f74fbb07740 1 -- 172.21.15.46:0/2984965561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74e80ad700 con 0x556b3179d9f0 2024-09-21T03:55:47.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.821+0000 7f74d2ff5640 1 -- 172.21.15.46:0/2984965561 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e002a040 con 0x556b3179d9f0 2024-09-21T03:55:47.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.821+0000 7f74d2ff5640 1 -- 172.21.15.46:0/2984965561 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f74e0005230 con 0x556b3179d9f0 2024-09-21T03:55:47.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.822+0000 7f74d2ff5640 1 -- 172.21.15.46:0/2984965561 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f74e0005850 con 0x556b3179d9f0 2024-09-21T03:55:47.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.822+0000 7f74fbb07740 10 client.15555 fetch_fsmap learned FSMap version 20 2024-09-21T03:55:47.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.822+0000 7f74fbb07740 1 -- 172.21.15.46:0/2984965561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({fsmap=20}) -- 0x556b31ba2aa0 con 0x556b3179d9f0 2024-09-21T03:55:47.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.822+0000 7f74d2ff5640 1 -- 172.21.15.46:0/2984965561 <== mon.0 v2:172.21.15.46:3300/0 4 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f74e0005430 con 0x556b3179d9f0 2024-09-21T03:55:47.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.822+0000 7f74fbb07740 10 client.15555 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:55:47.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.822+0000 7f74fbb07740 10 client.15555 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:55:47.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.822+0000 7f74fbb07740 20 client.15555 populate_metadata read hostname 'smithi046' 2024-09-21T03:55:47.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.822+0000 7f74fbb07740 1 --2- 172.21.15.46:0/2984965561 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x556b317df070 0x556b31c21c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:47.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.822+0000 7f74fbb07740 4 client.15555 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:55:47.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.822+0000 7f74fbb07740 1 -- 172.21.15.46:0/2984965561 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f74e80ad700 con 0x556b317df070 2024-09-21T03:55:47.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.823+0000 7f74ee7fc640 1 --2- 172.21.15.46:0/2984965561 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x556b317df070 0x556b31c21c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:47.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.823+0000 7f74ee7fc640 1 --2- 172.21.15.46:0/2984965561 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x556b317df070 0x556b31c21c80 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f90d148aaf4ee2c8 server_cookie=a4d2b18575c15759 in_seq=0 out_seq=0 2024-09-21T03:55:47.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.823+0000 7f74d2ff5640 10 client.15555 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:47.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.823+0000 7f74d2ff5640 1 -- 172.21.15.46:0/2984965561 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f74e80ad700 con 0x556b317df070 2024-09-21T03:55:47.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.823+0000 7f74d2ff5640 10 client.15555 handle_command_reply: tid=0 2024-09-21T03:55:47.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.823+0000 7f74fbb07740 1 client.15555 shutdown 2024-09-21T03:55:47.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.824+0000 7f74fbb07740 1 -- 172.21.15.46:0/2984965561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b3179d9f0 msgr2=0x556b31bbbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:47.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.824+0000 7f74fbb07740 1 --2- 172.21.15.46:0/2984965561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b3179d9f0 0x556b31bbbea0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f74e0003cf0 tx=0x7f74e0009370 comp rx=0 tx=0).stop 2024-09-21T03:55:47.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.824+0000 7f74fbb07740 1 -- 172.21.15.46:0/2984965561 shutdown_connections 2024-09-21T03:55:47.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.824+0000 7f74fbb07740 1 --2- 172.21.15.46:0/2984965561 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x556b317df070 0x556b31c21c80 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:47.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.824+0000 7f74fbb07740 1 --2- 172.21.15.46:0/2984965561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556b317be390 0x556b31ba1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:47.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.824+0000 7f74fbb07740 1 --2- 172.21.15.46:0/2984965561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556b317b61b0 0x556b31bbc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:47.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.824+0000 7f74d2ff5640 0 client.15555 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:47.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.824+0000 7f74fbb07740 1 --2- 172.21.15.46:0/2984965561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556b3179d9f0 0x556b31bbbea0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:47.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.824+0000 7f74fbb07740 1 -- 172.21.15.46:0/2984965561 >> 172.21.15.46:0/2984965561 conn(0x556b317d3460 msgr2=0x556b31b83ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:47.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.824+0000 7f74fbb07740 1 -- 172.21.15.46:0/2984965561 shutdown_connections 2024-09-21T03:55:47.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.824+0000 7f74fbb07740 1 -- 172.21.15.46:0/2984965561 wait complete. 2024-09-21T03:55:47.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.824+0000 7f74fbb07740 20 client.15555 trim_cache size 0 max 16384 2024-09-21T03:55:47.829 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-21T03:55:47.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.825+0000 7f74f5593640 1 -- 172.21.15.46:0/3039002677 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f74d80b6670 msgr2=0x7f74d80b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:47.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.825+0000 7f74f5593640 1 --2- 172.21.15.46:0/3039002677 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f74d80b6670 0x7f74d80b8b80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f74e402a930 tx=0x7f74e402a410 comp rx=0 tx=0).stop 2024-09-21T03:55:47.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.825+0000 7f74f5593640 1 -- 172.21.15.46:0/3039002677 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74f0109e00 msgr2=0x7f74f019fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:47.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.825+0000 7f74f5593640 1 --2- 172.21.15.46:0/3039002677 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74f0109e00 0x7f74f019fca0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f74e800eb10 tx=0x7f74e800c2d0 comp rx=0 tx=0).stop 2024-09-21T03:55:47.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.825+0000 7f74f5593640 1 -- 172.21.15.46:0/3039002677 shutdown_connections 2024-09-21T03:55:47.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.825+0000 7f74f5593640 1 --2- 172.21.15.46:0/3039002677 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74f0109e00 0x7f74f019fca0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:47.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.825+0000 7f74f5593640 1 --2- 172.21.15.46:0/3039002677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74f01094b0 0x7f74f019aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:47.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.825+0000 7f74f5593640 1 --2- 172.21.15.46:0/3039002677 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f74d80b6670 0x7f74d80b8b80 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:47.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.825+0000 7f74f5593640 1 --2- 172.21.15.46:0/3039002677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74f0103bc0 0x7f74f019a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:47.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.825+0000 7f74f5593640 1 -- 172.21.15.46:0/3039002677 >> 172.21.15.46:0/3039002677 conn(0x7f74f007b910 msgr2=0x7f74f0105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:47.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.826+0000 7f74f5593640 1 -- 172.21.15.46:0/3039002677 shutdown_connections 2024-09-21T03:55:47.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:47.826+0000 7f74f5593640 1 -- 172.21.15.46:0/3039002677 wait complete. 2024-09-21T03:55:49.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:49 smithi046 ceph-mon[30954]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-09-21T03:55:49.536 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:55:49.537 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:55:49.567 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:49 smithi105 ceph-mon[34773]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-09-21T03:55:49.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:49 smithi162 ceph-mon[35071]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-09-21T03:55:49.818 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:55:50.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.436+0000 7faa73ede640 1 -- 172.21.15.46:0/3188824622 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa6c107b30 msgr2=0x7faa6c107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:50.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.436+0000 7faa73ede640 1 --2- 172.21.15.46:0/3188824622 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa6c107b30 0x7faa6c107f40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7faa5c009900 tx=0x7faa5c02a3f0 comp rx=0 tx=0).stop 2024-09-21T03:55:50.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.437+0000 7faa73ede640 1 -- 172.21.15.46:0/3188824622 shutdown_connections 2024-09-21T03:55:50.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.437+0000 7faa73ede640 1 --2- 172.21.15.46:0/3188824622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa6c108480 0x7faa6c10ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:50.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.437+0000 7faa73ede640 1 --2- 172.21.15.46:0/3188824622 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa6c107b30 0x7faa6c107f40 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:50.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.437+0000 7faa73ede640 1 --2- 172.21.15.46:0/3188824622 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa6c1021f0 0x7faa6c102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:50.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.437+0000 7faa73ede640 1 -- 172.21.15.46:0/3188824622 >> 172.21.15.46:0/3188824622 conn(0x7faa6c077c60 msgr2=0x7faa6c0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:50.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.437+0000 7faa73ede640 1 -- 172.21.15.46:0/3188824622 shutdown_connections 2024-09-21T03:55:50.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.437+0000 7faa73ede640 1 -- 172.21.15.46:0/3188824622 wait complete. 2024-09-21T03:55:50.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.438+0000 7faa73ede640 1 Processor -- start 2024-09-21T03:55:50.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.438+0000 7faa73ede640 1 -- start start 2024-09-21T03:55:50.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.438+0000 7faa73ede640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa6c1021f0 0x7faa6c19b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:50.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.438+0000 7faa73ede640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa6c107b30 0x7faa6c19b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:50.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.438+0000 7faa73ede640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa6c108480 0x7faa6c19be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:50.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.438+0000 7faa73ede640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c112a10 con 0x7faa6c108480 2024-09-21T03:55:50.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.438+0000 7faa73ede640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c112890 con 0x7faa6c107b30 2024-09-21T03:55:50.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.438+0000 7faa73ede640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c112b90 con 0x7faa6c1021f0 2024-09-21T03:55:50.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.438+0000 7faa7247b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa6c108480 0x7faa6c19be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:50.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.438+0000 7faa7247b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa6c108480 0x7faa6c19be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44062/0 (socket says 172.21.15.46:44062) 2024-09-21T03:55:50.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.438+0000 7faa7247b640 1 -- 172.21.15.46:0/1375522948 learned_addr learned my addr 172.21.15.46:0/1375522948 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:50.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.438+0000 7faa71c7a640 1 --2- 172.21.15.46:0/1375522948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa6c1021f0 0x7faa6c19b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:50.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.439+0000 7faa71479640 1 --2- 172.21.15.46:0/1375522948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa6c107b30 0x7faa6c19b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:50.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.439+0000 7faa7247b640 1 -- 172.21.15.46:0/1375522948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa6c1021f0 msgr2=0x7faa6c19b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:50.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.439+0000 7faa7247b640 1 --2- 172.21.15.46:0/1375522948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa6c1021f0 0x7faa6c19b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:50.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.439+0000 7faa7247b640 1 -- 172.21.15.46:0/1375522948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa6c107b30 msgr2=0x7faa6c19b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:50.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.439+0000 7faa7247b640 1 --2- 172.21.15.46:0/1375522948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa6c107b30 0x7faa6c19b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:50.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.439+0000 7faa7247b640 1 -- 172.21.15.46:0/1375522948 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa6c1a65c0 con 0x7faa6c108480 2024-09-21T03:55:50.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.439+0000 7faa7247b640 1 --2- 172.21.15.46:0/1375522948 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa6c108480 0x7faa6c19be40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7faa6400cce0 tx=0x7faa6400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:50.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.439+0000 7faa62ffd640 1 -- 172.21.15.46:0/1375522948 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6400f450 con 0x7faa6c108480 2024-09-21T03:55:50.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.439+0000 7faa73ede640 1 -- 172.21.15.46:0/1375522948 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa6c199210 con 0x7faa6c108480 2024-09-21T03:55:50.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.440+0000 7faa73ede640 1 -- 172.21.15.46:0/1375522948 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa6c199770 con 0x7faa6c108480 2024-09-21T03:55:50.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.440+0000 7faa62ffd640 1 -- 172.21.15.46:0/1375522948 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa6400faa0 con 0x7faa6c108480 2024-09-21T03:55:50.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.440+0000 7faa62ffd640 1 -- 172.21.15.46:0/1375522948 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa64018b70 con 0x7faa6c108480 2024-09-21T03:55:50.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.442+0000 7faa62ffd640 1 -- 172.21.15.46:0/1375522948 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 22) ==== 154586+0+0 (secure 0 0 0) 0x7faa64018d10 con 0x7faa6c108480 2024-09-21T03:55:50.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.443+0000 7faa7a452740 1 Processor -- start 2024-09-21T03:55:50.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.443+0000 7faa7a452740 1 -- start start 2024-09-21T03:55:50.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.443+0000 7faa62ffd640 1 --2- 172.21.15.46:0/1375522948 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7faa580b6720 0x7faa580b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:50.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.444+0000 7faa62ffd640 1 -- 172.21.15.46:0/1375522948 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7faa640e74e0 con 0x7faa6c108480 2024-09-21T03:55:50.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.444+0000 7faa71479640 1 --2- 172.21.15.46:0/1375522948 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7faa580b6720 0x7faa580b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:50.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.444+0000 7faa7a452740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a5b18b1350 0x55a5b1c58430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:50.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.444+0000 7faa7a452740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5b1888490 0x55a5b1c58970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:50.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.444+0000 7faa7a452740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a5b1890670 0x55a5b1c58eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:50.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.444+0000 7faa7a452740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55a5b1bcee60 con 0x55a5b18b1350 2024-09-21T03:55:50.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.444+0000 7faa7a452740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55a5b1bbe290 con 0x55a5b1890670 2024-09-21T03:55:50.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.444+0000 7faa7a452740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a5b1bc20a0 con 0x55a5b1888490 2024-09-21T03:55:50.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.444+0000 7faa71c7a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a5b18b1350 0x55a5b1c58430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:50.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.444+0000 7faa71c7a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a5b18b1350 0x55a5b1c58430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44072/0 (socket says 172.21.15.46:44072) 2024-09-21T03:55:50.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.444+0000 7faa71c7a640 1 -- 172.21.15.46:0/981162957 learned_addr learned my addr 172.21.15.46:0/981162957 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:50.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.445+0000 7faa7247b640 1 --2- 172.21.15.46:0/981162957 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a5b1890670 0x55a5b1c58eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:50.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.445+0000 7faa71c7a640 1 -- 172.21.15.46:0/981162957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5b1888490 msgr2=0x55a5b1c58970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:50.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.445+0000 7faa71c7a640 1 --2- 172.21.15.46:0/981162957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5b1888490 0x55a5b1c58970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:50.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.445+0000 7faa71c7a640 1 -- 172.21.15.46:0/981162957 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a5b1890670 msgr2=0x55a5b1c58eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:50.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.445+0000 7faa71c7a640 1 --2- 172.21.15.46:0/981162957 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a5b1890670 0x55a5b1c58eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:50.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.445+0000 7faa71c7a640 1 -- 172.21.15.46:0/981162957 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5b191c930 con 0x55a5b18b1350 2024-09-21T03:55:50.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.445+0000 7faa71479640 1 --2- 172.21.15.46:0/1375522948 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7faa580b6720 0x7faa580b8c30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7faa5c02a9e0 tx=0x7faa5c005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:50.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.445+0000 7faa71c7a640 1 --2- 172.21.15.46:0/981162957 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a5b18b1350 0x55a5b1c58430 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7faa6800bcb0 tx=0x7faa680107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c22cff32a79bf3c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:50.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.446+0000 7faa57fff640 1 -- 172.21.15.46:0/981162957 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6801c480 con 0x55a5b18b1350 2024-09-21T03:55:50.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.446+0000 7faa57fff640 1 -- 172.21.15.46:0/981162957 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa6801cad0 con 0x55a5b18b1350 2024-09-21T03:55:50.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.446+0000 7faa57fff640 1 -- 172.21.15.46:0/981162957 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa68011c70 con 0x55a5b18b1350 2024-09-21T03:55:50.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.447+0000 7faa7a452740 1 -- 172.21.15.46:0/981162957 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a5b18b1350 msgr2=0x55a5b1c58430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:50.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.447+0000 7faa7a452740 1 --2- 172.21.15.46:0/981162957 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a5b18b1350 0x55a5b1c58430 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7faa6800bcb0 tx=0x7faa680107a0 comp rx=0 tx=0).stop 2024-09-21T03:55:50.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.447+0000 7faa7a452740 1 -- 172.21.15.46:0/981162957 shutdown_connections 2024-09-21T03:55:50.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.447+0000 7faa7a452740 1 --2- 172.21.15.46:0/981162957 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a5b1890670 0x55a5b1c58eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:50.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.447+0000 7faa7a452740 1 --2- 172.21.15.46:0/981162957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5b1888490 0x55a5b1c58970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:50.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.447+0000 7faa7a452740 1 --2- 172.21.15.46:0/981162957 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a5b18b1350 0x55a5b1c58430 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:50.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.447+0000 7faa7a452740 1 -- 172.21.15.46:0/981162957 >> 172.21.15.46:0/981162957 conn(0x55a5b18a5740 msgr2=0x55a5b1c56320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:50.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.447+0000 7faa7a452740 1 -- 172.21.15.46:0/981162957 shutdown_connections 2024-09-21T03:55:50.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.447+0000 7faa7a452740 1 -- 172.21.15.46:0/981162957 wait complete. 2024-09-21T03:55:50.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.447+0000 7faa7a452740 1 -- start start 2024-09-21T03:55:50.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.448+0000 7faa7a452740 1 Processor -- start 2024-09-21T03:55:50.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.448+0000 7faa7a452740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a5b1888490 0x55a5b1c64010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:50.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.449+0000 7faa7a452740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5b1890670 0x55a5b1c64550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:50.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.449+0000 7faa71c7a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a5b1888490 0x55a5b1c64010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:50.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.449+0000 7faa7a452740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a5b18b1350 0x55a5b1c787a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:50.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.449+0000 7faa71c7a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a5b1888490 0x55a5b1c64010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44076/0 (socket says 172.21.15.46:44076) 2024-09-21T03:55:50.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.449+0000 7faa71c7a640 1 -- 172.21.15.46:0/1013161142 learned_addr learned my addr 172.21.15.46:0/1013161142 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:50.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.449+0000 7faa7a452740 1 -- 172.21.15.46:0/1013161142 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55a5b1a1f890 con 0x55a5b1888490 2024-09-21T03:55:50.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.449+0000 7faa7a452740 1 -- 172.21.15.46:0/1013161142 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55a5b1b58d40 con 0x55a5b18b1350 2024-09-21T03:55:50.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.449+0000 7faa7a452740 1 -- 172.21.15.46:0/1013161142 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a5b1c6f420 con 0x55a5b1890670 2024-09-21T03:55:50.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.449+0000 7faa7a452740 10 client.0 _ll_register_callbacks cb 0x55a5b1bbcc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:55:50.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.449+0000 7faa71479640 1 --2- 172.21.15.46:0/1013161142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5b1890670 0x55a5b1c64550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:50.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.449+0000 7faa7247b640 1 --2- 172.21.15.46:0/1013161142 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a5b18b1350 0x55a5b1c787a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:50.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.449+0000 7faa71479640 1 -- 172.21.15.46:0/1013161142 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a5b18b1350 msgr2=0x55a5b1c787a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:50.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.449+0000 7faa71479640 1 --2- 172.21.15.46:0/1013161142 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a5b18b1350 0x55a5b1c787a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:50.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.449+0000 7faa71479640 1 -- 172.21.15.46:0/1013161142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a5b1888490 msgr2=0x55a5b1c64010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:50.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.449+0000 7faa71479640 1 --2- 172.21.15.46:0/1013161142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a5b1888490 0x55a5b1c64010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:50.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.449+0000 7faa71479640 1 -- 172.21.15.46:0/1013161142 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5b1c78d30 con 0x55a5b1890670 2024-09-21T03:55:50.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.450+0000 7faa71479640 1 --2- 172.21.15.46:0/1013161142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5b1890670 0x55a5b1c64550 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faa5c009230 tx=0x7faa5c009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf248a43f35394e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:50.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.450+0000 7faa557fa640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T03:55:50.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.450+0000 7faa557fa640 1 -- 172.21.15.46:0/1013161142 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa5c035050 con 0x55a5b1890670 2024-09-21T03:55:50.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.450+0000 7faa557fa640 1 -- 172.21.15.46:0/1013161142 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7faa5c004c20 con 0x55a5b1890670 2024-09-21T03:55:50.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.450+0000 7faa7a452740 1 -- 172.21.15.46:0/1013161142 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa6801cad0 con 0x55a5b1890670 2024-09-21T03:55:50.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.450+0000 7faa557fa640 1 -- 172.21.15.46:0/1013161142 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7faa5c004e20 con 0x55a5b1890670 2024-09-21T03:55:50.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.450+0000 7faa7a452740 10 client.25267 fetch_fsmap learned FSMap version 20 2024-09-21T03:55:50.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.450+0000 7faa7a452740 1 -- 172.21.15.46:0/1013161142 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a5b1c7b660 con 0x55a5b1890670 2024-09-21T03:55:50.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.451+0000 7faa557fa640 1 -- 172.21.15.46:0/1013161142 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa6801cad0 con 0x55a5b1890670 2024-09-21T03:55:50.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.451+0000 7faa557fa640 1 -- 172.21.15.46:0/1013161142 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7faa5c032890 con 0x55a5b1890670 2024-09-21T03:55:50.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.451+0000 7faa7a452740 10 client.25267 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:55:50.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.451+0000 7faa7a452740 10 client.25267 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:55:50.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.451+0000 7faa7a452740 20 client.25267 populate_metadata read hostname 'smithi046' 2024-09-21T03:55:50.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.451+0000 7faa7a452740 1 --2- 172.21.15.46:0/1013161142 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55a5b186fcd0 0x55a5b1c7eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:50.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.451+0000 7faa7a452740 4 client.25267 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:55:50.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.451+0000 7faa7a452740 1 -- 172.21.15.46:0/1013161142 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5b1bd0db0 con 0x55a5b186fcd0 2024-09-21T03:55:50.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.452+0000 7faa71c7a640 1 --2- 172.21.15.46:0/1013161142 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55a5b186fcd0 0x55a5b1c7eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:50.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.452+0000 7faa557fa640 10 client.25267 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:50.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.452+0000 7faa71c7a640 1 --2- 172.21.15.46:0/1013161142 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55a5b186fcd0 0x55a5b1c7eba0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c4de42eca48c3be server_cookie=a908e593ea0fd35c in_seq=0 out_seq=0 2024-09-21T03:55:50.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.453+0000 7faa557fa640 1 -- 172.21.15.46:0/1013161142 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a5b1bd0db0 con 0x55a5b186fcd0 2024-09-21T03:55:50.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.453+0000 7faa557fa640 10 client.25267 handle_command_reply: tid=0 2024-09-21T03:55:50.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.453+0000 7faa7a452740 1 client.25267 shutdown 2024-09-21T03:55:50.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.453+0000 7faa7a452740 1 -- 172.21.15.46:0/1013161142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5b1890670 msgr2=0x55a5b1c64550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:50.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.453+0000 7faa7a452740 1 --2- 172.21.15.46:0/1013161142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5b1890670 0x55a5b1c64550 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faa5c009230 tx=0x7faa5c009260 comp rx=0 tx=0).stop 2024-09-21T03:55:50.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.453+0000 7faa7a452740 1 -- 172.21.15.46:0/1013161142 shutdown_connections 2024-09-21T03:55:50.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.453+0000 7faa7a452740 1 --2- 172.21.15.46:0/1013161142 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55a5b186fcd0 0x55a5b1c7eba0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:50.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.453+0000 7faa557fa640 0 client.25267 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:50.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.453+0000 7faa7a452740 1 --2- 172.21.15.46:0/1013161142 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a5b18b1350 0x55a5b1c787a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:50.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.453+0000 7faa7a452740 1 --2- 172.21.15.46:0/1013161142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5b1890670 0x55a5b1c64550 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:50.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.453+0000 7faa7a452740 1 --2- 172.21.15.46:0/1013161142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a5b1888490 0x55a5b1c64010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:50.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.453+0000 7faa7a452740 1 -- 172.21.15.46:0/1013161142 >> 172.21.15.46:0/1013161142 conn(0x55a5b18a5740 msgr2=0x55a5b1c5b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:50.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.453+0000 7faa7a452740 1 -- 172.21.15.46:0/1013161142 shutdown_connections 2024-09-21T03:55:50.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.453+0000 7faa7a452740 1 -- 172.21.15.46:0/1013161142 wait complete. 2024-09-21T03:55:50.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.454+0000 7faa7a452740 20 client.25267 trim_cache size 0 max 16384 2024-09-21T03:55:50.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.472+0000 7faa7a452740 1 Processor -- start 2024-09-21T03:55:50.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.472+0000 7faa7a452740 1 -- start start 2024-09-21T03:55:50.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.472+0000 7faa7a452740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a5b1888490 0x55a5b1c5e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:50.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.472+0000 7faa7a452740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5b1890670 0x55a5b1c59b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:50.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.472+0000 7faa7a452740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a5b18b1350 0x55a5b1c61000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:50.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.472+0000 7faa7a452740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7faa5000c500 con 0x55a5b1888490 2024-09-21T03:55:50.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.472+0000 7faa7a452740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7faa5000eda0 con 0x55a5b18b1350 2024-09-21T03:55:50.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.472+0000 7faa7a452740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faa5000cb90 con 0x55a5b1890670 2024-09-21T03:55:50.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.472+0000 7faa71479640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5b1890670 0x55a5b1c59b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:50.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.472+0000 7faa71479640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5b1890670 0x55a5b1c59b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:39240/0 (socket says 172.21.15.46:39240) 2024-09-21T03:55:50.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.472+0000 7faa71479640 1 -- 172.21.15.46:0/1342579227 learned_addr learned my addr 172.21.15.46:0/1342579227 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:50.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.472+0000 7faa7247b640 1 --2- 172.21.15.46:0/1342579227 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a5b18b1350 0x55a5b1c61000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:50.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.472+0000 7faa71c7a640 1 --2- 172.21.15.46:0/1342579227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a5b1888490 0x55a5b1c5e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:50.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.473+0000 7faa71479640 1 -- 172.21.15.46:0/1342579227 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a5b18b1350 msgr2=0x55a5b1c61000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:50.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.473+0000 7faa71479640 1 --2- 172.21.15.46:0/1342579227 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a5b18b1350 0x55a5b1c61000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:50.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.473+0000 7faa71479640 1 -- 172.21.15.46:0/1342579227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a5b1888490 msgr2=0x55a5b1c5e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:50.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.473+0000 7faa71479640 1 --2- 172.21.15.46:0/1342579227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a5b1888490 0x55a5b1c5e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:50.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.473+0000 7faa71479640 1 -- 172.21.15.46:0/1342579227 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5b1c62d70 con 0x55a5b1890670 2024-09-21T03:55:50.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.473+0000 7faa71479640 1 --2- 172.21.15.46:0/1342579227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5b1890670 0x55a5b1c59b70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faa5c02a430 tx=0x7faa5c009830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9d792e4087ef451 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:50.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.473+0000 7faa577fe640 1 -- 172.21.15.46:0/1342579227 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa5c035070 con 0x55a5b1890670 2024-09-21T03:55:50.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.473+0000 7faa577fe640 1 -- 172.21.15.46:0/1342579227 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa5c04c070 con 0x55a5b1890670 2024-09-21T03:55:50.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.473+0000 7faa577fe640 1 -- 172.21.15.46:0/1342579227 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa5c003800 con 0x55a5b1890670 2024-09-21T03:55:50.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.474+0000 7faa7a452740 1 -- 172.21.15.46:0/1342579227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5b1890670 msgr2=0x55a5b1c59b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:50.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.474+0000 7faa7a452740 1 --2- 172.21.15.46:0/1342579227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5b1890670 0x55a5b1c59b70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faa5c02a430 tx=0x7faa5c009830 comp rx=0 tx=0).stop 2024-09-21T03:55:50.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.474+0000 7faa7a452740 1 -- 172.21.15.46:0/1342579227 shutdown_connections 2024-09-21T03:55:50.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.474+0000 7faa7a452740 1 --2- 172.21.15.46:0/1342579227 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a5b18b1350 0x55a5b1c61000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:50.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.474+0000 7faa7a452740 1 --2- 172.21.15.46:0/1342579227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5b1890670 0x55a5b1c59b70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:50.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.474+0000 7faa7a452740 1 --2- 172.21.15.46:0/1342579227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a5b1888490 0x55a5b1c5e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:50.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.474+0000 7faa7a452740 1 -- 172.21.15.46:0/1342579227 >> 172.21.15.46:0/1342579227 conn(0x55a5b18a5740 msgr2=0x55a5b1c59460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:50.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.474+0000 7faa7a452740 1 -- 172.21.15.46:0/1342579227 shutdown_connections 2024-09-21T03:55:50.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.474+0000 7faa7a452740 1 -- 172.21.15.46:0/1342579227 wait complete. 2024-09-21T03:55:50.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.475+0000 7faa7a452740 1 -- start start 2024-09-21T03:55:50.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.475+0000 7faa7a452740 1 Processor -- start 2024-09-21T03:55:50.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.476+0000 7faa7a452740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5b1888490 0x55a5b1c75050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:50.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.476+0000 7faa7a452740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a5b1890670 0x55a5b1c71510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:50.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.476+0000 7faa7a452740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a5b18b1350 0x55a5b1c71bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:50.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.476+0000 7faa7a452740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7faa5000d260 con 0x55a5b18b1350 2024-09-21T03:55:50.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.476+0000 7faa7a452740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7faa5000e6d0 con 0x55a5b1890670 2024-09-21T03:55:50.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.476+0000 7faa7a452740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faa5000d930 con 0x55a5b1888490 2024-09-21T03:55:50.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.476+0000 7faa71c7a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5b1888490 0x55a5b1c75050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:50.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.476+0000 7faa7247b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a5b18b1350 0x55a5b1c71bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:50.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.476+0000 7faa71c7a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5b1888490 0x55a5b1c75050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:39252/0 (socket says 172.21.15.46:39252) 2024-09-21T03:55:50.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.476+0000 7faa71c7a640 1 -- 172.21.15.46:0/962251484 learned_addr learned my addr 172.21.15.46:0/962251484 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:50.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.476+0000 7faa71479640 1 --2- 172.21.15.46:0/962251484 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a5b1890670 0x55a5b1c71510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:50.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.476+0000 7faa71c7a640 1 -- 172.21.15.46:0/962251484 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a5b1890670 msgr2=0x55a5b1c71510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:50.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.476+0000 7faa71c7a640 1 --2- 172.21.15.46:0/962251484 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a5b1890670 0x55a5b1c71510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:50.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.476+0000 7faa71c7a640 1 -- 172.21.15.46:0/962251484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a5b18b1350 msgr2=0x55a5b1c71bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:50.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.477+0000 7faa71c7a640 1 --2- 172.21.15.46:0/962251484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a5b18b1350 0x55a5b1c71bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:50.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.477+0000 7faa71c7a640 1 -- 172.21.15.46:0/962251484 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5b1c72340 con 0x55a5b1888490 2024-09-21T03:55:50.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.477+0000 7faa7247b640 1 --2- 172.21.15.46:0/962251484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a5b18b1350 0x55a5b1c71bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:55:50.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.477+0000 7faa7a452740 10 client.0 _ll_register_callbacks cb 0x7faa5c005e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:55:50.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.477+0000 7faa7a452740 1 -- 172.21.15.46:0/962251484 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa5c04c070 con 0x55a5b1888490 2024-09-21T03:55:50.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.477+0000 7faa71c7a640 1 --2- 172.21.15.46:0/962251484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5b1888490 0x55a5b1c75050 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faa68011740 tx=0x7faa680117d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70fc731e57e39e75 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:50.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.477+0000 7faa557fa640 10 client.25273 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T03:55:50.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.477+0000 7faa557fa640 1 -- 172.21.15.46:0/962251484 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa680052b0 con 0x55a5b1888490 2024-09-21T03:55:50.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.477+0000 7faa557fa640 1 -- 172.21.15.46:0/962251484 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7faa68005450 con 0x55a5b1888490 2024-09-21T03:55:50.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.478+0000 7faa557fa640 1 -- 172.21.15.46:0/962251484 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7faa68005850 con 0x55a5b1888490 2024-09-21T03:55:50.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.478+0000 7faa7a452740 10 client.25273 fetch_fsmap learned FSMap version 20 2024-09-21T03:55:50.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.478+0000 7faa7a452740 1 -- 172.21.15.46:0/962251484 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({fsmap=20}) -- 0x55a5b1cea4e0 con 0x55a5b1888490 2024-09-21T03:55:50.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.478+0000 7faa557fa640 1 -- 172.21.15.46:0/962251484 <== mon.1 v2:172.21.15.162:3300/0 4 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7faa6802c070 con 0x55a5b1888490 2024-09-21T03:55:50.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.478+0000 7faa7a452740 10 client.25273 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:55:50.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.478+0000 7faa7a452740 10 client.25273 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:55:50.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.478+0000 7faa7a452740 20 client.25273 populate_metadata read hostname 'smithi046' 2024-09-21T03:55:50.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.479+0000 7faa7a452740 1 --2- 172.21.15.46:0/962251484 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55a5b1845080 0x55a5b1cecad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:50.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.479+0000 7faa7a452740 4 client.25273 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:55:50.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.479+0000 7faa7a452740 1 -- 172.21.15.46:0/962251484 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a5b1bcc860 con 0x55a5b1845080 2024-09-21T03:55:50.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.479+0000 7faa71479640 1 --2- 172.21.15.46:0/962251484 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55a5b1845080 0x55a5b1cecad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:50.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.479+0000 7faa71479640 1 --2- 172.21.15.46:0/962251484 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55a5b1845080 0x55a5b1cecad0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70231bafe152cc25 server_cookie=e22df8fee7b7ef34 in_seq=0 out_seq=0 2024-09-21T03:55:50.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.479+0000 7faa557fa640 10 client.25273 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:50.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.481+0000 7faa557fa640 1 -- 172.21.15.46:0/962251484 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a5b1bcc860 con 0x55a5b1845080 2024-09-21T03:55:50.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.481+0000 7faa557fa640 10 client.25273 handle_command_reply: tid=0 2024-09-21T03:55:50.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.481+0000 7faa7a452740 1 client.25273 shutdown 2024-09-21T03:55:50.484 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T03:55:50.485 INFO:teuthology.orchestra.run.smithi046.stdout: "return_code": 0, 2024-09-21T03:55:50.485 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_tag": "d49f33a7-3d5a-421b-94ba-8b19a4120db1", 2024-09-21T03:55:50.485 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": "asynchronous" 2024-09-21T03:55:50.485 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T03:55:50.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.481+0000 7faa7a452740 1 -- 172.21.15.46:0/962251484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5b1888490 msgr2=0x55a5b1c75050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:50.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.482+0000 7faa7a452740 1 --2- 172.21.15.46:0/962251484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5b1888490 0x55a5b1c75050 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faa68011740 tx=0x7faa680117d0 comp rx=0 tx=0).stop 2024-09-21T03:55:50.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.482+0000 7faa7a452740 1 -- 172.21.15.46:0/962251484 shutdown_connections 2024-09-21T03:55:50.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.482+0000 7faa7a452740 1 --2- 172.21.15.46:0/962251484 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55a5b1845080 0x55a5b1cecad0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:50.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.482+0000 7faa7a452740 1 --2- 172.21.15.46:0/962251484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a5b18b1350 0x55a5b1c71bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:50.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.482+0000 7faa7a452740 1 --2- 172.21.15.46:0/962251484 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a5b1890670 0x55a5b1c71510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:50.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.482+0000 7faa557fa640 0 client.25273 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:50.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.482+0000 7faa7a452740 1 --2- 172.21.15.46:0/962251484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a5b1888490 0x55a5b1c75050 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:50.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.482+0000 7faa7a452740 1 -- 172.21.15.46:0/962251484 >> 172.21.15.46:0/962251484 conn(0x55a5b18a5740 msgr2=0x55a5b1c652c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:50.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.482+0000 7faa7a452740 1 -- 172.21.15.46:0/962251484 shutdown_connections 2024-09-21T03:55:50.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.482+0000 7faa7a452740 1 -- 172.21.15.46:0/962251484 wait complete. 2024-09-21T03:55:50.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.482+0000 7faa7a452740 20 client.25273 trim_cache size 0 max 16384 2024-09-21T03:55:50.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.483+0000 7faa73ede640 1 -- 172.21.15.46:0/1375522948 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7faa580b6720 msgr2=0x7faa580b8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:50.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.483+0000 7faa73ede640 1 --2- 172.21.15.46:0/1375522948 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7faa580b6720 0x7faa580b8c30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7faa5c02a9e0 tx=0x7faa5c005a20 comp rx=0 tx=0).stop 2024-09-21T03:55:50.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.483+0000 7faa73ede640 1 -- 172.21.15.46:0/1375522948 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa6c108480 msgr2=0x7faa6c19be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:50.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.483+0000 7faa73ede640 1 --2- 172.21.15.46:0/1375522948 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa6c108480 0x7faa6c19be40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7faa6400cce0 tx=0x7faa6400a620 comp rx=0 tx=0).stop 2024-09-21T03:55:50.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.483+0000 7faa73ede640 1 -- 172.21.15.46:0/1375522948 shutdown_connections 2024-09-21T03:55:50.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.483+0000 7faa73ede640 1 --2- 172.21.15.46:0/1375522948 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faa6c108480 0x7faa6c19be40 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:50.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.483+0000 7faa73ede640 1 --2- 172.21.15.46:0/1375522948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa6c107b30 0x7faa6c19b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:50.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.483+0000 7faa73ede640 1 --2- 172.21.15.46:0/1375522948 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7faa580b6720 0x7faa580b8c30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:50.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.483+0000 7faa73ede640 1 --2- 172.21.15.46:0/1375522948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa6c1021f0 0x7faa6c19b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:50.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.483+0000 7faa73ede640 1 -- 172.21.15.46:0/1375522948 >> 172.21.15.46:0/1375522948 conn(0x7faa6c077c60 msgr2=0x7faa6c103ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:50.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.483+0000 7faa73ede640 1 -- 172.21.15.46:0/1375522948 shutdown_connections 2024-09-21T03:55:50.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:50.484+0000 7faa73ede640 1 -- 172.21.15.46:0/1375522948 wait complete. 2024-09-21T03:55:51.178 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:55:51.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:51 smithi046 ceph-mon[30954]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.6 KiB/s wr, 3 op/s 2024-09-21T03:55:51.555 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:55:51.567 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:51 smithi105 ceph-mon[34773]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.6 KiB/s wr, 3 op/s 2024-09-21T03:55:51.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:51 smithi162 ceph-mon[35071]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.6 KiB/s wr, 3 op/s 2024-09-21T03:55:52.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.122+0000 7f37643b0640 1 -- 172.21.15.46:0/2246266292 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f375c108cf0 msgr2=0x7f375c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:52.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.122+0000 7f37643b0640 1 --2- 172.21.15.46:0/2246266292 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f375c108cf0 0x7f375c10f520 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3754009ca0 tx=0x7f375402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:55:52.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.122+0000 7f37643b0640 1 -- 172.21.15.46:0/2246266292 shutdown_connections 2024-09-21T03:55:52.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.122+0000 7f37643b0640 1 --2- 172.21.15.46:0/2246266292 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f375c108cf0 0x7f375c10f520 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:52.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.122+0000 7f37643b0640 1 --2- 172.21.15.46:0/2246266292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f375c1083a0 0x7f375c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:52.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.122+0000 7f37643b0640 1 --2- 172.21.15.46:0/2246266292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f375c102a60 0x7f375c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:52.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.122+0000 7f37643b0640 1 -- 172.21.15.46:0/2246266292 >> 172.21.15.46:0/2246266292 conn(0x7f375c079730 msgr2=0x7f375c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:52.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.122+0000 7f37643b0640 1 -- 172.21.15.46:0/2246266292 shutdown_connections 2024-09-21T03:55:52.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.122+0000 7f37643b0640 1 -- 172.21.15.46:0/2246266292 wait complete. 2024-09-21T03:55:52.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.123+0000 7f37643b0640 1 Processor -- start 2024-09-21T03:55:52.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.123+0000 7f37643b0640 1 -- start start 2024-09-21T03:55:52.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.123+0000 7f37643b0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f375c102a60 0x7f375c19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:52.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.123+0000 7f37643b0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f375c1083a0 0x7f375c19aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:52.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.123+0000 7f37643b0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f375c108cf0 0x7f375c19fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:52.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.123+0000 7f37643b0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f375c113a50 con 0x7f375c102a60 2024-09-21T03:55:52.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.123+0000 7f37643b0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f375c1138d0 con 0x7f375c108cf0 2024-09-21T03:55:52.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.123+0000 7f37643b0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f375c113bd0 con 0x7f375c1083a0 2024-09-21T03:55:52.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.124+0000 7f376214c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f375c102a60 0x7f375c19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:52.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.124+0000 7f376214c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f375c102a60 0x7f375c19a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41364/0 (socket says 172.21.15.46:41364) 2024-09-21T03:55:52.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.124+0000 7f376214c640 1 -- 172.21.15.46:0/3617035934 learned_addr learned my addr 172.21.15.46:0/3617035934 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:52.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.124+0000 7f376294d640 1 --2- 172.21.15.46:0/3617035934 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f375c108cf0 0x7f375c19fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:52.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.124+0000 7f376194b640 1 --2- 172.21.15.46:0/3617035934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f375c1083a0 0x7f375c19aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:52.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.124+0000 7f376214c640 1 -- 172.21.15.46:0/3617035934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f375c1083a0 msgr2=0x7f375c19aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:52.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.124+0000 7f376214c640 1 --2- 172.21.15.46:0/3617035934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f375c1083a0 0x7f375c19aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:52.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.124+0000 7f376214c640 1 -- 172.21.15.46:0/3617035934 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f375c108cf0 msgr2=0x7f375c19fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:52.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.124+0000 7f376214c640 1 --2- 172.21.15.46:0/3617035934 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f375c108cf0 0x7f375c19fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:52.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.124+0000 7f376214c640 1 -- 172.21.15.46:0/3617035934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f375c1a0450 con 0x7f375c102a60 2024-09-21T03:55:52.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.124+0000 7f376294d640 1 --2- 172.21.15.46:0/3617035934 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f375c108cf0 0x7f375c19fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:55:52.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.124+0000 7f376214c640 1 --2- 172.21.15.46:0/3617035934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f375c102a60 0x7f375c19a4e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f375800d950 tx=0x7f375800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:52.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.125+0000 7f37537fe640 1 -- 172.21.15.46:0/3617035934 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3758017030 con 0x7f375c102a60 2024-09-21T03:55:52.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.125+0000 7f37643b0640 1 -- 172.21.15.46:0/3617035934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f375c1a0740 con 0x7f375c102a60 2024-09-21T03:55:52.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.125+0000 7f37643b0640 1 -- 172.21.15.46:0/3617035934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f375c110120 con 0x7f375c102a60 2024-09-21T03:55:52.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.125+0000 7f37537fe640 1 -- 172.21.15.46:0/3617035934 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3758004020 con 0x7f375c102a60 2024-09-21T03:55:52.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.125+0000 7f37537fe640 1 -- 172.21.15.46:0/3617035934 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37580047a0 con 0x7f375c102a60 2024-09-21T03:55:52.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.128+0000 7f376a924740 1 Processor -- start 2024-09-21T03:55:52.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.128+0000 7f376a924740 1 -- start start 2024-09-21T03:55:52.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.129+0000 7f376a924740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db022e5070 0x55db0268c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:52.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.129+0000 7f376a924740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55db022bc1b0 0x55db0268cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:52.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.129+0000 7f376a924740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55db022c4390 0x55db0268d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:52.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.129+0000 7f376a924740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55db02602e50 con 0x55db022c4390 2024-09-21T03:55:52.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.129+0000 7f376a924740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55db025f2280 con 0x55db022bc1b0 2024-09-21T03:55:52.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.129+0000 7f376a924740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55db025f6090 con 0x55db022e5070 2024-09-21T03:55:52.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.129+0000 7f376194b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55db022c4390 0x55db0268d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:52.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.129+0000 7f376194b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55db022c4390 0x55db0268d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41370/0 (socket says 172.21.15.46:41370) 2024-09-21T03:55:52.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.129+0000 7f376194b640 1 -- 172.21.15.46:0/3917173577 learned_addr learned my addr 172.21.15.46:0/3917173577 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:52.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.129+0000 7f376294d640 1 --2- 172.21.15.46:0/3917173577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db022e5070 0x55db0268c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:52.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.129+0000 7f376194b640 1 -- 172.21.15.46:0/3917173577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db022e5070 msgr2=0x55db0268c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:52.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.129+0000 7f376194b640 1 --2- 172.21.15.46:0/3917173577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db022e5070 0x55db0268c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:52.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.129+0000 7f376194b640 1 -- 172.21.15.46:0/3917173577 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55db022bc1b0 msgr2=0x55db0268cb90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T03:55:52.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.129+0000 7f376194b640 1 --2- 172.21.15.46:0/3917173577 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55db022bc1b0 0x55db0268cb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:52.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.129+0000 7f376194b640 1 -- 172.21.15.46:0/3917173577 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db02350650 con 0x55db022c4390 2024-09-21T03:55:52.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.130+0000 7f37537fe640 1 -- 172.21.15.46:0/3617035934 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 22) ==== 154586+0+0 (secure 0 0 0) 0x7f3758009a30 con 0x7f375c102a60 2024-09-21T03:55:52.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.130+0000 7f376194b640 1 --2- 172.21.15.46:0/3917173577 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55db022c4390 0x55db0268d0d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f374c00bbd0 tx=0x7f374c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a464a1ef041a357 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:52.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.130+0000 7f3750d9a640 1 -- 172.21.15.46:0/3917173577 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374c01c480 con 0x55db022c4390 2024-09-21T03:55:52.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.130+0000 7f3750d9a640 1 -- 172.21.15.46:0/3917173577 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f374c0118f0 con 0x55db022c4390 2024-09-21T03:55:52.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.130+0000 7f3750d9a640 1 -- 172.21.15.46:0/3917173577 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374c01a760 con 0x55db022c4390 2024-09-21T03:55:52.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.131+0000 7f376a924740 1 -- 172.21.15.46:0/3917173577 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55db022c4390 msgr2=0x55db0268d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:52.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.131+0000 7f376a924740 1 --2- 172.21.15.46:0/3917173577 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55db022c4390 0x55db0268d0d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f374c00bbd0 tx=0x7f374c0107a0 comp rx=0 tx=0).stop 2024-09-21T03:55:52.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.131+0000 7f37537fe640 1 --2- 172.21.15.46:0/3617035934 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f37480b6670 0x7f37480b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:52.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.131+0000 7f376294d640 1 --2- 172.21.15.46:0/3617035934 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f37480b6670 0x7f37480b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:52.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.131+0000 7f37537fe640 1 -- 172.21.15.46:0/3617035934 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f37580e6f50 con 0x7f375c102a60 2024-09-21T03:55:52.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.132+0000 7f376a924740 1 -- 172.21.15.46:0/3917173577 shutdown_connections 2024-09-21T03:55:52.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.132+0000 7f376a924740 1 --2- 172.21.15.46:0/3917173577 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55db022c4390 0x55db0268d0d0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:52.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.132+0000 7f376a924740 1 --2- 172.21.15.46:0/3917173577 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55db022bc1b0 0x55db0268cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:52.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.132+0000 7f376a924740 1 --2- 172.21.15.46:0/3917173577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db022e5070 0x55db0268c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:52.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.132+0000 7f376a924740 1 -- 172.21.15.46:0/3917173577 >> 172.21.15.46:0/3917173577 conn(0x55db022d9460 msgr2=0x55db0268a540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:52.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.132+0000 7f376294d640 1 --2- 172.21.15.46:0/3617035934 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f37480b6670 0x7f37480b8b80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3754006010 tx=0x7f375403f040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:52.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.132+0000 7f376a924740 1 -- 172.21.15.46:0/3917173577 shutdown_connections 2024-09-21T03:55:52.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.132+0000 7f376a924740 1 -- 172.21.15.46:0/3917173577 wait complete. 2024-09-21T03:55:52.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.133+0000 7f376a924740 1 -- start start 2024-09-21T03:55:52.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.133+0000 7f376a924740 1 Processor -- start 2024-09-21T03:55:52.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.134+0000 7f376a924740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55db022bc1b0 0x55db02697d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:52.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.134+0000 7f376a924740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db022c4390 0x55db026982a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:52.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.134+0000 7f376a924740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55db022e5070 0x55db026a4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:52.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.134+0000 7f376214c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55db022bc1b0 0x55db02697d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:52.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.134+0000 7f376214c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55db022bc1b0 0x55db02697d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41386/0 (socket says 172.21.15.46:41386) 2024-09-21T03:55:52.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.134+0000 7f376214c640 1 -- 172.21.15.46:0/3550371673 learned_addr learned my addr 172.21.15.46:0/3550371673 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:52.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.134+0000 7f376a924740 1 -- 172.21.15.46:0/3550371673 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55db02453700 con 0x55db022bc1b0 2024-09-21T03:55:52.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.134+0000 7f376194b640 1 --2- 172.21.15.46:0/3550371673 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db022c4390 0x55db026982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:52.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.134+0000 7f376a924740 1 -- 172.21.15.46:0/3550371673 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55db0258d110 con 0x55db022e5070 2024-09-21T03:55:52.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.134+0000 7f376a924740 1 -- 172.21.15.46:0/3550371673 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55db0269ae30 con 0x55db022c4390 2024-09-21T03:55:52.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.134+0000 7f376294d640 1 --2- 172.21.15.46:0/3550371673 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55db022e5070 0x55db026a4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:52.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.135+0000 7f376214c640 1 -- 172.21.15.46:0/3550371673 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db022c4390 msgr2=0x55db026982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:52.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.135+0000 7f376214c640 1 --2- 172.21.15.46:0/3550371673 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db022c4390 0x55db026982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:52.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.135+0000 7f376214c640 1 -- 172.21.15.46:0/3550371673 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55db022e5070 msgr2=0x55db026a4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:52.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.135+0000 7f376214c640 1 --2- 172.21.15.46:0/3550371673 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55db022e5070 0x55db026a4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:52.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.135+0000 7f376214c640 1 -- 172.21.15.46:0/3550371673 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db025bac40 con 0x55db022bc1b0 2024-09-21T03:55:52.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.135+0000 7f376194b640 1 --2- 172.21.15.46:0/3550371673 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db022c4390 0x55db026982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:55:52.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.135+0000 7f376a924740 10 client.0 _ll_register_callbacks cb 0x55db025a6990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:55:52.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.135+0000 7f376a924740 1 -- 172.21.15.46:0/3550371673 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f374c0118f0 con 0x55db022bc1b0 2024-09-21T03:55:52.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.135+0000 7f376214c640 1 --2- 172.21.15.46:0/3550371673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55db022bc1b0 0x55db02697d60 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3758005fd0 tx=0x7f37580ac8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c818299e345e397 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:52.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.135+0000 7f3745ffb640 10 client.15585 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:55:52.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.136+0000 7f3745ffb640 1 -- 172.21.15.46:0/3550371673 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37580b19a0 con 0x55db022bc1b0 2024-09-21T03:55:52.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.136+0000 7f3745ffb640 1 -- 172.21.15.46:0/3550371673 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f37580a9130 con 0x55db022bc1b0 2024-09-21T03:55:52.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.136+0000 7f3745ffb640 1 -- 172.21.15.46:0/3550371673 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f37580b68e0 con 0x55db022bc1b0 2024-09-21T03:55:52.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.136+0000 7f376a924740 10 client.15585 fetch_fsmap learned FSMap version 20 2024-09-21T03:55:52.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.136+0000 7f376a924740 1 -- 172.21.15.46:0/3550371673 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({fsmap=20}) -- 0x55db026a6b40 con 0x55db022bc1b0 2024-09-21T03:55:52.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.136+0000 7f3745ffb640 1 -- 172.21.15.46:0/3550371673 <== mon.0 v2:172.21.15.46:3300/0 4 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f37580d41a0 con 0x55db022bc1b0 2024-09-21T03:55:52.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.136+0000 7f376a924740 10 client.15585 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:55:52.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.136+0000 7f376a924740 10 client.15585 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:55:52.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.136+0000 7f376a924740 20 client.15585 populate_metadata read hostname 'smithi046' 2024-09-21T03:55:52.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.136+0000 7f376a924740 1 --2- 172.21.15.46:0/3550371673 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55db022a39f0 0x55db026aa1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:52.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.136+0000 7f376a924740 4 client.15585 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:55:52.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.136+0000 7f376a924740 1 -- 172.21.15.46:0/3550371673 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db02604da0 con 0x55db022a39f0 2024-09-21T03:55:52.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.137+0000 7f376194b640 1 --2- 172.21.15.46:0/3550371673 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55db022a39f0 0x55db026aa1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:52.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.137+0000 7f376194b640 1 --2- 172.21.15.46:0/3550371673 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55db022a39f0 0x55db026aa1d0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=832113cad4b2aa15 server_cookie=8909ce4b21685aca in_seq=0 out_seq=0 2024-09-21T03:55:52.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.137+0000 7f3745ffb640 10 client.15585 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:52.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.138+0000 7f3745ffb640 1 -- 172.21.15.46:0/3550371673 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55db02604da0 con 0x55db022a39f0 2024-09-21T03:55:52.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.138+0000 7f3745ffb640 10 client.15585 handle_command_reply: tid=0 2024-09-21T03:55:52.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.138+0000 7f376a924740 1 client.15585 shutdown 2024-09-21T03:55:52.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.138+0000 7f376a924740 1 -- 172.21.15.46:0/3550371673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55db022bc1b0 msgr2=0x55db02697d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:52.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.138+0000 7f376a924740 1 --2- 172.21.15.46:0/3550371673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55db022bc1b0 0x55db02697d60 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3758005fd0 tx=0x7f37580ac8e0 comp rx=0 tx=0).stop 2024-09-21T03:55:52.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.138+0000 7f376a924740 1 -- 172.21.15.46:0/3550371673 shutdown_connections 2024-09-21T03:55:52.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.138+0000 7f376a924740 1 --2- 172.21.15.46:0/3550371673 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55db022a39f0 0x55db026aa1d0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:52.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.138+0000 7f376a924740 1 --2- 172.21.15.46:0/3550371673 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55db022e5070 0x55db026a4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:52.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.138+0000 7f376a924740 1 --2- 172.21.15.46:0/3550371673 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db022c4390 0x55db026982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:52.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.138+0000 7f3745ffb640 0 client.15585 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:52.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.138+0000 7f376a924740 1 --2- 172.21.15.46:0/3550371673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55db022bc1b0 0x55db02697d60 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:52.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.138+0000 7f376a924740 1 -- 172.21.15.46:0/3550371673 >> 172.21.15.46:0/3550371673 conn(0x55db022d9460 msgr2=0x55db0268f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:52.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.139+0000 7f376a924740 1 -- 172.21.15.46:0/3550371673 shutdown_connections 2024-09-21T03:55:52.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.139+0000 7f376a924740 1 -- 172.21.15.46:0/3550371673 wait complete. 2024-09-21T03:55:52.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.139+0000 7f376a924740 20 client.15585 trim_cache size 0 max 16384 2024-09-21T03:55:52.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.173+0000 7f376a924740 1 Processor -- start 2024-09-21T03:55:52.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.173+0000 7f376a924740 1 -- start start 2024-09-21T03:55:52.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.173+0000 7f376a924740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55db022a39f0 0x55db02698180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:52.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.173+0000 7f376a924740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55db022bc1b0 0x55db0268fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:52.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.173+0000 7f376a924740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db022c4390 0x55db026a40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:52.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.173+0000 7f376a924740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f375c1ab2e0 con 0x55db022bc1b0 2024-09-21T03:55:52.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.173+0000 7f376a924740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f375c1adb80 con 0x55db022a39f0 2024-09-21T03:55:52.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.174+0000 7f376a924740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f375c1ab970 con 0x55db022c4390 2024-09-21T03:55:52.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.174+0000 7f376194b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55db022bc1b0 0x55db0268fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:52.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.174+0000 7f376214c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55db022a39f0 0x55db02698180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:52.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.174+0000 7f376194b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55db022bc1b0 0x55db0268fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41396/0 (socket says 172.21.15.46:41396) 2024-09-21T03:55:52.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.174+0000 7f376194b640 1 -- 172.21.15.46:0/3032954972 learned_addr learned my addr 172.21.15.46:0/3032954972 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:52.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.174+0000 7f376294d640 1 --2- 172.21.15.46:0/3032954972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db022c4390 0x55db026a40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:52.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.174+0000 7f376214c640 1 -- 172.21.15.46:0/3032954972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db022c4390 msgr2=0x55db026a40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:52.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.174+0000 7f376214c640 1 --2- 172.21.15.46:0/3032954972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db022c4390 0x55db026a40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:52.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.174+0000 7f376214c640 1 -- 172.21.15.46:0/3032954972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55db022bc1b0 msgr2=0x55db0268fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:52.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.174+0000 7f376214c640 1 --2- 172.21.15.46:0/3032954972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55db022bc1b0 0x55db0268fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:52.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.174+0000 7f376214c640 1 -- 172.21.15.46:0/3032954972 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db026903a0 con 0x55db022a39f0 2024-09-21T03:55:52.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.175+0000 7f376214c640 1 --2- 172.21.15.46:0/3032954972 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55db022a39f0 0x55db02698180 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f37580aa130 tx=0x7f3758013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ecf4f46bd7f0340 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:52.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.175+0000 7f3747fff640 1 -- 172.21.15.46:0/3032954972 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37580b19a0 con 0x55db022a39f0 2024-09-21T03:55:52.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.175+0000 7f3747fff640 1 -- 172.21.15.46:0/3032954972 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f374c0118f0 con 0x55db022a39f0 2024-09-21T03:55:52.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.175+0000 7f3747fff640 1 -- 172.21.15.46:0/3032954972 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37580d41a0 con 0x55db022a39f0 2024-09-21T03:55:52.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.176+0000 7f376a924740 1 -- 172.21.15.46:0/3032954972 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55db022a39f0 msgr2=0x55db02698180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:52.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.176+0000 7f376a924740 1 --2- 172.21.15.46:0/3032954972 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55db022a39f0 0x55db02698180 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f37580aa130 tx=0x7f3758013000 comp rx=0 tx=0).stop 2024-09-21T03:55:52.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.176+0000 7f376a924740 1 -- 172.21.15.46:0/3032954972 shutdown_connections 2024-09-21T03:55:52.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.176+0000 7f376a924740 1 --2- 172.21.15.46:0/3032954972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db022c4390 0x55db026a40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:52.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.176+0000 7f376a924740 1 --2- 172.21.15.46:0/3032954972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55db022bc1b0 0x55db0268fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:52.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.176+0000 7f376a924740 1 --2- 172.21.15.46:0/3032954972 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55db022a39f0 0x55db02698180 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:52.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.176+0000 7f376a924740 1 -- 172.21.15.46:0/3032954972 >> 172.21.15.46:0/3032954972 conn(0x55db022d9460 msgr2=0x55db0268f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:52.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.177+0000 7f376a924740 1 -- 172.21.15.46:0/3032954972 shutdown_connections 2024-09-21T03:55:52.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.177+0000 7f376a924740 1 -- 172.21.15.46:0/3032954972 wait complete. 2024-09-21T03:55:52.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.177+0000 7f376a924740 1 -- start start 2024-09-21T03:55:52.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.177+0000 7f376a924740 1 Processor -- start 2024-09-21T03:55:52.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.178+0000 7f376a924740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55db022a39f0 0x55db026ab440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:52.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.178+0000 7f376a924740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55db022bc1b0 0x55db026ab980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:52.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.178+0000 7f376a924740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db022c4390 0x55db0271c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:52.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.178+0000 7f376a924740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f375c1ac040 con 0x55db022bc1b0 2024-09-21T03:55:52.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.178+0000 7f376a924740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f375c1ad4b0 con 0x55db022a39f0 2024-09-21T03:55:52.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.178+0000 7f376a924740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f375c1ac710 con 0x55db022c4390 2024-09-21T03:55:52.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.178+0000 7f376a924740 10 client.0 _ll_register_callbacks cb 0x7f37580044d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:55:52.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.178+0000 7f376294d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db022c4390 0x55db0271c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:52.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.178+0000 7f376294d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db022c4390 0x55db0271c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:34778/0 (socket says 172.21.15.46:34778) 2024-09-21T03:55:52.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.178+0000 7f376214c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55db022a39f0 0x55db026ab440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:52.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.178+0000 7f376294d640 1 -- 172.21.15.46:0/3289624388 learned_addr learned my addr 172.21.15.46:0/3289624388 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:52.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.178+0000 7f376194b640 1 --2- 172.21.15.46:0/3289624388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55db022bc1b0 0x55db026ab980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:52.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.178+0000 7f376214c640 1 -- 172.21.15.46:0/3289624388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db022c4390 msgr2=0x55db0271c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:52.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.178+0000 7f376214c640 1 --2- 172.21.15.46:0/3289624388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db022c4390 0x55db0271c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:52.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.178+0000 7f376214c640 1 -- 172.21.15.46:0/3289624388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55db022bc1b0 msgr2=0x55db026ab980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:52.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.178+0000 7f376214c640 1 --2- 172.21.15.46:0/3289624388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55db022bc1b0 0x55db026ab980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:52.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.178+0000 7f376214c640 1 -- 172.21.15.46:0/3289624388 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db026ac250 con 0x55db022a39f0 2024-09-21T03:55:52.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.178+0000 7f376294d640 1 --2- 172.21.15.46:0/3289624388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db022c4390 0x55db0271c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:55:52.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.178+0000 7f376194b640 1 --2- 172.21.15.46:0/3289624388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55db022bc1b0 0x55db026ab980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:55:52.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.179+0000 7f376214c640 1 --2- 172.21.15.46:0/3289624388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55db022a39f0 0x55db026ab440 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f37580ace50 tx=0x7f37580e4ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24e9f6a9e4dab2a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:52.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.179+0000 7f3745ffb640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-21T03:55:52.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.179+0000 7f3745ffb640 1 -- 172.21.15.46:0/3289624388 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37580ce020 con 0x55db022a39f0 2024-09-21T03:55:52.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.179+0000 7f3745ffb640 1 -- 172.21.15.46:0/3289624388 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f375805c1c0 con 0x55db022a39f0 2024-09-21T03:55:52.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.179+0000 7f376a924740 1 -- 172.21.15.46:0/3289624388 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f374c0118f0 con 0x55db022a39f0 2024-09-21T03:55:52.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.179+0000 7f3745ffb640 1 -- 172.21.15.46:0/3289624388 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f37580b19a0 con 0x55db022a39f0 2024-09-21T03:55:52.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.179+0000 7f376a924740 10 client.25268 fetch_fsmap learned FSMap version 20 2024-09-21T03:55:52.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.179+0000 7f376a924740 1 -- 172.21.15.46:0/3289624388 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55db026ac250 con 0x55db022a39f0 2024-09-21T03:55:52.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.179+0000 7f3745ffb640 1 -- 172.21.15.46:0/3289624388 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f375808b070 con 0x55db022a39f0 2024-09-21T03:55:52.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.180+0000 7f3745ffb640 1 -- 172.21.15.46:0/3289624388 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f375808e070 con 0x55db022a39f0 2024-09-21T03:55:52.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.180+0000 7f376a924740 10 client.25268 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:55:52.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.180+0000 7f376a924740 10 client.25268 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:55:52.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.180+0000 7f376a924740 20 client.25268 populate_metadata read hostname 'smithi046' 2024-09-21T03:55:52.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.181+0000 7f376a924740 1 --2- 172.21.15.46:0/3289624388 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55db022e5070 0x55db0271f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:52.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.181+0000 7f376a924740 4 client.25268 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:55:52.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.181+0000 7f376a924740 1 -- 172.21.15.46:0/3289624388 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f374c0118f0 con 0x55db022e5070 2024-09-21T03:55:52.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.181+0000 7f376194b640 1 --2- 172.21.15.46:0/3289624388 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55db022e5070 0x55db0271f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:52.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.181+0000 7f3745ffb640 10 client.25268 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:52.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.181+0000 7f376194b640 1 --2- 172.21.15.46:0/3289624388 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55db022e5070 0x55db0271f990 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=383f26f2132fd4f2 server_cookie=d1961e51e6ec212d in_seq=0 out_seq=0 2024-09-21T03:55:52.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.181+0000 7f3745ffb640 1 -- 172.21.15.46:0/3289624388 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1138 (crc 0 0 0) 0x7f374c0118f0 con 0x55db022e5070 2024-09-21T03:55:52.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.181+0000 7f3745ffb640 10 client.25268 handle_command_reply: tid=0 2024-09-21T03:55:52.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.181+0000 7f376a924740 1 client.25268 shutdown 2024-09-21T03:55:52.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.182+0000 7f376a924740 1 -- 172.21.15.46:0/3289624388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55db022a39f0 msgr2=0x55db026ab440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:52.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.182+0000 7f376a924740 1 --2- 172.21.15.46:0/3289624388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55db022a39f0 0x55db026ab440 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f37580ace50 tx=0x7f37580e4ca0 comp rx=0 tx=0).stop 2024-09-21T03:55:52.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.182+0000 7f376a924740 1 -- 172.21.15.46:0/3289624388 shutdown_connections 2024-09-21T03:55:52.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.182+0000 7f376a924740 1 --2- 172.21.15.46:0/3289624388 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55db022e5070 0x55db0271f990 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:52.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.182+0000 7f3745ffb640 0 client.25268 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:52.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.182+0000 7f376a924740 1 --2- 172.21.15.46:0/3289624388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55db022c4390 0x55db0271c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:52.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.182+0000 7f376a924740 1 --2- 172.21.15.46:0/3289624388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55db022bc1b0 0x55db026ab980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:52.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.182+0000 7f376a924740 1 --2- 172.21.15.46:0/3289624388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55db022a39f0 0x55db026ab440 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:52.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.182+0000 7f376a924740 1 -- 172.21.15.46:0/3289624388 >> 172.21.15.46:0/3289624388 conn(0x55db022d9460 msgr2=0x55db0268d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:52.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.182+0000 7f376a924740 1 -- 172.21.15.46:0/3289624388 shutdown_connections 2024-09-21T03:55:52.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.182+0000 7f376a924740 1 -- 172.21.15.46:0/3289624388 wait complete. 2024-09-21T03:55:52.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.182+0000 7f376a924740 20 client.25268 trim_cache size 0 max 16384 2024-09-21T03:55:52.189 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T03:55:52.189 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T03:55:52.189 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2024-09-21T03:55:52.190 INFO:teuthology.orchestra.run.smithi046.stdout: "d49f33a7-3d5a-421b-94ba-8b19a4120db1": { 2024-09-21T03:55:52.190 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:55:52.190 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "d49f33a7-3d5a-421b-94ba-8b19a4120db1", 2024-09-21T03:55:52.190 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2024-09-21T03:55:52.190 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:55:52.190 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:55:52.190 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_stats": { 2024-09-21T03:55:52.190 INFO:teuthology.orchestra.run.smithi046.stdout: "d49f33a7-3d5a-421b-94ba-8b19a4120db1": { 2024-09-21T03:55:52.190 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:50.480786+0000", 2024-09-21T03:55:52.190 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:55:52.190 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:55:52.191 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:55:52.191 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:55:52.191 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:55:52.191 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:55:52.191 INFO:teuthology.orchestra.run.smithi046.stdout: "3bbf7097-70d7-4743-bbce-41465502b35b": { 2024-09-21T03:55:52.191 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:10.661441+0000", 2024-09-21T03:55:52.191 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:55:52.191 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:55:52.191 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:55:52.191 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:55:52.191 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:55:52.192 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:55:52.192 INFO:teuthology.orchestra.run.smithi046.stdout: "08f0c962-df1a-4129-a1a2-b916240d9803": { 2024-09-21T03:55:52.192 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:02.937596+0000", 2024-09-21T03:55:52.192 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:55:52.192 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:55:52.192 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:55:52.192 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:55:52.192 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:55:52.192 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:55:52.192 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:55:52.192 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T03:55:52.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.183+0000 7f37643b0640 1 -- 172.21.15.46:0/3617035934 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f37480b6670 msgr2=0x7f37480b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:52.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.183+0000 7f37643b0640 1 --2- 172.21.15.46:0/3617035934 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f37480b6670 0x7f37480b8b80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3754006010 tx=0x7f375403f040 comp rx=0 tx=0).stop 2024-09-21T03:55:52.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.183+0000 7f37643b0640 1 -- 172.21.15.46:0/3617035934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f375c102a60 msgr2=0x7f375c19a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:52.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.183+0000 7f37643b0640 1 --2- 172.21.15.46:0/3617035934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f375c102a60 0x7f375c19a4e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f375800d950 tx=0x7f375800de10 comp rx=0 tx=0).stop 2024-09-21T03:55:52.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.184+0000 7f37643b0640 1 -- 172.21.15.46:0/3617035934 shutdown_connections 2024-09-21T03:55:52.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.184+0000 7f37643b0640 1 --2- 172.21.15.46:0/3617035934 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f375c108cf0 0x7f375c19fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:52.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.184+0000 7f37643b0640 1 --2- 172.21.15.46:0/3617035934 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f37480b6670 0x7f37480b8b80 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:52.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.184+0000 7f37643b0640 1 --2- 172.21.15.46:0/3617035934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f375c1083a0 0x7f375c19aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:52.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.184+0000 7f37643b0640 1 --2- 172.21.15.46:0/3617035934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f375c102a60 0x7f375c19a4e0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:52.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.184+0000 7f37643b0640 1 -- 172.21.15.46:0/3617035934 >> 172.21.15.46:0/3617035934 conn(0x7f375c079730 msgr2=0x7f375c104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:52.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.184+0000 7f37643b0640 1 -- 172.21.15.46:0/3617035934 shutdown_connections 2024-09-21T03:55:52.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:55:52.184+0000 7f37643b0640 1 -- 172.21.15.46:0/3617035934 wait complete. 2024-09-21T03:55:52.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:52 smithi046 ceph-mon[30954]: scrub queued for path: / 2024-09-21T03:55:52.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:52 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T03:55:52.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:52 smithi046 ceph-mon[30954]: scrub summary: active paths [/] 2024-09-21T03:55:52.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:52 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T03:55:52.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:52 smithi105 ceph-mon[34773]: scrub queued for path: / 2024-09-21T03:55:52.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:52 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T03:55:52.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:52 smithi105 ceph-mon[34773]: scrub summary: active paths [/] 2024-09-21T03:55:52.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:52 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T03:55:52.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:52 smithi162 ceph-mon[35071]: scrub queued for path: / 2024-09-21T03:55:52.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:52 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T03:55:52.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:52 smithi162 ceph-mon[35071]: scrub summary: active paths [/] 2024-09-21T03:55:52.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:52 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T03:55:52.923 INFO:tasks.cephfs.filesystem:scrub status for tag:d49f33a7-3d5a-421b-94ba-8b19a4120db1 - {'path': '/', 'tag': 'd49f33a7-3d5a-421b-94ba-8b19a4120db1', 'options': 'recursive,force'} 2024-09-21T03:55:53.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:53 smithi046 ceph-mon[30954]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-09-21T03:55:53.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:53 smithi105 ceph-mon[34773]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-09-21T03:55:53.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:53 smithi162 ceph-mon[35071]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-09-21T03:55:54.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:54 smithi046 ceph-mon[30954]: scrub summary: idle 2024-09-21T03:55:54.567 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:54 smithi105 ceph-mon[34773]: scrub summary: idle 2024-09-21T03:55:54.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:54 smithi162 ceph-mon[35071]: scrub summary: idle 2024-09-21T03:55:55.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:55 smithi046 ceph-mon[30954]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-09-21T03:55:55.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:55 smithi105 ceph-mon[34773]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-09-21T03:55:55.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:55 smithi162 ceph-mon[35071]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-09-21T03:55:56.633 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.631+0000 7f9c6a733640 1 -- 172.21.15.46:0/2531051634 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c64102a10 msgr2=0x7f9c64102e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.631+0000 7f9c6a733640 1 --2- 172.21.15.46:0/2531051634 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c64102a10 0x7f9c64102e20 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f9c54009900 tx=0x7f9c5402a410 comp rx=0 tx=0).stop 2024-09-21T03:55:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.631+0000 7f9c6a733640 1 -- 172.21.15.46:0/2531051634 shutdown_connections 2024-09-21T03:55:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.631+0000 7f9c6a733640 1 --2- 172.21.15.46:0/2531051634 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c64108c90 0x7f9c6410f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.631+0000 7f9c6a733640 1 --2- 172.21.15.46:0/2531051634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c64108340 0x7f9c64108750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.631+0000 7f9c6a733640 1 --2- 172.21.15.46:0/2531051634 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c64102a10 0x7f9c64102e20 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.631+0000 7f9c6a733640 1 -- 172.21.15.46:0/2531051634 >> 172.21.15.46:0/2531051634 conn(0x7f9c640fe410 msgr2=0x7f9c64100860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.631+0000 7f9c6a733640 1 -- 172.21.15.46:0/2531051634 shutdown_connections 2024-09-21T03:55:56.635 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.631+0000 7f9c6a733640 1 -- 172.21.15.46:0/2531051634 wait complete. 2024-09-21T03:55:56.637 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.632+0000 7f9c6a733640 1 Processor -- start 2024-09-21T03:55:56.637 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.632+0000 7f9c6a733640 1 -- start start 2024-09-21T03:55:56.637 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.632+0000 7f9c6a733640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c64102a10 0x7f9c6419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:56.637 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.632+0000 7f9c6a733640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c64108340 0x7f9c6419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:56.637 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.632+0000 7f9c6a733640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c64108c90 0x7f9c6419fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:56.637 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.633+0000 7f9c6a733640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9c64113aa0 con 0x7f9c64102a10 2024-09-21T03:55:56.637 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.633+0000 7f9c6a733640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9c64113920 con 0x7f9c64108340 2024-09-21T03:55:56.637 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.633+0000 7f9c6a733640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9c64113c20 con 0x7f9c64108c90 2024-09-21T03:55:56.638 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.633+0000 7f9c63fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c64102a10 0x7f9c6419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:56.638 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.633+0000 7f9c63fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c64102a10 0x7f9c6419a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41428/0 (socket says 172.21.15.46:41428) 2024-09-21T03:55:56.638 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.633+0000 7f9c63fff640 1 -- 172.21.15.46:0/2285708970 learned_addr learned my addr 172.21.15.46:0/2285708970 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:56.638 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.633+0000 7f9c637fe640 1 --2- 172.21.15.46:0/2285708970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c64108340 0x7f9c6419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:56.638 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.633+0000 7f9c68cd0640 1 --2- 172.21.15.46:0/2285708970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c64108c90 0x7f9c6419fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:56.638 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.633+0000 7f9c637fe640 1 -- 172.21.15.46:0/2285708970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c64108c90 msgr2=0x7f9c6419fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:56.638 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.633+0000 7f9c637fe640 1 --2- 172.21.15.46:0/2285708970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c64108c90 0x7f9c6419fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:56.638 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.633+0000 7f9c637fe640 1 -- 172.21.15.46:0/2285708970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c64102a10 msgr2=0x7f9c6419a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:56.638 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.633+0000 7f9c637fe640 1 --2- 172.21.15.46:0/2285708970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c64102a10 0x7f9c6419a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:56.638 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.633+0000 7f9c637fe640 1 -- 172.21.15.46:0/2285708970 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c641a03d0 con 0x7f9c64108340 2024-09-21T03:55:56.638 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.633+0000 7f9c68cd0640 1 --2- 172.21.15.46:0/2285708970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c64108c90 0x7f9c6419fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:55:56.638 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.633+0000 7f9c63fff640 1 --2- 172.21.15.46:0/2285708970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c64102a10 0x7f9c6419a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:55:56.639 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.634+0000 7f9c637fe640 1 --2- 172.21.15.46:0/2285708970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c64108340 0x7f9c6419aa40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9c6406a810 tx=0x7f9c5800ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:56.639 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.634+0000 7f9c617fa640 1 -- 172.21.15.46:0/2285708970 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5800cc40 con 0x7f9c64108340 2024-09-21T03:55:56.639 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.634+0000 7f9c617fa640 1 -- 172.21.15.46:0/2285708970 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c5800cde0 con 0x7f9c64108340 2024-09-21T03:55:56.639 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.634+0000 7f9c6a733640 1 -- 172.21.15.46:0/2285708970 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c641a06c0 con 0x7f9c64108340 2024-09-21T03:55:56.639 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.634+0000 7f9c617fa640 1 -- 172.21.15.46:0/2285708970 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c58004a00 con 0x7f9c64108340 2024-09-21T03:55:56.639 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.634+0000 7f9c6a733640 1 -- 172.21.15.46:0/2285708970 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c641a6e50 con 0x7f9c64108340 2024-09-21T03:55:56.640 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.637+0000 7f9c7169d740 1 Processor -- start 2024-09-21T03:55:56.640 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.638+0000 7f9c7169d740 1 -- start start 2024-09-21T03:55:56.640 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.638+0000 7f9c7169d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555dd60aa1b0 0x555dd644f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:56.640 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.638+0000 7f9c7169d740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555dd60812f0 0x555dd644fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:56.641 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.638+0000 7f9c7169d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555dd60894d0 0x555dd6450430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:56.641 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.638+0000 7f9c7169d740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x555dd63c46f0 con 0x555dd60812f0 2024-09-21T03:55:56.641 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.638+0000 7f9c7169d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x555dd63b3b20 con 0x555dd60aa1b0 2024-09-21T03:55:56.641 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.638+0000 7f9c7169d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555dd63b7930 con 0x555dd60894d0 2024-09-21T03:55:56.641 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.638+0000 7f9c68cd0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555dd60aa1b0 0x555dd644f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:56.641 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.638+0000 7f9c63fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555dd60812f0 0x555dd644fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:56.641 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.638+0000 7f9c68cd0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555dd60aa1b0 0x555dd644f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.46:42500/0 (socket says 172.21.15.46:42500) 2024-09-21T03:55:56.641 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.638+0000 7f9c68cd0640 1 -- 172.21.15.46:0/2650644976 learned_addr learned my addr 172.21.15.46:0/2650644976 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:56.642 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.639+0000 7f9c63fff640 1 -- 172.21.15.46:0/2650644976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555dd60894d0 msgr2=0x555dd6450430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T03:55:56.643 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.639+0000 7f9c617fa640 1 -- 172.21.15.46:0/2285708970 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 22) ==== 154586+0+0 (secure 0 0 0) 0x7f9c58004ba0 con 0x7f9c64108340 2024-09-21T03:55:56.643 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.639+0000 7f9c63fff640 1 --2- 172.21.15.46:0/2650644976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555dd60894d0 0x555dd6450430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:56.643 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.639+0000 7f9c63fff640 1 -- 172.21.15.46:0/2650644976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555dd60aa1b0 msgr2=0x555dd644f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:56.643 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.639+0000 7f9c63fff640 1 --2- 172.21.15.46:0/2650644976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555dd60aa1b0 0x555dd644f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:56.643 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.639+0000 7f9c63fff640 1 -- 172.21.15.46:0/2650644976 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dd6379530 con 0x555dd60812f0 2024-09-21T03:55:56.643 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.639+0000 7f9c63fff640 1 --2- 172.21.15.46:0/2650644976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555dd60812f0 0x555dd644fef0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f9c54000c00 tx=0x7f9c540044b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=327a729cc00c2f76 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:56.644 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.639+0000 7f9c4a7fc640 1 -- 172.21.15.46:0/2650644976 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c54040070 con 0x555dd60812f0 2024-09-21T03:55:56.644 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.640+0000 7f9c4a7fc640 1 -- 172.21.15.46:0/2650644976 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c540047a0 con 0x555dd60812f0 2024-09-21T03:55:56.644 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.640+0000 7f9c4a7fc640 1 -- 172.21.15.46:0/2650644976 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c54035040 con 0x555dd60812f0 2024-09-21T03:55:56.644 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.640+0000 7f9c617fa640 1 --2- 172.21.15.46:0/2285708970 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f9c4c0b66f0 0x7f9c4c0b8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:56.644 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.640+0000 7f9c68cd0640 1 --2- 172.21.15.46:0/2285708970 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f9c4c0b66f0 0x7f9c4c0b8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:56.644 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.640+0000 7f9c617fa640 1 -- 172.21.15.46:0/2285708970 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f9c580e74b0 con 0x7f9c64108340 2024-09-21T03:55:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.641+0000 7f9c68cd0640 1 --2- 172.21.15.46:0/2285708970 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f9c4c0b66f0 0x7f9c4c0b8c00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c009fd0 tx=0x7f9c5c009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.641+0000 7f9c7169d740 1 -- 172.21.15.46:0/2650644976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555dd60812f0 msgr2=0x555dd644fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.641+0000 7f9c7169d740 1 --2- 172.21.15.46:0/2650644976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555dd60812f0 0x555dd644fef0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f9c54000c00 tx=0x7f9c540044b0 comp rx=0 tx=0).stop 2024-09-21T03:55:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.641+0000 7f9c7169d740 1 -- 172.21.15.46:0/2650644976 shutdown_connections 2024-09-21T03:55:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.641+0000 7f9c7169d740 1 --2- 172.21.15.46:0/2650644976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555dd60894d0 0x555dd6450430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.641+0000 7f9c7169d740 1 --2- 172.21.15.46:0/2650644976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555dd60812f0 0x555dd644fef0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.641+0000 7f9c7169d740 1 --2- 172.21.15.46:0/2650644976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555dd60aa1b0 0x555dd644f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.641+0000 7f9c7169d740 1 -- 172.21.15.46:0/2650644976 >> 172.21.15.46:0/2650644976 conn(0x555dd609e300 msgr2=0x555dd644d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.641+0000 7f9c7169d740 1 -- 172.21.15.46:0/2650644976 shutdown_connections 2024-09-21T03:55:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.641+0000 7f9c7169d740 1 -- 172.21.15.46:0/2650644976 wait complete. 2024-09-21T03:55:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.642+0000 7f9c7169d740 1 -- start start 2024-09-21T03:55:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.642+0000 7f9c7169d740 1 Processor -- start 2024-09-21T03:55:56.649 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.643+0000 7f9c7169d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555dd60812f0 0x555dd645b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:56.649 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.643+0000 7f9c7169d740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555dd60894d0 0x555dd645b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:56.649 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.643+0000 7f9c7169d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555dd60aa1b0 0x555dd646b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:56.649 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.643+0000 7f9c7169d740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x555dd62ebab0 con 0x555dd60894d0 2024-09-21T03:55:56.649 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.643+0000 7f9c637fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555dd60894d0 0x555dd645b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:56.649 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.643+0000 7f9c637fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555dd60894d0 0x555dd645b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41444/0 (socket says 172.21.15.46:41444) 2024-09-21T03:55:56.649 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.643+0000 7f9c637fe640 1 -- 172.21.15.46:0/1821732179 learned_addr learned my addr 172.21.15.46:0/1821732179 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:56.649 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.643+0000 7f9c63fff640 1 --2- 172.21.15.46:0/1821732179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555dd60812f0 0x555dd645b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:56.649 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.643+0000 7f9c7169d740 1 -- 172.21.15.46:0/1821732179 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x555dd6359730 con 0x555dd60812f0 2024-09-21T03:55:56.649 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.643+0000 7f9c7169d740 1 -- 172.21.15.46:0/1821732179 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555dd64624e0 con 0x555dd60aa1b0 2024-09-21T03:55:56.649 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.644+0000 7f9c68cd0640 1 --2- 172.21.15.46:0/1821732179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555dd60aa1b0 0x555dd646b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:56.649 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.644+0000 7f9c637fe640 1 -- 172.21.15.46:0/1821732179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555dd60aa1b0 msgr2=0x555dd646b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:56.650 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.644+0000 7f9c637fe640 1 --2- 172.21.15.46:0/1821732179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555dd60aa1b0 0x555dd646b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:56.650 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.644+0000 7f9c637fe640 1 -- 172.21.15.46:0/1821732179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555dd60812f0 msgr2=0x555dd645b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:56.650 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.644+0000 7f9c637fe640 1 --2- 172.21.15.46:0/1821732179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555dd60812f0 0x555dd645b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:56.650 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.644+0000 7f9c637fe640 1 -- 172.21.15.46:0/1821732179 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dd6115790 con 0x555dd60894d0 2024-09-21T03:55:56.650 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.644+0000 7f9c637fe640 1 --2- 172.21.15.46:0/1821732179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555dd60894d0 0x555dd645b5e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f9c580a99f0 tx=0x7f9c580e52a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94c12f765b23bfe2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:56.650 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.644+0000 7f9c437fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:55:56.650 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.644+0000 7f9c7169d740 10 client.0 _ll_register_callbacks cb 0x555dd63ad6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:55:56.650 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.644+0000 7f9c437fe640 1 -- 172.21.15.46:0/1821732179 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5801c040 con 0x555dd60894d0 2024-09-21T03:55:56.650 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.645+0000 7f9c437fe640 1 -- 172.21.15.46:0/1821732179 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f9c580ac680 con 0x555dd60894d0 2024-09-21T03:55:56.650 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.645+0000 7f9c7169d740 1 -- 172.21.15.46:0/1821732179 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c540047a0 con 0x555dd60894d0 2024-09-21T03:55:56.650 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.645+0000 7f9c437fe640 1 -- 172.21.15.46:0/1821732179 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9c580acb90 con 0x555dd60894d0 2024-09-21T03:55:56.650 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.645+0000 7f9c7169d740 10 client.15603 fetch_fsmap learned FSMap version 20 2024-09-21T03:55:56.650 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.645+0000 7f9c7169d740 1 -- 172.21.15.46:0/1821732179 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({fsmap=20}) -- 0x555dd618e620 con 0x555dd60894d0 2024-09-21T03:55:56.651 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.645+0000 7f9c437fe640 1 -- 172.21.15.46:0/1821732179 <== mon.0 v2:172.21.15.46:3300/0 4 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f9c58094b60 con 0x555dd60894d0 2024-09-21T03:55:56.651 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.645+0000 7f9c7169d740 10 client.15603 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:55:56.651 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.645+0000 7f9c7169d740 10 client.15603 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:55:56.651 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.645+0000 7f9c7169d740 20 client.15603 populate_metadata read hostname 'smithi046' 2024-09-21T03:55:56.651 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.645+0000 7f9c7169d740 1 --2- 172.21.15.46:0/1821732179 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x555dd6068d80 0x555dd64712a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:56.651 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.645+0000 7f9c7169d740 4 client.15603 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:55:56.651 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.645+0000 7f9c7169d740 1 -- 172.21.15.46:0/1821732179 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555dd63c6640 con 0x555dd6068d80 2024-09-21T03:55:56.651 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.646+0000 7f9c63fff640 1 --2- 172.21.15.46:0/1821732179 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x555dd6068d80 0x555dd64712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:56.652 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.646+0000 7f9c63fff640 1 --2- 172.21.15.46:0/1821732179 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x555dd6068d80 0x555dd64712a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=504537f71fa6eb55 server_cookie=becff68313455d6e in_seq=0 out_seq=0 2024-09-21T03:55:56.652 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.646+0000 7f9c437fe640 10 client.15603 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.647+0000 7f9c437fe640 1 -- 172.21.15.46:0/1821732179 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555dd63c6640 con 0x555dd6068d80 2024-09-21T03:55:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.647+0000 7f9c437fe640 10 client.15603 handle_command_reply: tid=0 2024-09-21T03:55:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.647+0000 7f9c7169d740 1 client.15603 shutdown 2024-09-21T03:55:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.647+0000 7f9c7169d740 1 -- 172.21.15.46:0/1821732179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555dd60894d0 msgr2=0x555dd645b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.647+0000 7f9c7169d740 1 --2- 172.21.15.46:0/1821732179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555dd60894d0 0x555dd645b5e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f9c580a99f0 tx=0x7f9c580e52a0 comp rx=0 tx=0).stop 2024-09-21T03:55:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.647+0000 7f9c7169d740 1 -- 172.21.15.46:0/1821732179 shutdown_connections 2024-09-21T03:55:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.647+0000 7f9c7169d740 1 --2- 172.21.15.46:0/1821732179 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x555dd6068d80 0x555dd64712a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.647+0000 7f9c7169d740 1 --2- 172.21.15.46:0/1821732179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555dd60aa1b0 0x555dd646b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.647+0000 7f9c7169d740 1 --2- 172.21.15.46:0/1821732179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555dd60894d0 0x555dd645b5e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.647+0000 7f9c7169d740 1 --2- 172.21.15.46:0/1821732179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555dd60812f0 0x555dd645b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.647+0000 7f9c7169d740 1 -- 172.21.15.46:0/1821732179 >> 172.21.15.46:0/1821732179 conn(0x555dd609e300 msgr2=0x555dd64509e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.648+0000 7f9c437fe640 0 client.15603 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:56.654 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.648+0000 7f9c7169d740 1 -- 172.21.15.46:0/1821732179 shutdown_connections 2024-09-21T03:55:56.654 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.648+0000 7f9c7169d740 1 -- 172.21.15.46:0/1821732179 wait complete. 2024-09-21T03:55:56.654 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.648+0000 7f9c7169d740 20 client.15603 trim_cache size 0 max 16384 2024-09-21T03:55:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.671+0000 7f9c7169d740 1 Processor -- start 2024-09-21T03:55:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.671+0000 7f9c7169d740 1 -- start start 2024-09-21T03:55:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.672+0000 7f9c7169d740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555dd60812f0 0x555dd6458270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.672+0000 7f9c7169d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555dd60aa1b0 0x555dd64587b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.672+0000 7f9c7169d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555dd603e1c0 0x555dd6476aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.672+0000 7f9c7169d740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9c641ab220 con 0x555dd60812f0 2024-09-21T03:55:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.672+0000 7f9c7169d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9c641adac0 con 0x555dd60aa1b0 2024-09-21T03:55:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.672+0000 7f9c7169d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9c641ab8b0 con 0x555dd603e1c0 2024-09-21T03:55:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.672+0000 7f9c63fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555dd60812f0 0x555dd6458270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.672+0000 7f9c63fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555dd60812f0 0x555dd6458270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41460/0 (socket says 172.21.15.46:41460) 2024-09-21T03:55:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.672+0000 7f9c63fff640 1 -- 172.21.15.46:0/1144013960 learned_addr learned my addr 172.21.15.46:0/1144013960 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.672+0000 7f9c68cd0640 1 --2- 172.21.15.46:0/1144013960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555dd603e1c0 0x555dd6476aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.672+0000 7f9c637fe640 1 --2- 172.21.15.46:0/1144013960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555dd60aa1b0 0x555dd64587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.672+0000 7f9c63fff640 1 -- 172.21.15.46:0/1144013960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555dd603e1c0 msgr2=0x555dd6476aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.672+0000 7f9c63fff640 1 --2- 172.21.15.46:0/1144013960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555dd603e1c0 0x555dd6476aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.672+0000 7f9c63fff640 1 -- 172.21.15.46:0/1144013960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555dd60aa1b0 msgr2=0x555dd64587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.672+0000 7f9c63fff640 1 --2- 172.21.15.46:0/1144013960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555dd60aa1b0 0x555dd64587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.672+0000 7f9c63fff640 1 -- 172.21.15.46:0/1144013960 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dd6451ee0 con 0x555dd60812f0 2024-09-21T03:55:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.673+0000 7f9c63fff640 1 --2- 172.21.15.46:0/1144013960 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555dd60812f0 0x555dd6458270 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f9c54005ab0 tx=0x7f9c54031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52735380d915120 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.673+0000 7f9c49ffb640 1 -- 172.21.15.46:0/1144013960 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5405a070 con 0x555dd60812f0 2024-09-21T03:55:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.673+0000 7f9c49ffb640 1 -- 172.21.15.46:0/1144013960 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c54003cf0 con 0x555dd60812f0 2024-09-21T03:55:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.673+0000 7f9c49ffb640 1 -- 172.21.15.46:0/1144013960 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c54035040 con 0x555dd60812f0 2024-09-21T03:55:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.674+0000 7f9c7169d740 1 -- 172.21.15.46:0/1144013960 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555dd60812f0 msgr2=0x555dd6458270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.674+0000 7f9c7169d740 1 --2- 172.21.15.46:0/1144013960 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555dd60812f0 0x555dd6458270 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f9c54005ab0 tx=0x7f9c54031400 comp rx=0 tx=0).stop 2024-09-21T03:55:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.674+0000 7f9c7169d740 1 -- 172.21.15.46:0/1144013960 shutdown_connections 2024-09-21T03:55:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.674+0000 7f9c7169d740 1 --2- 172.21.15.46:0/1144013960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555dd603e1c0 0x555dd6476aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.674+0000 7f9c7169d740 1 --2- 172.21.15.46:0/1144013960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555dd60aa1b0 0x555dd64587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.674+0000 7f9c7169d740 1 --2- 172.21.15.46:0/1144013960 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555dd60812f0 0x555dd6458270 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.674+0000 7f9c7169d740 1 -- 172.21.15.46:0/1144013960 >> 172.21.15.46:0/1144013960 conn(0x555dd609e300 msgr2=0x555dd6459900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.674+0000 7f9c7169d740 1 -- 172.21.15.46:0/1144013960 shutdown_connections 2024-09-21T03:55:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.674+0000 7f9c7169d740 1 -- 172.21.15.46:0/1144013960 wait complete. 2024-09-21T03:55:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.675+0000 7f9c7169d740 1 -- start start 2024-09-21T03:55:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.675+0000 7f9c7169d740 1 Processor -- start 2024-09-21T03:55:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.676+0000 7f9c7169d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555dd603e1c0 0x555dd6465830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.676+0000 7f9c7169d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555dd60aa1b0 0x555dd6465d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.676+0000 7f9c7169d740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555dd64662b0 0x555dd64dacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.676+0000 7f9c7169d740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9c641abf80 con 0x555dd64662b0 2024-09-21T03:55:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.676+0000 7f9c7169d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9c641ad3f0 con 0x555dd603e1c0 2024-09-21T03:55:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.676+0000 7f9c7169d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9c641ac650 con 0x555dd60aa1b0 2024-09-21T03:55:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.676+0000 7f9c7169d740 10 client.0 _ll_register_callbacks cb 0x7f9c580a9a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:55:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.676+0000 7f9c68cd0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555dd64662b0 0x555dd64dacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.676+0000 7f9c68cd0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555dd64662b0 0x555dd64dacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41476/0 (socket says 172.21.15.46:41476) 2024-09-21T03:55:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.676+0000 7f9c68cd0640 1 -- 172.21.15.46:0/3027837679 learned_addr learned my addr 172.21.15.46:0/3027837679 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:55:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.676+0000 7f9c63fff640 1 --2- 172.21.15.46:0/3027837679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555dd603e1c0 0x555dd6465830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.676+0000 7f9c637fe640 1 --2- 172.21.15.46:0/3027837679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555dd60aa1b0 0x555dd6465d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.676+0000 7f9c68cd0640 1 -- 172.21.15.46:0/3027837679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555dd60aa1b0 msgr2=0x555dd6465d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.676+0000 7f9c68cd0640 1 --2- 172.21.15.46:0/3027837679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555dd60aa1b0 0x555dd6465d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.676+0000 7f9c68cd0640 1 -- 172.21.15.46:0/3027837679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555dd603e1c0 msgr2=0x555dd6465830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:55:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.676+0000 7f9c68cd0640 1 --2- 172.21.15.46:0/3027837679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555dd603e1c0 0x555dd6465830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.676+0000 7f9c68cd0640 1 -- 172.21.15.46:0/3027837679 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dd64db1f0 con 0x555dd64662b0 2024-09-21T03:55:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.676+0000 7f9c637fe640 1 --2- 172.21.15.46:0/3027837679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555dd60aa1b0 0x555dd6465d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:55:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.677+0000 7f9c68cd0640 1 --2- 172.21.15.46:0/3027837679 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555dd64662b0 0x555dd64dacb0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c011eb0 tx=0x7f9c5c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af9f5e55d15a0832 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.677+0000 7f9c437fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:55:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.677+0000 7f9c437fe640 1 -- 172.21.15.46:0/3027837679 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c029410 con 0x555dd64662b0 2024-09-21T03:55:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.677+0000 7f9c437fe640 1 -- 172.21.15.46:0/3027837679 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f9c5c0295b0 con 0x555dd64662b0 2024-09-21T03:55:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.677+0000 7f9c7169d740 1 -- 172.21.15.46:0/3027837679 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c54003cf0 con 0x555dd64662b0 2024-09-21T03:55:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.677+0000 7f9c437fe640 1 -- 172.21.15.46:0/3027837679 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9c5c038050 con 0x555dd64662b0 2024-09-21T03:55:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.677+0000 7f9c7169d740 10 client.15609 fetch_fsmap learned FSMap version 20 2024-09-21T03:55:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.677+0000 7f9c7169d740 1 -- 172.21.15.46:0/3027837679 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x555dd64dc4c0 con 0x555dd64662b0 2024-09-21T03:55:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.677+0000 7f9c437fe640 1 -- 172.21.15.46:0/3027837679 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c54003cf0 con 0x555dd64662b0 2024-09-21T03:55:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.678+0000 7f9c437fe640 1 -- 172.21.15.46:0/3027837679 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f9c5c0318d0 con 0x555dd64662b0 2024-09-21T03:55:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.678+0000 7f9c7169d740 10 client.15609 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:55:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.678+0000 7f9c7169d740 10 client.15609 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:55:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.678+0000 7f9c7169d740 20 client.15609 populate_metadata read hostname 'smithi046' 2024-09-21T03:55:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.678+0000 7f9c7169d740 1 --2- 172.21.15.46:0/3027837679 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x555dd64dcc60 0x555dd64df080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.678+0000 7f9c7169d740 4 client.15609 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T03:55:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.678+0000 7f9c7169d740 1 -- 172.21.15.46:0/3027837679 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555dd63c20f0 con 0x555dd64dcc60 2024-09-21T03:55:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.678+0000 7f9c63fff640 1 --2- 172.21.15.46:0/3027837679 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x555dd64dcc60 0x555dd64df080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.678+0000 7f9c437fe640 10 client.15609 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.678+0000 7f9c63fff640 1 --2- 172.21.15.46:0/3027837679 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x555dd64dcc60 0x555dd64df080 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58678b6b0a476f35 server_cookie=92f54abb0027ad57 in_seq=0 out_seq=0 2024-09-21T03:55:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.684+0000 7f9c437fe640 1 -- 172.21.15.46:0/3027837679 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555dd63c20f0 con 0x555dd64dcc60 2024-09-21T03:55:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.685+0000 7f9c437fe640 10 client.15609 handle_command_reply: tid=0 2024-09-21T03:55:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.685+0000 7f9c7169d740 1 client.15609 shutdown 2024-09-21T03:55:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.685+0000 7f9c7169d740 1 -- 172.21.15.46:0/3027837679 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555dd64662b0 msgr2=0x555dd64dacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.685+0000 7f9c7169d740 1 --2- 172.21.15.46:0/3027837679 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555dd64662b0 0x555dd64dacb0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c011eb0 tx=0x7f9c5c004ab0 comp rx=0 tx=0).stop 2024-09-21T03:55:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.685+0000 7f9c7169d740 1 -- 172.21.15.46:0/3027837679 shutdown_connections 2024-09-21T03:55:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.685+0000 7f9c7169d740 1 --2- 172.21.15.46:0/3027837679 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x555dd64dcc60 0x555dd64df080 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.685+0000 7f9c437fe640 0 client.15609 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:55:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.685+0000 7f9c7169d740 1 --2- 172.21.15.46:0/3027837679 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555dd64662b0 0x555dd64dacb0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.685+0000 7f9c7169d740 1 --2- 172.21.15.46:0/3027837679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555dd60aa1b0 0x555dd6465d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.685+0000 7f9c7169d740 1 --2- 172.21.15.46:0/3027837679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555dd603e1c0 0x555dd6465830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.685+0000 7f9c7169d740 1 -- 172.21.15.46:0/3027837679 >> 172.21.15.46:0/3027837679 conn(0x555dd609e300 msgr2=0x555dd64598c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.685+0000 7f9c7169d740 1 -- 172.21.15.46:0/3027837679 shutdown_connections 2024-09-21T03:55:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.685+0000 7f9c7169d740 1 -- 172.21.15.46:0/3027837679 wait complete. 2024-09-21T03:55:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.685+0000 7f9c7169d740 20 client.15609 trim_cache size 0 max 16384 2024-09-21T03:55:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:{ 2024-09-21T03:55:56.689 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "message": "", 2024-09-21T03:55:56.689 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "return_code": 0 2024-09-21T03:55:56.689 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:} 2024-09-21T03:55:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.686+0000 7f9c6a733640 1 -- 172.21.15.46:0/2285708970 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f9c4c0b66f0 msgr2=0x7f9c4c0b8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.686+0000 7f9c6a733640 1 --2- 172.21.15.46:0/2285708970 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f9c4c0b66f0 0x7f9c4c0b8c00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c009fd0 tx=0x7f9c5c009500 comp rx=0 tx=0).stop 2024-09-21T03:55:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.686+0000 7f9c6a733640 1 -- 172.21.15.46:0/2285708970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c64108340 msgr2=0x7f9c6419aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.686+0000 7f9c6a733640 1 --2- 172.21.15.46:0/2285708970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c64108340 0x7f9c6419aa40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9c6406a810 tx=0x7f9c5800ee50 comp rx=0 tx=0).stop 2024-09-21T03:55:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.686+0000 7f9c6a733640 1 -- 172.21.15.46:0/2285708970 shutdown_connections 2024-09-21T03:55:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.686+0000 7f9c6a733640 1 --2- 172.21.15.46:0/2285708970 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f9c4c0b66f0 0x7f9c4c0b8c00 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.686+0000 7f9c6a733640 1 --2- 172.21.15.46:0/2285708970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c64108c90 0x7f9c6419fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.686+0000 7f9c6a733640 1 --2- 172.21.15.46:0/2285708970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c64108340 0x7f9c6419aa40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.686+0000 7f9c6a733640 1 --2- 172.21.15.46:0/2285708970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c64102a10 0x7f9c6419a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.686+0000 7f9c6a733640 1 -- 172.21.15.46:0/2285708970 >> 172.21.15.46:0/2285708970 conn(0x7f9c640fe410 msgr2=0x7f9c64107a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.686+0000 7f9c6a733640 1 -- 172.21.15.46:0/2285708970 shutdown_connections 2024-09-21T03:55:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:55:56.686+0000 7f9c6a733640 1 -- 172.21.15.46:0/2285708970 wait complete. 2024-09-21T03:55:57.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:57 smithi046 ceph-mon[30954]: pgmap v347: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 682 B/s wr, 4 op/s 2024-09-21T03:55:57.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:57 smithi105 ceph-mon[34773]: pgmap v347: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 682 B/s wr, 4 op/s 2024-09-21T03:55:57.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:57 smithi162 ceph-mon[35071]: pgmap v347: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 682 B/s wr, 4 op/s 2024-09-21T03:55:59.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:55:59 smithi046 ceph-mon[30954]: pgmap v348: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-21T03:55:59.567 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:55:59 smithi105 ceph-mon[34773]: pgmap v348: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-21T03:55:59.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:55:59 smithi162 ceph-mon[35071]: pgmap v348: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-21T03:56:00.501 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:56:00 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: 2024-09-21T03:56:00.089+0000 7f4ff9e75640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T03:56:00.502 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:56:00 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: 2024-09-21T03:56:00.090+0000 7f4ff9e75640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T03:56:00.502 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:56:00 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: 2024-09-21T03:56:00.090+0000 7f4ff9e75640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T03:56:00.502 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:56:00 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: 2024-09-21T03:56:00.090+0000 7f4ff9e75640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T03:56:00.502 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 03:56:00 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: 2024-09-21T03:56:00.090+0000 7f4ff9e75640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T03:56:01.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:01 smithi046 ceph-mon[30954]: pgmap v349: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T03:56:01.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:01 smithi046 ceph-mon[30954]: mgrmap e23: x(active, since 9m), standbys: y, z 2024-09-21T03:56:01.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:01 smithi105 ceph-mon[34773]: pgmap v349: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T03:56:01.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:01 smithi105 ceph-mon[34773]: mgrmap e23: x(active, since 9m), standbys: y, z 2024-09-21T03:56:01.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:01 smithi162 ceph-mon[35071]: pgmap v349: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T03:56:01.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:01 smithi162 ceph-mon[35071]: mgrmap e23: x(active, since 9m), standbys: y, z 2024-09-21T03:56:03.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:03 smithi046 ceph-mon[30954]: pgmap v350: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 16 op/s 2024-09-21T03:56:03.567 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:03 smithi105 ceph-mon[34773]: pgmap v350: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 16 op/s 2024-09-21T03:56:03.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:03 smithi162 ceph-mon[35071]: pgmap v350: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 16 op/s 2024-09-21T03:56:05.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:05 smithi046 ceph-mon[30954]: pgmap v351: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-09-21T03:56:05.571 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:05 smithi105 ceph-mon[34773]: pgmap v351: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-09-21T03:56:05.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:05 smithi162 ceph-mon[35071]: pgmap v351: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-09-21T03:56:06.801 INFO:tasks.workunit.client.0.smithi046.stderr:Updating files: 91% (11620/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-21T03:56:07.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:07 smithi046 ceph-mon[30954]: pgmap v352: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T03:56:07.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:07 smithi105 ceph-mon[34773]: pgmap v352: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T03:56:07.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:07 smithi162 ceph-mon[35071]: pgmap v352: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T03:56:07.680 INFO:tasks.workunit.client.0.smithi046.stderr:Note: switching to '1843221895adccfb3b692060251dd6a0183bc410'. 2024-09-21T03:56:07.680 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-21T03:56:07.680 INFO:tasks.workunit.client.0.smithi046.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T03:56:07.680 INFO:tasks.workunit.client.0.smithi046.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T03:56:07.680 INFO:tasks.workunit.client.0.smithi046.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T03:56:07.680 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-21T03:56:07.680 INFO:tasks.workunit.client.0.smithi046.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T03:56:07.680 INFO:tasks.workunit.client.0.smithi046.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T03:56:07.680 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-21T03:56:07.680 INFO:tasks.workunit.client.0.smithi046.stderr: git switch -c 2024-09-21T03:56:07.681 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-21T03:56:07.681 INFO:tasks.workunit.client.0.smithi046.stderr:Or undo this operation with: 2024-09-21T03:56:07.681 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-21T03:56:07.681 INFO:tasks.workunit.client.0.smithi046.stderr: git switch - 2024-09-21T03:56:07.681 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-21T03:56:07.681 INFO:tasks.workunit.client.0.smithi046.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T03:56:07.681 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-21T03:56:07.681 INFO:tasks.workunit.client.0.smithi046.stderr:HEAD is now at 1843221895a Merge PR #56776 into wip-pdonnell-testing-20240920.212106-debug 2024-09-21T03:56:07.685 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-21T03:56:07.711 INFO:tasks.workunit.client.0.smithi046.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T03:56:07.713 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T03:56:07.713 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T03:56:08.384 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T03:56:08.445 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T03:56:08.486 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T03:56:08.487 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T03:56:08.487 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T03:56:08.528 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T03:56:08.531 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T03:56:08.531 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-21T03:56:08.588 INFO:tasks.workunit:Running workunits matching direct_io on client.0... 2024-09-21T03:56:08.590 INFO:tasks.workunit:Running workunit direct_io/big.sh... 2024-09-21T03:56:08.590 DEBUG:teuthology.orchestra.run.smithi046:workunit test direct_io/big.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/big.sh 2024-09-21T03:56:08.651 INFO:tasks.workunit.client.0.smithi046.stdout:test large (16MB) dio write 2024-09-21T03:56:08.652 INFO:tasks.workunit.client.0.smithi046.stderr:+ echo 'test large (16MB) dio write' 2024-09-21T03:56:08.652 INFO:tasks.workunit.client.0.smithi046.stderr:+ dd if=/dev/zero of=foo.big bs=16M count=1 oflag=direct 2024-09-21T03:56:08.727 INFO:tasks.workunit.client.0.smithi046.stderr:1+0 records in 2024-09-21T03:56:08.728 INFO:tasks.workunit.client.0.smithi046.stderr:1+0 records out 2024-09-21T03:56:08.728 INFO:tasks.workunit.client.0.smithi046.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.073607 s, 228 MB/s 2024-09-21T03:56:08.728 INFO:tasks.workunit.client.0.smithi046.stderr:+ echo OK 2024-09-21T03:56:08.729 INFO:tasks.workunit.client.0.smithi046.stdout:OK 2024-09-21T03:56:08.729 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T03:56:08.729 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T03:56:08.804 INFO:tasks.workunit:Running workunit direct_io/direct_io_test... 2024-09-21T03:56:08.804 DEBUG:teuthology.orchestra.run.smithi046:workunit test direct_io/direct_io_test> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/direct_io_test 2024-09-21T03:56:09.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:09 smithi046 ceph-mon[30954]: pgmap v353: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T03:56:09.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:09 smithi105 ceph-mon[34773]: pgmap v353: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T03:56:09.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:09 smithi162 ceph-mon[35071]: pgmap v353: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T03:56:09.792 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.789+0000 7f42c62a2640 1 -- 172.21.15.46:0/4192252651 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42c0102820 msgr2=0x7f42c0102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:09.792 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.789+0000 7f42c62a2640 1 --2- 172.21.15.46:0/4192252651 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42c0102820 0x7f42c0102c30 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f42b0009900 tx=0x7f42b002a410 comp rx=0 tx=0).stop 2024-09-21T03:56:09.792 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.789+0000 7f42c62a2640 1 -- 172.21.15.46:0/4192252651 shutdown_connections 2024-09-21T03:56:09.792 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.789+0000 7f42c62a2640 1 --2- 172.21.15.46:0/4192252651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42c0108aa0 0x7f42c010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:09.793 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.789+0000 7f42c62a2640 1 --2- 172.21.15.46:0/4192252651 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42c0108150 0x7f42c0108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:09.793 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.789+0000 7f42c62a2640 1 --2- 172.21.15.46:0/4192252651 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42c0102820 0x7f42c0102c30 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:09.793 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.789+0000 7f42c62a2640 1 -- 172.21.15.46:0/4192252651 >> 172.21.15.46:0/4192252651 conn(0x7f42c00fe260 msgr2=0x7f42c01006b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:09.793 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.789+0000 7f42c62a2640 1 -- 172.21.15.46:0/4192252651 shutdown_connections 2024-09-21T03:56:09.793 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.789+0000 7f42c62a2640 1 -- 172.21.15.46:0/4192252651 wait complete. 2024-09-21T03:56:09.793 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.790+0000 7f42c62a2640 1 Processor -- start 2024-09-21T03:56:09.793 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.790+0000 7f42c62a2640 1 -- start start 2024-09-21T03:56:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.791+0000 7f42c62a2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42c0102820 0x7f42c019a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.791+0000 7f42c62a2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42c0108150 0x7f42c019a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.791+0000 7f42c62a2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42c0108aa0 0x7f42c019fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.791+0000 7f42c62a2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f42c01138e0 con 0x7f42c0102820 2024-09-21T03:56:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.791+0000 7f42c62a2640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f42c0113760 con 0x7f42c0108aa0 2024-09-21T03:56:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.791+0000 7f42c62a2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f42c0113a60 con 0x7f42c0108150 2024-09-21T03:56:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.791+0000 7f42bffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42c0102820 0x7f42c019a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.791+0000 7f42bffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42c0102820 0x7f42c019a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57116/0 (socket says 172.21.15.46:57116) 2024-09-21T03:56:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.791+0000 7f42bffff640 1 -- 172.21.15.46:0/2226928973 learned_addr learned my addr 172.21.15.46:0/2226928973 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:56:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.791+0000 7f42bf7fe640 1 --2- 172.21.15.46:0/2226928973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42c0108150 0x7f42c019a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.791+0000 7f42c483f640 1 --2- 172.21.15.46:0/2226928973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42c0108aa0 0x7f42c019fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.791+0000 7f42bffff640 1 -- 172.21.15.46:0/2226928973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42c0108150 msgr2=0x7f42c019a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.791+0000 7f42bffff640 1 --2- 172.21.15.46:0/2226928973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42c0108150 0x7f42c019a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.791+0000 7f42bffff640 1 -- 172.21.15.46:0/2226928973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42c0108aa0 msgr2=0x7f42c019fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.791+0000 7f42bffff640 1 --2- 172.21.15.46:0/2226928973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42c0108aa0 0x7f42c019fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.791+0000 7f42bffff640 1 -- 172.21.15.46:0/2226928973 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c01a0250 con 0x7f42c0102820 2024-09-21T03:56:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.791+0000 7f42bffff640 1 --2- 172.21.15.46:0/2226928973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42c0102820 0x7f42c019a320 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f42b0005940 tx=0x7f42b0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.791+0000 7f42bd7fa640 1 -- 172.21.15.46:0/2226928973 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b003f030 con 0x7f42c0102820 2024-09-21T03:56:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.791+0000 7f42bd7fa640 1 -- 172.21.15.46:0/2226928973 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42b0003aa0 con 0x7f42c0102820 2024-09-21T03:56:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.792+0000 7f42bd7fa640 1 -- 172.21.15.46:0/2226928973 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b0035070 con 0x7f42c0102820 2024-09-21T03:56:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.792+0000 7f42c62a2640 1 -- 172.21.15.46:0/2226928973 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42c01a04e0 con 0x7f42c0102820 2024-09-21T03:56:09.797 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.792+0000 7f42c62a2640 1 -- 172.21.15.46:0/2226928973 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42c01a6cd0 con 0x7f42c0102820 2024-09-21T03:56:09.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.794+0000 7f42cd217740 1 Processor -- start 2024-09-21T03:56:09.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.795+0000 7f42cd217740 1 -- start start 2024-09-21T03:56:09.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.795+0000 7f42bd7fa640 1 -- 172.21.15.46:0/2226928973 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f42b0042030 con 0x7f42c0102820 2024-09-21T03:56:09.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.795+0000 7f42cd217740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d043411b0 0x558d046e6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:09.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.795+0000 7f42cd217740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d043182f0 0x558d046e70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:09.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.795+0000 7f42cd217740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d043204d0 0x558d046e7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:09.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.795+0000 7f42cd217740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x558d0465b6f0 con 0x558d043182f0 2024-09-21T03:56:09.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.795+0000 7f42cd217740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x558d0464ab20 con 0x558d043204d0 2024-09-21T03:56:09.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.795+0000 7f42cd217740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558d0464e930 con 0x558d043411b0 2024-09-21T03:56:09.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.795+0000 7f42bffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d043182f0 0x558d046e70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:09.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.795+0000 7f42c483f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d043411b0 0x558d046e6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:09.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.795+0000 7f42c483f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d043411b0 0x558d046e6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:60538/0 (socket says 172.21.15.46:60538) 2024-09-21T03:56:09.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.795+0000 7f42c483f640 1 -- 172.21.15.46:0/2360158250 learned_addr learned my addr 172.21.15.46:0/2360158250 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:56:09.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.795+0000 7f42bf7fe640 1 --2- 172.21.15.46:0/2360158250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d043204d0 0x558d046e7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:09.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.795+0000 7f42c483f640 1 -- 172.21.15.46:0/2360158250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d043204d0 msgr2=0x558d046e7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.795+0000 7f42c483f640 1 --2- 172.21.15.46:0/2360158250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d043204d0 0x558d046e7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.795+0000 7f42c483f640 1 -- 172.21.15.46:0/2360158250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d043182f0 msgr2=0x558d046e70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.795+0000 7f42c483f640 1 --2- 172.21.15.46:0/2360158250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d043182f0 0x558d046e70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.795+0000 7f42c483f640 1 -- 172.21.15.46:0/2360158250 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d04610530 con 0x558d043411b0 2024-09-21T03:56:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.796+0000 7f42bd7fa640 1 --2- 172.21.15.46:0/2226928973 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f42a80b6680 0x7f42a80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.796+0000 7f42c483f640 1 --2- 172.21.15.46:0/2360158250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d043411b0 0x558d046e6ba0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f42b8009f90 tx=0x7f42b800c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a39871744c21dc87 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.796+0000 7f42bffff640 1 --2- 172.21.15.46:0/2226928973 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f42a80b6680 0x7f42a80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.796+0000 7f42a67fc640 1 -- 172.21.15.46:0/2360158250 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b801a070 con 0x558d043411b0 2024-09-21T03:56:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.796+0000 7f42bd7fa640 1 -- 172.21.15.46:0/2226928973 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f42b0107de0 con 0x7f42c0102820 2024-09-21T03:56:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.796+0000 7f42a67fc640 1 -- 172.21.15.46:0/2360158250 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42b80158c0 con 0x558d043411b0 2024-09-21T03:56:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.796+0000 7f42a67fc640 1 -- 172.21.15.46:0/2360158250 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b800a7e0 con 0x558d043411b0 2024-09-21T03:56:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.797+0000 7f42cd217740 1 -- 172.21.15.46:0/2360158250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d043411b0 msgr2=0x558d046e6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.797+0000 7f42bffff640 1 --2- 172.21.15.46:0/2226928973 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f42a80b6680 0x7f42a80b8b90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x558d046e5820 tx=0x7f42b010b8d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.797+0000 7f42cd217740 1 --2- 172.21.15.46:0/2360158250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d043411b0 0x558d046e6ba0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f42b8009f90 tx=0x7f42b800c8b0 comp rx=0 tx=0).stop 2024-09-21T03:56:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.797+0000 7f42cd217740 1 -- 172.21.15.46:0/2360158250 shutdown_connections 2024-09-21T03:56:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.797+0000 7f42cd217740 1 --2- 172.21.15.46:0/2360158250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d043204d0 0x558d046e7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.797+0000 7f42cd217740 1 --2- 172.21.15.46:0/2360158250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d043182f0 0x558d046e70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.797+0000 7f42cd217740 1 --2- 172.21.15.46:0/2360158250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d043411b0 0x558d046e6ba0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.797+0000 7f42cd217740 1 -- 172.21.15.46:0/2360158250 >> 172.21.15.46:0/2360158250 conn(0x558d04335300 msgr2=0x558d046e4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.797+0000 7f42cd217740 1 -- 172.21.15.46:0/2360158250 shutdown_connections 2024-09-21T03:56:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.797+0000 7f42cd217740 1 -- 172.21.15.46:0/2360158250 wait complete. 2024-09-21T03:56:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.797+0000 7f42cd217740 1 -- start start 2024-09-21T03:56:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.798+0000 7f42cd217740 1 Processor -- start 2024-09-21T03:56:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.798+0000 7f42cd217740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d043182f0 0x558d046f22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.798+0000 7f42cd217740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d043204d0 0x558d046f2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.798+0000 7f42cd217740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d043411b0 0x558d046fe610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.798+0000 7f42cd217740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x558d04582ab0 con 0x558d043204d0 2024-09-21T03:56:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.798+0000 7f42cd217740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x558d045f0730 con 0x558d043182f0 2024-09-21T03:56:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.798+0000 7f42cd217740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558d046f5320 con 0x558d043411b0 2024-09-21T03:56:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.798+0000 7f42cd217740 10 client.0 _ll_register_callbacks cb 0x558d046446b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:56:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.798+0000 7f42bf7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d043204d0 0x558d046f2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.798+0000 7f42bf7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d043204d0 0x558d046f2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57138/0 (socket says 172.21.15.46:57138) 2024-09-21T03:56:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.798+0000 7f42c483f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d043411b0 0x558d046fe610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.798+0000 7f42bf7fe640 1 -- 172.21.15.46:0/2934456006 learned_addr learned my addr 172.21.15.46:0/2934456006 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:56:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.798+0000 7f42c483f640 1 --2- 172.21.15.46:0/2934456006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d043182f0 0x558d046f22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.798+0000 7f42c483f640 1 -- 172.21.15.46:0/2934456006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d043182f0 msgr2=0x558d046f22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.798+0000 7f42c483f640 1 --2- 172.21.15.46:0/2934456006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d043182f0 0x558d046f22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.798+0000 7f42c483f640 1 -- 172.21.15.46:0/2934456006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d043204d0 msgr2=0x558d046f2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.798+0000 7f42c483f640 1 --2- 172.21.15.46:0/2934456006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d043204d0 0x558d046f2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.799+0000 7f42c483f640 1 -- 172.21.15.46:0/2934456006 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d043ac790 con 0x558d043411b0 2024-09-21T03:56:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.799+0000 7f42bf7fe640 1 --2- 172.21.15.46:0/2934456006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d043204d0 0x558d046f2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:56:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.799+0000 7f42c483f640 1 --2- 172.21.15.46:0/2934456006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d043411b0 0x558d046fe610 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x558d046e5740 tx=0x7f42b800a4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcefdbe41adef0ab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.799+0000 7f429f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T03:56:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.799+0000 7f429f7fe640 1 -- 172.21.15.46:0/2934456006 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b8029060 con 0x558d043411b0 2024-09-21T03:56:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.799+0000 7f429f7fe640 1 -- 172.21.15.46:0/2934456006 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f42b8015c80 con 0x558d043411b0 2024-09-21T03:56:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.799+0000 7f42cd217740 1 -- 172.21.15.46:0/2934456006 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42b80158c0 con 0x558d043411b0 2024-09-21T03:56:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.799+0000 7f429f7fe640 1 -- 172.21.15.46:0/2934456006 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f42b801a070 con 0x558d043411b0 2024-09-21T03:56:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.799+0000 7f42cd217740 10 client.25318 fetch_fsmap learned FSMap version 20 2024-09-21T03:56:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.799+0000 7f42cd217740 1 -- 172.21.15.46:0/2934456006 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x558d04425620 con 0x558d043411b0 2024-09-21T03:56:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.799+0000 7f429f7fe640 1 -- 172.21.15.46:0/2934456006 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42b80158c0 con 0x558d043411b0 2024-09-21T03:56:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.799+0000 7f429f7fe640 1 -- 172.21.15.46:0/2934456006 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f42b8024910 con 0x558d043411b0 2024-09-21T03:56:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.800+0000 7f42cd217740 10 client.25318 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:56:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.800+0000 7f42cd217740 10 client.25318 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:56:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.800+0000 7f42cd217740 20 client.25318 populate_metadata read hostname 'smithi046' 2024-09-21T03:56:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.800+0000 7f42cd217740 1 --2- 172.21.15.46:0/2934456006 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558d042ffd80 0x558d04704350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.800+0000 7f42cd217740 4 client.25318 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:56:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.800+0000 7f42cd217740 1 -- 172.21.15.46:0/2934456006 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d0465d640 con 0x558d042ffd80 2024-09-21T03:56:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.800+0000 7f42bf7fe640 1 --2- 172.21.15.46:0/2934456006 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558d042ffd80 0x558d04704350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.800+0000 7f42bf7fe640 1 --2- 172.21.15.46:0/2934456006 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558d042ffd80 0x558d04704350 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a003ba5e297eec7 server_cookie=e7ed24d56469a640 in_seq=0 out_seq=0 2024-09-21T03:56:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.800+0000 7f429f7fe640 10 client.25318 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:56:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.801+0000 7f429f7fe640 1 -- 172.21.15.46:0/2934456006 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558d0465d640 con 0x558d042ffd80 2024-09-21T03:56:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.801+0000 7f429f7fe640 10 client.25318 handle_command_reply: tid=0 2024-09-21T03:56:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.801+0000 7f42cd217740 1 client.25318 shutdown 2024-09-21T03:56:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.801+0000 7f42cd217740 1 -- 172.21.15.46:0/2934456006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d043411b0 msgr2=0x558d046fe610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.801+0000 7f42cd217740 1 --2- 172.21.15.46:0/2934456006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d043411b0 0x558d046fe610 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x558d046e5740 tx=0x7f42b800a4a0 comp rx=0 tx=0).stop 2024-09-21T03:56:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.801+0000 7f42cd217740 1 -- 172.21.15.46:0/2934456006 shutdown_connections 2024-09-21T03:56:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.801+0000 7f42cd217740 1 --2- 172.21.15.46:0/2934456006 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558d042ffd80 0x558d04704350 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.801+0000 7f42cd217740 1 --2- 172.21.15.46:0/2934456006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d043411b0 0x558d046fe610 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.801+0000 7f42cd217740 1 --2- 172.21.15.46:0/2934456006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d043204d0 0x558d046f2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.801+0000 7f42cd217740 1 --2- 172.21.15.46:0/2934456006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d043182f0 0x558d046f22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.801+0000 7f429f7fe640 0 client.25318 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:56:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.801+0000 7f42cd217740 1 -- 172.21.15.46:0/2934456006 >> 172.21.15.46:0/2934456006 conn(0x558d04335300 msgr2=0x558d046e7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.801+0000 7f42cd217740 1 -- 172.21.15.46:0/2934456006 shutdown_connections 2024-09-21T03:56:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.801+0000 7f42cd217740 1 -- 172.21.15.46:0/2934456006 wait complete. 2024-09-21T03:56:09.811 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.802+0000 7f42cd217740 20 client.25318 trim_cache size 0 max 16384 2024-09-21T03:56:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.818+0000 7f42cd217740 1 Processor -- start 2024-09-21T03:56:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.818+0000 7f42cd217740 1 -- start start 2024-09-21T03:56:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.819+0000 7f42cd217740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d043182f0 0x558d046f41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.819+0000 7f42cd217740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d043204d0 0x558d046fe580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.819+0000 7f42cd217740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d043411b0 0x558d046f1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.819+0000 7f42cd217740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f42c01ad370 con 0x558d043204d0 2024-09-21T03:56:09.823 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.819+0000 7f42cd217740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f42c01afc10 con 0x558d043411b0 2024-09-21T03:56:09.823 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.819+0000 7f42cd217740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f42c01ada00 con 0x558d043182f0 2024-09-21T03:56:09.823 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.819+0000 7f42bf7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d043204d0 0x558d046fe580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:09.823 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.819+0000 7f42c483f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d043182f0 0x558d046f41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:09.823 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.819+0000 7f42bf7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d043204d0 0x558d046fe580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57142/0 (socket says 172.21.15.46:57142) 2024-09-21T03:56:09.823 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.819+0000 7f42c483f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d043182f0 0x558d046f41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:60554/0 (socket says 172.21.15.46:60554) 2024-09-21T03:56:09.823 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.819+0000 7f42bf7fe640 1 -- 172.21.15.46:0/3942646374 learned_addr learned my addr 172.21.15.46:0/3942646374 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:56:09.823 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.819+0000 7f42c483f640 1 --2- 172.21.15.46:0/3942646374 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d043411b0 0x558d046f1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:09.823 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.819+0000 7f42bf7fe640 1 -- 172.21.15.46:0/3942646374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d043182f0 msgr2=0x558d046f41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:09.823 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.819+0000 7f42bf7fe640 1 --2- 172.21.15.46:0/3942646374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d043182f0 0x558d046f41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:09.823 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.819+0000 7f42bf7fe640 1 -- 172.21.15.46:0/3942646374 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d043411b0 msgr2=0x558d046f1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:09.824 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.819+0000 7f42bf7fe640 1 --2- 172.21.15.46:0/3942646374 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d043411b0 0x558d046f1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:09.824 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.819+0000 7f42bf7fe640 1 -- 172.21.15.46:0/3942646374 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d046e9a50 con 0x558d043204d0 2024-09-21T03:56:09.824 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.819+0000 7f42c483f640 1 --2- 172.21.15.46:0/3942646374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d043182f0 0x558d046f41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:56:09.824 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.819+0000 7f42bf7fe640 1 --2- 172.21.15.46:0/3942646374 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d043204d0 0x558d046fe580 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x558d046f5350 tx=0x7f42b400bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec16ffb103814078 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:09.824 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.820+0000 7f42a5ffb640 1 -- 172.21.15.46:0/3942646374 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b4003b00 con 0x558d043204d0 2024-09-21T03:56:09.824 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.820+0000 7f42a5ffb640 1 -- 172.21.15.46:0/3942646374 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42b4003ca0 con 0x558d043204d0 2024-09-21T03:56:09.824 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.820+0000 7f42a5ffb640 1 -- 172.21.15.46:0/3942646374 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b4011730 con 0x558d043204d0 2024-09-21T03:56:09.828 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.821+0000 7f42cd217740 1 -- 172.21.15.46:0/3942646374 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d043204d0 msgr2=0x558d046fe580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:09.828 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.821+0000 7f42cd217740 1 --2- 172.21.15.46:0/3942646374 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d043204d0 0x558d046fe580 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x558d046f5350 tx=0x7f42b400bd80 comp rx=0 tx=0).stop 2024-09-21T03:56:09.828 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.821+0000 7f42cd217740 1 -- 172.21.15.46:0/3942646374 shutdown_connections 2024-09-21T03:56:09.828 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.821+0000 7f42cd217740 1 --2- 172.21.15.46:0/3942646374 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d043411b0 0x558d046f1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:09.828 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.821+0000 7f42cd217740 1 --2- 172.21.15.46:0/3942646374 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d043204d0 0x558d046fe580 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:09.828 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.821+0000 7f42cd217740 1 --2- 172.21.15.46:0/3942646374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d043182f0 0x558d046f41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:09.828 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.821+0000 7f42cd217740 1 -- 172.21.15.46:0/3942646374 >> 172.21.15.46:0/3942646374 conn(0x558d04335300 msgr2=0x558d046f1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:09.828 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.821+0000 7f42cd217740 1 -- 172.21.15.46:0/3942646374 shutdown_connections 2024-09-21T03:56:09.828 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.821+0000 7f42cd217740 1 -- 172.21.15.46:0/3942646374 wait complete. 2024-09-21T03:56:09.828 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.821+0000 7f42cd217740 1 -- start start 2024-09-21T03:56:09.829 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.822+0000 7f42cd217740 1 Processor -- start 2024-09-21T03:56:09.829 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.822+0000 7f42cd217740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d043182f0 0x558d04707290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:09.829 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.822+0000 7f42cd217740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d043204d0 0x558d04707870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:09.829 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.822+0000 7f42cd217740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d043411b0 0x558d04766fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:09.829 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.822+0000 7f42cd217740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f42c01ae0d0 con 0x558d043411b0 2024-09-21T03:56:09.829 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.822+0000 7f42cd217740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f42c01af540 con 0x558d043182f0 2024-09-21T03:56:09.829 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.822+0000 7f42cd217740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f42c01ae7a0 con 0x558d043204d0 2024-09-21T03:56:09.829 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.822+0000 7f42cd217740 10 client.0 _ll_register_callbacks cb 0x7f42b8018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:56:09.829 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.822+0000 7f42c483f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d043411b0 0x558d04766fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:09.829 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.822+0000 7f42bf7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d043204d0 0x558d04707870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:09.829 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.822+0000 7f42c483f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d043411b0 0x558d04766fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57148/0 (socket says 172.21.15.46:57148) 2024-09-21T03:56:09.829 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.822+0000 7f42c483f640 1 -- 172.21.15.46:0/3516857360 learned_addr learned my addr 172.21.15.46:0/3516857360 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:56:09.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.822+0000 7f42c483f640 1 --2- 172.21.15.46:0/3516857360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d043182f0 0x558d04707290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:09.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.822+0000 7f42c483f640 1 -- 172.21.15.46:0/3516857360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d043204d0 msgr2=0x558d04707870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:09.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.822+0000 7f42c483f640 1 --2- 172.21.15.46:0/3516857360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d043204d0 0x558d04707870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:09.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.822+0000 7f42c483f640 1 -- 172.21.15.46:0/3516857360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d043182f0 msgr2=0x558d04707290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:09.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.822+0000 7f42c483f640 1 --2- 172.21.15.46:0/3516857360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d043182f0 0x558d04707290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:09.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.822+0000 7f42c483f640 1 -- 172.21.15.46:0/3516857360 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d04767650 con 0x558d043411b0 2024-09-21T03:56:09.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.823+0000 7f42c483f640 1 --2- 172.21.15.46:0/3516857360 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d043411b0 0x558d04766fb0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f42b8009d70 tx=0x7f42b800a4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c549096ae6f19323 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:09.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.823+0000 7f429f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:56:09.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.823+0000 7f429f7fe640 1 -- 172.21.15.46:0/3516857360 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b8029040 con 0x558d043411b0 2024-09-21T03:56:09.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.823+0000 7f429f7fe640 1 -- 172.21.15.46:0/3516857360 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f42b80093a0 con 0x558d043411b0 2024-09-21T03:56:09.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.823+0000 7f42cd217740 1 -- 172.21.15.46:0/3516857360 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42b4003ca0 con 0x558d043411b0 2024-09-21T03:56:09.831 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.823+0000 7f429f7fe640 1 -- 172.21.15.46:0/3516857360 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f42b803d050 con 0x558d043411b0 2024-09-21T03:56:09.831 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.823+0000 7f42cd217740 10 client.15633 fetch_fsmap learned FSMap version 20 2024-09-21T03:56:09.831 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.823+0000 7f42cd217740 1 -- 172.21.15.46:0/3516857360 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x558d0476e9d0 con 0x558d043411b0 2024-09-21T03:56:09.831 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.823+0000 7f429f7fe640 1 -- 172.21.15.46:0/3516857360 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42b4003ca0 con 0x558d043411b0 2024-09-21T03:56:09.831 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.823+0000 7f429f7fe640 1 -- 172.21.15.46:0/3516857360 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f42b8035020 con 0x558d043411b0 2024-09-21T03:56:09.831 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.823+0000 7f42cd217740 10 client.15633 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:56:09.831 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.823+0000 7f42cd217740 10 client.15633 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:56:09.831 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.823+0000 7f42cd217740 20 client.15633 populate_metadata read hostname 'smithi046' 2024-09-21T03:56:09.831 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.823+0000 7f42cd217740 1 --2- 172.21.15.46:0/3516857360 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558d042d51c0 0x558d04771130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:09.831 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.823+0000 7f42cd217740 4 client.15633 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T03:56:09.831 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.823+0000 7f42cd217740 1 -- 172.21.15.46:0/3516857360 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558d046590f0 con 0x558d042d51c0 2024-09-21T03:56:09.831 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.824+0000 7f42bf7fe640 1 --2- 172.21.15.46:0/3516857360 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558d042d51c0 0x558d04771130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:09.832 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.824+0000 7f429f7fe640 10 client.15633 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:56:09.832 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.824+0000 7f42bf7fe640 1 --2- 172.21.15.46:0/3516857360 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558d042d51c0 0x558d04771130 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b5588f4ebcfb5fb server_cookie=d4930b7c31657207 in_seq=0 out_seq=0 2024-09-21T03:56:09.843 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.840+0000 7f429f7fe640 1 -- 172.21.15.46:0/3516857360 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558d046590f0 con 0x558d042d51c0 2024-09-21T03:56:09.844 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.840+0000 7f429f7fe640 10 client.15633 handle_command_reply: tid=0 2024-09-21T03:56:09.844 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.840+0000 7f42cd217740 1 client.15633 shutdown 2024-09-21T03:56:09.844 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.841+0000 7f42cd217740 1 -- 172.21.15.46:0/3516857360 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d043411b0 msgr2=0x558d04766fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:09.844 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.841+0000 7f42cd217740 1 --2- 172.21.15.46:0/3516857360 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d043411b0 0x558d04766fb0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f42b8009d70 tx=0x7f42b800a4a0 comp rx=0 tx=0).stop 2024-09-21T03:56:09.844 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.841+0000 7f42cd217740 1 -- 172.21.15.46:0/3516857360 shutdown_connections 2024-09-21T03:56:09.844 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.841+0000 7f42cd217740 1 --2- 172.21.15.46:0/3516857360 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558d042d51c0 0x558d04771130 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:09.844 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.841+0000 7f42cd217740 1 --2- 172.21.15.46:0/3516857360 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d043411b0 0x558d04766fb0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:09.844 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.841+0000 7f42cd217740 1 --2- 172.21.15.46:0/3516857360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d043204d0 0x558d04707870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:09.844 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.841+0000 7f429f7fe640 0 client.15633 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:56:09.844 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.841+0000 7f42cd217740 1 --2- 172.21.15.46:0/3516857360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d043182f0 0x558d04707290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:09.845 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.841+0000 7f42cd217740 1 -- 172.21.15.46:0/3516857360 >> 172.21.15.46:0/3516857360 conn(0x558d04335300 msgr2=0x558d046f3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:09.845 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.841+0000 7f42cd217740 1 -- 172.21.15.46:0/3516857360 shutdown_connections 2024-09-21T03:56:09.845 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.841+0000 7f42cd217740 1 -- 172.21.15.46:0/3516857360 wait complete. 2024-09-21T03:56:09.845 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.841+0000 7f42cd217740 20 client.15633 trim_cache size 0 max 16384 2024-09-21T03:56:09.845 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:{ 2024-09-21T03:56:09.845 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "message": "", 2024-09-21T03:56:09.845 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "return_code": 0 2024-09-21T03:56:09.845 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:} 2024-09-21T03:56:09.846 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.842+0000 7f42c62a2640 1 -- 172.21.15.46:0/2226928973 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f42a80b6680 msgr2=0x7f42a80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:09.846 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.842+0000 7f42c62a2640 1 --2- 172.21.15.46:0/2226928973 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f42a80b6680 0x7f42a80b8b90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x558d046e5820 tx=0x7f42b010b8d0 comp rx=0 tx=0).stop 2024-09-21T03:56:09.846 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.842+0000 7f42c62a2640 1 -- 172.21.15.46:0/2226928973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42c0102820 msgr2=0x7f42c019a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:09.846 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.842+0000 7f42c62a2640 1 --2- 172.21.15.46:0/2226928973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42c0102820 0x7f42c019a320 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f42b0005940 tx=0x7f42b0004270 comp rx=0 tx=0).stop 2024-09-21T03:56:09.847 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.842+0000 7f42c62a2640 1 -- 172.21.15.46:0/2226928973 shutdown_connections 2024-09-21T03:56:09.847 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.842+0000 7f42c62a2640 1 --2- 172.21.15.46:0/2226928973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42c0108aa0 0x7f42c019fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:09.847 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.842+0000 7f42c62a2640 1 --2- 172.21.15.46:0/2226928973 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f42a80b6680 0x7f42a80b8b90 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:09.847 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.842+0000 7f42c62a2640 1 --2- 172.21.15.46:0/2226928973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42c0108150 0x7f42c019a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:09.847 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.842+0000 7f42c62a2640 1 --2- 172.21.15.46:0/2226928973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42c0102820 0x7f42c019a320 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:09.847 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.842+0000 7f42c62a2640 1 -- 172.21.15.46:0/2226928973 >> 172.21.15.46:0/2226928973 conn(0x7f42c00fe260 msgr2=0x7f42c0100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:09.847 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.842+0000 7f42c62a2640 1 -- 172.21.15.46:0/2226928973 shutdown_connections 2024-09-21T03:56:09.847 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:09.842+0000 7f42c62a2640 1 -- 172.21.15.46:0/2226928973 wait complete. 2024-09-21T03:56:11.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:11 smithi046 ceph-mon[30954]: pgmap v354: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T03:56:11.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:11 smithi105 ceph-mon[34773]: pgmap v354: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T03:56:11.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:11 smithi162 ceph-mon[35071]: pgmap v354: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T03:56:13.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:13 smithi046 ceph-mon[30954]: pgmap v355: 97 pgs: 97 active+clean; 9.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 706 KiB/s wr, 19 op/s 2024-09-21T03:56:13.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:13 smithi105 ceph-mon[34773]: pgmap v355: 97 pgs: 97 active+clean; 9.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 706 KiB/s wr, 19 op/s 2024-09-21T03:56:13.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:13 smithi162 ceph-mon[35071]: pgmap v355: 97 pgs: 97 active+clean; 9.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 706 KiB/s wr, 19 op/s 2024-09-21T03:56:15.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:15 smithi046 ceph-mon[30954]: pgmap v356: 97 pgs: 97 active+clean; 18 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 1.4 MiB/s wr, 1.23k op/s 2024-09-21T03:56:15.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:15 smithi105 ceph-mon[34773]: pgmap v356: 97 pgs: 97 active+clean; 18 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 1.4 MiB/s wr, 1.23k op/s 2024-09-21T03:56:15.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:15 smithi162 ceph-mon[35071]: pgmap v356: 97 pgs: 97 active+clean; 18 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 1.4 MiB/s wr, 1.23k op/s 2024-09-21T03:56:17.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:17 smithi046 ceph-mon[30954]: pgmap v357: 97 pgs: 97 active+clean; 9.8 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 1.4 MiB/s wr, 1.22k op/s 2024-09-21T03:56:17.569 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:17 smithi105 ceph-mon[34773]: pgmap v357: 97 pgs: 97 active+clean; 9.8 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 1.4 MiB/s wr, 1.22k op/s 2024-09-21T03:56:17.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:17 smithi162 ceph-mon[35071]: pgmap v357: 97 pgs: 97 active+clean; 9.8 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 1.4 MiB/s wr, 1.22k op/s 2024-09-21T03:56:18.002 INFO:tasks.workunit.client.0.smithi046.stdout:.......... 2024-09-21T03:56:18.002 INFO:tasks.workunit.client.0.smithi046.stdout:do_o_direct_reads: SUCCESS 2024-09-21T03:56:18.005 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T03:56:18.005 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T03:56:18.076 INFO:tasks.workunit:Running workunit direct_io/misc.sh... 2024-09-21T03:56:18.076 DEBUG:teuthology.orchestra.run.smithi046:workunit test direct_io/misc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/misc.sh 2024-09-21T03:56:18.137 INFO:tasks.workunit.client.0.smithi046.stdout:test read from hole 2024-09-21T03:56:18.138 INFO:tasks.workunit.client.0.smithi046.stderr:+ echo 'test read from hole' 2024-09-21T03:56:18.138 INFO:tasks.workunit.client.0.smithi046.stderr:+ dd if=/dev/zero of=dd3 bs=1 seek=1048576 count=0 2024-09-21T03:56:18.140 INFO:tasks.workunit.client.0.smithi046.stderr:0+0 records in 2024-09-21T03:56:18.140 INFO:tasks.workunit.client.0.smithi046.stderr:0+0 records out 2024-09-21T03:56:18.140 INFO:tasks.workunit.client.0.smithi046.stderr:0 bytes copied, 9.1565e-05 s, 0.0 kB/s 2024-09-21T03:56:18.140 INFO:tasks.workunit.client.0.smithi046.stderr:+ dd if=dd3 of=/tmp/ddout1 skip=8 bs=512 count=2 iflag=direct 2024-09-21T03:56:18.142 INFO:tasks.workunit.client.0.smithi046.stderr:2+0 records in 2024-09-21T03:56:18.142 INFO:tasks.workunit.client.0.smithi046.stderr:2+0 records out 2024-09-21T03:56:18.142 INFO:tasks.workunit.client.0.smithi046.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00152437 s, 672 kB/s 2024-09-21T03:56:18.142 INFO:tasks.workunit.client.0.smithi046.stderr:+ dd if=/dev/zero of=/tmp/dd3 bs=512 count=2 2024-09-21T03:56:18.143 INFO:tasks.workunit.client.0.smithi046.stderr:2+0 records in 2024-09-21T03:56:18.143 INFO:tasks.workunit.client.0.smithi046.stderr:2+0 records out 2024-09-21T03:56:18.143 INFO:tasks.workunit.client.0.smithi046.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 4.118e-05 s, 24.9 MB/s 2024-09-21T03:56:18.143 INFO:tasks.workunit.client.0.smithi046.stderr:+ cmp /tmp/dd3 /tmp/ddout1 2024-09-21T03:56:18.144 INFO:tasks.workunit.client.0.smithi046.stdout:other thing 2024-09-21T03:56:18.144 INFO:tasks.workunit.client.0.smithi046.stderr:+ echo 'other thing' 2024-09-21T03:56:18.144 INFO:tasks.workunit.client.0.smithi046.stderr:+ dd if=/dev/urandom of=/tmp/dd10 bs=500 count=1 2024-09-21T03:56:18.145 INFO:tasks.workunit.client.0.smithi046.stderr:1+0 records in 2024-09-21T03:56:18.145 INFO:tasks.workunit.client.0.smithi046.stderr:1+0 records out 2024-09-21T03:56:18.145 INFO:tasks.workunit.client.0.smithi046.stderr:500 bytes copied, 5.1822e-05 s, 9.6 MB/s 2024-09-21T03:56:18.145 INFO:tasks.workunit.client.0.smithi046.stderr:+ dd if=/tmp/dd10 of=dd10 bs=512 seek=8388 count=1 2024-09-21T03:56:18.152 INFO:tasks.workunit.client.0.smithi046.stderr:0+1 records in 2024-09-21T03:56:18.152 INFO:tasks.workunit.client.0.smithi046.stderr:0+1 records out 2024-09-21T03:56:18.152 INFO:tasks.workunit.client.0.smithi046.stderr:500 bytes copied, 0.00558176 s, 89.6 kB/s 2024-09-21T03:56:18.152 INFO:tasks.workunit.client.0.smithi046.stderr:+ dd if=dd10 of=/tmp/dd10out bs=512 skip=8388 count=1 iflag=direct 2024-09-21T03:56:18.158 INFO:tasks.workunit.client.0.smithi046.stderr:0+1 records in 2024-09-21T03:56:18.158 INFO:tasks.workunit.client.0.smithi046.stderr:0+1 records out 2024-09-21T03:56:18.158 INFO:tasks.workunit.client.0.smithi046.stderr:500 bytes copied, 0.005122 s, 97.6 kB/s 2024-09-21T03:56:18.158 INFO:tasks.workunit.client.0.smithi046.stderr:+ cmp /tmp/dd10 /tmp/dd10out 2024-09-21T03:56:18.159 INFO:tasks.workunit.client.0.smithi046.stdout:OK 2024-09-21T03:56:18.160 INFO:tasks.workunit.client.0.smithi046.stderr:+ echo OK 2024-09-21T03:56:18.160 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T03:56:18.160 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T03:56:18.236 INFO:tasks.workunit:Running workunit direct_io/test_short_dio_read... 2024-09-21T03:56:18.236 DEBUG:teuthology.orchestra.run.smithi046:workunit test direct_io/test_short_dio_read> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/test_short_dio_read 2024-09-21T03:56:18.304 INFO:tasks.workunit.client.0.smithi046.stdout:writing first 3 bytes of 10k file 2024-09-21T03:56:18.304 INFO:tasks.workunit.client.0.smithi046.stdout:reading O_DIRECT 2024-09-21T03:56:18.304 INFO:tasks.workunit.client.0.smithi046.stdout:got 10000 2024-09-21T03:56:18.305 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T03:56:18.305 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T03:56:18.380 INFO:tasks.workunit:Running workunit direct_io/test_sync_io... 2024-09-21T03:56:18.380 DEBUG:teuthology.orchestra.run.smithi046:workunit test direct_io/test_sync_io> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/test_sync_io 2024-09-21T03:56:19.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:19 smithi046 ceph-mon[30954]: pgmap v358: 97 pgs: 97 active+clean; 1.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.4 MiB/s wr, 2.80k op/s 2024-09-21T03:56:19.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:19 smithi105 ceph-mon[34773]: pgmap v358: 97 pgs: 97 active+clean; 1.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.4 MiB/s wr, 2.80k op/s 2024-09-21T03:56:19.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:19 smithi162 ceph-mon[35071]: pgmap v358: 97 pgs: 97 active+clean; 1.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.4 MiB/s wr, 2.80k op/s 2024-09-21T03:56:19.983 INFO:tasks.workunit.client.0.smithi046.stdout:writing pattern 2024-09-21T03:56:19.983 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4190208 len 1024 2024-09-21T03:56:19.983 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4190208 len 1024 2024-09-21T03:56:19.983 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4190208 len 1024 2024-09-21T03:56:19.983 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4190208 len 1024 2024-09-21T03:56:19.984 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4190208 len 2048 2024-09-21T03:56:19.984 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4190208 len 2048 2024-09-21T03:56:19.984 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4190208 len 2048 2024-09-21T03:56:19.984 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4190208 len 2048 2024-09-21T03:56:19.984 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4190208 len 4096 2024-09-21T03:56:19.984 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4190208 len 4096 2024-09-21T03:56:19.984 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4190208 len 4096 2024-09-21T03:56:19.984 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4190208 len 4096 2024-09-21T03:56:19.984 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4190208 len 8192 2024-09-21T03:56:19.984 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4190208 len 8192 2024-09-21T03:56:19.984 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4190208 len 8192 2024-09-21T03:56:19.984 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4190208 len 8192 2024-09-21T03:56:19.984 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4190208 len 16384 2024-09-21T03:56:19.984 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4190208 len 16384 2024-09-21T03:56:19.984 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4190208 len 16384 2024-09-21T03:56:19.985 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4190208 len 16384 2024-09-21T03:56:19.985 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4190720 len 1024 2024-09-21T03:56:19.985 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4190720 len 1024 2024-09-21T03:56:19.985 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4190720 len 1024 2024-09-21T03:56:19.985 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4190720 len 1024 2024-09-21T03:56:19.985 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4190720 len 2048 2024-09-21T03:56:19.985 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4190720 len 2048 2024-09-21T03:56:19.985 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4190720 len 2048 2024-09-21T03:56:19.985 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4190720 len 2048 2024-09-21T03:56:19.985 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4190720 len 4096 2024-09-21T03:56:19.985 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4190720 len 4096 2024-09-21T03:56:19.985 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4190720 len 4096 2024-09-21T03:56:19.985 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4190720 len 4096 2024-09-21T03:56:19.985 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4190720 len 8192 2024-09-21T03:56:19.985 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4190720 len 8192 2024-09-21T03:56:19.986 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4190720 len 8192 2024-09-21T03:56:19.986 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4190720 len 8192 2024-09-21T03:56:19.986 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4190720 len 16384 2024-09-21T03:56:19.986 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4190720 len 16384 2024-09-21T03:56:19.986 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4190720 len 16384 2024-09-21T03:56:19.986 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4190720 len 16384 2024-09-21T03:56:19.986 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4191232 len 1024 2024-09-21T03:56:19.986 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4191232 len 1024 2024-09-21T03:56:19.986 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4191232 len 1024 2024-09-21T03:56:19.986 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4191232 len 1024 2024-09-21T03:56:19.986 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4191232 len 2048 2024-09-21T03:56:19.986 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4191232 len 2048 2024-09-21T03:56:19.986 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4191232 len 2048 2024-09-21T03:56:19.986 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4191232 len 2048 2024-09-21T03:56:19.987 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4191232 len 4096 2024-09-21T03:56:19.987 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4191232 len 4096 2024-09-21T03:56:19.987 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4191232 len 4096 2024-09-21T03:56:19.987 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4191232 len 4096 2024-09-21T03:56:19.987 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4191232 len 8192 2024-09-21T03:56:19.987 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4191232 len 8192 2024-09-21T03:56:19.987 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4191232 len 8192 2024-09-21T03:56:19.987 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4191232 len 8192 2024-09-21T03:56:19.987 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4191232 len 16384 2024-09-21T03:56:19.987 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4191232 len 16384 2024-09-21T03:56:19.987 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4191232 len 16384 2024-09-21T03:56:19.987 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4191232 len 16384 2024-09-21T03:56:19.987 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4191744 len 1024 2024-09-21T03:56:19.987 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4191744 len 1024 2024-09-21T03:56:19.988 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4191744 len 1024 2024-09-21T03:56:19.988 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4191744 len 1024 2024-09-21T03:56:19.988 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4191744 len 2048 2024-09-21T03:56:19.988 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4191744 len 2048 2024-09-21T03:56:19.988 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4191744 len 2048 2024-09-21T03:56:19.988 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4191744 len 2048 2024-09-21T03:56:19.988 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4191744 len 4096 2024-09-21T03:56:19.988 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4191744 len 4096 2024-09-21T03:56:19.988 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4191744 len 4096 2024-09-21T03:56:19.988 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4191744 len 4096 2024-09-21T03:56:19.988 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4191744 len 8192 2024-09-21T03:56:19.988 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4191744 len 8192 2024-09-21T03:56:19.988 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4191744 len 8192 2024-09-21T03:56:19.989 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4191744 len 8192 2024-09-21T03:56:19.989 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4191744 len 16384 2024-09-21T03:56:19.989 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4191744 len 16384 2024-09-21T03:56:19.989 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4191744 len 16384 2024-09-21T03:56:19.989 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4191744 len 16384 2024-09-21T03:56:19.989 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4192256 len 1024 2024-09-21T03:56:19.989 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4192256 len 1024 2024-09-21T03:56:19.989 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4192256 len 1024 2024-09-21T03:56:19.989 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4192256 len 1024 2024-09-21T03:56:19.989 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4192256 len 2048 2024-09-21T03:56:19.989 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4192256 len 2048 2024-09-21T03:56:19.989 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4192256 len 2048 2024-09-21T03:56:20.008 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4192256 len 2048 2024-09-21T03:56:20.008 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4192256 len 4096 2024-09-21T03:56:20.009 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4192256 len 4096 2024-09-21T03:56:20.009 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4192256 len 4096 2024-09-21T03:56:20.009 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4192256 len 4096 2024-09-21T03:56:20.009 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4192256 len 8192 2024-09-21T03:56:20.009 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4192256 len 8192 2024-09-21T03:56:20.009 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4192256 len 8192 2024-09-21T03:56:20.009 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4192256 len 8192 2024-09-21T03:56:20.009 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4192256 len 16384 2024-09-21T03:56:20.009 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4192256 len 16384 2024-09-21T03:56:20.009 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4192256 len 16384 2024-09-21T03:56:20.009 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4192256 len 16384 2024-09-21T03:56:20.009 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4192768 len 1024 2024-09-21T03:56:20.009 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4192768 len 1024 2024-09-21T03:56:20.009 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4192768 len 1024 2024-09-21T03:56:20.009 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4192768 len 1024 2024-09-21T03:56:20.010 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4192768 len 2048 2024-09-21T03:56:20.010 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4192768 len 2048 2024-09-21T03:56:20.010 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4192768 len 2048 2024-09-21T03:56:20.010 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4192768 len 2048 2024-09-21T03:56:20.010 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4192768 len 4096 2024-09-21T03:56:20.010 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4192768 len 4096 2024-09-21T03:56:20.010 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4192768 len 4096 2024-09-21T03:56:20.010 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4192768 len 4096 2024-09-21T03:56:20.010 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4192768 len 8192 2024-09-21T03:56:20.010 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4192768 len 8192 2024-09-21T03:56:20.010 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4192768 len 8192 2024-09-21T03:56:20.010 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4192768 len 8192 2024-09-21T03:56:20.010 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4192768 len 16384 2024-09-21T03:56:20.011 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4192768 len 16384 2024-09-21T03:56:20.011 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4192768 len 16384 2024-09-21T03:56:20.011 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4192768 len 16384 2024-09-21T03:56:20.011 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4193280 len 1024 2024-09-21T03:56:20.011 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4193280 len 1024 2024-09-21T03:56:20.011 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4193280 len 1024 2024-09-21T03:56:20.011 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4193280 len 1024 2024-09-21T03:56:20.011 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4193280 len 2048 2024-09-21T03:56:20.011 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4193280 len 2048 2024-09-21T03:56:20.011 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4193280 len 2048 2024-09-21T03:56:20.011 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4193280 len 2048 2024-09-21T03:56:20.011 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4193280 len 4096 2024-09-21T03:56:20.011 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4193280 len 4096 2024-09-21T03:56:20.012 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4193280 len 4096 2024-09-21T03:56:20.012 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4193280 len 4096 2024-09-21T03:56:20.012 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4193280 len 8192 2024-09-21T03:56:20.012 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4193280 len 8192 2024-09-21T03:56:20.012 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4193280 len 8192 2024-09-21T03:56:20.012 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4193280 len 8192 2024-09-21T03:56:20.012 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4193280 len 16384 2024-09-21T03:56:20.012 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4193280 len 16384 2024-09-21T03:56:20.012 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4193280 len 16384 2024-09-21T03:56:20.012 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4193280 len 16384 2024-09-21T03:56:20.012 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4193792 len 1024 2024-09-21T03:56:20.012 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4193792 len 1024 2024-09-21T03:56:20.012 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4193792 len 1024 2024-09-21T03:56:20.012 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4193792 len 1024 2024-09-21T03:56:20.012 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4193792 len 2048 2024-09-21T03:56:20.013 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4193792 len 2048 2024-09-21T03:56:20.013 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4193792 len 2048 2024-09-21T03:56:20.013 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4193792 len 2048 2024-09-21T03:56:20.013 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4193792 len 4096 2024-09-21T03:56:20.013 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4193792 len 4096 2024-09-21T03:56:20.013 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4193792 len 4096 2024-09-21T03:56:20.013 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4193792 len 4096 2024-09-21T03:56:20.013 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4193792 len 8192 2024-09-21T03:56:20.013 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4193792 len 8192 2024-09-21T03:56:20.013 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4193792 len 8192 2024-09-21T03:56:20.013 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4193792 len 8192 2024-09-21T03:56:20.013 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4193792 len 16384 2024-09-21T03:56:20.013 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4193792 len 16384 2024-09-21T03:56:20.014 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4193792 len 16384 2024-09-21T03:56:20.014 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4193792 len 16384 2024-09-21T03:56:20.014 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4194304 len 1024 2024-09-21T03:56:20.014 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4194304 len 1024 2024-09-21T03:56:20.014 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4194304 len 1024 2024-09-21T03:56:20.014 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4194304 len 1024 2024-09-21T03:56:20.014 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4194304 len 2048 2024-09-21T03:56:20.014 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4194304 len 2048 2024-09-21T03:56:20.014 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4194304 len 2048 2024-09-21T03:56:20.014 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4194304 len 2048 2024-09-21T03:56:20.014 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4194304 len 4096 2024-09-21T03:56:20.014 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4194304 len 4096 2024-09-21T03:56:20.014 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4194304 len 4096 2024-09-21T03:56:20.014 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4194304 len 4096 2024-09-21T03:56:20.015 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4194304 len 8192 2024-09-21T03:56:20.015 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4194304 len 8192 2024-09-21T03:56:20.015 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4194304 len 8192 2024-09-21T03:56:20.020 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4194304 len 8192 2024-09-21T03:56:20.020 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4194304 len 16384 2024-09-21T03:56:20.020 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4194304 len 16384 2024-09-21T03:56:20.020 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4194304 len 16384 2024-09-21T03:56:20.020 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4194304 len 16384 2024-09-21T03:56:20.020 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4194816 len 1024 2024-09-21T03:56:20.020 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4194816 len 1024 2024-09-21T03:56:20.020 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4194816 len 1024 2024-09-21T03:56:20.020 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4194816 len 1024 2024-09-21T03:56:20.020 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4194816 len 2048 2024-09-21T03:56:20.021 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4194816 len 2048 2024-09-21T03:56:20.021 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4194816 len 2048 2024-09-21T03:56:20.021 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4194816 len 2048 2024-09-21T03:56:20.021 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4194816 len 4096 2024-09-21T03:56:20.021 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4194816 len 4096 2024-09-21T03:56:20.021 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4194816 len 4096 2024-09-21T03:56:20.021 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4194816 len 4096 2024-09-21T03:56:20.021 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4194816 len 8192 2024-09-21T03:56:20.021 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4194816 len 8192 2024-09-21T03:56:20.021 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4194816 len 8192 2024-09-21T03:56:20.021 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4194816 len 8192 2024-09-21T03:56:20.021 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4194816 len 16384 2024-09-21T03:56:20.021 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4194816 len 16384 2024-09-21T03:56:20.021 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4194816 len 16384 2024-09-21T03:56:20.022 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4194816 len 16384 2024-09-21T03:56:20.022 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4195328 len 1024 2024-09-21T03:56:20.022 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4195328 len 1024 2024-09-21T03:56:20.022 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4195328 len 1024 2024-09-21T03:56:20.022 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4195328 len 1024 2024-09-21T03:56:20.022 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4195328 len 2048 2024-09-21T03:56:20.022 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4195328 len 2048 2024-09-21T03:56:20.022 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4195328 len 2048 2024-09-21T03:56:20.022 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4195328 len 2048 2024-09-21T03:56:20.022 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4195328 len 4096 2024-09-21T03:56:20.022 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4195328 len 4096 2024-09-21T03:56:20.022 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4195328 len 4096 2024-09-21T03:56:20.022 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4195328 len 4096 2024-09-21T03:56:20.022 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4195328 len 8192 2024-09-21T03:56:20.022 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4195328 len 8192 2024-09-21T03:56:20.023 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4195328 len 8192 2024-09-21T03:56:20.023 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4195328 len 8192 2024-09-21T03:56:20.023 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4195328 len 16384 2024-09-21T03:56:20.023 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4195328 len 16384 2024-09-21T03:56:20.023 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4195328 len 16384 2024-09-21T03:56:20.023 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4195328 len 16384 2024-09-21T03:56:20.023 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4195840 len 1024 2024-09-21T03:56:20.023 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4195840 len 1024 2024-09-21T03:56:20.023 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4195840 len 1024 2024-09-21T03:56:20.023 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4195840 len 1024 2024-09-21T03:56:20.023 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4195840 len 2048 2024-09-21T03:56:20.023 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4195840 len 2048 2024-09-21T03:56:20.023 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4195840 len 2048 2024-09-21T03:56:20.024 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4195840 len 2048 2024-09-21T03:56:20.024 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4195840 len 4096 2024-09-21T03:56:20.024 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4195840 len 4096 2024-09-21T03:56:20.024 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4195840 len 4096 2024-09-21T03:56:20.024 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4195840 len 4096 2024-09-21T03:56:20.024 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4195840 len 8192 2024-09-21T03:56:20.024 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4195840 len 8192 2024-09-21T03:56:20.024 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4195840 len 8192 2024-09-21T03:56:20.024 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4195840 len 8192 2024-09-21T03:56:20.024 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4195840 len 16384 2024-09-21T03:56:20.024 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4195840 len 16384 2024-09-21T03:56:20.024 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4195840 len 16384 2024-09-21T03:56:20.024 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4195840 len 16384 2024-09-21T03:56:20.024 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4196352 len 1024 2024-09-21T03:56:20.025 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4196352 len 1024 2024-09-21T03:56:20.025 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4196352 len 1024 2024-09-21T03:56:20.025 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4196352 len 1024 2024-09-21T03:56:20.025 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4196352 len 2048 2024-09-21T03:56:20.025 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4196352 len 2048 2024-09-21T03:56:20.025 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4196352 len 2048 2024-09-21T03:56:20.025 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4196352 len 2048 2024-09-21T03:56:20.025 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4196352 len 4096 2024-09-21T03:56:20.025 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4196352 len 4096 2024-09-21T03:56:20.025 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4196352 len 4096 2024-09-21T03:56:20.025 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4196352 len 4096 2024-09-21T03:56:20.025 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4196352 len 8192 2024-09-21T03:56:20.025 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4196352 len 8192 2024-09-21T03:56:20.026 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4196352 len 8192 2024-09-21T03:56:20.026 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4196352 len 8192 2024-09-21T03:56:20.026 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4196352 len 16384 2024-09-21T03:56:20.026 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4196352 len 16384 2024-09-21T03:56:20.026 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4196352 len 16384 2024-09-21T03:56:20.026 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4196352 len 16384 2024-09-21T03:56:20.026 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4196864 len 1024 2024-09-21T03:56:20.026 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4196864 len 1024 2024-09-21T03:56:20.033 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4196864 len 1024 2024-09-21T03:56:20.034 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4196864 len 1024 2024-09-21T03:56:20.034 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4196864 len 2048 2024-09-21T03:56:20.034 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4196864 len 2048 2024-09-21T03:56:20.034 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4196864 len 2048 2024-09-21T03:56:20.034 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4196864 len 2048 2024-09-21T03:56:20.034 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4196864 len 4096 2024-09-21T03:56:20.034 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4196864 len 4096 2024-09-21T03:56:20.034 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4196864 len 4096 2024-09-21T03:56:20.034 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4196864 len 4096 2024-09-21T03:56:20.034 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4196864 len 8192 2024-09-21T03:56:20.034 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4196864 len 8192 2024-09-21T03:56:20.034 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4196864 len 8192 2024-09-21T03:56:20.035 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4196864 len 8192 2024-09-21T03:56:20.035 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4196864 len 16384 2024-09-21T03:56:20.035 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4196864 len 16384 2024-09-21T03:56:20.035 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4196864 len 16384 2024-09-21T03:56:20.035 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4196864 len 16384 2024-09-21T03:56:20.035 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4197376 len 1024 2024-09-21T03:56:20.035 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4197376 len 1024 2024-09-21T03:56:20.035 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4197376 len 1024 2024-09-21T03:56:20.035 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4197376 len 1024 2024-09-21T03:56:20.035 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4197376 len 2048 2024-09-21T03:56:20.035 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4197376 len 2048 2024-09-21T03:56:20.035 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4197376 len 2048 2024-09-21T03:56:20.035 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4197376 len 2048 2024-09-21T03:56:20.035 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4197376 len 4096 2024-09-21T03:56:20.036 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4197376 len 4096 2024-09-21T03:56:20.036 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4197376 len 4096 2024-09-21T03:56:20.036 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4197376 len 4096 2024-09-21T03:56:20.036 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4197376 len 8192 2024-09-21T03:56:20.036 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4197376 len 8192 2024-09-21T03:56:20.036 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4197376 len 8192 2024-09-21T03:56:20.036 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4197376 len 8192 2024-09-21T03:56:20.036 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4197376 len 16384 2024-09-21T03:56:20.036 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4197376 len 16384 2024-09-21T03:56:20.036 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4197376 len 16384 2024-09-21T03:56:20.036 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4197376 len 16384 2024-09-21T03:56:20.036 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4197888 len 1024 2024-09-21T03:56:20.036 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4197888 len 1024 2024-09-21T03:56:20.037 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4197888 len 1024 2024-09-21T03:56:20.037 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4197888 len 1024 2024-09-21T03:56:20.037 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4197888 len 2048 2024-09-21T03:56:20.037 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4197888 len 2048 2024-09-21T03:56:20.037 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4197888 len 2048 2024-09-21T03:56:20.037 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4197888 len 2048 2024-09-21T03:56:20.037 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4197888 len 4096 2024-09-21T03:56:20.037 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4197888 len 4096 2024-09-21T03:56:20.037 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4197888 len 4096 2024-09-21T03:56:20.037 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4197888 len 4096 2024-09-21T03:56:20.037 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4197888 len 8192 2024-09-21T03:56:20.037 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4197888 len 8192 2024-09-21T03:56:20.037 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4197888 len 8192 2024-09-21T03:56:20.037 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4197888 len 8192 2024-09-21T03:56:20.038 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 0 offset 4197888 len 16384 2024-09-21T03:56:20.038 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4197888 len 16384 2024-09-21T03:56:20.038 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 0 offset 4197888 len 16384 2024-09-21T03:56:20.038 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 0 offset 4197888 len 16384 2024-09-21T03:56:20.038 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4190208 len 1024 2024-09-21T03:56:20.038 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4190208 len 1024 2024-09-21T03:56:20.038 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4190208 len 1024 2024-09-21T03:56:20.038 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4190208 len 1024 2024-09-21T03:56:20.038 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4190208 len 2048 2024-09-21T03:56:20.038 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4190208 len 2048 2024-09-21T03:56:20.038 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4190208 len 2048 2024-09-21T03:56:20.038 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4190208 len 2048 2024-09-21T03:56:20.038 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4190208 len 4096 2024-09-21T03:56:20.039 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4190208 len 4096 2024-09-21T03:56:20.039 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4190208 len 4096 2024-09-21T03:56:20.039 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4190208 len 4096 2024-09-21T03:56:20.039 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4190208 len 8192 2024-09-21T03:56:20.039 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4190208 len 8192 2024-09-21T03:56:20.039 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4190208 len 8192 2024-09-21T03:56:20.039 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4190208 len 8192 2024-09-21T03:56:20.039 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4190208 len 16384 2024-09-21T03:56:20.039 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4190208 len 16384 2024-09-21T03:56:20.039 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4190208 len 16384 2024-09-21T03:56:20.039 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4190208 len 16384 2024-09-21T03:56:20.039 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4190720 len 1024 2024-09-21T03:56:20.039 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4190720 len 1024 2024-09-21T03:56:20.039 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4190720 len 1024 2024-09-21T03:56:20.040 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4190720 len 1024 2024-09-21T03:56:20.040 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4190720 len 2048 2024-09-21T03:56:20.040 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4190720 len 2048 2024-09-21T03:56:20.040 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4190720 len 2048 2024-09-21T03:56:20.040 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4190720 len 2048 2024-09-21T03:56:20.040 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4190720 len 4096 2024-09-21T03:56:20.055 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4190720 len 4096 2024-09-21T03:56:20.056 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4190720 len 4096 2024-09-21T03:56:20.056 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4190720 len 4096 2024-09-21T03:56:20.056 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4190720 len 8192 2024-09-21T03:56:20.056 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4190720 len 8192 2024-09-21T03:56:20.056 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4190720 len 8192 2024-09-21T03:56:20.056 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4190720 len 8192 2024-09-21T03:56:20.056 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4190720 len 16384 2024-09-21T03:56:20.056 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4190720 len 16384 2024-09-21T03:56:20.056 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4190720 len 16384 2024-09-21T03:56:20.056 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4190720 len 16384 2024-09-21T03:56:20.056 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4191232 len 1024 2024-09-21T03:56:20.056 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4191232 len 1024 2024-09-21T03:56:20.057 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4191232 len 1024 2024-09-21T03:56:20.057 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4191232 len 1024 2024-09-21T03:56:20.057 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4191232 len 2048 2024-09-21T03:56:20.057 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4191232 len 2048 2024-09-21T03:56:20.057 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4191232 len 2048 2024-09-21T03:56:20.057 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4191232 len 2048 2024-09-21T03:56:20.057 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4191232 len 4096 2024-09-21T03:56:20.057 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4191232 len 4096 2024-09-21T03:56:20.057 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4191232 len 4096 2024-09-21T03:56:20.057 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4191232 len 4096 2024-09-21T03:56:20.057 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4191232 len 8192 2024-09-21T03:56:20.057 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4191232 len 8192 2024-09-21T03:56:20.057 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4191232 len 8192 2024-09-21T03:56:20.057 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4191232 len 8192 2024-09-21T03:56:20.058 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4191232 len 16384 2024-09-21T03:56:20.058 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4191232 len 16384 2024-09-21T03:56:20.058 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4191232 len 16384 2024-09-21T03:56:20.058 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4191232 len 16384 2024-09-21T03:56:20.058 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4191744 len 1024 2024-09-21T03:56:20.058 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4191744 len 1024 2024-09-21T03:56:20.058 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4191744 len 1024 2024-09-21T03:56:20.058 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4191744 len 1024 2024-09-21T03:56:20.058 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4191744 len 2048 2024-09-21T03:56:20.058 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4191744 len 2048 2024-09-21T03:56:20.058 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4191744 len 2048 2024-09-21T03:56:20.058 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4191744 len 2048 2024-09-21T03:56:20.058 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4191744 len 4096 2024-09-21T03:56:20.059 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4191744 len 4096 2024-09-21T03:56:20.059 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4191744 len 4096 2024-09-21T03:56:20.059 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4191744 len 4096 2024-09-21T03:56:20.059 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4191744 len 8192 2024-09-21T03:56:20.059 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4191744 len 8192 2024-09-21T03:56:20.059 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4191744 len 8192 2024-09-21T03:56:20.059 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4191744 len 8192 2024-09-21T03:56:20.059 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4191744 len 16384 2024-09-21T03:56:20.059 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4191744 len 16384 2024-09-21T03:56:20.059 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4191744 len 16384 2024-09-21T03:56:20.059 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4191744 len 16384 2024-09-21T03:56:20.059 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4192256 len 1024 2024-09-21T03:56:20.059 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4192256 len 1024 2024-09-21T03:56:20.059 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4192256 len 1024 2024-09-21T03:56:20.060 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4192256 len 1024 2024-09-21T03:56:20.060 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4192256 len 2048 2024-09-21T03:56:20.060 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4192256 len 2048 2024-09-21T03:56:20.060 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4192256 len 2048 2024-09-21T03:56:20.060 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4192256 len 2048 2024-09-21T03:56:20.060 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4192256 len 4096 2024-09-21T03:56:20.060 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4192256 len 4096 2024-09-21T03:56:20.060 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4192256 len 4096 2024-09-21T03:56:20.060 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4192256 len 4096 2024-09-21T03:56:20.060 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4192256 len 8192 2024-09-21T03:56:20.060 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4192256 len 8192 2024-09-21T03:56:20.060 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4192256 len 8192 2024-09-21T03:56:20.060 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4192256 len 8192 2024-09-21T03:56:20.060 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4192256 len 16384 2024-09-21T03:56:20.061 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4192256 len 16384 2024-09-21T03:56:20.061 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4192256 len 16384 2024-09-21T03:56:20.061 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4192256 len 16384 2024-09-21T03:56:20.061 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4192768 len 1024 2024-09-21T03:56:20.061 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4192768 len 1024 2024-09-21T03:56:20.061 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4192768 len 1024 2024-09-21T03:56:20.061 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4192768 len 1024 2024-09-21T03:56:20.061 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4192768 len 2048 2024-09-21T03:56:20.061 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4192768 len 2048 2024-09-21T03:56:20.061 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4192768 len 2048 2024-09-21T03:56:20.061 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4192768 len 2048 2024-09-21T03:56:20.061 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4192768 len 4096 2024-09-21T03:56:20.061 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4192768 len 4096 2024-09-21T03:56:20.061 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4192768 len 4096 2024-09-21T03:56:20.062 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4192768 len 4096 2024-09-21T03:56:20.062 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4192768 len 8192 2024-09-21T03:56:20.076 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4192768 len 8192 2024-09-21T03:56:20.076 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4192768 len 8192 2024-09-21T03:56:20.076 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4192768 len 8192 2024-09-21T03:56:20.076 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4192768 len 16384 2024-09-21T03:56:20.076 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4192768 len 16384 2024-09-21T03:56:20.076 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4192768 len 16384 2024-09-21T03:56:20.076 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4192768 len 16384 2024-09-21T03:56:20.076 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4193280 len 1024 2024-09-21T03:56:20.076 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4193280 len 1024 2024-09-21T03:56:20.076 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4193280 len 1024 2024-09-21T03:56:20.076 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4193280 len 1024 2024-09-21T03:56:20.076 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4193280 len 2048 2024-09-21T03:56:20.077 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4193280 len 2048 2024-09-21T03:56:20.077 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4193280 len 2048 2024-09-21T03:56:20.077 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4193280 len 2048 2024-09-21T03:56:20.077 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4193280 len 4096 2024-09-21T03:56:20.077 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4193280 len 4096 2024-09-21T03:56:20.077 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4193280 len 4096 2024-09-21T03:56:20.077 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4193280 len 4096 2024-09-21T03:56:20.077 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4193280 len 8192 2024-09-21T03:56:20.077 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4193280 len 8192 2024-09-21T03:56:20.077 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4193280 len 8192 2024-09-21T03:56:20.077 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4193280 len 8192 2024-09-21T03:56:20.077 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4193280 len 16384 2024-09-21T03:56:20.077 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4193280 len 16384 2024-09-21T03:56:20.078 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4193280 len 16384 2024-09-21T03:56:20.078 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4193280 len 16384 2024-09-21T03:56:20.078 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4193792 len 1024 2024-09-21T03:56:20.078 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4193792 len 1024 2024-09-21T03:56:20.078 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4193792 len 1024 2024-09-21T03:56:20.078 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4193792 len 1024 2024-09-21T03:56:20.078 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4193792 len 2048 2024-09-21T03:56:20.078 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4193792 len 2048 2024-09-21T03:56:20.078 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4193792 len 2048 2024-09-21T03:56:20.078 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4193792 len 2048 2024-09-21T03:56:20.078 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4193792 len 4096 2024-09-21T03:56:20.078 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4193792 len 4096 2024-09-21T03:56:20.078 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4193792 len 4096 2024-09-21T03:56:20.078 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4193792 len 4096 2024-09-21T03:56:20.079 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4193792 len 8192 2024-09-21T03:56:20.079 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4193792 len 8192 2024-09-21T03:56:20.079 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4193792 len 8192 2024-09-21T03:56:20.079 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4193792 len 8192 2024-09-21T03:56:20.079 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4193792 len 16384 2024-09-21T03:56:20.079 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4193792 len 16384 2024-09-21T03:56:20.079 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4193792 len 16384 2024-09-21T03:56:20.079 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4193792 len 16384 2024-09-21T03:56:20.079 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4194304 len 1024 2024-09-21T03:56:20.079 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4194304 len 1024 2024-09-21T03:56:20.079 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4194304 len 1024 2024-09-21T03:56:20.079 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4194304 len 1024 2024-09-21T03:56:20.079 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4194304 len 2048 2024-09-21T03:56:20.079 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4194304 len 2048 2024-09-21T03:56:20.080 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4194304 len 2048 2024-09-21T03:56:20.080 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4194304 len 2048 2024-09-21T03:56:20.080 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4194304 len 4096 2024-09-21T03:56:20.080 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4194304 len 4096 2024-09-21T03:56:20.080 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4194304 len 4096 2024-09-21T03:56:20.080 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4194304 len 4096 2024-09-21T03:56:20.080 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4194304 len 8192 2024-09-21T03:56:20.080 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4194304 len 8192 2024-09-21T03:56:20.080 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4194304 len 8192 2024-09-21T03:56:20.080 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4194304 len 8192 2024-09-21T03:56:20.080 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4194304 len 16384 2024-09-21T03:56:20.080 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4194304 len 16384 2024-09-21T03:56:20.080 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4194304 len 16384 2024-09-21T03:56:20.080 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4194304 len 16384 2024-09-21T03:56:20.081 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4194816 len 1024 2024-09-21T03:56:20.081 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4194816 len 1024 2024-09-21T03:56:20.081 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4194816 len 1024 2024-09-21T03:56:20.081 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4194816 len 1024 2024-09-21T03:56:20.081 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4194816 len 2048 2024-09-21T03:56:20.081 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4194816 len 2048 2024-09-21T03:56:20.081 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4194816 len 2048 2024-09-21T03:56:20.081 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4194816 len 2048 2024-09-21T03:56:20.081 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4194816 len 4096 2024-09-21T03:56:20.081 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4194816 len 4096 2024-09-21T03:56:20.081 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4194816 len 4096 2024-09-21T03:56:20.081 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4194816 len 4096 2024-09-21T03:56:20.081 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4194816 len 8192 2024-09-21T03:56:20.082 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4194816 len 8192 2024-09-21T03:56:20.082 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4194816 len 8192 2024-09-21T03:56:20.082 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4194816 len 8192 2024-09-21T03:56:20.082 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4194816 len 16384 2024-09-21T03:56:20.085 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4194816 len 16384 2024-09-21T03:56:20.086 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4194816 len 16384 2024-09-21T03:56:20.086 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4194816 len 16384 2024-09-21T03:56:20.086 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4195328 len 1024 2024-09-21T03:56:20.086 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4195328 len 1024 2024-09-21T03:56:20.086 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4195328 len 1024 2024-09-21T03:56:20.086 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4195328 len 1024 2024-09-21T03:56:20.086 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4195328 len 2048 2024-09-21T03:56:20.087 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4195328 len 2048 2024-09-21T03:56:20.087 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4195328 len 2048 2024-09-21T03:56:20.087 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4195328 len 2048 2024-09-21T03:56:20.087 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4195328 len 4096 2024-09-21T03:56:20.087 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4195328 len 4096 2024-09-21T03:56:20.087 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4195328 len 4096 2024-09-21T03:56:20.087 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4195328 len 4096 2024-09-21T03:56:20.087 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4195328 len 8192 2024-09-21T03:56:20.087 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4195328 len 8192 2024-09-21T03:56:20.087 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4195328 len 8192 2024-09-21T03:56:20.087 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4195328 len 8192 2024-09-21T03:56:20.088 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4195328 len 16384 2024-09-21T03:56:20.088 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4195328 len 16384 2024-09-21T03:56:20.088 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4195328 len 16384 2024-09-21T03:56:20.088 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4195328 len 16384 2024-09-21T03:56:20.088 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4195840 len 1024 2024-09-21T03:56:20.088 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4195840 len 1024 2024-09-21T03:56:20.088 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4195840 len 1024 2024-09-21T03:56:20.088 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4195840 len 1024 2024-09-21T03:56:20.088 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4195840 len 2048 2024-09-21T03:56:20.088 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4195840 len 2048 2024-09-21T03:56:20.088 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4195840 len 2048 2024-09-21T03:56:20.088 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4195840 len 2048 2024-09-21T03:56:20.088 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4195840 len 4096 2024-09-21T03:56:20.089 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4195840 len 4096 2024-09-21T03:56:20.089 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4195840 len 4096 2024-09-21T03:56:20.089 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4195840 len 4096 2024-09-21T03:56:20.089 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4195840 len 8192 2024-09-21T03:56:20.089 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4195840 len 8192 2024-09-21T03:56:20.089 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4195840 len 8192 2024-09-21T03:56:20.089 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4195840 len 8192 2024-09-21T03:56:20.089 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4195840 len 16384 2024-09-21T03:56:20.089 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4195840 len 16384 2024-09-21T03:56:20.089 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4195840 len 16384 2024-09-21T03:56:20.089 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4195840 len 16384 2024-09-21T03:56:20.089 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4196352 len 1024 2024-09-21T03:56:20.089 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4196352 len 1024 2024-09-21T03:56:20.089 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4196352 len 1024 2024-09-21T03:56:20.090 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4196352 len 1024 2024-09-21T03:56:20.090 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4196352 len 2048 2024-09-21T03:56:20.090 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4196352 len 2048 2024-09-21T03:56:20.090 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4196352 len 2048 2024-09-21T03:56:20.090 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4196352 len 2048 2024-09-21T03:56:20.090 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4196352 len 4096 2024-09-21T03:56:20.090 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4196352 len 4096 2024-09-21T03:56:20.090 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4196352 len 4096 2024-09-21T03:56:20.090 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4196352 len 4096 2024-09-21T03:56:20.090 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4196352 len 8192 2024-09-21T03:56:20.090 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4196352 len 8192 2024-09-21T03:56:20.090 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4196352 len 8192 2024-09-21T03:56:20.090 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4196352 len 8192 2024-09-21T03:56:20.091 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4196352 len 16384 2024-09-21T03:56:20.091 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4196352 len 16384 2024-09-21T03:56:20.091 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4196352 len 16384 2024-09-21T03:56:20.091 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4196352 len 16384 2024-09-21T03:56:20.091 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4196864 len 1024 2024-09-21T03:56:20.091 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4196864 len 1024 2024-09-21T03:56:20.091 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4196864 len 1024 2024-09-21T03:56:20.091 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4196864 len 1024 2024-09-21T03:56:20.091 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4196864 len 2048 2024-09-21T03:56:20.091 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4196864 len 2048 2024-09-21T03:56:20.091 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4196864 len 2048 2024-09-21T03:56:20.091 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4196864 len 2048 2024-09-21T03:56:20.091 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4196864 len 4096 2024-09-21T03:56:20.091 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4196864 len 4096 2024-09-21T03:56:20.092 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4196864 len 4096 2024-09-21T03:56:20.092 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4196864 len 4096 2024-09-21T03:56:20.092 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4196864 len 8192 2024-09-21T03:56:20.092 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4196864 len 8192 2024-09-21T03:56:20.092 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4196864 len 8192 2024-09-21T03:56:20.092 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4196864 len 8192 2024-09-21T03:56:20.092 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4196864 len 16384 2024-09-21T03:56:20.092 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4196864 len 16384 2024-09-21T03:56:20.092 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4196864 len 16384 2024-09-21T03:56:20.092 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4196864 len 16384 2024-09-21T03:56:20.092 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4197376 len 1024 2024-09-21T03:56:20.103 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4197376 len 1024 2024-09-21T03:56:20.103 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4197376 len 1024 2024-09-21T03:56:20.103 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4197376 len 1024 2024-09-21T03:56:20.103 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4197376 len 2048 2024-09-21T03:56:20.103 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4197376 len 2048 2024-09-21T03:56:20.103 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4197376 len 2048 2024-09-21T03:56:20.103 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4197376 len 2048 2024-09-21T03:56:20.103 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4197376 len 4096 2024-09-21T03:56:20.103 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4197376 len 4096 2024-09-21T03:56:20.103 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4197376 len 4096 2024-09-21T03:56:20.103 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4197376 len 4096 2024-09-21T03:56:20.103 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4197376 len 8192 2024-09-21T03:56:20.104 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4197376 len 8192 2024-09-21T03:56:20.104 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4197376 len 8192 2024-09-21T03:56:20.104 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4197376 len 8192 2024-09-21T03:56:20.104 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4197376 len 16384 2024-09-21T03:56:20.104 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4197376 len 16384 2024-09-21T03:56:20.104 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4197376 len 16384 2024-09-21T03:56:20.104 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4197376 len 16384 2024-09-21T03:56:20.104 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4197888 len 1024 2024-09-21T03:56:20.104 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4197888 len 1024 2024-09-21T03:56:20.104 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4197888 len 1024 2024-09-21T03:56:20.104 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4197888 len 1024 2024-09-21T03:56:20.104 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4197888 len 2048 2024-09-21T03:56:20.104 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4197888 len 2048 2024-09-21T03:56:20.104 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4197888 len 2048 2024-09-21T03:56:20.105 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4197888 len 2048 2024-09-21T03:56:20.105 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4197888 len 4096 2024-09-21T03:56:20.105 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4197888 len 4096 2024-09-21T03:56:20.105 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4197888 len 4096 2024-09-21T03:56:20.105 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4197888 len 4096 2024-09-21T03:56:20.105 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4197888 len 8192 2024-09-21T03:56:20.105 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4197888 len 8192 2024-09-21T03:56:20.105 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4197888 len 8192 2024-09-21T03:56:20.105 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4197888 len 8192 2024-09-21T03:56:20.105 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 512 offset 4197888 len 16384 2024-09-21T03:56:20.105 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4197888 len 16384 2024-09-21T03:56:20.105 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 512 offset 4197888 len 16384 2024-09-21T03:56:20.105 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 512 offset 4197888 len 16384 2024-09-21T03:56:20.105 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4190208 len 1024 2024-09-21T03:56:20.106 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4190208 len 1024 2024-09-21T03:56:20.106 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4190208 len 1024 2024-09-21T03:56:20.106 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4190208 len 1024 2024-09-21T03:56:20.106 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4190208 len 2048 2024-09-21T03:56:20.106 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4190208 len 2048 2024-09-21T03:56:20.106 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4190208 len 2048 2024-09-21T03:56:20.106 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4190208 len 2048 2024-09-21T03:56:20.106 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4190208 len 4096 2024-09-21T03:56:20.106 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4190208 len 4096 2024-09-21T03:56:20.106 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4190208 len 4096 2024-09-21T03:56:20.106 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4190208 len 4096 2024-09-21T03:56:20.106 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4190208 len 8192 2024-09-21T03:56:20.106 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4190208 len 8192 2024-09-21T03:56:20.107 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4190208 len 8192 2024-09-21T03:56:20.107 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4190208 len 8192 2024-09-21T03:56:20.107 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4190208 len 16384 2024-09-21T03:56:20.107 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4190208 len 16384 2024-09-21T03:56:20.107 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4190208 len 16384 2024-09-21T03:56:20.107 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4190208 len 16384 2024-09-21T03:56:20.107 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4190720 len 1024 2024-09-21T03:56:20.107 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4190720 len 1024 2024-09-21T03:56:20.107 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4190720 len 1024 2024-09-21T03:56:20.107 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4190720 len 1024 2024-09-21T03:56:20.107 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4190720 len 2048 2024-09-21T03:56:20.107 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4190720 len 2048 2024-09-21T03:56:20.107 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4190720 len 2048 2024-09-21T03:56:20.108 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4190720 len 2048 2024-09-21T03:56:20.108 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4190720 len 4096 2024-09-21T03:56:20.108 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4190720 len 4096 2024-09-21T03:56:20.108 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4190720 len 4096 2024-09-21T03:56:20.108 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4190720 len 4096 2024-09-21T03:56:20.108 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4190720 len 8192 2024-09-21T03:56:20.108 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4190720 len 8192 2024-09-21T03:56:20.108 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4190720 len 8192 2024-09-21T03:56:20.108 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4190720 len 8192 2024-09-21T03:56:20.108 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4190720 len 16384 2024-09-21T03:56:20.108 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4190720 len 16384 2024-09-21T03:56:20.108 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4190720 len 16384 2024-09-21T03:56:20.108 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4190720 len 16384 2024-09-21T03:56:20.108 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4191232 len 1024 2024-09-21T03:56:20.109 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4191232 len 1024 2024-09-21T03:56:20.109 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4191232 len 1024 2024-09-21T03:56:20.109 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4191232 len 1024 2024-09-21T03:56:20.129 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4191232 len 2048 2024-09-21T03:56:20.129 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4191232 len 2048 2024-09-21T03:56:20.129 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4191232 len 2048 2024-09-21T03:56:20.129 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4191232 len 2048 2024-09-21T03:56:20.129 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4191232 len 4096 2024-09-21T03:56:20.130 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4191232 len 4096 2024-09-21T03:56:20.130 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4191232 len 4096 2024-09-21T03:56:20.130 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4191232 len 4096 2024-09-21T03:56:20.130 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4191232 len 8192 2024-09-21T03:56:20.130 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4191232 len 8192 2024-09-21T03:56:20.130 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4191232 len 8192 2024-09-21T03:56:20.130 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4191232 len 8192 2024-09-21T03:56:20.130 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4191232 len 16384 2024-09-21T03:56:20.130 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4191232 len 16384 2024-09-21T03:56:20.130 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4191232 len 16384 2024-09-21T03:56:20.130 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4191232 len 16384 2024-09-21T03:56:20.130 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4191744 len 1024 2024-09-21T03:56:20.131 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4191744 len 1024 2024-09-21T03:56:20.131 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4191744 len 1024 2024-09-21T03:56:20.131 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4191744 len 1024 2024-09-21T03:56:20.131 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4191744 len 2048 2024-09-21T03:56:20.131 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4191744 len 2048 2024-09-21T03:56:20.131 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4191744 len 2048 2024-09-21T03:56:20.131 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4191744 len 2048 2024-09-21T03:56:20.131 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4191744 len 4096 2024-09-21T03:56:20.131 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4191744 len 4096 2024-09-21T03:56:20.131 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4191744 len 4096 2024-09-21T03:56:20.131 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4191744 len 4096 2024-09-21T03:56:20.131 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4191744 len 8192 2024-09-21T03:56:20.132 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4191744 len 8192 2024-09-21T03:56:20.132 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4191744 len 8192 2024-09-21T03:56:20.132 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4191744 len 8192 2024-09-21T03:56:20.132 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4191744 len 16384 2024-09-21T03:56:20.132 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4191744 len 16384 2024-09-21T03:56:20.132 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4191744 len 16384 2024-09-21T03:56:20.132 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4191744 len 16384 2024-09-21T03:56:20.132 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4192256 len 1024 2024-09-21T03:56:20.132 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4192256 len 1024 2024-09-21T03:56:20.132 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4192256 len 1024 2024-09-21T03:56:20.132 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4192256 len 1024 2024-09-21T03:56:20.132 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4192256 len 2048 2024-09-21T03:56:20.132 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4192256 len 2048 2024-09-21T03:56:20.133 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4192256 len 2048 2024-09-21T03:56:20.133 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4192256 len 2048 2024-09-21T03:56:20.133 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4192256 len 4096 2024-09-21T03:56:20.133 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4192256 len 4096 2024-09-21T03:56:20.133 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4192256 len 4096 2024-09-21T03:56:20.133 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4192256 len 4096 2024-09-21T03:56:20.133 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4192256 len 8192 2024-09-21T03:56:20.133 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4192256 len 8192 2024-09-21T03:56:20.133 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4192256 len 8192 2024-09-21T03:56:20.133 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4192256 len 8192 2024-09-21T03:56:20.133 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4192256 len 16384 2024-09-21T03:56:20.133 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4192256 len 16384 2024-09-21T03:56:20.133 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4192256 len 16384 2024-09-21T03:56:20.133 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4192256 len 16384 2024-09-21T03:56:20.134 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4192768 len 1024 2024-09-21T03:56:20.134 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4192768 len 1024 2024-09-21T03:56:20.134 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4192768 len 1024 2024-09-21T03:56:20.134 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4192768 len 1024 2024-09-21T03:56:20.134 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4192768 len 2048 2024-09-21T03:56:20.134 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4192768 len 2048 2024-09-21T03:56:20.134 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4192768 len 2048 2024-09-21T03:56:20.134 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4192768 len 2048 2024-09-21T03:56:20.134 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4192768 len 4096 2024-09-21T03:56:20.134 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4192768 len 4096 2024-09-21T03:56:20.134 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4192768 len 4096 2024-09-21T03:56:20.134 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4192768 len 4096 2024-09-21T03:56:20.134 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4192768 len 8192 2024-09-21T03:56:20.134 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4192768 len 8192 2024-09-21T03:56:20.135 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4192768 len 8192 2024-09-21T03:56:20.135 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4192768 len 8192 2024-09-21T03:56:20.135 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4192768 len 16384 2024-09-21T03:56:20.135 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4192768 len 16384 2024-09-21T03:56:20.135 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4192768 len 16384 2024-09-21T03:56:20.135 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4192768 len 16384 2024-09-21T03:56:20.135 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4193280 len 1024 2024-09-21T03:56:20.135 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4193280 len 1024 2024-09-21T03:56:20.135 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4193280 len 1024 2024-09-21T03:56:20.135 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4193280 len 1024 2024-09-21T03:56:20.135 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4193280 len 2048 2024-09-21T03:56:20.135 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4193280 len 2048 2024-09-21T03:56:20.135 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4193280 len 2048 2024-09-21T03:56:20.144 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4193280 len 2048 2024-09-21T03:56:20.144 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4193280 len 4096 2024-09-21T03:56:20.144 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4193280 len 4096 2024-09-21T03:56:20.145 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4193280 len 4096 2024-09-21T03:56:20.145 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4193280 len 4096 2024-09-21T03:56:20.145 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4193280 len 8192 2024-09-21T03:56:20.145 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4193280 len 8192 2024-09-21T03:56:20.145 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4193280 len 8192 2024-09-21T03:56:20.145 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4193280 len 8192 2024-09-21T03:56:20.145 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4193280 len 16384 2024-09-21T03:56:20.145 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4193280 len 16384 2024-09-21T03:56:20.145 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4193280 len 16384 2024-09-21T03:56:20.145 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4193280 len 16384 2024-09-21T03:56:20.145 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4193792 len 1024 2024-09-21T03:56:20.145 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4193792 len 1024 2024-09-21T03:56:20.145 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4193792 len 1024 2024-09-21T03:56:20.145 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4193792 len 1024 2024-09-21T03:56:20.146 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4193792 len 2048 2024-09-21T03:56:20.146 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4193792 len 2048 2024-09-21T03:56:20.146 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4193792 len 2048 2024-09-21T03:56:20.146 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4193792 len 2048 2024-09-21T03:56:20.146 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4193792 len 4096 2024-09-21T03:56:20.146 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4193792 len 4096 2024-09-21T03:56:20.146 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4193792 len 4096 2024-09-21T03:56:20.146 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4193792 len 4096 2024-09-21T03:56:20.146 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4193792 len 8192 2024-09-21T03:56:20.146 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4193792 len 8192 2024-09-21T03:56:20.146 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4193792 len 8192 2024-09-21T03:56:20.146 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4193792 len 8192 2024-09-21T03:56:20.146 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4193792 len 16384 2024-09-21T03:56:20.147 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4193792 len 16384 2024-09-21T03:56:20.147 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4193792 len 16384 2024-09-21T03:56:20.147 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4193792 len 16384 2024-09-21T03:56:20.147 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4194304 len 1024 2024-09-21T03:56:20.147 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4194304 len 1024 2024-09-21T03:56:20.147 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4194304 len 1024 2024-09-21T03:56:20.147 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4194304 len 1024 2024-09-21T03:56:20.147 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4194304 len 2048 2024-09-21T03:56:20.147 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4194304 len 2048 2024-09-21T03:56:20.147 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4194304 len 2048 2024-09-21T03:56:20.147 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4194304 len 2048 2024-09-21T03:56:20.147 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4194304 len 4096 2024-09-21T03:56:20.147 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4194304 len 4096 2024-09-21T03:56:20.148 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4194304 len 4096 2024-09-21T03:56:20.148 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4194304 len 4096 2024-09-21T03:56:20.148 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4194304 len 8192 2024-09-21T03:56:20.148 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4194304 len 8192 2024-09-21T03:56:20.148 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4194304 len 8192 2024-09-21T03:56:20.148 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4194304 len 8192 2024-09-21T03:56:20.148 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4194304 len 16384 2024-09-21T03:56:20.148 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4194304 len 16384 2024-09-21T03:56:20.148 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4194304 len 16384 2024-09-21T03:56:20.148 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4194304 len 16384 2024-09-21T03:56:20.148 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4194816 len 1024 2024-09-21T03:56:20.148 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4194816 len 1024 2024-09-21T03:56:20.148 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4194816 len 1024 2024-09-21T03:56:20.149 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4194816 len 1024 2024-09-21T03:56:20.149 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4194816 len 2048 2024-09-21T03:56:20.149 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4194816 len 2048 2024-09-21T03:56:20.149 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4194816 len 2048 2024-09-21T03:56:20.149 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4194816 len 2048 2024-09-21T03:56:20.149 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4194816 len 4096 2024-09-21T03:56:20.149 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4194816 len 4096 2024-09-21T03:56:20.149 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4194816 len 4096 2024-09-21T03:56:20.149 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4194816 len 4096 2024-09-21T03:56:20.149 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4194816 len 8192 2024-09-21T03:56:20.149 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4194816 len 8192 2024-09-21T03:56:20.149 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4194816 len 8192 2024-09-21T03:56:20.149 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4194816 len 8192 2024-09-21T03:56:20.149 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4194816 len 16384 2024-09-21T03:56:20.150 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4194816 len 16384 2024-09-21T03:56:20.150 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4194816 len 16384 2024-09-21T03:56:20.150 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4194816 len 16384 2024-09-21T03:56:20.150 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4195328 len 1024 2024-09-21T03:56:20.150 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4195328 len 1024 2024-09-21T03:56:20.150 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4195328 len 1024 2024-09-21T03:56:20.150 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4195328 len 1024 2024-09-21T03:56:20.150 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4195328 len 2048 2024-09-21T03:56:20.150 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4195328 len 2048 2024-09-21T03:56:20.150 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4195328 len 2048 2024-09-21T03:56:20.150 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4195328 len 2048 2024-09-21T03:56:20.150 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4195328 len 4096 2024-09-21T03:56:20.155 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4195328 len 4096 2024-09-21T03:56:20.155 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4195328 len 4096 2024-09-21T03:56:20.155 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4195328 len 4096 2024-09-21T03:56:20.155 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4195328 len 8192 2024-09-21T03:56:20.155 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4195328 len 8192 2024-09-21T03:56:20.156 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4195328 len 8192 2024-09-21T03:56:20.156 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4195328 len 8192 2024-09-21T03:56:20.156 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4195328 len 16384 2024-09-21T03:56:20.156 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4195328 len 16384 2024-09-21T03:56:20.156 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4195328 len 16384 2024-09-21T03:56:20.156 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4195328 len 16384 2024-09-21T03:56:20.156 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4195840 len 1024 2024-09-21T03:56:20.156 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4195840 len 1024 2024-09-21T03:56:20.156 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4195840 len 1024 2024-09-21T03:56:20.156 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4195840 len 1024 2024-09-21T03:56:20.156 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4195840 len 2048 2024-09-21T03:56:20.156 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4195840 len 2048 2024-09-21T03:56:20.156 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4195840 len 2048 2024-09-21T03:56:20.157 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4195840 len 2048 2024-09-21T03:56:20.157 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4195840 len 4096 2024-09-21T03:56:20.157 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4195840 len 4096 2024-09-21T03:56:20.157 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4195840 len 4096 2024-09-21T03:56:20.157 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4195840 len 4096 2024-09-21T03:56:20.157 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4195840 len 8192 2024-09-21T03:56:20.157 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4195840 len 8192 2024-09-21T03:56:20.157 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4195840 len 8192 2024-09-21T03:56:20.157 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4195840 len 8192 2024-09-21T03:56:20.157 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4195840 len 16384 2024-09-21T03:56:20.157 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4195840 len 16384 2024-09-21T03:56:20.157 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4195840 len 16384 2024-09-21T03:56:20.157 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4195840 len 16384 2024-09-21T03:56:20.158 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4196352 len 1024 2024-09-21T03:56:20.158 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4196352 len 1024 2024-09-21T03:56:20.158 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4196352 len 1024 2024-09-21T03:56:20.158 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4196352 len 1024 2024-09-21T03:56:20.158 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4196352 len 2048 2024-09-21T03:56:20.158 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4196352 len 2048 2024-09-21T03:56:20.158 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4196352 len 2048 2024-09-21T03:56:20.158 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4196352 len 2048 2024-09-21T03:56:20.158 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4196352 len 4096 2024-09-21T03:56:20.158 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4196352 len 4096 2024-09-21T03:56:20.158 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4196352 len 4096 2024-09-21T03:56:20.158 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4196352 len 4096 2024-09-21T03:56:20.158 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4196352 len 8192 2024-09-21T03:56:20.159 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4196352 len 8192 2024-09-21T03:56:20.159 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4196352 len 8192 2024-09-21T03:56:20.159 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4196352 len 8192 2024-09-21T03:56:20.159 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4196352 len 16384 2024-09-21T03:56:20.159 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4196352 len 16384 2024-09-21T03:56:20.159 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4196352 len 16384 2024-09-21T03:56:20.159 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4196352 len 16384 2024-09-21T03:56:20.159 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4196864 len 1024 2024-09-21T03:56:20.159 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4196864 len 1024 2024-09-21T03:56:20.159 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4196864 len 1024 2024-09-21T03:56:20.159 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4196864 len 1024 2024-09-21T03:56:20.159 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4196864 len 2048 2024-09-21T03:56:20.159 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4196864 len 2048 2024-09-21T03:56:20.160 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4196864 len 2048 2024-09-21T03:56:20.160 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4196864 len 2048 2024-09-21T03:56:20.160 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4196864 len 4096 2024-09-21T03:56:20.160 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4196864 len 4096 2024-09-21T03:56:20.160 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4196864 len 4096 2024-09-21T03:56:20.160 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4196864 len 4096 2024-09-21T03:56:20.160 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4196864 len 8192 2024-09-21T03:56:20.160 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4196864 len 8192 2024-09-21T03:56:20.160 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4196864 len 8192 2024-09-21T03:56:20.160 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4196864 len 8192 2024-09-21T03:56:20.160 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4196864 len 16384 2024-09-21T03:56:20.160 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4196864 len 16384 2024-09-21T03:56:20.160 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4196864 len 16384 2024-09-21T03:56:20.161 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4196864 len 16384 2024-09-21T03:56:20.161 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4197376 len 1024 2024-09-21T03:56:20.161 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4197376 len 1024 2024-09-21T03:56:20.161 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4197376 len 1024 2024-09-21T03:56:20.161 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4197376 len 1024 2024-09-21T03:56:20.161 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4197376 len 2048 2024-09-21T03:56:20.161 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4197376 len 2048 2024-09-21T03:56:20.161 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4197376 len 2048 2024-09-21T03:56:20.161 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4197376 len 2048 2024-09-21T03:56:20.161 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4197376 len 4096 2024-09-21T03:56:20.161 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4197376 len 4096 2024-09-21T03:56:20.161 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4197376 len 4096 2024-09-21T03:56:20.161 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4197376 len 4096 2024-09-21T03:56:20.173 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4197376 len 8192 2024-09-21T03:56:20.173 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4197376 len 8192 2024-09-21T03:56:20.173 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4197376 len 8192 2024-09-21T03:56:20.173 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4197376 len 8192 2024-09-21T03:56:20.173 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4197376 len 16384 2024-09-21T03:56:20.173 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4197376 len 16384 2024-09-21T03:56:20.173 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4197376 len 16384 2024-09-21T03:56:20.173 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4197376 len 16384 2024-09-21T03:56:20.173 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4197888 len 1024 2024-09-21T03:56:20.173 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4197888 len 1024 2024-09-21T03:56:20.173 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4197888 len 1024 2024-09-21T03:56:20.173 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4197888 len 1024 2024-09-21T03:56:20.174 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4197888 len 2048 2024-09-21T03:56:20.174 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4197888 len 2048 2024-09-21T03:56:20.174 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4197888 len 2048 2024-09-21T03:56:20.174 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4197888 len 2048 2024-09-21T03:56:20.174 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4197888 len 4096 2024-09-21T03:56:20.174 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4197888 len 4096 2024-09-21T03:56:20.174 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4197888 len 4096 2024-09-21T03:56:20.174 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4197888 len 4096 2024-09-21T03:56:20.174 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4197888 len 8192 2024-09-21T03:56:20.174 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4197888 len 8192 2024-09-21T03:56:20.174 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4197888 len 8192 2024-09-21T03:56:20.174 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4197888 len 8192 2024-09-21T03:56:20.174 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1024 offset 4197888 len 16384 2024-09-21T03:56:20.175 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4197888 len 16384 2024-09-21T03:56:20.175 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1024 offset 4197888 len 16384 2024-09-21T03:56:20.175 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1024 offset 4197888 len 16384 2024-09-21T03:56:20.175 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4190208 len 1024 2024-09-21T03:56:20.175 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4190208 len 1024 2024-09-21T03:56:20.175 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4190208 len 1024 2024-09-21T03:56:20.175 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4190208 len 1024 2024-09-21T03:56:20.175 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4190208 len 2048 2024-09-21T03:56:20.175 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4190208 len 2048 2024-09-21T03:56:20.175 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4190208 len 2048 2024-09-21T03:56:20.175 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4190208 len 2048 2024-09-21T03:56:20.175 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4190208 len 4096 2024-09-21T03:56:20.175 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4190208 len 4096 2024-09-21T03:56:20.175 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4190208 len 4096 2024-09-21T03:56:20.175 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4190208 len 4096 2024-09-21T03:56:20.176 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4190208 len 8192 2024-09-21T03:56:20.176 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4190208 len 8192 2024-09-21T03:56:20.176 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4190208 len 8192 2024-09-21T03:56:20.176 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4190208 len 8192 2024-09-21T03:56:20.176 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4190208 len 16384 2024-09-21T03:56:20.176 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4190208 len 16384 2024-09-21T03:56:20.176 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4190208 len 16384 2024-09-21T03:56:20.176 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4190208 len 16384 2024-09-21T03:56:20.176 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4190720 len 1024 2024-09-21T03:56:20.176 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4190720 len 1024 2024-09-21T03:56:20.176 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4190720 len 1024 2024-09-21T03:56:20.176 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4190720 len 1024 2024-09-21T03:56:20.176 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4190720 len 2048 2024-09-21T03:56:20.176 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4190720 len 2048 2024-09-21T03:56:20.176 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4190720 len 2048 2024-09-21T03:56:20.177 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4190720 len 2048 2024-09-21T03:56:20.177 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4190720 len 4096 2024-09-21T03:56:20.177 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4190720 len 4096 2024-09-21T03:56:20.177 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4190720 len 4096 2024-09-21T03:56:20.177 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4190720 len 4096 2024-09-21T03:56:20.177 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4190720 len 8192 2024-09-21T03:56:20.177 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4190720 len 8192 2024-09-21T03:56:20.177 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4190720 len 8192 2024-09-21T03:56:20.177 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4190720 len 8192 2024-09-21T03:56:20.177 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4190720 len 16384 2024-09-21T03:56:20.177 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4190720 len 16384 2024-09-21T03:56:20.177 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4190720 len 16384 2024-09-21T03:56:20.177 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4190720 len 16384 2024-09-21T03:56:20.177 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4191232 len 1024 2024-09-21T03:56:20.178 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4191232 len 1024 2024-09-21T03:56:20.178 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4191232 len 1024 2024-09-21T03:56:20.178 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4191232 len 1024 2024-09-21T03:56:20.178 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4191232 len 2048 2024-09-21T03:56:20.178 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4191232 len 2048 2024-09-21T03:56:20.178 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4191232 len 2048 2024-09-21T03:56:20.178 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4191232 len 2048 2024-09-21T03:56:20.178 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4191232 len 4096 2024-09-21T03:56:20.178 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4191232 len 4096 2024-09-21T03:56:20.178 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4191232 len 4096 2024-09-21T03:56:20.178 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4191232 len 4096 2024-09-21T03:56:20.178 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4191232 len 8192 2024-09-21T03:56:20.178 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4191232 len 8192 2024-09-21T03:56:20.194 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4191232 len 8192 2024-09-21T03:56:20.194 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4191232 len 8192 2024-09-21T03:56:20.194 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4191232 len 16384 2024-09-21T03:56:20.194 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4191232 len 16384 2024-09-21T03:56:20.194 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4191232 len 16384 2024-09-21T03:56:20.194 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4191232 len 16384 2024-09-21T03:56:20.194 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4191744 len 1024 2024-09-21T03:56:20.194 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4191744 len 1024 2024-09-21T03:56:20.194 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4191744 len 1024 2024-09-21T03:56:20.194 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4191744 len 1024 2024-09-21T03:56:20.195 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4191744 len 2048 2024-09-21T03:56:20.195 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4191744 len 2048 2024-09-21T03:56:20.195 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4191744 len 2048 2024-09-21T03:56:20.195 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4191744 len 2048 2024-09-21T03:56:20.195 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4191744 len 4096 2024-09-21T03:56:20.195 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4191744 len 4096 2024-09-21T03:56:20.195 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4191744 len 4096 2024-09-21T03:56:20.195 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4191744 len 4096 2024-09-21T03:56:20.195 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4191744 len 8192 2024-09-21T03:56:20.195 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4191744 len 8192 2024-09-21T03:56:20.195 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4191744 len 8192 2024-09-21T03:56:20.195 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4191744 len 8192 2024-09-21T03:56:20.195 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4191744 len 16384 2024-09-21T03:56:20.196 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4191744 len 16384 2024-09-21T03:56:20.196 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4191744 len 16384 2024-09-21T03:56:20.196 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4191744 len 16384 2024-09-21T03:56:20.196 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4192256 len 1024 2024-09-21T03:56:20.196 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4192256 len 1024 2024-09-21T03:56:20.196 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4192256 len 1024 2024-09-21T03:56:20.196 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4192256 len 1024 2024-09-21T03:56:20.196 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4192256 len 2048 2024-09-21T03:56:20.196 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4192256 len 2048 2024-09-21T03:56:20.196 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4192256 len 2048 2024-09-21T03:56:20.196 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4192256 len 2048 2024-09-21T03:56:20.196 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4192256 len 4096 2024-09-21T03:56:20.196 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4192256 len 4096 2024-09-21T03:56:20.196 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4192256 len 4096 2024-09-21T03:56:20.197 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4192256 len 4096 2024-09-21T03:56:20.197 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4192256 len 8192 2024-09-21T03:56:20.197 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4192256 len 8192 2024-09-21T03:56:20.197 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4192256 len 8192 2024-09-21T03:56:20.197 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4192256 len 8192 2024-09-21T03:56:20.197 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4192256 len 16384 2024-09-21T03:56:20.197 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4192256 len 16384 2024-09-21T03:56:20.197 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4192256 len 16384 2024-09-21T03:56:20.197 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4192256 len 16384 2024-09-21T03:56:20.197 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4192768 len 1024 2024-09-21T03:56:20.197 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4192768 len 1024 2024-09-21T03:56:20.197 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4192768 len 1024 2024-09-21T03:56:20.197 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4192768 len 1024 2024-09-21T03:56:20.197 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4192768 len 2048 2024-09-21T03:56:20.198 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4192768 len 2048 2024-09-21T03:56:20.198 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4192768 len 2048 2024-09-21T03:56:20.198 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4192768 len 2048 2024-09-21T03:56:20.198 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4192768 len 4096 2024-09-21T03:56:20.198 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4192768 len 4096 2024-09-21T03:56:20.198 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4192768 len 4096 2024-09-21T03:56:20.198 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4192768 len 4096 2024-09-21T03:56:20.198 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4192768 len 8192 2024-09-21T03:56:20.198 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4192768 len 8192 2024-09-21T03:56:20.198 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4192768 len 8192 2024-09-21T03:56:20.198 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4192768 len 8192 2024-09-21T03:56:20.198 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4192768 len 16384 2024-09-21T03:56:20.198 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4192768 len 16384 2024-09-21T03:56:20.199 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4192768 len 16384 2024-09-21T03:56:20.199 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4192768 len 16384 2024-09-21T03:56:20.199 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4193280 len 1024 2024-09-21T03:56:20.199 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4193280 len 1024 2024-09-21T03:56:20.199 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4193280 len 1024 2024-09-21T03:56:20.199 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4193280 len 1024 2024-09-21T03:56:20.199 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4193280 len 2048 2024-09-21T03:56:20.199 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4193280 len 2048 2024-09-21T03:56:20.199 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4193280 len 2048 2024-09-21T03:56:20.199 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4193280 len 2048 2024-09-21T03:56:20.199 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4193280 len 4096 2024-09-21T03:56:20.199 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4193280 len 4096 2024-09-21T03:56:20.199 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4193280 len 4096 2024-09-21T03:56:20.200 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4193280 len 4096 2024-09-21T03:56:20.200 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4193280 len 8192 2024-09-21T03:56:20.200 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4193280 len 8192 2024-09-21T03:56:20.200 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4193280 len 8192 2024-09-21T03:56:20.200 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4193280 len 8192 2024-09-21T03:56:20.207 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4193280 len 16384 2024-09-21T03:56:20.207 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4193280 len 16384 2024-09-21T03:56:20.207 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4193280 len 16384 2024-09-21T03:56:20.207 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4193280 len 16384 2024-09-21T03:56:20.207 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4193792 len 1024 2024-09-21T03:56:20.207 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4193792 len 1024 2024-09-21T03:56:20.207 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4193792 len 1024 2024-09-21T03:56:20.207 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4193792 len 1024 2024-09-21T03:56:20.207 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4193792 len 2048 2024-09-21T03:56:20.207 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4193792 len 2048 2024-09-21T03:56:20.207 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4193792 len 2048 2024-09-21T03:56:20.208 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4193792 len 2048 2024-09-21T03:56:20.208 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4193792 len 4096 2024-09-21T03:56:20.208 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4193792 len 4096 2024-09-21T03:56:20.208 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4193792 len 4096 2024-09-21T03:56:20.208 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4193792 len 4096 2024-09-21T03:56:20.208 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4193792 len 8192 2024-09-21T03:56:20.208 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4193792 len 8192 2024-09-21T03:56:20.208 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4193792 len 8192 2024-09-21T03:56:20.208 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4193792 len 8192 2024-09-21T03:56:20.208 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4193792 len 16384 2024-09-21T03:56:20.208 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4193792 len 16384 2024-09-21T03:56:20.208 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4193792 len 16384 2024-09-21T03:56:20.208 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4193792 len 16384 2024-09-21T03:56:20.208 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4194304 len 1024 2024-09-21T03:56:20.209 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4194304 len 1024 2024-09-21T03:56:20.209 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4194304 len 1024 2024-09-21T03:56:20.209 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4194304 len 1024 2024-09-21T03:56:20.209 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4194304 len 2048 2024-09-21T03:56:20.209 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4194304 len 2048 2024-09-21T03:56:20.209 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4194304 len 2048 2024-09-21T03:56:20.209 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4194304 len 2048 2024-09-21T03:56:20.209 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4194304 len 4096 2024-09-21T03:56:20.209 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4194304 len 4096 2024-09-21T03:56:20.209 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4194304 len 4096 2024-09-21T03:56:20.209 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4194304 len 4096 2024-09-21T03:56:20.209 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4194304 len 8192 2024-09-21T03:56:20.209 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4194304 len 8192 2024-09-21T03:56:20.209 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4194304 len 8192 2024-09-21T03:56:20.210 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4194304 len 8192 2024-09-21T03:56:20.210 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4194304 len 16384 2024-09-21T03:56:20.210 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4194304 len 16384 2024-09-21T03:56:20.210 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4194304 len 16384 2024-09-21T03:56:20.210 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4194304 len 16384 2024-09-21T03:56:20.210 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4194816 len 1024 2024-09-21T03:56:20.210 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4194816 len 1024 2024-09-21T03:56:20.210 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4194816 len 1024 2024-09-21T03:56:20.210 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4194816 len 1024 2024-09-21T03:56:20.210 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4194816 len 2048 2024-09-21T03:56:20.210 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4194816 len 2048 2024-09-21T03:56:20.210 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4194816 len 2048 2024-09-21T03:56:20.210 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4194816 len 2048 2024-09-21T03:56:20.211 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4194816 len 4096 2024-09-21T03:56:20.211 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4194816 len 4096 2024-09-21T03:56:20.211 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4194816 len 4096 2024-09-21T03:56:20.211 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4194816 len 4096 2024-09-21T03:56:20.211 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4194816 len 8192 2024-09-21T03:56:20.211 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4194816 len 8192 2024-09-21T03:56:20.211 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4194816 len 8192 2024-09-21T03:56:20.211 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4194816 len 8192 2024-09-21T03:56:20.211 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4194816 len 16384 2024-09-21T03:56:20.211 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4194816 len 16384 2024-09-21T03:56:20.211 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4194816 len 16384 2024-09-21T03:56:20.211 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4194816 len 16384 2024-09-21T03:56:20.211 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4195328 len 1024 2024-09-21T03:56:20.211 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4195328 len 1024 2024-09-21T03:56:20.212 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4195328 len 1024 2024-09-21T03:56:20.212 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4195328 len 1024 2024-09-21T03:56:20.212 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4195328 len 2048 2024-09-21T03:56:20.212 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4195328 len 2048 2024-09-21T03:56:20.212 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4195328 len 2048 2024-09-21T03:56:20.212 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4195328 len 2048 2024-09-21T03:56:20.212 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4195328 len 4096 2024-09-21T03:56:20.212 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4195328 len 4096 2024-09-21T03:56:20.212 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4195328 len 4096 2024-09-21T03:56:20.212 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4195328 len 4096 2024-09-21T03:56:20.212 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4195328 len 8192 2024-09-21T03:56:20.212 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4195328 len 8192 2024-09-21T03:56:20.212 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4195328 len 8192 2024-09-21T03:56:20.212 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4195328 len 8192 2024-09-21T03:56:20.213 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4195328 len 16384 2024-09-21T03:56:20.213 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4195328 len 16384 2024-09-21T03:56:20.213 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4195328 len 16384 2024-09-21T03:56:20.217 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4195328 len 16384 2024-09-21T03:56:20.217 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4195840 len 1024 2024-09-21T03:56:20.217 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4195840 len 1024 2024-09-21T03:56:20.217 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4195840 len 1024 2024-09-21T03:56:20.217 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4195840 len 1024 2024-09-21T03:56:20.217 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4195840 len 2048 2024-09-21T03:56:20.217 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4195840 len 2048 2024-09-21T03:56:20.217 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4195840 len 2048 2024-09-21T03:56:20.217 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4195840 len 2048 2024-09-21T03:56:20.217 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4195840 len 4096 2024-09-21T03:56:20.218 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4195840 len 4096 2024-09-21T03:56:20.218 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4195840 len 4096 2024-09-21T03:56:20.218 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4195840 len 4096 2024-09-21T03:56:20.218 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4195840 len 8192 2024-09-21T03:56:20.218 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4195840 len 8192 2024-09-21T03:56:20.218 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4195840 len 8192 2024-09-21T03:56:20.218 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4195840 len 8192 2024-09-21T03:56:20.218 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4195840 len 16384 2024-09-21T03:56:20.218 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4195840 len 16384 2024-09-21T03:56:20.218 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4195840 len 16384 2024-09-21T03:56:20.218 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4195840 len 16384 2024-09-21T03:56:20.218 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4196352 len 1024 2024-09-21T03:56:20.218 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4196352 len 1024 2024-09-21T03:56:20.219 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4196352 len 1024 2024-09-21T03:56:20.219 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4196352 len 1024 2024-09-21T03:56:20.219 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4196352 len 2048 2024-09-21T03:56:20.219 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4196352 len 2048 2024-09-21T03:56:20.219 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4196352 len 2048 2024-09-21T03:56:20.219 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4196352 len 2048 2024-09-21T03:56:20.219 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4196352 len 4096 2024-09-21T03:56:20.219 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4196352 len 4096 2024-09-21T03:56:20.219 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4196352 len 4096 2024-09-21T03:56:20.219 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4196352 len 4096 2024-09-21T03:56:20.219 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4196352 len 8192 2024-09-21T03:56:20.219 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4196352 len 8192 2024-09-21T03:56:20.219 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4196352 len 8192 2024-09-21T03:56:20.219 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4196352 len 8192 2024-09-21T03:56:20.219 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4196352 len 16384 2024-09-21T03:56:20.220 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4196352 len 16384 2024-09-21T03:56:20.220 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4196352 len 16384 2024-09-21T03:56:20.220 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4196352 len 16384 2024-09-21T03:56:20.220 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4196864 len 1024 2024-09-21T03:56:20.220 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4196864 len 1024 2024-09-21T03:56:20.220 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4196864 len 1024 2024-09-21T03:56:20.220 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4196864 len 1024 2024-09-21T03:56:20.220 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4196864 len 2048 2024-09-21T03:56:20.220 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4196864 len 2048 2024-09-21T03:56:20.220 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4196864 len 2048 2024-09-21T03:56:20.220 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4196864 len 2048 2024-09-21T03:56:20.220 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4196864 len 4096 2024-09-21T03:56:20.220 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4196864 len 4096 2024-09-21T03:56:20.220 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4196864 len 4096 2024-09-21T03:56:20.221 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4196864 len 4096 2024-09-21T03:56:20.221 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4196864 len 8192 2024-09-21T03:56:20.221 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4196864 len 8192 2024-09-21T03:56:20.221 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4196864 len 8192 2024-09-21T03:56:20.221 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4196864 len 8192 2024-09-21T03:56:20.221 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4196864 len 16384 2024-09-21T03:56:20.221 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4196864 len 16384 2024-09-21T03:56:20.221 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4196864 len 16384 2024-09-21T03:56:20.221 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4196864 len 16384 2024-09-21T03:56:20.221 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4197376 len 1024 2024-09-21T03:56:20.221 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4197376 len 1024 2024-09-21T03:56:20.221 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4197376 len 1024 2024-09-21T03:56:20.221 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4197376 len 1024 2024-09-21T03:56:20.221 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4197376 len 2048 2024-09-21T03:56:20.221 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4197376 len 2048 2024-09-21T03:56:20.222 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4197376 len 2048 2024-09-21T03:56:20.222 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4197376 len 2048 2024-09-21T03:56:20.222 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4197376 len 4096 2024-09-21T03:56:20.222 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4197376 len 4096 2024-09-21T03:56:20.222 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4197376 len 4096 2024-09-21T03:56:20.222 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4197376 len 4096 2024-09-21T03:56:20.222 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4197376 len 8192 2024-09-21T03:56:20.222 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4197376 len 8192 2024-09-21T03:56:20.222 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4197376 len 8192 2024-09-21T03:56:20.222 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4197376 len 8192 2024-09-21T03:56:20.222 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4197376 len 16384 2024-09-21T03:56:20.222 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4197376 len 16384 2024-09-21T03:56:20.222 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4197376 len 16384 2024-09-21T03:56:20.223 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4197376 len 16384 2024-09-21T03:56:20.223 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4197888 len 1024 2024-09-21T03:56:20.236 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4197888 len 1024 2024-09-21T03:56:20.236 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4197888 len 1024 2024-09-21T03:56:20.236 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4197888 len 1024 2024-09-21T03:56:20.237 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4197888 len 2048 2024-09-21T03:56:20.237 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4197888 len 2048 2024-09-21T03:56:20.237 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4197888 len 2048 2024-09-21T03:56:20.237 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4197888 len 2048 2024-09-21T03:56:20.237 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4197888 len 4096 2024-09-21T03:56:20.237 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4197888 len 4096 2024-09-21T03:56:20.237 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4197888 len 4096 2024-09-21T03:56:20.237 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4197888 len 4096 2024-09-21T03:56:20.237 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4197888 len 8192 2024-09-21T03:56:20.237 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4197888 len 8192 2024-09-21T03:56:20.237 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4197888 len 8192 2024-09-21T03:56:20.237 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4197888 len 8192 2024-09-21T03:56:20.237 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 1536 offset 4197888 len 16384 2024-09-21T03:56:20.238 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4197888 len 16384 2024-09-21T03:56:20.238 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 1536 offset 4197888 len 16384 2024-09-21T03:56:20.238 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 1536 offset 4197888 len 16384 2024-09-21T03:56:20.238 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4190208 len 1024 2024-09-21T03:56:20.238 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4190208 len 1024 2024-09-21T03:56:20.238 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4190208 len 1024 2024-09-21T03:56:20.238 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4190208 len 1024 2024-09-21T03:56:20.238 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4190208 len 2048 2024-09-21T03:56:20.238 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4190208 len 2048 2024-09-21T03:56:20.238 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4190208 len 2048 2024-09-21T03:56:20.238 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4190208 len 2048 2024-09-21T03:56:20.238 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4190208 len 4096 2024-09-21T03:56:20.238 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4190208 len 4096 2024-09-21T03:56:20.239 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4190208 len 4096 2024-09-21T03:56:20.239 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4190208 len 4096 2024-09-21T03:56:20.239 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4190208 len 8192 2024-09-21T03:56:20.239 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4190208 len 8192 2024-09-21T03:56:20.239 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4190208 len 8192 2024-09-21T03:56:20.239 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4190208 len 8192 2024-09-21T03:56:20.239 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4190208 len 16384 2024-09-21T03:56:20.239 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4190208 len 16384 2024-09-21T03:56:20.239 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4190208 len 16384 2024-09-21T03:56:20.239 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4190208 len 16384 2024-09-21T03:56:20.239 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4190720 len 1024 2024-09-21T03:56:20.239 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4190720 len 1024 2024-09-21T03:56:20.239 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4190720 len 1024 2024-09-21T03:56:20.239 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4190720 len 1024 2024-09-21T03:56:20.239 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4190720 len 2048 2024-09-21T03:56:20.240 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4190720 len 2048 2024-09-21T03:56:20.240 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4190720 len 2048 2024-09-21T03:56:20.240 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4190720 len 2048 2024-09-21T03:56:20.240 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4190720 len 4096 2024-09-21T03:56:20.240 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4190720 len 4096 2024-09-21T03:56:20.240 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4190720 len 4096 2024-09-21T03:56:20.240 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4190720 len 4096 2024-09-21T03:56:20.240 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4190720 len 8192 2024-09-21T03:56:20.240 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4190720 len 8192 2024-09-21T03:56:20.240 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4190720 len 8192 2024-09-21T03:56:20.240 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4190720 len 8192 2024-09-21T03:56:20.240 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4190720 len 16384 2024-09-21T03:56:20.240 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4190720 len 16384 2024-09-21T03:56:20.240 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4190720 len 16384 2024-09-21T03:56:20.240 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4190720 len 16384 2024-09-21T03:56:20.241 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4191232 len 1024 2024-09-21T03:56:20.241 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4191232 len 1024 2024-09-21T03:56:20.241 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4191232 len 1024 2024-09-21T03:56:20.241 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4191232 len 1024 2024-09-21T03:56:20.241 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4191232 len 2048 2024-09-21T03:56:20.241 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4191232 len 2048 2024-09-21T03:56:20.241 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4191232 len 2048 2024-09-21T03:56:20.241 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4191232 len 2048 2024-09-21T03:56:20.241 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4191232 len 4096 2024-09-21T03:56:20.241 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4191232 len 4096 2024-09-21T03:56:20.241 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4191232 len 4096 2024-09-21T03:56:20.241 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4191232 len 4096 2024-09-21T03:56:20.241 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4191232 len 8192 2024-09-21T03:56:20.241 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4191232 len 8192 2024-09-21T03:56:20.241 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4191232 len 8192 2024-09-21T03:56:20.242 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4191232 len 8192 2024-09-21T03:56:20.242 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4191232 len 16384 2024-09-21T03:56:20.242 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4191232 len 16384 2024-09-21T03:56:20.242 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4191232 len 16384 2024-09-21T03:56:20.242 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4191232 len 16384 2024-09-21T03:56:20.242 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4191744 len 1024 2024-09-21T03:56:20.242 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4191744 len 1024 2024-09-21T03:56:20.242 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4191744 len 1024 2024-09-21T03:56:20.242 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4191744 len 1024 2024-09-21T03:56:20.258 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4191744 len 2048 2024-09-21T03:56:20.258 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4191744 len 2048 2024-09-21T03:56:20.258 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4191744 len 2048 2024-09-21T03:56:20.258 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4191744 len 2048 2024-09-21T03:56:20.258 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4191744 len 4096 2024-09-21T03:56:20.258 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4191744 len 4096 2024-09-21T03:56:20.258 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4191744 len 4096 2024-09-21T03:56:20.258 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4191744 len 4096 2024-09-21T03:56:20.258 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4191744 len 8192 2024-09-21T03:56:20.258 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4191744 len 8192 2024-09-21T03:56:20.258 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4191744 len 8192 2024-09-21T03:56:20.258 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4191744 len 8192 2024-09-21T03:56:20.259 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4191744 len 16384 2024-09-21T03:56:20.259 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4191744 len 16384 2024-09-21T03:56:20.259 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4191744 len 16384 2024-09-21T03:56:20.259 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4191744 len 16384 2024-09-21T03:56:20.259 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4192256 len 1024 2024-09-21T03:56:20.259 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4192256 len 1024 2024-09-21T03:56:20.259 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4192256 len 1024 2024-09-21T03:56:20.259 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4192256 len 1024 2024-09-21T03:56:20.259 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4192256 len 2048 2024-09-21T03:56:20.259 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4192256 len 2048 2024-09-21T03:56:20.259 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4192256 len 2048 2024-09-21T03:56:20.259 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4192256 len 2048 2024-09-21T03:56:20.259 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4192256 len 4096 2024-09-21T03:56:20.260 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4192256 len 4096 2024-09-21T03:56:20.260 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4192256 len 4096 2024-09-21T03:56:20.260 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4192256 len 4096 2024-09-21T03:56:20.260 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4192256 len 8192 2024-09-21T03:56:20.260 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4192256 len 8192 2024-09-21T03:56:20.260 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4192256 len 8192 2024-09-21T03:56:20.260 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4192256 len 8192 2024-09-21T03:56:20.260 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4192256 len 16384 2024-09-21T03:56:20.260 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4192256 len 16384 2024-09-21T03:56:20.260 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4192256 len 16384 2024-09-21T03:56:20.260 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4192256 len 16384 2024-09-21T03:56:20.260 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4192768 len 1024 2024-09-21T03:56:20.260 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4192768 len 1024 2024-09-21T03:56:20.260 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4192768 len 1024 2024-09-21T03:56:20.261 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4192768 len 1024 2024-09-21T03:56:20.261 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4192768 len 2048 2024-09-21T03:56:20.261 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4192768 len 2048 2024-09-21T03:56:20.261 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4192768 len 2048 2024-09-21T03:56:20.261 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4192768 len 2048 2024-09-21T03:56:20.261 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4192768 len 4096 2024-09-21T03:56:20.261 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4192768 len 4096 2024-09-21T03:56:20.261 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4192768 len 4096 2024-09-21T03:56:20.261 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4192768 len 4096 2024-09-21T03:56:20.261 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4192768 len 8192 2024-09-21T03:56:20.261 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4192768 len 8192 2024-09-21T03:56:20.261 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4192768 len 8192 2024-09-21T03:56:20.261 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4192768 len 8192 2024-09-21T03:56:20.262 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4192768 len 16384 2024-09-21T03:56:20.262 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4192768 len 16384 2024-09-21T03:56:20.262 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4192768 len 16384 2024-09-21T03:56:20.262 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4192768 len 16384 2024-09-21T03:56:20.262 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4193280 len 1024 2024-09-21T03:56:20.262 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4193280 len 1024 2024-09-21T03:56:20.262 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4193280 len 1024 2024-09-21T03:56:20.262 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4193280 len 1024 2024-09-21T03:56:20.262 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4193280 len 2048 2024-09-21T03:56:20.262 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4193280 len 2048 2024-09-21T03:56:20.262 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4193280 len 2048 2024-09-21T03:56:20.262 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4193280 len 2048 2024-09-21T03:56:20.262 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4193280 len 4096 2024-09-21T03:56:20.262 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4193280 len 4096 2024-09-21T03:56:20.263 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4193280 len 4096 2024-09-21T03:56:20.263 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4193280 len 4096 2024-09-21T03:56:20.263 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4193280 len 8192 2024-09-21T03:56:20.263 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4193280 len 8192 2024-09-21T03:56:20.263 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4193280 len 8192 2024-09-21T03:56:20.263 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4193280 len 8192 2024-09-21T03:56:20.263 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4193280 len 16384 2024-09-21T03:56:20.263 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4193280 len 16384 2024-09-21T03:56:20.263 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4193280 len 16384 2024-09-21T03:56:20.263 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4193280 len 16384 2024-09-21T03:56:20.263 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4193792 len 1024 2024-09-21T03:56:20.263 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4193792 len 1024 2024-09-21T03:56:20.263 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4193792 len 1024 2024-09-21T03:56:20.263 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4193792 len 1024 2024-09-21T03:56:20.263 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4193792 len 2048 2024-09-21T03:56:20.264 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4193792 len 2048 2024-09-21T03:56:20.271 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4193792 len 2048 2024-09-21T03:56:20.271 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4193792 len 2048 2024-09-21T03:56:20.271 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4193792 len 4096 2024-09-21T03:56:20.271 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4193792 len 4096 2024-09-21T03:56:20.271 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4193792 len 4096 2024-09-21T03:56:20.271 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4193792 len 4096 2024-09-21T03:56:20.271 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4193792 len 8192 2024-09-21T03:56:20.271 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4193792 len 8192 2024-09-21T03:56:20.272 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4193792 len 8192 2024-09-21T03:56:20.272 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4193792 len 8192 2024-09-21T03:56:20.272 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4193792 len 16384 2024-09-21T03:56:20.272 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4193792 len 16384 2024-09-21T03:56:20.272 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4193792 len 16384 2024-09-21T03:56:20.272 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4193792 len 16384 2024-09-21T03:56:20.272 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4194304 len 1024 2024-09-21T03:56:20.272 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4194304 len 1024 2024-09-21T03:56:20.272 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4194304 len 1024 2024-09-21T03:56:20.272 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4194304 len 1024 2024-09-21T03:56:20.272 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4194304 len 2048 2024-09-21T03:56:20.272 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4194304 len 2048 2024-09-21T03:56:20.272 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4194304 len 2048 2024-09-21T03:56:20.272 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4194304 len 2048 2024-09-21T03:56:20.272 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4194304 len 4096 2024-09-21T03:56:20.273 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4194304 len 4096 2024-09-21T03:56:20.273 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4194304 len 4096 2024-09-21T03:56:20.273 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4194304 len 4096 2024-09-21T03:56:20.273 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4194304 len 8192 2024-09-21T03:56:20.273 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4194304 len 8192 2024-09-21T03:56:20.273 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4194304 len 8192 2024-09-21T03:56:20.273 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4194304 len 8192 2024-09-21T03:56:20.273 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4194304 len 16384 2024-09-21T03:56:20.273 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4194304 len 16384 2024-09-21T03:56:20.273 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4194304 len 16384 2024-09-21T03:56:20.273 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4194304 len 16384 2024-09-21T03:56:20.273 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4194816 len 1024 2024-09-21T03:56:20.273 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4194816 len 1024 2024-09-21T03:56:20.273 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4194816 len 1024 2024-09-21T03:56:20.274 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4194816 len 1024 2024-09-21T03:56:20.274 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4194816 len 2048 2024-09-21T03:56:20.274 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4194816 len 2048 2024-09-21T03:56:20.274 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4194816 len 2048 2024-09-21T03:56:20.274 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4194816 len 2048 2024-09-21T03:56:20.274 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4194816 len 4096 2024-09-21T03:56:20.274 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4194816 len 4096 2024-09-21T03:56:20.274 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4194816 len 4096 2024-09-21T03:56:20.274 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4194816 len 4096 2024-09-21T03:56:20.274 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4194816 len 8192 2024-09-21T03:56:20.274 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4194816 len 8192 2024-09-21T03:56:20.274 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4194816 len 8192 2024-09-21T03:56:20.274 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4194816 len 8192 2024-09-21T03:56:20.275 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4194816 len 16384 2024-09-21T03:56:20.275 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4194816 len 16384 2024-09-21T03:56:20.275 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4194816 len 16384 2024-09-21T03:56:20.275 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4194816 len 16384 2024-09-21T03:56:20.275 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4195328 len 1024 2024-09-21T03:56:20.275 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4195328 len 1024 2024-09-21T03:56:20.275 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4195328 len 1024 2024-09-21T03:56:20.275 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4195328 len 1024 2024-09-21T03:56:20.275 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4195328 len 2048 2024-09-21T03:56:20.275 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4195328 len 2048 2024-09-21T03:56:20.275 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4195328 len 2048 2024-09-21T03:56:20.275 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4195328 len 2048 2024-09-21T03:56:20.275 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4195328 len 4096 2024-09-21T03:56:20.275 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4195328 len 4096 2024-09-21T03:56:20.275 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4195328 len 4096 2024-09-21T03:56:20.276 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4195328 len 4096 2024-09-21T03:56:20.276 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4195328 len 8192 2024-09-21T03:56:20.276 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4195328 len 8192 2024-09-21T03:56:20.276 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4195328 len 8192 2024-09-21T03:56:20.276 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4195328 len 8192 2024-09-21T03:56:20.276 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4195328 len 16384 2024-09-21T03:56:20.276 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4195328 len 16384 2024-09-21T03:56:20.276 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4195328 len 16384 2024-09-21T03:56:20.276 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4195328 len 16384 2024-09-21T03:56:20.276 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4195840 len 1024 2024-09-21T03:56:20.276 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4195840 len 1024 2024-09-21T03:56:20.276 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4195840 len 1024 2024-09-21T03:56:20.276 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4195840 len 1024 2024-09-21T03:56:20.276 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4195840 len 2048 2024-09-21T03:56:20.277 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4195840 len 2048 2024-09-21T03:56:20.277 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4195840 len 2048 2024-09-21T03:56:20.277 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4195840 len 2048 2024-09-21T03:56:20.283 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4195840 len 4096 2024-09-21T03:56:20.283 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4195840 len 4096 2024-09-21T03:56:20.283 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4195840 len 4096 2024-09-21T03:56:20.283 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4195840 len 4096 2024-09-21T03:56:20.283 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4195840 len 8192 2024-09-21T03:56:20.283 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4195840 len 8192 2024-09-21T03:56:20.283 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4195840 len 8192 2024-09-21T03:56:20.283 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4195840 len 8192 2024-09-21T03:56:20.283 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4195840 len 16384 2024-09-21T03:56:20.283 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4195840 len 16384 2024-09-21T03:56:20.283 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4195840 len 16384 2024-09-21T03:56:20.283 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4195840 len 16384 2024-09-21T03:56:20.283 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4196352 len 1024 2024-09-21T03:56:20.283 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4196352 len 1024 2024-09-21T03:56:20.284 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4196352 len 1024 2024-09-21T03:56:20.284 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4196352 len 1024 2024-09-21T03:56:20.284 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4196352 len 2048 2024-09-21T03:56:20.284 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4196352 len 2048 2024-09-21T03:56:20.284 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4196352 len 2048 2024-09-21T03:56:20.284 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4196352 len 2048 2024-09-21T03:56:20.284 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4196352 len 4096 2024-09-21T03:56:20.284 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4196352 len 4096 2024-09-21T03:56:20.284 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4196352 len 4096 2024-09-21T03:56:20.284 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4196352 len 4096 2024-09-21T03:56:20.284 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4196352 len 8192 2024-09-21T03:56:20.284 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4196352 len 8192 2024-09-21T03:56:20.284 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4196352 len 8192 2024-09-21T03:56:20.284 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4196352 len 8192 2024-09-21T03:56:20.284 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4196352 len 16384 2024-09-21T03:56:20.285 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4196352 len 16384 2024-09-21T03:56:20.285 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4196352 len 16384 2024-09-21T03:56:20.285 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4196352 len 16384 2024-09-21T03:56:20.285 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4196864 len 1024 2024-09-21T03:56:20.285 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4196864 len 1024 2024-09-21T03:56:20.285 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4196864 len 1024 2024-09-21T03:56:20.285 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4196864 len 1024 2024-09-21T03:56:20.285 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4196864 len 2048 2024-09-21T03:56:20.285 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4196864 len 2048 2024-09-21T03:56:20.285 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4196864 len 2048 2024-09-21T03:56:20.285 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4196864 len 2048 2024-09-21T03:56:20.285 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4196864 len 4096 2024-09-21T03:56:20.285 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4196864 len 4096 2024-09-21T03:56:20.286 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4196864 len 4096 2024-09-21T03:56:20.286 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4196864 len 4096 2024-09-21T03:56:20.286 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4196864 len 8192 2024-09-21T03:56:20.286 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4196864 len 8192 2024-09-21T03:56:20.286 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4196864 len 8192 2024-09-21T03:56:20.286 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4196864 len 8192 2024-09-21T03:56:20.286 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4196864 len 16384 2024-09-21T03:56:20.286 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4196864 len 16384 2024-09-21T03:56:20.286 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4196864 len 16384 2024-09-21T03:56:20.286 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4196864 len 16384 2024-09-21T03:56:20.286 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4197376 len 1024 2024-09-21T03:56:20.286 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4197376 len 1024 2024-09-21T03:56:20.286 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4197376 len 1024 2024-09-21T03:56:20.287 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4197376 len 1024 2024-09-21T03:56:20.287 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4197376 len 2048 2024-09-21T03:56:20.287 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4197376 len 2048 2024-09-21T03:56:20.287 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4197376 len 2048 2024-09-21T03:56:20.287 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4197376 len 2048 2024-09-21T03:56:20.287 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4197376 len 4096 2024-09-21T03:56:20.287 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4197376 len 4096 2024-09-21T03:56:20.287 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4197376 len 4096 2024-09-21T03:56:20.287 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4197376 len 4096 2024-09-21T03:56:20.287 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4197376 len 8192 2024-09-21T03:56:20.287 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4197376 len 8192 2024-09-21T03:56:20.287 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4197376 len 8192 2024-09-21T03:56:20.287 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4197376 len 8192 2024-09-21T03:56:20.288 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4197376 len 16384 2024-09-21T03:56:20.288 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4197376 len 16384 2024-09-21T03:56:20.288 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4197376 len 16384 2024-09-21T03:56:20.288 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4197376 len 16384 2024-09-21T03:56:20.288 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4197888 len 1024 2024-09-21T03:56:20.288 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4197888 len 1024 2024-09-21T03:56:20.288 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4197888 len 1024 2024-09-21T03:56:20.288 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4197888 len 1024 2024-09-21T03:56:20.288 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4197888 len 2048 2024-09-21T03:56:20.288 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4197888 len 2048 2024-09-21T03:56:20.288 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4197888 len 2048 2024-09-21T03:56:20.288 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4197888 len 2048 2024-09-21T03:56:20.288 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4197888 len 4096 2024-09-21T03:56:20.288 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4197888 len 4096 2024-09-21T03:56:20.289 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4197888 len 4096 2024-09-21T03:56:20.299 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4197888 len 4096 2024-09-21T03:56:20.299 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4197888 len 8192 2024-09-21T03:56:20.299 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4197888 len 8192 2024-09-21T03:56:20.299 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4197888 len 8192 2024-09-21T03:56:20.299 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4197888 len 8192 2024-09-21T03:56:20.300 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2048 offset 4197888 len 16384 2024-09-21T03:56:20.300 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4197888 len 16384 2024-09-21T03:56:20.300 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2048 offset 4197888 len 16384 2024-09-21T03:56:20.300 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2048 offset 4197888 len 16384 2024-09-21T03:56:20.300 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4190208 len 1024 2024-09-21T03:56:20.300 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4190208 len 1024 2024-09-21T03:56:20.300 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4190208 len 1024 2024-09-21T03:56:20.300 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4190208 len 1024 2024-09-21T03:56:20.300 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4190208 len 2048 2024-09-21T03:56:20.300 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4190208 len 2048 2024-09-21T03:56:20.300 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4190208 len 2048 2024-09-21T03:56:20.300 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4190208 len 2048 2024-09-21T03:56:20.300 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4190208 len 4096 2024-09-21T03:56:20.300 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4190208 len 4096 2024-09-21T03:56:20.300 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4190208 len 4096 2024-09-21T03:56:20.300 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4190208 len 4096 2024-09-21T03:56:20.301 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4190208 len 8192 2024-09-21T03:56:20.301 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4190208 len 8192 2024-09-21T03:56:20.301 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4190208 len 8192 2024-09-21T03:56:20.301 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4190208 len 8192 2024-09-21T03:56:20.301 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4190208 len 16384 2024-09-21T03:56:20.301 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4190208 len 16384 2024-09-21T03:56:20.301 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4190208 len 16384 2024-09-21T03:56:20.301 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4190208 len 16384 2024-09-21T03:56:20.301 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4190720 len 1024 2024-09-21T03:56:20.301 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4190720 len 1024 2024-09-21T03:56:20.301 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4190720 len 1024 2024-09-21T03:56:20.301 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4190720 len 1024 2024-09-21T03:56:20.301 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4190720 len 2048 2024-09-21T03:56:20.301 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4190720 len 2048 2024-09-21T03:56:20.301 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4190720 len 2048 2024-09-21T03:56:20.302 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4190720 len 2048 2024-09-21T03:56:20.302 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4190720 len 4096 2024-09-21T03:56:20.302 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4190720 len 4096 2024-09-21T03:56:20.302 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4190720 len 4096 2024-09-21T03:56:20.302 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4190720 len 4096 2024-09-21T03:56:20.302 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4190720 len 8192 2024-09-21T03:56:20.302 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4190720 len 8192 2024-09-21T03:56:20.302 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4190720 len 8192 2024-09-21T03:56:20.302 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4190720 len 8192 2024-09-21T03:56:20.302 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4190720 len 16384 2024-09-21T03:56:20.302 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4190720 len 16384 2024-09-21T03:56:20.302 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4190720 len 16384 2024-09-21T03:56:20.302 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4190720 len 16384 2024-09-21T03:56:20.302 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4191232 len 1024 2024-09-21T03:56:20.302 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4191232 len 1024 2024-09-21T03:56:20.303 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4191232 len 1024 2024-09-21T03:56:20.303 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4191232 len 1024 2024-09-21T03:56:20.303 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4191232 len 2048 2024-09-21T03:56:20.303 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4191232 len 2048 2024-09-21T03:56:20.303 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4191232 len 2048 2024-09-21T03:56:20.303 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4191232 len 2048 2024-09-21T03:56:20.303 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4191232 len 4096 2024-09-21T03:56:20.303 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4191232 len 4096 2024-09-21T03:56:20.303 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4191232 len 4096 2024-09-21T03:56:20.303 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4191232 len 4096 2024-09-21T03:56:20.303 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4191232 len 8192 2024-09-21T03:56:20.303 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4191232 len 8192 2024-09-21T03:56:20.303 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4191232 len 8192 2024-09-21T03:56:20.303 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4191232 len 8192 2024-09-21T03:56:20.304 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4191232 len 16384 2024-09-21T03:56:20.304 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4191232 len 16384 2024-09-21T03:56:20.304 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4191232 len 16384 2024-09-21T03:56:20.304 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4191232 len 16384 2024-09-21T03:56:20.304 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4191744 len 1024 2024-09-21T03:56:20.304 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4191744 len 1024 2024-09-21T03:56:20.304 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4191744 len 1024 2024-09-21T03:56:20.304 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4191744 len 1024 2024-09-21T03:56:20.304 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4191744 len 2048 2024-09-21T03:56:20.304 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4191744 len 2048 2024-09-21T03:56:20.304 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4191744 len 2048 2024-09-21T03:56:20.304 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4191744 len 2048 2024-09-21T03:56:20.304 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4191744 len 4096 2024-09-21T03:56:20.304 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4191744 len 4096 2024-09-21T03:56:20.304 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4191744 len 4096 2024-09-21T03:56:20.305 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4191744 len 4096 2024-09-21T03:56:20.305 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4191744 len 8192 2024-09-21T03:56:20.323 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4191744 len 8192 2024-09-21T03:56:20.323 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4191744 len 8192 2024-09-21T03:56:20.323 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4191744 len 8192 2024-09-21T03:56:20.324 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4191744 len 16384 2024-09-21T03:56:20.324 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4191744 len 16384 2024-09-21T03:56:20.324 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4191744 len 16384 2024-09-21T03:56:20.324 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4191744 len 16384 2024-09-21T03:56:20.324 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4192256 len 1024 2024-09-21T03:56:20.324 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4192256 len 1024 2024-09-21T03:56:20.324 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4192256 len 1024 2024-09-21T03:56:20.324 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4192256 len 1024 2024-09-21T03:56:20.324 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4192256 len 2048 2024-09-21T03:56:20.324 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4192256 len 2048 2024-09-21T03:56:20.324 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4192256 len 2048 2024-09-21T03:56:20.324 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4192256 len 2048 2024-09-21T03:56:20.324 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4192256 len 4096 2024-09-21T03:56:20.324 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4192256 len 4096 2024-09-21T03:56:20.325 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4192256 len 4096 2024-09-21T03:56:20.325 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4192256 len 4096 2024-09-21T03:56:20.325 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4192256 len 8192 2024-09-21T03:56:20.325 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4192256 len 8192 2024-09-21T03:56:20.325 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4192256 len 8192 2024-09-21T03:56:20.325 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4192256 len 8192 2024-09-21T03:56:20.325 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4192256 len 16384 2024-09-21T03:56:20.325 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4192256 len 16384 2024-09-21T03:56:20.325 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4192256 len 16384 2024-09-21T03:56:20.325 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4192256 len 16384 2024-09-21T03:56:20.325 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4192768 len 1024 2024-09-21T03:56:20.325 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4192768 len 1024 2024-09-21T03:56:20.325 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4192768 len 1024 2024-09-21T03:56:20.325 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4192768 len 1024 2024-09-21T03:56:20.326 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4192768 len 2048 2024-09-21T03:56:20.326 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4192768 len 2048 2024-09-21T03:56:20.326 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4192768 len 2048 2024-09-21T03:56:20.326 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4192768 len 2048 2024-09-21T03:56:20.326 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4192768 len 4096 2024-09-21T03:56:20.326 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4192768 len 4096 2024-09-21T03:56:20.326 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4192768 len 4096 2024-09-21T03:56:20.326 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4192768 len 4096 2024-09-21T03:56:20.326 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4192768 len 8192 2024-09-21T03:56:20.326 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4192768 len 8192 2024-09-21T03:56:20.326 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4192768 len 8192 2024-09-21T03:56:20.326 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4192768 len 8192 2024-09-21T03:56:20.327 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4192768 len 16384 2024-09-21T03:56:20.327 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4192768 len 16384 2024-09-21T03:56:20.327 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4192768 len 16384 2024-09-21T03:56:20.327 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4192768 len 16384 2024-09-21T03:56:20.327 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4193280 len 1024 2024-09-21T03:56:20.327 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4193280 len 1024 2024-09-21T03:56:20.327 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4193280 len 1024 2024-09-21T03:56:20.327 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4193280 len 1024 2024-09-21T03:56:20.327 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4193280 len 2048 2024-09-21T03:56:20.327 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4193280 len 2048 2024-09-21T03:56:20.327 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4193280 len 2048 2024-09-21T03:56:20.327 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4193280 len 2048 2024-09-21T03:56:20.327 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4193280 len 4096 2024-09-21T03:56:20.327 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4193280 len 4096 2024-09-21T03:56:20.328 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4193280 len 4096 2024-09-21T03:56:20.328 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4193280 len 4096 2024-09-21T03:56:20.328 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4193280 len 8192 2024-09-21T03:56:20.328 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4193280 len 8192 2024-09-21T03:56:20.328 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4193280 len 8192 2024-09-21T03:56:20.328 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4193280 len 8192 2024-09-21T03:56:20.328 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4193280 len 16384 2024-09-21T03:56:20.328 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4193280 len 16384 2024-09-21T03:56:20.328 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4193280 len 16384 2024-09-21T03:56:20.328 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4193280 len 16384 2024-09-21T03:56:20.328 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4193792 len 1024 2024-09-21T03:56:20.328 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4193792 len 1024 2024-09-21T03:56:20.328 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4193792 len 1024 2024-09-21T03:56:20.328 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4193792 len 1024 2024-09-21T03:56:20.329 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4193792 len 2048 2024-09-21T03:56:20.329 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4193792 len 2048 2024-09-21T03:56:20.329 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4193792 len 2048 2024-09-21T03:56:20.329 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4193792 len 2048 2024-09-21T03:56:20.329 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4193792 len 4096 2024-09-21T03:56:20.329 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4193792 len 4096 2024-09-21T03:56:20.329 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4193792 len 4096 2024-09-21T03:56:20.329 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4193792 len 4096 2024-09-21T03:56:20.329 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4193792 len 8192 2024-09-21T03:56:20.329 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4193792 len 8192 2024-09-21T03:56:20.329 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4193792 len 8192 2024-09-21T03:56:20.329 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4193792 len 8192 2024-09-21T03:56:20.338 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4193792 len 16384 2024-09-21T03:56:20.338 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4193792 len 16384 2024-09-21T03:56:20.338 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4193792 len 16384 2024-09-21T03:56:20.338 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4193792 len 16384 2024-09-21T03:56:20.338 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4194304 len 1024 2024-09-21T03:56:20.338 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4194304 len 1024 2024-09-21T03:56:20.338 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4194304 len 1024 2024-09-21T03:56:20.338 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4194304 len 1024 2024-09-21T03:56:20.338 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4194304 len 2048 2024-09-21T03:56:20.338 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4194304 len 2048 2024-09-21T03:56:20.338 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4194304 len 2048 2024-09-21T03:56:20.338 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4194304 len 2048 2024-09-21T03:56:20.339 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4194304 len 4096 2024-09-21T03:56:20.339 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4194304 len 4096 2024-09-21T03:56:20.339 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4194304 len 4096 2024-09-21T03:56:20.339 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4194304 len 4096 2024-09-21T03:56:20.339 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4194304 len 8192 2024-09-21T03:56:20.339 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4194304 len 8192 2024-09-21T03:56:20.339 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4194304 len 8192 2024-09-21T03:56:20.339 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4194304 len 8192 2024-09-21T03:56:20.339 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4194304 len 16384 2024-09-21T03:56:20.339 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4194304 len 16384 2024-09-21T03:56:20.339 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4194304 len 16384 2024-09-21T03:56:20.339 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4194304 len 16384 2024-09-21T03:56:20.339 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4194816 len 1024 2024-09-21T03:56:20.340 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4194816 len 1024 2024-09-21T03:56:20.340 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4194816 len 1024 2024-09-21T03:56:20.340 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4194816 len 1024 2024-09-21T03:56:20.340 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4194816 len 2048 2024-09-21T03:56:20.340 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4194816 len 2048 2024-09-21T03:56:20.340 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4194816 len 2048 2024-09-21T03:56:20.340 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4194816 len 2048 2024-09-21T03:56:20.340 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4194816 len 4096 2024-09-21T03:56:20.340 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4194816 len 4096 2024-09-21T03:56:20.340 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4194816 len 4096 2024-09-21T03:56:20.340 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4194816 len 4096 2024-09-21T03:56:20.340 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4194816 len 8192 2024-09-21T03:56:20.340 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4194816 len 8192 2024-09-21T03:56:20.340 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4194816 len 8192 2024-09-21T03:56:20.341 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4194816 len 8192 2024-09-21T03:56:20.341 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4194816 len 16384 2024-09-21T03:56:20.341 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4194816 len 16384 2024-09-21T03:56:20.341 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4194816 len 16384 2024-09-21T03:56:20.341 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4194816 len 16384 2024-09-21T03:56:20.341 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4195328 len 1024 2024-09-21T03:56:20.341 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4195328 len 1024 2024-09-21T03:56:20.341 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4195328 len 1024 2024-09-21T03:56:20.341 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4195328 len 1024 2024-09-21T03:56:20.341 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4195328 len 2048 2024-09-21T03:56:20.341 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4195328 len 2048 2024-09-21T03:56:20.341 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4195328 len 2048 2024-09-21T03:56:20.341 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4195328 len 2048 2024-09-21T03:56:20.341 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4195328 len 4096 2024-09-21T03:56:20.341 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4195328 len 4096 2024-09-21T03:56:20.342 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4195328 len 4096 2024-09-21T03:56:20.342 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4195328 len 4096 2024-09-21T03:56:20.342 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4195328 len 8192 2024-09-21T03:56:20.342 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4195328 len 8192 2024-09-21T03:56:20.342 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4195328 len 8192 2024-09-21T03:56:20.342 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4195328 len 8192 2024-09-21T03:56:20.342 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4195328 len 16384 2024-09-21T03:56:20.342 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4195328 len 16384 2024-09-21T03:56:20.342 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4195328 len 16384 2024-09-21T03:56:20.342 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4195328 len 16384 2024-09-21T03:56:20.342 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4195840 len 1024 2024-09-21T03:56:20.342 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4195840 len 1024 2024-09-21T03:56:20.342 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4195840 len 1024 2024-09-21T03:56:20.342 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4195840 len 1024 2024-09-21T03:56:20.343 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4195840 len 2048 2024-09-21T03:56:20.343 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4195840 len 2048 2024-09-21T03:56:20.343 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4195840 len 2048 2024-09-21T03:56:20.343 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4195840 len 2048 2024-09-21T03:56:20.343 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4195840 len 4096 2024-09-21T03:56:20.343 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4195840 len 4096 2024-09-21T03:56:20.343 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4195840 len 4096 2024-09-21T03:56:20.343 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4195840 len 4096 2024-09-21T03:56:20.343 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4195840 len 8192 2024-09-21T03:56:20.343 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4195840 len 8192 2024-09-21T03:56:20.343 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4195840 len 8192 2024-09-21T03:56:20.343 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4195840 len 8192 2024-09-21T03:56:20.343 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4195840 len 16384 2024-09-21T03:56:20.344 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4195840 len 16384 2024-09-21T03:56:20.347 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4195840 len 16384 2024-09-21T03:56:20.347 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4195840 len 16384 2024-09-21T03:56:20.347 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4196352 len 1024 2024-09-21T03:56:20.347 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4196352 len 1024 2024-09-21T03:56:20.347 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4196352 len 1024 2024-09-21T03:56:20.347 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4196352 len 1024 2024-09-21T03:56:20.347 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4196352 len 2048 2024-09-21T03:56:20.347 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4196352 len 2048 2024-09-21T03:56:20.347 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4196352 len 2048 2024-09-21T03:56:20.347 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4196352 len 2048 2024-09-21T03:56:20.347 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4196352 len 4096 2024-09-21T03:56:20.347 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4196352 len 4096 2024-09-21T03:56:20.348 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4196352 len 4096 2024-09-21T03:56:20.348 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4196352 len 4096 2024-09-21T03:56:20.348 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4196352 len 8192 2024-09-21T03:56:20.348 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4196352 len 8192 2024-09-21T03:56:20.348 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4196352 len 8192 2024-09-21T03:56:20.348 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4196352 len 8192 2024-09-21T03:56:20.348 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4196352 len 16384 2024-09-21T03:56:20.348 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4196352 len 16384 2024-09-21T03:56:20.348 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4196352 len 16384 2024-09-21T03:56:20.348 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4196352 len 16384 2024-09-21T03:56:20.348 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4196864 len 1024 2024-09-21T03:56:20.348 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4196864 len 1024 2024-09-21T03:56:20.348 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4196864 len 1024 2024-09-21T03:56:20.348 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4196864 len 1024 2024-09-21T03:56:20.349 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4196864 len 2048 2024-09-21T03:56:20.349 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4196864 len 2048 2024-09-21T03:56:20.349 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4196864 len 2048 2024-09-21T03:56:20.349 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4196864 len 2048 2024-09-21T03:56:20.349 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4196864 len 4096 2024-09-21T03:56:20.349 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4196864 len 4096 2024-09-21T03:56:20.349 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4196864 len 4096 2024-09-21T03:56:20.349 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4196864 len 4096 2024-09-21T03:56:20.349 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4196864 len 8192 2024-09-21T03:56:20.349 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4196864 len 8192 2024-09-21T03:56:20.349 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4196864 len 8192 2024-09-21T03:56:20.349 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4196864 len 8192 2024-09-21T03:56:20.349 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4196864 len 16384 2024-09-21T03:56:20.349 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4196864 len 16384 2024-09-21T03:56:20.350 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4196864 len 16384 2024-09-21T03:56:20.350 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4196864 len 16384 2024-09-21T03:56:20.350 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4197376 len 1024 2024-09-21T03:56:20.350 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4197376 len 1024 2024-09-21T03:56:20.350 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4197376 len 1024 2024-09-21T03:56:20.350 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4197376 len 1024 2024-09-21T03:56:20.350 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4197376 len 2048 2024-09-21T03:56:20.350 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4197376 len 2048 2024-09-21T03:56:20.350 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4197376 len 2048 2024-09-21T03:56:20.350 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4197376 len 2048 2024-09-21T03:56:20.350 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4197376 len 4096 2024-09-21T03:56:20.350 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4197376 len 4096 2024-09-21T03:56:20.350 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4197376 len 4096 2024-09-21T03:56:20.351 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4197376 len 4096 2024-09-21T03:56:20.351 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4197376 len 8192 2024-09-21T03:56:20.351 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4197376 len 8192 2024-09-21T03:56:20.351 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4197376 len 8192 2024-09-21T03:56:20.351 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4197376 len 8192 2024-09-21T03:56:20.351 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4197376 len 16384 2024-09-21T03:56:20.351 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4197376 len 16384 2024-09-21T03:56:20.351 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4197376 len 16384 2024-09-21T03:56:20.351 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4197376 len 16384 2024-09-21T03:56:20.351 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4197888 len 1024 2024-09-21T03:56:20.351 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4197888 len 1024 2024-09-21T03:56:20.351 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4197888 len 1024 2024-09-21T03:56:20.351 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4197888 len 1024 2024-09-21T03:56:20.352 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4197888 len 2048 2024-09-21T03:56:20.352 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4197888 len 2048 2024-09-21T03:56:20.352 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4197888 len 2048 2024-09-21T03:56:20.352 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4197888 len 2048 2024-09-21T03:56:20.352 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4197888 len 4096 2024-09-21T03:56:20.352 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4197888 len 4096 2024-09-21T03:56:20.352 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4197888 len 4096 2024-09-21T03:56:20.352 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4197888 len 4096 2024-09-21T03:56:20.352 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4197888 len 8192 2024-09-21T03:56:20.352 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4197888 len 8192 2024-09-21T03:56:20.352 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4197888 len 8192 2024-09-21T03:56:20.352 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4197888 len 8192 2024-09-21T03:56:20.352 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 2560 offset 4197888 len 16384 2024-09-21T03:56:20.352 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4197888 len 16384 2024-09-21T03:56:20.353 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 2560 offset 4197888 len 16384 2024-09-21T03:56:20.353 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 2560 offset 4197888 len 16384 2024-09-21T03:56:20.364 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4190208 len 1024 2024-09-21T03:56:20.364 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4190208 len 1024 2024-09-21T03:56:20.364 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4190208 len 1024 2024-09-21T03:56:20.364 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4190208 len 1024 2024-09-21T03:56:20.364 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4190208 len 2048 2024-09-21T03:56:20.365 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4190208 len 2048 2024-09-21T03:56:20.365 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4190208 len 2048 2024-09-21T03:56:20.365 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4190208 len 2048 2024-09-21T03:56:20.365 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4190208 len 4096 2024-09-21T03:56:20.365 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4190208 len 4096 2024-09-21T03:56:20.365 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4190208 len 4096 2024-09-21T03:56:20.365 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4190208 len 4096 2024-09-21T03:56:20.365 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4190208 len 8192 2024-09-21T03:56:20.365 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4190208 len 8192 2024-09-21T03:56:20.365 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4190208 len 8192 2024-09-21T03:56:20.365 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4190208 len 8192 2024-09-21T03:56:20.365 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4190208 len 16384 2024-09-21T03:56:20.365 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4190208 len 16384 2024-09-21T03:56:20.365 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4190208 len 16384 2024-09-21T03:56:20.365 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4190208 len 16384 2024-09-21T03:56:20.366 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4190720 len 1024 2024-09-21T03:56:20.366 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4190720 len 1024 2024-09-21T03:56:20.366 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4190720 len 1024 2024-09-21T03:56:20.366 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4190720 len 1024 2024-09-21T03:56:20.366 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4190720 len 2048 2024-09-21T03:56:20.366 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4190720 len 2048 2024-09-21T03:56:20.366 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4190720 len 2048 2024-09-21T03:56:20.366 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4190720 len 2048 2024-09-21T03:56:20.366 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4190720 len 4096 2024-09-21T03:56:20.366 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4190720 len 4096 2024-09-21T03:56:20.366 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4190720 len 4096 2024-09-21T03:56:20.366 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4190720 len 4096 2024-09-21T03:56:20.366 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4190720 len 8192 2024-09-21T03:56:20.367 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4190720 len 8192 2024-09-21T03:56:20.367 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4190720 len 8192 2024-09-21T03:56:20.367 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4190720 len 8192 2024-09-21T03:56:20.367 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4190720 len 16384 2024-09-21T03:56:20.367 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4190720 len 16384 2024-09-21T03:56:20.367 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4190720 len 16384 2024-09-21T03:56:20.367 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4190720 len 16384 2024-09-21T03:56:20.367 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4191232 len 1024 2024-09-21T03:56:20.367 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4191232 len 1024 2024-09-21T03:56:20.367 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4191232 len 1024 2024-09-21T03:56:20.367 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4191232 len 1024 2024-09-21T03:56:20.367 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4191232 len 2048 2024-09-21T03:56:20.367 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4191232 len 2048 2024-09-21T03:56:20.367 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4191232 len 2048 2024-09-21T03:56:20.368 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4191232 len 2048 2024-09-21T03:56:20.368 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4191232 len 4096 2024-09-21T03:56:20.368 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4191232 len 4096 2024-09-21T03:56:20.368 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4191232 len 4096 2024-09-21T03:56:20.368 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4191232 len 4096 2024-09-21T03:56:20.368 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4191232 len 8192 2024-09-21T03:56:20.368 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4191232 len 8192 2024-09-21T03:56:20.368 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4191232 len 8192 2024-09-21T03:56:20.368 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4191232 len 8192 2024-09-21T03:56:20.368 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4191232 len 16384 2024-09-21T03:56:20.368 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4191232 len 16384 2024-09-21T03:56:20.368 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4191232 len 16384 2024-09-21T03:56:20.368 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4191232 len 16384 2024-09-21T03:56:20.368 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4191744 len 1024 2024-09-21T03:56:20.368 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4191744 len 1024 2024-09-21T03:56:20.369 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4191744 len 1024 2024-09-21T03:56:20.369 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4191744 len 1024 2024-09-21T03:56:20.369 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4191744 len 2048 2024-09-21T03:56:20.369 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4191744 len 2048 2024-09-21T03:56:20.369 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4191744 len 2048 2024-09-21T03:56:20.369 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4191744 len 2048 2024-09-21T03:56:20.369 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4191744 len 4096 2024-09-21T03:56:20.369 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4191744 len 4096 2024-09-21T03:56:20.369 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4191744 len 4096 2024-09-21T03:56:20.369 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4191744 len 4096 2024-09-21T03:56:20.369 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4191744 len 8192 2024-09-21T03:56:20.369 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4191744 len 8192 2024-09-21T03:56:20.369 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4191744 len 8192 2024-09-21T03:56:20.369 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4191744 len 8192 2024-09-21T03:56:20.370 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4191744 len 16384 2024-09-21T03:56:20.370 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4191744 len 16384 2024-09-21T03:56:20.370 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4191744 len 16384 2024-09-21T03:56:20.370 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4191744 len 16384 2024-09-21T03:56:20.370 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4192256 len 1024 2024-09-21T03:56:20.370 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4192256 len 1024 2024-09-21T03:56:20.370 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4192256 len 1024 2024-09-21T03:56:20.388 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4192256 len 1024 2024-09-21T03:56:20.388 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4192256 len 2048 2024-09-21T03:56:20.388 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4192256 len 2048 2024-09-21T03:56:20.388 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4192256 len 2048 2024-09-21T03:56:20.388 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4192256 len 2048 2024-09-21T03:56:20.388 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4192256 len 4096 2024-09-21T03:56:20.388 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4192256 len 4096 2024-09-21T03:56:20.388 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4192256 len 4096 2024-09-21T03:56:20.388 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4192256 len 4096 2024-09-21T03:56:20.388 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4192256 len 8192 2024-09-21T03:56:20.388 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4192256 len 8192 2024-09-21T03:56:20.388 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4192256 len 8192 2024-09-21T03:56:20.388 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4192256 len 8192 2024-09-21T03:56:20.389 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4192256 len 16384 2024-09-21T03:56:20.389 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4192256 len 16384 2024-09-21T03:56:20.389 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4192256 len 16384 2024-09-21T03:56:20.389 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4192256 len 16384 2024-09-21T03:56:20.389 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4192768 len 1024 2024-09-21T03:56:20.389 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4192768 len 1024 2024-09-21T03:56:20.389 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4192768 len 1024 2024-09-21T03:56:20.389 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4192768 len 1024 2024-09-21T03:56:20.389 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4192768 len 2048 2024-09-21T03:56:20.389 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4192768 len 2048 2024-09-21T03:56:20.389 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4192768 len 2048 2024-09-21T03:56:20.389 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4192768 len 2048 2024-09-21T03:56:20.389 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4192768 len 4096 2024-09-21T03:56:20.389 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4192768 len 4096 2024-09-21T03:56:20.390 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4192768 len 4096 2024-09-21T03:56:20.390 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4192768 len 4096 2024-09-21T03:56:20.390 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4192768 len 8192 2024-09-21T03:56:20.390 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4192768 len 8192 2024-09-21T03:56:20.390 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4192768 len 8192 2024-09-21T03:56:20.390 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4192768 len 8192 2024-09-21T03:56:20.390 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4192768 len 16384 2024-09-21T03:56:20.390 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4192768 len 16384 2024-09-21T03:56:20.390 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4192768 len 16384 2024-09-21T03:56:20.390 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4192768 len 16384 2024-09-21T03:56:20.390 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4193280 len 1024 2024-09-21T03:56:20.390 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4193280 len 1024 2024-09-21T03:56:20.390 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4193280 len 1024 2024-09-21T03:56:20.390 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4193280 len 1024 2024-09-21T03:56:20.391 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4193280 len 2048 2024-09-21T03:56:20.391 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4193280 len 2048 2024-09-21T03:56:20.391 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4193280 len 2048 2024-09-21T03:56:20.391 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4193280 len 2048 2024-09-21T03:56:20.391 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4193280 len 4096 2024-09-21T03:56:20.391 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4193280 len 4096 2024-09-21T03:56:20.391 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4193280 len 4096 2024-09-21T03:56:20.391 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4193280 len 4096 2024-09-21T03:56:20.391 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4193280 len 8192 2024-09-21T03:56:20.391 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4193280 len 8192 2024-09-21T03:56:20.391 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4193280 len 8192 2024-09-21T03:56:20.391 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4193280 len 8192 2024-09-21T03:56:20.391 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4193280 len 16384 2024-09-21T03:56:20.391 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4193280 len 16384 2024-09-21T03:56:20.392 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4193280 len 16384 2024-09-21T03:56:20.392 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4193280 len 16384 2024-09-21T03:56:20.392 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4193792 len 1024 2024-09-21T03:56:20.392 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4193792 len 1024 2024-09-21T03:56:20.392 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4193792 len 1024 2024-09-21T03:56:20.392 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4193792 len 1024 2024-09-21T03:56:20.392 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4193792 len 2048 2024-09-21T03:56:20.392 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4193792 len 2048 2024-09-21T03:56:20.392 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4193792 len 2048 2024-09-21T03:56:20.392 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4193792 len 2048 2024-09-21T03:56:20.392 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4193792 len 4096 2024-09-21T03:56:20.392 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4193792 len 4096 2024-09-21T03:56:20.392 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4193792 len 4096 2024-09-21T03:56:20.392 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4193792 len 4096 2024-09-21T03:56:20.392 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4193792 len 8192 2024-09-21T03:56:20.393 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4193792 len 8192 2024-09-21T03:56:20.393 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4193792 len 8192 2024-09-21T03:56:20.393 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4193792 len 8192 2024-09-21T03:56:20.393 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4193792 len 16384 2024-09-21T03:56:20.393 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4193792 len 16384 2024-09-21T03:56:20.393 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4193792 len 16384 2024-09-21T03:56:20.393 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4193792 len 16384 2024-09-21T03:56:20.393 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4194304 len 1024 2024-09-21T03:56:20.393 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4194304 len 1024 2024-09-21T03:56:20.393 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4194304 len 1024 2024-09-21T03:56:20.393 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4194304 len 1024 2024-09-21T03:56:20.393 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4194304 len 2048 2024-09-21T03:56:20.397 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4194304 len 2048 2024-09-21T03:56:20.397 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4194304 len 2048 2024-09-21T03:56:20.397 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4194304 len 2048 2024-09-21T03:56:20.397 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4194304 len 4096 2024-09-21T03:56:20.397 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4194304 len 4096 2024-09-21T03:56:20.397 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4194304 len 4096 2024-09-21T03:56:20.397 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4194304 len 4096 2024-09-21T03:56:20.397 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4194304 len 8192 2024-09-21T03:56:20.397 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4194304 len 8192 2024-09-21T03:56:20.397 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4194304 len 8192 2024-09-21T03:56:20.398 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4194304 len 8192 2024-09-21T03:56:20.398 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4194304 len 16384 2024-09-21T03:56:20.398 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4194304 len 16384 2024-09-21T03:56:20.398 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4194304 len 16384 2024-09-21T03:56:20.398 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4194304 len 16384 2024-09-21T03:56:20.398 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4194816 len 1024 2024-09-21T03:56:20.398 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4194816 len 1024 2024-09-21T03:56:20.398 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4194816 len 1024 2024-09-21T03:56:20.398 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4194816 len 1024 2024-09-21T03:56:20.398 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4194816 len 2048 2024-09-21T03:56:20.398 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4194816 len 2048 2024-09-21T03:56:20.398 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4194816 len 2048 2024-09-21T03:56:20.398 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4194816 len 2048 2024-09-21T03:56:20.399 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4194816 len 4096 2024-09-21T03:56:20.399 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4194816 len 4096 2024-09-21T03:56:20.399 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4194816 len 4096 2024-09-21T03:56:20.399 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4194816 len 4096 2024-09-21T03:56:20.399 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4194816 len 8192 2024-09-21T03:56:20.399 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4194816 len 8192 2024-09-21T03:56:20.399 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4194816 len 8192 2024-09-21T03:56:20.399 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4194816 len 8192 2024-09-21T03:56:20.399 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4194816 len 16384 2024-09-21T03:56:20.399 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4194816 len 16384 2024-09-21T03:56:20.399 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4194816 len 16384 2024-09-21T03:56:20.399 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4194816 len 16384 2024-09-21T03:56:20.399 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4195328 len 1024 2024-09-21T03:56:20.400 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4195328 len 1024 2024-09-21T03:56:20.400 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4195328 len 1024 2024-09-21T03:56:20.400 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4195328 len 1024 2024-09-21T03:56:20.400 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4195328 len 2048 2024-09-21T03:56:20.400 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4195328 len 2048 2024-09-21T03:56:20.400 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4195328 len 2048 2024-09-21T03:56:20.400 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4195328 len 2048 2024-09-21T03:56:20.400 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4195328 len 4096 2024-09-21T03:56:20.400 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4195328 len 4096 2024-09-21T03:56:20.400 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4195328 len 4096 2024-09-21T03:56:20.400 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4195328 len 4096 2024-09-21T03:56:20.400 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4195328 len 8192 2024-09-21T03:56:20.400 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4195328 len 8192 2024-09-21T03:56:20.400 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4195328 len 8192 2024-09-21T03:56:20.401 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4195328 len 8192 2024-09-21T03:56:20.401 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4195328 len 16384 2024-09-21T03:56:20.401 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4195328 len 16384 2024-09-21T03:56:20.401 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4195328 len 16384 2024-09-21T03:56:20.401 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4195328 len 16384 2024-09-21T03:56:20.401 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4195840 len 1024 2024-09-21T03:56:20.401 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4195840 len 1024 2024-09-21T03:56:20.401 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4195840 len 1024 2024-09-21T03:56:20.401 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4195840 len 1024 2024-09-21T03:56:20.401 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4195840 len 2048 2024-09-21T03:56:20.401 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4195840 len 2048 2024-09-21T03:56:20.401 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4195840 len 2048 2024-09-21T03:56:20.401 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4195840 len 2048 2024-09-21T03:56:20.401 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4195840 len 4096 2024-09-21T03:56:20.401 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4195840 len 4096 2024-09-21T03:56:20.402 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4195840 len 4096 2024-09-21T03:56:20.402 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4195840 len 4096 2024-09-21T03:56:20.402 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4195840 len 8192 2024-09-21T03:56:20.402 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4195840 len 8192 2024-09-21T03:56:20.402 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4195840 len 8192 2024-09-21T03:56:20.402 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4195840 len 8192 2024-09-21T03:56:20.402 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4195840 len 16384 2024-09-21T03:56:20.402 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4195840 len 16384 2024-09-21T03:56:20.402 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4195840 len 16384 2024-09-21T03:56:20.402 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4195840 len 16384 2024-09-21T03:56:20.402 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4196352 len 1024 2024-09-21T03:56:20.402 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4196352 len 1024 2024-09-21T03:56:20.402 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4196352 len 1024 2024-09-21T03:56:20.402 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4196352 len 1024 2024-09-21T03:56:20.403 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4196352 len 2048 2024-09-21T03:56:20.403 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4196352 len 2048 2024-09-21T03:56:20.403 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4196352 len 2048 2024-09-21T03:56:20.403 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4196352 len 2048 2024-09-21T03:56:20.407 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4196352 len 4096 2024-09-21T03:56:20.407 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4196352 len 4096 2024-09-21T03:56:20.407 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4196352 len 4096 2024-09-21T03:56:20.408 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4196352 len 4096 2024-09-21T03:56:20.408 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4196352 len 8192 2024-09-21T03:56:20.408 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4196352 len 8192 2024-09-21T03:56:20.408 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4196352 len 8192 2024-09-21T03:56:20.408 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4196352 len 8192 2024-09-21T03:56:20.408 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4196352 len 16384 2024-09-21T03:56:20.408 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4196352 len 16384 2024-09-21T03:56:20.408 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4196352 len 16384 2024-09-21T03:56:20.408 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4196352 len 16384 2024-09-21T03:56:20.408 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4196864 len 1024 2024-09-21T03:56:20.408 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4196864 len 1024 2024-09-21T03:56:20.408 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4196864 len 1024 2024-09-21T03:56:20.408 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4196864 len 1024 2024-09-21T03:56:20.409 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4196864 len 2048 2024-09-21T03:56:20.409 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4196864 len 2048 2024-09-21T03:56:20.409 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4196864 len 2048 2024-09-21T03:56:20.409 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4196864 len 2048 2024-09-21T03:56:20.409 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4196864 len 4096 2024-09-21T03:56:20.409 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4196864 len 4096 2024-09-21T03:56:20.409 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4196864 len 4096 2024-09-21T03:56:20.409 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4196864 len 4096 2024-09-21T03:56:20.409 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4196864 len 8192 2024-09-21T03:56:20.409 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4196864 len 8192 2024-09-21T03:56:20.409 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4196864 len 8192 2024-09-21T03:56:20.409 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4196864 len 8192 2024-09-21T03:56:20.409 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4196864 len 16384 2024-09-21T03:56:20.409 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4196864 len 16384 2024-09-21T03:56:20.410 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4196864 len 16384 2024-09-21T03:56:20.410 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4196864 len 16384 2024-09-21T03:56:20.410 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4197376 len 1024 2024-09-21T03:56:20.410 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4197376 len 1024 2024-09-21T03:56:20.410 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4197376 len 1024 2024-09-21T03:56:20.410 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4197376 len 1024 2024-09-21T03:56:20.410 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4197376 len 2048 2024-09-21T03:56:20.410 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4197376 len 2048 2024-09-21T03:56:20.410 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4197376 len 2048 2024-09-21T03:56:20.410 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4197376 len 2048 2024-09-21T03:56:20.410 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4197376 len 4096 2024-09-21T03:56:20.410 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4197376 len 4096 2024-09-21T03:56:20.410 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4197376 len 4096 2024-09-21T03:56:20.411 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4197376 len 4096 2024-09-21T03:56:20.411 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4197376 len 8192 2024-09-21T03:56:20.411 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4197376 len 8192 2024-09-21T03:56:20.411 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4197376 len 8192 2024-09-21T03:56:20.411 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4197376 len 8192 2024-09-21T03:56:20.411 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4197376 len 16384 2024-09-21T03:56:20.411 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4197376 len 16384 2024-09-21T03:56:20.411 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4197376 len 16384 2024-09-21T03:56:20.411 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4197376 len 16384 2024-09-21T03:56:20.411 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4197888 len 1024 2024-09-21T03:56:20.411 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4197888 len 1024 2024-09-21T03:56:20.411 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4197888 len 1024 2024-09-21T03:56:20.411 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4197888 len 1024 2024-09-21T03:56:20.411 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4197888 len 2048 2024-09-21T03:56:20.411 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4197888 len 2048 2024-09-21T03:56:20.412 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4197888 len 2048 2024-09-21T03:56:20.412 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4197888 len 2048 2024-09-21T03:56:20.412 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4197888 len 4096 2024-09-21T03:56:20.412 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4197888 len 4096 2024-09-21T03:56:20.412 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4197888 len 4096 2024-09-21T03:56:20.412 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4197888 len 4096 2024-09-21T03:56:20.412 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4197888 len 8192 2024-09-21T03:56:20.412 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4197888 len 8192 2024-09-21T03:56:20.412 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4197888 len 8192 2024-09-21T03:56:20.412 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4197888 len 8192 2024-09-21T03:56:20.412 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3072 offset 4197888 len 16384 2024-09-21T03:56:20.412 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4197888 len 16384 2024-09-21T03:56:20.412 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3072 offset 4197888 len 16384 2024-09-21T03:56:20.412 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3072 offset 4197888 len 16384 2024-09-21T03:56:20.412 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4190208 len 1024 2024-09-21T03:56:20.413 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4190208 len 1024 2024-09-21T03:56:20.413 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4190208 len 1024 2024-09-21T03:56:20.413 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4190208 len 1024 2024-09-21T03:56:20.413 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4190208 len 2048 2024-09-21T03:56:20.413 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4190208 len 2048 2024-09-21T03:56:20.413 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4190208 len 2048 2024-09-21T03:56:20.413 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4190208 len 2048 2024-09-21T03:56:20.413 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4190208 len 4096 2024-09-21T03:56:20.413 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4190208 len 4096 2024-09-21T03:56:20.427 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4190208 len 4096 2024-09-21T03:56:20.427 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4190208 len 4096 2024-09-21T03:56:20.427 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4190208 len 8192 2024-09-21T03:56:20.427 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4190208 len 8192 2024-09-21T03:56:20.427 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4190208 len 8192 2024-09-21T03:56:20.427 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4190208 len 8192 2024-09-21T03:56:20.427 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4190208 len 16384 2024-09-21T03:56:20.427 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4190208 len 16384 2024-09-21T03:56:20.427 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4190208 len 16384 2024-09-21T03:56:20.427 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4190208 len 16384 2024-09-21T03:56:20.428 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4190720 len 1024 2024-09-21T03:56:20.428 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4190720 len 1024 2024-09-21T03:56:20.428 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4190720 len 1024 2024-09-21T03:56:20.428 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4190720 len 1024 2024-09-21T03:56:20.428 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4190720 len 2048 2024-09-21T03:56:20.428 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4190720 len 2048 2024-09-21T03:56:20.428 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4190720 len 2048 2024-09-21T03:56:20.428 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4190720 len 2048 2024-09-21T03:56:20.428 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4190720 len 4096 2024-09-21T03:56:20.428 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4190720 len 4096 2024-09-21T03:56:20.428 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4190720 len 4096 2024-09-21T03:56:20.428 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4190720 len 4096 2024-09-21T03:56:20.428 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4190720 len 8192 2024-09-21T03:56:20.428 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4190720 len 8192 2024-09-21T03:56:20.429 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4190720 len 8192 2024-09-21T03:56:20.429 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4190720 len 8192 2024-09-21T03:56:20.429 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4190720 len 16384 2024-09-21T03:56:20.429 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4190720 len 16384 2024-09-21T03:56:20.429 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4190720 len 16384 2024-09-21T03:56:20.429 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4190720 len 16384 2024-09-21T03:56:20.429 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4191232 len 1024 2024-09-21T03:56:20.429 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4191232 len 1024 2024-09-21T03:56:20.429 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4191232 len 1024 2024-09-21T03:56:20.429 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4191232 len 1024 2024-09-21T03:56:20.429 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4191232 len 2048 2024-09-21T03:56:20.429 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4191232 len 2048 2024-09-21T03:56:20.429 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4191232 len 2048 2024-09-21T03:56:20.430 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4191232 len 2048 2024-09-21T03:56:20.430 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4191232 len 4096 2024-09-21T03:56:20.430 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4191232 len 4096 2024-09-21T03:56:20.430 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4191232 len 4096 2024-09-21T03:56:20.430 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4191232 len 4096 2024-09-21T03:56:20.430 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4191232 len 8192 2024-09-21T03:56:20.430 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4191232 len 8192 2024-09-21T03:56:20.430 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4191232 len 8192 2024-09-21T03:56:20.430 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4191232 len 8192 2024-09-21T03:56:20.430 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4191232 len 16384 2024-09-21T03:56:20.430 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4191232 len 16384 2024-09-21T03:56:20.430 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4191232 len 16384 2024-09-21T03:56:20.430 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4191232 len 16384 2024-09-21T03:56:20.431 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4191744 len 1024 2024-09-21T03:56:20.431 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4191744 len 1024 2024-09-21T03:56:20.431 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4191744 len 1024 2024-09-21T03:56:20.431 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4191744 len 1024 2024-09-21T03:56:20.431 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4191744 len 2048 2024-09-21T03:56:20.431 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4191744 len 2048 2024-09-21T03:56:20.431 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4191744 len 2048 2024-09-21T03:56:20.431 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4191744 len 2048 2024-09-21T03:56:20.431 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4191744 len 4096 2024-09-21T03:56:20.431 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4191744 len 4096 2024-09-21T03:56:20.431 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4191744 len 4096 2024-09-21T03:56:20.432 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4191744 len 4096 2024-09-21T03:56:20.432 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4191744 len 8192 2024-09-21T03:56:20.432 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4191744 len 8192 2024-09-21T03:56:20.432 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4191744 len 8192 2024-09-21T03:56:20.432 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4191744 len 8192 2024-09-21T03:56:20.432 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4191744 len 16384 2024-09-21T03:56:20.432 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4191744 len 16384 2024-09-21T03:56:20.432 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4191744 len 16384 2024-09-21T03:56:20.432 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4191744 len 16384 2024-09-21T03:56:20.432 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4192256 len 1024 2024-09-21T03:56:20.432 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4192256 len 1024 2024-09-21T03:56:20.432 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4192256 len 1024 2024-09-21T03:56:20.432 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4192256 len 1024 2024-09-21T03:56:20.432 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4192256 len 2048 2024-09-21T03:56:20.433 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4192256 len 2048 2024-09-21T03:56:20.433 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4192256 len 2048 2024-09-21T03:56:20.433 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4192256 len 2048 2024-09-21T03:56:20.433 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4192256 len 4096 2024-09-21T03:56:20.433 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4192256 len 4096 2024-09-21T03:56:20.433 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4192256 len 4096 2024-09-21T03:56:20.433 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4192256 len 4096 2024-09-21T03:56:20.433 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4192256 len 8192 2024-09-21T03:56:20.446 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4192256 len 8192 2024-09-21T03:56:20.447 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4192256 len 8192 2024-09-21T03:56:20.447 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4192256 len 8192 2024-09-21T03:56:20.447 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4192256 len 16384 2024-09-21T03:56:20.447 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4192256 len 16384 2024-09-21T03:56:20.447 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4192256 len 16384 2024-09-21T03:56:20.447 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4192256 len 16384 2024-09-21T03:56:20.447 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4192768 len 1024 2024-09-21T03:56:20.447 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4192768 len 1024 2024-09-21T03:56:20.447 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4192768 len 1024 2024-09-21T03:56:20.447 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4192768 len 1024 2024-09-21T03:56:20.447 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4192768 len 2048 2024-09-21T03:56:20.447 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4192768 len 2048 2024-09-21T03:56:20.447 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4192768 len 2048 2024-09-21T03:56:20.447 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4192768 len 2048 2024-09-21T03:56:20.448 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4192768 len 4096 2024-09-21T03:56:20.448 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4192768 len 4096 2024-09-21T03:56:20.448 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4192768 len 4096 2024-09-21T03:56:20.448 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4192768 len 4096 2024-09-21T03:56:20.448 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4192768 len 8192 2024-09-21T03:56:20.448 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4192768 len 8192 2024-09-21T03:56:20.448 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4192768 len 8192 2024-09-21T03:56:20.448 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4192768 len 8192 2024-09-21T03:56:20.448 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4192768 len 16384 2024-09-21T03:56:20.448 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4192768 len 16384 2024-09-21T03:56:20.448 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4192768 len 16384 2024-09-21T03:56:20.448 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4192768 len 16384 2024-09-21T03:56:20.448 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4193280 len 1024 2024-09-21T03:56:20.448 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4193280 len 1024 2024-09-21T03:56:20.448 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4193280 len 1024 2024-09-21T03:56:20.448 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4193280 len 1024 2024-09-21T03:56:20.449 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4193280 len 2048 2024-09-21T03:56:20.449 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4193280 len 2048 2024-09-21T03:56:20.449 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4193280 len 2048 2024-09-21T03:56:20.449 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4193280 len 2048 2024-09-21T03:56:20.449 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4193280 len 4096 2024-09-21T03:56:20.449 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4193280 len 4096 2024-09-21T03:56:20.449 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4193280 len 4096 2024-09-21T03:56:20.449 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4193280 len 4096 2024-09-21T03:56:20.449 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4193280 len 8192 2024-09-21T03:56:20.449 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4193280 len 8192 2024-09-21T03:56:20.449 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4193280 len 8192 2024-09-21T03:56:20.449 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4193280 len 8192 2024-09-21T03:56:20.449 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4193280 len 16384 2024-09-21T03:56:20.449 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4193280 len 16384 2024-09-21T03:56:20.449 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4193280 len 16384 2024-09-21T03:56:20.450 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4193280 len 16384 2024-09-21T03:56:20.450 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4193792 len 1024 2024-09-21T03:56:20.450 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4193792 len 1024 2024-09-21T03:56:20.450 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4193792 len 1024 2024-09-21T03:56:20.450 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4193792 len 1024 2024-09-21T03:56:20.450 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4193792 len 2048 2024-09-21T03:56:20.450 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4193792 len 2048 2024-09-21T03:56:20.450 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4193792 len 2048 2024-09-21T03:56:20.450 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4193792 len 2048 2024-09-21T03:56:20.450 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4193792 len 4096 2024-09-21T03:56:20.450 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4193792 len 4096 2024-09-21T03:56:20.450 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4193792 len 4096 2024-09-21T03:56:20.450 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4193792 len 4096 2024-09-21T03:56:20.450 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4193792 len 8192 2024-09-21T03:56:20.451 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4193792 len 8192 2024-09-21T03:56:20.451 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4193792 len 8192 2024-09-21T03:56:20.451 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4193792 len 8192 2024-09-21T03:56:20.451 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4193792 len 16384 2024-09-21T03:56:20.451 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4193792 len 16384 2024-09-21T03:56:20.451 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4193792 len 16384 2024-09-21T03:56:20.451 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4193792 len 16384 2024-09-21T03:56:20.451 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4194304 len 1024 2024-09-21T03:56:20.451 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4194304 len 1024 2024-09-21T03:56:20.451 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4194304 len 1024 2024-09-21T03:56:20.451 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4194304 len 1024 2024-09-21T03:56:20.451 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4194304 len 2048 2024-09-21T03:56:20.451 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4194304 len 2048 2024-09-21T03:56:20.451 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4194304 len 2048 2024-09-21T03:56:20.451 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4194304 len 2048 2024-09-21T03:56:20.452 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4194304 len 4096 2024-09-21T03:56:20.452 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4194304 len 4096 2024-09-21T03:56:20.452 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4194304 len 4096 2024-09-21T03:56:20.452 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4194304 len 4096 2024-09-21T03:56:20.452 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4194304 len 8192 2024-09-21T03:56:20.452 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4194304 len 8192 2024-09-21T03:56:20.452 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4194304 len 8192 2024-09-21T03:56:20.456 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4194304 len 8192 2024-09-21T03:56:20.456 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4194304 len 16384 2024-09-21T03:56:20.456 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4194304 len 16384 2024-09-21T03:56:20.456 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4194304 len 16384 2024-09-21T03:56:20.456 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4194304 len 16384 2024-09-21T03:56:20.456 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4194816 len 1024 2024-09-21T03:56:20.456 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4194816 len 1024 2024-09-21T03:56:20.456 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4194816 len 1024 2024-09-21T03:56:20.456 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4194816 len 1024 2024-09-21T03:56:20.457 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4194816 len 2048 2024-09-21T03:56:20.457 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4194816 len 2048 2024-09-21T03:56:20.457 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4194816 len 2048 2024-09-21T03:56:20.457 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4194816 len 2048 2024-09-21T03:56:20.457 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4194816 len 4096 2024-09-21T03:56:20.457 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4194816 len 4096 2024-09-21T03:56:20.457 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4194816 len 4096 2024-09-21T03:56:20.457 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4194816 len 4096 2024-09-21T03:56:20.457 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4194816 len 8192 2024-09-21T03:56:20.457 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4194816 len 8192 2024-09-21T03:56:20.457 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4194816 len 8192 2024-09-21T03:56:20.457 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4194816 len 8192 2024-09-21T03:56:20.457 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4194816 len 16384 2024-09-21T03:56:20.457 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4194816 len 16384 2024-09-21T03:56:20.457 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4194816 len 16384 2024-09-21T03:56:20.458 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4194816 len 16384 2024-09-21T03:56:20.458 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4195328 len 1024 2024-09-21T03:56:20.458 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4195328 len 1024 2024-09-21T03:56:20.458 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4195328 len 1024 2024-09-21T03:56:20.458 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4195328 len 1024 2024-09-21T03:56:20.458 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4195328 len 2048 2024-09-21T03:56:20.458 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4195328 len 2048 2024-09-21T03:56:20.458 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4195328 len 2048 2024-09-21T03:56:20.458 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4195328 len 2048 2024-09-21T03:56:20.458 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4195328 len 4096 2024-09-21T03:56:20.458 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4195328 len 4096 2024-09-21T03:56:20.458 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4195328 len 4096 2024-09-21T03:56:20.458 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4195328 len 4096 2024-09-21T03:56:20.459 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4195328 len 8192 2024-09-21T03:56:20.459 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4195328 len 8192 2024-09-21T03:56:20.459 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4195328 len 8192 2024-09-21T03:56:20.459 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4195328 len 8192 2024-09-21T03:56:20.459 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4195328 len 16384 2024-09-21T03:56:20.459 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4195328 len 16384 2024-09-21T03:56:20.459 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4195328 len 16384 2024-09-21T03:56:20.459 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4195328 len 16384 2024-09-21T03:56:20.459 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4195840 len 1024 2024-09-21T03:56:20.459 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4195840 len 1024 2024-09-21T03:56:20.459 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4195840 len 1024 2024-09-21T03:56:20.459 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4195840 len 1024 2024-09-21T03:56:20.459 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4195840 len 2048 2024-09-21T03:56:20.459 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4195840 len 2048 2024-09-21T03:56:20.460 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4195840 len 2048 2024-09-21T03:56:20.460 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4195840 len 2048 2024-09-21T03:56:20.460 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4195840 len 4096 2024-09-21T03:56:20.460 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4195840 len 4096 2024-09-21T03:56:20.460 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4195840 len 4096 2024-09-21T03:56:20.460 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4195840 len 4096 2024-09-21T03:56:20.460 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4195840 len 8192 2024-09-21T03:56:20.460 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4195840 len 8192 2024-09-21T03:56:20.460 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4195840 len 8192 2024-09-21T03:56:20.460 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4195840 len 8192 2024-09-21T03:56:20.460 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4195840 len 16384 2024-09-21T03:56:20.460 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4195840 len 16384 2024-09-21T03:56:20.460 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4195840 len 16384 2024-09-21T03:56:20.460 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4195840 len 16384 2024-09-21T03:56:20.460 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4196352 len 1024 2024-09-21T03:56:20.461 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4196352 len 1024 2024-09-21T03:56:20.461 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4196352 len 1024 2024-09-21T03:56:20.461 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4196352 len 1024 2024-09-21T03:56:20.461 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4196352 len 2048 2024-09-21T03:56:20.461 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4196352 len 2048 2024-09-21T03:56:20.461 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4196352 len 2048 2024-09-21T03:56:20.461 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4196352 len 2048 2024-09-21T03:56:20.461 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4196352 len 4096 2024-09-21T03:56:20.461 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4196352 len 4096 2024-09-21T03:56:20.461 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4196352 len 4096 2024-09-21T03:56:20.461 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4196352 len 4096 2024-09-21T03:56:20.461 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4196352 len 8192 2024-09-21T03:56:20.461 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4196352 len 8192 2024-09-21T03:56:20.462 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4196352 len 8192 2024-09-21T03:56:20.462 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4196352 len 8192 2024-09-21T03:56:20.462 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4196352 len 16384 2024-09-21T03:56:20.609 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4196352 len 16384 2024-09-21T03:56:20.609 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4196352 len 16384 2024-09-21T03:56:20.609 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4196352 len 16384 2024-09-21T03:56:20.609 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4196864 len 1024 2024-09-21T03:56:20.609 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4196864 len 1024 2024-09-21T03:56:20.609 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4196864 len 1024 2024-09-21T03:56:20.609 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4196864 len 1024 2024-09-21T03:56:20.609 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4196864 len 2048 2024-09-21T03:56:20.609 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4196864 len 2048 2024-09-21T03:56:20.610 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4196864 len 2048 2024-09-21T03:56:20.610 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4196864 len 2048 2024-09-21T03:56:20.610 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4196864 len 4096 2024-09-21T03:56:20.610 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4196864 len 4096 2024-09-21T03:56:20.610 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4196864 len 4096 2024-09-21T03:56:20.610 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4196864 len 4096 2024-09-21T03:56:20.610 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4196864 len 8192 2024-09-21T03:56:20.610 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4196864 len 8192 2024-09-21T03:56:20.610 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4196864 len 8192 2024-09-21T03:56:20.610 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4196864 len 8192 2024-09-21T03:56:20.610 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4196864 len 16384 2024-09-21T03:56:20.610 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4196864 len 16384 2024-09-21T03:56:20.610 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4196864 len 16384 2024-09-21T03:56:20.610 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4196864 len 16384 2024-09-21T03:56:20.611 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4197376 len 1024 2024-09-21T03:56:20.611 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4197376 len 1024 2024-09-21T03:56:20.611 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4197376 len 1024 2024-09-21T03:56:20.611 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4197376 len 1024 2024-09-21T03:56:20.611 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4197376 len 2048 2024-09-21T03:56:20.611 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4197376 len 2048 2024-09-21T03:56:20.611 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4197376 len 2048 2024-09-21T03:56:20.611 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4197376 len 2048 2024-09-21T03:56:20.611 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4197376 len 4096 2024-09-21T03:56:20.611 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4197376 len 4096 2024-09-21T03:56:20.611 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4197376 len 4096 2024-09-21T03:56:20.611 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4197376 len 4096 2024-09-21T03:56:20.611 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4197376 len 8192 2024-09-21T03:56:20.611 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4197376 len 8192 2024-09-21T03:56:20.611 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4197376 len 8192 2024-09-21T03:56:20.612 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4197376 len 8192 2024-09-21T03:56:20.612 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4197376 len 16384 2024-09-21T03:56:20.612 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4197376 len 16384 2024-09-21T03:56:20.612 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4197376 len 16384 2024-09-21T03:56:20.612 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4197376 len 16384 2024-09-21T03:56:20.612 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4197888 len 1024 2024-09-21T03:56:20.612 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4197888 len 1024 2024-09-21T03:56:20.612 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4197888 len 1024 2024-09-21T03:56:20.612 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4197888 len 1024 2024-09-21T03:56:20.612 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4197888 len 2048 2024-09-21T03:56:20.612 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4197888 len 2048 2024-09-21T03:56:20.612 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4197888 len 2048 2024-09-21T03:56:20.612 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4197888 len 2048 2024-09-21T03:56:20.612 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4197888 len 4096 2024-09-21T03:56:20.612 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4197888 len 4096 2024-09-21T03:56:20.613 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4197888 len 4096 2024-09-21T03:56:20.613 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4197888 len 4096 2024-09-21T03:56:20.613 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4197888 len 8192 2024-09-21T03:56:20.613 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4197888 len 8192 2024-09-21T03:56:20.613 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4197888 len 8192 2024-09-21T03:56:20.613 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4197888 len 8192 2024-09-21T03:56:20.613 INFO:tasks.workunit.client.0.smithi046.stdout:read_direct buf_align 3584 offset 4197888 len 16384 2024-09-21T03:56:20.613 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4197888 len 16384 2024-09-21T03:56:20.613 INFO:tasks.workunit.client.0.smithi046.stdout:read_sync buf_align 3584 offset 4197888 len 16384 2024-09-21T03:56:20.613 INFO:tasks.workunit.client.0.smithi046.stdout:read_file buf_align 3584 offset 4197888 len 16384 2024-09-21T03:56:20.613 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4190720 len 1024 2024-09-21T03:56:20.613 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4190720 len 1024 2024-09-21T03:56:20.613 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4190720 len 1024 2024-09-21T03:56:20.613 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4190720 len 1024 2024-09-21T03:56:20.613 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4190720 len 2048 2024-09-21T03:56:20.614 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4190720 len 2048 2024-09-21T03:56:20.614 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4190720 len 2048 2024-09-21T03:56:20.614 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4190720 len 2048 2024-09-21T03:56:20.614 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4190720 len 4096 2024-09-21T03:56:20.614 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4190720 len 4096 2024-09-21T03:56:20.614 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4190720 len 4096 2024-09-21T03:56:20.614 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4190720 len 4096 2024-09-21T03:56:20.614 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4190720 len 8192 2024-09-21T03:56:20.614 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4190720 len 8192 2024-09-21T03:56:20.614 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4190720 len 8192 2024-09-21T03:56:20.614 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4190720 len 8192 2024-09-21T03:56:20.614 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4190720 len 16384 2024-09-21T03:56:20.614 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4190720 len 16384 2024-09-21T03:56:20.614 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4190720 len 16384 2024-09-21T03:56:20.615 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4190720 len 16384 2024-09-21T03:56:20.615 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4191232 len 1024 2024-09-21T03:56:21.135 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4191232 len 1024 2024-09-21T03:56:21.136 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4191232 len 1024 2024-09-21T03:56:21.136 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4191232 len 1024 2024-09-21T03:56:21.136 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4191232 len 2048 2024-09-21T03:56:21.136 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4191232 len 2048 2024-09-21T03:56:21.136 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4191232 len 2048 2024-09-21T03:56:21.136 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4191232 len 2048 2024-09-21T03:56:21.136 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4191232 len 4096 2024-09-21T03:56:21.136 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4191232 len 4096 2024-09-21T03:56:21.136 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4191232 len 4096 2024-09-21T03:56:21.136 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4191232 len 4096 2024-09-21T03:56:21.136 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4191232 len 8192 2024-09-21T03:56:21.136 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4191232 len 8192 2024-09-21T03:56:21.136 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4191232 len 8192 2024-09-21T03:56:21.137 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4191232 len 8192 2024-09-21T03:56:21.137 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4191232 len 16384 2024-09-21T03:56:21.137 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4191232 len 16384 2024-09-21T03:56:21.137 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4191232 len 16384 2024-09-21T03:56:21.137 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4191232 len 16384 2024-09-21T03:56:21.137 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4191744 len 1024 2024-09-21T03:56:21.137 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4191744 len 1024 2024-09-21T03:56:21.137 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4191744 len 1024 2024-09-21T03:56:21.137 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4191744 len 1024 2024-09-21T03:56:21.137 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4191744 len 2048 2024-09-21T03:56:21.137 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4191744 len 2048 2024-09-21T03:56:21.137 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4191744 len 2048 2024-09-21T03:56:21.137 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4191744 len 2048 2024-09-21T03:56:21.137 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4191744 len 4096 2024-09-21T03:56:21.137 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4191744 len 4096 2024-09-21T03:56:21.138 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4191744 len 4096 2024-09-21T03:56:21.138 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4191744 len 4096 2024-09-21T03:56:21.138 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4191744 len 8192 2024-09-21T03:56:21.138 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4191744 len 8192 2024-09-21T03:56:21.138 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4191744 len 8192 2024-09-21T03:56:21.138 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4191744 len 8192 2024-09-21T03:56:21.138 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4191744 len 16384 2024-09-21T03:56:21.138 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4191744 len 16384 2024-09-21T03:56:21.138 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4191744 len 16384 2024-09-21T03:56:21.138 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4191744 len 16384 2024-09-21T03:56:21.138 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4192256 len 1024 2024-09-21T03:56:21.138 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4192256 len 1024 2024-09-21T03:56:21.138 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4192256 len 1024 2024-09-21T03:56:21.138 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4192256 len 1024 2024-09-21T03:56:21.139 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4192256 len 2048 2024-09-21T03:56:21.139 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4192256 len 2048 2024-09-21T03:56:21.139 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4192256 len 2048 2024-09-21T03:56:21.139 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4192256 len 2048 2024-09-21T03:56:21.139 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4192256 len 4096 2024-09-21T03:56:21.139 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4192256 len 4096 2024-09-21T03:56:21.139 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4192256 len 4096 2024-09-21T03:56:21.139 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4192256 len 4096 2024-09-21T03:56:21.139 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4192256 len 8192 2024-09-21T03:56:21.139 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4192256 len 8192 2024-09-21T03:56:21.139 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4192256 len 8192 2024-09-21T03:56:21.139 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4192256 len 8192 2024-09-21T03:56:21.139 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4192256 len 16384 2024-09-21T03:56:21.139 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4192256 len 16384 2024-09-21T03:56:21.139 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4192256 len 16384 2024-09-21T03:56:21.140 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4192256 len 16384 2024-09-21T03:56:21.140 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4192768 len 1024 2024-09-21T03:56:21.140 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4192768 len 1024 2024-09-21T03:56:21.140 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4192768 len 1024 2024-09-21T03:56:21.140 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4192768 len 1024 2024-09-21T03:56:21.140 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4192768 len 2048 2024-09-21T03:56:21.140 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4192768 len 2048 2024-09-21T03:56:21.140 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4192768 len 2048 2024-09-21T03:56:21.140 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4192768 len 2048 2024-09-21T03:56:21.140 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4192768 len 4096 2024-09-21T03:56:21.140 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4192768 len 4096 2024-09-21T03:56:21.140 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4192768 len 4096 2024-09-21T03:56:21.140 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4192768 len 4096 2024-09-21T03:56:21.140 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4192768 len 8192 2024-09-21T03:56:21.141 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4192768 len 8192 2024-09-21T03:56:21.141 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4192768 len 8192 2024-09-21T03:56:21.141 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4192768 len 8192 2024-09-21T03:56:21.141 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4192768 len 16384 2024-09-21T03:56:21.141 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4192768 len 16384 2024-09-21T03:56:21.141 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4192768 len 16384 2024-09-21T03:56:21.141 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4192768 len 16384 2024-09-21T03:56:21.141 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4193280 len 1024 2024-09-21T03:56:21.141 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4193280 len 1024 2024-09-21T03:56:21.141 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4193280 len 1024 2024-09-21T03:56:21.141 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4193280 len 1024 2024-09-21T03:56:21.141 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4193280 len 2048 2024-09-21T03:56:21.141 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4193280 len 2048 2024-09-21T03:56:21.141 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4193280 len 2048 2024-09-21T03:56:21.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:21 smithi046 ceph-mon[30954]: pgmap v359: 97 pgs: 97 active+clean; 1.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.4 MiB/s wr, 2.80k op/s 2024-09-21T03:56:21.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:21 smithi105 ceph-mon[34773]: pgmap v359: 97 pgs: 97 active+clean; 1.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.4 MiB/s wr, 2.80k op/s 2024-09-21T03:56:21.599 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4193280 len 2048 2024-09-21T03:56:21.600 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4193280 len 4096 2024-09-21T03:56:21.600 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4193280 len 4096 2024-09-21T03:56:21.600 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4193280 len 4096 2024-09-21T03:56:21.600 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4193280 len 4096 2024-09-21T03:56:21.600 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4193280 len 8192 2024-09-21T03:56:21.600 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4193280 len 8192 2024-09-21T03:56:21.600 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4193280 len 8192 2024-09-21T03:56:21.600 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4193280 len 8192 2024-09-21T03:56:21.600 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4193280 len 16384 2024-09-21T03:56:21.600 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4193280 len 16384 2024-09-21T03:56:21.601 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4193280 len 16384 2024-09-21T03:56:21.601 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4193280 len 16384 2024-09-21T03:56:21.601 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4193792 len 1024 2024-09-21T03:56:21.601 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4193792 len 1024 2024-09-21T03:56:21.601 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4193792 len 1024 2024-09-21T03:56:21.601 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4193792 len 1024 2024-09-21T03:56:21.601 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4193792 len 2048 2024-09-21T03:56:21.602 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4193792 len 2048 2024-09-21T03:56:21.602 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4193792 len 2048 2024-09-21T03:56:21.602 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4193792 len 2048 2024-09-21T03:56:21.602 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4193792 len 4096 2024-09-21T03:56:21.602 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4193792 len 4096 2024-09-21T03:56:21.602 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4193792 len 4096 2024-09-21T03:56:21.602 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4193792 len 4096 2024-09-21T03:56:21.602 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4193792 len 8192 2024-09-21T03:56:21.602 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4193792 len 8192 2024-09-21T03:56:21.602 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4193792 len 8192 2024-09-21T03:56:21.603 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4193792 len 8192 2024-09-21T03:56:21.603 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4193792 len 16384 2024-09-21T03:56:21.603 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4193792 len 16384 2024-09-21T03:56:21.603 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4193792 len 16384 2024-09-21T03:56:21.603 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4193792 len 16384 2024-09-21T03:56:21.603 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4194304 len 1024 2024-09-21T03:56:21.603 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4194304 len 1024 2024-09-21T03:56:21.603 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4194304 len 1024 2024-09-21T03:56:21.603 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4194304 len 1024 2024-09-21T03:56:21.603 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4194304 len 2048 2024-09-21T03:56:21.603 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4194304 len 2048 2024-09-21T03:56:21.604 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4194304 len 2048 2024-09-21T03:56:21.604 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4194304 len 2048 2024-09-21T03:56:21.604 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4194304 len 4096 2024-09-21T03:56:21.604 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4194304 len 4096 2024-09-21T03:56:21.604 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4194304 len 4096 2024-09-21T03:56:21.604 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4194304 len 4096 2024-09-21T03:56:21.604 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4194304 len 8192 2024-09-21T03:56:21.604 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4194304 len 8192 2024-09-21T03:56:21.604 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4194304 len 8192 2024-09-21T03:56:21.604 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4194304 len 8192 2024-09-21T03:56:21.604 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4194304 len 16384 2024-09-21T03:56:21.605 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4194304 len 16384 2024-09-21T03:56:21.605 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4194304 len 16384 2024-09-21T03:56:21.605 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4194304 len 16384 2024-09-21T03:56:21.605 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4194816 len 1024 2024-09-21T03:56:21.605 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4194816 len 1024 2024-09-21T03:56:21.605 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4194816 len 1024 2024-09-21T03:56:21.605 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4194816 len 1024 2024-09-21T03:56:21.605 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4194816 len 2048 2024-09-21T03:56:21.605 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4194816 len 2048 2024-09-21T03:56:21.605 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4194816 len 2048 2024-09-21T03:56:21.605 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4194816 len 2048 2024-09-21T03:56:21.606 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4194816 len 4096 2024-09-21T03:56:21.606 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4194816 len 4096 2024-09-21T03:56:21.606 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4194816 len 4096 2024-09-21T03:56:21.606 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4194816 len 4096 2024-09-21T03:56:21.606 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4194816 len 8192 2024-09-21T03:56:21.606 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4194816 len 8192 2024-09-21T03:56:21.606 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4194816 len 8192 2024-09-21T03:56:21.606 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4194816 len 8192 2024-09-21T03:56:21.606 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4194816 len 16384 2024-09-21T03:56:21.607 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4194816 len 16384 2024-09-21T03:56:21.607 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4194816 len 16384 2024-09-21T03:56:21.607 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4194816 len 16384 2024-09-21T03:56:21.607 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4195328 len 1024 2024-09-21T03:56:21.607 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4195328 len 1024 2024-09-21T03:56:21.607 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4195328 len 1024 2024-09-21T03:56:21.607 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4195328 len 1024 2024-09-21T03:56:21.607 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4195328 len 2048 2024-09-21T03:56:21.607 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4195328 len 2048 2024-09-21T03:56:21.607 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4195328 len 2048 2024-09-21T03:56:21.608 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4195328 len 2048 2024-09-21T03:56:21.608 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4195328 len 4096 2024-09-21T03:56:21.608 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4195328 len 4096 2024-09-21T03:56:21.608 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4195328 len 4096 2024-09-21T03:56:21.608 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4195328 len 4096 2024-09-21T03:56:21.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:21 smithi162 ceph-mon[35071]: pgmap v359: 97 pgs: 97 active+clean; 1.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.4 MiB/s wr, 2.80k op/s 2024-09-21T03:56:21.956 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4195328 len 8192 2024-09-21T03:56:21.956 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4195328 len 8192 2024-09-21T03:56:21.956 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4195328 len 8192 2024-09-21T03:56:21.956 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4195328 len 8192 2024-09-21T03:56:21.957 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4195328 len 16384 2024-09-21T03:56:21.957 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4195328 len 16384 2024-09-21T03:56:21.957 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4195328 len 16384 2024-09-21T03:56:21.957 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4195328 len 16384 2024-09-21T03:56:21.957 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4195840 len 1024 2024-09-21T03:56:21.957 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4195840 len 1024 2024-09-21T03:56:21.957 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4195840 len 1024 2024-09-21T03:56:21.957 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4195840 len 1024 2024-09-21T03:56:21.957 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4195840 len 2048 2024-09-21T03:56:21.957 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4195840 len 2048 2024-09-21T03:56:21.957 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4195840 len 2048 2024-09-21T03:56:21.957 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4195840 len 2048 2024-09-21T03:56:21.957 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4195840 len 4096 2024-09-21T03:56:21.958 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4195840 len 4096 2024-09-21T03:56:21.958 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4195840 len 4096 2024-09-21T03:56:21.958 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4195840 len 4096 2024-09-21T03:56:21.958 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4195840 len 8192 2024-09-21T03:56:21.958 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4195840 len 8192 2024-09-21T03:56:21.958 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4195840 len 8192 2024-09-21T03:56:21.958 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4195840 len 8192 2024-09-21T03:56:21.958 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4195840 len 16384 2024-09-21T03:56:21.958 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4195840 len 16384 2024-09-21T03:56:21.958 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4195840 len 16384 2024-09-21T03:56:21.958 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4195840 len 16384 2024-09-21T03:56:21.958 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4196352 len 1024 2024-09-21T03:56:21.958 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4196352 len 1024 2024-09-21T03:56:21.959 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4196352 len 1024 2024-09-21T03:56:21.959 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4196352 len 1024 2024-09-21T03:56:21.959 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4196352 len 2048 2024-09-21T03:56:21.959 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4196352 len 2048 2024-09-21T03:56:21.959 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4196352 len 2048 2024-09-21T03:56:21.959 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4196352 len 2048 2024-09-21T03:56:21.959 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4196352 len 4096 2024-09-21T03:56:21.959 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4196352 len 4096 2024-09-21T03:56:21.959 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4196352 len 4096 2024-09-21T03:56:21.959 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4196352 len 4096 2024-09-21T03:56:21.959 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4196352 len 8192 2024-09-21T03:56:21.959 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4196352 len 8192 2024-09-21T03:56:21.959 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4196352 len 8192 2024-09-21T03:56:21.960 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4196352 len 8192 2024-09-21T03:56:21.960 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4196352 len 16384 2024-09-21T03:56:21.960 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4196352 len 16384 2024-09-21T03:56:21.960 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4196352 len 16384 2024-09-21T03:56:21.960 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4196352 len 16384 2024-09-21T03:56:21.960 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4196864 len 1024 2024-09-21T03:56:21.960 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4196864 len 1024 2024-09-21T03:56:21.960 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4196864 len 1024 2024-09-21T03:56:21.960 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4196864 len 1024 2024-09-21T03:56:21.960 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4196864 len 2048 2024-09-21T03:56:21.960 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4196864 len 2048 2024-09-21T03:56:21.961 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4196864 len 2048 2024-09-21T03:56:21.961 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4196864 len 2048 2024-09-21T03:56:21.961 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4196864 len 4096 2024-09-21T03:56:21.961 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4196864 len 4096 2024-09-21T03:56:21.961 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4196864 len 4096 2024-09-21T03:56:21.961 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4196864 len 4096 2024-09-21T03:56:21.961 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4196864 len 8192 2024-09-21T03:56:21.961 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4196864 len 8192 2024-09-21T03:56:21.961 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4196864 len 8192 2024-09-21T03:56:21.961 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4196864 len 8192 2024-09-21T03:56:21.961 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4196864 len 16384 2024-09-21T03:56:21.961 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4196864 len 16384 2024-09-21T03:56:21.961 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4196864 len 16384 2024-09-21T03:56:21.961 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4196864 len 16384 2024-09-21T03:56:21.962 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4197376 len 1024 2024-09-21T03:56:21.962 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4197376 len 1024 2024-09-21T03:56:21.962 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4197376 len 1024 2024-09-21T03:56:21.962 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4197376 len 1024 2024-09-21T03:56:21.962 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4197376 len 2048 2024-09-21T03:56:21.962 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4197376 len 2048 2024-09-21T03:56:21.962 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4197376 len 2048 2024-09-21T03:56:21.962 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4197376 len 2048 2024-09-21T03:56:21.962 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4197376 len 4096 2024-09-21T03:56:21.962 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4197376 len 4096 2024-09-21T03:56:21.962 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4197376 len 4096 2024-09-21T03:56:21.963 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4197376 len 4096 2024-09-21T03:56:21.963 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4197376 len 8192 2024-09-21T03:56:21.963 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4197376 len 8192 2024-09-21T03:56:21.963 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4197376 len 8192 2024-09-21T03:56:21.963 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4197376 len 8192 2024-09-21T03:56:21.963 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4197376 len 16384 2024-09-21T03:56:21.963 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4197376 len 16384 2024-09-21T03:56:22.459 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4197376 len 16384 2024-09-21T03:56:22.459 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4197376 len 16384 2024-09-21T03:56:22.459 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4197888 len 1024 2024-09-21T03:56:22.459 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4197888 len 1024 2024-09-21T03:56:22.459 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4197888 len 1024 2024-09-21T03:56:22.459 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4197888 len 1024 2024-09-21T03:56:22.459 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4197888 len 2048 2024-09-21T03:56:22.459 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4197888 len 2048 2024-09-21T03:56:22.460 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4197888 len 2048 2024-09-21T03:56:22.460 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4197888 len 2048 2024-09-21T03:56:22.460 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4197888 len 4096 2024-09-21T03:56:22.460 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4197888 len 4096 2024-09-21T03:56:22.460 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4197888 len 4096 2024-09-21T03:56:22.460 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4197888 len 4096 2024-09-21T03:56:22.460 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4197888 len 8192 2024-09-21T03:56:22.460 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4197888 len 8192 2024-09-21T03:56:22.460 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4197888 len 8192 2024-09-21T03:56:22.460 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4197888 len 8192 2024-09-21T03:56:22.460 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 0 offset 4197888 len 16384 2024-09-21T03:56:22.460 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4197888 len 16384 2024-09-21T03:56:22.460 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 0 offset 4197888 len 16384 2024-09-21T03:56:22.461 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 0 offset 4197888 len 16384 2024-09-21T03:56:22.461 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4190720 len 1024 2024-09-21T03:56:22.461 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4190720 len 1024 2024-09-21T03:56:22.461 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4190720 len 1024 2024-09-21T03:56:22.461 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4190720 len 1024 2024-09-21T03:56:22.461 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4190720 len 2048 2024-09-21T03:56:22.461 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4190720 len 2048 2024-09-21T03:56:22.461 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4190720 len 2048 2024-09-21T03:56:22.461 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4190720 len 2048 2024-09-21T03:56:22.461 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4190720 len 4096 2024-09-21T03:56:22.461 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4190720 len 4096 2024-09-21T03:56:22.462 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4190720 len 4096 2024-09-21T03:56:22.462 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4190720 len 4096 2024-09-21T03:56:22.462 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4190720 len 8192 2024-09-21T03:56:22.462 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4190720 len 8192 2024-09-21T03:56:22.462 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4190720 len 8192 2024-09-21T03:56:22.462 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4190720 len 8192 2024-09-21T03:56:22.462 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4190720 len 16384 2024-09-21T03:56:22.462 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4190720 len 16384 2024-09-21T03:56:22.462 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4190720 len 16384 2024-09-21T03:56:22.462 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4190720 len 16384 2024-09-21T03:56:22.462 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4191232 len 1024 2024-09-21T03:56:22.462 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4191232 len 1024 2024-09-21T03:56:22.462 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4191232 len 1024 2024-09-21T03:56:22.463 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4191232 len 1024 2024-09-21T03:56:22.463 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4191232 len 2048 2024-09-21T03:56:22.463 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4191232 len 2048 2024-09-21T03:56:22.463 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4191232 len 2048 2024-09-21T03:56:22.463 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4191232 len 2048 2024-09-21T03:56:22.463 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4191232 len 4096 2024-09-21T03:56:22.463 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4191232 len 4096 2024-09-21T03:56:22.463 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4191232 len 4096 2024-09-21T03:56:22.463 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4191232 len 4096 2024-09-21T03:56:22.463 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4191232 len 8192 2024-09-21T03:56:22.463 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4191232 len 8192 2024-09-21T03:56:22.463 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4191232 len 8192 2024-09-21T03:56:22.463 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4191232 len 8192 2024-09-21T03:56:22.463 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4191232 len 16384 2024-09-21T03:56:22.464 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4191232 len 16384 2024-09-21T03:56:22.464 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4191232 len 16384 2024-09-21T03:56:22.464 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4191232 len 16384 2024-09-21T03:56:22.464 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4191744 len 1024 2024-09-21T03:56:22.464 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4191744 len 1024 2024-09-21T03:56:22.464 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4191744 len 1024 2024-09-21T03:56:22.464 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4191744 len 1024 2024-09-21T03:56:22.464 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4191744 len 2048 2024-09-21T03:56:22.464 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4191744 len 2048 2024-09-21T03:56:22.464 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4191744 len 2048 2024-09-21T03:56:22.464 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4191744 len 2048 2024-09-21T03:56:22.464 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4191744 len 4096 2024-09-21T03:56:22.464 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4191744 len 4096 2024-09-21T03:56:22.464 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4191744 len 4096 2024-09-21T03:56:22.465 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4191744 len 4096 2024-09-21T03:56:22.465 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4191744 len 8192 2024-09-21T03:56:22.465 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4191744 len 8192 2024-09-21T03:56:22.465 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4191744 len 8192 2024-09-21T03:56:22.465 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4191744 len 8192 2024-09-21T03:56:22.465 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4191744 len 16384 2024-09-21T03:56:22.465 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4191744 len 16384 2024-09-21T03:56:22.465 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4191744 len 16384 2024-09-21T03:56:22.465 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4191744 len 16384 2024-09-21T03:56:22.465 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4192256 len 1024 2024-09-21T03:56:22.465 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4192256 len 1024 2024-09-21T03:56:22.924 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:56:23.006 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.004+0000 7f56d9039640 1 -- 172.21.15.46:0/2516446507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56cc0ab1f0 msgr2=0x7f56cc0aba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:23.007 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.004+0000 7f56d9039640 1 --2- 172.21.15.46:0/2516446507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56cc0ab1f0 0x7f56cc0aba10 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f56d4066480 tx=0x7f56d408f880 comp rx=0 tx=0).stop 2024-09-21T03:56:23.008 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.006+0000 7f56d9039640 1 -- 172.21.15.46:0/2516446507 shutdown_connections 2024-09-21T03:56:23.008 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.006+0000 7f56d9039640 1 --2- 172.21.15.46:0/2516446507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56cc0ab1f0 0x7f56cc0aba10 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.008 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.006+0000 7f56d9039640 1 --2- 172.21.15.46:0/2516446507 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56cc0aa8a0 0x7f56cc0aacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.008 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.006+0000 7f56d9039640 1 --2- 172.21.15.46:0/2516446507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56cc0a4f70 0x7f56cc0a5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.008 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.006+0000 7f56d9039640 1 -- 172.21.15.46:0/2516446507 >> 172.21.15.46:0/2516446507 conn(0x7f56cc01cc80 msgr2=0x7f56cc01d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:23.010 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.008+0000 7f56d9039640 1 -- 172.21.15.46:0/2516446507 shutdown_connections 2024-09-21T03:56:23.012 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.010+0000 7f56d9039640 1 -- 172.21.15.46:0/2516446507 wait complete. 2024-09-21T03:56:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.011+0000 7f56d9039640 1 Processor -- start 2024-09-21T03:56:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.011+0000 7f56d9039640 1 -- start start 2024-09-21T03:56:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.012+0000 7f56d9039640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56cc0a4f70 0x7f56cc1440c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.012+0000 7f56d9039640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56cc0aa8a0 0x7f56cc144660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.012+0000 7f56d9039640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56cc0ab1f0 0x7f56cc1498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.012+0000 7f56d9039640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f56cc0bd620 con 0x7f56cc0aa8a0 2024-09-21T03:56:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.012+0000 7f56d9039640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f56cc0bd4a0 con 0x7f56cc0a4f70 2024-09-21T03:56:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.012+0000 7f56d9039640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f56cc0bd7a0 con 0x7f56cc0ab1f0 2024-09-21T03:56:23.016 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.012+0000 7f56d37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56cc0aa8a0 0x7f56cc144660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:23.016 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.013+0000 7f56d37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56cc0aa8a0 0x7f56cc144660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34848/0 (socket says 172.21.15.46:34848) 2024-09-21T03:56:23.016 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.013+0000 7f56d37fe640 1 -- 172.21.15.46:0/1211950616 learned_addr learned my addr 172.21.15.46:0/1211950616 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:56:23.016 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.013+0000 7f56d3fff640 1 --2- 172.21.15.46:0/1211950616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56cc0a4f70 0x7f56cc1440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:23.016 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.013+0000 7f56d8838640 1 --2- 172.21.15.46:0/1211950616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56cc0ab1f0 0x7f56cc1498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:23.016 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.013+0000 7f56d37fe640 1 -- 172.21.15.46:0/1211950616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56cc0ab1f0 msgr2=0x7f56cc1498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:23.016 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.013+0000 7f56d37fe640 1 --2- 172.21.15.46:0/1211950616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56cc0ab1f0 0x7f56cc1498f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.016 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.013+0000 7f56d37fe640 1 -- 172.21.15.46:0/1211950616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56cc0a4f70 msgr2=0x7f56cc1440c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:23.016 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.013+0000 7f56d37fe640 1 --2- 172.21.15.46:0/1211950616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56cc0a4f70 0x7f56cc1440c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.016 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.014+0000 7f56d37fe640 1 -- 172.21.15.46:0/1211950616 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56cc149ff0 con 0x7f56cc0aa8a0 2024-09-21T03:56:23.017 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.014+0000 7f56d37fe640 1 --2- 172.21.15.46:0/1211950616 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56cc0aa8a0 0x7f56cc144660 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f56c000b450 tx=0x7f56c000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:23.019 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.016+0000 7f56d17fa640 1 -- 172.21.15.46:0/1211950616 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c0015020 con 0x7f56cc0aa8a0 2024-09-21T03:56:23.020 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.016+0000 7f56d17fa640 1 -- 172.21.15.46:0/1211950616 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56c0011d40 con 0x7f56cc0aa8a0 2024-09-21T03:56:23.020 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.016+0000 7f56d17fa640 1 -- 172.21.15.46:0/1211950616 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c000f340 con 0x7f56cc0aa8a0 2024-09-21T03:56:23.020 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.016+0000 7f56d9039640 1 -- 172.21.15.46:0/1211950616 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56cc14a2e0 con 0x7f56cc0aa8a0 2024-09-21T03:56:23.020 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.016+0000 7f56d9039640 1 -- 172.21.15.46:0/1211950616 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56cc150a70 con 0x7f56cc0aa8a0 2024-09-21T03:56:23.026 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.023+0000 7f56e1211740 1 Processor -- start 2024-09-21T03:56:23.026 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.023+0000 7f56e1211740 1 -- start start 2024-09-21T03:56:23.028 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.023+0000 7f56e1211740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586187d91b0 0x558618b7eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.028 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.024+0000 7f56e1211740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586187b02f0 0x558618b7f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.028 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.024+0000 7f56e1211740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586187b84d0 0x558618b7f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.024+0000 7f56e1211740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x558618af36f0 con 0x5586187d91b0 2024-09-21T03:56:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.024+0000 7f56e1211740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x558618ae2b20 con 0x5586187b02f0 2024-09-21T03:56:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.024+0000 7f56e1211740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558618ae6930 con 0x5586187b84d0 2024-09-21T03:56:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.024+0000 7f56d3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586187b02f0 0x558618b7f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.024+0000 7f56d3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586187b02f0 0x558618b7f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.46:45518/0 (socket says 172.21.15.46:45518) 2024-09-21T03:56:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.024+0000 7f56d3fff640 1 -- 172.21.15.46:0/3214449382 learned_addr learned my addr 172.21.15.46:0/3214449382 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:56:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.024+0000 7f56d8838640 1 --2- 172.21.15.46:0/3214449382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586187d91b0 0x558618b7eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.024+0000 7f56d3fff640 1 -- 172.21.15.46:0/3214449382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586187b84d0 msgr2=0x558618b7f620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T03:56:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.024+0000 7f56d3fff640 1 --2- 172.21.15.46:0/3214449382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586187b84d0 0x558618b7f620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.024+0000 7f56d3fff640 1 -- 172.21.15.46:0/3214449382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586187d91b0 msgr2=0x558618b7eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.024+0000 7f56d3fff640 1 --2- 172.21.15.46:0/3214449382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586187d91b0 0x558618b7eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.024+0000 7f56d3fff640 1 -- 172.21.15.46:0/3214449382 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558618aa8530 con 0x5586187b02f0 2024-09-21T03:56:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.026+0000 7f56d3fff640 1 --2- 172.21.15.46:0/3214449382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586187b02f0 0x558618b7f0e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f56c8009c50 tx=0x7f56c8010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7dd3b529b51cb42 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:23.033 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.029+0000 7f56be7fc640 1 -- 172.21.15.46:0/3214449382 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c8004020 con 0x5586187b02f0 2024-09-21T03:56:23.033 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.029+0000 7f56be7fc640 1 -- 172.21.15.46:0/3214449382 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56c80041c0 con 0x5586187b02f0 2024-09-21T03:56:23.033 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.030+0000 7f56d17fa640 1 -- 172.21.15.46:0/1211950616 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f56c0018020 con 0x7f56cc0aa8a0 2024-09-21T03:56:23.033 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.030+0000 7f56e1211740 1 -- 172.21.15.46:0/3214449382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586187b02f0 msgr2=0x558618b7f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:23.033 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.030+0000 7f56e1211740 1 --2- 172.21.15.46:0/3214449382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586187b02f0 0x558618b7f0e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f56c8009c50 tx=0x7f56c8010740 comp rx=0 tx=0).stop 2024-09-21T03:56:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.032+0000 7f56e1211740 1 -- 172.21.15.46:0/3214449382 shutdown_connections 2024-09-21T03:56:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.032+0000 7f56e1211740 1 --2- 172.21.15.46:0/3214449382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586187b84d0 0x558618b7f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.032+0000 7f56e1211740 1 --2- 172.21.15.46:0/3214449382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586187b02f0 0x558618b7f0e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.032+0000 7f56e1211740 1 --2- 172.21.15.46:0/3214449382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586187d91b0 0x558618b7eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.032+0000 7f56e1211740 1 -- 172.21.15.46:0/3214449382 >> 172.21.15.46:0/3214449382 conn(0x5586187cd300 msgr2=0x558618b7ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.032+0000 7f56d17fa640 1 --2- 172.21.15.46:0/1211950616 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f56c40b6880 0x7f56c40b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.033+0000 7f56d17fa640 1 -- 172.21.15.46:0/1211950616 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f56c00e6ef0 con 0x7f56cc0aa8a0 2024-09-21T03:56:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.033+0000 7f56e1211740 1 -- 172.21.15.46:0/3214449382 shutdown_connections 2024-09-21T03:56:23.036 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.033+0000 7f56d3fff640 1 --2- 172.21.15.46:0/1211950616 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f56c40b6880 0x7f56c40b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:23.036 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.033+0000 7f56e1211740 1 -- 172.21.15.46:0/3214449382 wait complete. 2024-09-21T03:56:23.036 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.034+0000 7f56e1211740 1 -- start start 2024-09-21T03:56:23.036 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.034+0000 7f56e1211740 1 Processor -- start 2024-09-21T03:56:23.036 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.034+0000 7f56d3fff640 1 --2- 172.21.15.46:0/1211950616 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f56c40b6880 0x7f56c40b8d90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f56c8011010 tx=0x7f56c8003dd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.035+0000 7f56e1211740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586187b02f0 0x558618b9b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.035+0000 7f56e1211740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586187b84d0 0x558618b9b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.035+0000 7f56e1211740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586187d91b0 0x558618b9bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.035+0000 7f56e1211740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x558618a1aab0 con 0x5586187b84d0 2024-09-21T03:56:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.035+0000 7f56e1211740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x558618a88730 con 0x5586187d91b0 2024-09-21T03:56:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.035+0000 7f56e1211740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558618b9e350 con 0x5586187b02f0 2024-09-21T03:56:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.035+0000 7f56e1211740 10 client.0 _ll_register_callbacks cb 0x558618adc6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:56:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.035+0000 7f56d8838640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586187d91b0 0x558618b9bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.035+0000 7f56d8838640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586187d91b0 0x558618b9bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.46:45522/0 (socket says 172.21.15.46:45522) 2024-09-21T03:56:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.035+0000 7f56d8838640 1 -- 172.21.15.46:0/1977602378 learned_addr learned my addr 172.21.15.46:0/1977602378 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:56:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.035+0000 7f56d3fff640 1 --2- 172.21.15.46:0/1977602378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586187b02f0 0x558618b9b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.035+0000 7f56d37fe640 1 --2- 172.21.15.46:0/1977602378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586187b84d0 0x558618b9b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.036+0000 7f56d3fff640 1 -- 172.21.15.46:0/1977602378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586187d91b0 msgr2=0x558618b9bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.036+0000 7f56d3fff640 1 --2- 172.21.15.46:0/1977602378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586187d91b0 0x558618b9bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.036+0000 7f56d3fff640 1 -- 172.21.15.46:0/1977602378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586187b84d0 msgr2=0x558618b9b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.036+0000 7f56d3fff640 1 --2- 172.21.15.46:0/1977602378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586187b84d0 0x558618b9b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.036+0000 7f56d3fff640 1 -- 172.21.15.46:0/1977602378 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558618844790 con 0x5586187b02f0 2024-09-21T03:56:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.036+0000 7f56d3fff640 1 --2- 172.21.15.46:0/1977602378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586187b02f0 0x558618b9b1a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f56c8009c20 tx=0x7f56c8010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6eafd3a8f82463a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.039+0000 7f56b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T03:56:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.039+0000 7f56b37fe640 1 -- 172.21.15.46:0/1977602378 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c8035060 con 0x5586187b02f0 2024-09-21T03:56:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.039+0000 7f56e1211740 1 -- 172.21.15.46:0/1977602378 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56c80041c0 con 0x5586187b02f0 2024-09-21T03:56:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.039+0000 7f56b37fe640 1 -- 172.21.15.46:0/1977602378 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f56c8009d40 con 0x5586187b02f0 2024-09-21T03:56:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.041+0000 7f56b37fe640 1 -- 172.21.15.46:0/1977602378 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f56c8012ce0 con 0x5586187b02f0 2024-09-21T03:56:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.041+0000 7f56e1211740 10 client.25330 fetch_fsmap learned FSMap version 20 2024-09-21T03:56:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.041+0000 7f56e1211740 1 -- 172.21.15.46:0/1977602378 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5586188bd620 con 0x5586187b02f0 2024-09-21T03:56:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.044+0000 7f56b37fe640 1 -- 172.21.15.46:0/1977602378 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56c80041c0 con 0x5586187b02f0 2024-09-21T03:56:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.044+0000 7f56b37fe640 1 -- 172.21.15.46:0/1977602378 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f56c800f040 con 0x5586187b02f0 2024-09-21T03:56:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.044+0000 7f56e1211740 10 client.25330 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:56:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.044+0000 7f56e1211740 10 client.25330 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:56:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.044+0000 7f56e1211740 20 client.25330 populate_metadata read hostname 'smithi046' 2024-09-21T03:56:23.047 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.045+0000 7f56e1211740 1 --2- 172.21.15.46:0/1977602378 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558618797d80 0x558618bad250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.047 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.045+0000 7f56e1211740 4 client.25330 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:56:23.047 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.045+0000 7f56e1211740 1 -- 172.21.15.46:0/1977602378 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558618af5640 con 0x558618797d80 2024-09-21T03:56:23.047 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.045+0000 7f56d37fe640 1 --2- 172.21.15.46:0/1977602378 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558618797d80 0x558618bad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:23.047 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.045+0000 7f56b37fe640 10 client.25330 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:56:23.048 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.046+0000 7f56d37fe640 1 --2- 172.21.15.46:0/1977602378 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558618797d80 0x558618bad250 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8560af8b07f0f31 server_cookie=269194af252b3272 in_seq=0 out_seq=0 2024-09-21T03:56:23.049 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.047+0000 7f56b37fe640 1 -- 172.21.15.46:0/1977602378 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558618af5640 con 0x558618797d80 2024-09-21T03:56:23.049 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.047+0000 7f56b37fe640 10 client.25330 handle_command_reply: tid=0 2024-09-21T03:56:23.049 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.047+0000 7f56e1211740 1 client.25330 shutdown 2024-09-21T03:56:23.049 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.047+0000 7f56e1211740 1 -- 172.21.15.46:0/1977602378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586187b02f0 msgr2=0x558618b9b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:23.049 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.047+0000 7f56e1211740 1 --2- 172.21.15.46:0/1977602378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586187b02f0 0x558618b9b1a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f56c8009c20 tx=0x7f56c8010740 comp rx=0 tx=0).stop 2024-09-21T03:56:23.050 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.047+0000 7f56e1211740 1 -- 172.21.15.46:0/1977602378 shutdown_connections 2024-09-21T03:56:23.050 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.047+0000 7f56e1211740 1 --2- 172.21.15.46:0/1977602378 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558618797d80 0x558618bad250 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.050 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.047+0000 7f56e1211740 1 --2- 172.21.15.46:0/1977602378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586187d91b0 0x558618b9bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.050 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.047+0000 7f56e1211740 1 --2- 172.21.15.46:0/1977602378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586187b84d0 0x558618b9b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.050 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.047+0000 7f56e1211740 1 --2- 172.21.15.46:0/1977602378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586187b02f0 0x558618b9b1a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.050 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.047+0000 7f56e1211740 1 -- 172.21.15.46:0/1977602378 >> 172.21.15.46:0/1977602378 conn(0x5586187cd300 msgr2=0x558618b80590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:23.050 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.047+0000 7f56b37fe640 0 client.25330 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:56:23.050 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.047+0000 7f56e1211740 1 -- 172.21.15.46:0/1977602378 shutdown_connections 2024-09-21T03:56:23.050 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.047+0000 7f56e1211740 1 -- 172.21.15.46:0/1977602378 wait complete. 2024-09-21T03:56:23.051 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.048+0000 7f56e1211740 20 client.25330 trim_cache size 0 max 16384 2024-09-21T03:56:23.080 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.078+0000 7f56e1211740 1 Processor -- start 2024-09-21T03:56:23.080 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.078+0000 7f56e1211740 1 -- start start 2024-09-21T03:56:23.080 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.078+0000 7f56e1211740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586187b02f0 0x558618b965f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.081 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.078+0000 7f56e1211740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586187b84d0 0x558618b7c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.081 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.079+0000 7f56e1211740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586187d91b0 0x558618b7c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.082 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.079+0000 7f56d3fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586187b02f0 0x558618b965f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:23.082 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.079+0000 7f56d3fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586187b02f0 0x558618b965f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:44064/0 (socket says 172.21.15.46:44064) 2024-09-21T03:56:23.082 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.079+0000 7f56d37fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586187b84d0 0x558618b7c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:23.082 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.079+0000 7f56d37fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586187b84d0 0x558618b7c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.46:45524/0 (socket says 172.21.15.46:45524) 2024-09-21T03:56:23.082 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.079+0000 7f56d3fff640 1 -- 172.21.15.46:0/360895578 learned_addr learned my addr 172.21.15.46:0/360895578 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:56:23.082 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.079+0000 7f56e1211740 1 -- 172.21.15.46:0/360895578 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f56b800c6f0 con 0x5586187d91b0 2024-09-21T03:56:23.082 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.079+0000 7f56e1211740 1 -- 172.21.15.46:0/360895578 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f56b800ef90 con 0x5586187b84d0 2024-09-21T03:56:23.082 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.079+0000 7f56e1211740 1 -- 172.21.15.46:0/360895578 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f56b800cd80 con 0x5586187b02f0 2024-09-21T03:56:23.082 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.079+0000 7f56d8838640 1 --2- 172.21.15.46:0/360895578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586187d91b0 0x558618b7c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:23.082 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.079+0000 7f56d37fe640 1 -- 172.21.15.46:0/360895578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586187b02f0 msgr2=0x558618b965f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:23.082 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.079+0000 7f56d37fe640 1 --2- 172.21.15.46:0/360895578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586187b02f0 0x558618b965f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.082 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.079+0000 7f56d37fe640 1 -- 172.21.15.46:0/360895578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586187d91b0 msgr2=0x558618b7c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:23.083 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.079+0000 7f56d37fe640 1 --2- 172.21.15.46:0/360895578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586187d91b0 0x558618b7c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.083 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.079+0000 7f56d37fe640 1 -- 172.21.15.46:0/360895578 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558618b845c0 con 0x5586187b84d0 2024-09-21T03:56:23.083 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.080+0000 7f56d37fe640 1 --2- 172.21.15.46:0/360895578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586187b84d0 0x558618b7c160 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f56c00e46a0 tx=0x7f56c00d0040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5a706d23ac95db server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:23.084 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.080+0000 7f56bdffb640 1 -- 172.21.15.46:0/360895578 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c0017da0 con 0x5586187b84d0 2024-09-21T03:56:23.084 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.080+0000 7f56bdffb640 1 -- 172.21.15.46:0/360895578 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56c00a9010 con 0x5586187b84d0 2024-09-21T03:56:23.084 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.080+0000 7f56bdffb640 1 -- 172.21.15.46:0/360895578 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c00d4360 con 0x5586187b84d0 2024-09-21T03:56:23.084 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.081+0000 7f56e1211740 1 -- 172.21.15.46:0/360895578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586187b84d0 msgr2=0x558618b7c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:23.084 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.081+0000 7f56e1211740 1 --2- 172.21.15.46:0/360895578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586187b84d0 0x558618b7c160 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f56c00e46a0 tx=0x7f56c00d0040 comp rx=0 tx=0).stop 2024-09-21T03:56:23.084 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.081+0000 7f56e1211740 1 -- 172.21.15.46:0/360895578 shutdown_connections 2024-09-21T03:56:23.084 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.081+0000 7f56e1211740 1 --2- 172.21.15.46:0/360895578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586187d91b0 0x558618b7c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.084 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.081+0000 7f56e1211740 1 --2- 172.21.15.46:0/360895578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586187b84d0 0x558618b7c160 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.084 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.081+0000 7f56e1211740 1 --2- 172.21.15.46:0/360895578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586187b02f0 0x558618b965f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.085 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.081+0000 7f56e1211740 1 -- 172.21.15.46:0/360895578 >> 172.21.15.46:0/360895578 conn(0x5586187cd300 msgr2=0x558618b95ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:23.085 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.081+0000 7f56e1211740 1 -- 172.21.15.46:0/360895578 shutdown_connections 2024-09-21T03:56:23.085 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.081+0000 7f56e1211740 1 -- 172.21.15.46:0/360895578 wait complete. 2024-09-21T03:56:23.085 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.082+0000 7f56e1211740 1 -- start start 2024-09-21T03:56:23.085 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.082+0000 7f56e1211740 1 Processor -- start 2024-09-21T03:56:23.087 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.082+0000 7f56e1211740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586187b02f0 0x558618b9ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.087 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.082+0000 7f56e1211740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586187b84d0 0x558618b9f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.087 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.082+0000 7f56e1211740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586187d91b0 0x558618c15be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.087 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.083+0000 7f56e1211740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f56b800d450 con 0x5586187b84d0 2024-09-21T03:56:23.087 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.083+0000 7f56d37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586187b84d0 0x558618b9f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:23.087 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.083+0000 7f56d3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586187b02f0 0x558618b9ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:23.087 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.083+0000 7f56d3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586187b02f0 0x558618b9ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.46:45528/0 (socket says 172.21.15.46:45528) 2024-09-21T03:56:23.088 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.083+0000 7f56e1211740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f56b800e8c0 con 0x5586187b02f0 2024-09-21T03:56:23.088 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.083+0000 7f56d3fff640 1 -- 172.21.15.46:0/1964900811 learned_addr learned my addr 172.21.15.46:0/1964900811 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:56:23.088 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.083+0000 7f56e1211740 1 -- 172.21.15.46:0/1964900811 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f56b800db20 con 0x5586187d91b0 2024-09-21T03:56:23.088 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.083+0000 7f56d37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586187b84d0 0x558618b9f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34896/0 (socket says 172.21.15.46:34896) 2024-09-21T03:56:23.088 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.083+0000 7f56e1211740 10 client.0 _ll_register_callbacks cb 0x7f56c8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:56:23.088 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.083+0000 7f56d8838640 1 --2- 172.21.15.46:0/1964900811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586187d91b0 0x558618c15be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:23.088 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.083+0000 7f56d3fff640 1 -- 172.21.15.46:0/1964900811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586187d91b0 msgr2=0x558618c15be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:23.088 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.083+0000 7f56d3fff640 1 --2- 172.21.15.46:0/1964900811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586187d91b0 0x558618c15be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.088 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.083+0000 7f56d3fff640 1 -- 172.21.15.46:0/1964900811 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586187b84d0 msgr2=0x558618b9f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:23.088 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.083+0000 7f56d3fff640 1 --2- 172.21.15.46:0/1964900811 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586187b84d0 0x558618b9f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.088 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.083+0000 7f56d3fff640 1 -- 172.21.15.46:0/1964900811 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558618c16120 con 0x5586187b02f0 2024-09-21T03:56:23.088 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.083+0000 7f56d37fe640 1 --2- 172.21.15.46:0/1964900811 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586187b84d0 0x558618b9f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:56:23.088 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.083+0000 7f56d3fff640 1 --2- 172.21.15.46:0/1964900811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586187b02f0 0x558618b9ea80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f56c801b530 tx=0x7f56c8009f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13dbcf43b89a0bae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:23.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.083+0000 7f56b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-21T03:56:23.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.084+0000 7f56b37fe640 1 -- 172.21.15.46:0/1964900811 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c8035040 con 0x5586187b02f0 2024-09-21T03:56:23.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.084+0000 7f56b37fe640 1 -- 172.21.15.46:0/1964900811 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f56c801bc50 con 0x5586187b02f0 2024-09-21T03:56:23.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.084+0000 7f56e1211740 1 -- 172.21.15.46:0/1964900811 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56c00a9010 con 0x5586187b02f0 2024-09-21T03:56:23.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.084+0000 7f56b37fe640 1 -- 172.21.15.46:0/1964900811 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f56c801be50 con 0x5586187b02f0 2024-09-21T03:56:23.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.084+0000 7f56e1211740 10 client.25316 fetch_fsmap learned FSMap version 20 2024-09-21T03:56:23.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.084+0000 7f56e1211740 1 -- 172.21.15.46:0/1964900811 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x558618c17260 con 0x5586187b02f0 2024-09-21T03:56:23.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.084+0000 7f56b37fe640 1 -- 172.21.15.46:0/1964900811 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56c00a9010 con 0x5586187b02f0 2024-09-21T03:56:23.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.084+0000 7f56b37fe640 1 -- 172.21.15.46:0/1964900811 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f56c8004b10 con 0x5586187b02f0 2024-09-21T03:56:23.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.084+0000 7f56e1211740 10 client.25316 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:56:23.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.084+0000 7f56e1211740 10 client.25316 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T03:56:23.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.085+0000 7f56e1211740 20 client.25316 populate_metadata read hostname 'smithi046' 2024-09-21T03:56:23.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.085+0000 7f56e1211740 1 --2- 172.21.15.46:0/1964900811 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55861876d1c0 0x558618c199b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.085+0000 7f56e1211740 4 client.25316 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T03:56:23.090 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.085+0000 7f56e1211740 1 -- 172.21.15.46:0/1964900811 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558618af10f0 con 0x55861876d1c0 2024-09-21T03:56:23.090 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.085+0000 7f56d37fe640 1 --2- 172.21.15.46:0/1964900811 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55861876d1c0 0x558618c199b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:23.090 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.085+0000 7f56b37fe640 10 client.25316 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:56:23.090 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.086+0000 7f56d37fe640 1 --2- 172.21.15.46:0/1964900811 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55861876d1c0 0x558618c199b0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51e294319d558566 server_cookie=a841d0e6d0ef0fe8 in_seq=0 out_seq=0 2024-09-21T03:56:23.115 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.112+0000 7f56b37fe640 1 -- 172.21.15.46:0/1964900811 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558618af10f0 con 0x55861876d1c0 2024-09-21T03:56:23.115 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.112+0000 7f56b37fe640 10 client.25316 handle_command_reply: tid=0 2024-09-21T03:56:23.115 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.112+0000 7f56e1211740 1 client.25316 shutdown 2024-09-21T03:56:23.115 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.112+0000 7f56e1211740 1 -- 172.21.15.46:0/1964900811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586187b02f0 msgr2=0x558618b9ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:23.115 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.112+0000 7f56e1211740 1 --2- 172.21.15.46:0/1964900811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586187b02f0 0x558618b9ea80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f56c801b530 tx=0x7f56c8009f70 comp rx=0 tx=0).stop 2024-09-21T03:56:23.115 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.112+0000 7f56e1211740 1 -- 172.21.15.46:0/1964900811 shutdown_connections 2024-09-21T03:56:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.112+0000 7f56e1211740 1 --2- 172.21.15.46:0/1964900811 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55861876d1c0 0x558618c199b0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.112+0000 7f56b37fe640 0 client.25316 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:56:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.112+0000 7f56e1211740 1 --2- 172.21.15.46:0/1964900811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586187d91b0 0x558618c15be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.112+0000 7f56e1211740 1 --2- 172.21.15.46:0/1964900811 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586187b84d0 0x558618b9f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.112+0000 7f56e1211740 1 --2- 172.21.15.46:0/1964900811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586187b02f0 0x558618b9ea80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.112+0000 7f56e1211740 1 -- 172.21.15.46:0/1964900811 >> 172.21.15.46:0/1964900811 conn(0x5586187cd300 msgr2=0x558618b7fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.113+0000 7f56e1211740 1 -- 172.21.15.46:0/1964900811 shutdown_connections 2024-09-21T03:56:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.113+0000 7f56e1211740 1 -- 172.21.15.46:0/1964900811 wait complete. 2024-09-21T03:56:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.113+0000 7f56e1211740 20 client.25316 trim_cache size 0 max 16384 2024-09-21T03:56:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:{ 2024-09-21T03:56:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "message": "", 2024-09-21T03:56:23.117 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "return_code": 0 2024-09-21T03:56:23.117 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:} 2024-09-21T03:56:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.113+0000 7f56d9039640 1 -- 172.21.15.46:0/1211950616 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f56c40b6880 msgr2=0x7f56c40b8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.113+0000 7f56d9039640 1 --2- 172.21.15.46:0/1211950616 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f56c40b6880 0x7f56c40b8d90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f56c8011010 tx=0x7f56c8003dd0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.114+0000 7f56d9039640 1 -- 172.21.15.46:0/1211950616 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56cc0aa8a0 msgr2=0x7f56cc144660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.114+0000 7f56d9039640 1 --2- 172.21.15.46:0/1211950616 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56cc0aa8a0 0x7f56cc144660 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f56c000b450 tx=0x7f56c000b910 comp rx=0 tx=0).stop 2024-09-21T03:56:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.114+0000 7f56d9039640 1 -- 172.21.15.46:0/1211950616 shutdown_connections 2024-09-21T03:56:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.114+0000 7f56d9039640 1 --2- 172.21.15.46:0/1211950616 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f56c40b6880 0x7f56c40b8d90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.114+0000 7f56d9039640 1 --2- 172.21.15.46:0/1211950616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56cc0ab1f0 0x7f56cc1498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.114+0000 7f56d9039640 1 --2- 172.21.15.46:0/1211950616 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56cc0aa8a0 0x7f56cc144660 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.114+0000 7f56d9039640 1 --2- 172.21.15.46:0/1211950616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56cc0a4f70 0x7f56cc1440c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.114+0000 7f56d9039640 1 -- 172.21.15.46:0/1211950616 >> 172.21.15.46:0/1211950616 conn(0x7f56cc01cc80 msgr2=0x7f56cc0a39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.114+0000 7f56d9039640 1 -- 172.21.15.46:0/1211950616 shutdown_connections 2024-09-21T03:56:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-21T03:56:23.115+0000 7f56d9039640 1 -- 172.21.15.46:0/1211950616 wait complete. 2024-09-21T03:56:23.127 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4192256 len 1024 2024-09-21T03:56:23.127 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4192256 len 1024 2024-09-21T03:56:23.127 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4192256 len 2048 2024-09-21T03:56:23.127 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4192256 len 2048 2024-09-21T03:56:23.127 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4192256 len 2048 2024-09-21T03:56:23.127 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4192256 len 2048 2024-09-21T03:56:23.127 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4192256 len 4096 2024-09-21T03:56:23.128 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4192256 len 4096 2024-09-21T03:56:23.128 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4192256 len 4096 2024-09-21T03:56:23.128 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4192256 len 4096 2024-09-21T03:56:23.128 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4192256 len 8192 2024-09-21T03:56:23.128 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4192256 len 8192 2024-09-21T03:56:23.128 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4192256 len 8192 2024-09-21T03:56:23.128 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4192256 len 8192 2024-09-21T03:56:23.128 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4192256 len 16384 2024-09-21T03:56:23.128 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4192256 len 16384 2024-09-21T03:56:23.128 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4192256 len 16384 2024-09-21T03:56:23.128 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4192256 len 16384 2024-09-21T03:56:23.128 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4192768 len 1024 2024-09-21T03:56:23.128 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4192768 len 1024 2024-09-21T03:56:23.129 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4192768 len 1024 2024-09-21T03:56:23.129 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4192768 len 1024 2024-09-21T03:56:23.129 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4192768 len 2048 2024-09-21T03:56:23.129 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4192768 len 2048 2024-09-21T03:56:23.129 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4192768 len 2048 2024-09-21T03:56:23.129 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4192768 len 2048 2024-09-21T03:56:23.129 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4192768 len 4096 2024-09-21T03:56:23.129 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4192768 len 4096 2024-09-21T03:56:23.129 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4192768 len 4096 2024-09-21T03:56:23.129 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4192768 len 4096 2024-09-21T03:56:23.129 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4192768 len 8192 2024-09-21T03:56:23.129 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4192768 len 8192 2024-09-21T03:56:23.129 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4192768 len 8192 2024-09-21T03:56:23.129 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4192768 len 8192 2024-09-21T03:56:23.129 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4192768 len 16384 2024-09-21T03:56:23.130 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4192768 len 16384 2024-09-21T03:56:23.130 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4192768 len 16384 2024-09-21T03:56:23.130 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4192768 len 16384 2024-09-21T03:56:23.130 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4193280 len 1024 2024-09-21T03:56:23.130 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4193280 len 1024 2024-09-21T03:56:23.130 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4193280 len 1024 2024-09-21T03:56:23.130 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4193280 len 1024 2024-09-21T03:56:23.130 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4193280 len 2048 2024-09-21T03:56:23.130 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4193280 len 2048 2024-09-21T03:56:23.130 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4193280 len 2048 2024-09-21T03:56:23.130 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4193280 len 2048 2024-09-21T03:56:23.130 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4193280 len 4096 2024-09-21T03:56:23.130 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4193280 len 4096 2024-09-21T03:56:23.130 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4193280 len 4096 2024-09-21T03:56:23.131 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4193280 len 4096 2024-09-21T03:56:23.131 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4193280 len 8192 2024-09-21T03:56:23.131 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4193280 len 8192 2024-09-21T03:56:23.131 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4193280 len 8192 2024-09-21T03:56:23.131 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4193280 len 8192 2024-09-21T03:56:23.131 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4193280 len 16384 2024-09-21T03:56:23.131 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4193280 len 16384 2024-09-21T03:56:23.131 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4193280 len 16384 2024-09-21T03:56:23.131 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4193280 len 16384 2024-09-21T03:56:23.131 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4193792 len 1024 2024-09-21T03:56:23.131 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4193792 len 1024 2024-09-21T03:56:23.131 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4193792 len 1024 2024-09-21T03:56:23.131 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4193792 len 1024 2024-09-21T03:56:23.131 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4193792 len 2048 2024-09-21T03:56:23.132 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4193792 len 2048 2024-09-21T03:56:23.132 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4193792 len 2048 2024-09-21T03:56:23.132 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4193792 len 2048 2024-09-21T03:56:23.132 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4193792 len 4096 2024-09-21T03:56:23.132 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4193792 len 4096 2024-09-21T03:56:23.132 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4193792 len 4096 2024-09-21T03:56:23.132 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4193792 len 4096 2024-09-21T03:56:23.132 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4193792 len 8192 2024-09-21T03:56:23.132 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4193792 len 8192 2024-09-21T03:56:23.132 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4193792 len 8192 2024-09-21T03:56:23.132 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4193792 len 8192 2024-09-21T03:56:23.132 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4193792 len 16384 2024-09-21T03:56:23.132 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4193792 len 16384 2024-09-21T03:56:23.132 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4193792 len 16384 2024-09-21T03:56:23.132 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4193792 len 16384 2024-09-21T03:56:23.133 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4194304 len 1024 2024-09-21T03:56:23.133 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4194304 len 1024 2024-09-21T03:56:23.133 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4194304 len 1024 2024-09-21T03:56:23.133 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4194304 len 1024 2024-09-21T03:56:23.268 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:56:23.497 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4194304 len 2048 2024-09-21T03:56:23.497 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4194304 len 2048 2024-09-21T03:56:23.497 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4194304 len 2048 2024-09-21T03:56:23.497 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4194304 len 2048 2024-09-21T03:56:23.497 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4194304 len 4096 2024-09-21T03:56:23.497 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4194304 len 4096 2024-09-21T03:56:23.497 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4194304 len 4096 2024-09-21T03:56:23.498 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4194304 len 4096 2024-09-21T03:56:23.498 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4194304 len 8192 2024-09-21T03:56:23.498 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4194304 len 8192 2024-09-21T03:56:23.498 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4194304 len 8192 2024-09-21T03:56:23.498 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4194304 len 8192 2024-09-21T03:56:23.498 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4194304 len 16384 2024-09-21T03:56:23.498 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4194304 len 16384 2024-09-21T03:56:23.498 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4194304 len 16384 2024-09-21T03:56:23.498 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4194304 len 16384 2024-09-21T03:56:23.498 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4194816 len 1024 2024-09-21T03:56:23.498 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4194816 len 1024 2024-09-21T03:56:23.498 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4194816 len 1024 2024-09-21T03:56:23.498 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4194816 len 1024 2024-09-21T03:56:23.499 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4194816 len 2048 2024-09-21T03:56:23.499 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4194816 len 2048 2024-09-21T03:56:23.499 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4194816 len 2048 2024-09-21T03:56:23.499 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4194816 len 2048 2024-09-21T03:56:23.499 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4194816 len 4096 2024-09-21T03:56:23.499 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4194816 len 4096 2024-09-21T03:56:23.499 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4194816 len 4096 2024-09-21T03:56:23.499 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4194816 len 4096 2024-09-21T03:56:23.499 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4194816 len 8192 2024-09-21T03:56:23.499 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4194816 len 8192 2024-09-21T03:56:23.499 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4194816 len 8192 2024-09-21T03:56:23.499 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4194816 len 8192 2024-09-21T03:56:23.499 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4194816 len 16384 2024-09-21T03:56:23.499 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4194816 len 16384 2024-09-21T03:56:23.500 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4194816 len 16384 2024-09-21T03:56:23.500 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4194816 len 16384 2024-09-21T03:56:23.500 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4195328 len 1024 2024-09-21T03:56:23.500 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4195328 len 1024 2024-09-21T03:56:23.500 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4195328 len 1024 2024-09-21T03:56:23.500 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4195328 len 1024 2024-09-21T03:56:23.500 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4195328 len 2048 2024-09-21T03:56:23.500 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4195328 len 2048 2024-09-21T03:56:23.500 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4195328 len 2048 2024-09-21T03:56:23.500 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4195328 len 2048 2024-09-21T03:56:23.500 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4195328 len 4096 2024-09-21T03:56:23.500 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4195328 len 4096 2024-09-21T03:56:23.500 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4195328 len 4096 2024-09-21T03:56:23.500 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4195328 len 4096 2024-09-21T03:56:23.501 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4195328 len 8192 2024-09-21T03:56:23.501 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4195328 len 8192 2024-09-21T03:56:23.501 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4195328 len 8192 2024-09-21T03:56:23.501 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4195328 len 8192 2024-09-21T03:56:23.501 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4195328 len 16384 2024-09-21T03:56:23.501 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4195328 len 16384 2024-09-21T03:56:23.501 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4195328 len 16384 2024-09-21T03:56:23.501 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4195328 len 16384 2024-09-21T03:56:23.501 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4195840 len 1024 2024-09-21T03:56:23.501 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4195840 len 1024 2024-09-21T03:56:23.501 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4195840 len 1024 2024-09-21T03:56:23.501 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4195840 len 1024 2024-09-21T03:56:23.501 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4195840 len 2048 2024-09-21T03:56:23.501 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4195840 len 2048 2024-09-21T03:56:23.501 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4195840 len 2048 2024-09-21T03:56:23.502 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4195840 len 2048 2024-09-21T03:56:23.502 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4195840 len 4096 2024-09-21T03:56:23.502 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4195840 len 4096 2024-09-21T03:56:23.502 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4195840 len 4096 2024-09-21T03:56:23.502 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4195840 len 4096 2024-09-21T03:56:23.502 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4195840 len 8192 2024-09-21T03:56:23.502 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4195840 len 8192 2024-09-21T03:56:23.502 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4195840 len 8192 2024-09-21T03:56:23.502 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4195840 len 8192 2024-09-21T03:56:23.502 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4195840 len 16384 2024-09-21T03:56:23.502 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4195840 len 16384 2024-09-21T03:56:23.502 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4195840 len 16384 2024-09-21T03:56:23.502 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4195840 len 16384 2024-09-21T03:56:23.503 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4196352 len 1024 2024-09-21T03:56:23.503 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4196352 len 1024 2024-09-21T03:56:23.503 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4196352 len 1024 2024-09-21T03:56:23.503 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4196352 len 1024 2024-09-21T03:56:23.503 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4196352 len 2048 2024-09-21T03:56:23.503 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4196352 len 2048 2024-09-21T03:56:23.503 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:23 smithi046 ceph-mon[30954]: pgmap v360: 97 pgs: 97 active+clean; 166 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 1.7 MiB/s wr, 2.90k op/s 2024-09-21T03:56:23.503 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:23 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:56:23.503 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:23 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:56:23.503 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:23 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:56:23.504 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:23 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:56:23.504 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:23 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:56:23.504 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:23 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:56:23.504 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:23 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:56:23.504 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:23 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:56:23.504 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:23 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:56:23.504 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:23 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:56:23.567 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:23 smithi105 ceph-mon[34773]: pgmap v360: 97 pgs: 97 active+clean; 166 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 1.7 MiB/s wr, 2.90k op/s 2024-09-21T03:56:23.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:23 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:56:23.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:23 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:56:23.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:23 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:56:23.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:23 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:56:23.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:23 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:56:23.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:23 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:56:23.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:23 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:56:23.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:23 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:56:23.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:23 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:56:23.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:23 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:56:23.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:23 smithi162 ceph-mon[35071]: pgmap v360: 97 pgs: 97 active+clean; 166 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 1.7 MiB/s wr, 2.90k op/s 2024-09-21T03:56:23.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:23 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:56:23.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:23 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:56:23.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:23 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:56:23.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:23 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:56:23.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:23 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:56:23.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:23 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:56:23.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:23 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:56:23.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:23 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:56:23.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:23 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:56:23.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:23 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:56:23.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.764+0000 7f4ccbf29640 1 -- 172.21.15.46:0/2292776472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cc4103b70 msgr2=0x7f4cc4103f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:23.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.764+0000 7f4ccbf29640 1 --2- 172.21.15.46:0/2292776472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cc4103b70 0x7f4cc4103f80 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0009900 tx=0x7f4cc002a410 comp rx=0 tx=0).stop 2024-09-21T03:56:23.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.764+0000 7f4ccbf29640 1 -- 172.21.15.46:0/2292776472 shutdown_connections 2024-09-21T03:56:23.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.764+0000 7f4ccbf29640 1 --2- 172.21.15.46:0/2292776472 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc4109e00 0x7f4cc4110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.764+0000 7f4ccbf29640 1 --2- 172.21.15.46:0/2292776472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cc41094b0 0x7f4cc41098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.764+0000 7f4ccbf29640 1 --2- 172.21.15.46:0/2292776472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cc4103b70 0x7f4cc4103f80 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.764+0000 7f4ccbf29640 1 -- 172.21.15.46:0/2292776472 >> 172.21.15.46:0/2292776472 conn(0x7f4cc40ff5e0 msgr2=0x7f4cc4101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:23.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.764+0000 7f4ccbf29640 1 -- 172.21.15.46:0/2292776472 shutdown_connections 2024-09-21T03:56:23.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.764+0000 7f4ccbf29640 1 -- 172.21.15.46:0/2292776472 wait complete. 2024-09-21T03:56:23.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.765+0000 7f4ccbf29640 1 Processor -- start 2024-09-21T03:56:23.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.765+0000 7f4ccbf29640 1 -- start start 2024-09-21T03:56:23.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.765+0000 7f4ccbf29640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cc4103b70 0x7f4cc419a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.765+0000 7f4ccbf29640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc41094b0 0x7f4cc419aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.765+0000 7f4ccbf29640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cc4109e00 0x7f4cc419fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.765+0000 7f4ccbf29640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc4113ac0 con 0x7f4cc4109e00 2024-09-21T03:56:23.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.765+0000 7f4ccbf29640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc4113940 con 0x7f4cc41094b0 2024-09-21T03:56:23.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.765+0000 7f4ccbf29640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc4113c40 con 0x7f4cc4103b70 2024-09-21T03:56:23.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.765+0000 7f4cca4c6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cc4109e00 0x7f4cc419fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:23.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.765+0000 7f4cc9cc5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cc4103b70 0x7f4cc419a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:23.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.765+0000 7f4cca4c6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cc4109e00 0x7f4cc419fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34910/0 (socket says 172.21.15.46:34910) 2024-09-21T03:56:23.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.765+0000 7f4cca4c6640 1 -- 172.21.15.46:0/3296587191 learned_addr learned my addr 172.21.15.46:0/3296587191 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:56:23.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.765+0000 7f4cc9cc5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cc4103b70 0x7f4cc419a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:44078/0 (socket says 172.21.15.46:44078) 2024-09-21T03:56:23.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.765+0000 7f4cc94c4640 1 --2- 172.21.15.46:0/3296587191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc41094b0 0x7f4cc419aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:23.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.766+0000 7f4cca4c6640 1 -- 172.21.15.46:0/3296587191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cc4103b70 msgr2=0x7f4cc419a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:23.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.766+0000 7f4cca4c6640 1 --2- 172.21.15.46:0/3296587191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cc4103b70 0x7f4cc419a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.766+0000 7f4cca4c6640 1 -- 172.21.15.46:0/3296587191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc41094b0 msgr2=0x7f4cc419aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:23.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.766+0000 7f4cca4c6640 1 --2- 172.21.15.46:0/3296587191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc41094b0 0x7f4cc419aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.766+0000 7f4cca4c6640 1 -- 172.21.15.46:0/3296587191 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc41a03e0 con 0x7f4cc4109e00 2024-09-21T03:56:23.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.766+0000 7f4cc9cc5640 1 --2- 172.21.15.46:0/3296587191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cc4103b70 0x7f4cc419a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:56:23.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.766+0000 7f4cca4c6640 1 --2- 172.21.15.46:0/3296587191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cc4109e00 0x7f4cc419fcb0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc00eb10 tx=0x7f4cbc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:23.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.766+0000 7f4cbaffd640 1 -- 172.21.15.46:0/3296587191 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc004b20 con 0x7f4cc4109e00 2024-09-21T03:56:23.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.766+0000 7f4cbaffd640 1 -- 172.21.15.46:0/3296587191 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cbc004cc0 con 0x7f4cc4109e00 2024-09-21T03:56:23.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.766+0000 7f4ccbf29640 1 -- 172.21.15.46:0/3296587191 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc41a06d0 con 0x7f4cc4109e00 2024-09-21T03:56:23.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.766+0000 7f4cbaffd640 1 -- 172.21.15.46:0/3296587191 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc010670 con 0x7f4cc4109e00 2024-09-21T03:56:23.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.766+0000 7f4ccbf29640 1 -- 172.21.15.46:0/3296587191 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc41a6e30 con 0x7f4cc4109e00 2024-09-21T03:56:23.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.770+0000 7f4cd249d740 1 Processor -- start 2024-09-21T03:56:23.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.770+0000 7f4cbaffd640 1 -- 172.21.15.46:0/3296587191 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f4cbc005020 con 0x7f4cc4109e00 2024-09-21T03:56:23.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.771+0000 7f4cd249d740 1 -- start start 2024-09-21T03:56:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.771+0000 7f4cd249d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfc286c070 0x55cfc2c13650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.771+0000 7f4cd249d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfc28431b0 0x55cfc2c13b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.771+0000 7f4cd249d740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cfc284b390 0x55cfc2c140d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.771+0000 7f4cd249d740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55cfc2b89e50 con 0x55cfc284b390 2024-09-21T03:56:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.771+0000 7f4cd249d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55cfc2b79280 con 0x55cfc28431b0 2024-09-21T03:56:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.771+0000 7f4cd249d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cfc2b7d090 con 0x55cfc286c070 2024-09-21T03:56:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.771+0000 7f4cc94c4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cfc284b390 0x55cfc2c140d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.771+0000 7f4cc9cc5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfc28431b0 0x55cfc2c13b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.771+0000 7f4cc9cc5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfc28431b0 0x55cfc2c13b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.46:45560/0 (socket says 172.21.15.46:45560) 2024-09-21T03:56:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.771+0000 7f4cc94c4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cfc284b390 0x55cfc2c140d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34912/0 (socket says 172.21.15.46:34912) 2024-09-21T03:56:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.771+0000 7f4cc9cc5640 1 -- 172.21.15.46:0/2793618509 learned_addr learned my addr 172.21.15.46:0/2793618509 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:56:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.771+0000 7f4cc94c4640 1 --2- 172.21.15.46:0/2793618509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfc286c070 0x55cfc2c13650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.771+0000 7f4cbaffd640 1 --2- 172.21.15.46:0/3296587191 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4cb00b6680 0x7f4cb00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.771+0000 7f4cc94c4640 1 -- 172.21.15.46:0/2793618509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfc286c070 msgr2=0x55cfc2c13650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.771+0000 7f4cc94c4640 1 --2- 172.21.15.46:0/2793618509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfc286c070 0x55cfc2c13650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.771+0000 7f4cc94c4640 1 -- 172.21.15.46:0/2793618509 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfc28431b0 msgr2=0x55cfc2c13b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.771+0000 7f4cc94c4640 1 --2- 172.21.15.46:0/2793618509 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfc28431b0 0x55cfc2c13b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.772+0000 7f4cc94c4640 1 -- 172.21.15.46:0/2793618509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfc28d7650 con 0x55cfc284b390 2024-09-21T03:56:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.772+0000 7f4cca4c6640 1 --2- 172.21.15.46:0/3296587191 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4cb00b6680 0x7f4cb00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.772+0000 7f4cbaffd640 1 -- 172.21.15.46:0/3296587191 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f4cbc0e7c90 con 0x7f4cc4109e00 2024-09-21T03:56:23.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.772+0000 7f4cc94c4640 1 --2- 172.21.15.46:0/2793618509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cfc284b390 0x55cfc2c140d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4005d00 tx=0x7f4cb4005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63c82cda46fc005 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:23.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.772+0000 7f4caffff640 1 -- 172.21.15.46:0/2793618509 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4012d20 con 0x55cfc284b390 2024-09-21T03:56:23.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.772+0000 7f4caffff640 1 -- 172.21.15.46:0/2793618509 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cb40054d0 con 0x55cfc284b390 2024-09-21T03:56:23.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.772+0000 7f4caffff640 1 -- 172.21.15.46:0/2793618509 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4010740 con 0x55cfc284b390 2024-09-21T03:56:23.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.773+0000 7f4cd249d740 1 -- 172.21.15.46:0/2793618509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cfc284b390 msgr2=0x55cfc2c140d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:23.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.773+0000 7f4cca4c6640 1 --2- 172.21.15.46:0/3296587191 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4cb00b6680 0x7f4cb00b8b90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc0aadb0 tx=0x7f4cbc00efd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:23.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.773+0000 7f4cd249d740 1 --2- 172.21.15.46:0/2793618509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cfc284b390 0x55cfc2c140d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4005d00 tx=0x7f4cb4005c90 comp rx=0 tx=0).stop 2024-09-21T03:56:23.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.773+0000 7f4cd249d740 1 -- 172.21.15.46:0/2793618509 shutdown_connections 2024-09-21T03:56:23.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.773+0000 7f4cd249d740 1 --2- 172.21.15.46:0/2793618509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cfc284b390 0x55cfc2c140d0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.773+0000 7f4cd249d740 1 --2- 172.21.15.46:0/2793618509 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfc28431b0 0x55cfc2c13b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.773+0000 7f4cd249d740 1 --2- 172.21.15.46:0/2793618509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfc286c070 0x55cfc2c13650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.773+0000 7f4cd249d740 1 -- 172.21.15.46:0/2793618509 >> 172.21.15.46:0/2793618509 conn(0x55cfc2860460 msgr2=0x55cfc2c11540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:23.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.773+0000 7f4cd249d740 1 -- 172.21.15.46:0/2793618509 shutdown_connections 2024-09-21T03:56:23.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.773+0000 7f4cd249d740 1 -- 172.21.15.46:0/2793618509 wait complete. 2024-09-21T03:56:23.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.774+0000 7f4cd249d740 1 -- start start 2024-09-21T03:56:23.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.774+0000 7f4cd249d740 1 Processor -- start 2024-09-21T03:56:23.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.774+0000 7f4cd249d740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cfc28431b0 0x55cfc2c23110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.774+0000 7f4cd249d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfc284b390 0x55cfc2c23650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.774+0000 7f4cd249d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfc286c070 0x55cfc2c2f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.774+0000 7f4cd249d740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55cfc29da700 con 0x55cfc28431b0 2024-09-21T03:56:23.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.774+0000 7f4cd249d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55cfc2b14110 con 0x55cfc286c070 2024-09-21T03:56:23.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.774+0000 7f4cd249d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cfc2c26130 con 0x55cfc284b390 2024-09-21T03:56:23.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.774+0000 7f4cd249d740 10 client.0 _ll_register_callbacks cb 0x55cfc2b2d990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:56:23.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.774+0000 7f4cc94c4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cfc28431b0 0x55cfc2c23110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:23.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.775+0000 7f4cc94c4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cfc28431b0 0x55cfc2c23110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34920/0 (socket says 172.21.15.46:34920) 2024-09-21T03:56:23.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.775+0000 7f4cc94c4640 1 -- 172.21.15.46:0/2730084781 learned_addr learned my addr 172.21.15.46:0/2730084781 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:56:23.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.775+0000 7f4cc9cc5640 1 --2- 172.21.15.46:0/2730084781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfc284b390 0x55cfc2c23650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:23.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.775+0000 7f4cc94c4640 1 --2- 172.21.15.46:0/2730084781 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfc286c070 0x55cfc2c2f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:23.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.775+0000 7f4cc94c4640 1 -- 172.21.15.46:0/2730084781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfc284b390 msgr2=0x55cfc2c23650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:23.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.775+0000 7f4cc94c4640 1 --2- 172.21.15.46:0/2730084781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfc284b390 0x55cfc2c23650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.775+0000 7f4cc94c4640 1 -- 172.21.15.46:0/2730084781 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfc286c070 msgr2=0x55cfc2c2f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:23.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.775+0000 7f4cc94c4640 1 --2- 172.21.15.46:0/2730084781 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfc286c070 0x55cfc2c2f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.775+0000 7f4cc94c4640 1 -- 172.21.15.46:0/2730084781 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfc2b41c40 con 0x55cfc28431b0 2024-09-21T03:56:23.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.775+0000 7f4cc94c4640 1 --2- 172.21.15.46:0/2730084781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cfc28431b0 0x55cfc2c23110 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4cb400b620 tx=0x7f4cb4004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578215615c8c730b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:23.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.775+0000 7f4cad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:56:23.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.775+0000 7f4cad7fa640 1 -- 172.21.15.46:0/2730084781 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4004250 con 0x55cfc28431b0 2024-09-21T03:56:23.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.775+0000 7f4cd249d740 1 -- 172.21.15.46:0/2730084781 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4cb40054d0 con 0x55cfc28431b0 2024-09-21T03:56:23.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.775+0000 7f4cad7fa640 1 -- 172.21.15.46:0/2730084781 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f4cb40043f0 con 0x55cfc28431b0 2024-09-21T03:56:23.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.776+0000 7f4cad7fa640 1 -- 172.21.15.46:0/2730084781 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4cb4004d20 con 0x55cfc28431b0 2024-09-21T03:56:23.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.776+0000 7f4cd249d740 10 client.15663 fetch_fsmap learned FSMap version 20 2024-09-21T03:56:23.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.776+0000 7f4cd249d740 1 -- 172.21.15.46:0/2730084781 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55cfc2c31e70 con 0x55cfc28431b0 2024-09-21T03:56:23.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.776+0000 7f4cad7fa640 1 -- 172.21.15.46:0/2730084781 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cb40054d0 con 0x55cfc28431b0 2024-09-21T03:56:23.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.776+0000 7f4cad7fa640 1 -- 172.21.15.46:0/2730084781 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f4cb4010ce0 con 0x55cfc28431b0 2024-09-21T03:56:23.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.776+0000 7f4cd249d740 10 client.15663 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:56:23.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.776+0000 7f4cd249d740 10 client.15663 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:56:23.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.776+0000 7f4cd249d740 20 client.15663 populate_metadata read hostname 'smithi046' 2024-09-21T03:56:23.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.776+0000 7f4cd249d740 1 --2- 172.21.15.46:0/2730084781 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55cfc282a9f0 0x55cfc2c351d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.776+0000 7f4cd249d740 4 client.15663 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:56:23.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.776+0000 7f4cd249d740 1 -- 172.21.15.46:0/2730084781 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cfc2b8bda0 con 0x55cfc282a9f0 2024-09-21T03:56:23.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.777+0000 7f4cc9cc5640 1 --2- 172.21.15.46:0/2730084781 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55cfc282a9f0 0x55cfc2c351d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:23.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.777+0000 7f4cad7fa640 10 client.15663 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:56:23.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.777+0000 7f4cc9cc5640 1 --2- 172.21.15.46:0/2730084781 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55cfc282a9f0 0x55cfc2c351d0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9224f367273e7239 server_cookie=deebf2bead6f5d5d in_seq=0 out_seq=0 2024-09-21T03:56:23.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.778+0000 7f4cad7fa640 1 -- 172.21.15.46:0/2730084781 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cfc2b8bda0 con 0x55cfc282a9f0 2024-09-21T03:56:23.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.778+0000 7f4cad7fa640 10 client.15663 handle_command_reply: tid=0 2024-09-21T03:56:23.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.778+0000 7f4cd249d740 1 client.15663 shutdown 2024-09-21T03:56:23.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.778+0000 7f4cd249d740 1 -- 172.21.15.46:0/2730084781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cfc28431b0 msgr2=0x55cfc2c23110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:23.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.778+0000 7f4cd249d740 1 --2- 172.21.15.46:0/2730084781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cfc28431b0 0x55cfc2c23110 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4cb400b620 tx=0x7f4cb4004c80 comp rx=0 tx=0).stop 2024-09-21T03:56:23.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.778+0000 7f4cd249d740 1 -- 172.21.15.46:0/2730084781 shutdown_connections 2024-09-21T03:56:23.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.778+0000 7f4cd249d740 1 --2- 172.21.15.46:0/2730084781 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55cfc282a9f0 0x55cfc2c351d0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.778+0000 7f4cd249d740 1 --2- 172.21.15.46:0/2730084781 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfc286c070 0x55cfc2c2f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.778+0000 7f4cd249d740 1 --2- 172.21.15.46:0/2730084781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfc284b390 0x55cfc2c23650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.778+0000 7f4cad7fa640 0 client.15663 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:56:23.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.778+0000 7f4cd249d740 1 --2- 172.21.15.46:0/2730084781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cfc28431b0 0x55cfc2c23110 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.778+0000 7f4cd249d740 1 -- 172.21.15.46:0/2730084781 >> 172.21.15.46:0/2730084781 conn(0x55cfc2860460 msgr2=0x55cfc2c0fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:23.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.778+0000 7f4cd249d740 1 -- 172.21.15.46:0/2730084781 shutdown_connections 2024-09-21T03:56:23.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.778+0000 7f4cd249d740 1 -- 172.21.15.46:0/2730084781 wait complete. 2024-09-21T03:56:23.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.778+0000 7f4cd249d740 20 client.15663 trim_cache size 0 max 16384 2024-09-21T03:56:23.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.797+0000 7f4cd249d740 1 Processor -- start 2024-09-21T03:56:23.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.797+0000 7f4cd249d740 1 -- start start 2024-09-21T03:56:23.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.797+0000 7f4cd249d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfc282a9f0 0x55cfc2c24ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.797+0000 7f4cd249d740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cfc28431b0 0x55cfc2c2f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.797+0000 7f4cd249d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfc284b390 0x55cfc2c14d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.797+0000 7f4cd249d740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc41ab2f0 con 0x55cfc28431b0 2024-09-21T03:56:23.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.797+0000 7f4cd249d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc41adb50 con 0x55cfc284b390 2024-09-21T03:56:23.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.797+0000 7f4cd249d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc41ab940 con 0x55cfc282a9f0 2024-09-21T03:56:23.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.798+0000 7f4cc9cc5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cfc28431b0 0x55cfc2c2f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:23.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.798+0000 7f4cc9cc5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cfc28431b0 0x55cfc2c2f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34936/0 (socket says 172.21.15.46:34936) 2024-09-21T03:56:23.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.798+0000 7f4cc9cc5640 1 -- 172.21.15.46:0/2253752235 learned_addr learned my addr 172.21.15.46:0/2253752235 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:56:23.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.798+0000 7f4cc94c4640 1 --2- 172.21.15.46:0/2253752235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfc282a9f0 0x55cfc2c24ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:23.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.798+0000 7f4cc94c4640 1 --2- 172.21.15.46:0/2253752235 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfc284b390 0x55cfc2c14d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:23.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.798+0000 7f4cc94c4640 1 -- 172.21.15.46:0/2253752235 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfc284b390 msgr2=0x55cfc2c14d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:23.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.798+0000 7f4cc94c4640 1 --2- 172.21.15.46:0/2253752235 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfc284b390 0x55cfc2c14d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.798+0000 7f4cc94c4640 1 -- 172.21.15.46:0/2253752235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cfc28431b0 msgr2=0x55cfc2c2f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:23.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.798+0000 7f4cc94c4640 1 --2- 172.21.15.46:0/2253752235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cfc28431b0 0x55cfc2c2f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.798+0000 7f4cc94c4640 1 -- 172.21.15.46:0/2253752235 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfc2c14440 con 0x55cfc282a9f0 2024-09-21T03:56:23.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.798+0000 7f4cc9cc5640 1 --2- 172.21.15.46:0/2253752235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cfc28431b0 0x55cfc2c2f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:56:23.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.798+0000 7f4cc94c4640 1 --2- 172.21.15.46:0/2253752235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfc282a9f0 0x55cfc2c24ff0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4cb400b6b0 tx=0x7f4cb4001e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b58c05ed2184c4eb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:23.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.799+0000 7f4caf7fe640 1 -- 172.21.15.46:0/2253752235 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb40054d0 con 0x55cfc282a9f0 2024-09-21T03:56:23.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.799+0000 7f4caf7fe640 1 -- 172.21.15.46:0/2253752235 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cb4031070 con 0x55cfc282a9f0 2024-09-21T03:56:23.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.799+0000 7f4caf7fe640 1 -- 172.21.15.46:0/2253752235 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4004250 con 0x55cfc282a9f0 2024-09-21T03:56:23.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.799+0000 7f4cd249d740 1 -- 172.21.15.46:0/2253752235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfc282a9f0 msgr2=0x55cfc2c24ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:23.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.799+0000 7f4cd249d740 1 --2- 172.21.15.46:0/2253752235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfc282a9f0 0x55cfc2c24ff0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4cb400b6b0 tx=0x7f4cb4001e50 comp rx=0 tx=0).stop 2024-09-21T03:56:23.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.800+0000 7f4cd249d740 1 -- 172.21.15.46:0/2253752235 shutdown_connections 2024-09-21T03:56:23.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.800+0000 7f4cd249d740 1 --2- 172.21.15.46:0/2253752235 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfc284b390 0x55cfc2c14d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.800+0000 7f4cd249d740 1 --2- 172.21.15.46:0/2253752235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cfc28431b0 0x55cfc2c2f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.800+0000 7f4cd249d740 1 --2- 172.21.15.46:0/2253752235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfc282a9f0 0x55cfc2c24ff0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.800+0000 7f4cd249d740 1 -- 172.21.15.46:0/2253752235 >> 172.21.15.46:0/2253752235 conn(0x55cfc2860460 msgr2=0x55cfc2c14630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:23.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.800+0000 7f4cd249d740 1 -- 172.21.15.46:0/2253752235 shutdown_connections 2024-09-21T03:56:23.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.800+0000 7f4cd249d740 1 -- 172.21.15.46:0/2253752235 wait complete. 2024-09-21T03:56:23.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.800+0000 7f4cd249d740 1 -- start start 2024-09-21T03:56:23.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.800+0000 7f4cd249d740 1 Processor -- start 2024-09-21T03:56:23.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.801+0000 7f4cd249d740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cfc282a9f0 0x55cfc2c29330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.801+0000 7f4cd249d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfc28431b0 0x55cfc2c29870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.801+0000 7f4cd249d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfc284b390 0x55cfc2c29db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.801+0000 7f4cd249d740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc41ac010 con 0x55cfc282a9f0 2024-09-21T03:56:23.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.801+0000 7f4cd249d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc41ad480 con 0x55cfc284b390 2024-09-21T03:56:23.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.801+0000 7f4cd249d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc41ac6e0 con 0x55cfc28431b0 2024-09-21T03:56:23.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.801+0000 7f4cd249d740 10 client.0 _ll_register_callbacks cb 0x7f4cc0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:56:23.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.801+0000 7f4cc9cc5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfc28431b0 0x55cfc2c29870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:23.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.801+0000 7f4cc94c4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cfc282a9f0 0x55cfc2c29330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:23.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.801+0000 7f4cc9cc5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfc28431b0 0x55cfc2c29870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:44128/0 (socket says 172.21.15.46:44128) 2024-09-21T03:56:23.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.801+0000 7f4cc9cc5640 1 -- 172.21.15.46:0/207182216 learned_addr learned my addr 172.21.15.46:0/207182216 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:56:23.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.801+0000 7f4cc94c4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cfc282a9f0 0x55cfc2c29330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34938/0 (socket says 172.21.15.46:34938) 2024-09-21T03:56:23.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.801+0000 7f4cc94c4640 1 --2- 172.21.15.46:0/207182216 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfc284b390 0x55cfc2c29db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:23.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.801+0000 7f4cc9cc5640 1 -- 172.21.15.46:0/207182216 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfc284b390 msgr2=0x55cfc2c29db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:23.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.801+0000 7f4cc9cc5640 1 --2- 172.21.15.46:0/207182216 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfc284b390 0x55cfc2c29db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.801+0000 7f4cc9cc5640 1 -- 172.21.15.46:0/207182216 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cfc282a9f0 msgr2=0x55cfc2c29330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:23.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.801+0000 7f4cc9cc5640 1 --2- 172.21.15.46:0/207182216 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cfc282a9f0 0x55cfc2c29330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.801+0000 7f4cc9cc5640 1 -- 172.21.15.46:0/207182216 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfc2c9e9e0 con 0x55cfc28431b0 2024-09-21T03:56:23.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.801+0000 7f4cc94c4640 1 --2- 172.21.15.46:0/207182216 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfc284b390 0x55cfc2c29db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:56:23.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.801+0000 7f4cc9cc5640 1 --2- 172.21.15.46:0/207182216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfc28431b0 0x55cfc2c29870 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0009230 tx=0x7f4cc0004320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c2ab4fcbef68926 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:23.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.801+0000 7f4cad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T03:56:23.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.802+0000 7f4cad7fa640 1 -- 172.21.15.46:0/207182216 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc0035040 con 0x55cfc28431b0 2024-09-21T03:56:23.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.802+0000 7f4cad7fa640 1 -- 172.21.15.46:0/207182216 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f4cc0005450 con 0x55cfc28431b0 2024-09-21T03:56:23.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.802+0000 7f4cd249d740 1 -- 172.21.15.46:0/207182216 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4cb4031070 con 0x55cfc28431b0 2024-09-21T03:56:23.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.802+0000 7f4cad7fa640 1 -- 172.21.15.46:0/207182216 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4cc0053030 con 0x55cfc28431b0 2024-09-21T03:56:23.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.802+0000 7f4cd249d740 10 client.25354 fetch_fsmap learned FSMap version 20 2024-09-21T03:56:23.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.802+0000 7f4cd249d740 1 -- 172.21.15.46:0/207182216 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55cfc2c9fc10 con 0x55cfc28431b0 2024-09-21T03:56:23.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.802+0000 7f4cad7fa640 1 -- 172.21.15.46:0/207182216 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cb4031070 con 0x55cfc28431b0 2024-09-21T03:56:23.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.802+0000 7f4cad7fa640 1 -- 172.21.15.46:0/207182216 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f4cc00318e0 con 0x55cfc28431b0 2024-09-21T03:56:23.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.802+0000 7f4cd249d740 10 client.25354 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:56:23.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.802+0000 7f4cd249d740 10 client.25354 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:56:23.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.802+0000 7f4cd249d740 20 client.25354 populate_metadata read hostname 'smithi046' 2024-09-21T03:56:23.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.802+0000 7f4cd249d740 1 --2- 172.21.15.46:0/207182216 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55cfc286c070 0x55cfc2ca2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:23.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.802+0000 7f4cd249d740 4 client.25354 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:56:23.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.802+0000 7f4cd249d740 1 -- 172.21.15.46:0/207182216 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cfc2b87850 con 0x55cfc286c070 2024-09-21T03:56:23.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.803+0000 7f4cc94c4640 1 --2- 172.21.15.46:0/207182216 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55cfc286c070 0x55cfc2ca2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:23.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.803+0000 7f4cad7fa640 10 client.25354 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:56:23.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.803+0000 7f4cc94c4640 1 --2- 172.21.15.46:0/207182216 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55cfc286c070 0x55cfc2ca2450 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79da386fe3f7659c server_cookie=afa9508eeb2d37b6 in_seq=0 out_seq=0 2024-09-21T03:56:23.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.803+0000 7f4cad7fa640 1 -- 172.21.15.46:0/207182216 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+942 (crc 0 0 0) 0x55cfc2b87850 con 0x55cfc286c070 2024-09-21T03:56:23.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.803+0000 7f4cad7fa640 10 client.25354 handle_command_reply: tid=0 2024-09-21T03:56:23.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.803+0000 7f4cd249d740 1 client.25354 shutdown 2024-09-21T03:56:23.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.803+0000 7f4cd249d740 1 -- 172.21.15.46:0/207182216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfc28431b0 msgr2=0x55cfc2c29870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:23.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.803+0000 7f4cd249d740 1 --2- 172.21.15.46:0/207182216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfc28431b0 0x55cfc2c29870 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0009230 tx=0x7f4cc0004320 comp rx=0 tx=0).stop 2024-09-21T03:56:23.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.804+0000 7f4cd249d740 1 -- 172.21.15.46:0/207182216 shutdown_connections 2024-09-21T03:56:23.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.804+0000 7f4cd249d740 1 --2- 172.21.15.46:0/207182216 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55cfc286c070 0x55cfc2ca2450 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.804+0000 7f4cd249d740 1 --2- 172.21.15.46:0/207182216 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfc284b390 0x55cfc2c29db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.804+0000 7f4cd249d740 1 --2- 172.21.15.46:0/207182216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cfc28431b0 0x55cfc2c29870 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.804+0000 7f4cd249d740 1 --2- 172.21.15.46:0/207182216 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cfc282a9f0 0x55cfc2c29330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.804+0000 7f4cad7fa640 0 client.25354 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:56:23.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.804+0000 7f4cd249d740 1 -- 172.21.15.46:0/207182216 >> 172.21.15.46:0/207182216 conn(0x55cfc2860460 msgr2=0x55cfc2c243d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:23.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.804+0000 7f4cd249d740 1 -- 172.21.15.46:0/207182216 shutdown_connections 2024-09-21T03:56:23.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.804+0000 7f4cd249d740 1 -- 172.21.15.46:0/207182216 wait complete. 2024-09-21T03:56:23.810 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T03:56:23.810 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "no active scrubs running", 2024-09-21T03:56:23.810 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": {}, 2024-09-21T03:56:23.810 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_stats": { 2024-09-21T03:56:23.810 INFO:teuthology.orchestra.run.smithi046.stdout: "d49f33a7-3d5a-421b-94ba-8b19a4120db1": { 2024-09-21T03:56:23.811 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:50.480786+0000", 2024-09-21T03:56:23.811 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:56:23.811 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:56:23.811 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:56:23.811 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:56:23.811 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:56:23.811 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:56:23.811 INFO:teuthology.orchestra.run.smithi046.stdout: "3bbf7097-70d7-4743-bbce-41465502b35b": { 2024-09-21T03:56:23.811 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:10.661441+0000", 2024-09-21T03:56:23.811 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:56:23.811 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:56:23.811 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:56:23.811 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:56:23.811 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:56:23.812 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:56:23.812 INFO:teuthology.orchestra.run.smithi046.stdout: "08f0c962-df1a-4129-a1a2-b916240d9803": { 2024-09-21T03:56:23.812 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:02.937596+0000", 2024-09-21T03:56:23.812 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:56:23.812 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:56:23.812 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:56:23.812 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:56:23.812 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:56:23.812 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:56:23.812 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:56:23.812 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T03:56:23.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.804+0000 7f4cd249d740 20 client.25354 trim_cache size 0 max 16384 2024-09-21T03:56:23.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.805+0000 7f4ccbf29640 1 -- 172.21.15.46:0/3296587191 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4cb00b6680 msgr2=0x7f4cb00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:23.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.805+0000 7f4ccbf29640 1 --2- 172.21.15.46:0/3296587191 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4cb00b6680 0x7f4cb00b8b90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc0aadb0 tx=0x7f4cbc00efd0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.805+0000 7f4ccbf29640 1 -- 172.21.15.46:0/3296587191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cc4109e00 msgr2=0x7f4cc419fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:23.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.805+0000 7f4ccbf29640 1 --2- 172.21.15.46:0/3296587191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cc4109e00 0x7f4cc419fcb0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc00eb10 tx=0x7f4cbc00c2d0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.805+0000 7f4ccbf29640 1 -- 172.21.15.46:0/3296587191 shutdown_connections 2024-09-21T03:56:23.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.805+0000 7f4ccbf29640 1 --2- 172.21.15.46:0/3296587191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cc4109e00 0x7f4cc419fcb0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.805+0000 7f4ccbf29640 1 --2- 172.21.15.46:0/3296587191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc41094b0 0x7f4cc419aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.805+0000 7f4ccbf29640 1 --2- 172.21.15.46:0/3296587191 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4cb00b6680 0x7f4cb00b8b90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.805+0000 7f4ccbf29640 1 --2- 172.21.15.46:0/3296587191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cc4103b70 0x7f4cc419a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:23.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.805+0000 7f4ccbf29640 1 -- 172.21.15.46:0/3296587191 >> 172.21.15.46:0/3296587191 conn(0x7f4cc40ff5e0 msgr2=0x7f4cc4101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:23.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.805+0000 7f4ccbf29640 1 -- 172.21.15.46:0/3296587191 shutdown_connections 2024-09-21T03:56:23.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:23.805+0000 7f4ccbf29640 1 -- 172.21.15.46:0/3296587191 wait complete. 2024-09-21T03:56:23.891 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4196352 len 2048 2024-09-21T03:56:23.891 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4196352 len 2048 2024-09-21T03:56:23.892 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4196352 len 4096 2024-09-21T03:56:23.892 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4196352 len 4096 2024-09-21T03:56:23.892 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4196352 len 4096 2024-09-21T03:56:23.892 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4196352 len 4096 2024-09-21T03:56:23.892 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4196352 len 8192 2024-09-21T03:56:23.892 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4196352 len 8192 2024-09-21T03:56:23.893 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4196352 len 8192 2024-09-21T03:56:23.893 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4196352 len 8192 2024-09-21T03:56:23.893 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4196352 len 16384 2024-09-21T03:56:23.894 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4196352 len 16384 2024-09-21T03:56:23.894 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4196352 len 16384 2024-09-21T03:56:23.894 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4196352 len 16384 2024-09-21T03:56:23.894 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4196864 len 1024 2024-09-21T03:56:23.894 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4196864 len 1024 2024-09-21T03:56:23.894 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4196864 len 1024 2024-09-21T03:56:23.894 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4196864 len 1024 2024-09-21T03:56:23.894 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4196864 len 2048 2024-09-21T03:56:23.894 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4196864 len 2048 2024-09-21T03:56:23.894 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4196864 len 2048 2024-09-21T03:56:23.894 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4196864 len 2048 2024-09-21T03:56:23.894 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4196864 len 4096 2024-09-21T03:56:23.894 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4196864 len 4096 2024-09-21T03:56:23.895 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4196864 len 4096 2024-09-21T03:56:23.895 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4196864 len 4096 2024-09-21T03:56:23.895 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4196864 len 8192 2024-09-21T03:56:23.895 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4196864 len 8192 2024-09-21T03:56:23.895 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4196864 len 8192 2024-09-21T03:56:23.895 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4196864 len 8192 2024-09-21T03:56:23.895 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4196864 len 16384 2024-09-21T03:56:23.895 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4196864 len 16384 2024-09-21T03:56:23.895 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4196864 len 16384 2024-09-21T03:56:23.895 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4196864 len 16384 2024-09-21T03:56:23.895 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4197376 len 1024 2024-09-21T03:56:23.895 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4197376 len 1024 2024-09-21T03:56:23.895 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4197376 len 1024 2024-09-21T03:56:23.895 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4197376 len 1024 2024-09-21T03:56:23.896 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4197376 len 2048 2024-09-21T03:56:23.896 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4197376 len 2048 2024-09-21T03:56:23.896 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4197376 len 2048 2024-09-21T03:56:23.896 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4197376 len 2048 2024-09-21T03:56:23.896 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4197376 len 4096 2024-09-21T03:56:23.896 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4197376 len 4096 2024-09-21T03:56:23.896 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4197376 len 4096 2024-09-21T03:56:23.896 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4197376 len 4096 2024-09-21T03:56:23.896 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4197376 len 8192 2024-09-21T03:56:23.896 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4197376 len 8192 2024-09-21T03:56:23.897 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4197376 len 8192 2024-09-21T03:56:23.897 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4197376 len 8192 2024-09-21T03:56:23.897 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4197376 len 16384 2024-09-21T03:56:23.897 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4197376 len 16384 2024-09-21T03:56:23.897 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4197376 len 16384 2024-09-21T03:56:23.897 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4197376 len 16384 2024-09-21T03:56:23.897 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4197888 len 1024 2024-09-21T03:56:23.897 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4197888 len 1024 2024-09-21T03:56:23.897 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4197888 len 1024 2024-09-21T03:56:23.897 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4197888 len 1024 2024-09-21T03:56:23.897 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4197888 len 2048 2024-09-21T03:56:23.897 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4197888 len 2048 2024-09-21T03:56:23.897 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4197888 len 2048 2024-09-21T03:56:23.897 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4197888 len 2048 2024-09-21T03:56:23.898 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4197888 len 4096 2024-09-21T03:56:23.898 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4197888 len 4096 2024-09-21T03:56:23.898 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4197888 len 4096 2024-09-21T03:56:23.898 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4197888 len 4096 2024-09-21T03:56:23.898 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4197888 len 8192 2024-09-21T03:56:23.898 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4197888 len 8192 2024-09-21T03:56:23.898 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4197888 len 8192 2024-09-21T03:56:23.898 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4197888 len 8192 2024-09-21T03:56:23.898 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 512 offset 4197888 len 16384 2024-09-21T03:56:23.898 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4197888 len 16384 2024-09-21T03:56:23.898 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 512 offset 4197888 len 16384 2024-09-21T03:56:23.898 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 512 offset 4197888 len 16384 2024-09-21T03:56:23.898 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4190720 len 1024 2024-09-21T03:56:23.899 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4190720 len 1024 2024-09-21T03:56:23.899 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4190720 len 1024 2024-09-21T03:56:23.899 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4190720 len 1024 2024-09-21T03:56:23.899 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4190720 len 2048 2024-09-21T03:56:23.899 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4190720 len 2048 2024-09-21T03:56:23.899 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4190720 len 2048 2024-09-21T03:56:23.899 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4190720 len 2048 2024-09-21T03:56:23.899 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4190720 len 4096 2024-09-21T03:56:24.427 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4190720 len 4096 2024-09-21T03:56:24.428 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4190720 len 4096 2024-09-21T03:56:24.428 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4190720 len 4096 2024-09-21T03:56:24.428 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4190720 len 8192 2024-09-21T03:56:24.428 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4190720 len 8192 2024-09-21T03:56:24.428 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4190720 len 8192 2024-09-21T03:56:24.428 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4190720 len 8192 2024-09-21T03:56:24.428 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4190720 len 16384 2024-09-21T03:56:24.428 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4190720 len 16384 2024-09-21T03:56:24.428 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4190720 len 16384 2024-09-21T03:56:24.428 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4190720 len 16384 2024-09-21T03:56:24.428 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4191232 len 1024 2024-09-21T03:56:24.428 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4191232 len 1024 2024-09-21T03:56:24.429 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4191232 len 1024 2024-09-21T03:56:24.429 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4191232 len 1024 2024-09-21T03:56:24.429 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4191232 len 2048 2024-09-21T03:56:24.429 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4191232 len 2048 2024-09-21T03:56:24.429 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4191232 len 2048 2024-09-21T03:56:24.429 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4191232 len 2048 2024-09-21T03:56:24.429 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4191232 len 4096 2024-09-21T03:56:24.429 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4191232 len 4096 2024-09-21T03:56:24.429 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4191232 len 4096 2024-09-21T03:56:24.429 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4191232 len 4096 2024-09-21T03:56:24.429 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4191232 len 8192 2024-09-21T03:56:24.429 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4191232 len 8192 2024-09-21T03:56:24.430 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4191232 len 8192 2024-09-21T03:56:24.430 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4191232 len 8192 2024-09-21T03:56:24.430 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4191232 len 16384 2024-09-21T03:56:24.430 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4191232 len 16384 2024-09-21T03:56:24.430 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4191232 len 16384 2024-09-21T03:56:24.430 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4191232 len 16384 2024-09-21T03:56:24.430 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4191744 len 1024 2024-09-21T03:56:24.430 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4191744 len 1024 2024-09-21T03:56:24.430 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4191744 len 1024 2024-09-21T03:56:24.430 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4191744 len 1024 2024-09-21T03:56:24.430 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4191744 len 2048 2024-09-21T03:56:24.430 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4191744 len 2048 2024-09-21T03:56:24.431 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4191744 len 2048 2024-09-21T03:56:24.431 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4191744 len 2048 2024-09-21T03:56:24.431 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4191744 len 4096 2024-09-21T03:56:24.431 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4191744 len 4096 2024-09-21T03:56:24.431 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4191744 len 4096 2024-09-21T03:56:24.431 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4191744 len 4096 2024-09-21T03:56:24.431 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4191744 len 8192 2024-09-21T03:56:24.431 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4191744 len 8192 2024-09-21T03:56:24.431 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4191744 len 8192 2024-09-21T03:56:24.431 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4191744 len 8192 2024-09-21T03:56:24.431 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4191744 len 16384 2024-09-21T03:56:24.431 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4191744 len 16384 2024-09-21T03:56:24.432 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4191744 len 16384 2024-09-21T03:56:24.432 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4191744 len 16384 2024-09-21T03:56:24.432 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4192256 len 1024 2024-09-21T03:56:24.432 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4192256 len 1024 2024-09-21T03:56:24.432 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4192256 len 1024 2024-09-21T03:56:24.432 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4192256 len 1024 2024-09-21T03:56:24.432 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4192256 len 2048 2024-09-21T03:56:24.432 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4192256 len 2048 2024-09-21T03:56:24.432 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4192256 len 2048 2024-09-21T03:56:24.432 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4192256 len 2048 2024-09-21T03:56:24.432 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4192256 len 4096 2024-09-21T03:56:24.433 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4192256 len 4096 2024-09-21T03:56:24.433 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4192256 len 4096 2024-09-21T03:56:24.433 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4192256 len 4096 2024-09-21T03:56:24.433 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4192256 len 8192 2024-09-21T03:56:24.433 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4192256 len 8192 2024-09-21T03:56:24.433 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4192256 len 8192 2024-09-21T03:56:24.433 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4192256 len 8192 2024-09-21T03:56:24.433 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4192256 len 16384 2024-09-21T03:56:24.433 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4192256 len 16384 2024-09-21T03:56:24.433 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4192256 len 16384 2024-09-21T03:56:24.433 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4192256 len 16384 2024-09-21T03:56:24.433 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4192768 len 1024 2024-09-21T03:56:24.434 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4192768 len 1024 2024-09-21T03:56:24.434 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4192768 len 1024 2024-09-21T03:56:24.434 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4192768 len 1024 2024-09-21T03:56:24.434 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4192768 len 2048 2024-09-21T03:56:24.434 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4192768 len 2048 2024-09-21T03:56:24.434 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4192768 len 2048 2024-09-21T03:56:24.434 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4192768 len 2048 2024-09-21T03:56:24.434 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4192768 len 4096 2024-09-21T03:56:24.627 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:56:24.627 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:56:24.922 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4192768 len 4096 2024-09-21T03:56:24.922 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4192768 len 4096 2024-09-21T03:56:24.922 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4192768 len 4096 2024-09-21T03:56:24.922 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4192768 len 8192 2024-09-21T03:56:24.923 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4192768 len 8192 2024-09-21T03:56:24.923 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4192768 len 8192 2024-09-21T03:56:24.923 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4192768 len 8192 2024-09-21T03:56:24.923 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4192768 len 16384 2024-09-21T03:56:24.923 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4192768 len 16384 2024-09-21T03:56:24.923 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4192768 len 16384 2024-09-21T03:56:24.923 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4192768 len 16384 2024-09-21T03:56:24.923 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4193280 len 1024 2024-09-21T03:56:24.923 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4193280 len 1024 2024-09-21T03:56:24.923 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4193280 len 1024 2024-09-21T03:56:24.923 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4193280 len 1024 2024-09-21T03:56:24.923 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4193280 len 2048 2024-09-21T03:56:24.923 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4193280 len 2048 2024-09-21T03:56:24.923 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4193280 len 2048 2024-09-21T03:56:24.924 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4193280 len 2048 2024-09-21T03:56:24.924 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4193280 len 4096 2024-09-21T03:56:24.924 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4193280 len 4096 2024-09-21T03:56:24.924 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4193280 len 4096 2024-09-21T03:56:24.924 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4193280 len 4096 2024-09-21T03:56:24.924 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4193280 len 8192 2024-09-21T03:56:24.924 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4193280 len 8192 2024-09-21T03:56:24.924 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4193280 len 8192 2024-09-21T03:56:24.924 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4193280 len 8192 2024-09-21T03:56:24.924 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4193280 len 16384 2024-09-21T03:56:24.924 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4193280 len 16384 2024-09-21T03:56:24.924 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4193280 len 16384 2024-09-21T03:56:24.924 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4193280 len 16384 2024-09-21T03:56:24.924 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4193792 len 1024 2024-09-21T03:56:24.925 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4193792 len 1024 2024-09-21T03:56:24.925 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4193792 len 1024 2024-09-21T03:56:24.925 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4193792 len 1024 2024-09-21T03:56:24.925 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4193792 len 2048 2024-09-21T03:56:24.925 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4193792 len 2048 2024-09-21T03:56:24.925 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4193792 len 2048 2024-09-21T03:56:24.925 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4193792 len 2048 2024-09-21T03:56:24.925 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4193792 len 4096 2024-09-21T03:56:24.925 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4193792 len 4096 2024-09-21T03:56:24.925 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4193792 len 4096 2024-09-21T03:56:24.925 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4193792 len 4096 2024-09-21T03:56:24.925 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4193792 len 8192 2024-09-21T03:56:24.925 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4193792 len 8192 2024-09-21T03:56:24.925 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4193792 len 8192 2024-09-21T03:56:24.926 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4193792 len 8192 2024-09-21T03:56:24.926 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4193792 len 16384 2024-09-21T03:56:24.926 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4193792 len 16384 2024-09-21T03:56:24.926 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4193792 len 16384 2024-09-21T03:56:24.926 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4193792 len 16384 2024-09-21T03:56:24.926 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4194304 len 1024 2024-09-21T03:56:24.926 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4194304 len 1024 2024-09-21T03:56:24.926 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4194304 len 1024 2024-09-21T03:56:24.926 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4194304 len 1024 2024-09-21T03:56:24.926 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4194304 len 2048 2024-09-21T03:56:24.926 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4194304 len 2048 2024-09-21T03:56:24.926 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4194304 len 2048 2024-09-21T03:56:24.926 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4194304 len 2048 2024-09-21T03:56:24.927 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4194304 len 4096 2024-09-21T03:56:24.927 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4194304 len 4096 2024-09-21T03:56:24.927 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4194304 len 4096 2024-09-21T03:56:24.927 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4194304 len 4096 2024-09-21T03:56:24.927 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4194304 len 8192 2024-09-21T03:56:24.927 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4194304 len 8192 2024-09-21T03:56:24.927 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4194304 len 8192 2024-09-21T03:56:24.927 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4194304 len 8192 2024-09-21T03:56:24.927 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4194304 len 16384 2024-09-21T03:56:24.927 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4194304 len 16384 2024-09-21T03:56:24.927 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4194304 len 16384 2024-09-21T03:56:24.927 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4194304 len 16384 2024-09-21T03:56:24.927 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4194816 len 1024 2024-09-21T03:56:24.927 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4194816 len 1024 2024-09-21T03:56:24.928 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4194816 len 1024 2024-09-21T03:56:24.928 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4194816 len 1024 2024-09-21T03:56:24.928 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4194816 len 2048 2024-09-21T03:56:24.928 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4194816 len 2048 2024-09-21T03:56:24.928 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4194816 len 2048 2024-09-21T03:56:24.928 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4194816 len 2048 2024-09-21T03:56:24.928 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4194816 len 4096 2024-09-21T03:56:24.928 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4194816 len 4096 2024-09-21T03:56:24.928 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:56:25.327 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:25 smithi046 ceph-mon[30954]: pgmap v361: 97 pgs: 97 active+clean; 224 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 34 MiB/s rd, 1.6 MiB/s wr, 3.11k op/s 2024-09-21T03:56:25.352 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4194816 len 4096 2024-09-21T03:56:25.352 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4194816 len 4096 2024-09-21T03:56:25.352 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4194816 len 8192 2024-09-21T03:56:25.352 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4194816 len 8192 2024-09-21T03:56:25.352 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4194816 len 8192 2024-09-21T03:56:25.353 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4194816 len 8192 2024-09-21T03:56:25.353 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4194816 len 16384 2024-09-21T03:56:25.353 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4194816 len 16384 2024-09-21T03:56:25.353 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4194816 len 16384 2024-09-21T03:56:25.353 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4194816 len 16384 2024-09-21T03:56:25.353 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4195328 len 1024 2024-09-21T03:56:25.353 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4195328 len 1024 2024-09-21T03:56:25.353 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4195328 len 1024 2024-09-21T03:56:25.353 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4195328 len 1024 2024-09-21T03:56:25.354 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4195328 len 2048 2024-09-21T03:56:25.354 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4195328 len 2048 2024-09-21T03:56:25.354 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4195328 len 2048 2024-09-21T03:56:25.354 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4195328 len 2048 2024-09-21T03:56:25.354 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4195328 len 4096 2024-09-21T03:56:25.354 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4195328 len 4096 2024-09-21T03:56:25.354 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4195328 len 4096 2024-09-21T03:56:25.354 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4195328 len 4096 2024-09-21T03:56:25.355 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4195328 len 8192 2024-09-21T03:56:25.355 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4195328 len 8192 2024-09-21T03:56:25.355 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4195328 len 8192 2024-09-21T03:56:25.355 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4195328 len 8192 2024-09-21T03:56:25.355 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4195328 len 16384 2024-09-21T03:56:25.355 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4195328 len 16384 2024-09-21T03:56:25.355 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4195328 len 16384 2024-09-21T03:56:25.355 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4195328 len 16384 2024-09-21T03:56:25.355 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4195840 len 1024 2024-09-21T03:56:25.355 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4195840 len 1024 2024-09-21T03:56:25.355 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4195840 len 1024 2024-09-21T03:56:25.356 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4195840 len 1024 2024-09-21T03:56:25.356 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4195840 len 2048 2024-09-21T03:56:25.356 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4195840 len 2048 2024-09-21T03:56:25.356 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4195840 len 2048 2024-09-21T03:56:25.356 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4195840 len 2048 2024-09-21T03:56:25.356 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4195840 len 4096 2024-09-21T03:56:25.356 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4195840 len 4096 2024-09-21T03:56:25.356 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4195840 len 4096 2024-09-21T03:56:25.357 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4195840 len 4096 2024-09-21T03:56:25.357 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4195840 len 8192 2024-09-21T03:56:25.357 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4195840 len 8192 2024-09-21T03:56:25.357 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4195840 len 8192 2024-09-21T03:56:25.357 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4195840 len 8192 2024-09-21T03:56:25.357 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4195840 len 16384 2024-09-21T03:56:25.357 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4195840 len 16384 2024-09-21T03:56:25.358 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4195840 len 16384 2024-09-21T03:56:25.358 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4195840 len 16384 2024-09-21T03:56:25.358 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4196352 len 1024 2024-09-21T03:56:25.358 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4196352 len 1024 2024-09-21T03:56:25.358 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4196352 len 1024 2024-09-21T03:56:25.358 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4196352 len 1024 2024-09-21T03:56:25.358 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4196352 len 2048 2024-09-21T03:56:25.358 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4196352 len 2048 2024-09-21T03:56:25.359 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4196352 len 2048 2024-09-21T03:56:25.359 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4196352 len 2048 2024-09-21T03:56:25.359 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4196352 len 4096 2024-09-21T03:56:25.359 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4196352 len 4096 2024-09-21T03:56:25.359 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4196352 len 4096 2024-09-21T03:56:25.359 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4196352 len 4096 2024-09-21T03:56:25.359 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4196352 len 8192 2024-09-21T03:56:25.359 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4196352 len 8192 2024-09-21T03:56:25.359 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4196352 len 8192 2024-09-21T03:56:25.359 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4196352 len 8192 2024-09-21T03:56:25.360 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4196352 len 16384 2024-09-21T03:56:25.360 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4196352 len 16384 2024-09-21T03:56:25.360 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4196352 len 16384 2024-09-21T03:56:25.360 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4196352 len 16384 2024-09-21T03:56:25.360 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4196864 len 1024 2024-09-21T03:56:25.360 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4196864 len 1024 2024-09-21T03:56:25.360 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4196864 len 1024 2024-09-21T03:56:25.360 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4196864 len 1024 2024-09-21T03:56:25.360 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4196864 len 2048 2024-09-21T03:56:25.360 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4196864 len 2048 2024-09-21T03:56:25.360 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4196864 len 2048 2024-09-21T03:56:25.360 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4196864 len 2048 2024-09-21T03:56:25.360 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4196864 len 4096 2024-09-21T03:56:25.360 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4196864 len 4096 2024-09-21T03:56:25.361 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4196864 len 4096 2024-09-21T03:56:25.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.420+0000 7fe754a51640 1 -- 172.21.15.46:0/409140280 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7501049b0 msgr2=0x7fe750104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:25.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.420+0000 7fe754a51640 1 --2- 172.21.15.46:0/409140280 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7501049b0 0x7fe750104dc0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fe740009900 tx=0x7fe74002a410 comp rx=0 tx=0).stop 2024-09-21T03:56:25.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.420+0000 7fe754a51640 1 -- 172.21.15.46:0/409140280 shutdown_connections 2024-09-21T03:56:25.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.420+0000 7fe754a51640 1 --2- 172.21.15.46:0/409140280 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe75010de10 0x7fe750110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:25.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.420+0000 7fe754a51640 1 --2- 172.21.15.46:0/409140280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe750105300 0x7fe75010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:25.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.420+0000 7fe754a51640 1 --2- 172.21.15.46:0/409140280 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7501049b0 0x7fe750104dc0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:25.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.420+0000 7fe754a51640 1 -- 172.21.15.46:0/409140280 >> 172.21.15.46:0/409140280 conn(0x7fe750079730 msgr2=0x7fe750079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:25.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.420+0000 7fe754a51640 1 -- 172.21.15.46:0/409140280 shutdown_connections 2024-09-21T03:56:25.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.420+0000 7fe754a51640 1 -- 172.21.15.46:0/409140280 wait complete. 2024-09-21T03:56:25.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.421+0000 7fe754a51640 1 Processor -- start 2024-09-21T03:56:25.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.421+0000 7fe754a51640 1 -- start start 2024-09-21T03:56:25.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.421+0000 7fe754a51640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7501049b0 0x7fe75019a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:25.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.421+0000 7fe754a51640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe750105300 0x7fe75019aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:25.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.421+0000 7fe754a51640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe75010de10 0x7fe75019fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:25.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.421+0000 7fe754a51640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe750113a70 con 0x7fe750105300 2024-09-21T03:56:25.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.421+0000 7fe754a51640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe7501138f0 con 0x7fe75010de10 2024-09-21T03:56:25.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.421+0000 7fe754a51640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe750113bf0 con 0x7fe7501049b0 2024-09-21T03:56:25.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.421+0000 7fe74dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe750105300 0x7fe75019aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:25.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.421+0000 7fe74dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe750105300 0x7fe75019aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34960/0 (socket says 172.21.15.46:34960) 2024-09-21T03:56:25.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.421+0000 7fe74dd9b640 1 -- 172.21.15.46:0/3395505507 learned_addr learned my addr 172.21.15.46:0/3395505507 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:56:25.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.421+0000 7fe74e59c640 1 --2- 172.21.15.46:0/3395505507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7501049b0 0x7fe75019a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:25.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.421+0000 7fe74ed9d640 1 --2- 172.21.15.46:0/3395505507 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe75010de10 0x7fe75019fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:25.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.422+0000 7fe74dd9b640 1 -- 172.21.15.46:0/3395505507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7501049b0 msgr2=0x7fe75019a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:25.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.422+0000 7fe74dd9b640 1 --2- 172.21.15.46:0/3395505507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7501049b0 0x7fe75019a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:25.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.422+0000 7fe74dd9b640 1 -- 172.21.15.46:0/3395505507 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe75010de10 msgr2=0x7fe75019fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:25.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.422+0000 7fe74dd9b640 1 --2- 172.21.15.46:0/3395505507 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe75010de10 0x7fe75019fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:25.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.422+0000 7fe74dd9b640 1 -- 172.21.15.46:0/3395505507 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7501a0490 con 0x7fe750105300 2024-09-21T03:56:25.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.422+0000 7fe74dd9b640 1 --2- 172.21.15.46:0/3395505507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe750105300 0x7fe75019aac0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe74400d740 tx=0x7fe74400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:25.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.422+0000 7fe73f7fe640 1 -- 172.21.15.46:0/3395505507 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe744017070 con 0x7fe750105300 2024-09-21T03:56:25.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.422+0000 7fe73f7fe640 1 -- 172.21.15.46:0/3395505507 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe74400de50 con 0x7fe750105300 2024-09-21T03:56:25.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.422+0000 7fe754a51640 1 -- 172.21.15.46:0/3395505507 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7501a0780 con 0x7fe750105300 2024-09-21T03:56:25.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.422+0000 7fe73f7fe640 1 -- 172.21.15.46:0/3395505507 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74400f620 con 0x7fe750105300 2024-09-21T03:56:25.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.422+0000 7fe754a51640 1 -- 172.21.15.46:0/3395505507 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7501a6ee0 con 0x7fe750105300 2024-09-21T03:56:25.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.423+0000 7fe754a51640 1 -- 172.21.15.46:0/3395505507 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe750104dc0 con 0x7fe750105300 2024-09-21T03:56:25.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.425+0000 7fe73f7fe640 1 -- 172.21.15.46:0/3395505507 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7fe74401a070 con 0x7fe750105300 2024-09-21T03:56:25.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.425+0000 7fe73f7fe640 1 --2- 172.21.15.46:0/3395505507 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe7380b6680 0x7fe7380b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:25.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.426+0000 7fe74e59c640 1 --2- 172.21.15.46:0/3395505507 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe7380b6680 0x7fe7380b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:25.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.426+0000 7fe73f7fe640 1 -- 172.21.15.46:0/3395505507 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fe7440e6fe0 con 0x7fe750105300 2024-09-21T03:56:25.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.426+0000 7fe74e59c640 1 --2- 172.21.15.46:0/3395505507 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe7380b6680 0x7fe7380b8b90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe740000c00 tx=0x7fe740031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:25.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.429+0000 7fe73f7fe640 1 -- 172.21.15.46:0/3395505507 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe7440b1970 con 0x7fe750105300 2024-09-21T03:56:25.567 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:25 smithi105 ceph-mon[34773]: pgmap v361: 97 pgs: 97 active+clean; 224 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 34 MiB/s rd, 1.6 MiB/s wr, 3.11k op/s 2024-09-21T03:56:25.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:25 smithi162 ceph-mon[35071]: pgmap v361: 97 pgs: 97 active+clean; 224 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 34 MiB/s rd, 1.6 MiB/s wr, 3.11k op/s 2024-09-21T03:56:25.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.672+0000 7fe754a51640 1 -- 172.21.15.46:0/3395505507 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe75019b650 con 0x7fe750105300 2024-09-21T03:56:25.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.673+0000 7fe73f7fe640 1 -- 172.21.15.46:0/3395505507 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7fe75019b650 con 0x7fe750105300 2024-09-21T03:56:25.675 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:56:25.675 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"btime":"2024-09-21T03:53:23:865820+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1766354184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1766354184},{"type":"v1","addr":"172.21.15.46:6839","nonce":1766354184}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/1901774207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":1901774207},{"type":"v1","addr":"172.21.15.46:6841","nonce":1901774207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3548633196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":3548633196},{"type":"v1","addr":"172.21.15.105:6837","nonce":3548633196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24652,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3551934241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3551934241},{"type":"v1","addr":"172.21.15.162:6835","nonce":3551934241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/48949822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":48949822},{"type":"v1","addr":"172.21.15.162:6837","nonce":48949822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:53:14.452819+0000","modified":"2024-09-21T03:53:23.593278+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24680},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/2196053213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2196053213},{"type":"v1","addr":"172.21.15.162:6839","nonce":2196053213}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.105:6839/3911438406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":3911438406},{"type":"v1","addr":"172.21.15.105:6839","nonce":3911438406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24680,"qdb_cluster":[24680]},"id":1}]} 2024-09-21T03:56:25.676 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T03:56:25.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.676+0000 7fe754a51640 1 -- 172.21.15.46:0/3395505507 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe7380b6680 msgr2=0x7fe7380b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:25.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.676+0000 7fe754a51640 1 --2- 172.21.15.46:0/3395505507 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe7380b6680 0x7fe7380b8b90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe740000c00 tx=0x7fe740031400 comp rx=0 tx=0).stop 2024-09-21T03:56:25.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.676+0000 7fe754a51640 1 -- 172.21.15.46:0/3395505507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe750105300 msgr2=0x7fe75019aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:25.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.676+0000 7fe754a51640 1 --2- 172.21.15.46:0/3395505507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe750105300 0x7fe75019aac0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe74400d740 tx=0x7fe74400dc00 comp rx=0 tx=0).stop 2024-09-21T03:56:25.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.676+0000 7fe754a51640 1 -- 172.21.15.46:0/3395505507 shutdown_connections 2024-09-21T03:56:25.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.676+0000 7fe754a51640 1 --2- 172.21.15.46:0/3395505507 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe75010de10 0x7fe75019fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:25.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.676+0000 7fe754a51640 1 --2- 172.21.15.46:0/3395505507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe750105300 0x7fe75019aac0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:25.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.676+0000 7fe754a51640 1 --2- 172.21.15.46:0/3395505507 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe7380b6680 0x7fe7380b8b90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:25.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.676+0000 7fe754a51640 1 --2- 172.21.15.46:0/3395505507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7501049b0 0x7fe75019a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:25.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.676+0000 7fe754a51640 1 -- 172.21.15.46:0/3395505507 >> 172.21.15.46:0/3395505507 conn(0x7fe750079730 msgr2=0x7fe7500ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:25.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.676+0000 7fe754a51640 1 -- 172.21.15.46:0/3395505507 shutdown_connections 2024-09-21T03:56:25.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:25.676+0000 7fe754a51640 1 -- 172.21.15.46:0/3395505507 wait complete. 2024-09-21T03:56:25.789 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4196864 len 4096 2024-09-21T03:56:25.789 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4196864 len 8192 2024-09-21T03:56:25.789 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4196864 len 8192 2024-09-21T03:56:25.789 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4196864 len 8192 2024-09-21T03:56:25.789 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4196864 len 8192 2024-09-21T03:56:25.789 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4196864 len 16384 2024-09-21T03:56:25.789 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4196864 len 16384 2024-09-21T03:56:25.789 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4196864 len 16384 2024-09-21T03:56:25.789 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4196864 len 16384 2024-09-21T03:56:25.789 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4197376 len 1024 2024-09-21T03:56:25.789 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4197376 len 1024 2024-09-21T03:56:25.790 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4197376 len 1024 2024-09-21T03:56:25.790 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4197376 len 1024 2024-09-21T03:56:25.790 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4197376 len 2048 2024-09-21T03:56:25.790 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4197376 len 2048 2024-09-21T03:56:25.790 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4197376 len 2048 2024-09-21T03:56:25.790 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4197376 len 2048 2024-09-21T03:56:25.790 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4197376 len 4096 2024-09-21T03:56:25.790 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4197376 len 4096 2024-09-21T03:56:25.790 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4197376 len 4096 2024-09-21T03:56:25.790 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4197376 len 4096 2024-09-21T03:56:25.790 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4197376 len 8192 2024-09-21T03:56:25.790 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4197376 len 8192 2024-09-21T03:56:25.790 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4197376 len 8192 2024-09-21T03:56:25.791 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4197376 len 8192 2024-09-21T03:56:25.791 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4197376 len 16384 2024-09-21T03:56:25.791 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4197376 len 16384 2024-09-21T03:56:25.791 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4197376 len 16384 2024-09-21T03:56:25.791 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4197376 len 16384 2024-09-21T03:56:25.791 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4197888 len 1024 2024-09-21T03:56:25.791 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4197888 len 1024 2024-09-21T03:56:25.791 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4197888 len 1024 2024-09-21T03:56:25.791 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4197888 len 1024 2024-09-21T03:56:25.791 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4197888 len 2048 2024-09-21T03:56:25.791 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4197888 len 2048 2024-09-21T03:56:25.791 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4197888 len 2048 2024-09-21T03:56:25.791 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4197888 len 2048 2024-09-21T03:56:25.791 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4197888 len 4096 2024-09-21T03:56:25.792 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4197888 len 4096 2024-09-21T03:56:25.792 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4197888 len 4096 2024-09-21T03:56:25.792 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4197888 len 4096 2024-09-21T03:56:25.792 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4197888 len 8192 2024-09-21T03:56:25.792 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4197888 len 8192 2024-09-21T03:56:25.792 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4197888 len 8192 2024-09-21T03:56:25.792 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4197888 len 8192 2024-09-21T03:56:25.792 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1024 offset 4197888 len 16384 2024-09-21T03:56:25.792 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4197888 len 16384 2024-09-21T03:56:25.792 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1024 offset 4197888 len 16384 2024-09-21T03:56:25.792 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1024 offset 4197888 len 16384 2024-09-21T03:56:25.792 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4190720 len 1024 2024-09-21T03:56:25.792 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4190720 len 1024 2024-09-21T03:56:25.792 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4190720 len 1024 2024-09-21T03:56:25.793 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4190720 len 1024 2024-09-21T03:56:25.793 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4190720 len 2048 2024-09-21T03:56:25.793 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4190720 len 2048 2024-09-21T03:56:25.793 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4190720 len 2048 2024-09-21T03:56:25.793 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4190720 len 2048 2024-09-21T03:56:25.793 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4190720 len 4096 2024-09-21T03:56:25.793 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4190720 len 4096 2024-09-21T03:56:25.793 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4190720 len 4096 2024-09-21T03:56:25.793 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4190720 len 4096 2024-09-21T03:56:25.793 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4190720 len 8192 2024-09-21T03:56:25.793 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4190720 len 8192 2024-09-21T03:56:25.793 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4190720 len 8192 2024-09-21T03:56:25.793 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4190720 len 8192 2024-09-21T03:56:25.793 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4190720 len 16384 2024-09-21T03:56:25.794 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4190720 len 16384 2024-09-21T03:56:25.794 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4190720 len 16384 2024-09-21T03:56:25.794 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4190720 len 16384 2024-09-21T03:56:25.794 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4191232 len 1024 2024-09-21T03:56:25.794 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4191232 len 1024 2024-09-21T03:56:25.794 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4191232 len 1024 2024-09-21T03:56:25.794 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4191232 len 1024 2024-09-21T03:56:25.794 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4191232 len 2048 2024-09-21T03:56:25.794 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4191232 len 2048 2024-09-21T03:56:25.794 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4191232 len 2048 2024-09-21T03:56:25.794 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4191232 len 2048 2024-09-21T03:56:25.794 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4191232 len 4096 2024-09-21T03:56:25.794 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4191232 len 4096 2024-09-21T03:56:25.795 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4191232 len 4096 2024-09-21T03:56:25.795 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4191232 len 4096 2024-09-21T03:56:26.295 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4191232 len 8192 2024-09-21T03:56:26.295 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4191232 len 8192 2024-09-21T03:56:26.295 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4191232 len 8192 2024-09-21T03:56:26.295 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4191232 len 8192 2024-09-21T03:56:26.296 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4191232 len 16384 2024-09-21T03:56:26.296 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4191232 len 16384 2024-09-21T03:56:26.296 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4191232 len 16384 2024-09-21T03:56:26.296 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4191232 len 16384 2024-09-21T03:56:26.296 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4191744 len 1024 2024-09-21T03:56:26.296 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4191744 len 1024 2024-09-21T03:56:26.296 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4191744 len 1024 2024-09-21T03:56:26.296 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4191744 len 1024 2024-09-21T03:56:26.296 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4191744 len 2048 2024-09-21T03:56:26.297 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4191744 len 2048 2024-09-21T03:56:26.297 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4191744 len 2048 2024-09-21T03:56:26.297 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4191744 len 2048 2024-09-21T03:56:26.297 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4191744 len 4096 2024-09-21T03:56:26.297 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4191744 len 4096 2024-09-21T03:56:26.297 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4191744 len 4096 2024-09-21T03:56:26.297 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4191744 len 4096 2024-09-21T03:56:26.297 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4191744 len 8192 2024-09-21T03:56:26.298 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4191744 len 8192 2024-09-21T03:56:26.298 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4191744 len 8192 2024-09-21T03:56:26.298 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4191744 len 8192 2024-09-21T03:56:26.298 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4191744 len 16384 2024-09-21T03:56:26.298 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4191744 len 16384 2024-09-21T03:56:26.298 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4191744 len 16384 2024-09-21T03:56:26.298 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4191744 len 16384 2024-09-21T03:56:26.299 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4192256 len 1024 2024-09-21T03:56:26.299 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4192256 len 1024 2024-09-21T03:56:26.299 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4192256 len 1024 2024-09-21T03:56:26.299 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4192256 len 1024 2024-09-21T03:56:26.299 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4192256 len 2048 2024-09-21T03:56:26.299 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4192256 len 2048 2024-09-21T03:56:26.299 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4192256 len 2048 2024-09-21T03:56:26.299 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4192256 len 2048 2024-09-21T03:56:26.299 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4192256 len 4096 2024-09-21T03:56:26.299 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4192256 len 4096 2024-09-21T03:56:26.299 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4192256 len 4096 2024-09-21T03:56:26.299 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4192256 len 4096 2024-09-21T03:56:26.300 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4192256 len 8192 2024-09-21T03:56:26.300 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4192256 len 8192 2024-09-21T03:56:26.300 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4192256 len 8192 2024-09-21T03:56:26.300 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4192256 len 8192 2024-09-21T03:56:26.300 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4192256 len 16384 2024-09-21T03:56:26.300 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4192256 len 16384 2024-09-21T03:56:26.300 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4192256 len 16384 2024-09-21T03:56:26.300 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4192256 len 16384 2024-09-21T03:56:26.300 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4192768 len 1024 2024-09-21T03:56:26.300 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4192768 len 1024 2024-09-21T03:56:26.300 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4192768 len 1024 2024-09-21T03:56:26.300 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4192768 len 1024 2024-09-21T03:56:26.300 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4192768 len 2048 2024-09-21T03:56:26.300 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4192768 len 2048 2024-09-21T03:56:26.301 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4192768 len 2048 2024-09-21T03:56:26.301 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4192768 len 2048 2024-09-21T03:56:26.301 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4192768 len 4096 2024-09-21T03:56:26.301 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4192768 len 4096 2024-09-21T03:56:26.301 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4192768 len 4096 2024-09-21T03:56:26.301 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4192768 len 4096 2024-09-21T03:56:26.301 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4192768 len 8192 2024-09-21T03:56:26.301 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4192768 len 8192 2024-09-21T03:56:26.301 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4192768 len 8192 2024-09-21T03:56:26.301 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4192768 len 8192 2024-09-21T03:56:26.301 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4192768 len 16384 2024-09-21T03:56:26.301 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4192768 len 16384 2024-09-21T03:56:26.301 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4192768 len 16384 2024-09-21T03:56:26.301 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4192768 len 16384 2024-09-21T03:56:26.302 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4193280 len 1024 2024-09-21T03:56:26.302 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4193280 len 1024 2024-09-21T03:56:26.302 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4193280 len 1024 2024-09-21T03:56:26.302 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4193280 len 1024 2024-09-21T03:56:26.302 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4193280 len 2048 2024-09-21T03:56:26.302 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4193280 len 2048 2024-09-21T03:56:26.302 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4193280 len 2048 2024-09-21T03:56:26.302 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4193280 len 2048 2024-09-21T03:56:26.302 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4193280 len 4096 2024-09-21T03:56:26.302 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4193280 len 4096 2024-09-21T03:56:26.302 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4193280 len 4096 2024-09-21T03:56:26.302 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4193280 len 4096 2024-09-21T03:56:26.302 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4193280 len 8192 2024-09-21T03:56:26.433 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:26 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3395505507' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:56:26.466 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:56:26.567 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:26 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3395505507' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:56:26.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:26 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3395505507' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:56:26.711 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4193280 len 8192 2024-09-21T03:56:26.711 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4193280 len 8192 2024-09-21T03:56:26.711 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4193280 len 8192 2024-09-21T03:56:26.711 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4193280 len 16384 2024-09-21T03:56:26.711 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4193280 len 16384 2024-09-21T03:56:26.711 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4193280 len 16384 2024-09-21T03:56:26.711 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4193280 len 16384 2024-09-21T03:56:26.711 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4193792 len 1024 2024-09-21T03:56:26.711 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4193792 len 1024 2024-09-21T03:56:26.712 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4193792 len 1024 2024-09-21T03:56:26.712 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4193792 len 1024 2024-09-21T03:56:26.712 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4193792 len 2048 2024-09-21T03:56:26.712 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4193792 len 2048 2024-09-21T03:56:26.712 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4193792 len 2048 2024-09-21T03:56:26.712 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4193792 len 2048 2024-09-21T03:56:26.712 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4193792 len 4096 2024-09-21T03:56:26.712 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4193792 len 4096 2024-09-21T03:56:26.712 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4193792 len 4096 2024-09-21T03:56:26.712 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4193792 len 4096 2024-09-21T03:56:26.712 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4193792 len 8192 2024-09-21T03:56:26.712 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4193792 len 8192 2024-09-21T03:56:26.712 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4193792 len 8192 2024-09-21T03:56:26.713 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4193792 len 8192 2024-09-21T03:56:26.713 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4193792 len 16384 2024-09-21T03:56:26.713 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4193792 len 16384 2024-09-21T03:56:26.713 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4193792 len 16384 2024-09-21T03:56:26.713 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4193792 len 16384 2024-09-21T03:56:26.713 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4194304 len 1024 2024-09-21T03:56:26.713 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4194304 len 1024 2024-09-21T03:56:26.713 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4194304 len 1024 2024-09-21T03:56:26.713 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4194304 len 1024 2024-09-21T03:56:26.713 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4194304 len 2048 2024-09-21T03:56:26.713 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4194304 len 2048 2024-09-21T03:56:26.713 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4194304 len 2048 2024-09-21T03:56:26.713 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4194304 len 2048 2024-09-21T03:56:26.713 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4194304 len 4096 2024-09-21T03:56:26.714 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4194304 len 4096 2024-09-21T03:56:26.714 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4194304 len 4096 2024-09-21T03:56:26.714 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4194304 len 4096 2024-09-21T03:56:26.714 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4194304 len 8192 2024-09-21T03:56:26.714 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4194304 len 8192 2024-09-21T03:56:26.714 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4194304 len 8192 2024-09-21T03:56:26.714 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4194304 len 8192 2024-09-21T03:56:26.714 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4194304 len 16384 2024-09-21T03:56:26.714 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4194304 len 16384 2024-09-21T03:56:26.714 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4194304 len 16384 2024-09-21T03:56:26.714 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4194304 len 16384 2024-09-21T03:56:26.714 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4194816 len 1024 2024-09-21T03:56:26.714 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4194816 len 1024 2024-09-21T03:56:26.715 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4194816 len 1024 2024-09-21T03:56:26.715 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4194816 len 1024 2024-09-21T03:56:26.715 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4194816 len 2048 2024-09-21T03:56:26.715 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4194816 len 2048 2024-09-21T03:56:26.715 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4194816 len 2048 2024-09-21T03:56:26.715 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4194816 len 2048 2024-09-21T03:56:26.715 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4194816 len 4096 2024-09-21T03:56:26.715 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4194816 len 4096 2024-09-21T03:56:26.715 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4194816 len 4096 2024-09-21T03:56:26.715 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4194816 len 4096 2024-09-21T03:56:26.715 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4194816 len 8192 2024-09-21T03:56:26.715 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4194816 len 8192 2024-09-21T03:56:26.715 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4194816 len 8192 2024-09-21T03:56:26.715 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4194816 len 8192 2024-09-21T03:56:26.716 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4194816 len 16384 2024-09-21T03:56:26.716 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4194816 len 16384 2024-09-21T03:56:26.716 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4194816 len 16384 2024-09-21T03:56:26.716 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4194816 len 16384 2024-09-21T03:56:26.716 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4195328 len 1024 2024-09-21T03:56:26.716 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4195328 len 1024 2024-09-21T03:56:26.716 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4195328 len 1024 2024-09-21T03:56:26.716 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4195328 len 1024 2024-09-21T03:56:26.716 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4195328 len 2048 2024-09-21T03:56:26.716 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4195328 len 2048 2024-09-21T03:56:26.716 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4195328 len 2048 2024-09-21T03:56:26.716 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4195328 len 2048 2024-09-21T03:56:26.716 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4195328 len 4096 2024-09-21T03:56:26.716 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4195328 len 4096 2024-09-21T03:56:26.717 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4195328 len 4096 2024-09-21T03:56:26.717 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4195328 len 4096 2024-09-21T03:56:26.717 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4195328 len 8192 2024-09-21T03:56:26.740 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:56:27.156 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4195328 len 8192 2024-09-21T03:56:27.156 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4195328 len 8192 2024-09-21T03:56:27.156 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4195328 len 8192 2024-09-21T03:56:27.156 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4195328 len 16384 2024-09-21T03:56:27.156 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4195328 len 16384 2024-09-21T03:56:27.156 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4195328 len 16384 2024-09-21T03:56:27.156 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4195328 len 16384 2024-09-21T03:56:27.157 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4195840 len 1024 2024-09-21T03:56:27.157 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4195840 len 1024 2024-09-21T03:56:27.157 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4195840 len 1024 2024-09-21T03:56:27.157 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4195840 len 1024 2024-09-21T03:56:27.157 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4195840 len 2048 2024-09-21T03:56:27.157 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4195840 len 2048 2024-09-21T03:56:27.157 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4195840 len 2048 2024-09-21T03:56:27.157 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4195840 len 2048 2024-09-21T03:56:27.157 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4195840 len 4096 2024-09-21T03:56:27.157 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4195840 len 4096 2024-09-21T03:56:27.157 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4195840 len 4096 2024-09-21T03:56:27.157 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4195840 len 4096 2024-09-21T03:56:27.157 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4195840 len 8192 2024-09-21T03:56:27.157 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4195840 len 8192 2024-09-21T03:56:27.158 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4195840 len 8192 2024-09-21T03:56:27.158 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4195840 len 8192 2024-09-21T03:56:27.158 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4195840 len 16384 2024-09-21T03:56:27.158 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4195840 len 16384 2024-09-21T03:56:27.158 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4195840 len 16384 2024-09-21T03:56:27.158 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4195840 len 16384 2024-09-21T03:56:27.158 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4196352 len 1024 2024-09-21T03:56:27.158 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4196352 len 1024 2024-09-21T03:56:27.158 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4196352 len 1024 2024-09-21T03:56:27.158 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4196352 len 1024 2024-09-21T03:56:27.158 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4196352 len 2048 2024-09-21T03:56:27.158 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4196352 len 2048 2024-09-21T03:56:27.158 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4196352 len 2048 2024-09-21T03:56:27.159 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4196352 len 2048 2024-09-21T03:56:27.159 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4196352 len 4096 2024-09-21T03:56:27.159 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4196352 len 4096 2024-09-21T03:56:27.159 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4196352 len 4096 2024-09-21T03:56:27.159 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4196352 len 4096 2024-09-21T03:56:27.159 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4196352 len 8192 2024-09-21T03:56:27.159 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4196352 len 8192 2024-09-21T03:56:27.159 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4196352 len 8192 2024-09-21T03:56:27.159 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4196352 len 8192 2024-09-21T03:56:27.159 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4196352 len 16384 2024-09-21T03:56:27.159 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4196352 len 16384 2024-09-21T03:56:27.159 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4196352 len 16384 2024-09-21T03:56:27.159 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4196352 len 16384 2024-09-21T03:56:27.159 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4196864 len 1024 2024-09-21T03:56:27.160 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4196864 len 1024 2024-09-21T03:56:27.160 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4196864 len 1024 2024-09-21T03:56:27.160 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4196864 len 1024 2024-09-21T03:56:27.160 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4196864 len 2048 2024-09-21T03:56:27.160 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4196864 len 2048 2024-09-21T03:56:27.160 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4196864 len 2048 2024-09-21T03:56:27.160 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4196864 len 2048 2024-09-21T03:56:27.160 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4196864 len 4096 2024-09-21T03:56:27.160 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4196864 len 4096 2024-09-21T03:56:27.160 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4196864 len 4096 2024-09-21T03:56:27.160 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4196864 len 4096 2024-09-21T03:56:27.160 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4196864 len 8192 2024-09-21T03:56:27.160 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4196864 len 8192 2024-09-21T03:56:27.161 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4196864 len 8192 2024-09-21T03:56:27.161 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4196864 len 8192 2024-09-21T03:56:27.161 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4196864 len 16384 2024-09-21T03:56:27.161 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4196864 len 16384 2024-09-21T03:56:27.161 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4196864 len 16384 2024-09-21T03:56:27.161 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4196864 len 16384 2024-09-21T03:56:27.161 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4197376 len 1024 2024-09-21T03:56:27.161 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4197376 len 1024 2024-09-21T03:56:27.161 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4197376 len 1024 2024-09-21T03:56:27.161 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4197376 len 1024 2024-09-21T03:56:27.161 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4197376 len 2048 2024-09-21T03:56:27.161 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4197376 len 2048 2024-09-21T03:56:27.161 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4197376 len 2048 2024-09-21T03:56:27.161 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4197376 len 2048 2024-09-21T03:56:27.162 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4197376 len 4096 2024-09-21T03:56:27.162 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4197376 len 4096 2024-09-21T03:56:27.162 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4197376 len 4096 2024-09-21T03:56:27.162 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4197376 len 4096 2024-09-21T03:56:27.162 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4197376 len 8192 2024-09-21T03:56:27.162 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4197376 len 8192 2024-09-21T03:56:27.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.290+0000 7fe2a7d75640 1 -- 172.21.15.46:0/2164284807 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2a0104840 msgr2=0x7fe2a0104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:27.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.290+0000 7fe2a7d75640 1 --2- 172.21.15.46:0/2164284807 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2a0104840 0x7fe2a0104c50 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe29c009900 tx=0x7fe29c02a410 comp rx=0 tx=0).stop 2024-09-21T03:56:27.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.291+0000 7fe2a7d75640 1 -- 172.21.15.46:0/2164284807 shutdown_connections 2024-09-21T03:56:27.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.291+0000 7fe2a7d75640 1 --2- 172.21.15.46:0/2164284807 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2a010ddf0 0x7fe2a0110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:27.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.291+0000 7fe2a7d75640 1 --2- 172.21.15.46:0/2164284807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2a0105270 0x7fe2a010d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:27.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.291+0000 7fe2a7d75640 1 --2- 172.21.15.46:0/2164284807 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2a0104840 0x7fe2a0104c50 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:27.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.291+0000 7fe2a7d75640 1 -- 172.21.15.46:0/2164284807 >> 172.21.15.46:0/2164284807 conn(0x7fe2a0079730 msgr2=0x7fe2a0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:27.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.291+0000 7fe2a7d75640 1 -- 172.21.15.46:0/2164284807 shutdown_connections 2024-09-21T03:56:27.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.291+0000 7fe2a7d75640 1 -- 172.21.15.46:0/2164284807 wait complete. 2024-09-21T03:56:27.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.292+0000 7fe2a7d75640 1 Processor -- start 2024-09-21T03:56:27.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.292+0000 7fe2a7d75640 1 -- start start 2024-09-21T03:56:27.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.292+0000 7fe2a7d75640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2a0104840 0x7fe2a0102750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:27.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.292+0000 7fe2a7d75640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2a0105270 0x7fe2a0102c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:27.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.292+0000 7fe2a7d75640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2a010ddf0 0x7fe2a01031d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:27.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.292+0000 7fe2a7d75640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a0113a90 con 0x7fe2a010ddf0 2024-09-21T03:56:27.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.292+0000 7fe2a7d75640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a0113910 con 0x7fe2a0105270 2024-09-21T03:56:27.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.292+0000 7fe2a7d75640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a0113c10 con 0x7fe2a0104840 2024-09-21T03:56:27.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.292+0000 7fe2a6312640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2a010ddf0 0x7fe2a01031d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:27.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.292+0000 7fe2a5310640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2a0105270 0x7fe2a0102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:27.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.292+0000 7fe2a5b11640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2a0104840 0x7fe2a0102750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:27.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.292+0000 7fe2a6312640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2a010ddf0 0x7fe2a01031d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34980/0 (socket says 172.21.15.46:34980) 2024-09-21T03:56:27.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.292+0000 7fe2a6312640 1 -- 172.21.15.46:0/2918424026 learned_addr learned my addr 172.21.15.46:0/2918424026 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:56:27.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.292+0000 7fe2a6312640 1 -- 172.21.15.46:0/2918424026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2a0104840 msgr2=0x7fe2a0102750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:27.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.292+0000 7fe2a6312640 1 --2- 172.21.15.46:0/2918424026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2a0104840 0x7fe2a0102750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:27.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.292+0000 7fe2a6312640 1 -- 172.21.15.46:0/2918424026 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2a0105270 msgr2=0x7fe2a0102c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:27.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.292+0000 7fe2a6312640 1 --2- 172.21.15.46:0/2918424026 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2a0105270 0x7fe2a0102c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:27.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.292+0000 7fe2a6312640 1 -- 172.21.15.46:0/2918424026 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a01a8840 con 0x7fe2a010ddf0 2024-09-21T03:56:27.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.293+0000 7fe2a5310640 1 --2- 172.21.15.46:0/2918424026 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2a0105270 0x7fe2a0102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:56:27.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.293+0000 7fe2a5b11640 1 --2- 172.21.15.46:0/2918424026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2a0104840 0x7fe2a0102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:56:27.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.293+0000 7fe2a6312640 1 --2- 172.21.15.46:0/2918424026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2a010ddf0 0x7fe2a01031d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe29800eb10 tx=0x7fe29800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:27.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.293+0000 7fe296ffd640 1 -- 172.21.15.46:0/2918424026 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe298004b20 con 0x7fe2a010ddf0 2024-09-21T03:56:27.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.293+0000 7fe296ffd640 1 -- 172.21.15.46:0/2918424026 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe298004cc0 con 0x7fe2a010ddf0 2024-09-21T03:56:27.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.293+0000 7fe2a7d75640 1 -- 172.21.15.46:0/2918424026 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2a01a8b30 con 0x7fe2a010ddf0 2024-09-21T03:56:27.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.293+0000 7fe296ffd640 1 -- 172.21.15.46:0/2918424026 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe298010670 con 0x7fe2a010ddf0 2024-09-21T03:56:27.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.293+0000 7fe2a7d75640 1 -- 172.21.15.46:0/2918424026 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2a01a9020 con 0x7fe2a010ddf0 2024-09-21T03:56:27.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.296+0000 7fe2ae2e9740 1 Processor -- start 2024-09-21T03:56:27.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.296+0000 7fe296ffd640 1 -- 172.21.15.46:0/2918424026 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7fe298005020 con 0x7fe2a010ddf0 2024-09-21T03:56:27.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.296+0000 7fe2ae2e9740 1 -- start start 2024-09-21T03:56:27.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.297+0000 7fe2ae2e9740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5575e525f070 0x5575e56066a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:27.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.297+0000 7fe2ae2e9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575e52361b0 0x5575e5606be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:27.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.297+0000 7fe2ae2e9740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e523e390 0x5575e5607120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:27.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.297+0000 7fe2ae2e9740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5575e557cea0 con 0x5575e525f070 2024-09-21T03:56:27.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.297+0000 7fe2ae2e9740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5575e556c2d0 con 0x5575e523e390 2024-09-21T03:56:27.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.297+0000 7fe2ae2e9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5575e55700e0 con 0x5575e52361b0 2024-09-21T03:56:27.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.297+0000 7fe2a5310640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5575e525f070 0x5575e56066a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:27.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.297+0000 7fe2a5b11640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575e52361b0 0x5575e5606be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:27.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.297+0000 7fe2a5310640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5575e525f070 0x5575e56066a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34984/0 (socket says 172.21.15.46:34984) 2024-09-21T03:56:27.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.297+0000 7fe2a5310640 1 -- 172.21.15.46:0/348383866 learned_addr learned my addr 172.21.15.46:0/348383866 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:56:27.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.297+0000 7fe2a5b11640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575e52361b0 0x5575e5606be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:44168/0 (socket says 172.21.15.46:44168) 2024-09-21T03:56:27.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.297+0000 7fe2a5310640 1 --2- 172.21.15.46:0/348383866 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e523e390 0x5575e5607120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:27.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.297+0000 7fe2a5b11640 1 -- 172.21.15.46:0/348383866 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e523e390 msgr2=0x5575e5607120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:27.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.297+0000 7fe2a5b11640 1 --2- 172.21.15.46:0/348383866 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e523e390 0x5575e5607120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:27.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.297+0000 7fe2a5b11640 1 -- 172.21.15.46:0/348383866 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5575e525f070 msgr2=0x5575e56066a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:27.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.297+0000 7fe2a5b11640 1 --2- 172.21.15.46:0/348383866 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5575e525f070 0x5575e56066a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:27.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.297+0000 7fe2a5b11640 1 -- 172.21.15.46:0/348383866 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575e52ca650 con 0x5575e52361b0 2024-09-21T03:56:27.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.297+0000 7fe296ffd640 1 --2- 172.21.15.46:0/2918424026 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe28c0b6680 0x7fe28c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:27.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.298+0000 7fe2a5310640 1 --2- 172.21.15.46:0/2918424026 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe28c0b6680 0x7fe28c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:27.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.298+0000 7fe2a5b11640 1 --2- 172.21.15.46:0/348383866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575e52361b0 0x5575e5606be0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe29c006010 tx=0x7fe29c005e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19fb5ac022191973 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:27.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.298+0000 7fe296ffd640 1 -- 172.21.15.46:0/2918424026 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fe2980e7c00 con 0x7fe2a010ddf0 2024-09-21T03:56:27.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.298+0000 7fe2a5310640 1 --2- 172.21.15.46:0/2918424026 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe28c0b6680 0x7fe28c0b8b90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe290009710 tx=0x7fe290005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:27.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.298+0000 7fe28bfff640 1 -- 172.21.15.46:0/348383866 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29c040070 con 0x5575e52361b0 2024-09-21T03:56:27.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.298+0000 7fe28bfff640 1 -- 172.21.15.46:0/348383866 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe29c031720 con 0x5575e52361b0 2024-09-21T03:56:27.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.298+0000 7fe28bfff640 1 -- 172.21.15.46:0/348383866 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29c035040 con 0x5575e52361b0 2024-09-21T03:56:27.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.299+0000 7fe2ae2e9740 1 -- 172.21.15.46:0/348383866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575e52361b0 msgr2=0x5575e5606be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:27.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.299+0000 7fe2ae2e9740 1 --2- 172.21.15.46:0/348383866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575e52361b0 0x5575e5606be0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe29c006010 tx=0x7fe29c005e20 comp rx=0 tx=0).stop 2024-09-21T03:56:27.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.300+0000 7fe2ae2e9740 1 -- 172.21.15.46:0/348383866 shutdown_connections 2024-09-21T03:56:27.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.300+0000 7fe2ae2e9740 1 --2- 172.21.15.46:0/348383866 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e523e390 0x5575e5607120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:27.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.300+0000 7fe2ae2e9740 1 --2- 172.21.15.46:0/348383866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575e52361b0 0x5575e5606be0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:27.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.300+0000 7fe2ae2e9740 1 --2- 172.21.15.46:0/348383866 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5575e525f070 0x5575e56066a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:27.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.300+0000 7fe2ae2e9740 1 -- 172.21.15.46:0/348383866 >> 172.21.15.46:0/348383866 conn(0x5575e5253460 msgr2=0x5575e5604590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:27.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.300+0000 7fe2ae2e9740 1 -- 172.21.15.46:0/348383866 shutdown_connections 2024-09-21T03:56:27.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.300+0000 7fe2ae2e9740 1 -- 172.21.15.46:0/348383866 wait complete. 2024-09-21T03:56:27.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.300+0000 7fe2ae2e9740 1 -- start start 2024-09-21T03:56:27.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.301+0000 7fe2ae2e9740 1 Processor -- start 2024-09-21T03:56:27.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.301+0000 7fe2ae2e9740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5575e52361b0 0x5575e5611d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:27.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.301+0000 7fe2ae2e9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575e523e390 0x5575e5612260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:27.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.301+0000 7fe2ae2e9740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e525f070 0x5575e561e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:27.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.301+0000 7fe2ae2e9740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5575e53cd700 con 0x5575e52361b0 2024-09-21T03:56:27.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.301+0000 7fe2ae2e9740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5575e5507160 con 0x5575e525f070 2024-09-21T03:56:27.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.301+0000 7fe2ae2e9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5575e5614e20 con 0x5575e523e390 2024-09-21T03:56:27.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.301+0000 7fe2ae2e9740 10 client.0 _ll_register_callbacks cb 0x5575e55209e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:56:27.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.301+0000 7fe2a5b11640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5575e52361b0 0x5575e5611d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:27.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.301+0000 7fe2a5310640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575e523e390 0x5575e5612260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:27.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.301+0000 7fe2a5b11640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5575e52361b0 0x5575e5611d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34990/0 (socket says 172.21.15.46:34990) 2024-09-21T03:56:27.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.301+0000 7fe2a5b11640 1 -- 172.21.15.46:0/1060023900 learned_addr learned my addr 172.21.15.46:0/1060023900 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:56:27.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.301+0000 7fe2a6312640 1 --2- 172.21.15.46:0/1060023900 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e525f070 0x5575e561e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:27.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.302+0000 7fe2a5310640 1 -- 172.21.15.46:0/1060023900 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e525f070 msgr2=0x5575e561e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:27.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.302+0000 7fe2a5310640 1 --2- 172.21.15.46:0/1060023900 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e525f070 0x5575e561e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:27.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.302+0000 7fe2a5310640 1 -- 172.21.15.46:0/1060023900 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5575e52361b0 msgr2=0x5575e5611d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:27.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.302+0000 7fe2a5310640 1 --2- 172.21.15.46:0/1060023900 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5575e52361b0 0x5575e5611d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:27.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.302+0000 7fe2a5310640 1 -- 172.21.15.46:0/1060023900 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575e5534c90 con 0x5575e523e390 2024-09-21T03:56:27.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.302+0000 7fe2a5b11640 1 --2- 172.21.15.46:0/1060023900 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5575e52361b0 0x5575e5611d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:56:27.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.302+0000 7fe2a5310640 1 --2- 172.21.15.46:0/1060023900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575e523e390 0x5575e5612260 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe2900058c0 tx=0x7fe290005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a217ad9778af67c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:27.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.302+0000 7fe2897fa640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-21T03:56:27.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.302+0000 7fe2897fa640 1 -- 172.21.15.46:0/1060023900 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe290004050 con 0x5575e523e390 2024-09-21T03:56:27.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.302+0000 7fe2ae2e9740 1 -- 172.21.15.46:0/1060023900 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe29c031720 con 0x5575e523e390 2024-09-21T03:56:27.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.302+0000 7fe2897fa640 1 -- 172.21.15.46:0/1060023900 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fe29001c030 con 0x5575e523e390 2024-09-21T03:56:27.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.303+0000 7fe2897fa640 1 -- 172.21.15.46:0/1060023900 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe2900041f0 con 0x5575e523e390 2024-09-21T03:56:27.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.303+0000 7fe2ae2e9740 10 client.25372 fetch_fsmap learned FSMap version 20 2024-09-21T03:56:27.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.303+0000 7fe2ae2e9740 1 -- 172.21.15.46:0/1060023900 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5575e5620b50 con 0x5575e523e390 2024-09-21T03:56:27.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.303+0000 7fe2897fa640 1 -- 172.21.15.46:0/1060023900 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe29c031720 con 0x5575e523e390 2024-09-21T03:56:27.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.303+0000 7fe2897fa640 1 -- 172.21.15.46:0/1060023900 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fe290035480 con 0x5575e523e390 2024-09-21T03:56:27.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.303+0000 7fe2ae2e9740 10 client.25372 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:56:27.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.303+0000 7fe2ae2e9740 10 client.25372 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:56:27.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.303+0000 7fe2ae2e9740 20 client.25372 populate_metadata read hostname 'smithi046' 2024-09-21T03:56:27.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.303+0000 7fe2ae2e9740 1 --2- 172.21.15.46:0/1060023900 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5575e521d9f0 0x5575e5624130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:27.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.303+0000 7fe2ae2e9740 4 client.25372 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:56:27.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.303+0000 7fe2ae2e9740 1 -- 172.21.15.46:0/1060023900 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575e557edf0 con 0x5575e521d9f0 2024-09-21T03:56:27.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.303+0000 7fe2a5b11640 1 --2- 172.21.15.46:0/1060023900 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5575e521d9f0 0x5575e5624130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:27.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.304+0000 7fe2897fa640 10 client.25372 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:56:27.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.304+0000 7fe2a5b11640 1 --2- 172.21.15.46:0/1060023900 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5575e521d9f0 0x5575e5624130 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59dda0d0635c908c server_cookie=a6781e4b963c1c45 in_seq=0 out_seq=0 2024-09-21T03:56:27.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.305+0000 7fe2897fa640 1 -- 172.21.15.46:0/1060023900 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5575e557edf0 con 0x5575e521d9f0 2024-09-21T03:56:27.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.305+0000 7fe2897fa640 10 client.25372 handle_command_reply: tid=0 2024-09-21T03:56:27.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.305+0000 7fe2ae2e9740 1 client.25372 shutdown 2024-09-21T03:56:27.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.305+0000 7fe2ae2e9740 1 -- 172.21.15.46:0/1060023900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575e523e390 msgr2=0x5575e5612260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:27.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.305+0000 7fe2ae2e9740 1 --2- 172.21.15.46:0/1060023900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575e523e390 0x5575e5612260 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe2900058c0 tx=0x7fe290005f90 comp rx=0 tx=0).stop 2024-09-21T03:56:27.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.305+0000 7fe2ae2e9740 1 -- 172.21.15.46:0/1060023900 shutdown_connections 2024-09-21T03:56:27.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.305+0000 7fe2ae2e9740 1 --2- 172.21.15.46:0/1060023900 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5575e521d9f0 0x5575e5624130 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:27.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.305+0000 7fe2897fa640 0 client.25372 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:56:27.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.305+0000 7fe2ae2e9740 1 --2- 172.21.15.46:0/1060023900 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e525f070 0x5575e561e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:27.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.305+0000 7fe2ae2e9740 1 --2- 172.21.15.46:0/1060023900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575e523e390 0x5575e5612260 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:27.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.305+0000 7fe2ae2e9740 1 --2- 172.21.15.46:0/1060023900 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5575e52361b0 0x5575e5611d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:27.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.305+0000 7fe2ae2e9740 1 -- 172.21.15.46:0/1060023900 >> 172.21.15.46:0/1060023900 conn(0x5575e5253460 msgr2=0x5575e5609880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:27.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.305+0000 7fe2ae2e9740 1 -- 172.21.15.46:0/1060023900 shutdown_connections 2024-09-21T03:56:27.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.305+0000 7fe2ae2e9740 1 -- 172.21.15.46:0/1060023900 wait complete. 2024-09-21T03:56:27.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.305+0000 7fe2ae2e9740 20 client.25372 trim_cache size 0 max 16384 2024-09-21T03:56:27.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.321+0000 7fe2ae2e9740 1 Processor -- start 2024-09-21T03:56:27.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.321+0000 7fe2ae2e9740 1 -- start start 2024-09-21T03:56:27.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.321+0000 7fe2ae2e9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575e521d9f0 0x5575e56121e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:27.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.321+0000 7fe2ae2e9740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e52361b0 0x5575e561e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:27.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.321+0000 7fe2ae2e9740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5575e523e390 0x5575e560ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:27.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.321+0000 7fe2ae2e9740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a01ab370 con 0x5575e523e390 2024-09-21T03:56:27.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.321+0000 7fe2ae2e9740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a01adbd0 con 0x5575e52361b0 2024-09-21T03:56:27.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.321+0000 7fe2ae2e9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a01ab9c0 con 0x5575e521d9f0 2024-09-21T03:56:27.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.321+0000 7fe2a6312640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5575e523e390 0x5575e560ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:27.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.321+0000 7fe2a5310640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e52361b0 0x5575e561e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:27.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.321+0000 7fe2a6312640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5575e523e390 0x5575e560ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35004/0 (socket says 172.21.15.46:35004) 2024-09-21T03:56:27.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.321+0000 7fe2a6312640 1 -- 172.21.15.46:0/2110385962 learned_addr learned my addr 172.21.15.46:0/2110385962 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:56:27.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.321+0000 7fe2a5b11640 1 --2- 172.21.15.46:0/2110385962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575e521d9f0 0x5575e56121e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:27.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.322+0000 7fe2a5310640 1 -- 172.21.15.46:0/2110385962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575e521d9f0 msgr2=0x5575e56121e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:27.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.322+0000 7fe2a5310640 1 --2- 172.21.15.46:0/2110385962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575e521d9f0 0x5575e56121e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:27.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.322+0000 7fe2a5310640 1 -- 172.21.15.46:0/2110385962 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5575e523e390 msgr2=0x5575e560ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:27.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.322+0000 7fe2a5310640 1 --2- 172.21.15.46:0/2110385962 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5575e523e390 0x5575e560ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:27.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.322+0000 7fe2a5310640 1 -- 172.21.15.46:0/2110385962 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575e5608990 con 0x5575e52361b0 2024-09-21T03:56:27.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.322+0000 7fe2a6312640 1 --2- 172.21.15.46:0/2110385962 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5575e523e390 0x5575e560ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:56:27.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.322+0000 7fe2a5310640 1 --2- 172.21.15.46:0/2110385962 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e52361b0 0x5575e561e010 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe2900358c0 tx=0x7fe290013fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8378e89bdffd21d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:27.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.322+0000 7fe28b7fe640 1 -- 172.21.15.46:0/2110385962 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe290013d70 con 0x5575e52361b0 2024-09-21T03:56:27.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.322+0000 7fe28b7fe640 1 -- 172.21.15.46:0/2110385962 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe290004390 con 0x5575e52361b0 2024-09-21T03:56:27.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.322+0000 7fe28b7fe640 1 -- 172.21.15.46:0/2110385962 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe290005310 con 0x5575e52361b0 2024-09-21T03:56:27.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.323+0000 7fe2ae2e9740 1 -- 172.21.15.46:0/2110385962 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e52361b0 msgr2=0x5575e561e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:27.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.323+0000 7fe2ae2e9740 1 --2- 172.21.15.46:0/2110385962 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e52361b0 0x5575e561e010 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe2900358c0 tx=0x7fe290013fd0 comp rx=0 tx=0).stop 2024-09-21T03:56:27.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.323+0000 7fe2ae2e9740 1 -- 172.21.15.46:0/2110385962 shutdown_connections 2024-09-21T03:56:27.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.323+0000 7fe2ae2e9740 1 --2- 172.21.15.46:0/2110385962 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5575e523e390 0x5575e560ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:27.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.323+0000 7fe2ae2e9740 1 --2- 172.21.15.46:0/2110385962 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e52361b0 0x5575e561e010 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:27.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.323+0000 7fe2ae2e9740 1 --2- 172.21.15.46:0/2110385962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575e521d9f0 0x5575e56121e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:27.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.323+0000 7fe2ae2e9740 1 -- 172.21.15.46:0/2110385962 >> 172.21.15.46:0/2110385962 conn(0x5575e5253460 msgr2=0x5575e5611ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:27.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.323+0000 7fe2ae2e9740 1 -- 172.21.15.46:0/2110385962 shutdown_connections 2024-09-21T03:56:27.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.323+0000 7fe2ae2e9740 1 -- 172.21.15.46:0/2110385962 wait complete. 2024-09-21T03:56:27.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.324+0000 7fe2ae2e9740 1 -- start start 2024-09-21T03:56:27.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.324+0000 7fe2ae2e9740 1 Processor -- start 2024-09-21T03:56:27.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.324+0000 7fe2ae2e9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575e521d9f0 0x5575e561aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:27.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.324+0000 7fe2ae2e9740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5575e52361b0 0x5575e5615fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:27.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.324+0000 7fe2ae2e9740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e523e390 0x5575e56166e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:27.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.324+0000 7fe2ae2e9740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a01ac090 con 0x5575e52361b0 2024-09-21T03:56:27.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.324+0000 7fe2ae2e9740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a01ad500 con 0x5575e523e390 2024-09-21T03:56:27.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.324+0000 7fe2ae2e9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a01ac760 con 0x5575e521d9f0 2024-09-21T03:56:27.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.324+0000 7fe2ae2e9740 10 client.0 _ll_register_callbacks cb 0x7fe290009d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:56:27.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.324+0000 7fe2a5310640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5575e52361b0 0x5575e5615fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:27.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.324+0000 7fe2a5b11640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575e521d9f0 0x5575e561aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:27.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.324+0000 7fe2a5310640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5575e52361b0 0x5575e5615fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35010/0 (socket says 172.21.15.46:35010) 2024-09-21T03:56:27.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.324+0000 7fe2a5310640 1 -- 172.21.15.46:0/2564977319 learned_addr learned my addr 172.21.15.46:0/2564977319 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:56:27.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.324+0000 7fe2a6312640 1 --2- 172.21.15.46:0/2564977319 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e523e390 0x5575e56166e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:27.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.325+0000 7fe2a5310640 1 -- 172.21.15.46:0/2564977319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575e521d9f0 msgr2=0x5575e561aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:27.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.325+0000 7fe2a5310640 1 --2- 172.21.15.46:0/2564977319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575e521d9f0 0x5575e561aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:27.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.325+0000 7fe2a5310640 1 -- 172.21.15.46:0/2564977319 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e523e390 msgr2=0x5575e56166e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:27.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.325+0000 7fe2a5310640 1 --2- 172.21.15.46:0/2564977319 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e523e390 0x5575e56166e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:27.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.325+0000 7fe2a5310640 1 -- 172.21.15.46:0/2564977319 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575e568daf0 con 0x5575e52361b0 2024-09-21T03:56:27.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.325+0000 7fe2a5b11640 1 --2- 172.21.15.46:0/2564977319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575e521d9f0 0x5575e561aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:56:27.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.325+0000 7fe2a6312640 1 --2- 172.21.15.46:0/2564977319 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e523e390 0x5575e56166e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:56:27.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.325+0000 7fe2a5310640 1 --2- 172.21.15.46:0/2564977319 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5575e52361b0 0x5575e5615fd0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fe29000fc90 tx=0x7fe290035c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9fe1a0acaca778 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:27.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.325+0000 7fe2897fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:56:27.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.325+0000 7fe2897fa640 1 -- 172.21.15.46:0/2564977319 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe290013d70 con 0x5575e52361b0 2024-09-21T03:56:27.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.325+0000 7fe2897fa640 1 -- 172.21.15.46:0/2564977319 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fe290027040 con 0x5575e52361b0 2024-09-21T03:56:27.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.325+0000 7fe2ae2e9740 1 -- 172.21.15.46:0/2564977319 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe290004390 con 0x5575e52361b0 2024-09-21T03:56:27.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.325+0000 7fe2897fa640 1 -- 172.21.15.46:0/2564977319 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe2900054a0 con 0x5575e52361b0 2024-09-21T03:56:27.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.325+0000 7fe2ae2e9740 10 client.15693 fetch_fsmap learned FSMap version 20 2024-09-21T03:56:27.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.325+0000 7fe2ae2e9740 1 -- 172.21.15.46:0/2564977319 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5575e568ec80 con 0x5575e52361b0 2024-09-21T03:56:27.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.326+0000 7fe2897fa640 1 -- 172.21.15.46:0/2564977319 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe290004390 con 0x5575e52361b0 2024-09-21T03:56:27.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.326+0000 7fe2897fa640 1 -- 172.21.15.46:0/2564977319 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fe29003f470 con 0x5575e52361b0 2024-09-21T03:56:27.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.326+0000 7fe2ae2e9740 10 client.15693 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:56:27.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.326+0000 7fe2ae2e9740 10 client.15693 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:56:27.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.326+0000 7fe2ae2e9740 20 client.15693 populate_metadata read hostname 'smithi046' 2024-09-21T03:56:27.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.326+0000 7fe2ae2e9740 1 --2- 172.21.15.46:0/2564977319 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5575e525f070 0x5575e56913d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:27.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.326+0000 7fe2ae2e9740 4 client.15693 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:56:27.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.326+0000 7fe2ae2e9740 1 -- 172.21.15.46:0/2564977319 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5575e557a8a0 con 0x5575e525f070 2024-09-21T03:56:27.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.326+0000 7fe2a5b11640 1 --2- 172.21.15.46:0/2564977319 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5575e525f070 0x5575e56913d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:27.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.327+0000 7fe2897fa640 10 client.15693 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:56:27.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.327+0000 7fe2a5b11640 1 --2- 172.21.15.46:0/2564977319 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5575e525f070 0x5575e56913d0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2222dbefb4dc0b7 server_cookie=48cc92a4ba2de252 in_seq=0 out_seq=0 2024-09-21T03:56:27.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.327+0000 7fe2897fa640 1 -- 172.21.15.46:0/2564977319 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5575e557a8a0 con 0x5575e525f070 2024-09-21T03:56:27.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.327+0000 7fe2897fa640 10 client.15693 handle_command_reply: tid=0 2024-09-21T03:56:27.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.327+0000 7fe2ae2e9740 1 client.15693 shutdown 2024-09-21T03:56:27.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.327+0000 7fe2ae2e9740 1 -- 172.21.15.46:0/2564977319 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5575e52361b0 msgr2=0x5575e5615fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:27.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.327+0000 7fe2ae2e9740 1 --2- 172.21.15.46:0/2564977319 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5575e52361b0 0x5575e5615fd0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fe29000fc90 tx=0x7fe290035c90 comp rx=0 tx=0).stop 2024-09-21T03:56:27.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.327+0000 7fe2ae2e9740 1 -- 172.21.15.46:0/2564977319 shutdown_connections 2024-09-21T03:56:27.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.327+0000 7fe2ae2e9740 1 --2- 172.21.15.46:0/2564977319 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5575e525f070 0x5575e56913d0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:27.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.327+0000 7fe2ae2e9740 1 --2- 172.21.15.46:0/2564977319 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e523e390 0x5575e56166e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:27.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.327+0000 7fe2ae2e9740 1 --2- 172.21.15.46:0/2564977319 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5575e52361b0 0x5575e5615fd0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:27.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.327+0000 7fe2897fa640 0 client.15693 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:56:27.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.327+0000 7fe2ae2e9740 1 --2- 172.21.15.46:0/2564977319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575e521d9f0 0x5575e561aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:27.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.327+0000 7fe2ae2e9740 1 -- 172.21.15.46:0/2564977319 >> 172.21.15.46:0/2564977319 conn(0x5575e5253460 msgr2=0x5575e56131d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:27.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.327+0000 7fe2ae2e9740 1 -- 172.21.15.46:0/2564977319 shutdown_connections 2024-09-21T03:56:27.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.327+0000 7fe2ae2e9740 1 -- 172.21.15.46:0/2564977319 wait complete. 2024-09-21T03:56:27.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.328+0000 7fe2ae2e9740 20 client.15693 trim_cache size 0 max 16384 2024-09-21T03:56:27.335 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-21T03:56:27.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.328+0000 7fe2a7d75640 1 -- 172.21.15.46:0/2918424026 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe28c0b6680 msgr2=0x7fe28c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:27.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.328+0000 7fe2a7d75640 1 --2- 172.21.15.46:0/2918424026 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe28c0b6680 0x7fe28c0b8b90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe290009710 tx=0x7fe290005850 comp rx=0 tx=0).stop 2024-09-21T03:56:27.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.328+0000 7fe2a7d75640 1 -- 172.21.15.46:0/2918424026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2a010ddf0 msgr2=0x7fe2a01031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:27.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.328+0000 7fe2a7d75640 1 --2- 172.21.15.46:0/2918424026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2a010ddf0 0x7fe2a01031d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe29800eb10 tx=0x7fe29800c2d0 comp rx=0 tx=0).stop 2024-09-21T03:56:27.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.328+0000 7fe2a7d75640 1 -- 172.21.15.46:0/2918424026 shutdown_connections 2024-09-21T03:56:27.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.328+0000 7fe2a7d75640 1 --2- 172.21.15.46:0/2918424026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2a010ddf0 0x7fe2a01031d0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:27.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.328+0000 7fe2a7d75640 1 --2- 172.21.15.46:0/2918424026 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2a0105270 0x7fe2a0102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:27.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.328+0000 7fe2a7d75640 1 --2- 172.21.15.46:0/2918424026 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe28c0b6680 0x7fe28c0b8b90 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:27.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.328+0000 7fe2a7d75640 1 --2- 172.21.15.46:0/2918424026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2a0104840 0x7fe2a0102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:27.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.328+0000 7fe2a7d75640 1 -- 172.21.15.46:0/2918424026 >> 172.21.15.46:0/2918424026 conn(0x7fe2a0079730 msgr2=0x7fe2a0107a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:27.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.328+0000 7fe2a7d75640 1 -- 172.21.15.46:0/2918424026 shutdown_connections 2024-09-21T03:56:27.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:27.328+0000 7fe2a7d75640 1 -- 172.21.15.46:0/2918424026 wait complete. 2024-09-21T03:56:27.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:27 smithi046 ceph-mon[30954]: pgmap v362: 97 pgs: 97 active+clean; 296 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 60 MiB/s rd, 1.0 MiB/s wr, 1.96k op/s 2024-09-21T03:56:27.566 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4197376 len 8192 2024-09-21T03:56:27.566 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4197376 len 8192 2024-09-21T03:56:27.566 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4197376 len 16384 2024-09-21T03:56:27.566 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4197376 len 16384 2024-09-21T03:56:27.567 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4197376 len 16384 2024-09-21T03:56:27.567 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4197376 len 16384 2024-09-21T03:56:27.567 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4197888 len 1024 2024-09-21T03:56:27.567 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4197888 len 1024 2024-09-21T03:56:27.567 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4197888 len 1024 2024-09-21T03:56:27.567 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4197888 len 1024 2024-09-21T03:56:27.567 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4197888 len 2048 2024-09-21T03:56:27.567 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4197888 len 2048 2024-09-21T03:56:27.567 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4197888 len 2048 2024-09-21T03:56:27.567 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4197888 len 2048 2024-09-21T03:56:27.567 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4197888 len 4096 2024-09-21T03:56:27.567 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4197888 len 4096 2024-09-21T03:56:27.567 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4197888 len 4096 2024-09-21T03:56:27.568 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4197888 len 4096 2024-09-21T03:56:27.568 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4197888 len 8192 2024-09-21T03:56:27.568 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4197888 len 8192 2024-09-21T03:56:27.568 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4197888 len 8192 2024-09-21T03:56:27.568 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4197888 len 8192 2024-09-21T03:56:27.568 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 1536 offset 4197888 len 16384 2024-09-21T03:56:27.568 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4197888 len 16384 2024-09-21T03:56:27.568 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 1536 offset 4197888 len 16384 2024-09-21T03:56:27.568 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 1536 offset 4197888 len 16384 2024-09-21T03:56:27.568 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4190720 len 1024 2024-09-21T03:56:27.568 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4190720 len 1024 2024-09-21T03:56:27.568 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4190720 len 1024 2024-09-21T03:56:27.568 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4190720 len 1024 2024-09-21T03:56:27.568 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4190720 len 2048 2024-09-21T03:56:27.569 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4190720 len 2048 2024-09-21T03:56:27.569 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4190720 len 2048 2024-09-21T03:56:27.569 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4190720 len 2048 2024-09-21T03:56:27.569 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4190720 len 4096 2024-09-21T03:56:27.569 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4190720 len 4096 2024-09-21T03:56:27.569 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4190720 len 4096 2024-09-21T03:56:27.569 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4190720 len 4096 2024-09-21T03:56:27.569 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4190720 len 8192 2024-09-21T03:56:27.569 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4190720 len 8192 2024-09-21T03:56:27.569 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4190720 len 8192 2024-09-21T03:56:27.569 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4190720 len 8192 2024-09-21T03:56:27.569 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4190720 len 16384 2024-09-21T03:56:27.569 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4190720 len 16384 2024-09-21T03:56:27.570 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4190720 len 16384 2024-09-21T03:56:27.570 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4190720 len 16384 2024-09-21T03:56:27.570 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4191232 len 1024 2024-09-21T03:56:27.570 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4191232 len 1024 2024-09-21T03:56:27.570 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4191232 len 1024 2024-09-21T03:56:27.570 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4191232 len 1024 2024-09-21T03:56:27.570 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4191232 len 2048 2024-09-21T03:56:27.570 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4191232 len 2048 2024-09-21T03:56:27.570 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4191232 len 2048 2024-09-21T03:56:27.570 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4191232 len 2048 2024-09-21T03:56:27.570 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4191232 len 4096 2024-09-21T03:56:27.570 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4191232 len 4096 2024-09-21T03:56:27.570 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4191232 len 4096 2024-09-21T03:56:27.570 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4191232 len 4096 2024-09-21T03:56:27.571 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4191232 len 8192 2024-09-21T03:56:27.571 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4191232 len 8192 2024-09-21T03:56:27.571 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4191232 len 8192 2024-09-21T03:56:27.571 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4191232 len 8192 2024-09-21T03:56:27.571 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4191232 len 16384 2024-09-21T03:56:27.571 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4191232 len 16384 2024-09-21T03:56:27.571 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4191232 len 16384 2024-09-21T03:56:27.571 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4191232 len 16384 2024-09-21T03:56:27.571 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4191744 len 1024 2024-09-21T03:56:27.571 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4191744 len 1024 2024-09-21T03:56:27.571 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4191744 len 1024 2024-09-21T03:56:27.571 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4191744 len 1024 2024-09-21T03:56:27.571 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4191744 len 2048 2024-09-21T03:56:27.571 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4191744 len 2048 2024-09-21T03:56:27.572 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4191744 len 2048 2024-09-21T03:56:27.572 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4191744 len 2048 2024-09-21T03:56:27.572 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4191744 len 4096 2024-09-21T03:56:27.572 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4191744 len 4096 2024-09-21T03:56:27.572 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4191744 len 4096 2024-09-21T03:56:27.572 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4191744 len 4096 2024-09-21T03:56:27.572 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4191744 len 8192 2024-09-21T03:56:27.572 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4191744 len 8192 2024-09-21T03:56:27.572 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4191744 len 8192 2024-09-21T03:56:27.572 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:27 smithi105 ceph-mon[34773]: pgmap v362: 97 pgs: 97 active+clean; 296 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 60 MiB/s rd, 1.0 MiB/s wr, 1.96k op/s 2024-09-21T03:56:27.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:27 smithi162 ceph-mon[35071]: pgmap v362: 97 pgs: 97 active+clean; 296 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 60 MiB/s rd, 1.0 MiB/s wr, 1.96k op/s 2024-09-21T03:56:28.078 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4191744 len 8192 2024-09-21T03:56:28.078 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4191744 len 16384 2024-09-21T03:56:28.078 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4191744 len 16384 2024-09-21T03:56:28.078 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4191744 len 16384 2024-09-21T03:56:28.078 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4191744 len 16384 2024-09-21T03:56:28.078 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4192256 len 1024 2024-09-21T03:56:28.078 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4192256 len 1024 2024-09-21T03:56:28.078 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4192256 len 1024 2024-09-21T03:56:28.078 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4192256 len 1024 2024-09-21T03:56:28.079 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4192256 len 2048 2024-09-21T03:56:28.079 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4192256 len 2048 2024-09-21T03:56:28.079 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4192256 len 2048 2024-09-21T03:56:28.079 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4192256 len 2048 2024-09-21T03:56:28.079 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4192256 len 4096 2024-09-21T03:56:28.079 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4192256 len 4096 2024-09-21T03:56:28.079 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4192256 len 4096 2024-09-21T03:56:28.079 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4192256 len 4096 2024-09-21T03:56:28.079 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4192256 len 8192 2024-09-21T03:56:28.079 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4192256 len 8192 2024-09-21T03:56:28.079 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4192256 len 8192 2024-09-21T03:56:28.080 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4192256 len 8192 2024-09-21T03:56:28.080 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4192256 len 16384 2024-09-21T03:56:28.080 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4192256 len 16384 2024-09-21T03:56:28.080 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4192256 len 16384 2024-09-21T03:56:28.080 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4192256 len 16384 2024-09-21T03:56:28.080 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4192768 len 1024 2024-09-21T03:56:28.080 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4192768 len 1024 2024-09-21T03:56:28.080 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4192768 len 1024 2024-09-21T03:56:28.080 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4192768 len 1024 2024-09-21T03:56:28.080 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4192768 len 2048 2024-09-21T03:56:28.080 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4192768 len 2048 2024-09-21T03:56:28.080 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4192768 len 2048 2024-09-21T03:56:28.080 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4192768 len 2048 2024-09-21T03:56:28.080 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4192768 len 4096 2024-09-21T03:56:28.081 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4192768 len 4096 2024-09-21T03:56:28.081 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4192768 len 4096 2024-09-21T03:56:28.081 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4192768 len 4096 2024-09-21T03:56:28.081 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4192768 len 8192 2024-09-21T03:56:28.081 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4192768 len 8192 2024-09-21T03:56:28.081 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4192768 len 8192 2024-09-21T03:56:28.081 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4192768 len 8192 2024-09-21T03:56:28.081 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4192768 len 16384 2024-09-21T03:56:28.081 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4192768 len 16384 2024-09-21T03:56:28.081 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4192768 len 16384 2024-09-21T03:56:28.081 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4192768 len 16384 2024-09-21T03:56:28.081 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4193280 len 1024 2024-09-21T03:56:28.081 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4193280 len 1024 2024-09-21T03:56:28.081 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4193280 len 1024 2024-09-21T03:56:28.082 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4193280 len 1024 2024-09-21T03:56:28.082 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4193280 len 2048 2024-09-21T03:56:28.082 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4193280 len 2048 2024-09-21T03:56:28.082 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4193280 len 2048 2024-09-21T03:56:28.082 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4193280 len 2048 2024-09-21T03:56:28.082 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4193280 len 4096 2024-09-21T03:56:28.082 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4193280 len 4096 2024-09-21T03:56:28.082 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4193280 len 4096 2024-09-21T03:56:28.082 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4193280 len 4096 2024-09-21T03:56:28.082 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4193280 len 8192 2024-09-21T03:56:28.082 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4193280 len 8192 2024-09-21T03:56:28.082 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4193280 len 8192 2024-09-21T03:56:28.082 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4193280 len 8192 2024-09-21T03:56:28.082 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4193280 len 16384 2024-09-21T03:56:28.083 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4193280 len 16384 2024-09-21T03:56:28.083 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4193280 len 16384 2024-09-21T03:56:28.083 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4193280 len 16384 2024-09-21T03:56:28.083 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4193792 len 1024 2024-09-21T03:56:28.083 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4193792 len 1024 2024-09-21T03:56:28.083 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4193792 len 1024 2024-09-21T03:56:28.083 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4193792 len 1024 2024-09-21T03:56:28.083 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4193792 len 2048 2024-09-21T03:56:28.083 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4193792 len 2048 2024-09-21T03:56:28.083 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4193792 len 2048 2024-09-21T03:56:28.083 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4193792 len 2048 2024-09-21T03:56:28.083 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4193792 len 4096 2024-09-21T03:56:28.083 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4193792 len 4096 2024-09-21T03:56:28.083 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4193792 len 4096 2024-09-21T03:56:28.084 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4193792 len 4096 2024-09-21T03:56:28.084 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4193792 len 8192 2024-09-21T03:56:28.084 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4193792 len 8192 2024-09-21T03:56:28.084 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4193792 len 8192 2024-09-21T03:56:28.084 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4193792 len 8192 2024-09-21T03:56:28.433 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4193792 len 16384 2024-09-21T03:56:28.433 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4193792 len 16384 2024-09-21T03:56:28.433 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4193792 len 16384 2024-09-21T03:56:28.433 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4193792 len 16384 2024-09-21T03:56:28.433 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4194304 len 1024 2024-09-21T03:56:28.434 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4194304 len 1024 2024-09-21T03:56:28.434 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4194304 len 1024 2024-09-21T03:56:28.434 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4194304 len 1024 2024-09-21T03:56:28.434 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4194304 len 2048 2024-09-21T03:56:28.434 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4194304 len 2048 2024-09-21T03:56:28.434 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4194304 len 2048 2024-09-21T03:56:28.434 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4194304 len 2048 2024-09-21T03:56:28.434 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4194304 len 4096 2024-09-21T03:56:28.434 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4194304 len 4096 2024-09-21T03:56:28.434 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4194304 len 4096 2024-09-21T03:56:28.434 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4194304 len 4096 2024-09-21T03:56:28.434 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4194304 len 8192 2024-09-21T03:56:28.434 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4194304 len 8192 2024-09-21T03:56:28.434 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4194304 len 8192 2024-09-21T03:56:28.435 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4194304 len 8192 2024-09-21T03:56:28.435 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4194304 len 16384 2024-09-21T03:56:28.435 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4194304 len 16384 2024-09-21T03:56:28.435 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4194304 len 16384 2024-09-21T03:56:28.435 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4194304 len 16384 2024-09-21T03:56:28.435 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4194816 len 1024 2024-09-21T03:56:28.435 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4194816 len 1024 2024-09-21T03:56:28.435 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4194816 len 1024 2024-09-21T03:56:28.435 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4194816 len 1024 2024-09-21T03:56:28.435 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4194816 len 2048 2024-09-21T03:56:28.435 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4194816 len 2048 2024-09-21T03:56:28.435 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4194816 len 2048 2024-09-21T03:56:28.435 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4194816 len 2048 2024-09-21T03:56:28.435 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4194816 len 4096 2024-09-21T03:56:28.436 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4194816 len 4096 2024-09-21T03:56:28.436 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4194816 len 4096 2024-09-21T03:56:28.436 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4194816 len 4096 2024-09-21T03:56:28.436 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4194816 len 8192 2024-09-21T03:56:28.436 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4194816 len 8192 2024-09-21T03:56:28.436 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4194816 len 8192 2024-09-21T03:56:28.436 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4194816 len 8192 2024-09-21T03:56:28.436 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4194816 len 16384 2024-09-21T03:56:28.436 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4194816 len 16384 2024-09-21T03:56:28.436 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4194816 len 16384 2024-09-21T03:56:28.436 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4194816 len 16384 2024-09-21T03:56:28.436 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4195328 len 1024 2024-09-21T03:56:28.436 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4195328 len 1024 2024-09-21T03:56:28.436 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4195328 len 1024 2024-09-21T03:56:28.437 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4195328 len 1024 2024-09-21T03:56:28.437 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4195328 len 2048 2024-09-21T03:56:28.437 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4195328 len 2048 2024-09-21T03:56:28.437 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4195328 len 2048 2024-09-21T03:56:28.437 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4195328 len 2048 2024-09-21T03:56:28.437 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4195328 len 4096 2024-09-21T03:56:28.437 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4195328 len 4096 2024-09-21T03:56:28.437 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4195328 len 4096 2024-09-21T03:56:28.437 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4195328 len 4096 2024-09-21T03:56:28.437 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4195328 len 8192 2024-09-21T03:56:28.437 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4195328 len 8192 2024-09-21T03:56:28.437 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4195328 len 8192 2024-09-21T03:56:28.437 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4195328 len 8192 2024-09-21T03:56:28.437 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4195328 len 16384 2024-09-21T03:56:28.437 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4195328 len 16384 2024-09-21T03:56:28.438 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4195328 len 16384 2024-09-21T03:56:28.438 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4195328 len 16384 2024-09-21T03:56:28.438 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4195840 len 1024 2024-09-21T03:56:28.438 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4195840 len 1024 2024-09-21T03:56:28.438 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4195840 len 1024 2024-09-21T03:56:28.438 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4195840 len 1024 2024-09-21T03:56:28.438 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4195840 len 2048 2024-09-21T03:56:28.438 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4195840 len 2048 2024-09-21T03:56:28.438 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4195840 len 2048 2024-09-21T03:56:28.438 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4195840 len 2048 2024-09-21T03:56:28.438 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4195840 len 4096 2024-09-21T03:56:28.438 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4195840 len 4096 2024-09-21T03:56:28.438 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4195840 len 4096 2024-09-21T03:56:28.438 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4195840 len 4096 2024-09-21T03:56:28.439 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4195840 len 8192 2024-09-21T03:56:28.439 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4195840 len 8192 2024-09-21T03:56:28.439 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4195840 len 8192 2024-09-21T03:56:28.439 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4195840 len 8192 2024-09-21T03:56:28.781 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4195840 len 16384 2024-09-21T03:56:28.782 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4195840 len 16384 2024-09-21T03:56:28.782 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4195840 len 16384 2024-09-21T03:56:28.782 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4195840 len 16384 2024-09-21T03:56:28.782 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4196352 len 1024 2024-09-21T03:56:28.782 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4196352 len 1024 2024-09-21T03:56:28.782 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4196352 len 1024 2024-09-21T03:56:28.782 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4196352 len 1024 2024-09-21T03:56:28.782 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4196352 len 2048 2024-09-21T03:56:28.783 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4196352 len 2048 2024-09-21T03:56:28.783 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4196352 len 2048 2024-09-21T03:56:28.783 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4196352 len 2048 2024-09-21T03:56:28.783 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4196352 len 4096 2024-09-21T03:56:28.783 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4196352 len 4096 2024-09-21T03:56:28.783 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4196352 len 4096 2024-09-21T03:56:28.783 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4196352 len 4096 2024-09-21T03:56:28.783 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4196352 len 8192 2024-09-21T03:56:28.783 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4196352 len 8192 2024-09-21T03:56:28.784 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4196352 len 8192 2024-09-21T03:56:28.784 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4196352 len 8192 2024-09-21T03:56:28.784 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4196352 len 16384 2024-09-21T03:56:28.784 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4196352 len 16384 2024-09-21T03:56:28.784 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4196352 len 16384 2024-09-21T03:56:28.784 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4196352 len 16384 2024-09-21T03:56:28.785 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4196864 len 1024 2024-09-21T03:56:28.785 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4196864 len 1024 2024-09-21T03:56:28.785 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4196864 len 1024 2024-09-21T03:56:28.785 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4196864 len 1024 2024-09-21T03:56:28.785 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4196864 len 2048 2024-09-21T03:56:28.785 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4196864 len 2048 2024-09-21T03:56:28.785 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4196864 len 2048 2024-09-21T03:56:28.785 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4196864 len 2048 2024-09-21T03:56:28.785 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4196864 len 4096 2024-09-21T03:56:28.786 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4196864 len 4096 2024-09-21T03:56:28.786 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4196864 len 4096 2024-09-21T03:56:28.786 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4196864 len 4096 2024-09-21T03:56:28.786 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4196864 len 8192 2024-09-21T03:56:28.786 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4196864 len 8192 2024-09-21T03:56:28.786 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4196864 len 8192 2024-09-21T03:56:28.786 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4196864 len 8192 2024-09-21T03:56:28.787 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4196864 len 16384 2024-09-21T03:56:28.787 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4196864 len 16384 2024-09-21T03:56:28.787 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4196864 len 16384 2024-09-21T03:56:28.787 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4196864 len 16384 2024-09-21T03:56:28.787 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4197376 len 1024 2024-09-21T03:56:28.787 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4197376 len 1024 2024-09-21T03:56:28.787 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4197376 len 1024 2024-09-21T03:56:28.787 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4197376 len 1024 2024-09-21T03:56:28.788 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4197376 len 2048 2024-09-21T03:56:28.788 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4197376 len 2048 2024-09-21T03:56:28.788 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4197376 len 2048 2024-09-21T03:56:28.788 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4197376 len 2048 2024-09-21T03:56:28.788 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4197376 len 4096 2024-09-21T03:56:28.788 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4197376 len 4096 2024-09-21T03:56:28.788 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4197376 len 4096 2024-09-21T03:56:28.788 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4197376 len 4096 2024-09-21T03:56:28.788 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4197376 len 8192 2024-09-21T03:56:28.788 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4197376 len 8192 2024-09-21T03:56:28.788 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4197376 len 8192 2024-09-21T03:56:28.789 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4197376 len 8192 2024-09-21T03:56:28.789 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4197376 len 16384 2024-09-21T03:56:28.789 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4197376 len 16384 2024-09-21T03:56:28.789 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4197376 len 16384 2024-09-21T03:56:28.789 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4197376 len 16384 2024-09-21T03:56:28.789 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4197888 len 1024 2024-09-21T03:56:28.789 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4197888 len 1024 2024-09-21T03:56:28.789 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4197888 len 1024 2024-09-21T03:56:28.789 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4197888 len 1024 2024-09-21T03:56:28.789 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4197888 len 2048 2024-09-21T03:56:28.789 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4197888 len 2048 2024-09-21T03:56:28.789 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4197888 len 2048 2024-09-21T03:56:28.789 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4197888 len 2048 2024-09-21T03:56:28.789 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4197888 len 4096 2024-09-21T03:56:28.790 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4197888 len 4096 2024-09-21T03:56:28.790 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4197888 len 4096 2024-09-21T03:56:28.790 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4197888 len 4096 2024-09-21T03:56:28.790 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4197888 len 8192 2024-09-21T03:56:28.790 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4197888 len 8192 2024-09-21T03:56:28.790 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4197888 len 8192 2024-09-21T03:56:28.790 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4197888 len 8192 2024-09-21T03:56:28.790 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2048 offset 4197888 len 16384 2024-09-21T03:56:29.140 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:56:29.140 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:56:29.341 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4197888 len 16384 2024-09-21T03:56:29.341 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2048 offset 4197888 len 16384 2024-09-21T03:56:29.341 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2048 offset 4197888 len 16384 2024-09-21T03:56:29.341 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4190720 len 1024 2024-09-21T03:56:29.341 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4190720 len 1024 2024-09-21T03:56:29.341 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4190720 len 1024 2024-09-21T03:56:29.341 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4190720 len 1024 2024-09-21T03:56:29.341 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4190720 len 2048 2024-09-21T03:56:29.341 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4190720 len 2048 2024-09-21T03:56:29.342 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4190720 len 2048 2024-09-21T03:56:29.342 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4190720 len 2048 2024-09-21T03:56:29.342 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4190720 len 4096 2024-09-21T03:56:29.342 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4190720 len 4096 2024-09-21T03:56:29.342 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4190720 len 4096 2024-09-21T03:56:29.342 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4190720 len 4096 2024-09-21T03:56:29.342 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4190720 len 8192 2024-09-21T03:56:29.342 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4190720 len 8192 2024-09-21T03:56:29.342 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4190720 len 8192 2024-09-21T03:56:29.342 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4190720 len 8192 2024-09-21T03:56:29.342 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4190720 len 16384 2024-09-21T03:56:29.342 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4190720 len 16384 2024-09-21T03:56:29.342 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4190720 len 16384 2024-09-21T03:56:29.343 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4190720 len 16384 2024-09-21T03:56:29.343 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4191232 len 1024 2024-09-21T03:56:29.343 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4191232 len 1024 2024-09-21T03:56:29.343 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4191232 len 1024 2024-09-21T03:56:29.343 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4191232 len 1024 2024-09-21T03:56:29.343 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4191232 len 2048 2024-09-21T03:56:29.343 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4191232 len 2048 2024-09-21T03:56:29.343 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4191232 len 2048 2024-09-21T03:56:29.343 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4191232 len 2048 2024-09-21T03:56:29.343 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4191232 len 4096 2024-09-21T03:56:29.343 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4191232 len 4096 2024-09-21T03:56:29.343 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4191232 len 4096 2024-09-21T03:56:29.343 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4191232 len 4096 2024-09-21T03:56:29.343 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4191232 len 8192 2024-09-21T03:56:29.344 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4191232 len 8192 2024-09-21T03:56:29.344 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4191232 len 8192 2024-09-21T03:56:29.344 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4191232 len 8192 2024-09-21T03:56:29.344 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4191232 len 16384 2024-09-21T03:56:29.344 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4191232 len 16384 2024-09-21T03:56:29.344 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4191232 len 16384 2024-09-21T03:56:29.344 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4191232 len 16384 2024-09-21T03:56:29.344 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4191744 len 1024 2024-09-21T03:56:29.344 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4191744 len 1024 2024-09-21T03:56:29.344 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4191744 len 1024 2024-09-21T03:56:29.344 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4191744 len 1024 2024-09-21T03:56:29.344 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4191744 len 2048 2024-09-21T03:56:29.344 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4191744 len 2048 2024-09-21T03:56:29.345 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4191744 len 2048 2024-09-21T03:56:29.345 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4191744 len 2048 2024-09-21T03:56:29.345 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4191744 len 4096 2024-09-21T03:56:29.345 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4191744 len 4096 2024-09-21T03:56:29.345 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4191744 len 4096 2024-09-21T03:56:29.345 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4191744 len 4096 2024-09-21T03:56:29.345 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4191744 len 8192 2024-09-21T03:56:29.345 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4191744 len 8192 2024-09-21T03:56:29.345 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4191744 len 8192 2024-09-21T03:56:29.345 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4191744 len 8192 2024-09-21T03:56:29.345 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4191744 len 16384 2024-09-21T03:56:29.345 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4191744 len 16384 2024-09-21T03:56:29.345 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4191744 len 16384 2024-09-21T03:56:29.345 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4191744 len 16384 2024-09-21T03:56:29.346 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4192256 len 1024 2024-09-21T03:56:29.346 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4192256 len 1024 2024-09-21T03:56:29.346 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4192256 len 1024 2024-09-21T03:56:29.346 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4192256 len 1024 2024-09-21T03:56:29.346 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4192256 len 2048 2024-09-21T03:56:29.346 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4192256 len 2048 2024-09-21T03:56:29.346 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4192256 len 2048 2024-09-21T03:56:29.346 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4192256 len 2048 2024-09-21T03:56:29.346 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4192256 len 4096 2024-09-21T03:56:29.346 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4192256 len 4096 2024-09-21T03:56:29.346 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4192256 len 4096 2024-09-21T03:56:29.346 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4192256 len 4096 2024-09-21T03:56:29.346 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4192256 len 8192 2024-09-21T03:56:29.346 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4192256 len 8192 2024-09-21T03:56:29.347 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4192256 len 8192 2024-09-21T03:56:29.347 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4192256 len 8192 2024-09-21T03:56:29.347 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4192256 len 16384 2024-09-21T03:56:29.347 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4192256 len 16384 2024-09-21T03:56:29.430 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:56:29.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:29 smithi046 ceph-mon[30954]: pgmap v363: 97 pgs: 97 active+clean; 293 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 90 MiB/s rd, 1.6 MiB/s wr, 2.10k op/s 2024-09-21T03:56:29.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:29 smithi105 ceph-mon[34773]: pgmap v363: 97 pgs: 97 active+clean; 293 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 90 MiB/s rd, 1.6 MiB/s wr, 2.10k op/s 2024-09-21T03:56:29.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:29 smithi162 ceph-mon[35071]: pgmap v363: 97 pgs: 97 active+clean; 293 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 90 MiB/s rd, 1.6 MiB/s wr, 2.10k op/s 2024-09-21T03:56:29.902 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4192256 len 16384 2024-09-21T03:56:29.903 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4192256 len 16384 2024-09-21T03:56:29.903 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4192768 len 1024 2024-09-21T03:56:29.903 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4192768 len 1024 2024-09-21T03:56:29.903 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4192768 len 1024 2024-09-21T03:56:29.903 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4192768 len 1024 2024-09-21T03:56:29.903 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4192768 len 2048 2024-09-21T03:56:29.903 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4192768 len 2048 2024-09-21T03:56:29.903 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4192768 len 2048 2024-09-21T03:56:29.903 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4192768 len 2048 2024-09-21T03:56:29.904 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4192768 len 4096 2024-09-21T03:56:29.904 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4192768 len 4096 2024-09-21T03:56:29.904 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4192768 len 4096 2024-09-21T03:56:29.904 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4192768 len 4096 2024-09-21T03:56:29.904 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4192768 len 8192 2024-09-21T03:56:29.904 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4192768 len 8192 2024-09-21T03:56:29.904 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4192768 len 8192 2024-09-21T03:56:29.904 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4192768 len 8192 2024-09-21T03:56:29.904 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4192768 len 16384 2024-09-21T03:56:29.904 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4192768 len 16384 2024-09-21T03:56:29.904 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4192768 len 16384 2024-09-21T03:56:29.904 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4192768 len 16384 2024-09-21T03:56:29.905 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4193280 len 1024 2024-09-21T03:56:29.905 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4193280 len 1024 2024-09-21T03:56:29.905 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4193280 len 1024 2024-09-21T03:56:29.905 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4193280 len 1024 2024-09-21T03:56:29.905 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4193280 len 2048 2024-09-21T03:56:29.905 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4193280 len 2048 2024-09-21T03:56:29.905 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4193280 len 2048 2024-09-21T03:56:29.905 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4193280 len 2048 2024-09-21T03:56:29.905 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4193280 len 4096 2024-09-21T03:56:29.905 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4193280 len 4096 2024-09-21T03:56:29.905 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4193280 len 4096 2024-09-21T03:56:29.906 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4193280 len 4096 2024-09-21T03:56:29.906 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4193280 len 8192 2024-09-21T03:56:29.906 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4193280 len 8192 2024-09-21T03:56:29.906 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4193280 len 8192 2024-09-21T03:56:29.906 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4193280 len 8192 2024-09-21T03:56:29.906 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4193280 len 16384 2024-09-21T03:56:29.906 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4193280 len 16384 2024-09-21T03:56:29.906 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4193280 len 16384 2024-09-21T03:56:29.906 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4193280 len 16384 2024-09-21T03:56:29.907 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4193792 len 1024 2024-09-21T03:56:29.907 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4193792 len 1024 2024-09-21T03:56:29.907 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4193792 len 1024 2024-09-21T03:56:29.907 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4193792 len 1024 2024-09-21T03:56:29.907 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4193792 len 2048 2024-09-21T03:56:29.907 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4193792 len 2048 2024-09-21T03:56:29.907 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4193792 len 2048 2024-09-21T03:56:29.907 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4193792 len 2048 2024-09-21T03:56:29.907 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4193792 len 4096 2024-09-21T03:56:29.907 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4193792 len 4096 2024-09-21T03:56:29.908 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4193792 len 4096 2024-09-21T03:56:29.908 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4193792 len 4096 2024-09-21T03:56:29.908 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4193792 len 8192 2024-09-21T03:56:29.908 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4193792 len 8192 2024-09-21T03:56:29.908 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4193792 len 8192 2024-09-21T03:56:29.908 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4193792 len 8192 2024-09-21T03:56:29.908 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4193792 len 16384 2024-09-21T03:56:29.908 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4193792 len 16384 2024-09-21T03:56:29.908 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4193792 len 16384 2024-09-21T03:56:29.908 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4193792 len 16384 2024-09-21T03:56:29.908 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4194304 len 1024 2024-09-21T03:56:29.908 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4194304 len 1024 2024-09-21T03:56:29.908 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4194304 len 1024 2024-09-21T03:56:29.909 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4194304 len 1024 2024-09-21T03:56:29.909 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4194304 len 2048 2024-09-21T03:56:29.909 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4194304 len 2048 2024-09-21T03:56:29.909 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4194304 len 2048 2024-09-21T03:56:29.909 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4194304 len 2048 2024-09-21T03:56:29.909 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4194304 len 4096 2024-09-21T03:56:29.909 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4194304 len 4096 2024-09-21T03:56:29.909 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4194304 len 4096 2024-09-21T03:56:29.909 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4194304 len 4096 2024-09-21T03:56:29.909 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4194304 len 8192 2024-09-21T03:56:29.909 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4194304 len 8192 2024-09-21T03:56:29.909 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4194304 len 8192 2024-09-21T03:56:29.909 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4194304 len 8192 2024-09-21T03:56:29.909 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4194304 len 16384 2024-09-21T03:56:29.909 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4194304 len 16384 2024-09-21T03:56:29.910 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4194304 len 16384 2024-09-21T03:56:30.244 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4194304 len 16384 2024-09-21T03:56:30.245 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4194816 len 1024 2024-09-21T03:56:30.245 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4194816 len 1024 2024-09-21T03:56:30.245 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4194816 len 1024 2024-09-21T03:56:30.245 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4194816 len 1024 2024-09-21T03:56:30.245 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4194816 len 2048 2024-09-21T03:56:30.245 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4194816 len 2048 2024-09-21T03:56:30.245 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4194816 len 2048 2024-09-21T03:56:30.245 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4194816 len 2048 2024-09-21T03:56:30.245 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4194816 len 4096 2024-09-21T03:56:30.245 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4194816 len 4096 2024-09-21T03:56:30.245 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4194816 len 4096 2024-09-21T03:56:30.245 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4194816 len 4096 2024-09-21T03:56:30.245 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4194816 len 8192 2024-09-21T03:56:30.246 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4194816 len 8192 2024-09-21T03:56:30.246 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4194816 len 8192 2024-09-21T03:56:30.246 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4194816 len 8192 2024-09-21T03:56:30.246 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4194816 len 16384 2024-09-21T03:56:30.246 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4194816 len 16384 2024-09-21T03:56:30.246 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4194816 len 16384 2024-09-21T03:56:30.246 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4194816 len 16384 2024-09-21T03:56:30.246 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4195328 len 1024 2024-09-21T03:56:30.246 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4195328 len 1024 2024-09-21T03:56:30.246 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4195328 len 1024 2024-09-21T03:56:30.246 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4195328 len 1024 2024-09-21T03:56:30.246 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4195328 len 2048 2024-09-21T03:56:30.247 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4195328 len 2048 2024-09-21T03:56:30.247 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4195328 len 2048 2024-09-21T03:56:30.247 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4195328 len 2048 2024-09-21T03:56:30.247 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4195328 len 4096 2024-09-21T03:56:30.247 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4195328 len 4096 2024-09-21T03:56:30.247 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4195328 len 4096 2024-09-21T03:56:30.247 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4195328 len 4096 2024-09-21T03:56:30.247 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4195328 len 8192 2024-09-21T03:56:30.247 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4195328 len 8192 2024-09-21T03:56:30.247 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4195328 len 8192 2024-09-21T03:56:30.247 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4195328 len 8192 2024-09-21T03:56:30.247 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4195328 len 16384 2024-09-21T03:56:30.247 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4195328 len 16384 2024-09-21T03:56:30.247 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4195328 len 16384 2024-09-21T03:56:30.248 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4195328 len 16384 2024-09-21T03:56:30.248 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4195840 len 1024 2024-09-21T03:56:30.248 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4195840 len 1024 2024-09-21T03:56:30.248 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4195840 len 1024 2024-09-21T03:56:30.248 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4195840 len 1024 2024-09-21T03:56:30.248 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4195840 len 2048 2024-09-21T03:56:30.248 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4195840 len 2048 2024-09-21T03:56:30.248 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4195840 len 2048 2024-09-21T03:56:30.248 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4195840 len 2048 2024-09-21T03:56:30.248 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4195840 len 4096 2024-09-21T03:56:30.248 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4195840 len 4096 2024-09-21T03:56:30.248 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4195840 len 4096 2024-09-21T03:56:30.248 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4195840 len 4096 2024-09-21T03:56:30.248 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4195840 len 8192 2024-09-21T03:56:30.249 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4195840 len 8192 2024-09-21T03:56:30.249 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4195840 len 8192 2024-09-21T03:56:30.249 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4195840 len 8192 2024-09-21T03:56:30.249 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4195840 len 16384 2024-09-21T03:56:30.249 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4195840 len 16384 2024-09-21T03:56:30.249 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4195840 len 16384 2024-09-21T03:56:30.249 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4195840 len 16384 2024-09-21T03:56:30.249 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4196352 len 1024 2024-09-21T03:56:30.249 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4196352 len 1024 2024-09-21T03:56:30.249 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4196352 len 1024 2024-09-21T03:56:30.249 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4196352 len 1024 2024-09-21T03:56:30.249 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4196352 len 2048 2024-09-21T03:56:30.249 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4196352 len 2048 2024-09-21T03:56:30.249 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4196352 len 2048 2024-09-21T03:56:30.249 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4196352 len 2048 2024-09-21T03:56:30.250 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4196352 len 4096 2024-09-21T03:56:30.250 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4196352 len 4096 2024-09-21T03:56:30.250 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4196352 len 4096 2024-09-21T03:56:30.250 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4196352 len 4096 2024-09-21T03:56:30.250 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4196352 len 8192 2024-09-21T03:56:30.250 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4196352 len 8192 2024-09-21T03:56:30.250 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4196352 len 8192 2024-09-21T03:56:30.250 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4196352 len 8192 2024-09-21T03:56:30.250 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4196352 len 16384 2024-09-21T03:56:30.250 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4196352 len 16384 2024-09-21T03:56:30.250 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4196352 len 16384 2024-09-21T03:56:30.250 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4196352 len 16384 2024-09-21T03:56:30.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.045+0000 7f104f970640 1 -- 172.21.15.46:0/944668490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1048106bd0 msgr2=0x7f1048110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:30.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.045+0000 7f104f970640 1 --2- 172.21.15.46:0/944668490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1048106bd0 0x7f1048110660 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1040009900 tx=0x7f104002a410 comp rx=0 tx=0).stop 2024-09-21T03:56:30.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.045+0000 7f104f970640 1 -- 172.21.15.46:0/944668490 shutdown_connections 2024-09-21T03:56:30.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.045+0000 7f104f970640 1 --2- 172.21.15.46:0/944668490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1048106bd0 0x7f1048110660 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:30.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.045+0000 7f104f970640 1 --2- 172.21.15.46:0/944668490 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1048106280 0x7f1048106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:30.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.045+0000 7f104f970640 1 --2- 172.21.15.46:0/944668490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1048102090 0x7f10481024a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:30.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.045+0000 7f104f970640 1 -- 172.21.15.46:0/944668490 >> 172.21.15.46:0/944668490 conn(0x7f1048077c60 msgr2=0x7f10480780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:30.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.045+0000 7f104f970640 1 -- 172.21.15.46:0/944668490 shutdown_connections 2024-09-21T03:56:30.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.045+0000 7f104f970640 1 -- 172.21.15.46:0/944668490 wait complete. 2024-09-21T03:56:30.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.046+0000 7f104f970640 1 Processor -- start 2024-09-21T03:56:30.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.046+0000 7f104f970640 1 -- start start 2024-09-21T03:56:30.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.046+0000 7f104f970640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1048102090 0x7f104819a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:30.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.046+0000 7f104f970640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1048106280 0x7f104819aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:30.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.046+0000 7f104f970640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1048106bd0 0x7f104819fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:30.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.046+0000 7f104f970640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1048113ac0 con 0x7f1048106280 2024-09-21T03:56:30.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.046+0000 7f104f970640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1048113940 con 0x7f1048102090 2024-09-21T03:56:30.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.046+0000 7f104f970640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1048113c40 con 0x7f1048106bd0 2024-09-21T03:56:30.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.046+0000 7f104cf0b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1048106280 0x7f104819aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:30.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.046+0000 7f104d70c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1048102090 0x7f104819a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:30.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.046+0000 7f104cf0b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1048106280 0x7f104819aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35018/0 (socket says 172.21.15.46:35018) 2024-09-21T03:56:30.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.046+0000 7f104cf0b640 1 -- 172.21.15.46:0/521269195 learned_addr learned my addr 172.21.15.46:0/521269195 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:56:30.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.047+0000 7f104df0d640 1 --2- 172.21.15.46:0/521269195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1048106bd0 0x7f104819fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:30.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.047+0000 7f104cf0b640 1 -- 172.21.15.46:0/521269195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1048106bd0 msgr2=0x7f104819fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:30.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.047+0000 7f104cf0b640 1 --2- 172.21.15.46:0/521269195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1048106bd0 0x7f104819fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:30.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.047+0000 7f104cf0b640 1 -- 172.21.15.46:0/521269195 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1048102090 msgr2=0x7f104819a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:30.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.047+0000 7f104cf0b640 1 --2- 172.21.15.46:0/521269195 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1048102090 0x7f104819a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:30.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.047+0000 7f104cf0b640 1 -- 172.21.15.46:0/521269195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10481a04a0 con 0x7f1048106280 2024-09-21T03:56:30.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.047+0000 7f104cf0b640 1 --2- 172.21.15.46:0/521269195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1048106280 0x7f104819aad0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f103c00d740 tx=0x7f103c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:30.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.047+0000 7f10467fc640 1 -- 172.21.15.46:0/521269195 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103c017070 con 0x7f1048106280 2024-09-21T03:56:30.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.047+0000 7f104f970640 1 -- 172.21.15.46:0/521269195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10481a0790 con 0x7f1048106280 2024-09-21T03:56:30.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.047+0000 7f10467fc640 1 -- 172.21.15.46:0/521269195 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f103c00de50 con 0x7f1048106280 2024-09-21T03:56:30.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.047+0000 7f10467fc640 1 -- 172.21.15.46:0/521269195 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103c00f620 con 0x7f1048106280 2024-09-21T03:56:30.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.047+0000 7f104f970640 1 -- 172.21.15.46:0/521269195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10481a6ef0 con 0x7f1048106280 2024-09-21T03:56:30.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.050+0000 7f1055ee4740 1 Processor -- start 2024-09-21T03:56:30.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.050+0000 7f1055ee4740 1 -- start start 2024-09-21T03:56:30.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.051+0000 7f1055ee4740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55664ef76350 0x55664f31d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:30.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.051+0000 7f1055ee4740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55664ef4d490 0x55664f31d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:30.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.051+0000 7f10467fc640 1 -- 172.21.15.46:0/521269195 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f103c01a070 con 0x7f1048106280 2024-09-21T03:56:30.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.051+0000 7f1055ee4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55664ef55670 0x55664f31deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:30.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.051+0000 7f1055ee4740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55664f293e60 con 0x55664ef76350 2024-09-21T03:56:30.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.051+0000 7f1055ee4740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55664f283290 con 0x55664ef4d490 2024-09-21T03:56:30.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.051+0000 7f1055ee4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55664f2870a0 con 0x55664ef55670 2024-09-21T03:56:30.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.051+0000 7f104df0d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55664ef76350 0x55664f31d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:30.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.051+0000 7f104df0d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55664ef76350 0x55664f31d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35032/0 (socket says 172.21.15.46:35032) 2024-09-21T03:56:30.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.051+0000 7f104d70c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55664ef4d490 0x55664f31d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:30.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.051+0000 7f104df0d640 1 -- 172.21.15.46:0/4203122992 learned_addr learned my addr 172.21.15.46:0/4203122992 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:56:30.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.051+0000 7f104cf0b640 1 --2- 172.21.15.46:0/4203122992 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55664ef55670 0x55664f31deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:30.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.051+0000 7f104d70c640 1 -- 172.21.15.46:0/4203122992 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55664ef55670 msgr2=0x55664f31deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:30.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.051+0000 7f104d70c640 1 --2- 172.21.15.46:0/4203122992 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55664ef55670 0x55664f31deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:30.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.051+0000 7f104d70c640 1 -- 172.21.15.46:0/4203122992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55664ef76350 msgr2=0x55664f31d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:30.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.051+0000 7f104d70c640 1 --2- 172.21.15.46:0/4203122992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55664ef76350 0x55664f31d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:30.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.051+0000 7f104d70c640 1 -- 172.21.15.46:0/4203122992 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55664efe1930 con 0x55664ef4d490 2024-09-21T03:56:30.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.052+0000 7f104d70c640 1 --2- 172.21.15.46:0/4203122992 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55664ef4d490 0x55664f31d970 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1038005fd0 tx=0x7f10380118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56b58fb479064737 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:30.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.052+0000 7f102f7fe640 1 -- 172.21.15.46:0/4203122992 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1038004b20 con 0x55664ef4d490 2024-09-21T03:56:30.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.052+0000 7f10467fc640 1 --2- 172.21.15.46:0/521269195 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f10300b6680 0x7f10300b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:30.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.052+0000 7f102f7fe640 1 -- 172.21.15.46:0/4203122992 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1038003e20 con 0x55664ef4d490 2024-09-21T03:56:30.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.052+0000 7f102f7fe640 1 -- 172.21.15.46:0/4203122992 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10380047c0 con 0x55664ef4d490 2024-09-21T03:56:30.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.052+0000 7f104df0d640 1 --2- 172.21.15.46:0/521269195 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f10300b6680 0x7f10300b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:30.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.052+0000 7f10467fc640 1 -- 172.21.15.46:0/521269195 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f103c0e6f50 con 0x7f1048106280 2024-09-21T03:56:30.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.053+0000 7f1055ee4740 1 -- 172.21.15.46:0/4203122992 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55664ef4d490 msgr2=0x55664f31d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:30.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.053+0000 7f1055ee4740 1 --2- 172.21.15.46:0/4203122992 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55664ef4d490 0x55664f31d970 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1038005fd0 tx=0x7f10380118d0 comp rx=0 tx=0).stop 2024-09-21T03:56:30.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.053+0000 7f104df0d640 1 --2- 172.21.15.46:0/521269195 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f10300b6680 0x7f10300b8b90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1040005f70 tx=0x7f10400095c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:30.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.053+0000 7f1055ee4740 1 -- 172.21.15.46:0/4203122992 shutdown_connections 2024-09-21T03:56:30.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.053+0000 7f1055ee4740 1 --2- 172.21.15.46:0/4203122992 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55664ef55670 0x55664f31deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:30.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.053+0000 7f1055ee4740 1 --2- 172.21.15.46:0/4203122992 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55664ef4d490 0x55664f31d970 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:30.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.053+0000 7f1055ee4740 1 --2- 172.21.15.46:0/4203122992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55664ef76350 0x55664f31d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:30.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.053+0000 7f1055ee4740 1 -- 172.21.15.46:0/4203122992 >> 172.21.15.46:0/4203122992 conn(0x55664ef6a740 msgr2=0x55664f31b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:30.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.053+0000 7f1055ee4740 1 -- 172.21.15.46:0/4203122992 shutdown_connections 2024-09-21T03:56:30.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.053+0000 7f1055ee4740 1 -- 172.21.15.46:0/4203122992 wait complete. 2024-09-21T03:56:30.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.053+0000 7f1055ee4740 1 -- start start 2024-09-21T03:56:30.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.053+0000 7f1055ee4740 1 Processor -- start 2024-09-21T03:56:30.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.054+0000 7f1055ee4740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55664ef4d490 0x55664f329030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:30.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.054+0000 7f1055ee4740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55664ef55670 0x55664f329570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:30.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.054+0000 7f1055ee4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55664ef76350 0x55664f339370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:30.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.054+0000 7f1055ee4740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55664f0e4890 con 0x55664ef4d490 2024-09-21T03:56:30.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.054+0000 7f1055ee4740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55664f21dd40 con 0x55664ef55670 2024-09-21T03:56:30.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.054+0000 7f1055ee4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55664f330020 con 0x55664ef76350 2024-09-21T03:56:30.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.054+0000 7f1055ee4740 10 client.0 _ll_register_callbacks cb 0x55664f281c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:56:30.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.054+0000 7f104d70c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55664ef4d490 0x55664f329030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:30.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.054+0000 7f104d70c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55664ef4d490 0x55664f329030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35034/0 (socket says 172.21.15.46:35034) 2024-09-21T03:56:30.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.054+0000 7f104d70c640 1 -- 172.21.15.46:0/2853353159 learned_addr learned my addr 172.21.15.46:0/2853353159 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:56:30.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.054+0000 7f104cf0b640 1 --2- 172.21.15.46:0/2853353159 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55664ef55670 0x55664f329570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:30.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.054+0000 7f104df0d640 1 --2- 172.21.15.46:0/2853353159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55664ef76350 0x55664f339370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:30.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.054+0000 7f104d70c640 1 -- 172.21.15.46:0/2853353159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55664ef76350 msgr2=0x55664f339370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:30.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.054+0000 7f104d70c640 1 --2- 172.21.15.46:0/2853353159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55664ef76350 0x55664f339370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:30.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.054+0000 7f104d70c640 1 -- 172.21.15.46:0/2853353159 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55664ef55670 msgr2=0x55664f329570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:30.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.054+0000 7f104d70c640 1 --2- 172.21.15.46:0/2853353159 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55664ef55670 0x55664f329570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:30.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.054+0000 7f104d70c640 1 -- 172.21.15.46:0/2853353159 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55664f3398b0 con 0x55664ef4d490 2024-09-21T03:56:30.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.055+0000 7f104d70c640 1 --2- 172.21.15.46:0/2853353159 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55664ef4d490 0x55664f329030 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1038012fd0 tx=0x7f1038009be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee67446dc1e196d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:30.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.055+0000 7f102cff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:56:30.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.055+0000 7f102cff9640 1 -- 172.21.15.46:0/2853353159 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1038028020 con 0x55664ef4d490 2024-09-21T03:56:30.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.055+0000 7f1055ee4740 1 -- 172.21.15.46:0/2853353159 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1038003e20 con 0x55664ef4d490 2024-09-21T03:56:30.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.055+0000 7f102cff9640 1 -- 172.21.15.46:0/2853353159 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f1038016040 con 0x55664ef4d490 2024-09-21T03:56:30.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.055+0000 7f102cff9640 1 -- 172.21.15.46:0/2853353159 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1038004d90 con 0x55664ef4d490 2024-09-21T03:56:30.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.055+0000 7f1055ee4740 10 client.15705 fetch_fsmap learned FSMap version 20 2024-09-21T03:56:30.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.055+0000 7f1055ee4740 1 -- 172.21.15.46:0/2853353159 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55664f33c1c0 con 0x55664ef4d490 2024-09-21T03:56:30.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.056+0000 7f102cff9640 1 -- 172.21.15.46:0/2853353159 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1038003e20 con 0x55664ef4d490 2024-09-21T03:56:30.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.056+0000 7f102cff9640 1 -- 172.21.15.46:0/2853353159 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f103800fcd0 con 0x55664ef4d490 2024-09-21T03:56:30.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.056+0000 7f1055ee4740 10 client.15705 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:56:30.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.056+0000 7f1055ee4740 10 client.15705 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:56:30.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.056+0000 7f1055ee4740 20 client.15705 populate_metadata read hostname 'smithi046' 2024-09-21T03:56:30.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.056+0000 7f1055ee4740 1 --2- 172.21.15.46:0/2853353159 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55664ef34cd0 0x55664f33f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:30.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.056+0000 7f1055ee4740 4 client.15705 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:56:30.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.056+0000 7f1055ee4740 1 -- 172.21.15.46:0/2853353159 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55664f295db0 con 0x55664ef34cd0 2024-09-21T03:56:30.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.056+0000 7f104cf0b640 1 --2- 172.21.15.46:0/2853353159 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55664ef34cd0 0x55664f33f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:30.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.057+0000 7f102cff9640 10 client.15705 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:56:30.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.057+0000 7f104cf0b640 1 --2- 172.21.15.46:0/2853353159 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55664ef34cd0 0x55664f33f580 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c025a8e350525033 server_cookie=e3f791e09539c85e in_seq=0 out_seq=0 2024-09-21T03:56:30.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.057+0000 7f102cff9640 1 -- 172.21.15.46:0/2853353159 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55664f295db0 con 0x55664ef34cd0 2024-09-21T03:56:30.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.057+0000 7f102cff9640 10 client.15705 handle_command_reply: tid=0 2024-09-21T03:56:30.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.057+0000 7f1055ee4740 1 client.15705 shutdown 2024-09-21T03:56:30.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.057+0000 7f1055ee4740 1 -- 172.21.15.46:0/2853353159 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55664ef4d490 msgr2=0x55664f329030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:30.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.057+0000 7f1055ee4740 1 --2- 172.21.15.46:0/2853353159 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55664ef4d490 0x55664f329030 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1038012fd0 tx=0x7f1038009be0 comp rx=0 tx=0).stop 2024-09-21T03:56:30.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.058+0000 7f1055ee4740 1 -- 172.21.15.46:0/2853353159 shutdown_connections 2024-09-21T03:56:30.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.058+0000 7f1055ee4740 1 --2- 172.21.15.46:0/2853353159 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55664ef34cd0 0x55664f33f580 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:30.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.058+0000 7f1055ee4740 1 --2- 172.21.15.46:0/2853353159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55664ef76350 0x55664f339370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:30.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.058+0000 7f1055ee4740 1 --2- 172.21.15.46:0/2853353159 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55664ef55670 0x55664f329570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:30.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.058+0000 7f102cff9640 0 client.15705 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:56:30.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.058+0000 7f1055ee4740 1 --2- 172.21.15.46:0/2853353159 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55664ef4d490 0x55664f329030 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:30.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.058+0000 7f1055ee4740 1 -- 172.21.15.46:0/2853353159 >> 172.21.15.46:0/2853353159 conn(0x55664ef6a740 msgr2=0x55664f320610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:30.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.058+0000 7f1055ee4740 1 -- 172.21.15.46:0/2853353159 shutdown_connections 2024-09-21T03:56:30.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.058+0000 7f1055ee4740 1 -- 172.21.15.46:0/2853353159 wait complete. 2024-09-21T03:56:30.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.058+0000 7f1055ee4740 20 client.15705 trim_cache size 0 max 16384 2024-09-21T03:56:30.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.077+0000 7f1055ee4740 1 Processor -- start 2024-09-21T03:56:30.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.077+0000 7f1055ee4740 1 -- start start 2024-09-21T03:56:30.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.077+0000 7f1055ee4740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55664ef34cd0 0x55664f322c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:30.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.077+0000 7f1055ee4740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55664ef4d490 0x55664f339270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:30.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.077+0000 7f1055ee4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55664ef55670 0x55664f3286c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:30.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.077+0000 7f1055ee4740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f10481ab360 con 0x55664ef34cd0 2024-09-21T03:56:30.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.077+0000 7f1055ee4740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f10481adbe0 con 0x55664ef4d490 2024-09-21T03:56:30.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.077+0000 7f1055ee4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f10481ab9d0 con 0x55664ef55670 2024-09-21T03:56:30.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.077+0000 7f104d70c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55664ef34cd0 0x55664f322c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:30.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.077+0000 7f104d70c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55664ef34cd0 0x55664f322c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35050/0 (socket says 172.21.15.46:35050) 2024-09-21T03:56:30.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.077+0000 7f104df0d640 1 --2- 172.21.15.46:0/3668612988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55664ef55670 0x55664f3286c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:30.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.077+0000 7f104d70c640 1 -- 172.21.15.46:0/3668612988 learned_addr learned my addr 172.21.15.46:0/3668612988 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:56:30.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.077+0000 7f104cf0b640 1 --2- 172.21.15.46:0/3668612988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55664ef4d490 0x55664f339270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:30.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.077+0000 7f104d70c640 1 -- 172.21.15.46:0/3668612988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55664ef55670 msgr2=0x55664f3286c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:30.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.077+0000 7f104d70c640 1 --2- 172.21.15.46:0/3668612988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55664ef55670 0x55664f3286c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:30.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.077+0000 7f104d70c640 1 -- 172.21.15.46:0/3668612988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55664ef4d490 msgr2=0x55664f339270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:30.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.077+0000 7f104d70c640 1 --2- 172.21.15.46:0/3668612988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55664ef4d490 0x55664f339270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:30.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.077+0000 7f104d70c640 1 -- 172.21.15.46:0/3668612988 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55664f320290 con 0x55664ef34cd0 2024-09-21T03:56:30.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.078+0000 7f104d70c640 1 --2- 172.21.15.46:0/3668612988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55664ef34cd0 0x55664f322c50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1038005d70 tx=0x7f10380094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13dcc32435ac6c14 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:30.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.078+0000 7f102effd640 1 -- 172.21.15.46:0/3668612988 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103803c070 con 0x55664ef34cd0 2024-09-21T03:56:30.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.078+0000 7f102effd640 1 -- 172.21.15.46:0/3668612988 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1038004210 con 0x55664ef34cd0 2024-09-21T03:56:30.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.078+0000 7f102effd640 1 -- 172.21.15.46:0/3668612988 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1038028040 con 0x55664ef34cd0 2024-09-21T03:56:30.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.079+0000 7f1055ee4740 1 -- 172.21.15.46:0/3668612988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55664ef34cd0 msgr2=0x55664f322c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:30.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.079+0000 7f1055ee4740 1 --2- 172.21.15.46:0/3668612988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55664ef34cd0 0x55664f322c50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1038005d70 tx=0x7f10380094a0 comp rx=0 tx=0).stop 2024-09-21T03:56:30.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.079+0000 7f1055ee4740 1 -- 172.21.15.46:0/3668612988 shutdown_connections 2024-09-21T03:56:30.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.079+0000 7f1055ee4740 1 --2- 172.21.15.46:0/3668612988 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55664ef55670 0x55664f3286c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:30.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.079+0000 7f1055ee4740 1 --2- 172.21.15.46:0/3668612988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55664ef4d490 0x55664f339270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:30.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.079+0000 7f1055ee4740 1 --2- 172.21.15.46:0/3668612988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55664ef34cd0 0x55664f322c50 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:30.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.079+0000 7f1055ee4740 1 -- 172.21.15.46:0/3668612988 >> 172.21.15.46:0/3668612988 conn(0x55664ef6a740 msgr2=0x55664f322540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:30.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.079+0000 7f1055ee4740 1 -- 172.21.15.46:0/3668612988 shutdown_connections 2024-09-21T03:56:30.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.079+0000 7f1055ee4740 1 -- 172.21.15.46:0/3668612988 wait complete. 2024-09-21T03:56:30.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.079+0000 7f1055ee4740 1 -- start start 2024-09-21T03:56:30.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.080+0000 7f1055ee4740 1 Processor -- start 2024-09-21T03:56:30.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.080+0000 7f1055ee4740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55664ef4d490 0x55664f331a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:30.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.080+0000 7f1055ee4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55664ef55670 0x55664f331f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:30.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.080+0000 7f1055ee4740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55664ef76350 0x55664f3a8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:30.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.080+0000 7f1055ee4740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f10481ac0a0 con 0x55664ef76350 2024-09-21T03:56:30.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.080+0000 7f1055ee4740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f10481ad510 con 0x55664ef4d490 2024-09-21T03:56:30.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.080+0000 7f1055ee4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f10481ac770 con 0x55664ef55670 2024-09-21T03:56:30.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.080+0000 7f1055ee4740 10 client.0 _ll_register_callbacks cb 0x7f1040009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:56:30.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.080+0000 7f104df0d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55664ef76350 0x55664f3a8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:30.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.080+0000 7f104d70c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55664ef4d490 0x55664f331a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:30.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.080+0000 7f104cf0b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55664ef55670 0x55664f331f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:30.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.080+0000 7f104df0d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55664ef76350 0x55664f3a8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35062/0 (socket says 172.21.15.46:35062) 2024-09-21T03:56:30.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.080+0000 7f104df0d640 1 -- 172.21.15.46:0/3687097176 learned_addr learned my addr 172.21.15.46:0/3687097176 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:56:30.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.080+0000 7f104d70c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55664ef4d490 0x55664f331a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.46:45690/0 (socket says 172.21.15.46:45690) 2024-09-21T03:56:30.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.081+0000 7f104df0d640 1 -- 172.21.15.46:0/3687097176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55664ef55670 msgr2=0x55664f331f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:30.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.081+0000 7f104df0d640 1 --2- 172.21.15.46:0/3687097176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55664ef55670 0x55664f331f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:30.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.081+0000 7f104df0d640 1 -- 172.21.15.46:0/3687097176 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55664ef4d490 msgr2=0x55664f331a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:30.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.081+0000 7f104df0d640 1 --2- 172.21.15.46:0/3687097176 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55664ef4d490 0x55664f331a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:30.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.081+0000 7f104df0d640 1 -- 172.21.15.46:0/3687097176 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55664f3a9480 con 0x55664ef76350 2024-09-21T03:56:30.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.081+0000 7f104cf0b640 1 --2- 172.21.15.46:0/3687097176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55664ef55670 0x55664f331f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:56:30.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.081+0000 7f104df0d640 1 --2- 172.21.15.46:0/3687097176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55664ef76350 0x55664f3a8ef0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f1040033000 tx=0x7f1040009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=980473663859369b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:30.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.081+0000 7f102cff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:56:30.317 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T03:56:30.317 INFO:teuthology.orchestra.run.smithi046.stdout: "return_code": 0, 2024-09-21T03:56:30.317 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_tag": "a871f724-0198-493c-b03e-b2de78aba243", 2024-09-21T03:56:30.317 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": "asynchronous" 2024-09-21T03:56:30.317 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T03:56:30.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.081+0000 7f102cff9640 1 -- 172.21.15.46:0/3687097176 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1040035040 con 0x55664ef76350 2024-09-21T03:56:30.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.081+0000 7f102cff9640 1 -- 172.21.15.46:0/3687097176 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f1040003a00 con 0x55664ef76350 2024-09-21T03:56:30.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.081+0000 7f1055ee4740 1 -- 172.21.15.46:0/3687097176 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1038004210 con 0x55664ef76350 2024-09-21T03:56:30.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.081+0000 7f102cff9640 1 -- 172.21.15.46:0/3687097176 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1040059030 con 0x55664ef76350 2024-09-21T03:56:30.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.081+0000 7f1055ee4740 10 client.15711 fetch_fsmap learned FSMap version 20 2024-09-21T03:56:30.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.081+0000 7f1055ee4740 1 -- 172.21.15.46:0/3687097176 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55664f3aa740 con 0x55664ef76350 2024-09-21T03:56:30.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.081+0000 7f102cff9640 1 -- 172.21.15.46:0/3687097176 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1038004210 con 0x55664ef76350 2024-09-21T03:56:30.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.082+0000 7f102cff9640 1 -- 172.21.15.46:0/3687097176 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f1040052020 con 0x55664ef76350 2024-09-21T03:56:30.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.082+0000 7f1055ee4740 10 client.15711 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:56:30.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.082+0000 7f1055ee4740 10 client.15711 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:56:30.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.082+0000 7f1055ee4740 20 client.15711 populate_metadata read hostname 'smithi046' 2024-09-21T03:56:30.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.082+0000 7f1055ee4740 1 --2- 172.21.15.46:0/3687097176 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55664ef0a080 0x55664f3acf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:30.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.082+0000 7f1055ee4740 4 client.15711 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:56:30.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.082+0000 7f1055ee4740 1 -- 172.21.15.46:0/3687097176 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55664f291860 con 0x55664ef0a080 2024-09-21T03:56:30.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.082+0000 7f104d70c640 1 --2- 172.21.15.46:0/3687097176 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55664ef0a080 0x55664f3acf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:30.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.082+0000 7f104d70c640 1 --2- 172.21.15.46:0/3687097176 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55664ef0a080 0x55664f3acf60 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5dd51df32e17ec9 server_cookie=ca8c01273112aa86 in_seq=0 out_seq=0 2024-09-21T03:56:30.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.082+0000 7f102cff9640 10 client.15711 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:56:30.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.084+0000 7f102cff9640 1 -- 172.21.15.46:0/3687097176 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55664f291860 con 0x55664ef0a080 2024-09-21T03:56:30.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.084+0000 7f102cff9640 10 client.15711 handle_command_reply: tid=0 2024-09-21T03:56:30.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.084+0000 7f1055ee4740 1 client.15711 shutdown 2024-09-21T03:56:30.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.084+0000 7f1055ee4740 1 -- 172.21.15.46:0/3687097176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55664ef76350 msgr2=0x55664f3a8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:30.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.084+0000 7f1055ee4740 1 --2- 172.21.15.46:0/3687097176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55664ef76350 0x55664f3a8ef0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f1040033000 tx=0x7f1040009260 comp rx=0 tx=0).stop 2024-09-21T03:56:30.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.084+0000 7f1055ee4740 1 -- 172.21.15.46:0/3687097176 shutdown_connections 2024-09-21T03:56:30.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.084+0000 7f1055ee4740 1 --2- 172.21.15.46:0/3687097176 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55664ef0a080 0x55664f3acf60 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:30.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.084+0000 7f1055ee4740 1 --2- 172.21.15.46:0/3687097176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55664ef76350 0x55664f3a8ef0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:30.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.084+0000 7f1055ee4740 1 --2- 172.21.15.46:0/3687097176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55664ef55670 0x55664f331f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:30.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.084+0000 7f1055ee4740 1 --2- 172.21.15.46:0/3687097176 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55664ef4d490 0x55664f331a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:30.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.084+0000 7f1055ee4740 1 -- 172.21.15.46:0/3687097176 >> 172.21.15.46:0/3687097176 conn(0x55664ef6a740 msgr2=0x55664f31e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:30.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.084+0000 7f102cff9640 0 client.15711 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:56:30.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.084+0000 7f1055ee4740 1 -- 172.21.15.46:0/3687097176 shutdown_connections 2024-09-21T03:56:30.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.085+0000 7f1055ee4740 1 -- 172.21.15.46:0/3687097176 wait complete. 2024-09-21T03:56:30.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.085+0000 7f1055ee4740 20 client.15711 trim_cache size 0 max 16384 2024-09-21T03:56:30.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.085+0000 7f104f970640 1 -- 172.21.15.46:0/521269195 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f10300b6680 msgr2=0x7f10300b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:30.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.085+0000 7f104f970640 1 --2- 172.21.15.46:0/521269195 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f10300b6680 0x7f10300b8b90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1040005f70 tx=0x7f10400095c0 comp rx=0 tx=0).stop 2024-09-21T03:56:30.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.085+0000 7f104f970640 1 -- 172.21.15.46:0/521269195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1048106280 msgr2=0x7f104819aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:30.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.085+0000 7f104f970640 1 --2- 172.21.15.46:0/521269195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1048106280 0x7f104819aad0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f103c00d740 tx=0x7f103c00dc00 comp rx=0 tx=0).stop 2024-09-21T03:56:30.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.085+0000 7f104f970640 1 -- 172.21.15.46:0/521269195 shutdown_connections 2024-09-21T03:56:30.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.085+0000 7f104f970640 1 --2- 172.21.15.46:0/521269195 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f10300b6680 0x7f10300b8b90 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:30.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.085+0000 7f104f970640 1 --2- 172.21.15.46:0/521269195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1048106bd0 0x7f104819fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:30.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.085+0000 7f104f970640 1 --2- 172.21.15.46:0/521269195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1048106280 0x7f104819aad0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:30.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.085+0000 7f104f970640 1 --2- 172.21.15.46:0/521269195 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1048102090 0x7f104819a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:30.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.085+0000 7f104f970640 1 -- 172.21.15.46:0/521269195 >> 172.21.15.46:0/521269195 conn(0x7f1048077c60 msgr2=0x7f1048107510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:30.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.085+0000 7f104f970640 1 -- 172.21.15.46:0/521269195 shutdown_connections 2024-09-21T03:56:30.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:30.085+0000 7f104f970640 1 -- 172.21.15.46:0/521269195 wait complete. 2024-09-21T03:56:30.619 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4196864 len 1024 2024-09-21T03:56:30.619 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4196864 len 1024 2024-09-21T03:56:30.619 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4196864 len 1024 2024-09-21T03:56:30.619 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4196864 len 1024 2024-09-21T03:56:30.619 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4196864 len 2048 2024-09-21T03:56:30.619 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4196864 len 2048 2024-09-21T03:56:30.619 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4196864 len 2048 2024-09-21T03:56:30.619 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4196864 len 2048 2024-09-21T03:56:30.619 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4196864 len 4096 2024-09-21T03:56:30.619 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4196864 len 4096 2024-09-21T03:56:30.619 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4196864 len 4096 2024-09-21T03:56:30.620 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4196864 len 4096 2024-09-21T03:56:30.620 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4196864 len 8192 2024-09-21T03:56:30.620 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4196864 len 8192 2024-09-21T03:56:30.620 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4196864 len 8192 2024-09-21T03:56:30.620 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4196864 len 8192 2024-09-21T03:56:30.620 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4196864 len 16384 2024-09-21T03:56:30.620 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4196864 len 16384 2024-09-21T03:56:30.620 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4196864 len 16384 2024-09-21T03:56:30.620 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4196864 len 16384 2024-09-21T03:56:30.620 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4197376 len 1024 2024-09-21T03:56:30.620 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4197376 len 1024 2024-09-21T03:56:30.620 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4197376 len 1024 2024-09-21T03:56:30.620 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4197376 len 1024 2024-09-21T03:56:30.620 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4197376 len 2048 2024-09-21T03:56:30.621 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4197376 len 2048 2024-09-21T03:56:30.621 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4197376 len 2048 2024-09-21T03:56:30.621 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4197376 len 2048 2024-09-21T03:56:30.621 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4197376 len 4096 2024-09-21T03:56:30.621 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4197376 len 4096 2024-09-21T03:56:30.621 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4197376 len 4096 2024-09-21T03:56:30.621 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4197376 len 4096 2024-09-21T03:56:30.621 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4197376 len 8192 2024-09-21T03:56:30.621 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4197376 len 8192 2024-09-21T03:56:30.621 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4197376 len 8192 2024-09-21T03:56:30.621 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4197376 len 8192 2024-09-21T03:56:30.621 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4197376 len 16384 2024-09-21T03:56:30.621 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4197376 len 16384 2024-09-21T03:56:30.621 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4197376 len 16384 2024-09-21T03:56:30.622 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4197376 len 16384 2024-09-21T03:56:30.622 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4197888 len 1024 2024-09-21T03:56:30.622 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4197888 len 1024 2024-09-21T03:56:30.622 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4197888 len 1024 2024-09-21T03:56:30.622 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4197888 len 1024 2024-09-21T03:56:30.622 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4197888 len 2048 2024-09-21T03:56:30.622 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4197888 len 2048 2024-09-21T03:56:30.622 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4197888 len 2048 2024-09-21T03:56:30.622 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4197888 len 2048 2024-09-21T03:56:30.622 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4197888 len 4096 2024-09-21T03:56:30.622 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4197888 len 4096 2024-09-21T03:56:30.622 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4197888 len 4096 2024-09-21T03:56:30.622 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4197888 len 4096 2024-09-21T03:56:30.622 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4197888 len 8192 2024-09-21T03:56:30.623 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4197888 len 8192 2024-09-21T03:56:30.623 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4197888 len 8192 2024-09-21T03:56:30.623 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4197888 len 8192 2024-09-21T03:56:30.623 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 2560 offset 4197888 len 16384 2024-09-21T03:56:30.623 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4197888 len 16384 2024-09-21T03:56:30.623 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 2560 offset 4197888 len 16384 2024-09-21T03:56:30.623 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 2560 offset 4197888 len 16384 2024-09-21T03:56:30.623 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4190720 len 1024 2024-09-21T03:56:30.623 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4190720 len 1024 2024-09-21T03:56:30.623 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4190720 len 1024 2024-09-21T03:56:30.624 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4190720 len 1024 2024-09-21T03:56:30.624 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4190720 len 2048 2024-09-21T03:56:30.624 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4190720 len 2048 2024-09-21T03:56:30.624 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4190720 len 2048 2024-09-21T03:56:30.624 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4190720 len 2048 2024-09-21T03:56:30.624 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4190720 len 4096 2024-09-21T03:56:30.624 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4190720 len 4096 2024-09-21T03:56:30.624 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4190720 len 4096 2024-09-21T03:56:30.624 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4190720 len 4096 2024-09-21T03:56:30.624 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4190720 len 8192 2024-09-21T03:56:30.624 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4190720 len 8192 2024-09-21T03:56:30.624 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4190720 len 8192 2024-09-21T03:56:30.624 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4190720 len 8192 2024-09-21T03:56:30.625 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4190720 len 16384 2024-09-21T03:56:30.625 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4190720 len 16384 2024-09-21T03:56:30.625 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4190720 len 16384 2024-09-21T03:56:30.625 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4190720 len 16384 2024-09-21T03:56:31.170 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4191232 len 1024 2024-09-21T03:56:31.170 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4191232 len 1024 2024-09-21T03:56:31.170 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4191232 len 1024 2024-09-21T03:56:31.170 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4191232 len 1024 2024-09-21T03:56:31.170 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4191232 len 2048 2024-09-21T03:56:31.170 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4191232 len 2048 2024-09-21T03:56:31.170 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4191232 len 2048 2024-09-21T03:56:31.171 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4191232 len 2048 2024-09-21T03:56:31.171 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4191232 len 4096 2024-09-21T03:56:31.171 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4191232 len 4096 2024-09-21T03:56:31.171 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4191232 len 4096 2024-09-21T03:56:31.171 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4191232 len 4096 2024-09-21T03:56:31.171 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4191232 len 8192 2024-09-21T03:56:31.171 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4191232 len 8192 2024-09-21T03:56:31.171 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4191232 len 8192 2024-09-21T03:56:31.171 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4191232 len 8192 2024-09-21T03:56:31.171 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4191232 len 16384 2024-09-21T03:56:31.171 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4191232 len 16384 2024-09-21T03:56:31.171 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4191232 len 16384 2024-09-21T03:56:31.171 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4191232 len 16384 2024-09-21T03:56:31.171 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4191744 len 1024 2024-09-21T03:56:31.172 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4191744 len 1024 2024-09-21T03:56:31.172 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4191744 len 1024 2024-09-21T03:56:31.172 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4191744 len 1024 2024-09-21T03:56:31.172 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4191744 len 2048 2024-09-21T03:56:31.172 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4191744 len 2048 2024-09-21T03:56:31.172 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4191744 len 2048 2024-09-21T03:56:31.172 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4191744 len 2048 2024-09-21T03:56:31.172 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4191744 len 4096 2024-09-21T03:56:31.172 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4191744 len 4096 2024-09-21T03:56:31.172 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4191744 len 4096 2024-09-21T03:56:31.172 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4191744 len 4096 2024-09-21T03:56:31.172 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4191744 len 8192 2024-09-21T03:56:31.172 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4191744 len 8192 2024-09-21T03:56:31.173 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4191744 len 8192 2024-09-21T03:56:31.173 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4191744 len 8192 2024-09-21T03:56:31.173 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4191744 len 16384 2024-09-21T03:56:31.173 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4191744 len 16384 2024-09-21T03:56:31.173 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4191744 len 16384 2024-09-21T03:56:31.173 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4191744 len 16384 2024-09-21T03:56:31.173 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4192256 len 1024 2024-09-21T03:56:31.173 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4192256 len 1024 2024-09-21T03:56:31.173 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4192256 len 1024 2024-09-21T03:56:31.173 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4192256 len 1024 2024-09-21T03:56:31.173 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4192256 len 2048 2024-09-21T03:56:31.173 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4192256 len 2048 2024-09-21T03:56:31.173 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4192256 len 2048 2024-09-21T03:56:31.173 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4192256 len 2048 2024-09-21T03:56:31.173 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4192256 len 4096 2024-09-21T03:56:31.174 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4192256 len 4096 2024-09-21T03:56:31.174 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4192256 len 4096 2024-09-21T03:56:31.174 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4192256 len 4096 2024-09-21T03:56:31.174 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4192256 len 8192 2024-09-21T03:56:31.174 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4192256 len 8192 2024-09-21T03:56:31.174 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4192256 len 8192 2024-09-21T03:56:31.174 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4192256 len 8192 2024-09-21T03:56:31.174 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4192256 len 16384 2024-09-21T03:56:31.174 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4192256 len 16384 2024-09-21T03:56:31.174 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4192256 len 16384 2024-09-21T03:56:31.174 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4192256 len 16384 2024-09-21T03:56:31.174 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4192768 len 1024 2024-09-21T03:56:31.174 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4192768 len 1024 2024-09-21T03:56:31.175 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4192768 len 1024 2024-09-21T03:56:31.175 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4192768 len 1024 2024-09-21T03:56:31.175 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4192768 len 2048 2024-09-21T03:56:31.175 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4192768 len 2048 2024-09-21T03:56:31.175 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4192768 len 2048 2024-09-21T03:56:31.175 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4192768 len 2048 2024-09-21T03:56:31.175 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4192768 len 4096 2024-09-21T03:56:31.175 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4192768 len 4096 2024-09-21T03:56:31.175 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4192768 len 4096 2024-09-21T03:56:31.175 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4192768 len 4096 2024-09-21T03:56:31.175 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4192768 len 8192 2024-09-21T03:56:31.175 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4192768 len 8192 2024-09-21T03:56:31.175 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4192768 len 8192 2024-09-21T03:56:31.175 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4192768 len 8192 2024-09-21T03:56:31.176 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4192768 len 16384 2024-09-21T03:56:31.176 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4192768 len 16384 2024-09-21T03:56:31.176 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4192768 len 16384 2024-09-21T03:56:31.176 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4192768 len 16384 2024-09-21T03:56:31.176 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4193280 len 1024 2024-09-21T03:56:31.406 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:56:31.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:31 smithi046 ceph-mon[30954]: scrub queued for path: / 2024-09-21T03:56:31.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:31 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T03:56:31.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:31 smithi046 ceph-mon[30954]: scrub summary: active paths [/] 2024-09-21T03:56:31.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:31 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T03:56:31.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:31 smithi046 ceph-mon[30954]: pgmap v364: 97 pgs: 97 active+clean; 265 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 99 MiB/s rd, 1.6 MiB/s wr, 550 op/s 2024-09-21T03:56:31.567 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:31 smithi105 ceph-mon[34773]: scrub queued for path: / 2024-09-21T03:56:31.567 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:31 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T03:56:31.567 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:31 smithi105 ceph-mon[34773]: scrub summary: active paths [/] 2024-09-21T03:56:31.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:31 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T03:56:31.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:31 smithi105 ceph-mon[34773]: pgmap v364: 97 pgs: 97 active+clean; 265 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 99 MiB/s rd, 1.6 MiB/s wr, 550 op/s 2024-09-21T03:56:31.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:31 smithi162 ceph-mon[35071]: scrub queued for path: / 2024-09-21T03:56:31.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:31 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T03:56:31.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:31 smithi162 ceph-mon[35071]: scrub summary: active paths [/] 2024-09-21T03:56:31.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:31 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T03:56:31.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:31 smithi162 ceph-mon[35071]: pgmap v364: 97 pgs: 97 active+clean; 265 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 99 MiB/s rd, 1.6 MiB/s wr, 550 op/s 2024-09-21T03:56:31.660 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4193280 len 1024 2024-09-21T03:56:31.660 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4193280 len 1024 2024-09-21T03:56:31.660 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4193280 len 1024 2024-09-21T03:56:31.660 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4193280 len 2048 2024-09-21T03:56:31.660 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4193280 len 2048 2024-09-21T03:56:31.660 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4193280 len 2048 2024-09-21T03:56:31.660 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4193280 len 2048 2024-09-21T03:56:31.660 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4193280 len 4096 2024-09-21T03:56:31.661 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4193280 len 4096 2024-09-21T03:56:31.661 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4193280 len 4096 2024-09-21T03:56:31.661 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4193280 len 4096 2024-09-21T03:56:31.661 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4193280 len 8192 2024-09-21T03:56:31.661 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4193280 len 8192 2024-09-21T03:56:31.661 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4193280 len 8192 2024-09-21T03:56:31.661 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4193280 len 8192 2024-09-21T03:56:31.661 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4193280 len 16384 2024-09-21T03:56:31.661 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4193280 len 16384 2024-09-21T03:56:31.661 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4193280 len 16384 2024-09-21T03:56:31.661 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4193280 len 16384 2024-09-21T03:56:31.661 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4193792 len 1024 2024-09-21T03:56:31.661 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4193792 len 1024 2024-09-21T03:56:31.662 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4193792 len 1024 2024-09-21T03:56:31.662 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4193792 len 1024 2024-09-21T03:56:31.662 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4193792 len 2048 2024-09-21T03:56:31.662 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4193792 len 2048 2024-09-21T03:56:31.662 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4193792 len 2048 2024-09-21T03:56:31.662 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4193792 len 2048 2024-09-21T03:56:31.662 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4193792 len 4096 2024-09-21T03:56:31.662 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4193792 len 4096 2024-09-21T03:56:31.662 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4193792 len 4096 2024-09-21T03:56:31.662 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4193792 len 4096 2024-09-21T03:56:31.662 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4193792 len 8192 2024-09-21T03:56:31.663 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4193792 len 8192 2024-09-21T03:56:31.663 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4193792 len 8192 2024-09-21T03:56:31.663 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4193792 len 8192 2024-09-21T03:56:31.663 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4193792 len 16384 2024-09-21T03:56:31.663 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4193792 len 16384 2024-09-21T03:56:31.663 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4193792 len 16384 2024-09-21T03:56:31.663 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4193792 len 16384 2024-09-21T03:56:31.663 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4194304 len 1024 2024-09-21T03:56:31.663 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4194304 len 1024 2024-09-21T03:56:31.664 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4194304 len 1024 2024-09-21T03:56:31.664 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4194304 len 1024 2024-09-21T03:56:31.664 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4194304 len 2048 2024-09-21T03:56:31.664 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4194304 len 2048 2024-09-21T03:56:31.664 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4194304 len 2048 2024-09-21T03:56:31.664 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4194304 len 2048 2024-09-21T03:56:31.664 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4194304 len 4096 2024-09-21T03:56:31.664 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4194304 len 4096 2024-09-21T03:56:31.664 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4194304 len 4096 2024-09-21T03:56:31.664 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4194304 len 4096 2024-09-21T03:56:31.664 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4194304 len 8192 2024-09-21T03:56:31.664 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4194304 len 8192 2024-09-21T03:56:31.664 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4194304 len 8192 2024-09-21T03:56:31.665 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4194304 len 8192 2024-09-21T03:56:31.665 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4194304 len 16384 2024-09-21T03:56:31.665 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4194304 len 16384 2024-09-21T03:56:31.665 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4194304 len 16384 2024-09-21T03:56:31.665 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4194304 len 16384 2024-09-21T03:56:31.665 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4194816 len 1024 2024-09-21T03:56:31.665 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4194816 len 1024 2024-09-21T03:56:31.665 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4194816 len 1024 2024-09-21T03:56:31.665 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4194816 len 1024 2024-09-21T03:56:31.665 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4194816 len 2048 2024-09-21T03:56:31.666 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4194816 len 2048 2024-09-21T03:56:31.666 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4194816 len 2048 2024-09-21T03:56:31.666 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4194816 len 2048 2024-09-21T03:56:31.666 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4194816 len 4096 2024-09-21T03:56:31.666 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4194816 len 4096 2024-09-21T03:56:31.666 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4194816 len 4096 2024-09-21T03:56:31.666 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4194816 len 4096 2024-09-21T03:56:31.666 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4194816 len 8192 2024-09-21T03:56:31.666 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4194816 len 8192 2024-09-21T03:56:31.667 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4194816 len 8192 2024-09-21T03:56:31.667 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4194816 len 8192 2024-09-21T03:56:31.667 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4194816 len 16384 2024-09-21T03:56:31.667 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4194816 len 16384 2024-09-21T03:56:31.667 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4194816 len 16384 2024-09-21T03:56:31.667 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4194816 len 16384 2024-09-21T03:56:31.667 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4195328 len 1024 2024-09-21T03:56:31.667 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4195328 len 1024 2024-09-21T03:56:31.676 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:56:32.045 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4195328 len 1024 2024-09-21T03:56:32.046 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4195328 len 1024 2024-09-21T03:56:32.046 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4195328 len 2048 2024-09-21T03:56:32.046 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4195328 len 2048 2024-09-21T03:56:32.046 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4195328 len 2048 2024-09-21T03:56:32.046 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4195328 len 2048 2024-09-21T03:56:32.046 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4195328 len 4096 2024-09-21T03:56:32.046 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4195328 len 4096 2024-09-21T03:56:32.046 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4195328 len 4096 2024-09-21T03:56:32.046 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4195328 len 4096 2024-09-21T03:56:32.046 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4195328 len 8192 2024-09-21T03:56:32.046 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4195328 len 8192 2024-09-21T03:56:32.046 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4195328 len 8192 2024-09-21T03:56:32.047 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4195328 len 8192 2024-09-21T03:56:32.047 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4195328 len 16384 2024-09-21T03:56:32.047 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4195328 len 16384 2024-09-21T03:56:32.047 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4195328 len 16384 2024-09-21T03:56:32.047 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4195328 len 16384 2024-09-21T03:56:32.047 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4195840 len 1024 2024-09-21T03:56:32.047 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4195840 len 1024 2024-09-21T03:56:32.047 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4195840 len 1024 2024-09-21T03:56:32.047 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4195840 len 1024 2024-09-21T03:56:32.047 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4195840 len 2048 2024-09-21T03:56:32.047 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4195840 len 2048 2024-09-21T03:56:32.047 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4195840 len 2048 2024-09-21T03:56:32.048 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4195840 len 2048 2024-09-21T03:56:32.048 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4195840 len 4096 2024-09-21T03:56:32.048 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4195840 len 4096 2024-09-21T03:56:32.048 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4195840 len 4096 2024-09-21T03:56:32.048 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4195840 len 4096 2024-09-21T03:56:32.048 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4195840 len 8192 2024-09-21T03:56:32.048 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4195840 len 8192 2024-09-21T03:56:32.048 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4195840 len 8192 2024-09-21T03:56:32.048 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4195840 len 8192 2024-09-21T03:56:32.048 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4195840 len 16384 2024-09-21T03:56:32.048 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4195840 len 16384 2024-09-21T03:56:32.048 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4195840 len 16384 2024-09-21T03:56:32.049 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4195840 len 16384 2024-09-21T03:56:32.049 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4196352 len 1024 2024-09-21T03:56:32.049 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4196352 len 1024 2024-09-21T03:56:32.049 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4196352 len 1024 2024-09-21T03:56:32.049 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4196352 len 1024 2024-09-21T03:56:32.049 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4196352 len 2048 2024-09-21T03:56:32.049 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4196352 len 2048 2024-09-21T03:56:32.049 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4196352 len 2048 2024-09-21T03:56:32.049 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4196352 len 2048 2024-09-21T03:56:32.049 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4196352 len 4096 2024-09-21T03:56:32.049 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4196352 len 4096 2024-09-21T03:56:32.049 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4196352 len 4096 2024-09-21T03:56:32.049 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4196352 len 4096 2024-09-21T03:56:32.050 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4196352 len 8192 2024-09-21T03:56:32.050 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4196352 len 8192 2024-09-21T03:56:32.050 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4196352 len 8192 2024-09-21T03:56:32.050 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4196352 len 8192 2024-09-21T03:56:32.050 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4196352 len 16384 2024-09-21T03:56:32.050 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4196352 len 16384 2024-09-21T03:56:32.050 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4196352 len 16384 2024-09-21T03:56:32.050 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4196352 len 16384 2024-09-21T03:56:32.050 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4196864 len 1024 2024-09-21T03:56:32.050 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4196864 len 1024 2024-09-21T03:56:32.050 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4196864 len 1024 2024-09-21T03:56:32.051 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4196864 len 1024 2024-09-21T03:56:32.051 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4196864 len 2048 2024-09-21T03:56:32.051 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4196864 len 2048 2024-09-21T03:56:32.051 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4196864 len 2048 2024-09-21T03:56:32.051 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4196864 len 2048 2024-09-21T03:56:32.051 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4196864 len 4096 2024-09-21T03:56:32.051 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4196864 len 4096 2024-09-21T03:56:32.051 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4196864 len 4096 2024-09-21T03:56:32.051 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4196864 len 4096 2024-09-21T03:56:32.051 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4196864 len 8192 2024-09-21T03:56:32.051 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4196864 len 8192 2024-09-21T03:56:32.051 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4196864 len 8192 2024-09-21T03:56:32.052 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4196864 len 8192 2024-09-21T03:56:32.052 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4196864 len 16384 2024-09-21T03:56:32.052 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4196864 len 16384 2024-09-21T03:56:32.052 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4196864 len 16384 2024-09-21T03:56:32.052 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4196864 len 16384 2024-09-21T03:56:32.052 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4197376 len 1024 2024-09-21T03:56:32.052 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4197376 len 1024 2024-09-21T03:56:32.052 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4197376 len 1024 2024-09-21T03:56:32.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.173+0000 7fc86a9c2640 1 -- 172.21.15.46:0/948029048 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc864108d10 msgr2=0x7fc86410f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:32.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.173+0000 7fc86a9c2640 1 --2- 172.21.15.46:0/948029048 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc864108d10 0x7fc86410f540 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc85c009ca0 tx=0x7fc85c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.174+0000 7fc86a9c2640 1 -- 172.21.15.46:0/948029048 shutdown_connections 2024-09-21T03:56:32.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.174+0000 7fc86a9c2640 1 --2- 172.21.15.46:0/948029048 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc864108d10 0x7fc86410f540 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.174+0000 7fc86a9c2640 1 --2- 172.21.15.46:0/948029048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8641083c0 0x7fc8641087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.174+0000 7fc86a9c2640 1 --2- 172.21.15.46:0/948029048 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc864102ad0 0x7fc864102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.174+0000 7fc86a9c2640 1 -- 172.21.15.46:0/948029048 >> 172.21.15.46:0/948029048 conn(0x7fc8640796d0 msgr2=0x7fc864079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:32.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.174+0000 7fc86a9c2640 1 -- 172.21.15.46:0/948029048 shutdown_connections 2024-09-21T03:56:32.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.174+0000 7fc86a9c2640 1 -- 172.21.15.46:0/948029048 wait complete. 2024-09-21T03:56:32.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.174+0000 7fc86a9c2640 1 Processor -- start 2024-09-21T03:56:32.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.174+0000 7fc86a9c2640 1 -- start start 2024-09-21T03:56:32.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.175+0000 7fc86a9c2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc864102ad0 0x7fc86419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:32.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.175+0000 7fc86a9c2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8641083c0 0x7fc86419aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:32.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.175+0000 7fc86a9c2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc864108d10 0x7fc86419fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:32.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.175+0000 7fc86a9c2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc8641129d0 con 0x7fc8641083c0 2024-09-21T03:56:32.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.175+0000 7fc86a9c2640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc864112850 con 0x7fc864102ad0 2024-09-21T03:56:32.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.175+0000 7fc86a9c2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc864112b50 con 0x7fc864108d10 2024-09-21T03:56:32.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.175+0000 7fc863fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc864102ad0 0x7fc86419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:32.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.175+0000 7fc863fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc864102ad0 0x7fc86419a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.46:48494/0 (socket says 172.21.15.46:48494) 2024-09-21T03:56:32.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.175+0000 7fc863fff640 1 -- 172.21.15.46:0/3239877014 learned_addr learned my addr 172.21.15.46:0/3239877014 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:56:32.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.175+0000 7fc868f5f640 1 --2- 172.21.15.46:0/3239877014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc864108d10 0x7fc86419fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:32.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.175+0000 7fc85bfff640 1 --2- 172.21.15.46:0/3239877014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8641083c0 0x7fc86419aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:32.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.175+0000 7fc863fff640 1 -- 172.21.15.46:0/3239877014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc864108d10 msgr2=0x7fc86419fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:32.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.175+0000 7fc863fff640 1 --2- 172.21.15.46:0/3239877014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc864108d10 0x7fc86419fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.175+0000 7fc863fff640 1 -- 172.21.15.46:0/3239877014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8641083c0 msgr2=0x7fc86419aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:32.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.175+0000 7fc863fff640 1 --2- 172.21.15.46:0/3239877014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8641083c0 0x7fc86419aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.175+0000 7fc863fff640 1 -- 172.21.15.46:0/3239877014 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8641a0400 con 0x7fc864102ad0 2024-09-21T03:56:32.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.176+0000 7fc863fff640 1 --2- 172.21.15.46:0/3239877014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc864102ad0 0x7fc86419a490 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc85400e9f0 tx=0x7fc85400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:32.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.176+0000 7fc861ffb640 1 -- 172.21.15.46:0/3239877014 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85400cd80 con 0x7fc864102ad0 2024-09-21T03:56:32.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.176+0000 7fc861ffb640 1 -- 172.21.15.46:0/3239877014 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8540108e0 con 0x7fc864102ad0 2024-09-21T03:56:32.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.176+0000 7fc86a9c2640 1 -- 172.21.15.46:0/3239877014 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8641a06f0 con 0x7fc864102ad0 2024-09-21T03:56:32.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.176+0000 7fc861ffb640 1 -- 172.21.15.46:0/3239877014 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc854018980 con 0x7fc864102ad0 2024-09-21T03:56:32.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.176+0000 7fc86a9c2640 1 -- 172.21.15.46:0/3239877014 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8641a6e50 con 0x7fc864102ad0 2024-09-21T03:56:32.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.179+0000 7fc870f36740 1 Processor -- start 2024-09-21T03:56:32.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.179+0000 7fc870f36740 1 -- start start 2024-09-21T03:56:32.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.180+0000 7fc870f36740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d712f9070 0x558d716a0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:32.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.180+0000 7fc870f36740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d712d01b0 0x558d716a07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:32.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.180+0000 7fc870f36740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d712d8390 0x558d716a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:32.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.180+0000 7fc870f36740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x558d71616e50 con 0x558d712d01b0 2024-09-21T03:56:32.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.180+0000 7fc870f36740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x558d71606280 con 0x558d712d8390 2024-09-21T03:56:32.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.180+0000 7fc870f36740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558d7160a090 con 0x558d712f9070 2024-09-21T03:56:32.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.180+0000 7fc861ffb640 1 -- 172.21.15.46:0/3239877014 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7fc854018b20 con 0x7fc864102ad0 2024-09-21T03:56:32.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.180+0000 7fc868f5f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d712f9070 0x558d716a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:32.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.180+0000 7fc868f5f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d712f9070 0x558d716a0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:48100/0 (socket says 172.21.15.46:48100) 2024-09-21T03:56:32.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.180+0000 7fc85bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d712d8390 0x558d716a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:32.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.180+0000 7fc868f5f640 1 -- 172.21.15.46:0/569847204 learned_addr learned my addr 172.21.15.46:0/569847204 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:56:32.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.180+0000 7fc863fff640 1 --2- 172.21.15.46:0/569847204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d712d01b0 0x558d716a07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:32.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.180+0000 7fc868f5f640 1 -- 172.21.15.46:0/569847204 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d712d8390 msgr2=0x558d716a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:32.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.180+0000 7fc868f5f640 1 --2- 172.21.15.46:0/569847204 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d712d8390 0x558d716a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.180+0000 7fc868f5f640 1 -- 172.21.15.46:0/569847204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d712d01b0 msgr2=0x558d716a07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:32.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.180+0000 7fc868f5f640 1 --2- 172.21.15.46:0/569847204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d712d01b0 0x558d716a07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.180+0000 7fc868f5f640 1 -- 172.21.15.46:0/569847204 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d71364650 con 0x558d712f9070 2024-09-21T03:56:32.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.180+0000 7fc863fff640 1 --2- 172.21.15.46:0/569847204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d712d01b0 0x558d716a07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:56:32.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.181+0000 7fc868f5f640 1 --2- 172.21.15.46:0/569847204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d712f9070 0x558d716a0270 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc85c02f410 tx=0x7fc85c02f440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e0db467d348109a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:32.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.181+0000 7fc85a7fc640 1 -- 172.21.15.46:0/569847204 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85c031cf0 con 0x558d712f9070 2024-09-21T03:56:32.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.181+0000 7fc85a7fc640 1 -- 172.21.15.46:0/569847204 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc85c036030 con 0x558d712f9070 2024-09-21T03:56:32.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.181+0000 7fc85a7fc640 1 -- 172.21.15.46:0/569847204 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85c0042a0 con 0x558d712f9070 2024-09-21T03:56:32.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.181+0000 7fc861ffb640 1 --2- 172.21.15.46:0/3239877014 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc8500b6680 0x7fc8500b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:32.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.182+0000 7fc863fff640 1 --2- 172.21.15.46:0/3239877014 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc8500b6680 0x7fc8500b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:32.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.182+0000 7fc861ffb640 1 -- 172.21.15.46:0/3239877014 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fc8540e7a90 con 0x7fc864102ad0 2024-09-21T03:56:32.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.182+0000 7fc870f36740 1 -- 172.21.15.46:0/569847204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d712f9070 msgr2=0x558d716a0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:32.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.182+0000 7fc870f36740 1 --2- 172.21.15.46:0/569847204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d712f9070 0x558d716a0270 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc85c02f410 tx=0x7fc85c02f440 comp rx=0 tx=0).stop 2024-09-21T03:56:32.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.182+0000 7fc870f36740 1 -- 172.21.15.46:0/569847204 shutdown_connections 2024-09-21T03:56:32.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.182+0000 7fc870f36740 1 --2- 172.21.15.46:0/569847204 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d712d8390 0x558d716a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.182+0000 7fc870f36740 1 --2- 172.21.15.46:0/569847204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d712d01b0 0x558d716a07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.182+0000 7fc870f36740 1 --2- 172.21.15.46:0/569847204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d712f9070 0x558d716a0270 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.182+0000 7fc870f36740 1 -- 172.21.15.46:0/569847204 >> 172.21.15.46:0/569847204 conn(0x558d712ed460 msgr2=0x558d7169e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:32.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.182+0000 7fc870f36740 1 -- 172.21.15.46:0/569847204 shutdown_connections 2024-09-21T03:56:32.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.182+0000 7fc870f36740 1 -- 172.21.15.46:0/569847204 wait complete. 2024-09-21T03:56:32.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.182+0000 7fc863fff640 1 --2- 172.21.15.46:0/3239877014 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc8500b6680 0x7fc8500b8b90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x558d7169eef0 tx=0x7fc85401f000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:32.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.182+0000 7fc870f36740 1 -- start start 2024-09-21T03:56:32.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.183+0000 7fc870f36740 1 Processor -- start 2024-09-21T03:56:32.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.183+0000 7fc870f36740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d712d01b0 0x558d716afd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:32.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.183+0000 7fc870f36740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d712d8390 0x558d716b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:32.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.183+0000 7fc870f36740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d712f9070 0x558d716b0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:32.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.183+0000 7fc870f36740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x558d71467700 con 0x558d712d01b0 2024-09-21T03:56:32.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.183+0000 7fc870f36740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x558d715a1110 con 0x558d712f9070 2024-09-21T03:56:32.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.183+0000 7fc870f36740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558d716b2bd0 con 0x558d712d8390 2024-09-21T03:56:32.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.183+0000 7fc868f5f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d712d01b0 0x558d716afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:32.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.183+0000 7fc870f36740 10 client.0 _ll_register_callbacks cb 0x558d715ba990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:56:32.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.183+0000 7fc868f5f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d712d01b0 0x558d716afd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34690/0 (socket says 172.21.15.46:34690) 2024-09-21T03:56:32.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.183+0000 7fc868f5f640 1 -- 172.21.15.46:0/3440020378 learned_addr learned my addr 172.21.15.46:0/3440020378 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:56:32.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.183+0000 7fc85bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d712d8390 0x558d716b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:32.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.183+0000 7fc868f5f640 1 --2- 172.21.15.46:0/3440020378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d712f9070 0x558d716b0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:32.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.184+0000 7fc868f5f640 1 -- 172.21.15.46:0/3440020378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d712d8390 msgr2=0x558d716b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:32.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.184+0000 7fc868f5f640 1 --2- 172.21.15.46:0/3440020378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d712d8390 0x558d716b02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.184+0000 7fc868f5f640 1 -- 172.21.15.46:0/3440020378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d712f9070 msgr2=0x558d716b0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:32.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.184+0000 7fc868f5f640 1 --2- 172.21.15.46:0/3440020378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d712f9070 0x558d716b0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.184+0000 7fc868f5f640 1 -- 172.21.15.46:0/3440020378 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d715cec40 con 0x558d712d01b0 2024-09-21T03:56:32.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.184+0000 7fc85bfff640 1 --2- 172.21.15.46:0/3440020378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d712d8390 0x558d716b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:56:32.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.184+0000 7fc868f5f640 1 --2- 172.21.15.46:0/3440020378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d712d01b0 0x558d716afd60 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc85c009620 tx=0x7fc85c003c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a165675f8d9f23 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:32.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.184+0000 7fc8437fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:56:32.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.184+0000 7fc8437fe640 1 -- 172.21.15.46:0/3440020378 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85c04a040 con 0x558d712d01b0 2024-09-21T03:56:32.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.184+0000 7fc8437fe640 1 -- 172.21.15.46:0/3440020378 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fc85c02f660 con 0x558d712d01b0 2024-09-21T03:56:32.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.184+0000 7fc870f36740 1 -- 172.21.15.46:0/3440020378 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc85c036030 con 0x558d712d01b0 2024-09-21T03:56:32.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.184+0000 7fc8437fe640 1 -- 172.21.15.46:0/3440020378 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc85c0318d0 con 0x558d712d01b0 2024-09-21T03:56:32.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.184+0000 7fc870f36740 10 client.15723 fetch_fsmap learned FSMap version 20 2024-09-21T03:56:32.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.184+0000 7fc870f36740 1 -- 172.21.15.46:0/3440020378 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x558d716be8b0 con 0x558d712d01b0 2024-09-21T03:56:32.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.185+0000 7fc8437fe640 1 -- 172.21.15.46:0/3440020378 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc85c036030 con 0x558d712d01b0 2024-09-21T03:56:32.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.185+0000 7fc8437fe640 1 -- 172.21.15.46:0/3440020378 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc85c050070 con 0x558d712d01b0 2024-09-21T03:56:32.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.185+0000 7fc870f36740 10 client.15723 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:56:32.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.185+0000 7fc870f36740 10 client.15723 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:56:32.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.185+0000 7fc870f36740 20 client.15723 populate_metadata read hostname 'smithi046' 2024-09-21T03:56:32.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.185+0000 7fc870f36740 1 --2- 172.21.15.46:0/3440020378 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558d712b79f0 0x558d716c1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:32.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.185+0000 7fc870f36740 4 client.15723 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:56:32.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.185+0000 7fc870f36740 1 -- 172.21.15.46:0/3440020378 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d71618da0 con 0x558d712b79f0 2024-09-21T03:56:32.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.185+0000 7fc85bfff640 1 --2- 172.21.15.46:0/3440020378 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558d712b79f0 0x558d716c1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:32.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.185+0000 7fc8437fe640 10 client.15723 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:56:32.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.186+0000 7fc85bfff640 1 --2- 172.21.15.46:0/3440020378 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558d712b79f0 0x558d716c1c10 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdbb91e053e2e97 server_cookie=253643e1066c6b82 in_seq=0 out_seq=0 2024-09-21T03:56:32.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.186+0000 7fc8437fe640 1 -- 172.21.15.46:0/3440020378 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558d71618da0 con 0x558d712b79f0 2024-09-21T03:56:32.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.186+0000 7fc8437fe640 10 client.15723 handle_command_reply: tid=0 2024-09-21T03:56:32.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.186+0000 7fc870f36740 1 client.15723 shutdown 2024-09-21T03:56:32.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.187+0000 7fc870f36740 1 -- 172.21.15.46:0/3440020378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d712d01b0 msgr2=0x558d716afd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:32.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.187+0000 7fc870f36740 1 --2- 172.21.15.46:0/3440020378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d712d01b0 0x558d716afd60 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc85c009620 tx=0x7fc85c003c90 comp rx=0 tx=0).stop 2024-09-21T03:56:32.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.187+0000 7fc870f36740 1 -- 172.21.15.46:0/3440020378 shutdown_connections 2024-09-21T03:56:32.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.187+0000 7fc870f36740 1 --2- 172.21.15.46:0/3440020378 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558d712b79f0 0x558d716c1c10 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.187+0000 7fc870f36740 1 --2- 172.21.15.46:0/3440020378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d712f9070 0x558d716b0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.187+0000 7fc870f36740 1 --2- 172.21.15.46:0/3440020378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d712d8390 0x558d716b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.187+0000 7fc870f36740 1 --2- 172.21.15.46:0/3440020378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d712d01b0 0x558d716afd60 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.187+0000 7fc870f36740 1 -- 172.21.15.46:0/3440020378 >> 172.21.15.46:0/3440020378 conn(0x558d712ed460 msgr2=0x558d7169c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:32.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.187+0000 7fc8437fe640 0 client.15723 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:56:32.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.187+0000 7fc870f36740 1 -- 172.21.15.46:0/3440020378 shutdown_connections 2024-09-21T03:56:32.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.187+0000 7fc870f36740 1 -- 172.21.15.46:0/3440020378 wait complete. 2024-09-21T03:56:32.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.187+0000 7fc870f36740 20 client.15723 trim_cache size 0 max 16384 2024-09-21T03:56:32.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.205+0000 7fc870f36740 1 Processor -- start 2024-09-21T03:56:32.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.205+0000 7fc870f36740 1 -- start start 2024-09-21T03:56:32.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.205+0000 7fc870f36740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d712d01b0 0x558d716a1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:32.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.205+0000 7fc870f36740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d712d8390 0x558d716b1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:32.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.205+0000 7fc870f36740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d712f9070 0x558d716acf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:32.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.205+0000 7fc870f36740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc8641ab230 con 0x558d712d01b0 2024-09-21T03:56:32.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.205+0000 7fc870f36740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc8641adab0 con 0x558d712d8390 2024-09-21T03:56:32.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.205+0000 7fc870f36740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc8641ab8a0 con 0x558d712f9070 2024-09-21T03:56:32.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.205+0000 7fc868f5f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d712d01b0 0x558d716a1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:32.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.205+0000 7fc868f5f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d712d01b0 0x558d716a1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34696/0 (socket says 172.21.15.46:34696) 2024-09-21T03:56:32.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.205+0000 7fc868f5f640 1 -- 172.21.15.46:0/115424462 learned_addr learned my addr 172.21.15.46:0/115424462 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:56:32.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.205+0000 7fc85bfff640 1 --2- 172.21.15.46:0/115424462 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d712d8390 0x558d716b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:32.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.205+0000 7fc868f5f640 1 --2- 172.21.15.46:0/115424462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d712f9070 0x558d716acf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:32.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.206+0000 7fc85bfff640 1 -- 172.21.15.46:0/115424462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d712f9070 msgr2=0x558d716acf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:32.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.206+0000 7fc85bfff640 1 --2- 172.21.15.46:0/115424462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d712f9070 0x558d716acf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.206+0000 7fc85bfff640 1 -- 172.21.15.46:0/115424462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d712d01b0 msgr2=0x558d716a1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:32.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.206+0000 7fc85bfff640 1 --2- 172.21.15.46:0/115424462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d712d01b0 0x558d716a1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.206+0000 7fc85bfff640 1 -- 172.21.15.46:0/115424462 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d716a2780 con 0x558d712d8390 2024-09-21T03:56:32.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.206+0000 7fc868f5f640 1 --2- 172.21.15.46:0/115424462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d712d01b0 0x558d716a1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:56:32.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.206+0000 7fc85bfff640 1 --2- 172.21.15.46:0/115424462 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d712d8390 0x558d716b1990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x558d71616e80 tx=0x7fc84c005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef7c82b2f0e32888 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:32.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.206+0000 7fc859ffb640 1 -- 172.21.15.46:0/115424462 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84c011a10 con 0x558d712d8390 2024-09-21T03:56:32.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.206+0000 7fc859ffb640 1 -- 172.21.15.46:0/115424462 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc84c012e40 con 0x558d712d8390 2024-09-21T03:56:32.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.206+0000 7fc859ffb640 1 -- 172.21.15.46:0/115424462 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84c0243d0 con 0x558d712d8390 2024-09-21T03:56:32.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.207+0000 7fc870f36740 1 -- 172.21.15.46:0/115424462 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d712d8390 msgr2=0x558d716b1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:32.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.207+0000 7fc870f36740 1 --2- 172.21.15.46:0/115424462 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d712d8390 0x558d716b1990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x558d71616e80 tx=0x7fc84c005f90 comp rx=0 tx=0).stop 2024-09-21T03:56:32.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.207+0000 7fc870f36740 1 -- 172.21.15.46:0/115424462 shutdown_connections 2024-09-21T03:56:32.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.207+0000 7fc870f36740 1 --2- 172.21.15.46:0/115424462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d712f9070 0x558d716acf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.207+0000 7fc870f36740 1 --2- 172.21.15.46:0/115424462 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d712d8390 0x558d716b1990 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.207+0000 7fc870f36740 1 --2- 172.21.15.46:0/115424462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d712d01b0 0x558d716a1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.207+0000 7fc870f36740 1 -- 172.21.15.46:0/115424462 >> 172.21.15.46:0/115424462 conn(0x558d712ed460 msgr2=0x558d716b1280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:32.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.207+0000 7fc870f36740 1 -- 172.21.15.46:0/115424462 shutdown_connections 2024-09-21T03:56:32.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.207+0000 7fc870f36740 1 -- 172.21.15.46:0/115424462 wait complete. 2024-09-21T03:56:32.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.207+0000 7fc870f36740 1 -- start start 2024-09-21T03:56:32.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.208+0000 7fc870f36740 1 Processor -- start 2024-09-21T03:56:32.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.208+0000 7fc870f36740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d712d01b0 0x558d71720320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:32.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.208+0000 7fc870f36740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d712d8390 0x558d71720860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:32.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.208+0000 7fc870f36740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d712f9070 0x558d7172b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.208+0000 7fc870f36740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc8641abf70 con 0x558d712f9070 2024-09-21T03:56:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.208+0000 7fc870f36740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc8641ad3e0 con 0x558d712d8390 2024-09-21T03:56:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.208+0000 7fc870f36740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc8641ac640 con 0x558d712d01b0 2024-09-21T03:56:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.208+0000 7fc870f36740 10 client.0 _ll_register_callbacks cb 0x7fc84c009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:56:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.208+0000 7fc85bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d712d8390 0x558d71720860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.208+0000 7fc85bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d712d8390 0x558d71720860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.46:48536/0 (socket says 172.21.15.46:48536) 2024-09-21T03:56:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.208+0000 7fc85bfff640 1 -- 172.21.15.46:0/2240025268 learned_addr learned my addr 172.21.15.46:0/2240025268 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:56:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.208+0000 7fc868f5f640 1 --2- 172.21.15.46:0/2240025268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d712f9070 0x558d7172b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.208+0000 7fc868f5f640 1 --2- 172.21.15.46:0/2240025268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d712d01b0 0x558d71720320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.209+0000 7fc868f5f640 1 -- 172.21.15.46:0/2240025268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d712d01b0 msgr2=0x558d71720320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.209+0000 7fc868f5f640 1 --2- 172.21.15.46:0/2240025268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d712d01b0 0x558d71720320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.209+0000 7fc868f5f640 1 -- 172.21.15.46:0/2240025268 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d712d8390 msgr2=0x558d71720860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:56:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.209+0000 7fc868f5f640 1 --2- 172.21.15.46:0/2240025268 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d712d8390 0x558d71720860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.209+0000 7fc868f5f640 1 -- 172.21.15.46:0/2240025268 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d71721080 con 0x558d712f9070 2024-09-21T03:56:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.209+0000 7fc85bfff640 1 --2- 172.21.15.46:0/2240025268 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d712d8390 0x558d71720860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:56:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.209+0000 7fc868f5f640 1 --2- 172.21.15.46:0/2240025268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d712f9070 0x558d7172b3a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fc85c031ea0 tx=0x7fc85c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0f285d4a09dfe9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.209+0000 7fc8437fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:56:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.209+0000 7fc8437fe640 1 -- 172.21.15.46:0/2240025268 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85c003a30 con 0x558d712f9070 2024-09-21T03:56:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.209+0000 7fc8437fe640 1 -- 172.21.15.46:0/2240025268 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fc85c04a040 con 0x558d712f9070 2024-09-21T03:56:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.209+0000 7fc870f36740 1 -- 172.21.15.46:0/2240025268 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558d716ab910 con 0x558d712f9070 2024-09-21T03:56:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.209+0000 7fc8437fe640 1 -- 172.21.15.46:0/2240025268 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc85c06b030 con 0x558d712f9070 2024-09-21T03:56:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.209+0000 7fc870f36740 10 client.15729 fetch_fsmap learned FSMap version 20 2024-09-21T03:56:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.209+0000 7fc870f36740 1 -- 172.21.15.46:0/2240025268 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x558d7172c8a0 con 0x558d712f9070 2024-09-21T03:56:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.210+0000 7fc8437fe640 1 -- 172.21.15.46:0/2240025268 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x558d716ab910 con 0x558d712f9070 2024-09-21T03:56:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.210+0000 7fc8437fe640 1 -- 172.21.15.46:0/2240025268 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc85c050070 con 0x558d712f9070 2024-09-21T03:56:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.210+0000 7fc870f36740 10 client.15729 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:56:32.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.210+0000 7fc870f36740 10 client.15729 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:56:32.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.210+0000 7fc870f36740 20 client.15729 populate_metadata read hostname 'smithi046' 2024-09-21T03:56:32.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.210+0000 7fc870f36740 1 --2- 172.21.15.46:0/2240025268 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558d7128cda0 0x558d7172eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:32.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.210+0000 7fc870f36740 4 client.15729 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:56:32.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.210+0000 7fc870f36740 1 -- 172.21.15.46:0/2240025268 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558d71614850 con 0x558d7128cda0 2024-09-21T03:56:32.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.210+0000 7fc85bfff640 1 --2- 172.21.15.46:0/2240025268 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558d7128cda0 0x558d7172eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:32.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.210+0000 7fc8437fe640 10 client.15729 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:56:32.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.210+0000 7fc85bfff640 1 --2- 172.21.15.46:0/2240025268 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558d7128cda0 0x558d7172eef0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=935a4ce44d758a3e server_cookie=ca2a4eed16a1775e in_seq=0 out_seq=0 2024-09-21T03:56:32.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.211+0000 7fc8437fe640 1 -- 172.21.15.46:0/2240025268 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1422 (crc 0 0 0) 0x558d71614850 con 0x558d7128cda0 2024-09-21T03:56:32.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.211+0000 7fc8437fe640 10 client.15729 handle_command_reply: tid=0 2024-09-21T03:56:32.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.211+0000 7fc870f36740 1 client.15729 shutdown 2024-09-21T03:56:32.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.211+0000 7fc870f36740 1 -- 172.21.15.46:0/2240025268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d712f9070 msgr2=0x558d7172b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:32.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.211+0000 7fc870f36740 1 --2- 172.21.15.46:0/2240025268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d712f9070 0x558d7172b3a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fc85c031ea0 tx=0x7fc85c005fd0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.211+0000 7fc870f36740 1 -- 172.21.15.46:0/2240025268 shutdown_connections 2024-09-21T03:56:32.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.211+0000 7fc870f36740 1 --2- 172.21.15.46:0/2240025268 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558d7128cda0 0x558d7172eef0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.211+0000 7fc8437fe640 0 client.15729 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:56:32.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.211+0000 7fc870f36740 1 --2- 172.21.15.46:0/2240025268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558d712f9070 0x558d7172b3a0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.211+0000 7fc870f36740 1 --2- 172.21.15.46:0/2240025268 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558d712d8390 0x558d71720860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.211+0000 7fc870f36740 1 --2- 172.21.15.46:0/2240025268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d712d01b0 0x558d71720320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.211+0000 7fc870f36740 1 -- 172.21.15.46:0/2240025268 >> 172.21.15.46:0/2240025268 conn(0x558d712ed460 msgr2=0x558d716bb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:32.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.211+0000 7fc870f36740 1 -- 172.21.15.46:0/2240025268 shutdown_connections 2024-09-21T03:56:32.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.211+0000 7fc870f36740 1 -- 172.21.15.46:0/2240025268 wait complete. 2024-09-21T03:56:32.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.211+0000 7fc870f36740 20 client.15729 trim_cache size 0 max 16384 2024-09-21T03:56:32.218 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T03:56:32.219 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T03:56:32.219 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2024-09-21T03:56:32.219 INFO:teuthology.orchestra.run.smithi046.stdout: "a871f724-0198-493c-b03e-b2de78aba243": { 2024-09-21T03:56:32.219 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:56:32.219 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "a871f724-0198-493c-b03e-b2de78aba243", 2024-09-21T03:56:32.219 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2024-09-21T03:56:32.219 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:56:32.219 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:56:32.219 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_stats": { 2024-09-21T03:56:32.219 INFO:teuthology.orchestra.run.smithi046.stdout: "a871f724-0198-493c-b03e-b2de78aba243": { 2024-09-21T03:56:32.219 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:56:30.082991+0000", 2024-09-21T03:56:32.219 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:56:32.220 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:56:32.220 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:56:32.220 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:56:32.220 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:56:32.220 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:56:32.220 INFO:teuthology.orchestra.run.smithi046.stdout: "d49f33a7-3d5a-421b-94ba-8b19a4120db1": { 2024-09-21T03:56:32.220 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:50.480786+0000", 2024-09-21T03:56:32.220 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:56:32.220 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:56:32.220 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:56:32.221 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:56:32.221 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:56:32.221 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:56:32.221 INFO:teuthology.orchestra.run.smithi046.stdout: "3bbf7097-70d7-4743-bbce-41465502b35b": { 2024-09-21T03:56:32.221 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:10.661441+0000", 2024-09-21T03:56:32.221 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:56:32.221 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:56:32.221 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:56:32.221 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:56:32.221 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:56:32.221 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:56:32.221 INFO:teuthology.orchestra.run.smithi046.stdout: "08f0c962-df1a-4129-a1a2-b916240d9803": { 2024-09-21T03:56:32.221 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:02.937596+0000", 2024-09-21T03:56:32.222 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:56:32.222 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:56:32.222 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:56:32.222 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:56:32.222 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:56:32.222 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:56:32.222 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:56:32.222 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T03:56:32.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.212+0000 7fc86a9c2640 1 -- 172.21.15.46:0/3239877014 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc8500b6680 msgr2=0x7fc8500b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:32.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.212+0000 7fc86a9c2640 1 --2- 172.21.15.46:0/3239877014 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc8500b6680 0x7fc8500b8b90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x558d7169eef0 tx=0x7fc85401f000 comp rx=0 tx=0).stop 2024-09-21T03:56:32.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.212+0000 7fc86a9c2640 1 -- 172.21.15.46:0/3239877014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc864102ad0 msgr2=0x7fc86419a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:32.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.212+0000 7fc86a9c2640 1 --2- 172.21.15.46:0/3239877014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc864102ad0 0x7fc86419a490 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc85400e9f0 tx=0x7fc85400eeb0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.212+0000 7fc86a9c2640 1 -- 172.21.15.46:0/3239877014 shutdown_connections 2024-09-21T03:56:32.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.212+0000 7fc86a9c2640 1 --2- 172.21.15.46:0/3239877014 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc8500b6680 0x7fc8500b8b90 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.212+0000 7fc86a9c2640 1 --2- 172.21.15.46:0/3239877014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc864108d10 0x7fc86419fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.212+0000 7fc86a9c2640 1 --2- 172.21.15.46:0/3239877014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8641083c0 0x7fc86419aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.212+0000 7fc86a9c2640 1 --2- 172.21.15.46:0/3239877014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc864102ad0 0x7fc86419a490 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.212+0000 7fc86a9c2640 1 -- 172.21.15.46:0/3239877014 >> 172.21.15.46:0/3239877014 conn(0x7fc8640796d0 msgr2=0x7fc8641019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:32.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.212+0000 7fc86a9c2640 1 -- 172.21.15.46:0/3239877014 shutdown_connections 2024-09-21T03:56:32.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:56:32.212+0000 7fc86a9c2640 1 -- 172.21.15.46:0/3239877014 wait complete. 2024-09-21T03:56:32.499 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4197376 len 1024 2024-09-21T03:56:32.499 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4197376 len 2048 2024-09-21T03:56:32.500 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4197376 len 2048 2024-09-21T03:56:32.500 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4197376 len 2048 2024-09-21T03:56:32.500 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4197376 len 2048 2024-09-21T03:56:32.500 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4197376 len 4096 2024-09-21T03:56:32.500 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4197376 len 4096 2024-09-21T03:56:32.500 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4197376 len 4096 2024-09-21T03:56:32.500 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4197376 len 4096 2024-09-21T03:56:32.500 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4197376 len 8192 2024-09-21T03:56:32.500 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4197376 len 8192 2024-09-21T03:56:32.500 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4197376 len 8192 2024-09-21T03:56:32.500 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4197376 len 8192 2024-09-21T03:56:32.500 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4197376 len 16384 2024-09-21T03:56:32.500 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4197376 len 16384 2024-09-21T03:56:32.500 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4197376 len 16384 2024-09-21T03:56:32.501 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4197376 len 16384 2024-09-21T03:56:32.501 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4197888 len 1024 2024-09-21T03:56:32.501 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4197888 len 1024 2024-09-21T03:56:32.501 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4197888 len 1024 2024-09-21T03:56:32.501 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4197888 len 1024 2024-09-21T03:56:32.501 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4197888 len 2048 2024-09-21T03:56:32.501 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4197888 len 2048 2024-09-21T03:56:32.501 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4197888 len 2048 2024-09-21T03:56:32.501 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4197888 len 2048 2024-09-21T03:56:32.501 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4197888 len 4096 2024-09-21T03:56:32.501 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4197888 len 4096 2024-09-21T03:56:32.501 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4197888 len 4096 2024-09-21T03:56:32.501 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4197888 len 4096 2024-09-21T03:56:32.501 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4197888 len 8192 2024-09-21T03:56:32.502 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4197888 len 8192 2024-09-21T03:56:32.502 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4197888 len 8192 2024-09-21T03:56:32.502 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4197888 len 8192 2024-09-21T03:56:32.502 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3072 offset 4197888 len 16384 2024-09-21T03:56:32.502 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4197888 len 16384 2024-09-21T03:56:32.502 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3072 offset 4197888 len 16384 2024-09-21T03:56:32.502 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3072 offset 4197888 len 16384 2024-09-21T03:56:32.502 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4190720 len 1024 2024-09-21T03:56:32.503 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4190720 len 1024 2024-09-21T03:56:32.503 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4190720 len 1024 2024-09-21T03:56:32.503 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4190720 len 1024 2024-09-21T03:56:32.503 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4190720 len 2048 2024-09-21T03:56:32.503 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4190720 len 2048 2024-09-21T03:56:32.503 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4190720 len 2048 2024-09-21T03:56:32.503 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4190720 len 2048 2024-09-21T03:56:32.503 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4190720 len 4096 2024-09-21T03:56:32.503 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4190720 len 4096 2024-09-21T03:56:32.503 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4190720 len 4096 2024-09-21T03:56:32.503 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4190720 len 4096 2024-09-21T03:56:32.503 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4190720 len 8192 2024-09-21T03:56:32.503 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4190720 len 8192 2024-09-21T03:56:32.503 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4190720 len 8192 2024-09-21T03:56:32.504 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4190720 len 8192 2024-09-21T03:56:32.504 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4190720 len 16384 2024-09-21T03:56:32.504 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4190720 len 16384 2024-09-21T03:56:32.504 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4190720 len 16384 2024-09-21T03:56:32.504 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4190720 len 16384 2024-09-21T03:56:32.504 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4191232 len 1024 2024-09-21T03:56:32.504 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4191232 len 1024 2024-09-21T03:56:32.504 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4191232 len 1024 2024-09-21T03:56:32.504 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4191232 len 1024 2024-09-21T03:56:32.504 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4191232 len 2048 2024-09-21T03:56:32.504 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4191232 len 2048 2024-09-21T03:56:32.504 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4191232 len 2048 2024-09-21T03:56:32.504 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4191232 len 2048 2024-09-21T03:56:32.504 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4191232 len 4096 2024-09-21T03:56:32.505 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4191232 len 4096 2024-09-21T03:56:32.505 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4191232 len 4096 2024-09-21T03:56:32.505 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4191232 len 4096 2024-09-21T03:56:32.505 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4191232 len 8192 2024-09-21T03:56:32.505 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4191232 len 8192 2024-09-21T03:56:32.505 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4191232 len 8192 2024-09-21T03:56:32.505 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4191232 len 8192 2024-09-21T03:56:32.505 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4191232 len 16384 2024-09-21T03:56:32.505 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4191232 len 16384 2024-09-21T03:56:32.505 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4191232 len 16384 2024-09-21T03:56:32.505 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4191232 len 16384 2024-09-21T03:56:32.505 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4191744 len 1024 2024-09-21T03:56:32.505 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4191744 len 1024 2024-09-21T03:56:32.505 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4191744 len 1024 2024-09-21T03:56:32.506 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4191744 len 1024 2024-09-21T03:56:33.026 INFO:tasks.cephfs.filesystem:scrub status for tag:a871f724-0198-493c-b03e-b2de78aba243 - {'path': '/', 'tag': 'a871f724-0198-493c-b03e-b2de78aba243', 'options': 'recursive,force'} 2024-09-21T03:56:33.080 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4191744 len 2048 2024-09-21T03:56:33.080 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4191744 len 2048 2024-09-21T03:56:33.080 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4191744 len 2048 2024-09-21T03:56:33.080 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4191744 len 2048 2024-09-21T03:56:33.081 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4191744 len 4096 2024-09-21T03:56:33.081 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4191744 len 4096 2024-09-21T03:56:33.081 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4191744 len 4096 2024-09-21T03:56:33.081 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4191744 len 4096 2024-09-21T03:56:33.081 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4191744 len 8192 2024-09-21T03:56:33.081 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4191744 len 8192 2024-09-21T03:56:33.081 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4191744 len 8192 2024-09-21T03:56:33.081 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4191744 len 8192 2024-09-21T03:56:33.081 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4191744 len 16384 2024-09-21T03:56:33.081 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4191744 len 16384 2024-09-21T03:56:33.081 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4191744 len 16384 2024-09-21T03:56:33.081 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4191744 len 16384 2024-09-21T03:56:33.081 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4192256 len 1024 2024-09-21T03:56:33.082 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4192256 len 1024 2024-09-21T03:56:33.082 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4192256 len 1024 2024-09-21T03:56:33.082 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4192256 len 1024 2024-09-21T03:56:33.082 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4192256 len 2048 2024-09-21T03:56:33.082 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4192256 len 2048 2024-09-21T03:56:33.082 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4192256 len 2048 2024-09-21T03:56:33.082 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4192256 len 2048 2024-09-21T03:56:33.082 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4192256 len 4096 2024-09-21T03:56:33.082 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4192256 len 4096 2024-09-21T03:56:33.082 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4192256 len 4096 2024-09-21T03:56:33.082 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4192256 len 4096 2024-09-21T03:56:33.082 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4192256 len 8192 2024-09-21T03:56:33.082 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4192256 len 8192 2024-09-21T03:56:33.083 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4192256 len 8192 2024-09-21T03:56:33.083 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4192256 len 8192 2024-09-21T03:56:33.083 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4192256 len 16384 2024-09-21T03:56:33.083 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4192256 len 16384 2024-09-21T03:56:33.083 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4192256 len 16384 2024-09-21T03:56:33.083 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4192256 len 16384 2024-09-21T03:56:33.083 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4192768 len 1024 2024-09-21T03:56:33.083 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4192768 len 1024 2024-09-21T03:56:33.083 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4192768 len 1024 2024-09-21T03:56:33.083 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4192768 len 1024 2024-09-21T03:56:33.083 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4192768 len 2048 2024-09-21T03:56:33.083 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4192768 len 2048 2024-09-21T03:56:33.083 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4192768 len 2048 2024-09-21T03:56:33.083 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4192768 len 2048 2024-09-21T03:56:33.084 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4192768 len 4096 2024-09-21T03:56:33.084 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4192768 len 4096 2024-09-21T03:56:33.084 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4192768 len 4096 2024-09-21T03:56:33.084 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4192768 len 4096 2024-09-21T03:56:33.084 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4192768 len 8192 2024-09-21T03:56:33.084 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4192768 len 8192 2024-09-21T03:56:33.084 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4192768 len 8192 2024-09-21T03:56:33.084 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4192768 len 8192 2024-09-21T03:56:33.084 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4192768 len 16384 2024-09-21T03:56:33.084 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4192768 len 16384 2024-09-21T03:56:33.084 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4192768 len 16384 2024-09-21T03:56:33.084 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4192768 len 16384 2024-09-21T03:56:33.084 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4193280 len 1024 2024-09-21T03:56:33.085 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4193280 len 1024 2024-09-21T03:56:33.085 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4193280 len 1024 2024-09-21T03:56:33.085 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4193280 len 1024 2024-09-21T03:56:33.085 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4193280 len 2048 2024-09-21T03:56:33.085 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4193280 len 2048 2024-09-21T03:56:33.085 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4193280 len 2048 2024-09-21T03:56:33.085 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4193280 len 2048 2024-09-21T03:56:33.085 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4193280 len 4096 2024-09-21T03:56:33.085 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4193280 len 4096 2024-09-21T03:56:33.085 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4193280 len 4096 2024-09-21T03:56:33.085 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4193280 len 4096 2024-09-21T03:56:33.085 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4193280 len 8192 2024-09-21T03:56:33.085 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4193280 len 8192 2024-09-21T03:56:33.085 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4193280 len 8192 2024-09-21T03:56:33.086 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4193280 len 8192 2024-09-21T03:56:33.086 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4193280 len 16384 2024-09-21T03:56:33.086 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4193280 len 16384 2024-09-21T03:56:33.086 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4193280 len 16384 2024-09-21T03:56:33.086 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4193280 len 16384 2024-09-21T03:56:33.086 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4193792 len 1024 2024-09-21T03:56:33.086 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4193792 len 1024 2024-09-21T03:56:33.086 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4193792 len 1024 2024-09-21T03:56:33.086 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4193792 len 1024 2024-09-21T03:56:33.453 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4193792 len 2048 2024-09-21T03:56:33.454 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4193792 len 2048 2024-09-21T03:56:33.454 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4193792 len 2048 2024-09-21T03:56:33.454 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4193792 len 2048 2024-09-21T03:56:33.454 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4193792 len 4096 2024-09-21T03:56:33.454 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4193792 len 4096 2024-09-21T03:56:33.454 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4193792 len 4096 2024-09-21T03:56:33.454 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4193792 len 4096 2024-09-21T03:56:33.454 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4193792 len 8192 2024-09-21T03:56:33.454 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4193792 len 8192 2024-09-21T03:56:33.454 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4193792 len 8192 2024-09-21T03:56:33.454 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4193792 len 8192 2024-09-21T03:56:33.455 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4193792 len 16384 2024-09-21T03:56:33.455 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4193792 len 16384 2024-09-21T03:56:33.455 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4193792 len 16384 2024-09-21T03:56:33.455 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4193792 len 16384 2024-09-21T03:56:33.455 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4194304 len 1024 2024-09-21T03:56:33.455 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4194304 len 1024 2024-09-21T03:56:33.455 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4194304 len 1024 2024-09-21T03:56:33.455 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4194304 len 1024 2024-09-21T03:56:33.455 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4194304 len 2048 2024-09-21T03:56:33.455 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4194304 len 2048 2024-09-21T03:56:33.455 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4194304 len 2048 2024-09-21T03:56:33.455 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4194304 len 2048 2024-09-21T03:56:33.455 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4194304 len 4096 2024-09-21T03:56:33.455 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4194304 len 4096 2024-09-21T03:56:33.456 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4194304 len 4096 2024-09-21T03:56:33.456 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4194304 len 4096 2024-09-21T03:56:33.456 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4194304 len 8192 2024-09-21T03:56:33.456 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4194304 len 8192 2024-09-21T03:56:33.456 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4194304 len 8192 2024-09-21T03:56:33.456 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4194304 len 8192 2024-09-21T03:56:33.456 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4194304 len 16384 2024-09-21T03:56:33.456 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4194304 len 16384 2024-09-21T03:56:33.456 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4194304 len 16384 2024-09-21T03:56:33.456 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4194304 len 16384 2024-09-21T03:56:33.456 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4194816 len 1024 2024-09-21T03:56:33.456 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4194816 len 1024 2024-09-21T03:56:33.456 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4194816 len 1024 2024-09-21T03:56:33.456 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4194816 len 1024 2024-09-21T03:56:33.457 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4194816 len 2048 2024-09-21T03:56:33.457 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4194816 len 2048 2024-09-21T03:56:33.457 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4194816 len 2048 2024-09-21T03:56:33.457 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4194816 len 2048 2024-09-21T03:56:33.457 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4194816 len 4096 2024-09-21T03:56:33.457 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4194816 len 4096 2024-09-21T03:56:33.457 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4194816 len 4096 2024-09-21T03:56:33.457 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4194816 len 4096 2024-09-21T03:56:33.457 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4194816 len 8192 2024-09-21T03:56:33.457 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4194816 len 8192 2024-09-21T03:56:33.457 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4194816 len 8192 2024-09-21T03:56:33.457 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4194816 len 8192 2024-09-21T03:56:33.457 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4194816 len 16384 2024-09-21T03:56:33.457 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4194816 len 16384 2024-09-21T03:56:33.458 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4194816 len 16384 2024-09-21T03:56:33.458 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4194816 len 16384 2024-09-21T03:56:33.458 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4195328 len 1024 2024-09-21T03:56:33.458 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4195328 len 1024 2024-09-21T03:56:33.458 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4195328 len 1024 2024-09-21T03:56:33.458 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4195328 len 1024 2024-09-21T03:56:33.458 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4195328 len 2048 2024-09-21T03:56:33.458 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4195328 len 2048 2024-09-21T03:56:33.458 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4195328 len 2048 2024-09-21T03:56:33.458 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4195328 len 2048 2024-09-21T03:56:33.458 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4195328 len 4096 2024-09-21T03:56:33.458 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4195328 len 4096 2024-09-21T03:56:33.458 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4195328 len 4096 2024-09-21T03:56:33.458 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4195328 len 4096 2024-09-21T03:56:33.459 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4195328 len 8192 2024-09-21T03:56:33.459 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4195328 len 8192 2024-09-21T03:56:33.459 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4195328 len 8192 2024-09-21T03:56:33.459 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4195328 len 8192 2024-09-21T03:56:33.459 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4195328 len 16384 2024-09-21T03:56:33.459 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4195328 len 16384 2024-09-21T03:56:33.459 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4195328 len 16384 2024-09-21T03:56:33.459 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4195328 len 16384 2024-09-21T03:56:33.459 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4195840 len 1024 2024-09-21T03:56:33.459 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4195840 len 1024 2024-09-21T03:56:33.459 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4195840 len 1024 2024-09-21T03:56:33.459 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4195840 len 1024 2024-09-21T03:56:33.459 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4195840 len 2048 2024-09-21T03:56:33.774 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4195840 len 2048 2024-09-21T03:56:33.774 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4195840 len 2048 2024-09-21T03:56:33.774 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4195840 len 2048 2024-09-21T03:56:33.774 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4195840 len 4096 2024-09-21T03:56:33.774 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4195840 len 4096 2024-09-21T03:56:33.774 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4195840 len 4096 2024-09-21T03:56:33.774 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4195840 len 4096 2024-09-21T03:56:33.774 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4195840 len 8192 2024-09-21T03:56:33.774 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4195840 len 8192 2024-09-21T03:56:33.774 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4195840 len 8192 2024-09-21T03:56:33.775 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4195840 len 8192 2024-09-21T03:56:33.775 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4195840 len 16384 2024-09-21T03:56:33.775 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4195840 len 16384 2024-09-21T03:56:33.775 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4195840 len 16384 2024-09-21T03:56:33.775 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4195840 len 16384 2024-09-21T03:56:33.775 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4196352 len 1024 2024-09-21T03:56:33.775 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4196352 len 1024 2024-09-21T03:56:33.775 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4196352 len 1024 2024-09-21T03:56:33.775 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4196352 len 1024 2024-09-21T03:56:33.775 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4196352 len 2048 2024-09-21T03:56:33.775 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4196352 len 2048 2024-09-21T03:56:33.775 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4196352 len 2048 2024-09-21T03:56:33.775 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4196352 len 2048 2024-09-21T03:56:33.775 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4196352 len 4096 2024-09-21T03:56:33.776 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4196352 len 4096 2024-09-21T03:56:33.776 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4196352 len 4096 2024-09-21T03:56:33.776 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4196352 len 4096 2024-09-21T03:56:33.776 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4196352 len 8192 2024-09-21T03:56:33.776 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4196352 len 8192 2024-09-21T03:56:33.776 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4196352 len 8192 2024-09-21T03:56:33.776 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4196352 len 8192 2024-09-21T03:56:33.776 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4196352 len 16384 2024-09-21T03:56:33.776 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4196352 len 16384 2024-09-21T03:56:33.776 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4196352 len 16384 2024-09-21T03:56:33.776 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4196352 len 16384 2024-09-21T03:56:33.776 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4196864 len 1024 2024-09-21T03:56:33.776 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4196864 len 1024 2024-09-21T03:56:33.777 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4196864 len 1024 2024-09-21T03:56:33.777 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4196864 len 1024 2024-09-21T03:56:33.777 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4196864 len 2048 2024-09-21T03:56:33.777 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4196864 len 2048 2024-09-21T03:56:33.777 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4196864 len 2048 2024-09-21T03:56:33.777 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4196864 len 2048 2024-09-21T03:56:33.777 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4196864 len 4096 2024-09-21T03:56:33.777 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4196864 len 4096 2024-09-21T03:56:33.777 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4196864 len 4096 2024-09-21T03:56:33.777 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4196864 len 4096 2024-09-21T03:56:33.777 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4196864 len 8192 2024-09-21T03:56:33.777 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4196864 len 8192 2024-09-21T03:56:33.777 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4196864 len 8192 2024-09-21T03:56:33.778 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4196864 len 8192 2024-09-21T03:56:33.778 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4196864 len 16384 2024-09-21T03:56:33.778 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4196864 len 16384 2024-09-21T03:56:33.778 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4196864 len 16384 2024-09-21T03:56:33.778 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4196864 len 16384 2024-09-21T03:56:33.778 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4197376 len 1024 2024-09-21T03:56:33.778 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4197376 len 1024 2024-09-21T03:56:33.778 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4197376 len 1024 2024-09-21T03:56:33.778 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4197376 len 1024 2024-09-21T03:56:33.778 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4197376 len 2048 2024-09-21T03:56:33.778 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4197376 len 2048 2024-09-21T03:56:33.778 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4197376 len 2048 2024-09-21T03:56:33.778 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4197376 len 2048 2024-09-21T03:56:33.779 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4197376 len 4096 2024-09-21T03:56:33.779 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4197376 len 4096 2024-09-21T03:56:33.779 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4197376 len 4096 2024-09-21T03:56:33.779 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4197376 len 4096 2024-09-21T03:56:33.779 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4197376 len 8192 2024-09-21T03:56:33.779 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4197376 len 8192 2024-09-21T03:56:33.779 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4197376 len 8192 2024-09-21T03:56:33.779 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4197376 len 8192 2024-09-21T03:56:33.779 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4197376 len 16384 2024-09-21T03:56:33.779 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4197376 len 16384 2024-09-21T03:56:33.779 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4197376 len 16384 2024-09-21T03:56:33.779 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4197376 len 16384 2024-09-21T03:56:33.779 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4197888 len 1024 2024-09-21T03:56:33.779 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4197888 len 1024 2024-09-21T03:56:33.780 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4197888 len 1024 2024-09-21T03:56:33.780 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4197888 len 1024 2024-09-21T03:56:33.780 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4197888 len 2048 2024-09-21T03:56:33.780 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4197888 len 2048 2024-09-21T03:56:33.828 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4197888 len 2048 2024-09-21T03:56:33.828 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4197888 len 2048 2024-09-21T03:56:33.828 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4197888 len 4096 2024-09-21T03:56:33.828 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4197888 len 4096 2024-09-21T03:56:33.828 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4197888 len 4096 2024-09-21T03:56:33.828 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4197888 len 4096 2024-09-21T03:56:33.828 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4197888 len 8192 2024-09-21T03:56:33.829 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4197888 len 8192 2024-09-21T03:56:33.829 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4197888 len 8192 2024-09-21T03:56:33.829 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4197888 len 8192 2024-09-21T03:56:33.829 INFO:tasks.workunit.client.0.smithi046.stdout:write_direct buf_align 3584 offset 4197888 len 16384 2024-09-21T03:56:33.829 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4197888 len 16384 2024-09-21T03:56:33.829 INFO:tasks.workunit.client.0.smithi046.stdout:write_sync buf_align 3584 offset 4197888 len 16384 2024-09-21T03:56:33.829 INFO:tasks.workunit.client.0.smithi046.stdout:write_file buf_align 3584 offset 4197888 len 16384 2024-09-21T03:56:33.829 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T03:56:33.829 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T03:56:33.860 INFO:tasks.workunit:Stopping ['direct_io'] on client.0... 2024-09-21T03:56:33.861 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-21T03:56:34.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:33 smithi046 ceph-mon[30954]: pgmap v365: 97 pgs: 97 active+clean; 291 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 146 MiB/s rd, 2.0 MiB/s wr, 687 op/s 2024-09-21T03:56:34.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:33 smithi046 ceph-mon[30954]: scrub summary: idle 2024-09-21T03:56:34.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:33 smithi105 ceph-mon[34773]: pgmap v365: 97 pgs: 97 active+clean; 291 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 146 MiB/s rd, 2.0 MiB/s wr, 687 op/s 2024-09-21T03:56:34.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:33 smithi105 ceph-mon[34773]: scrub summary: idle 2024-09-21T03:56:34.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:33 smithi162 ceph-mon[35071]: pgmap v365: 97 pgs: 97 active+clean; 291 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 146 MiB/s rd, 2.0 MiB/s wr, 687 op/s 2024-09-21T03:56:34.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:33 smithi162 ceph-mon[35071]: scrub summary: idle 2024-09-21T03:56:34.173 DEBUG:teuthology.parallel:result is None 2024-09-21T03:56:34.173 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T03:56:34.204 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T03:56:34.205 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-21T03:56:34.214 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi046.front.sepia.ceph.com 2024-09-21T03:56:34.254 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-21T03:56:34.263 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-21T03:56:34.263 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T03:56:34.263 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi046.front.sepia.ceph.com 2024-09-21T03:56:34.263 DEBUG:teuthology.orchestra.run.smithi046:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-21T03:56:34.321 DEBUG:teuthology.orchestra.run.smithi046:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-21T03:56:36.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:35 smithi046 ceph-mon[30954]: pgmap v366: 97 pgs: 97 active+clean; 356 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 151 MiB/s rd, 1.8 MiB/s wr, 646 op/s 2024-09-21T03:56:36.067 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:35 smithi105 ceph-mon[34773]: pgmap v366: 97 pgs: 97 active+clean; 356 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 151 MiB/s rd, 1.8 MiB/s wr, 646 op/s 2024-09-21T03:56:36.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:35 smithi162 ceph-mon[35071]: pgmap v366: 97 pgs: 97 active+clean; 356 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 151 MiB/s rd, 1.8 MiB/s wr, 646 op/s 2024-09-21T03:56:38.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:37 smithi046 ceph-mon[30954]: pgmap v367: 97 pgs: 97 active+clean; 212 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 157 MiB/s rd, 1.3 MiB/s wr, 484 op/s 2024-09-21T03:56:38.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:37 smithi105 ceph-mon[34773]: pgmap v367: 97 pgs: 97 active+clean; 212 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 157 MiB/s rd, 1.3 MiB/s wr, 484 op/s 2024-09-21T03:56:38.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:37 smithi162 ceph-mon[35071]: pgmap v367: 97 pgs: 97 active+clean; 212 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 157 MiB/s rd, 1.3 MiB/s wr, 484 op/s 2024-09-21T03:56:40.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:39 smithi046 ceph-mon[30954]: pgmap v368: 97 pgs: 97 active+clean; 78 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 136 MiB/s rd, 1.5 MiB/s wr, 493 op/s 2024-09-21T03:56:40.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:39 smithi105 ceph-mon[34773]: pgmap v368: 97 pgs: 97 active+clean; 78 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 136 MiB/s rd, 1.5 MiB/s wr, 493 op/s 2024-09-21T03:56:40.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:39 smithi162 ceph-mon[35071]: pgmap v368: 97 pgs: 97 active+clean; 78 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 136 MiB/s rd, 1.5 MiB/s wr, 493 op/s 2024-09-21T03:56:42.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:41 smithi046 ceph-mon[30954]: pgmap v369: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 106 MiB/s rd, 982 KiB/s wr, 358 op/s 2024-09-21T03:56:42.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:41 smithi105 ceph-mon[34773]: pgmap v369: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 106 MiB/s rd, 982 KiB/s wr, 358 op/s 2024-09-21T03:56:42.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:41 smithi162 ceph-mon[35071]: pgmap v369: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 106 MiB/s rd, 982 KiB/s wr, 358 op/s 2024-09-21T03:56:44.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:43 smithi046 ceph-mon[30954]: pgmap v370: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 91 MiB/s rd, 944 KiB/s wr, 329 op/s 2024-09-21T03:56:44.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:43 smithi105 ceph-mon[34773]: pgmap v370: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 91 MiB/s rd, 944 KiB/s wr, 329 op/s 2024-09-21T03:56:44.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:43 smithi162 ceph-mon[35071]: pgmap v370: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 91 MiB/s rd, 944 KiB/s wr, 329 op/s 2024-09-21T03:56:46.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:45 smithi046 ceph-mon[30954]: pgmap v371: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 44 MiB/s rd, 559 KiB/s wr, 193 op/s 2024-09-21T03:56:46.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:45 smithi105 ceph-mon[34773]: pgmap v371: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 44 MiB/s rd, 559 KiB/s wr, 193 op/s 2024-09-21T03:56:46.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:45 smithi162 ceph-mon[35071]: pgmap v371: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 44 MiB/s rd, 559 KiB/s wr, 193 op/s 2024-09-21T03:56:48.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:47 smithi046 ceph-mon[30954]: pgmap v372: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 386 KiB/s wr, 132 op/s 2024-09-21T03:56:48.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:47 smithi105 ceph-mon[34773]: pgmap v372: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 386 KiB/s wr, 132 op/s 2024-09-21T03:56:48.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:47 smithi162 ceph-mon[35071]: pgmap v372: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 386 KiB/s wr, 132 op/s 2024-09-21T03:56:50.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:49 smithi046 ceph-mon[30954]: pgmap v373: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 315 KiB/s wr, 86 op/s 2024-09-21T03:56:50.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:49 smithi105 ceph-mon[34773]: pgmap v373: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 315 KiB/s wr, 86 op/s 2024-09-21T03:56:50.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:49 smithi162 ceph-mon[35071]: pgmap v373: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 315 KiB/s wr, 86 op/s 2024-09-21T03:56:52.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:51 smithi046 ceph-mon[30954]: pgmap v374: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-09-21T03:56:52.067 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:51 smithi105 ceph-mon[34773]: pgmap v374: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-09-21T03:56:52.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:51 smithi162 ceph-mon[35071]: pgmap v374: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-09-21T03:56:54.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:53 smithi046 ceph-mon[30954]: pgmap v375: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 4 op/s 2024-09-21T03:56:54.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:53 smithi105 ceph-mon[34773]: pgmap v375: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 4 op/s 2024-09-21T03:56:54.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:53 smithi162 ceph-mon[35071]: pgmap v375: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 4 op/s 2024-09-21T03:56:56.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:55 smithi105 ceph-mon[34773]: pgmap v376: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 853 B/s wr, 2 op/s 2024-09-21T03:56:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:55 smithi162 ceph-mon[35071]: pgmap v376: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 853 B/s wr, 2 op/s 2024-09-21T03:56:56.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:55 smithi046 ceph-mon[30954]: pgmap v376: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 853 B/s wr, 2 op/s 2024-09-21T03:56:58.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:57 smithi105 ceph-mon[34773]: pgmap v377: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T03:56:58.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:57 smithi162 ceph-mon[35071]: pgmap v377: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T03:56:58.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:57 smithi046 ceph-mon[30954]: pgmap v377: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-21T03:57:00.067 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:56:59 smithi105 ceph-mon[34773]: pgmap v378: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-21T03:57:00.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:56:59 smithi162 ceph-mon[35071]: pgmap v378: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-21T03:57:00.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:56:59 smithi046 ceph-mon[30954]: pgmap v378: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-21T03:57:02.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:01 smithi105 ceph-mon[34773]: pgmap v379: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:57:02.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:01 smithi162 ceph-mon[35071]: pgmap v379: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:57:02.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:01 smithi046 ceph-mon[30954]: pgmap v379: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:57:03.027 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:57:03.301 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:57:04.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.987+0000 7fb6ad4bd640 1 -- 172.21.15.46:0/3420223236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6a8101fe0 msgr2=0x7fb6a81023f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:04.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.987+0000 7fb6ad4bd640 1 --2- 172.21.15.46:0/3420223236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6a8101fe0 0x7fb6a81023f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb698009900 tx=0x7fb69802a410 comp rx=0 tx=0).stop 2024-09-21T03:57:04.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.987+0000 7fb6ad4bd640 1 -- 172.21.15.46:0/3420223236 shutdown_connections 2024-09-21T03:57:04.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.987+0000 7fb6ad4bd640 1 --2- 172.21.15.46:0/3420223236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6a8109e10 0x7fb6a8110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:04.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.987+0000 7fb6ad4bd640 1 --2- 172.21.15.46:0/3420223236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6a81094c0 0x7fb6a81098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:04.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.987+0000 7fb6ad4bd640 1 --2- 172.21.15.46:0/3420223236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6a8101fe0 0x7fb6a81023f0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:04.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.987+0000 7fb6ad4bd640 1 -- 172.21.15.46:0/3420223236 >> 172.21.15.46:0/3420223236 conn(0x7fb6a8077bc0 msgr2=0x7fb6a8078000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:04.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.987+0000 7fb6ad4bd640 1 -- 172.21.15.46:0/3420223236 shutdown_connections 2024-09-21T03:57:04.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.987+0000 7fb6ad4bd640 1 -- 172.21.15.46:0/3420223236 wait complete. 2024-09-21T03:57:04.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.987+0000 7fb6ad4bd640 1 Processor -- start 2024-09-21T03:57:04.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.988+0000 7fb6ad4bd640 1 -- start start 2024-09-21T03:57:04.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.988+0000 7fb6ad4bd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6a8101fe0 0x7fb6a819a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:04.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.988+0000 7fb6ad4bd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6a81094c0 0x7fb6a819aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:04.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.988+0000 7fb6ad4bd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6a8109e10 0x7fb6a819fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:04.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.988+0000 7fb6ad4bd640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a8113a80 con 0x7fb6a81094c0 2024-09-21T03:57:04.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.988+0000 7fb6ad4bd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a8113900 con 0x7fb6a8109e10 2024-09-21T03:57:04.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.988+0000 7fb6ad4bd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a8113c00 con 0x7fb6a8101fe0 2024-09-21T03:57:04.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.988+0000 7fb6a67fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6a81094c0 0x7fb6a819aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:04.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.988+0000 7fb6a67fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6a81094c0 0x7fb6a819aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51762/0 (socket says 172.21.15.46:51762) 2024-09-21T03:57:04.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.988+0000 7fb6a67fc640 1 -- 172.21.15.46:0/369102171 learned_addr learned my addr 172.21.15.46:0/369102171 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:04.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.988+0000 7fb6a6ffd640 1 --2- 172.21.15.46:0/369102171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6a8101fe0 0x7fb6a819a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:04.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.988+0000 7fb6a77fe640 1 --2- 172.21.15.46:0/369102171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6a8109e10 0x7fb6a819fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:04.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.988+0000 7fb6a67fc640 1 -- 172.21.15.46:0/369102171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6a8101fe0 msgr2=0x7fb6a819a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:04.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.988+0000 7fb6a67fc640 1 --2- 172.21.15.46:0/369102171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6a8101fe0 0x7fb6a819a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:04.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.988+0000 7fb6a67fc640 1 -- 172.21.15.46:0/369102171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6a8109e10 msgr2=0x7fb6a819fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:04.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.988+0000 7fb6a67fc640 1 --2- 172.21.15.46:0/369102171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6a8109e10 0x7fb6a819fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:04.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.988+0000 7fb6a67fc640 1 -- 172.21.15.46:0/369102171 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6a81a0340 con 0x7fb6a81094c0 2024-09-21T03:57:04.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.989+0000 7fb6a67fc640 1 --2- 172.21.15.46:0/369102171 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6a81094c0 0x7fb6a819aa30 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb69c00c970 tx=0x7fb69c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:04.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.989+0000 7fb68ffff640 1 -- 172.21.15.46:0/369102171 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb69c007c70 con 0x7fb6a81094c0 2024-09-21T03:57:04.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.989+0000 7fb68ffff640 1 -- 172.21.15.46:0/369102171 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb69c007e10 con 0x7fb6a81094c0 2024-09-21T03:57:04.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.989+0000 7fb68ffff640 1 -- 172.21.15.46:0/369102171 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb69c0187b0 con 0x7fb6a81094c0 2024-09-21T03:57:04.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.989+0000 7fb6ad4bd640 1 -- 172.21.15.46:0/369102171 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6a81a0630 con 0x7fb6a81094c0 2024-09-21T03:57:04.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.989+0000 7fb6ad4bd640 1 -- 172.21.15.46:0/369102171 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6a81a6e50 con 0x7fb6a81094c0 2024-09-21T03:57:04.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.992+0000 7fb6b3a31740 1 Processor -- start 2024-09-21T03:57:04.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.992+0000 7fb6b3a31740 1 -- start start 2024-09-21T03:57:04.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.992+0000 7fb68ffff640 1 -- 172.21.15.46:0/369102171 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7fb69c00fab0 con 0x7fb6a81094c0 2024-09-21T03:57:04.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.992+0000 7fb6b3a31740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559d61170070 0x559d61517270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:04.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.992+0000 7fb6b3a31740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d611471b0 0x559d615177b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:04.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.992+0000 7fb6b3a31740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d6114f390 0x559d61517cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:04.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.992+0000 7fb6b3a31740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x559d6148de50 con 0x559d61170070 2024-09-21T03:57:04.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.992+0000 7fb6b3a31740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x559d6147d280 con 0x559d611471b0 2024-09-21T03:57:04.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.992+0000 7fb6b3a31740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559d61481090 con 0x559d6114f390 2024-09-21T03:57:04.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.992+0000 7fb6a77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559d61170070 0x559d61517270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:04.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.992+0000 7fb6a77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559d61170070 0x559d61517270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51766/0 (socket says 172.21.15.46:51766) 2024-09-21T03:57:04.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.992+0000 7fb6a77fe640 1 -- 172.21.15.46:0/107850301 learned_addr learned my addr 172.21.15.46:0/107850301 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:04.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.992+0000 7fb6a6ffd640 1 --2- 172.21.15.46:0/107850301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d611471b0 0x559d615177b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:04.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.992+0000 7fb6a67fc640 1 --2- 172.21.15.46:0/107850301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d6114f390 0x559d61517cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:04.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.992+0000 7fb6a77fe640 1 -- 172.21.15.46:0/107850301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d6114f390 msgr2=0x559d61517cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:04.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.992+0000 7fb6a77fe640 1 --2- 172.21.15.46:0/107850301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d6114f390 0x559d61517cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:04.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.992+0000 7fb6a77fe640 1 -- 172.21.15.46:0/107850301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d611471b0 msgr2=0x559d615177b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:04.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.992+0000 7fb6a77fe640 1 --2- 172.21.15.46:0/107850301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d611471b0 0x559d615177b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:04.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.993+0000 7fb6a77fe640 1 -- 172.21.15.46:0/107850301 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d611db650 con 0x559d61170070 2024-09-21T03:57:04.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.993+0000 7fb6a6ffd640 1 --2- 172.21.15.46:0/107850301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d611471b0 0x559d615177b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:57:04.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.993+0000 7fb68ffff640 1 --2- 172.21.15.46:0/369102171 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb6900b66b0 0x7fb6900b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:04.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.993+0000 7fb6a77fe640 1 --2- 172.21.15.46:0/107850301 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559d61170070 0x559d61517270 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0008dc0 tx=0x7fb6a000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18abe2e496cade82 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:04.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.993+0000 7fb6a6ffd640 1 --2- 172.21.15.46:0/369102171 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb6900b66b0 0x7fb6900b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:04.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.993+0000 7fb68ffff640 1 -- 172.21.15.46:0/369102171 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fb69c0e7720 con 0x7fb6a81094c0 2024-09-21T03:57:04.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.993+0000 7fb68d7fa640 1 -- 172.21.15.46:0/107850301 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0014070 con 0x559d61170070 2024-09-21T03:57:04.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.993+0000 7fb68d7fa640 1 -- 172.21.15.46:0/107850301 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6a0003b70 con 0x559d61170070 2024-09-21T03:57:04.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.993+0000 7fb68d7fa640 1 -- 172.21.15.46:0/107850301 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0010700 con 0x559d61170070 2024-09-21T03:57:04.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.994+0000 7fb6b3a31740 1 -- 172.21.15.46:0/107850301 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559d61170070 msgr2=0x559d61517270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:04.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.994+0000 7fb6b3a31740 1 --2- 172.21.15.46:0/107850301 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559d61170070 0x559d61517270 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0008dc0 tx=0x7fb6a000e720 comp rx=0 tx=0).stop 2024-09-21T03:57:04.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.994+0000 7fb6a6ffd640 1 --2- 172.21.15.46:0/369102171 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb6900b66b0 0x7fb6900b8bc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb698031440 tx=0x7fb698031b10 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:04.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.994+0000 7fb6b3a31740 1 -- 172.21.15.46:0/107850301 shutdown_connections 2024-09-21T03:57:04.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.994+0000 7fb6b3a31740 1 --2- 172.21.15.46:0/107850301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d6114f390 0x559d61517cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:04.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.994+0000 7fb6b3a31740 1 --2- 172.21.15.46:0/107850301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d611471b0 0x559d615177b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:04.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.994+0000 7fb6b3a31740 1 --2- 172.21.15.46:0/107850301 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559d61170070 0x559d61517270 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:04.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.994+0000 7fb6b3a31740 1 -- 172.21.15.46:0/107850301 >> 172.21.15.46:0/107850301 conn(0x559d61164460 msgr2=0x559d61515160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:04.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.994+0000 7fb6b3a31740 1 -- 172.21.15.46:0/107850301 shutdown_connections 2024-09-21T03:57:04.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.994+0000 7fb6b3a31740 1 -- 172.21.15.46:0/107850301 wait complete. 2024-09-21T03:57:04.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.995+0000 7fb6b3a31740 1 -- start start 2024-09-21T03:57:04.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.995+0000 7fb6b3a31740 1 Processor -- start 2024-09-21T03:57:04.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.995+0000 7fb6b3a31740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d611471b0 0x559d61522970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:04.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.995+0000 7fb6b3a31740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d6114f390 0x559d61522eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:04.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.995+0000 7fb6b3a31740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559d61170070 0x559d6152ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:04.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.995+0000 7fb6b3a31740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x559d612de700 con 0x559d61170070 2024-09-21T03:57:04.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.995+0000 7fb6b3a31740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x559d61418110 con 0x559d611471b0 2024-09-21T03:57:04.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.995+0000 7fb6b3a31740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559d61525a50 con 0x559d6114f390 2024-09-21T03:57:04.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.995+0000 7fb6b3a31740 10 client.0 _ll_register_callbacks cb 0x559d61431990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:57:04.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.995+0000 7fb6a77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559d61170070 0x559d6152ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:04.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.995+0000 7fb6a77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559d61170070 0x559d6152ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51774/0 (socket says 172.21.15.46:51774) 2024-09-21T03:57:04.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.995+0000 7fb6a77fe640 1 -- 172.21.15.46:0/1889534558 learned_addr learned my addr 172.21.15.46:0/1889534558 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:04.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.995+0000 7fb6a6ffd640 1 --2- 172.21.15.46:0/1889534558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d611471b0 0x559d61522970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:04.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.995+0000 7fb6a67fc640 1 --2- 172.21.15.46:0/1889534558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d6114f390 0x559d61522eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:04.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.995+0000 7fb6a77fe640 1 -- 172.21.15.46:0/1889534558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d6114f390 msgr2=0x559d61522eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:04.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.995+0000 7fb6a77fe640 1 --2- 172.21.15.46:0/1889534558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d6114f390 0x559d61522eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:04.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.996+0000 7fb6a77fe640 1 -- 172.21.15.46:0/1889534558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d611471b0 msgr2=0x559d61522970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:04.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.996+0000 7fb6a77fe640 1 --2- 172.21.15.46:0/1889534558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d611471b0 0x559d61522970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:04.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.996+0000 7fb6a77fe640 1 -- 172.21.15.46:0/1889534558 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d61445c40 con 0x559d61170070 2024-09-21T03:57:04.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.996+0000 7fb6a67fc640 1 --2- 172.21.15.46:0/1889534558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d6114f390 0x559d61522eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:57:04.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.996+0000 7fb6a77fe640 1 --2- 172.21.15.46:0/1889534558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559d61170070 0x559d6152ed40 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0004550 tx=0x7fb6a0004580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80023cdca5ccbc16 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:04.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.996+0000 7fb68aff5640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:57:04.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.996+0000 7fb68aff5640 1 -- 172.21.15.46:0/1889534558 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0014030 con 0x559d61170070 2024-09-21T03:57:04.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.996+0000 7fb68aff5640 1 -- 172.21.15.46:0/1889534558 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fb6a0003970 con 0x559d61170070 2024-09-21T03:57:04.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.996+0000 7fb6b3a31740 1 -- 172.21.15.46:0/1889534558 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6a0003b70 con 0x559d61170070 2024-09-21T03:57:04.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.996+0000 7fb68aff5640 1 -- 172.21.15.46:0/1889534558 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb6a0004a40 con 0x559d61170070 2024-09-21T03:57:04.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.996+0000 7fb6b3a31740 10 client.15741 fetch_fsmap learned FSMap version 20 2024-09-21T03:57:04.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.996+0000 7fb6b3a31740 1 -- 172.21.15.46:0/1889534558 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x559d61531740 con 0x559d61170070 2024-09-21T03:57:04.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.996+0000 7fb68aff5640 1 -- 172.21.15.46:0/1889534558 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6a0003b70 con 0x559d61170070 2024-09-21T03:57:04.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.997+0000 7fb68aff5640 1 -- 172.21.15.46:0/1889534558 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fb6a00104a0 con 0x559d61170070 2024-09-21T03:57:04.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.997+0000 7fb6b3a31740 10 client.15741 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:57:04.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.997+0000 7fb6b3a31740 10 client.15741 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:57:04.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.997+0000 7fb6b3a31740 20 client.15741 populate_metadata read hostname 'smithi046' 2024-09-21T03:57:04.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.997+0000 7fb6b3a31740 1 --2- 172.21.15.46:0/1889534558 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x559d6112e9f0 0x559d61534aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:04.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.997+0000 7fb6b3a31740 4 client.15741 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:57:04.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.997+0000 7fb6b3a31740 1 -- 172.21.15.46:0/1889534558 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d6148fda0 con 0x559d6112e9f0 2024-09-21T03:57:04.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.997+0000 7fb6a6ffd640 1 --2- 172.21.15.46:0/1889534558 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x559d6112e9f0 0x559d61534aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:04.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.998+0000 7fb6a6ffd640 1 --2- 172.21.15.46:0/1889534558 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x559d6112e9f0 0x559d61534aa0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e70a86262bb3f81c server_cookie=92a757d0865175be in_seq=0 out_seq=0 2024-09-21T03:57:04.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.998+0000 7fb68aff5640 10 client.15741 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:57:04.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.998+0000 7fb68aff5640 1 -- 172.21.15.46:0/1889534558 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559d6148fda0 con 0x559d6112e9f0 2024-09-21T03:57:04.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.998+0000 7fb68aff5640 10 client.15741 handle_command_reply: tid=0 2024-09-21T03:57:04.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.998+0000 7fb6b3a31740 1 client.15741 shutdown 2024-09-21T03:57:04.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.999+0000 7fb6b3a31740 1 -- 172.21.15.46:0/1889534558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559d61170070 msgr2=0x559d6152ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:04.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.999+0000 7fb6b3a31740 1 --2- 172.21.15.46:0/1889534558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559d61170070 0x559d6152ed40 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0004550 tx=0x7fb6a0004580 comp rx=0 tx=0).stop 2024-09-21T03:57:04.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.999+0000 7fb6b3a31740 1 -- 172.21.15.46:0/1889534558 shutdown_connections 2024-09-21T03:57:04.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.999+0000 7fb6b3a31740 1 --2- 172.21.15.46:0/1889534558 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x559d6112e9f0 0x559d61534aa0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:04.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.999+0000 7fb6b3a31740 1 --2- 172.21.15.46:0/1889534558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559d61170070 0x559d6152ed40 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:04.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.999+0000 7fb6b3a31740 1 --2- 172.21.15.46:0/1889534558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d6114f390 0x559d61522eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:04.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.999+0000 7fb6b3a31740 1 --2- 172.21.15.46:0/1889534558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d611471b0 0x559d61522970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:04.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.999+0000 7fb68aff5640 0 client.15741 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:57:04.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.999+0000 7fb6b3a31740 1 -- 172.21.15.46:0/1889534558 >> 172.21.15.46:0/1889534558 conn(0x559d61164460 msgr2=0x559d6151a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:04.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.999+0000 7fb6b3a31740 1 -- 172.21.15.46:0/1889534558 shutdown_connections 2024-09-21T03:57:04.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.999+0000 7fb6b3a31740 1 -- 172.21.15.46:0/1889534558 wait complete. 2024-09-21T03:57:04.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:03.999+0000 7fb6b3a31740 20 client.15741 trim_cache size 0 max 16384 2024-09-21T03:57:04.010 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:03 smithi046 ceph-mon[30954]: pgmap v380: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-21T03:57:04.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.017+0000 7fb6b3a31740 1 Processor -- start 2024-09-21T03:57:04.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.017+0000 7fb6b3a31740 1 -- start start 2024-09-21T03:57:04.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.017+0000 7fb6b3a31740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d611471b0 0x559d61518c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:04.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.017+0000 7fb6b3a31740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d6114f390 0x559d615245a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:04.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.017+0000 7fb6b3a31740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559d61170070 0x559d6152ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:04.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.017+0000 7fb6b3a31740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a81ad540 con 0x559d61170070 2024-09-21T03:57:04.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.017+0000 7fb6b3a31740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a81afd80 con 0x559d611471b0 2024-09-21T03:57:04.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.017+0000 7fb6b3a31740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a81adb90 con 0x559d6114f390 2024-09-21T03:57:04.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.017+0000 7fb6a77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559d61170070 0x559d6152ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:04.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.017+0000 7fb6a77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559d61170070 0x559d6152ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51790/0 (socket says 172.21.15.46:51790) 2024-09-21T03:57:04.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.018+0000 7fb6a77fe640 1 -- 172.21.15.46:0/4214668098 learned_addr learned my addr 172.21.15.46:0/4214668098 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:04.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.018+0000 7fb6a6ffd640 1 --2- 172.21.15.46:0/4214668098 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d611471b0 0x559d61518c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:04.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.018+0000 7fb6a67fc640 1 --2- 172.21.15.46:0/4214668098 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d6114f390 0x559d615245a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:04.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.018+0000 7fb6a77fe640 1 -- 172.21.15.46:0/4214668098 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d6114f390 msgr2=0x559d615245a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:04.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.018+0000 7fb6a77fe640 1 --2- 172.21.15.46:0/4214668098 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d6114f390 0x559d615245a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:04.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.018+0000 7fb6a77fe640 1 -- 172.21.15.46:0/4214668098 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d611471b0 msgr2=0x559d61518c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:04.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.018+0000 7fb6a77fe640 1 --2- 172.21.15.46:0/4214668098 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d611471b0 0x559d61518c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:04.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.018+0000 7fb6a77fe640 1 -- 172.21.15.46:0/4214668098 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d61523c30 con 0x559d61170070 2024-09-21T03:57:04.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.018+0000 7fb6a6ffd640 1 --2- 172.21.15.46:0/4214668098 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d611471b0 0x559d61518c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:57:04.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.018+0000 7fb6a77fe640 1 --2- 172.21.15.46:0/4214668098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559d61170070 0x559d6152ec40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0008ce0 tx=0x7fb6a0005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20c5eb2340898608 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:04.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.018+0000 7fb68cff9640 1 -- 172.21.15.46:0/4214668098 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0014040 con 0x559d61170070 2024-09-21T03:57:04.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.018+0000 7fb68cff9640 1 -- 172.21.15.46:0/4214668098 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6a001ccd0 con 0x559d61170070 2024-09-21T03:57:04.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.018+0000 7fb68cff9640 1 -- 172.21.15.46:0/4214668098 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0010ab0 con 0x559d61170070 2024-09-21T03:57:04.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.019+0000 7fb6b3a31740 1 -- 172.21.15.46:0/4214668098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559d61170070 msgr2=0x559d6152ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:04.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.019+0000 7fb6b3a31740 1 --2- 172.21.15.46:0/4214668098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559d61170070 0x559d6152ec40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0008ce0 tx=0x7fb6a0005d90 comp rx=0 tx=0).stop 2024-09-21T03:57:04.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.019+0000 7fb6b3a31740 1 -- 172.21.15.46:0/4214668098 shutdown_connections 2024-09-21T03:57:04.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.019+0000 7fb6b3a31740 1 --2- 172.21.15.46:0/4214668098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559d61170070 0x559d6152ec40 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:04.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.019+0000 7fb6b3a31740 1 --2- 172.21.15.46:0/4214668098 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d6114f390 0x559d615245a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:04.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.019+0000 7fb6b3a31740 1 --2- 172.21.15.46:0/4214668098 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d611471b0 0x559d61518c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:04.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.019+0000 7fb6b3a31740 1 -- 172.21.15.46:0/4214668098 >> 172.21.15.46:0/4214668098 conn(0x559d61164460 msgr2=0x559d61523e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:04.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.019+0000 7fb6b3a31740 1 -- 172.21.15.46:0/4214668098 shutdown_connections 2024-09-21T03:57:04.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.020+0000 7fb6b3a31740 1 -- 172.21.15.46:0/4214668098 wait complete. 2024-09-21T03:57:04.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.020+0000 7fb6b3a31740 1 -- start start 2024-09-21T03:57:04.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.020+0000 7fb6b3a31740 1 Processor -- start 2024-09-21T03:57:04.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.021+0000 7fb6b3a31740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d611471b0 0x559d6152b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:04.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.021+0000 7fb6b3a31740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d6114f390 0x559d61526860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:04.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.021+0000 7fb6b3a31740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559d61170070 0x559d61526da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:04.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.021+0000 7fb6b3a31740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a81ae240 con 0x559d61170070 2024-09-21T03:57:04.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.021+0000 7fb6b3a31740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a81af6b0 con 0x559d611471b0 2024-09-21T03:57:04.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.021+0000 7fb6b3a31740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a81ae910 con 0x559d6114f390 2024-09-21T03:57:04.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.021+0000 7fb6a77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559d61170070 0x559d61526da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:04.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.021+0000 7fb6a77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559d61170070 0x559d61526da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51796/0 (socket says 172.21.15.46:51796) 2024-09-21T03:57:04.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.021+0000 7fb6a77fe640 1 -- 172.21.15.46:0/2243546442 learned_addr learned my addr 172.21.15.46:0/2243546442 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:04.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.021+0000 7fb6b3a31740 10 client.0 _ll_register_callbacks cb 0x7fb6a0008c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:57:04.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.021+0000 7fb6a6ffd640 1 --2- 172.21.15.46:0/2243546442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d611471b0 0x559d6152b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:04.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.021+0000 7fb6a67fc640 1 --2- 172.21.15.46:0/2243546442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d6114f390 0x559d61526860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:04.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.021+0000 7fb6a77fe640 1 -- 172.21.15.46:0/2243546442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d6114f390 msgr2=0x559d61526860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:04.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.021+0000 7fb6a77fe640 1 --2- 172.21.15.46:0/2243546442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d6114f390 0x559d61526860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:04.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.021+0000 7fb6a77fe640 1 -- 172.21.15.46:0/2243546442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d611471b0 msgr2=0x559d6152b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:04.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.021+0000 7fb6a77fe640 1 --2- 172.21.15.46:0/2243546442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d611471b0 0x559d6152b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:04.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.021+0000 7fb6a77fe640 1 -- 172.21.15.46:0/2243546442 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d61527490 con 0x559d61170070 2024-09-21T03:57:04.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.021+0000 7fb6a77fe640 1 --2- 172.21.15.46:0/2243546442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559d61170070 0x559d61526da0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0012000 tx=0x7fb6a001cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee168da45d07ffd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:04.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.021+0000 7fb68aff5640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:57:04.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.022+0000 7fb68aff5640 1 -- 172.21.15.46:0/2243546442 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0014040 con 0x559d61170070 2024-09-21T03:57:04.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.022+0000 7fb68aff5640 1 -- 172.21.15.46:0/2243546442 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fb6a0003b20 con 0x559d61170070 2024-09-21T03:57:04.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.022+0000 7fb6b3a31740 1 -- 172.21.15.46:0/2243546442 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6a001ccd0 con 0x559d61170070 2024-09-21T03:57:04.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.022+0000 7fb68aff5640 1 -- 172.21.15.46:0/2243546442 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb6a001ce80 con 0x559d61170070 2024-09-21T03:57:04.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.022+0000 7fb6b3a31740 10 client.15747 fetch_fsmap learned FSMap version 20 2024-09-21T03:57:04.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.022+0000 7fb6b3a31740 1 -- 172.21.15.46:0/2243546442 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x559d6159f1b0 con 0x559d61170070 2024-09-21T03:57:04.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.022+0000 7fb68aff5640 1 -- 172.21.15.46:0/2243546442 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6a001ccd0 con 0x559d61170070 2024-09-21T03:57:04.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.022+0000 7fb68aff5640 1 -- 172.21.15.46:0/2243546442 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fb6a002d930 con 0x559d61170070 2024-09-21T03:57:04.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.022+0000 7fb6b3a31740 10 client.15747 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:57:04.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.022+0000 7fb6b3a31740 10 client.15747 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:57:04.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.022+0000 7fb6b3a31740 20 client.15747 populate_metadata read hostname 'smithi046' 2024-09-21T03:57:04.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.023+0000 7fb6b3a31740 1 --2- 172.21.15.46:0/2243546442 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x559d61103da0 0x559d615a1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:04.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.023+0000 7fb6b3a31740 4 client.15747 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:57:04.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.023+0000 7fb6b3a31740 1 -- 172.21.15.46:0/2243546442 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559d6148b850 con 0x559d61103da0 2024-09-21T03:57:04.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.023+0000 7fb6a6ffd640 1 --2- 172.21.15.46:0/2243546442 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x559d61103da0 0x559d615a1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:04.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.023+0000 7fb6a6ffd640 1 --2- 172.21.15.46:0/2243546442 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x559d61103da0 0x559d615a1550 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb9f9f4ceaab40e7 server_cookie=67902a0cb532c2f in_seq=0 out_seq=0 2024-09-21T03:57:04.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.023+0000 7fb68aff5640 10 client.15747 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:57:04.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.024+0000 7fb68aff5640 1 -- 172.21.15.46:0/2243546442 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1226 (crc 0 0 0) 0x559d6148b850 con 0x559d61103da0 2024-09-21T03:57:04.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.024+0000 7fb68aff5640 10 client.15747 handle_command_reply: tid=0 2024-09-21T03:57:04.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.024+0000 7fb6b3a31740 1 client.15747 shutdown 2024-09-21T03:57:04.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.024+0000 7fb6b3a31740 1 -- 172.21.15.46:0/2243546442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559d61170070 msgr2=0x559d61526da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:04.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.024+0000 7fb6b3a31740 1 --2- 172.21.15.46:0/2243546442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559d61170070 0x559d61526da0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0012000 tx=0x7fb6a001cad0 comp rx=0 tx=0).stop 2024-09-21T03:57:04.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.024+0000 7fb6b3a31740 1 -- 172.21.15.46:0/2243546442 shutdown_connections 2024-09-21T03:57:04.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.024+0000 7fb6b3a31740 1 --2- 172.21.15.46:0/2243546442 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x559d61103da0 0x559d615a1550 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:04.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.024+0000 7fb6b3a31740 1 --2- 172.21.15.46:0/2243546442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559d61170070 0x559d61526da0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:04.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.024+0000 7fb6b3a31740 1 --2- 172.21.15.46:0/2243546442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559d6114f390 0x559d61526860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:04.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.024+0000 7fb68aff5640 0 client.15747 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:57:04.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.024+0000 7fb6b3a31740 1 --2- 172.21.15.46:0/2243546442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559d611471b0 0x559d6152b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:04.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.024+0000 7fb6b3a31740 1 -- 172.21.15.46:0/2243546442 >> 172.21.15.46:0/2243546442 conn(0x559d61164460 msgr2=0x559d61518a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:04.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.024+0000 7fb6b3a31740 1 -- 172.21.15.46:0/2243546442 shutdown_connections 2024-09-21T03:57:04.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.024+0000 7fb6b3a31740 1 -- 172.21.15.46:0/2243546442 wait complete. 2024-09-21T03:57:04.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.024+0000 7fb6b3a31740 20 client.15747 trim_cache size 0 max 16384 2024-09-21T03:57:04.030 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T03:57:04.030 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "no active scrubs running", 2024-09-21T03:57:04.031 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": {}, 2024-09-21T03:57:04.031 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_stats": { 2024-09-21T03:57:04.031 INFO:teuthology.orchestra.run.smithi046.stdout: "a871f724-0198-493c-b03e-b2de78aba243": { 2024-09-21T03:57:04.031 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:56:30.082991+0000", 2024-09-21T03:57:04.031 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:57:04.031 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:57:04.031 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:57:04.031 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:57:04.031 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:57:04.031 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:57:04.031 INFO:teuthology.orchestra.run.smithi046.stdout: "d49f33a7-3d5a-421b-94ba-8b19a4120db1": { 2024-09-21T03:57:04.031 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:50.480786+0000", 2024-09-21T03:57:04.031 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:57:04.031 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:57:04.032 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:57:04.032 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:57:04.032 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:57:04.032 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:57:04.032 INFO:teuthology.orchestra.run.smithi046.stdout: "3bbf7097-70d7-4743-bbce-41465502b35b": { 2024-09-21T03:57:04.032 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:10.661441+0000", 2024-09-21T03:57:04.032 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:57:04.032 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:57:04.032 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:57:04.032 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:57:04.032 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:57:04.032 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:57:04.032 INFO:teuthology.orchestra.run.smithi046.stdout: "08f0c962-df1a-4129-a1a2-b916240d9803": { 2024-09-21T03:57:04.032 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:02.937596+0000", 2024-09-21T03:57:04.032 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:57:04.033 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:57:04.033 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:57:04.033 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:57:04.033 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:57:04.033 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:57:04.033 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:57:04.033 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T03:57:04.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.025+0000 7fb6ad4bd640 1 -- 172.21.15.46:0/369102171 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb6900b66b0 msgr2=0x7fb6900b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:04.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.025+0000 7fb6ad4bd640 1 --2- 172.21.15.46:0/369102171 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb6900b66b0 0x7fb6900b8bc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb698031440 tx=0x7fb698031b10 comp rx=0 tx=0).stop 2024-09-21T03:57:04.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.025+0000 7fb6ad4bd640 1 -- 172.21.15.46:0/369102171 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6a81094c0 msgr2=0x7fb6a819aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:04.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.025+0000 7fb6ad4bd640 1 --2- 172.21.15.46:0/369102171 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6a81094c0 0x7fb6a819aa30 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb69c00c970 tx=0x7fb69c00ce30 comp rx=0 tx=0).stop 2024-09-21T03:57:04.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.025+0000 7fb6ad4bd640 1 -- 172.21.15.46:0/369102171 shutdown_connections 2024-09-21T03:57:04.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.025+0000 7fb6ad4bd640 1 --2- 172.21.15.46:0/369102171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6a8109e10 0x7fb6a819fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:04.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.025+0000 7fb6ad4bd640 1 --2- 172.21.15.46:0/369102171 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6a81094c0 0x7fb6a819aa30 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:04.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.025+0000 7fb6ad4bd640 1 --2- 172.21.15.46:0/369102171 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb6900b66b0 0x7fb6900b8bc0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:04.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.025+0000 7fb6ad4bd640 1 --2- 172.21.15.46:0/369102171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6a8101fe0 0x7fb6a819a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:04.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.025+0000 7fb6ad4bd640 1 -- 172.21.15.46:0/369102171 >> 172.21.15.46:0/369102171 conn(0x7fb6a8077bc0 msgr2=0x7fb6a81075c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:04.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.025+0000 7fb6ad4bd640 1 -- 172.21.15.46:0/369102171 shutdown_connections 2024-09-21T03:57:04.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:04.025+0000 7fb6ad4bd640 1 -- 172.21.15.46:0/369102171 wait complete. 2024-09-21T03:57:04.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:03 smithi105 ceph-mon[34773]: pgmap v380: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-21T03:57:04.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:03 smithi162 ceph-mon[35071]: pgmap v380: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-21T03:57:04.718 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:57:04.719 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:57:04.983 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:57:05.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.500+0000 7fafd32d8640 1 -- 172.21.15.46:0/3654830003 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fafcc1083d0 msgr2=0x7fafcc1087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:05.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.500+0000 7fafd32d8640 1 --2- 172.21.15.46:0/3654830003 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fafcc1083d0 0x7fafcc1087e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fafbc009900 tx=0x7fafbc02a410 comp rx=0 tx=0).stop 2024-09-21T03:57:05.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.501+0000 7fafd32d8640 1 -- 172.21.15.46:0/3654830003 shutdown_connections 2024-09-21T03:57:05.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.501+0000 7fafd32d8640 1 --2- 172.21.15.46:0/3654830003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafcc108d20 0x7fafcc10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:05.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.501+0000 7fafd32d8640 1 --2- 172.21.15.46:0/3654830003 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fafcc1083d0 0x7fafcc1087e0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:05.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.501+0000 7fafd32d8640 1 --2- 172.21.15.46:0/3654830003 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafcc102ae0 0x7fafcc102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:05.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.501+0000 7fafd32d8640 1 -- 172.21.15.46:0/3654830003 >> 172.21.15.46:0/3654830003 conn(0x7fafcc079760 msgr2=0x7fafcc079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:05.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.501+0000 7fafd32d8640 1 -- 172.21.15.46:0/3654830003 shutdown_connections 2024-09-21T03:57:05.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.501+0000 7fafd32d8640 1 -- 172.21.15.46:0/3654830003 wait complete. 2024-09-21T03:57:05.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.501+0000 7fafd32d8640 1 Processor -- start 2024-09-21T03:57:05.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.501+0000 7fafd32d8640 1 -- start start 2024-09-21T03:57:05.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.502+0000 7fafd32d8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafcc102ae0 0x7fafcc19c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:05.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.502+0000 7fafd32d8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fafcc1083d0 0x7fafcc19cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:05.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.502+0000 7fafd32d8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafcc108d20 0x7fafcc1a1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:05.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.502+0000 7fafd32d8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fafcc112990 con 0x7fafcc1083d0 2024-09-21T03:57:05.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.502+0000 7fafd32d8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fafcc112810 con 0x7fafcc108d20 2024-09-21T03:57:05.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.502+0000 7fafd32d8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fafcc112b10 con 0x7fafcc102ae0 2024-09-21T03:57:05.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.502+0000 7fafd0873640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fafcc1083d0 0x7fafcc19cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:05.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.502+0000 7fafd0873640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fafcc1083d0 0x7fafcc19cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51810/0 (socket says 172.21.15.46:51810) 2024-09-21T03:57:05.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.502+0000 7fafd0873640 1 -- 172.21.15.46:0/4166218524 learned_addr learned my addr 172.21.15.46:0/4166218524 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:05.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.502+0000 7fafd1074640 1 --2- 172.21.15.46:0/4166218524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafcc102ae0 0x7fafcc19c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:05.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.502+0000 7fafd1875640 1 --2- 172.21.15.46:0/4166218524 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafcc108d20 0x7fafcc1a1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:05.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.502+0000 7fafd0873640 1 -- 172.21.15.46:0/4166218524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafcc102ae0 msgr2=0x7fafcc19c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:05.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.502+0000 7fafd0873640 1 --2- 172.21.15.46:0/4166218524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafcc102ae0 0x7fafcc19c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:05.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.502+0000 7fafd0873640 1 -- 172.21.15.46:0/4166218524 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafcc108d20 msgr2=0x7fafcc1a1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:05.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.502+0000 7fafd0873640 1 --2- 172.21.15.46:0/4166218524 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafcc108d20 0x7fafcc1a1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:05.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.502+0000 7fafd0873640 1 -- 172.21.15.46:0/4166218524 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafcc1a2660 con 0x7fafcc1083d0 2024-09-21T03:57:05.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.502+0000 7fafd1875640 1 --2- 172.21.15.46:0/4166218524 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafcc108d20 0x7fafcc1a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:57:05.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.502+0000 7fafd0873640 1 --2- 172.21.15.46:0/4166218524 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fafcc1083d0 0x7fafcc19cc90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fafbc006010 tx=0x7fafbc004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:05.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.503+0000 7fafc27fc640 1 -- 172.21.15.46:0/4166218524 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafbc03f030 con 0x7fafcc1083d0 2024-09-21T03:57:05.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.503+0000 7fafd32d8640 1 -- 172.21.15.46:0/4166218524 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafcc1a28f0 con 0x7fafcc1083d0 2024-09-21T03:57:05.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.503+0000 7fafc27fc640 1 -- 172.21.15.46:0/4166218524 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fafbc003aa0 con 0x7fafcc1083d0 2024-09-21T03:57:05.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.503+0000 7fafc27fc640 1 -- 172.21.15.46:0/4166218524 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafbc035070 con 0x7fafcc1083d0 2024-09-21T03:57:05.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.503+0000 7fafd32d8640 1 -- 172.21.15.46:0/4166218524 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafcc1a90b0 con 0x7fafcc1083d0 2024-09-21T03:57:05.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.504+0000 7fafd32d8640 1 -- 172.21.15.46:0/4166218524 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafcc103d10 con 0x7fafcc1083d0 2024-09-21T03:57:05.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.505+0000 7fafc27fc640 1 -- 172.21.15.46:0/4166218524 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7fafbc042030 con 0x7fafcc1083d0 2024-09-21T03:57:05.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.506+0000 7fafc27fc640 1 --2- 172.21.15.46:0/4166218524 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fafb80b6680 0x7fafb80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:05.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.506+0000 7fafd1074640 1 --2- 172.21.15.46:0/4166218524 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fafb80b6680 0x7fafb80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:05.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.506+0000 7fafc27fc640 1 -- 172.21.15.46:0/4166218524 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fafbc107f10 con 0x7fafcc1083d0 2024-09-21T03:57:05.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.507+0000 7fafd1074640 1 --2- 172.21.15.46:0/4166218524 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fafb80b6680 0x7fafb80b8b90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fafc8009bd0 tx=0x7fafc8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:05.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.509+0000 7fafc27fc640 1 -- 172.21.15.46:0/4166218524 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fafbc0ce500 con 0x7fafcc1083d0 2024-09-21T03:57:05.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.733+0000 7fafd32d8640 1 -- 172.21.15.46:0/4166218524 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fafcc102ef0 con 0x7fafcc1083d0 2024-09-21T03:57:05.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.734+0000 7fafc27fc640 1 -- 172.21.15.46:0/4166218524 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7fafcc102ef0 con 0x7fafcc1083d0 2024-09-21T03:57:05.737 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:57:05.737 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"btime":"2024-09-21T03:53:23:865820+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1766354184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1766354184},{"type":"v1","addr":"172.21.15.46:6839","nonce":1766354184}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/1901774207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":1901774207},{"type":"v1","addr":"172.21.15.46:6841","nonce":1901774207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3548633196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":3548633196},{"type":"v1","addr":"172.21.15.105:6837","nonce":3548633196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24652,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3551934241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3551934241},{"type":"v1","addr":"172.21.15.162:6835","nonce":3551934241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/48949822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":48949822},{"type":"v1","addr":"172.21.15.162:6837","nonce":48949822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:53:14.452819+0000","modified":"2024-09-21T03:53:23.593278+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24680},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/2196053213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2196053213},{"type":"v1","addr":"172.21.15.162:6839","nonce":2196053213}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.105:6839/3911438406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":3911438406},{"type":"v1","addr":"172.21.15.105:6839","nonce":3911438406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24680,"qdb_cluster":[24680]},"id":1}]} 2024-09-21T03:57:05.737 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T03:57:05.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.737+0000 7fafd32d8640 1 -- 172.21.15.46:0/4166218524 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fafb80b6680 msgr2=0x7fafb80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:05.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.737+0000 7fafd32d8640 1 --2- 172.21.15.46:0/4166218524 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fafb80b6680 0x7fafb80b8b90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fafc8009bd0 tx=0x7fafc8005f90 comp rx=0 tx=0).stop 2024-09-21T03:57:05.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.737+0000 7fafd32d8640 1 -- 172.21.15.46:0/4166218524 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fafcc1083d0 msgr2=0x7fafcc19cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:05.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.737+0000 7fafd32d8640 1 --2- 172.21.15.46:0/4166218524 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fafcc1083d0 0x7fafcc19cc90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fafbc006010 tx=0x7fafbc004060 comp rx=0 tx=0).stop 2024-09-21T03:57:05.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.737+0000 7fafd32d8640 1 -- 172.21.15.46:0/4166218524 shutdown_connections 2024-09-21T03:57:05.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.737+0000 7fafd32d8640 1 --2- 172.21.15.46:0/4166218524 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafcc108d20 0x7fafcc1a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:05.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.737+0000 7fafd32d8640 1 --2- 172.21.15.46:0/4166218524 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fafcc1083d0 0x7fafcc19cc90 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:05.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.737+0000 7fafd32d8640 1 --2- 172.21.15.46:0/4166218524 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fafb80b6680 0x7fafb80b8b90 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:05.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.737+0000 7fafd32d8640 1 --2- 172.21.15.46:0/4166218524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafcc102ae0 0x7fafcc19c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:05.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.737+0000 7fafd32d8640 1 -- 172.21.15.46:0/4166218524 >> 172.21.15.46:0/4166218524 conn(0x7fafcc079760 msgr2=0x7fafcc06bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:05.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.737+0000 7fafd32d8640 1 -- 172.21.15.46:0/4166218524 shutdown_connections 2024-09-21T03:57:05.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:05.738+0000 7fafd32d8640 1 -- 172.21.15.46:0/4166218524 wait complete. 2024-09-21T03:57:06.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:05 smithi046 ceph-mon[30954]: pgmap v381: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T03:57:06.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:05 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/4166218524' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:57:06.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:05 smithi105 ceph-mon[34773]: pgmap v381: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T03:57:06.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:05 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/4166218524' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:57:06.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:05 smithi162 ceph-mon[35071]: pgmap v381: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T03:57:06.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:05 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/4166218524' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:57:06.440 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:57:06.703 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:57:07.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.181+0000 7fe2f3357640 1 -- 172.21.15.46:0/2107026021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2ec106c20 msgr2=0x7fe2ec110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:07.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.181+0000 7fe2f3357640 1 --2- 172.21.15.46:0/2107026021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2ec106c20 0x7fe2ec110670 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4009900 tx=0x7fe2e402a410 comp rx=0 tx=0).stop 2024-09-21T03:57:07.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.181+0000 7fe2f3357640 1 -- 172.21.15.46:0/2107026021 shutdown_connections 2024-09-21T03:57:07.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.181+0000 7fe2f3357640 1 --2- 172.21.15.46:0/2107026021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2ec106c20 0x7fe2ec110670 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:07.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.181+0000 7fe2f3357640 1 --2- 172.21.15.46:0/2107026021 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2ec1062d0 0x7fe2ec1066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:07.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.181+0000 7fe2f3357640 1 --2- 172.21.15.46:0/2107026021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2ec101ff0 0x7fe2ec102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:07.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.181+0000 7fe2f3357640 1 -- 172.21.15.46:0/2107026021 >> 172.21.15.46:0/2107026021 conn(0x7fe2ec077cc0 msgr2=0x7fe2ec078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:07.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.181+0000 7fe2f3357640 1 -- 172.21.15.46:0/2107026021 shutdown_connections 2024-09-21T03:57:07.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.181+0000 7fe2f3357640 1 -- 172.21.15.46:0/2107026021 wait complete. 2024-09-21T03:57:07.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.182+0000 7fe2f3357640 1 Processor -- start 2024-09-21T03:57:07.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.182+0000 7fe2f3357640 1 -- start start 2024-09-21T03:57:07.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.182+0000 7fe2f3357640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2ec101ff0 0x7fe2ec102f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:07.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.182+0000 7fe2f3357640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2ec1062d0 0x7fe2ec1034d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:07.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.182+0000 7fe2f3357640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2ec106c20 0x7fe2ec103a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:07.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.182+0000 7fe2f3357640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ec113ac0 con 0x7fe2ec101ff0 2024-09-21T03:57:07.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.182+0000 7fe2f3357640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ec113940 con 0x7fe2ec1062d0 2024-09-21T03:57:07.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.182+0000 7fe2f3357640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ec113c40 con 0x7fe2ec106c20 2024-09-21T03:57:07.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.182+0000 7fe2f10f3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2ec101ff0 0x7fe2ec102f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:07.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.182+0000 7fe2f10f3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2ec101ff0 0x7fe2ec102f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51828/0 (socket says 172.21.15.46:51828) 2024-09-21T03:57:07.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.182+0000 7fe2f10f3640 1 -- 172.21.15.46:0/2441568679 learned_addr learned my addr 172.21.15.46:0/2441568679 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:07.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.182+0000 7fe2f08f2640 1 --2- 172.21.15.46:0/2441568679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2ec1062d0 0x7fe2ec1034d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:07.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.182+0000 7fe2f18f4640 1 --2- 172.21.15.46:0/2441568679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2ec106c20 0x7fe2ec103a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:07.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.183+0000 7fe2f10f3640 1 -- 172.21.15.46:0/2441568679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2ec106c20 msgr2=0x7fe2ec103a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:07.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.183+0000 7fe2f10f3640 1 --2- 172.21.15.46:0/2441568679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2ec106c20 0x7fe2ec103a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:07.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.183+0000 7fe2f10f3640 1 -- 172.21.15.46:0/2441568679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2ec1062d0 msgr2=0x7fe2ec1034d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:07.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.183+0000 7fe2f10f3640 1 --2- 172.21.15.46:0/2441568679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2ec1062d0 0x7fe2ec1034d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:07.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.183+0000 7fe2f10f3640 1 -- 172.21.15.46:0/2441568679 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2ec1a8640 con 0x7fe2ec101ff0 2024-09-21T03:57:07.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.183+0000 7fe2f18f4640 1 --2- 172.21.15.46:0/2441568679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2ec106c20 0x7fe2ec103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:57:07.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.183+0000 7fe2f10f3640 1 --2- 172.21.15.46:0/2441568679 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2ec101ff0 0x7fe2ec102f90 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc00eab0 tx=0x7fe2dc00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:07.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.183+0000 7fe2ea7fc640 1 -- 172.21.15.46:0/2441568679 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc00ce40 con 0x7fe2ec101ff0 2024-09-21T03:57:07.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.183+0000 7fe2f3357640 1 -- 172.21.15.46:0/2441568679 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2ec1a8930 con 0x7fe2ec101ff0 2024-09-21T03:57:07.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.183+0000 7fe2ea7fc640 1 -- 172.21.15.46:0/2441568679 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2dc011920 con 0x7fe2ec101ff0 2024-09-21T03:57:07.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.183+0000 7fe2ea7fc640 1 -- 172.21.15.46:0/2441568679 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc010a30 con 0x7fe2ec101ff0 2024-09-21T03:57:07.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.183+0000 7fe2f3357640 1 -- 172.21.15.46:0/2441568679 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2ec1a8e70 con 0x7fe2ec101ff0 2024-09-21T03:57:07.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.186+0000 7fe2ea7fc640 1 -- 172.21.15.46:0/2441568679 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7fe2dc010bd0 con 0x7fe2ec101ff0 2024-09-21T03:57:07.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.186+0000 7fe2f98cb740 1 Processor -- start 2024-09-21T03:57:07.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.186+0000 7fe2f98cb740 1 -- start start 2024-09-21T03:57:07.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.187+0000 7fe2f98cb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc0c946070 0x55dc0cced6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:07.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.187+0000 7fe2f98cb740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dc0c91d1b0 0x55dc0ccedbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:07.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.187+0000 7fe2f98cb740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dc0c925390 0x55dc0ccee120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:07.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.187+0000 7fe2f98cb740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55dc0cc63ea0 con 0x55dc0c91d1b0 2024-09-21T03:57:07.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.187+0000 7fe2f98cb740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55dc0cc532d0 con 0x55dc0c925390 2024-09-21T03:57:07.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.187+0000 7fe2f98cb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55dc0cc570e0 con 0x55dc0c946070 2024-09-21T03:57:07.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.187+0000 7fe2ea7fc640 1 --2- 172.21.15.46:0/2441568679 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe2d40b6680 0x7fe2d40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:07.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.187+0000 7fe2f10f3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dc0c91d1b0 0x55dc0ccedbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:07.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.187+0000 7fe2f08f2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dc0c925390 0x55dc0ccee120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:07.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.187+0000 7fe2f10f3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dc0c91d1b0 0x55dc0ccedbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51834/0 (socket says 172.21.15.46:51834) 2024-09-21T03:57:07.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.187+0000 7fe2f18f4640 1 --2- 172.21.15.46:0/2441568679 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe2d40b6680 0x7fe2d40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:07.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.187+0000 7fe2f10f3640 1 -- 172.21.15.46:0/2534476546 learned_addr learned my addr 172.21.15.46:0/2534476546 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:07.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.187+0000 7fe2f08f2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dc0c925390 0x55dc0ccee120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.46:43510/0 (socket says 172.21.15.46:43510) 2024-09-21T03:57:07.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.187+0000 7fe2f18f4640 1 --2- 172.21.15.46:0/2534476546 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc0c946070 0x55dc0cced6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:07.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.187+0000 7fe2ea7fc640 1 -- 172.21.15.46:0/2441568679 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fe2dc0e7d90 con 0x7fe2ec101ff0 2024-09-21T03:57:07.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.188+0000 7fe2f10f3640 1 -- 172.21.15.46:0/2534476546 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc0c946070 msgr2=0x55dc0cced6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:07.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.188+0000 7fe2f10f3640 1 --2- 172.21.15.46:0/2534476546 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc0c946070 0x55dc0cced6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:07.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.188+0000 7fe2f10f3640 1 -- 172.21.15.46:0/2534476546 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dc0c925390 msgr2=0x55dc0ccee120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:07.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.188+0000 7fe2f10f3640 1 --2- 172.21.15.46:0/2534476546 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dc0c925390 0x55dc0ccee120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:07.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.188+0000 7fe2f10f3640 1 -- 172.21.15.46:0/2534476546 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc0c9b1650 con 0x55dc0c91d1b0 2024-09-21T03:57:07.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.188+0000 7fe2f08f2640 1 --2- 172.21.15.46:0/2534476546 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dc0c925390 0x55dc0ccee120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:57:07.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.188+0000 7fe2f18f4640 1 --2- 172.21.15.46:0/2441568679 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe2d40b6680 0x7fe2d40b8b90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4005f70 tx=0x7fe2e4032b20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:07.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.188+0000 7fe2f10f3640 1 --2- 172.21.15.46:0/2534476546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dc0c91d1b0 0x55dc0ccedbe0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc000f80 tx=0x7fe2dc0094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40d8741582317d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:07.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.188+0000 7fe2d37fe640 1 -- 172.21.15.46:0/2534476546 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc0ad5d0 con 0x55dc0c91d1b0 2024-09-21T03:57:07.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.188+0000 7fe2d37fe640 1 -- 172.21.15.46:0/2534476546 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2dc0950e0 con 0x55dc0c91d1b0 2024-09-21T03:57:07.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.188+0000 7fe2d37fe640 1 -- 172.21.15.46:0/2534476546 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc0ad3f0 con 0x55dc0c91d1b0 2024-09-21T03:57:07.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.189+0000 7fe2f98cb740 1 -- 172.21.15.46:0/2534476546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dc0c91d1b0 msgr2=0x55dc0ccedbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:07.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.189+0000 7fe2f98cb740 1 --2- 172.21.15.46:0/2534476546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dc0c91d1b0 0x55dc0ccedbe0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc000f80 tx=0x7fe2dc0094a0 comp rx=0 tx=0).stop 2024-09-21T03:57:07.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.189+0000 7fe2f98cb740 1 -- 172.21.15.46:0/2534476546 shutdown_connections 2024-09-21T03:57:07.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.189+0000 7fe2f98cb740 1 --2- 172.21.15.46:0/2534476546 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dc0c925390 0x55dc0ccee120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:07.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.189+0000 7fe2f98cb740 1 --2- 172.21.15.46:0/2534476546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dc0c91d1b0 0x55dc0ccedbe0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:07.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.189+0000 7fe2f98cb740 1 --2- 172.21.15.46:0/2534476546 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc0c946070 0x55dc0cced6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:07.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.189+0000 7fe2f98cb740 1 -- 172.21.15.46:0/2534476546 >> 172.21.15.46:0/2534476546 conn(0x55dc0c93a460 msgr2=0x55dc0cceb590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:07.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.189+0000 7fe2f98cb740 1 -- 172.21.15.46:0/2534476546 shutdown_connections 2024-09-21T03:57:07.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.189+0000 7fe2f98cb740 1 -- 172.21.15.46:0/2534476546 wait complete. 2024-09-21T03:57:07.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.189+0000 7fe2f98cb740 1 -- start start 2024-09-21T03:57:07.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.190+0000 7fe2f98cb740 1 Processor -- start 2024-09-21T03:57:07.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.190+0000 7fe2f98cb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc0c91d1b0 0x55dc0ccf8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:07.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.190+0000 7fe2f98cb740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dc0c925390 0x55dc0ccf92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:07.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.190+0000 7fe2f98cb740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dc0c946070 0x55dc0cd051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:07.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.190+0000 7fe2f98cb740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55dc0cab4700 con 0x55dc0c946070 2024-09-21T03:57:07.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.190+0000 7fe2f98cb740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55dc0cbee160 con 0x55dc0c925390 2024-09-21T03:57:07.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.190+0000 7fe2f98cb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55dc0ccfbe80 con 0x55dc0c91d1b0 2024-09-21T03:57:07.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.190+0000 7fe2f98cb740 10 client.0 _ll_register_callbacks cb 0x55dc0cc079e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:57:07.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.190+0000 7fe2f18f4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dc0c946070 0x55dc0cd051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:07.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.190+0000 7fe2f18f4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dc0c946070 0x55dc0cd051a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51838/0 (socket says 172.21.15.46:51838) 2024-09-21T03:57:07.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.190+0000 7fe2f18f4640 1 -- 172.21.15.46:0/3344942958 learned_addr learned my addr 172.21.15.46:0/3344942958 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:07.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.190+0000 7fe2f10f3640 1 --2- 172.21.15.46:0/3344942958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc0c91d1b0 0x55dc0ccf8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:07.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.190+0000 7fe2f08f2640 1 --2- 172.21.15.46:0/3344942958 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dc0c925390 0x55dc0ccf92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:07.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.191+0000 7fe2f18f4640 1 -- 172.21.15.46:0/3344942958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc0c91d1b0 msgr2=0x55dc0ccf8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:07.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.191+0000 7fe2f18f4640 1 --2- 172.21.15.46:0/3344942958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc0c91d1b0 0x55dc0ccf8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:07.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.191+0000 7fe2f18f4640 1 -- 172.21.15.46:0/3344942958 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dc0c925390 msgr2=0x55dc0ccf92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:07.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.191+0000 7fe2f18f4640 1 --2- 172.21.15.46:0/3344942958 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dc0c925390 0x55dc0ccf92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:07.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.191+0000 7fe2f18f4640 1 -- 172.21.15.46:0/3344942958 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc0cc1bc90 con 0x55dc0c946070 2024-09-21T03:57:07.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.191+0000 7fe2f18f4640 1 --2- 172.21.15.46:0/3344942958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dc0c946070 0x55dc0cd051a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4004500 tx=0x7fe2e4005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb3db9fb960738a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:07.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.191+0000 7fe2d0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:57:07.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.191+0000 7fe2d0ff9640 1 -- 172.21.15.46:0/3344942958 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4035040 con 0x55dc0c946070 2024-09-21T03:57:07.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.191+0000 7fe2f98cb740 1 -- 172.21.15.46:0/3344942958 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dc0cc65df0 con 0x55dc0c946070 2024-09-21T03:57:07.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.191+0000 7fe2d0ff9640 1 -- 172.21.15.46:0/3344942958 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fe2e4005280 con 0x55dc0c946070 2024-09-21T03:57:07.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.191+0000 7fe2d0ff9640 1 -- 172.21.15.46:0/3344942958 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe2e4032df0 con 0x55dc0c946070 2024-09-21T03:57:07.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.191+0000 7fe2f98cb740 10 client.15765 fetch_fsmap learned FSMap version 20 2024-09-21T03:57:07.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.191+0000 7fe2f98cb740 1 -- 172.21.15.46:0/3344942958 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55dc0cd07bc0 con 0x55dc0c946070 2024-09-21T03:57:07.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.191+0000 7fe2d0ff9640 1 -- 172.21.15.46:0/3344942958 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55dc0cc65df0 con 0x55dc0c946070 2024-09-21T03:57:07.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.192+0000 7fe2d0ff9640 1 -- 172.21.15.46:0/3344942958 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fe2e403a070 con 0x55dc0c946070 2024-09-21T03:57:07.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.192+0000 7fe2f98cb740 10 client.15765 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:57:07.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.192+0000 7fe2f98cb740 10 client.15765 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:57:07.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.192+0000 7fe2f98cb740 20 client.15765 populate_metadata read hostname 'smithi046' 2024-09-21T03:57:07.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.192+0000 7fe2f98cb740 1 --2- 172.21.15.46:0/3344942958 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55dc0c9049f0 0x55dc0cd0b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:07.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.192+0000 7fe2f98cb740 4 client.15765 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:57:07.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.192+0000 7fe2f98cb740 1 -- 172.21.15.46:0/3344942958 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc0cc618a0 con 0x55dc0c9049f0 2024-09-21T03:57:07.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.192+0000 7fe2f10f3640 1 --2- 172.21.15.46:0/3344942958 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55dc0c9049f0 0x55dc0cd0b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:07.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.193+0000 7fe2d0ff9640 10 client.15765 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:57:07.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.193+0000 7fe2f10f3640 1 --2- 172.21.15.46:0/3344942958 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55dc0c9049f0 0x55dc0cd0b130 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4359e416f7b4ff55 server_cookie=10527230684425ea in_seq=0 out_seq=0 2024-09-21T03:57:07.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.194+0000 7fe2d0ff9640 1 -- 172.21.15.46:0/3344942958 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dc0cc618a0 con 0x55dc0c9049f0 2024-09-21T03:57:07.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.194+0000 7fe2d0ff9640 10 client.15765 handle_command_reply: tid=0 2024-09-21T03:57:07.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.194+0000 7fe2f98cb740 1 client.15765 shutdown 2024-09-21T03:57:07.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.194+0000 7fe2f98cb740 1 -- 172.21.15.46:0/3344942958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dc0c946070 msgr2=0x55dc0cd051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:07.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.194+0000 7fe2f98cb740 1 --2- 172.21.15.46:0/3344942958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dc0c946070 0x55dc0cd051a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4004500 tx=0x7fe2e4005fd0 comp rx=0 tx=0).stop 2024-09-21T03:57:07.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.194+0000 7fe2f98cb740 1 -- 172.21.15.46:0/3344942958 shutdown_connections 2024-09-21T03:57:07.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.194+0000 7fe2f98cb740 1 --2- 172.21.15.46:0/3344942958 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55dc0c9049f0 0x55dc0cd0b130 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:07.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.194+0000 7fe2f98cb740 1 --2- 172.21.15.46:0/3344942958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dc0c946070 0x55dc0cd051a0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:07.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.194+0000 7fe2f98cb740 1 --2- 172.21.15.46:0/3344942958 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dc0c925390 0x55dc0ccf92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:07.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.194+0000 7fe2f98cb740 1 --2- 172.21.15.46:0/3344942958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc0c91d1b0 0x55dc0ccf8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:07.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.194+0000 7fe2f98cb740 1 -- 172.21.15.46:0/3344942958 >> 172.21.15.46:0/3344942958 conn(0x55dc0c93a460 msgr2=0x55dc0ccee6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:07.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.194+0000 7fe2d0ff9640 0 client.15765 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:57:07.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.194+0000 7fe2f98cb740 1 -- 172.21.15.46:0/3344942958 shutdown_connections 2024-09-21T03:57:07.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.194+0000 7fe2f98cb740 1 -- 172.21.15.46:0/3344942958 wait complete. 2024-09-21T03:57:07.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.194+0000 7fe2f98cb740 20 client.15765 trim_cache size 0 max 16384 2024-09-21T03:57:07.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.208+0000 7fe2f98cb740 1 Processor -- start 2024-09-21T03:57:07.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.208+0000 7fe2f98cb740 1 -- start start 2024-09-21T03:57:07.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.208+0000 7fe2f98cb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc0c91d1b0 0x55dc0ccfac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:07.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.208+0000 7fe2f98cb740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dc0c925390 0x55dc0cceed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:07.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.208+0000 7fe2f98cb740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dc0c946070 0x55dc0cd050a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:07.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.208+0000 7fe2f98cb740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ec1af670 con 0x55dc0c946070 2024-09-21T03:57:07.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.208+0000 7fe2f98cb740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ec1b1f10 con 0x55dc0c925390 2024-09-21T03:57:07.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.208+0000 7fe2f98cb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ec1afd00 con 0x55dc0c91d1b0 2024-09-21T03:57:07.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.208+0000 7fe2f18f4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dc0c946070 0x55dc0cd050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:07.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.208+0000 7fe2f18f4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dc0c946070 0x55dc0cd050a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51842/0 (socket says 172.21.15.46:51842) 2024-09-21T03:57:07.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.208+0000 7fe2f18f4640 1 -- 172.21.15.46:0/460335117 learned_addr learned my addr 172.21.15.46:0/460335117 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:07.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.208+0000 7fe2f10f3640 1 --2- 172.21.15.46:0/460335117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc0c91d1b0 0x55dc0ccfac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:07.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.208+0000 7fe2f08f2640 1 --2- 172.21.15.46:0/460335117 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dc0c925390 0x55dc0cceed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:07.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.208+0000 7fe2f18f4640 1 -- 172.21.15.46:0/460335117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc0c91d1b0 msgr2=0x55dc0ccfac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:07.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.208+0000 7fe2f18f4640 1 --2- 172.21.15.46:0/460335117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc0c91d1b0 0x55dc0ccfac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:07.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.208+0000 7fe2f18f4640 1 -- 172.21.15.46:0/460335117 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dc0c925390 msgr2=0x55dc0cceed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:07.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.208+0000 7fe2f18f4640 1 --2- 172.21.15.46:0/460335117 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dc0c925390 0x55dc0cceed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:07.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.208+0000 7fe2f18f4640 1 -- 172.21.15.46:0/460335117 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc0ccfa050 con 0x55dc0c946070 2024-09-21T03:57:07.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.208+0000 7fe2f08f2640 1 --2- 172.21.15.46:0/460335117 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dc0c925390 0x55dc0cceed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:57:07.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.209+0000 7fe2f18f4640 1 --2- 172.21.15.46:0/460335117 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dc0c946070 0x55dc0cd050a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4009900 tx=0x7fe2e402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c426446bc8162343 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:07.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.209+0000 7fe2d2ffd640 1 -- 172.21.15.46:0/460335117 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4062070 con 0x55dc0c946070 2024-09-21T03:57:07.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.209+0000 7fe2d2ffd640 1 -- 172.21.15.46:0/460335117 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2e404f070 con 0x55dc0c946070 2024-09-21T03:57:07.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.209+0000 7fe2d2ffd640 1 -- 172.21.15.46:0/460335117 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4035030 con 0x55dc0c946070 2024-09-21T03:57:07.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.209+0000 7fe2f98cb740 1 -- 172.21.15.46:0/460335117 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dc0c946070 msgr2=0x55dc0cd050a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:07.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.209+0000 7fe2f98cb740 1 --2- 172.21.15.46:0/460335117 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dc0c946070 0x55dc0cd050a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4009900 tx=0x7fe2e402a410 comp rx=0 tx=0).stop 2024-09-21T03:57:07.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.209+0000 7fe2f98cb740 1 -- 172.21.15.46:0/460335117 shutdown_connections 2024-09-21T03:57:07.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.209+0000 7fe2f98cb740 1 --2- 172.21.15.46:0/460335117 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dc0c946070 0x55dc0cd050a0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:07.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.209+0000 7fe2f98cb740 1 --2- 172.21.15.46:0/460335117 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dc0c925390 0x55dc0cceed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:07.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.209+0000 7fe2f98cb740 1 --2- 172.21.15.46:0/460335117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc0c91d1b0 0x55dc0ccfac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:07.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.209+0000 7fe2f98cb740 1 -- 172.21.15.46:0/460335117 >> 172.21.15.46:0/460335117 conn(0x55dc0c93a460 msgr2=0x55dc0ccee680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:07.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.210+0000 7fe2f98cb740 1 -- 172.21.15.46:0/460335117 shutdown_connections 2024-09-21T03:57:07.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.210+0000 7fe2f98cb740 1 -- 172.21.15.46:0/460335117 wait complete. 2024-09-21T03:57:07.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.210+0000 7fe2f98cb740 1 -- start start 2024-09-21T03:57:07.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.210+0000 7fe2f98cb740 1 Processor -- start 2024-09-21T03:57:07.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.211+0000 7fe2f98cb740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dc0c91d1b0 0x55dc0cd01b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:07.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.211+0000 7fe2f98cb740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dc0c925390 0x55dc0ccfd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:07.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.211+0000 7fe2f98cb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc0c946070 0x55dc0ccfd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:07.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.211+0000 7fe2f98cb740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ec1b03d0 con 0x55dc0c91d1b0 2024-09-21T03:57:07.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.211+0000 7fe2f98cb740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ec1b1840 con 0x55dc0c925390 2024-09-21T03:57:07.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.211+0000 7fe2f98cb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ec1b0aa0 con 0x55dc0c946070 2024-09-21T03:57:07.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.211+0000 7fe2f98cb740 10 client.0 _ll_register_callbacks cb 0x7fe2e4009520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:57:07.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.211+0000 7fe2f10f3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dc0c91d1b0 0x55dc0cd01b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:07.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.211+0000 7fe2f10f3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dc0c91d1b0 0x55dc0cd01b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51844/0 (socket says 172.21.15.46:51844) 2024-09-21T03:57:07.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.211+0000 7fe2f10f3640 1 -- 172.21.15.46:0/2944832038 learned_addr learned my addr 172.21.15.46:0/2944832038 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:07.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.211+0000 7fe2f08f2640 1 --2- 172.21.15.46:0/2944832038 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dc0c925390 0x55dc0ccfd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:07.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.211+0000 7fe2f18f4640 1 --2- 172.21.15.46:0/2944832038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc0c946070 0x55dc0ccfd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:07.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.211+0000 7fe2f10f3640 1 -- 172.21.15.46:0/2944832038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc0c946070 msgr2=0x55dc0ccfd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:07.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.211+0000 7fe2f10f3640 1 --2- 172.21.15.46:0/2944832038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc0c946070 0x55dc0ccfd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:07.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.211+0000 7fe2f10f3640 1 -- 172.21.15.46:0/2944832038 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dc0c925390 msgr2=0x55dc0ccfd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:07.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.211+0000 7fe2f10f3640 1 --2- 172.21.15.46:0/2944832038 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dc0c925390 0x55dc0ccfd030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:07.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.211+0000 7fe2f10f3640 1 -- 172.21.15.46:0/2944832038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc0cd74ae0 con 0x55dc0c91d1b0 2024-09-21T03:57:07.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.211+0000 7fe2f08f2640 1 --2- 172.21.15.46:0/2944832038 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dc0c925390 0x55dc0ccfd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:57:07.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.211+0000 7fe2f10f3640 1 --2- 172.21.15.46:0/2944832038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dc0c91d1b0 0x55dc0cd01b20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc010480 tx=0x7fe2dc0e8100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e2a44beb992cce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:07.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.211+0000 7fe2d0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:57:07.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.211+0000 7fe2d0ff9640 1 -- 172.21.15.46:0/2944832038 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc0ad5d0 con 0x55dc0c91d1b0 2024-09-21T03:57:07.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.211+0000 7fe2d0ff9640 1 -- 172.21.15.46:0/2944832038 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fe2dc0a9ef0 con 0x55dc0c91d1b0 2024-09-21T03:57:07.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.212+0000 7fe2f98cb740 1 -- 172.21.15.46:0/2944832038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2e404f070 con 0x55dc0c91d1b0 2024-09-21T03:57:07.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.212+0000 7fe2d0ff9640 1 -- 172.21.15.46:0/2944832038 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe2dc0ae380 con 0x55dc0c91d1b0 2024-09-21T03:57:07.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.212+0000 7fe2f98cb740 10 client.15771 fetch_fsmap learned FSMap version 20 2024-09-21T03:57:07.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.212+0000 7fe2f98cb740 1 -- 172.21.15.46:0/2944832038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55dc0cd75bd0 con 0x55dc0c91d1b0 2024-09-21T03:57:07.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.212+0000 7fe2d0ff9640 1 -- 172.21.15.46:0/2944832038 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2e404f070 con 0x55dc0c91d1b0 2024-09-21T03:57:07.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.212+0000 7fe2d0ff9640 1 -- 172.21.15.46:0/2944832038 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fe2dc00f040 con 0x55dc0c91d1b0 2024-09-21T03:57:07.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.212+0000 7fe2f98cb740 10 client.15771 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:57:07.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.212+0000 7fe2f98cb740 10 client.15771 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:57:07.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.212+0000 7fe2f98cb740 20 client.15771 populate_metadata read hostname 'smithi046' 2024-09-21T03:57:07.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.212+0000 7fe2f98cb740 1 --2- 172.21.15.46:0/2944832038 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55dc0c8d9da0 0x55dc0cd77f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:07.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.212+0000 7fe2f98cb740 4 client.15771 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:57:07.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.212+0000 7fe2f98cb740 1 -- 172.21.15.46:0/2944832038 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dc0cc5ecd0 con 0x55dc0c8d9da0 2024-09-21T03:57:07.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.213+0000 7fe2f08f2640 1 --2- 172.21.15.46:0/2944832038 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55dc0c8d9da0 0x55dc0cd77f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:07.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.213+0000 7fe2d0ff9640 10 client.15771 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:57:07.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.213+0000 7fe2f08f2640 1 --2- 172.21.15.46:0/2944832038 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55dc0c8d9da0 0x55dc0cd77f10 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd45805586c64cac server_cookie=47f7f91532250f7d in_seq=0 out_seq=0 2024-09-21T03:57:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.213+0000 7fe2d0ff9640 1 -- 172.21.15.46:0/2944832038 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dc0cc5ecd0 con 0x55dc0c8d9da0 2024-09-21T03:57:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.213+0000 7fe2d0ff9640 10 client.15771 handle_command_reply: tid=0 2024-09-21T03:57:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.213+0000 7fe2f98cb740 1 client.15771 shutdown 2024-09-21T03:57:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.213+0000 7fe2f98cb740 1 -- 172.21.15.46:0/2944832038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dc0c91d1b0 msgr2=0x55dc0cd01b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.213+0000 7fe2f98cb740 1 --2- 172.21.15.46:0/2944832038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dc0c91d1b0 0x55dc0cd01b20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc010480 tx=0x7fe2dc0e8100 comp rx=0 tx=0).stop 2024-09-21T03:57:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.213+0000 7fe2f98cb740 1 -- 172.21.15.46:0/2944832038 shutdown_connections 2024-09-21T03:57:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.213+0000 7fe2f98cb740 1 --2- 172.21.15.46:0/2944832038 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55dc0c8d9da0 0x55dc0cd77f10 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.213+0000 7fe2f98cb740 1 --2- 172.21.15.46:0/2944832038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc0c946070 0x55dc0ccfd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.213+0000 7fe2f98cb740 1 --2- 172.21.15.46:0/2944832038 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dc0c925390 0x55dc0ccfd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.213+0000 7fe2f98cb740 1 --2- 172.21.15.46:0/2944832038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dc0c91d1b0 0x55dc0cd01b20 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.214+0000 7fe2f98cb740 1 -- 172.21.15.46:0/2944832038 >> 172.21.15.46:0/2944832038 conn(0x55dc0c93a460 msgr2=0x55dc0ccfa9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.214+0000 7fe2d0ff9640 0 client.15771 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:57:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.214+0000 7fe2f98cb740 1 -- 172.21.15.46:0/2944832038 shutdown_connections 2024-09-21T03:57:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.214+0000 7fe2f98cb740 1 -- 172.21.15.46:0/2944832038 wait complete. 2024-09-21T03:57:07.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.214+0000 7fe2f98cb740 20 client.15771 trim_cache size 0 max 16384 2024-09-21T03:57:07.221 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-21T03:57:07.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.214+0000 7fe2f3357640 1 -- 172.21.15.46:0/2441568679 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe2d40b6680 msgr2=0x7fe2d40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:07.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.214+0000 7fe2f3357640 1 --2- 172.21.15.46:0/2441568679 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe2d40b6680 0x7fe2d40b8b90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4005f70 tx=0x7fe2e4032b20 comp rx=0 tx=0).stop 2024-09-21T03:57:07.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.214+0000 7fe2f3357640 1 -- 172.21.15.46:0/2441568679 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2ec101ff0 msgr2=0x7fe2ec102f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:07.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.214+0000 7fe2f3357640 1 --2- 172.21.15.46:0/2441568679 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2ec101ff0 0x7fe2ec102f90 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc00eab0 tx=0x7fe2dc00ef70 comp rx=0 tx=0).stop 2024-09-21T03:57:07.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.214+0000 7fe2f3357640 1 -- 172.21.15.46:0/2441568679 shutdown_connections 2024-09-21T03:57:07.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.214+0000 7fe2f3357640 1 --2- 172.21.15.46:0/2441568679 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe2d40b6680 0x7fe2d40b8b90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:07.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.214+0000 7fe2f3357640 1 --2- 172.21.15.46:0/2441568679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2ec106c20 0x7fe2ec103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:07.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.214+0000 7fe2f3357640 1 --2- 172.21.15.46:0/2441568679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2ec1062d0 0x7fe2ec1034d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:07.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.214+0000 7fe2f3357640 1 --2- 172.21.15.46:0/2441568679 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2ec101ff0 0x7fe2ec102f90 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:07.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.214+0000 7fe2f3357640 1 -- 172.21.15.46:0/2441568679 >> 172.21.15.46:0/2441568679 conn(0x7fe2ec077cc0 msgr2=0x7fe2ec107440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:07.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.215+0000 7fe2f3357640 1 -- 172.21.15.46:0/2441568679 shutdown_connections 2024-09-21T03:57:07.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:07.215+0000 7fe2f3357640 1 -- 172.21.15.46:0/2441568679 wait complete. 2024-09-21T03:57:07.927 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:07 smithi046 ceph-mon[30954]: pgmap v382: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T03:57:08.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:07 smithi105 ceph-mon[34773]: pgmap v382: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T03:57:08.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:07 smithi162 ceph-mon[35071]: pgmap v382: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T03:57:08.957 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:57:08.958 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:57:09.233 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:57:09.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.700+0000 7f131fd00640 1 -- 172.21.15.46:0/2946483270 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1318109e40 msgr2=0x7f1318110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:09.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.700+0000 7f131fd00640 1 --2- 172.21.15.46:0/2946483270 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1318109e40 0x7f1318110670 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f1310009900 tx=0x7f131002a410 comp rx=0 tx=0).stop 2024-09-21T03:57:09.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.700+0000 7f131fd00640 1 -- 172.21.15.46:0/2946483270 shutdown_connections 2024-09-21T03:57:09.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.700+0000 7f131fd00640 1 --2- 172.21.15.46:0/2946483270 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1318109e40 0x7f1318110670 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:09.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.700+0000 7f131fd00640 1 --2- 172.21.15.46:0/2946483270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13181094f0 0x7f1318109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:09.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.700+0000 7f131fd00640 1 --2- 172.21.15.46:0/2946483270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1318103bb0 0x7f1318103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:09.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.700+0000 7f131fd00640 1 -- 172.21.15.46:0/2946483270 >> 172.21.15.46:0/2946483270 conn(0x7f13180ff600 msgr2=0x7f1318101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:09.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.700+0000 7f131fd00640 1 -- 172.21.15.46:0/2946483270 shutdown_connections 2024-09-21T03:57:09.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.700+0000 7f131fd00640 1 -- 172.21.15.46:0/2946483270 wait complete. 2024-09-21T03:57:09.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.701+0000 7f131fd00640 1 Processor -- start 2024-09-21T03:57:09.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.701+0000 7f131fd00640 1 -- start start 2024-09-21T03:57:09.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.701+0000 7f131fd00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1318103bb0 0x7f131819a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:09.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.701+0000 7f131fd00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13181094f0 0x7f131819aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:09.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.701+0000 7f131fd00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1318109e40 0x7f131819fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:09.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.701+0000 7f131fd00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1318113b40 con 0x7f13181094f0 2024-09-21T03:57:09.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.701+0000 7f131fd00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f13181139c0 con 0x7f1318103bb0 2024-09-21T03:57:09.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.701+0000 7f131fd00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1318113cc0 con 0x7f1318109e40 2024-09-21T03:57:09.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.701+0000 7f131d29b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13181094f0 0x7f131819aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:09.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.701+0000 7f131d29b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13181094f0 0x7f131819aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51858/0 (socket says 172.21.15.46:51858) 2024-09-21T03:57:09.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.701+0000 7f131d29b640 1 -- 172.21.15.46:0/2703610062 learned_addr learned my addr 172.21.15.46:0/2703610062 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:09.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.702+0000 7f131da9c640 1 --2- 172.21.15.46:0/2703610062 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1318103bb0 0x7f131819a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:09.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.702+0000 7f131e29d640 1 --2- 172.21.15.46:0/2703610062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1318109e40 0x7f131819fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:09.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.702+0000 7f131d29b640 1 -- 172.21.15.46:0/2703610062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1318109e40 msgr2=0x7f131819fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:09.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.702+0000 7f131d29b640 1 --2- 172.21.15.46:0/2703610062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1318109e40 0x7f131819fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:09.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.702+0000 7f131d29b640 1 -- 172.21.15.46:0/2703610062 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1318103bb0 msgr2=0x7f131819a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:09.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.702+0000 7f131d29b640 1 --2- 172.21.15.46:0/2703610062 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1318103bb0 0x7f131819a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:09.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.702+0000 7f131d29b640 1 -- 172.21.15.46:0/2703610062 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13181a0360 con 0x7f13181094f0 2024-09-21T03:57:09.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.702+0000 7f131da9c640 1 --2- 172.21.15.46:0/2703610062 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1318103bb0 0x7f131819a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:57:09.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.702+0000 7f131d29b640 1 --2- 172.21.15.46:0/2703610062 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13181094f0 0x7f131819aa50 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f130c006fd0 tx=0x7f130c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:09.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.702+0000 7f1316ffd640 1 -- 172.21.15.46:0/2703610062 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f130c011830 con 0x7f13181094f0 2024-09-21T03:57:09.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.702+0000 7f131fd00640 1 -- 172.21.15.46:0/2703610062 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13181a0650 con 0x7f13181094f0 2024-09-21T03:57:09.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.702+0000 7f1316ffd640 1 -- 172.21.15.46:0/2703610062 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f130c016070 con 0x7f13181094f0 2024-09-21T03:57:09.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.702+0000 7f1316ffd640 1 -- 172.21.15.46:0/2703610062 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f130c010e00 con 0x7f13181094f0 2024-09-21T03:57:09.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.702+0000 7f131fd00640 1 -- 172.21.15.46:0/2703610062 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13181a6e70 con 0x7f13181094f0 2024-09-21T03:57:09.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.705+0000 7f1326274740 1 Processor -- start 2024-09-21T03:57:09.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.705+0000 7f1326274740 1 -- start start 2024-09-21T03:57:09.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.705+0000 7f1326274740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9fdcee350 0x55b9fe095430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:09.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.705+0000 7f1326274740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b9fdcc5490 0x55b9fe095970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:09.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.705+0000 7f1326274740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9fdccd670 0x55b9fe095eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:09.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.705+0000 7f1326274740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55b9fe00be60 con 0x55b9fdcc5490 2024-09-21T03:57:09.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.705+0000 7f1326274740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55b9fdffb290 con 0x55b9fdccd670 2024-09-21T03:57:09.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.705+0000 7f1326274740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b9fdfff0a0 con 0x55b9fdcee350 2024-09-21T03:57:09.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.705+0000 7f131da9c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b9fdcc5490 0x55b9fe095970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:09.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.705+0000 7f1316ffd640 1 -- 172.21.15.46:0/2703610062 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f130c01b460 con 0x7f13181094f0 2024-09-21T03:57:09.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.705+0000 7f131da9c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b9fdcc5490 0x55b9fe095970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51864/0 (socket says 172.21.15.46:51864) 2024-09-21T03:57:09.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.705+0000 7f131da9c640 1 -- 172.21.15.46:0/3038647829 learned_addr learned my addr 172.21.15.46:0/3038647829 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:09.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.705+0000 7f131e29d640 1 --2- 172.21.15.46:0/3038647829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9fdcee350 0x55b9fe095430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:09.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.706+0000 7f131d29b640 1 --2- 172.21.15.46:0/3038647829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9fdccd670 0x55b9fe095eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:09.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.706+0000 7f131da9c640 1 -- 172.21.15.46:0/3038647829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9fdcee350 msgr2=0x55b9fe095430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:09.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.706+0000 7f131da9c640 1 --2- 172.21.15.46:0/3038647829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9fdcee350 0x55b9fe095430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:09.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.706+0000 7f131da9c640 1 -- 172.21.15.46:0/3038647829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9fdccd670 msgr2=0x55b9fe095eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:09.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.706+0000 7f131da9c640 1 --2- 172.21.15.46:0/3038647829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9fdccd670 0x55b9fe095eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:09.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.706+0000 7f131da9c640 1 -- 172.21.15.46:0/3038647829 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9fdd59930 con 0x55b9fdcc5490 2024-09-21T03:57:09.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.706+0000 7f131d29b640 1 --2- 172.21.15.46:0/3038647829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9fdccd670 0x55b9fe095eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:57:09.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.706+0000 7f131da9c640 1 --2- 172.21.15.46:0/3038647829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b9fdcc5490 0x55b9fe095970 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1308008f10 tx=0x7f130800d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9c8d8e1fb2f3e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:09.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.706+0000 7f12fffff640 1 -- 172.21.15.46:0/3038647829 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f130800f830 con 0x55b9fdcc5490 2024-09-21T03:57:09.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.706+0000 7f12fffff640 1 -- 172.21.15.46:0/3038647829 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1308018480 con 0x55b9fdcc5490 2024-09-21T03:57:09.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.706+0000 7f12fffff640 1 -- 172.21.15.46:0/3038647829 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f130800e5d0 con 0x55b9fdcc5490 2024-09-21T03:57:09.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.706+0000 7f1316ffd640 1 --2- 172.21.15.46:0/2703610062 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f13000b66b0 0x7f13000b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:09.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.706+0000 7f131e29d640 1 --2- 172.21.15.46:0/2703610062 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f13000b66b0 0x7f13000b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:09.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.707+0000 7f1316ffd640 1 -- 172.21.15.46:0/2703610062 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f130c0e6c50 con 0x7f13181094f0 2024-09-21T03:57:09.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.707+0000 7f1326274740 1 -- 172.21.15.46:0/3038647829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b9fdcc5490 msgr2=0x55b9fe095970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:09.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.707+0000 7f1326274740 1 --2- 172.21.15.46:0/3038647829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b9fdcc5490 0x55b9fe095970 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1308008f10 tx=0x7f130800d710 comp rx=0 tx=0).stop 2024-09-21T03:57:09.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.707+0000 7f131e29d640 1 --2- 172.21.15.46:0/2703610062 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f13000b66b0 0x7f13000b8bc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1310005f70 tx=0x7f1310005e60 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:09.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.707+0000 7f1326274740 1 -- 172.21.15.46:0/3038647829 shutdown_connections 2024-09-21T03:57:09.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.707+0000 7f1326274740 1 --2- 172.21.15.46:0/3038647829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9fdccd670 0x55b9fe095eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:09.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.707+0000 7f1326274740 1 --2- 172.21.15.46:0/3038647829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b9fdcc5490 0x55b9fe095970 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:09.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.707+0000 7f1326274740 1 --2- 172.21.15.46:0/3038647829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9fdcee350 0x55b9fe095430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:09.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.707+0000 7f1326274740 1 -- 172.21.15.46:0/3038647829 >> 172.21.15.46:0/3038647829 conn(0x55b9fdce2740 msgr2=0x55b9fe093320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:09.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.707+0000 7f1326274740 1 -- 172.21.15.46:0/3038647829 shutdown_connections 2024-09-21T03:57:09.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.707+0000 7f1326274740 1 -- 172.21.15.46:0/3038647829 wait complete. 2024-09-21T03:57:09.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.708+0000 7f1326274740 1 -- start start 2024-09-21T03:57:09.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.708+0000 7f1326274740 1 Processor -- start 2024-09-21T03:57:09.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.708+0000 7f1326274740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b9fdcc5490 0x55b9fe0a0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:09.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.708+0000 7f1326274740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9fdccd670 0x55b9fe0a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:09.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.708+0000 7f1326274740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9fdcee350 0x55b9fe0acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:09.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.708+0000 7f1326274740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55b9fde5c890 con 0x55b9fdcc5490 2024-09-21T03:57:09.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.708+0000 7f1326274740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55b9fdf95d40 con 0x55b9fdccd670 2024-09-21T03:57:09.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.708+0000 7f1326274740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b9fe0a3c10 con 0x55b9fdcee350 2024-09-21T03:57:09.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.708+0000 7f1326274740 10 client.0 _ll_register_callbacks cb 0x55b9fdff9c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:57:09.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.708+0000 7f131da9c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b9fdcc5490 0x55b9fe0a0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:09.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.708+0000 7f131da9c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b9fdcc5490 0x55b9fe0a0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51880/0 (socket says 172.21.15.46:51880) 2024-09-21T03:57:09.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.708+0000 7f131da9c640 1 -- 172.21.15.46:0/1292714861 learned_addr learned my addr 172.21.15.46:0/1292714861 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:09.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.709+0000 7f131d29b640 1 --2- 172.21.15.46:0/1292714861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9fdccd670 0x55b9fe0a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:09.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.709+0000 7f131e29d640 1 --2- 172.21.15.46:0/1292714861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9fdcee350 0x55b9fe0acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:09.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.709+0000 7f131da9c640 1 -- 172.21.15.46:0/1292714861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9fdcee350 msgr2=0x55b9fe0acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:09.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.709+0000 7f131da9c640 1 --2- 172.21.15.46:0/1292714861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9fdcee350 0x55b9fe0acf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:09.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.709+0000 7f131da9c640 1 -- 172.21.15.46:0/1292714861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9fdccd670 msgr2=0x55b9fe0a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:09.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.709+0000 7f131da9c640 1 --2- 172.21.15.46:0/1292714861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9fdccd670 0x55b9fe0a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:09.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.709+0000 7f131da9c640 1 -- 172.21.15.46:0/1292714861 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9fe0ad4a0 con 0x55b9fdcc5490 2024-09-21T03:57:09.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.709+0000 7f131da9c640 1 --2- 172.21.15.46:0/1292714861 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b9fdcc5490 0x55b9fe0a0fe0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1308000f80 tx=0x7f13080085f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db7706cf590b3d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:09.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.709+0000 7f12fd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:57:09.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.709+0000 7f12fd7fa640 1 -- 172.21.15.46:0/1292714861 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1308027060 con 0x55b9fdcc5490 2024-09-21T03:57:09.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.709+0000 7f12fd7fa640 1 -- 172.21.15.46:0/1292714861 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f1308004cc0 con 0x55b9fdcc5490 2024-09-21T03:57:09.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.709+0000 7f1326274740 1 -- 172.21.15.46:0/1292714861 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1308018480 con 0x55b9fdcc5490 2024-09-21T03:57:09.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.709+0000 7f12fd7fa640 1 -- 172.21.15.46:0/1292714861 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f130800f630 con 0x55b9fdcc5490 2024-09-21T03:57:09.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.709+0000 7f1326274740 10 client.15783 fetch_fsmap learned FSMap version 20 2024-09-21T03:57:09.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.709+0000 7f1326274740 1 -- 172.21.15.46:0/1292714861 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55b9fe0afd40 con 0x55b9fdcc5490 2024-09-21T03:57:09.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.710+0000 7f12fd7fa640 1 -- 172.21.15.46:0/1292714861 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1308018480 con 0x55b9fdcc5490 2024-09-21T03:57:09.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.710+0000 7f12fd7fa640 1 -- 172.21.15.46:0/1292714861 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f1308005410 con 0x55b9fdcc5490 2024-09-21T03:57:09.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.710+0000 7f1326274740 10 client.15783 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:57:09.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.710+0000 7f1326274740 10 client.15783 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:57:09.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.710+0000 7f1326274740 20 client.15783 populate_metadata read hostname 'smithi046' 2024-09-21T03:57:09.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.710+0000 7f1326274740 1 --2- 172.21.15.46:0/1292714861 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55b9fdcaccd0 0x55b9fe0b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:09.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.710+0000 7f1326274740 4 client.15783 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:57:09.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.710+0000 7f1326274740 1 -- 172.21.15.46:0/1292714861 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9fe00ddb0 con 0x55b9fdcaccd0 2024-09-21T03:57:09.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.710+0000 7f131d29b640 1 --2- 172.21.15.46:0/1292714861 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55b9fdcaccd0 0x55b9fe0b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:09.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.711+0000 7f131d29b640 1 --2- 172.21.15.46:0/1292714861 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55b9fdcaccd0 0x55b9fe0b30f0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c67a325fe7362d6 server_cookie=825fd901bbc2d035 in_seq=0 out_seq=0 2024-09-21T03:57:09.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.711+0000 7f12fd7fa640 10 client.15783 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:57:09.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.711+0000 7f12fd7fa640 1 -- 172.21.15.46:0/1292714861 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b9fe00ddb0 con 0x55b9fdcaccd0 2024-09-21T03:57:09.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.711+0000 7f12fd7fa640 10 client.15783 handle_command_reply: tid=0 2024-09-21T03:57:09.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.711+0000 7f1326274740 1 client.15783 shutdown 2024-09-21T03:57:09.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.712+0000 7f1326274740 1 -- 172.21.15.46:0/1292714861 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b9fdcc5490 msgr2=0x55b9fe0a0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:09.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.712+0000 7f1326274740 1 --2- 172.21.15.46:0/1292714861 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b9fdcc5490 0x55b9fe0a0fe0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1308000f80 tx=0x7f13080085f0 comp rx=0 tx=0).stop 2024-09-21T03:57:09.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.712+0000 7f1326274740 1 -- 172.21.15.46:0/1292714861 shutdown_connections 2024-09-21T03:57:09.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.712+0000 7f1326274740 1 --2- 172.21.15.46:0/1292714861 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55b9fdcaccd0 0x55b9fe0b30f0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:09.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.712+0000 7f1326274740 1 --2- 172.21.15.46:0/1292714861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9fdcee350 0x55b9fe0acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:09.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.712+0000 7f1326274740 1 --2- 172.21.15.46:0/1292714861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9fdccd670 0x55b9fe0a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:09.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.712+0000 7f12fd7fa640 0 client.15783 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:57:09.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.712+0000 7f1326274740 1 --2- 172.21.15.46:0/1292714861 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b9fdcc5490 0x55b9fe0a0fe0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:09.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.712+0000 7f1326274740 1 -- 172.21.15.46:0/1292714861 >> 172.21.15.46:0/1292714861 conn(0x55b9fdce2740 msgr2=0x55b9fe0985c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:09.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.712+0000 7f1326274740 1 -- 172.21.15.46:0/1292714861 shutdown_connections 2024-09-21T03:57:09.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.712+0000 7f1326274740 1 -- 172.21.15.46:0/1292714861 wait complete. 2024-09-21T03:57:09.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.712+0000 7f1326274740 20 client.15783 trim_cache size 0 max 16384 2024-09-21T03:57:09.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.730+0000 7f1326274740 1 Processor -- start 2024-09-21T03:57:09.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.730+0000 7f1326274740 1 -- start start 2024-09-21T03:57:09.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.730+0000 7f1326274740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9fdcaccd0 0x55b9fe09c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:09.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.730+0000 7f1326274740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9fdcc5490 0x55b9fe0acea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:09.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.730+0000 7f1326274740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b9fdccd670 0x55b9fe096e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:09.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.730+0000 7f1326274740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f13181ad5d0 con 0x55b9fdccd670 2024-09-21T03:57:09.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.730+0000 7f1326274740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f13181afe50 con 0x55b9fdcc5490 2024-09-21T03:57:09.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.730+0000 7f1326274740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f13181adc40 con 0x55b9fdcaccd0 2024-09-21T03:57:09.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.731+0000 7f131e29d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b9fdccd670 0x55b9fe096e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:09.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.731+0000 7f131e29d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b9fdccd670 0x55b9fe096e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51894/0 (socket says 172.21.15.46:51894) 2024-09-21T03:57:09.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.731+0000 7f131e29d640 1 -- 172.21.15.46:0/2637625500 learned_addr learned my addr 172.21.15.46:0/2637625500 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:09.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.731+0000 7f131d29b640 1 --2- 172.21.15.46:0/2637625500 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9fdcc5490 0x55b9fe0acea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:09.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.731+0000 7f131da9c640 1 --2- 172.21.15.46:0/2637625500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9fdcaccd0 0x55b9fe09c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:09.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.731+0000 7f131e29d640 1 -- 172.21.15.46:0/2637625500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9fdcaccd0 msgr2=0x55b9fe09c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:09.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.731+0000 7f131e29d640 1 --2- 172.21.15.46:0/2637625500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9fdcaccd0 0x55b9fe09c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:09.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.731+0000 7f131e29d640 1 -- 172.21.15.46:0/2637625500 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9fdcc5490 msgr2=0x55b9fe0acea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:09.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.731+0000 7f131e29d640 1 --2- 172.21.15.46:0/2637625500 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9fdcc5490 0x55b9fe0acea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:09.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.731+0000 7f131e29d640 1 -- 172.21.15.46:0/2637625500 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9fe097c70 con 0x55b9fdccd670 2024-09-21T03:57:09.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.731+0000 7f131e29d640 1 --2- 172.21.15.46:0/2637625500 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b9fdccd670 0x55b9fe096e20 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1310033000 tx=0x7f131003c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8d4a6995ebc135d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:09.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.731+0000 7f12ff7fe640 1 -- 172.21.15.46:0/2637625500 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1310035050 con 0x55b9fdccd670 2024-09-21T03:57:09.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.731+0000 7f12ff7fe640 1 -- 172.21.15.46:0/2637625500 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f131004d070 con 0x55b9fdccd670 2024-09-21T03:57:09.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.731+0000 7f12ff7fe640 1 -- 172.21.15.46:0/2637625500 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1310004920 con 0x55b9fdccd670 2024-09-21T03:57:09.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.732+0000 7f1326274740 1 -- 172.21.15.46:0/2637625500 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b9fdccd670 msgr2=0x55b9fe096e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:09.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.732+0000 7f1326274740 1 --2- 172.21.15.46:0/2637625500 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b9fdccd670 0x55b9fe096e20 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1310033000 tx=0x7f131003c000 comp rx=0 tx=0).stop 2024-09-21T03:57:09.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.732+0000 7f1326274740 1 -- 172.21.15.46:0/2637625500 shutdown_connections 2024-09-21T03:57:09.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.732+0000 7f1326274740 1 --2- 172.21.15.46:0/2637625500 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b9fdccd670 0x55b9fe096e20 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:09.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.732+0000 7f1326274740 1 --2- 172.21.15.46:0/2637625500 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9fdcc5490 0x55b9fe0acea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:09.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.732+0000 7f1326274740 1 --2- 172.21.15.46:0/2637625500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9fdcaccd0 0x55b9fe09c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:09.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.732+0000 7f1326274740 1 -- 172.21.15.46:0/2637625500 >> 172.21.15.46:0/2637625500 conn(0x55b9fdce2740 msgr2=0x55b9fe0a20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:09.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.732+0000 7f1326274740 1 -- 172.21.15.46:0/2637625500 shutdown_connections 2024-09-21T03:57:09.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.732+0000 7f1326274740 1 -- 172.21.15.46:0/2637625500 wait complete. 2024-09-21T03:57:09.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.733+0000 7f1326274740 1 -- start start 2024-09-21T03:57:09.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.733+0000 7f1326274740 1 Processor -- start 2024-09-21T03:57:09.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.733+0000 7f1326274740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9fdcaccd0 0x55b9fe0b4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:09.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.733+0000 7f1326274740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9fdcc5490 0x55b9fe0b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:09.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.733+0000 7f1326274740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b9fdccd670 0x55b9fe11c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:09.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.733+0000 7f1326274740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f13181ae310 con 0x55b9fdccd670 2024-09-21T03:57:09.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.733+0000 7f1326274740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f13181af780 con 0x55b9fdcc5490 2024-09-21T03:57:09.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.733+0000 7f1326274740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f13181ae9e0 con 0x55b9fdcaccd0 2024-09-21T03:57:09.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.733+0000 7f1326274740 10 client.0 _ll_register_callbacks cb 0x7f1308008d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:57:09.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.734+0000 7f131d29b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9fdcc5490 0x55b9fe0b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:09.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.734+0000 7f131e29d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b9fdccd670 0x55b9fe11c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:09.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.734+0000 7f131d29b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9fdcc5490 0x55b9fe0b49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.46:43558/0 (socket says 172.21.15.46:43558) 2024-09-21T03:57:09.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.734+0000 7f131e29d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b9fdccd670 0x55b9fe11c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51896/0 (socket says 172.21.15.46:51896) 2024-09-21T03:57:09.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.734+0000 7f131d29b640 1 -- 172.21.15.46:0/3104567867 learned_addr learned my addr 172.21.15.46:0/3104567867 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:09.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.734+0000 7f131da9c640 1 --2- 172.21.15.46:0/3104567867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9fdcaccd0 0x55b9fe0b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:09.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.734+0000 7f131e29d640 1 -- 172.21.15.46:0/3104567867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9fdcaccd0 msgr2=0x55b9fe0b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:09.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.734+0000 7f131e29d640 1 --2- 172.21.15.46:0/3104567867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9fdcaccd0 0x55b9fe0b4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:09.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.734+0000 7f131e29d640 1 -- 172.21.15.46:0/3104567867 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9fdcc5490 msgr2=0x55b9fe0b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:09.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.734+0000 7f131e29d640 1 --2- 172.21.15.46:0/3104567867 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9fdcc5490 0x55b9fe0b49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:09.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.734+0000 7f131e29d640 1 -- 172.21.15.46:0/3104567867 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9fe11cdb0 con 0x55b9fdccd670 2024-09-21T03:57:09.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.734+0000 7f131e29d640 1 --2- 172.21.15.46:0/3104567867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b9fdccd670 0x55b9fe11c870 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f1310009900 tx=0x7f1310005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b56a7bbbf1b7f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:09.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.734+0000 7f12fd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:57:09.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.734+0000 7f12fd7fa640 1 -- 172.21.15.46:0/3104567867 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1310035070 con 0x55b9fdccd670 2024-09-21T03:57:09.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.734+0000 7f12fd7fa640 1 -- 172.21.15.46:0/3104567867 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f13100048c0 con 0x55b9fdccd670 2024-09-21T03:57:09.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.734+0000 7f1326274740 1 -- 172.21.15.46:0/3104567867 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f131004d070 con 0x55b9fdccd670 2024-09-21T03:57:09.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.735+0000 7f12fd7fa640 1 -- 172.21.15.46:0/3104567867 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1310004ac0 con 0x55b9fdccd670 2024-09-21T03:57:09.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.735+0000 7f1326274740 10 client.15789 fetch_fsmap learned FSMap version 20 2024-09-21T03:57:09.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.735+0000 7f1326274740 1 -- 172.21.15.46:0/3104567867 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55b9fe11deb0 con 0x55b9fdccd670 2024-09-21T03:57:09.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.735+0000 7f12fd7fa640 1 -- 172.21.15.46:0/3104567867 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f131004d070 con 0x55b9fdccd670 2024-09-21T03:57:09.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.735+0000 7f12fd7fa640 1 -- 172.21.15.46:0/3104567867 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f1310065b60 con 0x55b9fdccd670 2024-09-21T03:57:09.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.735+0000 7f1326274740 10 client.15789 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:57:09.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.735+0000 7f1326274740 10 client.15789 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:57:09.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.735+0000 7f1326274740 20 client.15789 populate_metadata read hostname 'smithi046' 2024-09-21T03:57:09.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.735+0000 7f1326274740 1 --2- 172.21.15.46:0/3104567867 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55b9fdcee350 0x55b9fe1205e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:09.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.735+0000 7f1326274740 4 client.15789 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:57:09.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.735+0000 7f1326274740 1 -- 172.21.15.46:0/3104567867 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b9fe009860 con 0x55b9fdcee350 2024-09-21T03:57:09.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.735+0000 7f131da9c640 1 --2- 172.21.15.46:0/3104567867 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55b9fdcee350 0x55b9fe1205e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:09.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.736+0000 7f12fd7fa640 10 client.15789 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:57:09.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.736+0000 7f131da9c640 1 --2- 172.21.15.46:0/3104567867 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55b9fdcee350 0x55b9fe1205e0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9a97a22e4810958 server_cookie=dc395668ffce27bc in_seq=0 out_seq=0 2024-09-21T03:57:09.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.738+0000 7f12fd7fa640 1 -- 172.21.15.46:0/3104567867 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b9fe009860 con 0x55b9fdcee350 2024-09-21T03:57:09.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.738+0000 7f12fd7fa640 10 client.15789 handle_command_reply: tid=0 2024-09-21T03:57:09.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.738+0000 7f1326274740 1 client.15789 shutdown 2024-09-21T03:57:09.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.738+0000 7f1326274740 1 -- 172.21.15.46:0/3104567867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b9fdccd670 msgr2=0x55b9fe11c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:09.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.738+0000 7f1326274740 1 --2- 172.21.15.46:0/3104567867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b9fdccd670 0x55b9fe11c870 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f1310009900 tx=0x7f1310005520 comp rx=0 tx=0).stop 2024-09-21T03:57:09.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.738+0000 7f1326274740 1 -- 172.21.15.46:0/3104567867 shutdown_connections 2024-09-21T03:57:09.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.738+0000 7f1326274740 1 --2- 172.21.15.46:0/3104567867 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55b9fdcee350 0x55b9fe1205e0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:09.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.738+0000 7f1326274740 1 --2- 172.21.15.46:0/3104567867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b9fdccd670 0x55b9fe11c870 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:09.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.738+0000 7f1326274740 1 --2- 172.21.15.46:0/3104567867 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9fdcc5490 0x55b9fe0b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:09.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.738+0000 7f12fd7fa640 0 client.15789 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:57:09.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.738+0000 7f1326274740 1 --2- 172.21.15.46:0/3104567867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9fdcaccd0 0x55b9fe0b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:09.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.738+0000 7f1326274740 1 -- 172.21.15.46:0/3104567867 >> 172.21.15.46:0/3104567867 conn(0x55b9fdce2740 msgr2=0x55b9fe096bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:09.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.738+0000 7f1326274740 1 -- 172.21.15.46:0/3104567867 shutdown_connections 2024-09-21T03:57:09.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.738+0000 7f1326274740 1 -- 172.21.15.46:0/3104567867 wait complete. 2024-09-21T03:57:09.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.738+0000 7f1326274740 20 client.15789 trim_cache size 0 max 16384 2024-09-21T03:57:09.745 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T03:57:09.745 INFO:teuthology.orchestra.run.smithi046.stdout: "return_code": 0, 2024-09-21T03:57:09.745 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_tag": "e24ec8f1-0d13-478f-9c2c-b51798868ffc", 2024-09-21T03:57:09.745 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": "asynchronous" 2024-09-21T03:57:09.745 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T03:57:09.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.739+0000 7f131fd00640 1 -- 172.21.15.46:0/2703610062 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f13000b66b0 msgr2=0x7f13000b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:09.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.739+0000 7f131fd00640 1 --2- 172.21.15.46:0/2703610062 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f13000b66b0 0x7f13000b8bc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1310005f70 tx=0x7f1310005e60 comp rx=0 tx=0).stop 2024-09-21T03:57:09.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.739+0000 7f131fd00640 1 -- 172.21.15.46:0/2703610062 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13181094f0 msgr2=0x7f131819aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:09.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.739+0000 7f131fd00640 1 --2- 172.21.15.46:0/2703610062 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13181094f0 0x7f131819aa50 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f130c006fd0 tx=0x7f130c00b8e0 comp rx=0 tx=0).stop 2024-09-21T03:57:09.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.739+0000 7f131fd00640 1 -- 172.21.15.46:0/2703610062 shutdown_connections 2024-09-21T03:57:09.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.739+0000 7f131fd00640 1 --2- 172.21.15.46:0/2703610062 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f13000b66b0 0x7f13000b8bc0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:09.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.739+0000 7f131fd00640 1 --2- 172.21.15.46:0/2703610062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1318109e40 0x7f131819fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:09.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.739+0000 7f131fd00640 1 --2- 172.21.15.46:0/2703610062 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13181094f0 0x7f131819aa50 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:09.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.739+0000 7f131fd00640 1 --2- 172.21.15.46:0/2703610062 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1318103bb0 0x7f131819a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:09.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.739+0000 7f131fd00640 1 -- 172.21.15.46:0/2703610062 >> 172.21.15.46:0/2703610062 conn(0x7f13180ff600 msgr2=0x7f1318101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:09.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.739+0000 7f131fd00640 1 -- 172.21.15.46:0/2703610062 shutdown_connections 2024-09-21T03:57:09.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:09.739+0000 7f131fd00640 1 -- 172.21.15.46:0/2703610062 wait complete. 2024-09-21T03:57:10.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:09 smithi046 ceph-mon[30954]: pgmap v383: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T03:57:10.067 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:09 smithi105 ceph-mon[34773]: pgmap v383: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T03:57:10.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:09 smithi162 ceph-mon[35071]: pgmap v383: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T03:57:10.496 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:57:10.761 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:57:11.047 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:10 smithi046 ceph-mon[30954]: scrub queued for path: / 2024-09-21T03:57:11.047 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:10 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T03:57:11.047 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:10 smithi046 ceph-mon[30954]: scrub summary: active paths [/] 2024-09-21T03:57:11.047 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:10 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T03:57:11.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:10 smithi105 ceph-mon[34773]: scrub queued for path: / 2024-09-21T03:57:11.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:10 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T03:57:11.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:10 smithi105 ceph-mon[34773]: scrub summary: active paths [/] 2024-09-21T03:57:11.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:10 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T03:57:11.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:10 smithi162 ceph-mon[35071]: scrub queued for path: / 2024-09-21T03:57:11.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:10 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T03:57:11.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:10 smithi162 ceph-mon[35071]: scrub summary: active paths [/] 2024-09-21T03:57:11.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:10 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T03:57:11.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.292+0000 7fec30d28640 1 -- 172.21.15.46:0/787223645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec2c102ae0 msgr2=0x7fec2c102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:11.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.292+0000 7fec30d28640 1 --2- 172.21.15.46:0/787223645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec2c102ae0 0x7fec2c102ef0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fec1c009900 tx=0x7fec1c02a410 comp rx=0 tx=0).stop 2024-09-21T03:57:11.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.292+0000 7fec30d28640 1 -- 172.21.15.46:0/787223645 shutdown_connections 2024-09-21T03:57:11.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.292+0000 7fec30d28640 1 --2- 172.21.15.46:0/787223645 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec2c108d20 0x7fec2c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:11.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.292+0000 7fec30d28640 1 --2- 172.21.15.46:0/787223645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec2c1083d0 0x7fec2c1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:11.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.292+0000 7fec30d28640 1 --2- 172.21.15.46:0/787223645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec2c102ae0 0x7fec2c102ef0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:11.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.292+0000 7fec30d28640 1 -- 172.21.15.46:0/787223645 >> 172.21.15.46:0/787223645 conn(0x7fec2c079760 msgr2=0x7fec2c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:11.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.293+0000 7fec30d28640 1 -- 172.21.15.46:0/787223645 shutdown_connections 2024-09-21T03:57:11.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.293+0000 7fec30d28640 1 -- 172.21.15.46:0/787223645 wait complete. 2024-09-21T03:57:11.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.293+0000 7fec30d28640 1 Processor -- start 2024-09-21T03:57:11.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.293+0000 7fec30d28640 1 -- start start 2024-09-21T03:57:11.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.294+0000 7fec30d28640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec2c102ae0 0x7fec2c19a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:11.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.294+0000 7fec30d28640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec2c1083d0 0x7fec2c19aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:11.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.294+0000 7fec30d28640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec2c108d20 0x7fec2c19fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:11.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.294+0000 7fec30d28640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fec2c112990 con 0x7fec2c108d20 2024-09-21T03:57:11.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.294+0000 7fec30d28640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fec2c112810 con 0x7fec2c102ae0 2024-09-21T03:57:11.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.294+0000 7fec30d28640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fec2c112b10 con 0x7fec2c1083d0 2024-09-21T03:57:11.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.294+0000 7fec2ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec2c108d20 0x7fec2c19fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:11.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.294+0000 7fec2ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec2c108d20 0x7fec2c19fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51916/0 (socket says 172.21.15.46:51916) 2024-09-21T03:57:11.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.294+0000 7fec2ad9d640 1 -- 172.21.15.46:0/2500032038 learned_addr learned my addr 172.21.15.46:0/2500032038 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:11.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.294+0000 7fec2a59c640 1 --2- 172.21.15.46:0/2500032038 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec2c102ae0 0x7fec2c19a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:11.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.294+0000 7fec29d9b640 1 --2- 172.21.15.46:0/2500032038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec2c1083d0 0x7fec2c19aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:11.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.294+0000 7fec2ad9d640 1 -- 172.21.15.46:0/2500032038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec2c1083d0 msgr2=0x7fec2c19aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:11.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.294+0000 7fec2ad9d640 1 --2- 172.21.15.46:0/2500032038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec2c1083d0 0x7fec2c19aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:11.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.294+0000 7fec2ad9d640 1 -- 172.21.15.46:0/2500032038 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec2c102ae0 msgr2=0x7fec2c19a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:11.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.294+0000 7fec2ad9d640 1 --2- 172.21.15.46:0/2500032038 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec2c102ae0 0x7fec2c19a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:11.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.294+0000 7fec2ad9d640 1 -- 172.21.15.46:0/2500032038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec2c1a0400 con 0x7fec2c108d20 2024-09-21T03:57:11.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.294+0000 7fec29d9b640 1 --2- 172.21.15.46:0/2500032038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec2c1083d0 0x7fec2c19aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:57:11.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.294+0000 7fec2ad9d640 1 --2- 172.21.15.46:0/2500032038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec2c108d20 0x7fec2c19fcd0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fec24009fd0 tx=0x7fec2400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:11.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.295+0000 7fec1b7fe640 1 -- 172.21.15.46:0/2500032038 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec24017070 con 0x7fec2c108d20 2024-09-21T03:57:11.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.295+0000 7fec1b7fe640 1 -- 172.21.15.46:0/2500032038 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec24003e20 con 0x7fec2c108d20 2024-09-21T03:57:11.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.295+0000 7fec30d28640 1 -- 172.21.15.46:0/2500032038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec2c1a06f0 con 0x7fec2c108d20 2024-09-21T03:57:11.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.295+0000 7fec1b7fe640 1 -- 172.21.15.46:0/2500032038 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec24010460 con 0x7fec2c108d20 2024-09-21T03:57:11.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.295+0000 7fec30d28640 1 -- 172.21.15.46:0/2500032038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec2c1a6e50 con 0x7fec2c108d20 2024-09-21T03:57:11.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.297+0000 7fec3729c740 1 Processor -- start 2024-09-21T03:57:11.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.298+0000 7fec1b7fe640 1 -- 172.21.15.46:0/2500032038 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7fec24003970 con 0x7fec2c108d20 2024-09-21T03:57:11.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.298+0000 7fec3729c740 1 -- start start 2024-09-21T03:57:11.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.298+0000 7fec3729c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f9d1189070 0x55f9d1530650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:11.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.298+0000 7fec3729c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9d11601b0 0x55f9d1530b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:11.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.298+0000 7fec3729c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9d1168390 0x55f9d15310d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:11.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.298+0000 7fec3729c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55f9d14a6e50 con 0x55f9d1168390 2024-09-21T03:57:11.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.298+0000 7fec3729c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55f9d1496280 con 0x55f9d1189070 2024-09-21T03:57:11.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.298+0000 7fec3729c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f9d149a090 con 0x55f9d11601b0 2024-09-21T03:57:11.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.299+0000 7fec29d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9d1168390 0x55f9d15310d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:11.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.299+0000 7fec29d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9d1168390 0x55f9d15310d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51932/0 (socket says 172.21.15.46:51932) 2024-09-21T03:57:11.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.299+0000 7fec29d9b640 1 -- 172.21.15.46:0/2307735995 learned_addr learned my addr 172.21.15.46:0/2307735995 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:11.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.299+0000 7fec29d9b640 1 --2- 172.21.15.46:0/2307735995 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f9d1189070 0x55f9d1530650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:11.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.299+0000 7fec2a59c640 1 --2- 172.21.15.46:0/2307735995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9d11601b0 0x55f9d1530b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:11.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.299+0000 7fec29d9b640 1 -- 172.21.15.46:0/2307735995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9d11601b0 msgr2=0x55f9d1530b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:11.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.299+0000 7fec29d9b640 1 --2- 172.21.15.46:0/2307735995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9d11601b0 0x55f9d1530b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:11.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.299+0000 7fec29d9b640 1 -- 172.21.15.46:0/2307735995 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f9d1189070 msgr2=0x55f9d1530650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:11.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.299+0000 7fec29d9b640 1 --2- 172.21.15.46:0/2307735995 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f9d1189070 0x55f9d1530650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:11.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.299+0000 7fec1b7fe640 1 --2- 172.21.15.46:0/2500032038 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fec140b6680 0x7fec140b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:11.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.299+0000 7fec29d9b640 1 -- 172.21.15.46:0/2307735995 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9d11f4650 con 0x55f9d1168390 2024-09-21T03:57:11.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.299+0000 7fec29d9b640 1 --2- 172.21.15.46:0/2307735995 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9d1168390 0x55f9d15310d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fec20014a20 tx=0x7fec2000c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bd21045e90dda9b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:11.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.299+0000 7fec2ad9d640 1 --2- 172.21.15.46:0/2500032038 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fec140b6680 0x7fec140b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:11.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.299+0000 7fec1b7fe640 1 -- 172.21.15.46:0/2500032038 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fec240e73f0 con 0x7fec2c108d20 2024-09-21T03:57:11.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.300+0000 7fec18ff9640 1 -- 172.21.15.46:0/2307735995 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec200142d0 con 0x55f9d1168390 2024-09-21T03:57:11.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.300+0000 7fec18ff9640 1 -- 172.21.15.46:0/2307735995 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec200054d0 con 0x55f9d1168390 2024-09-21T03:57:11.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.300+0000 7fec18ff9640 1 -- 172.21.15.46:0/2307735995 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec2000f760 con 0x55f9d1168390 2024-09-21T03:57:11.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.301+0000 7fec3729c740 1 -- 172.21.15.46:0/2307735995 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9d1168390 msgr2=0x55f9d15310d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:11.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.301+0000 7fec3729c740 1 --2- 172.21.15.46:0/2307735995 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9d1168390 0x55f9d15310d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fec20014a20 tx=0x7fec2000c540 comp rx=0 tx=0).stop 2024-09-21T03:57:11.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.301+0000 7fec2ad9d640 1 --2- 172.21.15.46:0/2500032038 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fec140b6680 0x7fec140b8b90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fec240ad270 tx=0x7fec24079f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:11.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.301+0000 7fec3729c740 1 -- 172.21.15.46:0/2307735995 shutdown_connections 2024-09-21T03:57:11.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.301+0000 7fec3729c740 1 --2- 172.21.15.46:0/2307735995 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9d1168390 0x55f9d15310d0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:11.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.301+0000 7fec3729c740 1 --2- 172.21.15.46:0/2307735995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9d11601b0 0x55f9d1530b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:11.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.301+0000 7fec3729c740 1 --2- 172.21.15.46:0/2307735995 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f9d1189070 0x55f9d1530650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:11.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.301+0000 7fec3729c740 1 -- 172.21.15.46:0/2307735995 >> 172.21.15.46:0/2307735995 conn(0x55f9d117d460 msgr2=0x55f9d152e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:11.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.301+0000 7fec3729c740 1 -- 172.21.15.46:0/2307735995 shutdown_connections 2024-09-21T03:57:11.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.301+0000 7fec3729c740 1 -- 172.21.15.46:0/2307735995 wait complete. 2024-09-21T03:57:11.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.302+0000 7fec3729c740 1 -- start start 2024-09-21T03:57:11.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.302+0000 7fec3729c740 1 Processor -- start 2024-09-21T03:57:11.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.302+0000 7fec3729c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9d11601b0 0x55f9d153bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:11.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.302+0000 7fec3729c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f9d1168390 0x55f9d153c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:11.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.302+0000 7fec3729c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9d1189070 0x55f9d153c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:11.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.302+0000 7fec3729c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55f9d12f7700 con 0x55f9d1189070 2024-09-21T03:57:11.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.302+0000 7fec3729c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55f9d1431110 con 0x55f9d1168390 2024-09-21T03:57:11.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.302+0000 7fec3729c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f9d153edd0 con 0x55f9d11601b0 2024-09-21T03:57:11.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.302+0000 7fec3729c740 10 client.0 _ll_register_callbacks cb 0x55f9d144a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:57:11.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.302+0000 7fec29d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9d1189070 0x55f9d153c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:11.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.302+0000 7fec29d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9d1189070 0x55f9d153c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51936/0 (socket says 172.21.15.46:51936) 2024-09-21T03:57:11.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.302+0000 7fec29d9b640 1 -- 172.21.15.46:0/997669543 learned_addr learned my addr 172.21.15.46:0/997669543 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:11.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.302+0000 7fec2a59c640 1 --2- 172.21.15.46:0/997669543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f9d1168390 0x55f9d153c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:11.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.303+0000 7fec29d9b640 1 --2- 172.21.15.46:0/997669543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9d11601b0 0x55f9d153bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:11.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.303+0000 7fec29d9b640 1 -- 172.21.15.46:0/997669543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9d11601b0 msgr2=0x55f9d153bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:11.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.303+0000 7fec29d9b640 1 --2- 172.21.15.46:0/997669543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9d11601b0 0x55f9d153bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:11.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.303+0000 7fec29d9b640 1 -- 172.21.15.46:0/997669543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f9d1168390 msgr2=0x55f9d153c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:11.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.303+0000 7fec29d9b640 1 --2- 172.21.15.46:0/997669543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f9d1168390 0x55f9d153c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:11.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.303+0000 7fec29d9b640 1 -- 172.21.15.46:0/997669543 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9d145ec40 con 0x55f9d1189070 2024-09-21T03:57:11.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.303+0000 7fec2a59c640 1 --2- 172.21.15.46:0/997669543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f9d1168390 0x55f9d153c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:57:11.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.303+0000 7fec29d9b640 1 --2- 172.21.15.46:0/997669543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9d1189070 0x55f9d153c6d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x55f9d1532f00 tx=0x7fec20004b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40d0aa90039a46b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:11.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.303+0000 7fec11ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:57:11.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.303+0000 7fec11ffb640 1 -- 172.21.15.46:0/997669543 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec20004fb0 con 0x55f9d1189070 2024-09-21T03:57:11.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.303+0000 7fec11ffb640 1 -- 172.21.15.46:0/997669543 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fec20005150 con 0x55f9d1189070 2024-09-21T03:57:11.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.303+0000 7fec3729c740 1 -- 172.21.15.46:0/997669543 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec200054d0 con 0x55f9d1189070 2024-09-21T03:57:11.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.304+0000 7fec11ffb640 1 -- 172.21.15.46:0/997669543 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fec2000f910 con 0x55f9d1189070 2024-09-21T03:57:11.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.304+0000 7fec3729c740 10 client.15801 fetch_fsmap learned FSMap version 20 2024-09-21T03:57:11.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.304+0000 7fec3729c740 1 -- 172.21.15.46:0/997669543 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55f9d154aa50 con 0x55f9d1189070 2024-09-21T03:57:11.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.304+0000 7fec11ffb640 1 -- 172.21.15.46:0/997669543 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec200054d0 con 0x55f9d1189070 2024-09-21T03:57:11.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.304+0000 7fec11ffb640 1 -- 172.21.15.46:0/997669543 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fec200227b0 con 0x55f9d1189070 2024-09-21T03:57:11.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.304+0000 7fec3729c740 10 client.15801 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:57:11.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.304+0000 7fec3729c740 10 client.15801 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:57:11.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.304+0000 7fec3729c740 20 client.15801 populate_metadata read hostname 'smithi046' 2024-09-21T03:57:11.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.304+0000 7fec3729c740 1 --2- 172.21.15.46:0/997669543 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55f9d11479f0 0x55f9d154dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:11.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.304+0000 7fec3729c740 4 client.15801 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:57:11.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.304+0000 7fec3729c740 1 -- 172.21.15.46:0/997669543 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9d14a8da0 con 0x55f9d11479f0 2024-09-21T03:57:11.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.305+0000 7fec2a59c640 1 --2- 172.21.15.46:0/997669543 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55f9d11479f0 0x55f9d154dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:11.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.305+0000 7fec2a59c640 1 --2- 172.21.15.46:0/997669543 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55f9d11479f0 0x55f9d154dec0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=637888daeee10cef server_cookie=21b52f6cf5a4e0bc in_seq=0 out_seq=0 2024-09-21T03:57:11.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.305+0000 7fec11ffb640 10 client.15801 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:57:11.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.306+0000 7fec11ffb640 1 -- 172.21.15.46:0/997669543 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f9d14a8da0 con 0x55f9d11479f0 2024-09-21T03:57:11.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.306+0000 7fec11ffb640 10 client.15801 handle_command_reply: tid=0 2024-09-21T03:57:11.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.306+0000 7fec3729c740 1 client.15801 shutdown 2024-09-21T03:57:11.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.306+0000 7fec3729c740 1 -- 172.21.15.46:0/997669543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9d1189070 msgr2=0x55f9d153c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:11.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.306+0000 7fec3729c740 1 --2- 172.21.15.46:0/997669543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9d1189070 0x55f9d153c6d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x55f9d1532f00 tx=0x7fec20004b00 comp rx=0 tx=0).stop 2024-09-21T03:57:11.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.306+0000 7fec3729c740 1 -- 172.21.15.46:0/997669543 shutdown_connections 2024-09-21T03:57:11.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.306+0000 7fec3729c740 1 --2- 172.21.15.46:0/997669543 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55f9d11479f0 0x55f9d154dec0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:11.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.306+0000 7fec3729c740 1 --2- 172.21.15.46:0/997669543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9d1189070 0x55f9d153c6d0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:11.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.306+0000 7fec3729c740 1 --2- 172.21.15.46:0/997669543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f9d1168390 0x55f9d153c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:11.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.306+0000 7fec3729c740 1 --2- 172.21.15.46:0/997669543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9d11601b0 0x55f9d153bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:11.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.306+0000 7fec3729c740 1 -- 172.21.15.46:0/997669543 >> 172.21.15.46:0/997669543 conn(0x55f9d117d460 msgr2=0x55f9d15337e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:11.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.306+0000 7fec11ffb640 0 client.15801 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:57:11.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.306+0000 7fec3729c740 1 -- 172.21.15.46:0/997669543 shutdown_connections 2024-09-21T03:57:11.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.306+0000 7fec3729c740 1 -- 172.21.15.46:0/997669543 wait complete. 2024-09-21T03:57:11.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.306+0000 7fec3729c740 20 client.15801 trim_cache size 0 max 16384 2024-09-21T03:57:11.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.324+0000 7fec3729c740 1 Processor -- start 2024-09-21T03:57:11.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.324+0000 7fec3729c740 1 -- start start 2024-09-21T03:57:11.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.324+0000 7fec3729c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9d11601b0 0x55f9d1531ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:11.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.324+0000 7fec3729c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9d1168390 0x55f9d153d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:11.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.324+0000 7fec3729c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f9d1189070 0x55f9d1547760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:11.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.324+0000 7fec3729c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fec2c1ad4b0 con 0x55f9d1168390 2024-09-21T03:57:11.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.324+0000 7fec3729c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fec2c1afd50 con 0x55f9d1189070 2024-09-21T03:57:11.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.324+0000 7fec3729c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fec2c1adb40 con 0x55f9d11601b0 2024-09-21T03:57:11.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.324+0000 7fec2a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9d1168390 0x55f9d153d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:11.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.324+0000 7fec29d9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9d11601b0 0x55f9d1531ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:11.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.324+0000 7fec2a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9d1168390 0x55f9d153d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51952/0 (socket says 172.21.15.46:51952) 2024-09-21T03:57:11.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.324+0000 7fec2a59c640 1 -- 172.21.15.46:0/1416947015 learned_addr learned my addr 172.21.15.46:0/1416947015 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:11.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.324+0000 7fec29d9b640 1 --2- 172.21.15.46:0/1416947015 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f9d1189070 0x55f9d1547760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:11.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.325+0000 7fec29d9b640 1 -- 172.21.15.46:0/1416947015 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f9d1189070 msgr2=0x55f9d1547760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:11.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.325+0000 7fec29d9b640 1 --2- 172.21.15.46:0/1416947015 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f9d1189070 0x55f9d1547760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:11.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.325+0000 7fec29d9b640 1 -- 172.21.15.46:0/1416947015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9d1168390 msgr2=0x55f9d153d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:11.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.325+0000 7fec29d9b640 1 --2- 172.21.15.46:0/1416947015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9d1168390 0x55f9d153d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:11.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.325+0000 7fec29d9b640 1 -- 172.21.15.46:0/1416947015 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9d153e020 con 0x55f9d11601b0 2024-09-21T03:57:11.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.325+0000 7fec2a59c640 1 --2- 172.21.15.46:0/1416947015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9d1168390 0x55f9d153d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:57:11.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.325+0000 7fec29d9b640 1 --2- 172.21.15.46:0/1416947015 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9d11601b0 0x55f9d1531ff0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fec200145e0 tx=0x7fec2000c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e68ac8dba8ea2090 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:11.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.325+0000 7fec13fff640 1 -- 172.21.15.46:0/1416947015 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec20014680 con 0x55f9d11601b0 2024-09-21T03:57:11.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.325+0000 7fec13fff640 1 -- 172.21.15.46:0/1416947015 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec2000f730 con 0x55f9d11601b0 2024-09-21T03:57:11.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.325+0000 7fec13fff640 1 -- 172.21.15.46:0/1416947015 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec20005410 con 0x55f9d11601b0 2024-09-21T03:57:11.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.326+0000 7fec3729c740 1 -- 172.21.15.46:0/1416947015 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9d11601b0 msgr2=0x55f9d1531ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:11.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.326+0000 7fec3729c740 1 --2- 172.21.15.46:0/1416947015 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9d11601b0 0x55f9d1531ff0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fec200145e0 tx=0x7fec2000c4a0 comp rx=0 tx=0).stop 2024-09-21T03:57:11.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.326+0000 7fec3729c740 1 -- 172.21.15.46:0/1416947015 shutdown_connections 2024-09-21T03:57:11.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.326+0000 7fec3729c740 1 --2- 172.21.15.46:0/1416947015 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f9d1189070 0x55f9d1547760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:11.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.326+0000 7fec3729c740 1 --2- 172.21.15.46:0/1416947015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9d1168390 0x55f9d153d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:11.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.326+0000 7fec3729c740 1 --2- 172.21.15.46:0/1416947015 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9d11601b0 0x55f9d1531ff0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:11.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.326+0000 7fec3729c740 1 -- 172.21.15.46:0/1416947015 >> 172.21.15.46:0/1416947015 conn(0x55f9d117d460 msgr2=0x55f9d1547050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:11.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.326+0000 7fec3729c740 1 -- 172.21.15.46:0/1416947015 shutdown_connections 2024-09-21T03:57:11.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.326+0000 7fec3729c740 1 -- 172.21.15.46:0/1416947015 wait complete. 2024-09-21T03:57:11.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.326+0000 7fec3729c740 1 -- start start 2024-09-21T03:57:11.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.326+0000 7fec3729c740 1 Processor -- start 2024-09-21T03:57:11.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.327+0000 7fec3729c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9d11601b0 0x55f9d15515c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:11.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.327+0000 7fec3729c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f9d1168390 0x55f9d154ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:11.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.327+0000 7fec3729c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9d1189070 0x55f9d154efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:11.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.327+0000 7fec3729c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fec2c1ae210 con 0x55f9d1189070 2024-09-21T03:57:11.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.327+0000 7fec3729c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fec2c1af680 con 0x55f9d1168390 2024-09-21T03:57:11.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.327+0000 7fec3729c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fec2c1ae8e0 con 0x55f9d11601b0 2024-09-21T03:57:11.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.327+0000 7fec3729c740 10 client.0 _ll_register_callbacks cb 0x7fec20014470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:57:11.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.327+0000 7fec29d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9d1189070 0x55f9d154efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:11.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.327+0000 7fec29d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9d1189070 0x55f9d154efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51958/0 (socket says 172.21.15.46:51958) 2024-09-21T03:57:11.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.327+0000 7fec29d9b640 1 -- 172.21.15.46:0/3249418347 learned_addr learned my addr 172.21.15.46:0/3249418347 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:11.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.327+0000 7fec2a59c640 1 --2- 172.21.15.46:0/3249418347 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f9d1168390 0x55f9d154ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:11.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.327+0000 7fec29d9b640 1 --2- 172.21.15.46:0/3249418347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9d11601b0 0x55f9d15515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:11.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.327+0000 7fec29d9b640 1 -- 172.21.15.46:0/3249418347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9d11601b0 msgr2=0x55f9d15515c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:11.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.327+0000 7fec29d9b640 1 --2- 172.21.15.46:0/3249418347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9d11601b0 0x55f9d15515c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:11.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.327+0000 7fec29d9b640 1 -- 172.21.15.46:0/3249418347 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f9d1168390 msgr2=0x55f9d154ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:11.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.327+0000 7fec29d9b640 1 --2- 172.21.15.46:0/3249418347 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f9d1168390 0x55f9d154ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:11.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.327+0000 7fec29d9b640 1 -- 172.21.15.46:0/3249418347 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9d154f640 con 0x55f9d1189070 2024-09-21T03:57:11.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.327+0000 7fec2a59c640 1 --2- 172.21.15.46:0/3249418347 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f9d1168390 0x55f9d154ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:57:11.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.327+0000 7fec29d9b640 1 --2- 172.21.15.46:0/3249418347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9d1189070 0x55f9d154efd0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fec200057c0 tx=0x7fec20004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1825ff966cfe26d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:11.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.327+0000 7fec11ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:57:11.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.328+0000 7fec11ffb640 1 -- 172.21.15.46:0/3249418347 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec20042040 con 0x55f9d1189070 2024-09-21T03:57:11.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.328+0000 7fec11ffb640 1 -- 172.21.15.46:0/3249418347 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fec2000fab0 con 0x55f9d1189070 2024-09-21T03:57:11.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.328+0000 7fec3729c740 1 -- 172.21.15.46:0/3249418347 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec2000f730 con 0x55f9d1189070 2024-09-21T03:57:11.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.328+0000 7fec11ffb640 1 -- 172.21.15.46:0/3249418347 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fec20014680 con 0x55f9d1189070 2024-09-21T03:57:11.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.328+0000 7fec3729c740 10 client.15807 fetch_fsmap learned FSMap version 20 2024-09-21T03:57:11.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.328+0000 7fec3729c740 1 -- 172.21.15.46:0/3249418347 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55f9d15bc890 con 0x55f9d1189070 2024-09-21T03:57:11.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.328+0000 7fec11ffb640 1 -- 172.21.15.46:0/3249418347 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec2000f730 con 0x55f9d1189070 2024-09-21T03:57:11.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.328+0000 7fec11ffb640 1 -- 172.21.15.46:0/3249418347 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fec20048070 con 0x55f9d1189070 2024-09-21T03:57:11.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.328+0000 7fec3729c740 10 client.15807 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:57:11.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.328+0000 7fec3729c740 10 client.15807 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:57:11.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.328+0000 7fec3729c740 20 client.15807 populate_metadata read hostname 'smithi046' 2024-09-21T03:57:11.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.328+0000 7fec3729c740 1 --2- 172.21.15.46:0/3249418347 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55f9d111cda0 0x55f9d15bed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:11.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.328+0000 7fec3729c740 4 client.15807 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:57:11.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.328+0000 7fec3729c740 1 -- 172.21.15.46:0/3249418347 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f9d14a4850 con 0x55f9d111cda0 2024-09-21T03:57:11.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.329+0000 7fec2a59c640 1 --2- 172.21.15.46:0/3249418347 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55f9d111cda0 0x55f9d15bed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:11.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.329+0000 7fec2a59c640 1 --2- 172.21.15.46:0/3249418347 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55f9d111cda0 0x55f9d15bed80 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=838b16adb2d1a920 server_cookie=1f3187f15ce241f5 in_seq=0 out_seq=0 2024-09-21T03:57:11.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.329+0000 7fec11ffb640 10 client.15807 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:57:11.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.329+0000 7fec11ffb640 1 -- 172.21.15.46:0/3249418347 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1706 (crc 0 0 0) 0x55f9d14a4850 con 0x55f9d111cda0 2024-09-21T03:57:11.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.329+0000 7fec11ffb640 10 client.15807 handle_command_reply: tid=0 2024-09-21T03:57:11.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.329+0000 7fec3729c740 1 client.15807 shutdown 2024-09-21T03:57:11.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.329+0000 7fec3729c740 1 -- 172.21.15.46:0/3249418347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9d1189070 msgr2=0x55f9d154efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:11.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.329+0000 7fec3729c740 1 --2- 172.21.15.46:0/3249418347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9d1189070 0x55f9d154efd0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fec200057c0 tx=0x7fec20004c00 comp rx=0 tx=0).stop 2024-09-21T03:57:11.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.329+0000 7fec3729c740 1 -- 172.21.15.46:0/3249418347 shutdown_connections 2024-09-21T03:57:11.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.329+0000 7fec3729c740 1 --2- 172.21.15.46:0/3249418347 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55f9d111cda0 0x55f9d15bed80 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:11.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.330+0000 7fec3729c740 1 --2- 172.21.15.46:0/3249418347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9d1189070 0x55f9d154efd0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:11.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.330+0000 7fec3729c740 1 --2- 172.21.15.46:0/3249418347 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f9d1168390 0x55f9d154ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:11.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.330+0000 7fec3729c740 1 --2- 172.21.15.46:0/3249418347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f9d11601b0 0x55f9d15515c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:11.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.330+0000 7fec11ffb640 0 client.15807 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:57:11.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.330+0000 7fec3729c740 1 -- 172.21.15.46:0/3249418347 >> 172.21.15.46:0/3249418347 conn(0x55f9d117d460 msgr2=0x55f9d153d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:11.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.330+0000 7fec3729c740 1 -- 172.21.15.46:0/3249418347 shutdown_connections 2024-09-21T03:57:11.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.330+0000 7fec3729c740 1 -- 172.21.15.46:0/3249418347 wait complete. 2024-09-21T03:57:11.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.330+0000 7fec3729c740 20 client.15807 trim_cache size 0 max 16384 2024-09-21T03:57:11.337 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T03:57:11.337 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T03:57:11.337 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2024-09-21T03:57:11.337 INFO:teuthology.orchestra.run.smithi046.stdout: "e24ec8f1-0d13-478f-9c2c-b51798868ffc": { 2024-09-21T03:57:11.337 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:57:11.337 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "e24ec8f1-0d13-478f-9c2c-b51798868ffc", 2024-09-21T03:57:11.337 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2024-09-21T03:57:11.337 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:57:11.338 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:57:11.338 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_stats": { 2024-09-21T03:57:11.338 INFO:teuthology.orchestra.run.smithi046.stdout: "e24ec8f1-0d13-478f-9c2c-b51798868ffc": { 2024-09-21T03:57:11.338 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:09.736194+0000", 2024-09-21T03:57:11.338 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:57:11.338 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:57:11.338 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:57:11.338 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:57:11.338 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:57:11.338 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:57:11.338 INFO:teuthology.orchestra.run.smithi046.stdout: "a871f724-0198-493c-b03e-b2de78aba243": { 2024-09-21T03:57:11.338 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:56:30.082991+0000", 2024-09-21T03:57:11.338 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:57:11.339 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:57:11.339 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:57:11.339 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:57:11.339 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:57:11.339 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:57:11.339 INFO:teuthology.orchestra.run.smithi046.stdout: "d49f33a7-3d5a-421b-94ba-8b19a4120db1": { 2024-09-21T03:57:11.339 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:50.480786+0000", 2024-09-21T03:57:11.339 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:57:11.339 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:57:11.339 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:57:11.339 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:57:11.339 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:57:11.339 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:57:11.339 INFO:teuthology.orchestra.run.smithi046.stdout: "3bbf7097-70d7-4743-bbce-41465502b35b": { 2024-09-21T03:57:11.339 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:10.661441+0000", 2024-09-21T03:57:11.340 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:57:11.340 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:57:11.340 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:57:11.341 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:57:11.341 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:57:11.341 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:57:11.341 INFO:teuthology.orchestra.run.smithi046.stdout: "08f0c962-df1a-4129-a1a2-b916240d9803": { 2024-09-21T03:57:11.342 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:02.937596+0000", 2024-09-21T03:57:11.342 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:57:11.342 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:57:11.342 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:57:11.342 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:57:11.342 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:57:11.342 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:57:11.342 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:57:11.342 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T03:57:11.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.330+0000 7fec30d28640 1 -- 172.21.15.46:0/2500032038 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fec140b6680 msgr2=0x7fec140b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:11.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.330+0000 7fec30d28640 1 --2- 172.21.15.46:0/2500032038 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fec140b6680 0x7fec140b8b90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fec240ad270 tx=0x7fec24079f90 comp rx=0 tx=0).stop 2024-09-21T03:57:11.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.330+0000 7fec30d28640 1 -- 172.21.15.46:0/2500032038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec2c108d20 msgr2=0x7fec2c19fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:11.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.330+0000 7fec30d28640 1 --2- 172.21.15.46:0/2500032038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec2c108d20 0x7fec2c19fcd0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fec24009fd0 tx=0x7fec2400b260 comp rx=0 tx=0).stop 2024-09-21T03:57:11.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.330+0000 7fec30d28640 1 -- 172.21.15.46:0/2500032038 shutdown_connections 2024-09-21T03:57:11.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.330+0000 7fec30d28640 1 --2- 172.21.15.46:0/2500032038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec2c108d20 0x7fec2c19fcd0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:11.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.330+0000 7fec30d28640 1 --2- 172.21.15.46:0/2500032038 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fec140b6680 0x7fec140b8b90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:11.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.330+0000 7fec30d28640 1 --2- 172.21.15.46:0/2500032038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec2c1083d0 0x7fec2c19aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:11.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.330+0000 7fec30d28640 1 --2- 172.21.15.46:0/2500032038 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec2c102ae0 0x7fec2c19a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:11.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.330+0000 7fec30d28640 1 -- 172.21.15.46:0/2500032038 >> 172.21.15.46:0/2500032038 conn(0x7fec2c079760 msgr2=0x7fec2c101b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:11.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.331+0000 7fec30d28640 1 -- 172.21.15.46:0/2500032038 shutdown_connections 2024-09-21T03:57:11.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:11.331+0000 7fec30d28640 1 -- 172.21.15.46:0/2500032038 wait complete. 2024-09-21T03:57:11.989 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:11 smithi046 ceph-mon[30954]: pgmap v384: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T03:57:12.022 INFO:tasks.cephfs.filesystem:scrub status for tag:e24ec8f1-0d13-478f-9c2c-b51798868ffc - {'path': '/', 'tag': 'e24ec8f1-0d13-478f-9c2c-b51798868ffc', 'options': 'recursive,force'} 2024-09-21T03:57:12.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:11 smithi105 ceph-mon[34773]: pgmap v384: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T03:57:12.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:11 smithi162 ceph-mon[35071]: pgmap v384: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T03:57:14.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:13 smithi105 ceph-mon[34773]: pgmap v385: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T03:57:14.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:13 smithi105 ceph-mon[34773]: scrub summary: idle 2024-09-21T03:57:14.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:13 smithi162 ceph-mon[35071]: pgmap v385: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T03:57:14.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:13 smithi162 ceph-mon[35071]: scrub summary: idle 2024-09-21T03:57:14.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:13 smithi046 ceph-mon[30954]: pgmap v385: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T03:57:14.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:13 smithi046 ceph-mon[30954]: scrub summary: idle 2024-09-21T03:57:16.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:15 smithi105 ceph-mon[34773]: pgmap v386: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 11 KiB/s wr, 4 op/s 2024-09-21T03:57:16.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:15 smithi162 ceph-mon[35071]: pgmap v386: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 11 KiB/s wr, 4 op/s 2024-09-21T03:57:16.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:15 smithi046 ceph-mon[30954]: pgmap v386: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 11 KiB/s wr, 4 op/s 2024-09-21T03:57:18.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:17 smithi105 ceph-mon[34773]: pgmap v387: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T03:57:18.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:17 smithi162 ceph-mon[35071]: pgmap v387: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T03:57:18.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:17 smithi046 ceph-mon[30954]: pgmap v387: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T03:57:20.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:19 smithi105 ceph-mon[34773]: pgmap v388: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T03:57:20.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:19 smithi162 ceph-mon[35071]: pgmap v388: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T03:57:20.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:19 smithi046 ceph-mon[30954]: pgmap v388: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T03:57:22.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:21 smithi105 ceph-mon[34773]: pgmap v389: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-21T03:57:22.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:21 smithi162 ceph-mon[35071]: pgmap v389: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-21T03:57:22.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:21 smithi046 ceph-mon[30954]: pgmap v389: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-21T03:57:24.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:23 smithi105 ceph-mon[34773]: pgmap v390: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-21T03:57:24.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:23 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:57:24.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:23 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:57:24.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:23 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:57:24.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:23 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:57:24.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:23 smithi162 ceph-mon[35071]: pgmap v390: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-21T03:57:24.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:23 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:57:24.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:23 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:57:24.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:23 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:57:24.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:23 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:57:24.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:23 smithi046 ceph-mon[30954]: pgmap v390: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-21T03:57:24.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:23 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:57:24.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:23 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:57:24.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:23 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:57:24.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:23 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:57:26.070 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:25 smithi105 ceph-mon[34773]: pgmap v391: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2 op/s 2024-09-21T03:57:26.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:25 smithi162 ceph-mon[35071]: pgmap v391: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2 op/s 2024-09-21T03:57:26.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:25 smithi046 ceph-mon[30954]: pgmap v391: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2 op/s 2024-09-21T03:57:28.081 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:27 smithi105 ceph-mon[34773]: pgmap v392: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:57:28.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:27 smithi162 ceph-mon[35071]: pgmap v392: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:57:28.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:27 smithi046 ceph-mon[30954]: pgmap v392: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:57:30.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:29 smithi105 ceph-mon[34773]: pgmap v393: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:57:30.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:29 smithi162 ceph-mon[35071]: pgmap v393: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:57:30.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:29 smithi046 ceph-mon[30954]: pgmap v393: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:57:32.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:31 smithi105 ceph-mon[34773]: pgmap v394: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:57:32.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:31 smithi162 ceph-mon[35071]: pgmap v394: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:57:32.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:31 smithi046 ceph-mon[30954]: pgmap v394: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:57:34.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:33 smithi105 ceph-mon[34773]: pgmap v395: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T03:57:34.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:33 smithi162 ceph-mon[35071]: pgmap v395: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T03:57:34.254 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:33 smithi046 ceph-mon[30954]: pgmap v395: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T03:57:36.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:35 smithi162 ceph-mon[35071]: pgmap v396: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:57:36.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:35 smithi046 ceph-mon[30954]: pgmap v396: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:57:36.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:35 smithi105 ceph-mon[34773]: pgmap v396: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:57:38.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:37 smithi162 ceph-mon[35071]: pgmap v397: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:57:38.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:37 smithi046 ceph-mon[30954]: pgmap v397: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:57:38.317 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:37 smithi105 ceph-mon[34773]: pgmap v397: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:57:40.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:39 smithi162 ceph-mon[35071]: pgmap v398: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:57:40.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:39 smithi046 ceph-mon[30954]: pgmap v398: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:57:40.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:39 smithi105 ceph-mon[34773]: pgmap v398: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:57:42.023 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:57:42.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:41 smithi162 ceph-mon[35071]: pgmap v399: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:57:42.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:41 smithi046 ceph-mon[30954]: pgmap v399: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:57:42.289 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:57:42.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:41 smithi105 ceph-mon[34773]: pgmap v399: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:57:42.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.788+0000 7f6c89fc7640 1 -- 172.21.15.46:0/3214809156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c841094a0 msgr2=0x7f6c841098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:42.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.788+0000 7f6c89fc7640 1 --2- 172.21.15.46:0/3214809156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c841094a0 0x7f6c841098b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f6c78009900 tx=0x7f6c7802a410 comp rx=0 tx=0).stop 2024-09-21T03:57:42.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.788+0000 7f6c89fc7640 1 -- 172.21.15.46:0/3214809156 shutdown_connections 2024-09-21T03:57:42.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.788+0000 7f6c89fc7640 1 --2- 172.21.15.46:0/3214809156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c84109df0 0x7f6c84110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:42.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.788+0000 7f6c89fc7640 1 --2- 172.21.15.46:0/3214809156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c841094a0 0x7f6c841098b0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:42.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.788+0000 7f6c89fc7640 1 --2- 172.21.15.46:0/3214809156 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c84103b60 0x7f6c84103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:42.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.788+0000 7f6c89fc7640 1 -- 172.21.15.46:0/3214809156 >> 172.21.15.46:0/3214809156 conn(0x7f6c8407b850 msgr2=0x7f6c8407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:42.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.788+0000 7f6c89fc7640 1 -- 172.21.15.46:0/3214809156 shutdown_connections 2024-09-21T03:57:42.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.788+0000 7f6c89fc7640 1 -- 172.21.15.46:0/3214809156 wait complete. 2024-09-21T03:57:42.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.789+0000 7f6c89fc7640 1 Processor -- start 2024-09-21T03:57:42.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.789+0000 7f6c89fc7640 1 -- start start 2024-09-21T03:57:42.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.789+0000 7f6c89fc7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c84103b60 0x7f6c8419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:42.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.789+0000 7f6c89fc7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c841094a0 0x7f6c8419aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:42.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.789+0000 7f6c89fc7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c84109df0 0x7f6c8419fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:42.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.789+0000 7f6c89fc7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6c84113ab0 con 0x7f6c841094a0 2024-09-21T03:57:42.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.789+0000 7f6c89fc7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6c84113930 con 0x7f6c84109df0 2024-09-21T03:57:42.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.789+0000 7f6c89fc7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6c84113c30 con 0x7f6c84103b60 2024-09-21T03:57:42.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.790+0000 7f6c82ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c841094a0 0x7f6c8419aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:42.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.790+0000 7f6c82ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c841094a0 0x7f6c8419aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57322/0 (socket says 172.21.15.46:57322) 2024-09-21T03:57:42.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.790+0000 7f6c82ffd640 1 -- 172.21.15.46:0/1248312710 learned_addr learned my addr 172.21.15.46:0/1248312710 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:42.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.790+0000 7f6c837fe640 1 --2- 172.21.15.46:0/1248312710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c84103b60 0x7f6c8419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:42.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.790+0000 7f6c83fff640 1 --2- 172.21.15.46:0/1248312710 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c84109df0 0x7f6c8419fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:42.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.790+0000 7f6c82ffd640 1 -- 172.21.15.46:0/1248312710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c84103b60 msgr2=0x7f6c8419a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:42.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.790+0000 7f6c82ffd640 1 --2- 172.21.15.46:0/1248312710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c84103b60 0x7f6c8419a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:42.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.790+0000 7f6c82ffd640 1 -- 172.21.15.46:0/1248312710 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c84109df0 msgr2=0x7f6c8419fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:42.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.790+0000 7f6c82ffd640 1 --2- 172.21.15.46:0/1248312710 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c84109df0 0x7f6c8419fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:42.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.790+0000 7f6c82ffd640 1 -- 172.21.15.46:0/1248312710 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c841a03f0 con 0x7f6c841094a0 2024-09-21T03:57:42.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.790+0000 7f6c83fff640 1 --2- 172.21.15.46:0/1248312710 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c84109df0 0x7f6c8419fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:57:42.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.790+0000 7f6c82ffd640 1 --2- 172.21.15.46:0/1248312710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c841094a0 0x7f6c8419aa20 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f6c78006010 tx=0x7f6c78004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:42.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.790+0000 7f6c80ff9640 1 -- 172.21.15.46:0/1248312710 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7803f030 con 0x7f6c841094a0 2024-09-21T03:57:42.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.790+0000 7f6c89fc7640 1 -- 172.21.15.46:0/1248312710 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c841a0680 con 0x7f6c841094a0 2024-09-21T03:57:42.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.790+0000 7f6c80ff9640 1 -- 172.21.15.46:0/1248312710 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c78003aa0 con 0x7f6c841094a0 2024-09-21T03:57:42.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.790+0000 7f6c80ff9640 1 -- 172.21.15.46:0/1248312710 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c78035070 con 0x7f6c841094a0 2024-09-21T03:57:42.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.790+0000 7f6c89fc7640 1 -- 172.21.15.46:0/1248312710 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c841a6e40 con 0x7f6c841094a0 2024-09-21T03:57:42.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.793+0000 7f6c80ff9640 1 -- 172.21.15.46:0/1248312710 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f6c78042030 con 0x7f6c841094a0 2024-09-21T03:57:42.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.793+0000 7f6c9053b740 1 Processor -- start 2024-09-21T03:57:42.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.793+0000 7f6c9053b740 1 -- start start 2024-09-21T03:57:42.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.793+0000 7f6c9053b740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55de4bf6e070 0x55de4c315650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:42.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.793+0000 7f6c9053b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de4bf451b0 0x55de4c315b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:42.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.793+0000 7f6c9053b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de4bf4d390 0x55de4c3160d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:42.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.793+0000 7f6c9053b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55de4c28be50 con 0x55de4bf4d390 2024-09-21T03:57:42.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.793+0000 7f6c9053b740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55de4c27b280 con 0x55de4bf6e070 2024-09-21T03:57:42.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.793+0000 7f6c9053b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55de4c27f090 con 0x55de4bf451b0 2024-09-21T03:57:42.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.794+0000 7f6c82ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de4bf4d390 0x55de4c3160d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:42.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.794+0000 7f6c83fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55de4bf6e070 0x55de4c315650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:42.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.794+0000 7f6c83fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55de4bf6e070 0x55de4c315650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.46:57936/0 (socket says 172.21.15.46:57936) 2024-09-21T03:57:42.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.794+0000 7f6c83fff640 1 -- 172.21.15.46:0/572952158 learned_addr learned my addr 172.21.15.46:0/572952158 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:42.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.794+0000 7f6c837fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de4bf451b0 0x55de4c315b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:42.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.794+0000 7f6c80ff9640 1 --2- 172.21.15.46:0/1248312710 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f6c6c0b6680 0x7f6c6c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:42.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.794+0000 7f6c83fff640 1 --2- 172.21.15.46:0/1248312710 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f6c6c0b6680 0x7f6c6c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:42.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.794+0000 7f6c837fe640 1 -- 172.21.15.46:0/572952158 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55de4bf6e070 msgr2=0x55de4c315650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:42.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.794+0000 7f6c837fe640 1 --2- 172.21.15.46:0/572952158 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55de4bf6e070 0x55de4c315650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:42.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.794+0000 7f6c837fe640 1 -- 172.21.15.46:0/572952158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de4bf4d390 msgr2=0x55de4c3160d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:42.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.794+0000 7f6c837fe640 1 --2- 172.21.15.46:0/572952158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de4bf4d390 0x55de4c3160d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:42.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.794+0000 7f6c80ff9640 1 -- 172.21.15.46:0/1248312710 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f6c78107c60 con 0x7f6c841094a0 2024-09-21T03:57:42.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.794+0000 7f6c837fe640 1 -- 172.21.15.46:0/572952158 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de4bfd9650 con 0x55de4bf451b0 2024-09-21T03:57:42.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.794+0000 7f6c83fff640 1 --2- 172.21.15.46:0/572952158 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55de4bf6e070 0x55de4c315650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:57:42.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.794+0000 7f6c837fe640 1 --2- 172.21.15.46:0/572952158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de4bf451b0 0x55de4c315b90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6c7400bbe0 tx=0x7f6c7400f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e9fdf0249557159 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:42.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.795+0000 7f6c69ffb640 1 -- 172.21.15.46:0/572952158 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c74015070 con 0x55de4bf451b0 2024-09-21T03:57:42.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.795+0000 7f6c69ffb640 1 -- 172.21.15.46:0/572952158 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c740035f0 con 0x55de4bf451b0 2024-09-21T03:57:42.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.795+0000 7f6c69ffb640 1 -- 172.21.15.46:0/572952158 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c740116a0 con 0x55de4bf451b0 2024-09-21T03:57:42.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.795+0000 7f6c83fff640 1 --2- 172.21.15.46:0/1248312710 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f6c6c0b6680 0x7f6c6c0b8b90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c013860 tx=0x7f6c7c004ab0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:42.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.795+0000 7f6c9053b740 1 -- 172.21.15.46:0/572952158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de4bf451b0 msgr2=0x55de4c315b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:42.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.795+0000 7f6c9053b740 1 --2- 172.21.15.46:0/572952158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de4bf451b0 0x55de4c315b90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6c7400bbe0 tx=0x7f6c7400f730 comp rx=0 tx=0).stop 2024-09-21T03:57:42.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.796+0000 7f6c9053b740 1 -- 172.21.15.46:0/572952158 shutdown_connections 2024-09-21T03:57:42.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.796+0000 7f6c9053b740 1 --2- 172.21.15.46:0/572952158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de4bf4d390 0x55de4c3160d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:42.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.796+0000 7f6c9053b740 1 --2- 172.21.15.46:0/572952158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de4bf451b0 0x55de4c315b90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:42.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.796+0000 7f6c9053b740 1 --2- 172.21.15.46:0/572952158 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55de4bf6e070 0x55de4c315650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:42.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.796+0000 7f6c9053b740 1 -- 172.21.15.46:0/572952158 >> 172.21.15.46:0/572952158 conn(0x55de4bf62460 msgr2=0x55de4c313540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:42.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.796+0000 7f6c9053b740 1 -- 172.21.15.46:0/572952158 shutdown_connections 2024-09-21T03:57:42.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.796+0000 7f6c9053b740 1 -- 172.21.15.46:0/572952158 wait complete. 2024-09-21T03:57:42.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.796+0000 7f6c9053b740 1 -- start start 2024-09-21T03:57:42.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.796+0000 7f6c9053b740 1 Processor -- start 2024-09-21T03:57:42.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.797+0000 7f6c9053b740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55de4bf451b0 0x55de4c320cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:42.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.797+0000 7f6c9053b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de4bf4d390 0x55de4c321230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:42.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.797+0000 7f6c9053b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de4bf6e070 0x55de4c32d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:42.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.797+0000 7f6c9053b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55de4c0dc700 con 0x55de4bf6e070 2024-09-21T03:57:42.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.797+0000 7f6c9053b740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55de4c216110 con 0x55de4bf451b0 2024-09-21T03:57:42.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.797+0000 7f6c9053b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55de4c323e30 con 0x55de4bf4d390 2024-09-21T03:57:42.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.797+0000 7f6c9053b740 10 client.0 _ll_register_callbacks cb 0x55de4c22f990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:57:42.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.797+0000 7f6c83fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de4bf6e070 0x55de4c32d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:42.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.797+0000 7f6c83fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de4bf6e070 0x55de4c32d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57350/0 (socket says 172.21.15.46:57350) 2024-09-21T03:57:42.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.797+0000 7f6c83fff640 1 -- 172.21.15.46:0/413013210 learned_addr learned my addr 172.21.15.46:0/413013210 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:42.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.797+0000 7f6c837fe640 1 --2- 172.21.15.46:0/413013210 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55de4bf451b0 0x55de4c320cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:42.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.797+0000 7f6c82ffd640 1 --2- 172.21.15.46:0/413013210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de4bf4d390 0x55de4c321230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:42.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.797+0000 7f6c83fff640 1 -- 172.21.15.46:0/413013210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de4bf4d390 msgr2=0x55de4c321230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:42.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.797+0000 7f6c83fff640 1 --2- 172.21.15.46:0/413013210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de4bf4d390 0x55de4c321230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:42.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.797+0000 7f6c83fff640 1 -- 172.21.15.46:0/413013210 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55de4bf451b0 msgr2=0x55de4c320cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:42.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.797+0000 7f6c83fff640 1 --2- 172.21.15.46:0/413013210 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55de4bf451b0 0x55de4c320cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:42.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.797+0000 7f6c83fff640 1 -- 172.21.15.46:0/413013210 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de4c243c40 con 0x55de4bf6e070 2024-09-21T03:57:42.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.797+0000 7f6c83fff640 1 --2- 172.21.15.46:0/413013210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de4bf6e070 0x55de4c32d120 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c005c00 tx=0x7f6c7c009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80d771d0fd87291e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:42.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.797+0000 7f6c62ffd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:57:42.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.798+0000 7f6c62ffd640 1 -- 172.21.15.46:0/413013210 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c023070 con 0x55de4bf6e070 2024-09-21T03:57:42.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.798+0000 7f6c62ffd640 1 -- 172.21.15.46:0/413013210 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f6c7c011d90 con 0x55de4bf6e070 2024-09-21T03:57:42.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.798+0000 7f6c9053b740 1 -- 172.21.15.46:0/413013210 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c740035f0 con 0x55de4bf6e070 2024-09-21T03:57:42.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.798+0000 7f6c62ffd640 1 -- 172.21.15.46:0/413013210 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6c7c01f3f0 con 0x55de4bf6e070 2024-09-21T03:57:42.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.798+0000 7f6c9053b740 10 client.15819 fetch_fsmap learned FSMap version 20 2024-09-21T03:57:42.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.798+0000 7f6c9053b740 1 -- 172.21.15.46:0/413013210 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55de4c32fb80 con 0x55de4bf6e070 2024-09-21T03:57:42.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.798+0000 7f6c62ffd640 1 -- 172.21.15.46:0/413013210 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c740035f0 con 0x55de4bf6e070 2024-09-21T03:57:42.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.798+0000 7f6c62ffd640 1 -- 172.21.15.46:0/413013210 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f6c7c010600 con 0x55de4bf6e070 2024-09-21T03:57:42.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.798+0000 7f6c9053b740 10 client.15819 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:57:42.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.798+0000 7f6c9053b740 10 client.15819 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:57:42.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.798+0000 7f6c9053b740 20 client.15819 populate_metadata read hostname 'smithi046' 2024-09-21T03:57:42.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.798+0000 7f6c9053b740 1 --2- 172.21.15.46:0/413013210 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55de4bf2c9f0 0x55de4c3330f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:42.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.798+0000 7f6c9053b740 4 client.15819 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:57:42.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.798+0000 7f6c9053b740 1 -- 172.21.15.46:0/413013210 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de4c28dda0 con 0x55de4bf2c9f0 2024-09-21T03:57:42.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.799+0000 7f6c837fe640 1 --2- 172.21.15.46:0/413013210 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55de4bf2c9f0 0x55de4c3330f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:42.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.799+0000 7f6c62ffd640 10 client.15819 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:57:42.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.799+0000 7f6c837fe640 1 --2- 172.21.15.46:0/413013210 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55de4bf2c9f0 0x55de4c3330f0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f719adad114f8a9b server_cookie=bde2bd01ea45788b in_seq=0 out_seq=0 2024-09-21T03:57:42.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.800+0000 7f6c62ffd640 1 -- 172.21.15.46:0/413013210 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55de4c28dda0 con 0x55de4bf2c9f0 2024-09-21T03:57:42.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.800+0000 7f6c62ffd640 10 client.15819 handle_command_reply: tid=0 2024-09-21T03:57:42.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.800+0000 7f6c9053b740 1 client.15819 shutdown 2024-09-21T03:57:42.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.800+0000 7f6c9053b740 1 -- 172.21.15.46:0/413013210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de4bf6e070 msgr2=0x55de4c32d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:42.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.800+0000 7f6c9053b740 1 --2- 172.21.15.46:0/413013210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de4bf6e070 0x55de4c32d120 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c005c00 tx=0x7f6c7c009500 comp rx=0 tx=0).stop 2024-09-21T03:57:42.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.800+0000 7f6c9053b740 1 -- 172.21.15.46:0/413013210 shutdown_connections 2024-09-21T03:57:42.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.800+0000 7f6c9053b740 1 --2- 172.21.15.46:0/413013210 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55de4bf2c9f0 0x55de4c3330f0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:42.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.800+0000 7f6c9053b740 1 --2- 172.21.15.46:0/413013210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de4bf6e070 0x55de4c32d120 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:42.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.800+0000 7f6c9053b740 1 --2- 172.21.15.46:0/413013210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de4bf4d390 0x55de4c321230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:42.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.800+0000 7f6c62ffd640 0 client.15819 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:57:42.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.800+0000 7f6c9053b740 1 --2- 172.21.15.46:0/413013210 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55de4bf451b0 0x55de4c320cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:42.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.800+0000 7f6c9053b740 1 -- 172.21.15.46:0/413013210 >> 172.21.15.46:0/413013210 conn(0x55de4bf62460 msgr2=0x55de4c318830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:42.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.800+0000 7f6c9053b740 1 -- 172.21.15.46:0/413013210 shutdown_connections 2024-09-21T03:57:42.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.800+0000 7f6c9053b740 1 -- 172.21.15.46:0/413013210 wait complete. 2024-09-21T03:57:42.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.801+0000 7f6c9053b740 20 client.15819 trim_cache size 0 max 16384 2024-09-21T03:57:42.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.818+0000 7f6c9053b740 1 Processor -- start 2024-09-21T03:57:42.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.818+0000 7f6c9053b740 1 -- start start 2024-09-21T03:57:42.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.818+0000 7f6c9053b740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55de4bf451b0 0x55de4c316d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:42.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.818+0000 7f6c9053b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de4bf4d390 0x55de4c312b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:42.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.818+0000 7f6c9053b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de4bf6e070 0x55de4c3130b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:42.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.818+0000 7f6c9053b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6c841ad510 con 0x55de4bf6e070 2024-09-21T03:57:42.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.818+0000 7f6c9053b740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6c841afdb0 con 0x55de4bf451b0 2024-09-21T03:57:42.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.818+0000 7f6c9053b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6c841adba0 con 0x55de4bf4d390 2024-09-21T03:57:42.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.818+0000 7f6c83fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de4bf6e070 0x55de4c3130b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:42.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.818+0000 7f6c83fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de4bf6e070 0x55de4c3130b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57356/0 (socket says 172.21.15.46:57356) 2024-09-21T03:57:42.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.818+0000 7f6c83fff640 1 -- 172.21.15.46:0/218279431 learned_addr learned my addr 172.21.15.46:0/218279431 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:42.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.819+0000 7f6c837fe640 1 --2- 172.21.15.46:0/218279431 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55de4bf451b0 0x55de4c316d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:42.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.819+0000 7f6c82ffd640 1 --2- 172.21.15.46:0/218279431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de4bf4d390 0x55de4c312b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:42.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.819+0000 7f6c83fff640 1 -- 172.21.15.46:0/218279431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de4bf4d390 msgr2=0x55de4c312b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:42.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.819+0000 7f6c83fff640 1 --2- 172.21.15.46:0/218279431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de4bf4d390 0x55de4c312b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:42.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.819+0000 7f6c83fff640 1 -- 172.21.15.46:0/218279431 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55de4bf451b0 msgr2=0x55de4c316d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:42.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.819+0000 7f6c83fff640 1 --2- 172.21.15.46:0/218279431 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55de4bf451b0 0x55de4c316d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:42.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.819+0000 7f6c83fff640 1 -- 172.21.15.46:0/218279431 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de4c3334a0 con 0x55de4bf6e070 2024-09-21T03:57:42.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.819+0000 7f6c82ffd640 1 --2- 172.21.15.46:0/218279431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de4bf4d390 0x55de4c312b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:57:42.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.819+0000 7f6c83fff640 1 --2- 172.21.15.46:0/218279431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de4bf6e070 0x55de4c3130b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00a010 tx=0x7f6c7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e470ea3550808ec7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:42.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.819+0000 7f6c697fa640 1 -- 172.21.15.46:0/218279431 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c038070 con 0x55de4bf6e070 2024-09-21T03:57:42.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.819+0000 7f6c697fa640 1 -- 172.21.15.46:0/218279431 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c7c011d90 con 0x55de4bf6e070 2024-09-21T03:57:42.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.819+0000 7f6c697fa640 1 -- 172.21.15.46:0/218279431 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c023070 con 0x55de4bf6e070 2024-09-21T03:57:42.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.820+0000 7f6c9053b740 1 -- 172.21.15.46:0/218279431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de4bf6e070 msgr2=0x55de4c3130b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:42.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.820+0000 7f6c9053b740 1 --2- 172.21.15.46:0/218279431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de4bf6e070 0x55de4c3130b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00a010 tx=0x7f6c7c004a40 comp rx=0 tx=0).stop 2024-09-21T03:57:42.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.820+0000 7f6c9053b740 1 -- 172.21.15.46:0/218279431 shutdown_connections 2024-09-21T03:57:42.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.820+0000 7f6c9053b740 1 --2- 172.21.15.46:0/218279431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de4bf6e070 0x55de4c3130b0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:42.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.820+0000 7f6c9053b740 1 --2- 172.21.15.46:0/218279431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de4bf4d390 0x55de4c312b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:42.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.820+0000 7f6c9053b740 1 --2- 172.21.15.46:0/218279431 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55de4bf451b0 0x55de4c316d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:42.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.820+0000 7f6c9053b740 1 -- 172.21.15.46:0/218279431 >> 172.21.15.46:0/218279431 conn(0x55de4bf62460 msgr2=0x55de4c316680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:42.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.820+0000 7f6c9053b740 1 -- 172.21.15.46:0/218279431 shutdown_connections 2024-09-21T03:57:42.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.820+0000 7f6c9053b740 1 -- 172.21.15.46:0/218279431 wait complete. 2024-09-21T03:57:42.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.820+0000 7f6c9053b740 1 -- start start 2024-09-21T03:57:42.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.821+0000 7f6c9053b740 1 Processor -- start 2024-09-21T03:57:42.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.821+0000 7f6c9053b740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55de4bf451b0 0x55de4c325060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:42.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.821+0000 7f6c9053b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de4bf4d390 0x55de4c3255a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:42.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.821+0000 7f6c9053b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de4bf6e070 0x55de4c325ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:42.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.821+0000 7f6c9053b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6c841ae270 con 0x55de4bf4d390 2024-09-21T03:57:42.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.821+0000 7f6c9053b740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6c841af6e0 con 0x55de4bf451b0 2024-09-21T03:57:42.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.821+0000 7f6c9053b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6c841ae940 con 0x55de4bf6e070 2024-09-21T03:57:42.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.821+0000 7f6c9053b740 10 client.0 _ll_register_callbacks cb 0x7f6c7c009b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:57:42.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.821+0000 7f6c82ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de4bf4d390 0x55de4c3255a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:42.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.821+0000 7f6c82ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de4bf4d390 0x55de4c3255a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57372/0 (socket says 172.21.15.46:57372) 2024-09-21T03:57:42.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.821+0000 7f6c82ffd640 1 -- 172.21.15.46:0/2075401937 learned_addr learned my addr 172.21.15.46:0/2075401937 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:42.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.821+0000 7f6c837fe640 1 --2- 172.21.15.46:0/2075401937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55de4bf451b0 0x55de4c325060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:42.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.821+0000 7f6c83fff640 1 --2- 172.21.15.46:0/2075401937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de4bf6e070 0x55de4c325ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:42.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.822+0000 7f6c82ffd640 1 -- 172.21.15.46:0/2075401937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de4bf6e070 msgr2=0x55de4c325ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:42.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.822+0000 7f6c82ffd640 1 --2- 172.21.15.46:0/2075401937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de4bf6e070 0x55de4c325ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:42.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.822+0000 7f6c82ffd640 1 -- 172.21.15.46:0/2075401937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55de4bf451b0 msgr2=0x55de4c325060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:42.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.822+0000 7f6c82ffd640 1 --2- 172.21.15.46:0/2075401937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55de4bf451b0 0x55de4c325060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:42.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.822+0000 7f6c82ffd640 1 -- 172.21.15.46:0/2075401937 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de4c39caf0 con 0x55de4bf4d390 2024-09-21T03:57:42.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.822+0000 7f6c837fe640 1 --2- 172.21.15.46:0/2075401937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55de4bf451b0 0x55de4c325060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:57:42.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.822+0000 7f6c82ffd640 1 --2- 172.21.15.46:0/2075401937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de4bf4d390 0x55de4c3255a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f6c78031440 tx=0x7f6c7803b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aaea2ccf3e46c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:42.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.822+0000 7f6c62ffd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:57:42.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.822+0000 7f6c62ffd640 1 -- 172.21.15.46:0/2075401937 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c78049040 con 0x55de4bf4d390 2024-09-21T03:57:42.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.822+0000 7f6c62ffd640 1 -- 172.21.15.46:0/2075401937 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f6c781056d0 con 0x55de4bf4d390 2024-09-21T03:57:42.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.822+0000 7f6c9053b740 1 -- 172.21.15.46:0/2075401937 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c7c011d90 con 0x55de4bf4d390 2024-09-21T03:57:42.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.822+0000 7f6c62ffd640 1 -- 172.21.15.46:0/2075401937 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6c780cd920 con 0x55de4bf4d390 2024-09-21T03:57:42.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.822+0000 7f6c9053b740 10 client.15825 fetch_fsmap learned FSMap version 20 2024-09-21T03:57:42.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.822+0000 7f6c9053b740 1 -- 172.21.15.46:0/2075401937 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55de4c39dcf0 con 0x55de4bf4d390 2024-09-21T03:57:42.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.822+0000 7f6c62ffd640 1 -- 172.21.15.46:0/2075401937 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c7c011d90 con 0x55de4bf4d390 2024-09-21T03:57:42.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.823+0000 7f6c62ffd640 1 -- 172.21.15.46:0/2075401937 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f6c7810d070 con 0x55de4bf4d390 2024-09-21T03:57:42.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.823+0000 7f6c9053b740 10 client.15825 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:57:42.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.823+0000 7f6c9053b740 10 client.15825 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:57:42.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.823+0000 7f6c9053b740 20 client.15825 populate_metadata read hostname 'smithi046' 2024-09-21T03:57:42.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.823+0000 7f6c9053b740 1 --2- 172.21.15.46:0/2075401937 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55de4bf01da0 0x55de4c3a0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:42.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.823+0000 7f6c9053b740 4 client.15825 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:57:42.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.823+0000 7f6c9053b740 1 -- 172.21.15.46:0/2075401937 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55de4c289850 con 0x55de4bf01da0 2024-09-21T03:57:42.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.823+0000 7f6c837fe640 1 --2- 172.21.15.46:0/2075401937 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55de4bf01da0 0x55de4c3a0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:42.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.823+0000 7f6c62ffd640 10 client.15825 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:57:42.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.823+0000 7f6c837fe640 1 --2- 172.21.15.46:0/2075401937 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55de4bf01da0 0x55de4c3a0480 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61e671e638e74b26 server_cookie=baf6ca6ad4ee10e6 in_seq=0 out_seq=0 2024-09-21T03:57:42.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.824+0000 7f6c62ffd640 1 -- 172.21.15.46:0/2075401937 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1510 (crc 0 0 0) 0x55de4c289850 con 0x55de4bf01da0 2024-09-21T03:57:42.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.824+0000 7f6c62ffd640 10 client.15825 handle_command_reply: tid=0 2024-09-21T03:57:42.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.824+0000 7f6c9053b740 1 client.15825 shutdown 2024-09-21T03:57:42.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.824+0000 7f6c9053b740 1 -- 172.21.15.46:0/2075401937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de4bf4d390 msgr2=0x55de4c3255a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:42.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.824+0000 7f6c9053b740 1 --2- 172.21.15.46:0/2075401937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de4bf4d390 0x55de4c3255a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f6c78031440 tx=0x7f6c7803b5d0 comp rx=0 tx=0).stop 2024-09-21T03:57:42.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.824+0000 7f6c9053b740 1 -- 172.21.15.46:0/2075401937 shutdown_connections 2024-09-21T03:57:42.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.824+0000 7f6c9053b740 1 --2- 172.21.15.46:0/2075401937 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55de4bf01da0 0x55de4c3a0480 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:42.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.824+0000 7f6c9053b740 1 --2- 172.21.15.46:0/2075401937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55de4bf6e070 0x55de4c325ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:42.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.824+0000 7f6c9053b740 1 --2- 172.21.15.46:0/2075401937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de4bf4d390 0x55de4c3255a0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:42.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.824+0000 7f6c9053b740 1 --2- 172.21.15.46:0/2075401937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55de4bf451b0 0x55de4c325060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:42.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.824+0000 7f6c9053b740 1 -- 172.21.15.46:0/2075401937 >> 172.21.15.46:0/2075401937 conn(0x55de4bf62460 msgr2=0x55de4c3221a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:42.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.824+0000 7f6c62ffd640 0 client.15825 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:57:42.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.824+0000 7f6c9053b740 1 -- 172.21.15.46:0/2075401937 shutdown_connections 2024-09-21T03:57:42.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.824+0000 7f6c9053b740 1 -- 172.21.15.46:0/2075401937 wait complete. 2024-09-21T03:57:42.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.824+0000 7f6c9053b740 20 client.15825 trim_cache size 0 max 16384 2024-09-21T03:57:42.833 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T03:57:42.833 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "no active scrubs running", 2024-09-21T03:57:42.833 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": {}, 2024-09-21T03:57:42.833 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_stats": { 2024-09-21T03:57:42.833 INFO:teuthology.orchestra.run.smithi046.stdout: "e24ec8f1-0d13-478f-9c2c-b51798868ffc": { 2024-09-21T03:57:42.833 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:09.736194+0000", 2024-09-21T03:57:42.833 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:57:42.833 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:57:42.833 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:57:42.833 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:57:42.834 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:57:42.834 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:57:42.834 INFO:teuthology.orchestra.run.smithi046.stdout: "a871f724-0198-493c-b03e-b2de78aba243": { 2024-09-21T03:57:42.834 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:56:30.082991+0000", 2024-09-21T03:57:42.834 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:57:42.834 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:57:42.834 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:57:42.834 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:57:42.834 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:57:42.834 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:57:42.834 INFO:teuthology.orchestra.run.smithi046.stdout: "d49f33a7-3d5a-421b-94ba-8b19a4120db1": { 2024-09-21T03:57:42.834 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:50.480786+0000", 2024-09-21T03:57:42.834 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:57:42.835 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:57:42.835 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:57:42.835 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:57:42.835 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:57:42.835 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:57:42.835 INFO:teuthology.orchestra.run.smithi046.stdout: "3bbf7097-70d7-4743-bbce-41465502b35b": { 2024-09-21T03:57:42.835 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:10.661441+0000", 2024-09-21T03:57:42.835 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:57:42.835 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:57:42.835 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:57:42.835 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:57:42.835 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:57:42.836 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:57:42.836 INFO:teuthology.orchestra.run.smithi046.stdout: "08f0c962-df1a-4129-a1a2-b916240d9803": { 2024-09-21T03:57:42.836 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:02.937596+0000", 2024-09-21T03:57:42.836 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:57:42.836 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:57:42.836 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:57:42.836 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:57:42.836 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:57:42.836 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:57:42.836 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:57:42.836 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T03:57:42.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.825+0000 7f6c89fc7640 1 -- 172.21.15.46:0/1248312710 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f6c6c0b6680 msgr2=0x7f6c6c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:42.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.825+0000 7f6c89fc7640 1 --2- 172.21.15.46:0/1248312710 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f6c6c0b6680 0x7f6c6c0b8b90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c013860 tx=0x7f6c7c004ab0 comp rx=0 tx=0).stop 2024-09-21T03:57:42.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.825+0000 7f6c89fc7640 1 -- 172.21.15.46:0/1248312710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c841094a0 msgr2=0x7f6c8419aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:42.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.825+0000 7f6c89fc7640 1 --2- 172.21.15.46:0/1248312710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c841094a0 0x7f6c8419aa20 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f6c78006010 tx=0x7f6c78004060 comp rx=0 tx=0).stop 2024-09-21T03:57:42.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.825+0000 7f6c89fc7640 1 -- 172.21.15.46:0/1248312710 shutdown_connections 2024-09-21T03:57:42.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.825+0000 7f6c89fc7640 1 --2- 172.21.15.46:0/1248312710 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c84109df0 0x7f6c8419fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:42.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.825+0000 7f6c89fc7640 1 --2- 172.21.15.46:0/1248312710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c841094a0 0x7f6c8419aa20 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:42.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.825+0000 7f6c89fc7640 1 --2- 172.21.15.46:0/1248312710 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f6c6c0b6680 0x7f6c6c0b8b90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:42.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.825+0000 7f6c89fc7640 1 --2- 172.21.15.46:0/1248312710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c84103b60 0x7f6c8419a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:42.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.825+0000 7f6c89fc7640 1 -- 172.21.15.46:0/1248312710 >> 172.21.15.46:0/1248312710 conn(0x7f6c8407b850 msgr2=0x7f6c84107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:42.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.825+0000 7f6c89fc7640 1 -- 172.21.15.46:0/1248312710 shutdown_connections 2024-09-21T03:57:42.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:42.825+0000 7f6c89fc7640 1 -- 172.21.15.46:0/1248312710 wait complete. 2024-09-21T03:57:43.613 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:57:43.613 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:57:43.882 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:57:44.120 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:43 smithi105 ceph-mon[34773]: pgmap v400: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T03:57:44.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:43 smithi162 ceph-mon[35071]: pgmap v400: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T03:57:44.139 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:43 smithi046 ceph-mon[30954]: pgmap v400: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T03:57:44.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.389+0000 7f2bac175640 1 -- 172.21.15.46:0/3491313520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ba4103b60 msgr2=0x7f2ba4103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:44.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.389+0000 7f2bac175640 1 --2- 172.21.15.46:0/3491313520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ba4103b60 0x7f2ba4103f70 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0009ca0 tx=0x7f2ba002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:57:44.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.389+0000 7f2bac175640 1 -- 172.21.15.46:0/3491313520 shutdown_connections 2024-09-21T03:57:44.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.389+0000 7f2bac175640 1 --2- 172.21.15.46:0/3491313520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ba4109df0 0x7f2ba4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:44.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.389+0000 7f2bac175640 1 --2- 172.21.15.46:0/3491313520 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ba41094a0 0x7f2ba41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:44.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.389+0000 7f2bac175640 1 --2- 172.21.15.46:0/3491313520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ba4103b60 0x7f2ba4103f70 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:44.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.389+0000 7f2bac175640 1 -- 172.21.15.46:0/3491313520 >> 172.21.15.46:0/3491313520 conn(0x7f2ba407b850 msgr2=0x7f2ba407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:44.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.389+0000 7f2bac175640 1 -- 172.21.15.46:0/3491313520 shutdown_connections 2024-09-21T03:57:44.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.389+0000 7f2bac175640 1 -- 172.21.15.46:0/3491313520 wait complete. 2024-09-21T03:57:44.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.389+0000 7f2bac175640 1 Processor -- start 2024-09-21T03:57:44.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.390+0000 7f2bac175640 1 -- start start 2024-09-21T03:57:44.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.390+0000 7f2bac175640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ba4103b60 0x7f2ba419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:44.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.390+0000 7f2bac175640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ba41094a0 0x7f2ba419aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:44.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.390+0000 7f2bac175640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ba4109df0 0x7f2ba419fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:44.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.390+0000 7f2bac175640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba4113ab0 con 0x7f2ba4109df0 2024-09-21T03:57:44.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.390+0000 7f2bac175640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba4113930 con 0x7f2ba4103b60 2024-09-21T03:57:44.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.390+0000 7f2bac175640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba4113c30 con 0x7f2ba41094a0 2024-09-21T03:57:44.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.390+0000 7f2baa712640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ba4109df0 0x7f2ba419fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:44.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.390+0000 7f2baa712640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ba4109df0 0x7f2ba419fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57382/0 (socket says 172.21.15.46:57382) 2024-09-21T03:57:44.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.390+0000 7f2baa712640 1 -- 172.21.15.46:0/1400728291 learned_addr learned my addr 172.21.15.46:0/1400728291 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:44.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.390+0000 7f2ba9f11640 1 --2- 172.21.15.46:0/1400728291 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ba4103b60 0x7f2ba419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:44.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.390+0000 7f2ba9710640 1 --2- 172.21.15.46:0/1400728291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ba41094a0 0x7f2ba419aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:44.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.390+0000 7f2baa712640 1 -- 172.21.15.46:0/1400728291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ba41094a0 msgr2=0x7f2ba419aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:44.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.390+0000 7f2baa712640 1 --2- 172.21.15.46:0/1400728291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ba41094a0 0x7f2ba419aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:44.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.390+0000 7f2baa712640 1 -- 172.21.15.46:0/1400728291 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ba4103b60 msgr2=0x7f2ba419a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:44.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.390+0000 7f2baa712640 1 --2- 172.21.15.46:0/1400728291 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ba4103b60 0x7f2ba419a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:44.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.390+0000 7f2baa712640 1 -- 172.21.15.46:0/1400728291 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ba41a03f0 con 0x7f2ba4109df0 2024-09-21T03:57:44.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.390+0000 7f2ba9710640 1 --2- 172.21.15.46:0/1400728291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ba41094a0 0x7f2ba419aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:57:44.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.391+0000 7f2baa712640 1 --2- 172.21.15.46:0/1400728291 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ba4109df0 0x7f2ba419fcc0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c00d750 tx=0x7f2b9c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:44.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.391+0000 7f2b96ffd640 1 -- 172.21.15.46:0/1400728291 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c017070 con 0x7f2ba4109df0 2024-09-21T03:57:44.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.391+0000 7f2bac175640 1 -- 172.21.15.46:0/1400728291 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ba41a06e0 con 0x7f2ba4109df0 2024-09-21T03:57:44.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.391+0000 7f2b96ffd640 1 -- 172.21.15.46:0/1400728291 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b9c0054d0 con 0x7f2ba4109df0 2024-09-21T03:57:44.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.391+0000 7f2b96ffd640 1 -- 172.21.15.46:0/1400728291 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c004c60 con 0x7f2ba4109df0 2024-09-21T03:57:44.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.391+0000 7f2bac175640 1 -- 172.21.15.46:0/1400728291 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ba41a6e40 con 0x7f2ba4109df0 2024-09-21T03:57:44.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.392+0000 7f2bac175640 1 -- 172.21.15.46:0/1400728291 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ba4103f70 con 0x7f2ba4109df0 2024-09-21T03:57:44.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.394+0000 7f2b96ffd640 1 -- 172.21.15.46:0/1400728291 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f2b9c009bd0 con 0x7f2ba4109df0 2024-09-21T03:57:44.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.394+0000 7f2b96ffd640 1 --2- 172.21.15.46:0/1400728291 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f2b900b6680 0x7f2b900b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:44.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.395+0000 7f2ba9f11640 1 --2- 172.21.15.46:0/1400728291 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f2b900b6680 0x7f2b900b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:44.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.395+0000 7f2b96ffd640 1 -- 172.21.15.46:0/1400728291 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f2b9c0e7430 con 0x7f2ba4109df0 2024-09-21T03:57:44.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.395+0000 7f2ba9f11640 1 --2- 172.21.15.46:0/1400728291 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f2b900b6680 0x7f2b900b8b90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0005e30 tx=0x7f2ba0009360 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:44.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.398+0000 7f2b96ffd640 1 -- 172.21.15.46:0/1400728291 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2b9c0ada20 con 0x7f2ba4109df0 2024-09-21T03:57:44.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.627+0000 7f2bac175640 1 -- 172.21.15.46:0/1400728291 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ba419b5b0 con 0x7f2ba4109df0 2024-09-21T03:57:44.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.627+0000 7f2b96ffd640 1 -- 172.21.15.46:0/1400728291 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f2ba419b5b0 con 0x7f2ba4109df0 2024-09-21T03:57:44.630 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:57:44.630 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"btime":"2024-09-21T03:53:23:865820+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1766354184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1766354184},{"type":"v1","addr":"172.21.15.46:6839","nonce":1766354184}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/1901774207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":1901774207},{"type":"v1","addr":"172.21.15.46:6841","nonce":1901774207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3548633196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":3548633196},{"type":"v1","addr":"172.21.15.105:6837","nonce":3548633196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24652,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3551934241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3551934241},{"type":"v1","addr":"172.21.15.162:6835","nonce":3551934241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/48949822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":48949822},{"type":"v1","addr":"172.21.15.162:6837","nonce":48949822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:53:14.452819+0000","modified":"2024-09-21T03:53:23.593278+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24680},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/2196053213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2196053213},{"type":"v1","addr":"172.21.15.162:6839","nonce":2196053213}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.105:6839/3911438406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":3911438406},{"type":"v1","addr":"172.21.15.105:6839","nonce":3911438406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24680,"qdb_cluster":[24680]},"id":1}]} 2024-09-21T03:57:44.630 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T03:57:44.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.630+0000 7f2bac175640 1 -- 172.21.15.46:0/1400728291 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f2b900b6680 msgr2=0x7f2b900b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:44.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.630+0000 7f2bac175640 1 --2- 172.21.15.46:0/1400728291 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f2b900b6680 0x7f2b900b8b90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0005e30 tx=0x7f2ba0009360 comp rx=0 tx=0).stop 2024-09-21T03:57:44.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.630+0000 7f2bac175640 1 -- 172.21.15.46:0/1400728291 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ba4109df0 msgr2=0x7f2ba419fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:44.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.630+0000 7f2bac175640 1 --2- 172.21.15.46:0/1400728291 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ba4109df0 0x7f2ba419fcc0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c00d750 tx=0x7f2b9c00dc10 comp rx=0 tx=0).stop 2024-09-21T03:57:44.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.630+0000 7f2bac175640 1 -- 172.21.15.46:0/1400728291 shutdown_connections 2024-09-21T03:57:44.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.630+0000 7f2bac175640 1 --2- 172.21.15.46:0/1400728291 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ba4109df0 0x7f2ba419fcc0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:44.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.630+0000 7f2bac175640 1 --2- 172.21.15.46:0/1400728291 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f2b900b6680 0x7f2b900b8b90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:44.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.630+0000 7f2bac175640 1 --2- 172.21.15.46:0/1400728291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ba41094a0 0x7f2ba419aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:44.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.630+0000 7f2bac175640 1 --2- 172.21.15.46:0/1400728291 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ba4103b60 0x7f2ba419a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:44.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.630+0000 7f2bac175640 1 -- 172.21.15.46:0/1400728291 >> 172.21.15.46:0/1400728291 conn(0x7f2ba407b850 msgr2=0x7f2ba4107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:44.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.630+0000 7f2bac175640 1 -- 172.21.15.46:0/1400728291 shutdown_connections 2024-09-21T03:57:44.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:44.630+0000 7f2bac175640 1 -- 172.21.15.46:0/1400728291 wait complete. 2024-09-21T03:57:44.993 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:44 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/1400728291' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:57:45.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:44 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/1400728291' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:57:45.317 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:44 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/1400728291' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:57:45.334 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:57:45.596 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:57:45.990 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:45 smithi046 ceph-mon[30954]: pgmap v401: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:57:46.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.082+0000 7fcc0dd21640 1 -- 172.21.15.46:0/976569735 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc081048a0 msgr2=0x7fcc08104cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:46.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.082+0000 7fcc0dd21640 1 --2- 172.21.15.46:0/976569735 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc081048a0 0x7fcc08104cb0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8009900 tx=0x7fcbf802a410 comp rx=0 tx=0).stop 2024-09-21T03:57:46.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.082+0000 7fcc0dd21640 1 -- 172.21.15.46:0/976569735 shutdown_connections 2024-09-21T03:57:46.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.082+0000 7fcc0dd21640 1 --2- 172.21.15.46:0/976569735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc0810de50 0x7fcc081102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:46.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.082+0000 7fcc0dd21640 1 --2- 172.21.15.46:0/976569735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc081052d0 0x7fcc0810d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:46.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.082+0000 7fcc0dd21640 1 --2- 172.21.15.46:0/976569735 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc081048a0 0x7fcc08104cb0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:46.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.082+0000 7fcc0dd21640 1 -- 172.21.15.46:0/976569735 >> 172.21.15.46:0/976569735 conn(0x7fcc08079730 msgr2=0x7fcc08079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:46.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.082+0000 7fcc0dd21640 1 -- 172.21.15.46:0/976569735 shutdown_connections 2024-09-21T03:57:46.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.082+0000 7fcc0dd21640 1 -- 172.21.15.46:0/976569735 wait complete. 2024-09-21T03:57:46.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.083+0000 7fcc0dd21640 1 Processor -- start 2024-09-21T03:57:46.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.083+0000 7fcc0dd21640 1 -- start start 2024-09-21T03:57:46.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.083+0000 7fcc0dd21640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc081048a0 0x7fcc0819a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:46.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.083+0000 7fcc0dd21640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc081052d0 0x7fcc0819aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:46.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.083+0000 7fcc0dd21640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc0810de50 0x7fcc0819fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:46.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.083+0000 7fcc0dd21640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fcc08113ac0 con 0x7fcc081052d0 2024-09-21T03:57:46.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.083+0000 7fcc0dd21640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcc08113940 con 0x7fcc0810de50 2024-09-21T03:57:46.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.083+0000 7fcc0dd21640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcc08113c40 con 0x7fcc081048a0 2024-09-21T03:57:46.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.083+0000 7fcc06ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc081052d0 0x7fcc0819aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:46.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.084+0000 7fcc06ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc081052d0 0x7fcc0819aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57396/0 (socket says 172.21.15.46:57396) 2024-09-21T03:57:46.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.084+0000 7fcc077fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc081048a0 0x7fcc0819a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:46.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.084+0000 7fcc06ffd640 1 -- 172.21.15.46:0/3708621119 learned_addr learned my addr 172.21.15.46:0/3708621119 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:46.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.084+0000 7fcc07fff640 1 --2- 172.21.15.46:0/3708621119 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc0810de50 0x7fcc0819fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:46.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.084+0000 7fcc06ffd640 1 -- 172.21.15.46:0/3708621119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc081048a0 msgr2=0x7fcc0819a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:46.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.084+0000 7fcc06ffd640 1 --2- 172.21.15.46:0/3708621119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc081048a0 0x7fcc0819a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:46.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.084+0000 7fcc06ffd640 1 -- 172.21.15.46:0/3708621119 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc0810de50 msgr2=0x7fcc0819fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:46.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.084+0000 7fcc06ffd640 1 --2- 172.21.15.46:0/3708621119 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc0810de50 0x7fcc0819fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:46.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.084+0000 7fcc06ffd640 1 -- 172.21.15.46:0/3708621119 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc081a0480 con 0x7fcc081052d0 2024-09-21T03:57:46.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.084+0000 7fcc06ffd640 1 --2- 172.21.15.46:0/3708621119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc081052d0 0x7fcc0819aab0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fcbf000b9c0 tx=0x7fcbf000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:46.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.084+0000 7fcc04ff9640 1 -- 172.21.15.46:0/3708621119 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf0019070 con 0x7fcc081052d0 2024-09-21T03:57:46.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.084+0000 7fcc04ff9640 1 -- 172.21.15.46:0/3708621119 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcbf000cba0 con 0x7fcc081052d0 2024-09-21T03:57:46.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.084+0000 7fcc0dd21640 1 -- 172.21.15.46:0/3708621119 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc081a0770 con 0x7fcc081052d0 2024-09-21T03:57:46.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.084+0000 7fcc04ff9640 1 -- 172.21.15.46:0/3708621119 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf00125a0 con 0x7fcc081052d0 2024-09-21T03:57:46.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.084+0000 7fcc0dd21640 1 -- 172.21.15.46:0/3708621119 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc081a6ed0 con 0x7fcc081052d0 2024-09-21T03:57:46.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.087+0000 7fcc14295740 1 Processor -- start 2024-09-21T03:57:46.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.087+0000 7fcc14295740 1 -- start start 2024-09-21T03:57:46.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.087+0000 7fcc14295740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a0e4d4070 0x560a0e87b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:46.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.087+0000 7fcc14295740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560a0e4ab1b0 0x560a0e87b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:46.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.087+0000 7fcc14295740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a0e4b3390 0x560a0e87bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:46.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.087+0000 7fcc14295740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x560a0e7f1ea0 con 0x560a0e4ab1b0 2024-09-21T03:57:46.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.087+0000 7fcc14295740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x560a0e7e12d0 con 0x560a0e4b3390 2024-09-21T03:57:46.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.087+0000 7fcc14295740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560a0e7e50e0 con 0x560a0e4d4070 2024-09-21T03:57:46.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.087+0000 7fcc077fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560a0e4ab1b0 0x560a0e87b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:46.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.087+0000 7fcc077fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560a0e4ab1b0 0x560a0e87b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57412/0 (socket says 172.21.15.46:57412) 2024-09-21T03:57:46.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.087+0000 7fcc077fe640 1 -- 172.21.15.46:0/392952915 learned_addr learned my addr 172.21.15.46:0/392952915 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:46.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.087+0000 7fcc07fff640 1 --2- 172.21.15.46:0/392952915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a0e4d4070 0x560a0e87b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:46.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.088+0000 7fcc077fe640 1 -- 172.21.15.46:0/392952915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a0e4d4070 msgr2=0x560a0e87b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:46.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.088+0000 7fcc077fe640 1 --2- 172.21.15.46:0/392952915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a0e4d4070 0x560a0e87b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:46.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.088+0000 7fcc04ff9640 1 -- 172.21.15.46:0/3708621119 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7fcbf001c070 con 0x7fcc081052d0 2024-09-21T03:57:46.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.088+0000 7fcc077fe640 1 -- 172.21.15.46:0/392952915 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a0e4b3390 msgr2=0x560a0e87bd40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T03:57:46.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.088+0000 7fcc077fe640 1 --2- 172.21.15.46:0/392952915 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a0e4b3390 0x560a0e87bd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:46.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.088+0000 7fcc077fe640 1 -- 172.21.15.46:0/392952915 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a0e53f650 con 0x560a0e4ab1b0 2024-09-21T03:57:46.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.088+0000 7fcc077fe640 1 --2- 172.21.15.46:0/392952915 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560a0e4ab1b0 0x560a0e87b800 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fcc0806bba0 tx=0x7fcbf8032df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12ef082bca85866 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:46.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.088+0000 7fcbfdffb640 1 -- 172.21.15.46:0/392952915 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf8040070 con 0x560a0e4ab1b0 2024-09-21T03:57:46.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.088+0000 7fcbfdffb640 1 -- 172.21.15.46:0/392952915 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcbf8005db0 con 0x560a0e4ab1b0 2024-09-21T03:57:46.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.088+0000 7fcbfdffb640 1 -- 172.21.15.46:0/392952915 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf8035040 con 0x560a0e4ab1b0 2024-09-21T03:57:46.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.089+0000 7fcc04ff9640 1 --2- 172.21.15.46:0/3708621119 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fcbf40b6680 0x7fcbf40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:46.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.089+0000 7fcc07fff640 1 --2- 172.21.15.46:0/3708621119 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fcbf40b6680 0x7fcbf40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:46.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.089+0000 7fcc04ff9640 1 -- 172.21.15.46:0/3708621119 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fcbf00e6b70 con 0x7fcc081052d0 2024-09-21T03:57:46.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.089+0000 7fcc14295740 1 -- 172.21.15.46:0/392952915 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560a0e4ab1b0 msgr2=0x560a0e87b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:46.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.089+0000 7fcc14295740 1 --2- 172.21.15.46:0/392952915 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560a0e4ab1b0 0x560a0e87b800 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fcc0806bba0 tx=0x7fcbf8032df0 comp rx=0 tx=0).stop 2024-09-21T03:57:46.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.089+0000 7fcc14295740 1 -- 172.21.15.46:0/392952915 shutdown_connections 2024-09-21T03:57:46.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.089+0000 7fcc14295740 1 --2- 172.21.15.46:0/392952915 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a0e4b3390 0x560a0e87bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:46.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.089+0000 7fcc14295740 1 --2- 172.21.15.46:0/392952915 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560a0e4ab1b0 0x560a0e87b800 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:46.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.089+0000 7fcc14295740 1 --2- 172.21.15.46:0/392952915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a0e4d4070 0x560a0e87b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:46.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.089+0000 7fcc14295740 1 -- 172.21.15.46:0/392952915 >> 172.21.15.46:0/392952915 conn(0x560a0e4c8460 msgr2=0x560a0e8791b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:46.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.089+0000 7fcc07fff640 1 --2- 172.21.15.46:0/3708621119 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fcbf40b6680 0x7fcbf40b8b90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fcc0000b7f0 tx=0x7fcc0000b2e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:46.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.089+0000 7fcc14295740 1 -- 172.21.15.46:0/392952915 shutdown_connections 2024-09-21T03:57:46.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.089+0000 7fcc14295740 1 -- 172.21.15.46:0/392952915 wait complete. 2024-09-21T03:57:46.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.090+0000 7fcc14295740 1 -- start start 2024-09-21T03:57:46.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.090+0000 7fcc14295740 1 Processor -- start 2024-09-21T03:57:46.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.090+0000 7fcc14295740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560a0e4ab1b0 0x560a0e88ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:46.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.090+0000 7fcc14295740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a0e4b3390 0x560a0e88b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:46.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.090+0000 7fcc14295740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a0e4d4070 0x560a0e897100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:46.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.090+0000 7fcc14295740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x560a0e642700 con 0x560a0e4ab1b0 2024-09-21T03:57:46.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.090+0000 7fcc14295740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x560a0e77c160 con 0x560a0e4b3390 2024-09-21T03:57:46.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.090+0000 7fcc14295740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560a0e88dda0 con 0x560a0e4d4070 2024-09-21T03:57:46.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.090+0000 7fcc14295740 10 client.0 _ll_register_callbacks cb 0x560a0e7959e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:57:46.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.090+0000 7fcc077fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560a0e4ab1b0 0x560a0e88ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:46.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.090+0000 7fcc077fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560a0e4ab1b0 0x560a0e88ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57414/0 (socket says 172.21.15.46:57414) 2024-09-21T03:57:46.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.090+0000 7fcc077fe640 1 -- 172.21.15.46:0/2936851390 learned_addr learned my addr 172.21.15.46:0/2936851390 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:46.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.090+0000 7fcc07fff640 1 --2- 172.21.15.46:0/2936851390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a0e4d4070 0x560a0e897100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:46.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.091+0000 7fcc06ffd640 1 --2- 172.21.15.46:0/2936851390 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a0e4b3390 0x560a0e88b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:46.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.091+0000 7fcc077fe640 1 -- 172.21.15.46:0/2936851390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a0e4d4070 msgr2=0x560a0e897100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:46.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.091+0000 7fcc077fe640 1 --2- 172.21.15.46:0/2936851390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a0e4d4070 0x560a0e897100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:46.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.091+0000 7fcc077fe640 1 -- 172.21.15.46:0/2936851390 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a0e4b3390 msgr2=0x560a0e88b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:46.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.091+0000 7fcc077fe640 1 --2- 172.21.15.46:0/2936851390 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a0e4b3390 0x560a0e88b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:46.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.091+0000 7fcc077fe640 1 -- 172.21.15.46:0/2936851390 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a0e7a9c90 con 0x560a0e4ab1b0 2024-09-21T03:57:46.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.091+0000 7fcc06ffd640 1 --2- 172.21.15.46:0/2936851390 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a0e4b3390 0x560a0e88b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:57:46.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.091+0000 7fcc077fe640 1 --2- 172.21.15.46:0/2936851390 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560a0e4ab1b0 0x560a0e88ae40 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fcbf802a930 tx=0x7fcbf80051c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b8256af460a521b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:46.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.091+0000 7fcbe6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:57:46.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.091+0000 7fcbe6ffd640 1 -- 172.21.15.46:0/2936851390 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf804b070 con 0x560a0e4ab1b0 2024-09-21T03:57:46.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.091+0000 7fcc14295740 1 -- 172.21.15.46:0/2936851390 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbf8005db0 con 0x560a0e4ab1b0 2024-09-21T03:57:46.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.091+0000 7fcbe6ffd640 1 -- 172.21.15.46:0/2936851390 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fcbf8004750 con 0x560a0e4ab1b0 2024-09-21T03:57:46.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.091+0000 7fcbe6ffd640 1 -- 172.21.15.46:0/2936851390 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fcbf8057050 con 0x560a0e4ab1b0 2024-09-21T03:57:46.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.091+0000 7fcc14295740 10 client.15843 fetch_fsmap learned FSMap version 20 2024-09-21T03:57:46.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.091+0000 7fcc14295740 1 -- 172.21.15.46:0/2936851390 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560a0e899ba0 con 0x560a0e4ab1b0 2024-09-21T03:57:46.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.092+0000 7fcbe6ffd640 1 -- 172.21.15.46:0/2936851390 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcbf8005db0 con 0x560a0e4ab1b0 2024-09-21T03:57:46.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.092+0000 7fcbe6ffd640 1 -- 172.21.15.46:0/2936851390 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fcbf803c850 con 0x560a0e4ab1b0 2024-09-21T03:57:46.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.092+0000 7fcc14295740 10 client.15843 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:57:46.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.092+0000 7fcc14295740 10 client.15843 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:57:46.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.092+0000 7fcc14295740 20 client.15843 populate_metadata read hostname 'smithi046' 2024-09-21T03:57:46.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.092+0000 7fcc14295740 1 --2- 172.21.15.46:0/2936851390 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560a0e4929f0 0x560a0e89cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:46.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.092+0000 7fcc14295740 4 client.15843 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:57:46.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.092+0000 7fcc14295740 1 -- 172.21.15.46:0/2936851390 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a0e7f3df0 con 0x560a0e4929f0 2024-09-21T03:57:46.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.092+0000 7fcc06ffd640 1 --2- 172.21.15.46:0/2936851390 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560a0e4929f0 0x560a0e89cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:46.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.093+0000 7fcbe6ffd640 10 client.15843 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:57:46.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.093+0000 7fcc06ffd640 1 --2- 172.21.15.46:0/2936851390 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560a0e4929f0 0x560a0e89cf00 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86fbcdb9df3418 server_cookie=edd28d31fd212c89 in_seq=0 out_seq=0 2024-09-21T03:57:46.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.093+0000 7fcbe6ffd640 1 -- 172.21.15.46:0/2936851390 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560a0e7f3df0 con 0x560a0e4929f0 2024-09-21T03:57:46.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.093+0000 7fcbe6ffd640 10 client.15843 handle_command_reply: tid=0 2024-09-21T03:57:46.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.093+0000 7fcc14295740 1 client.15843 shutdown 2024-09-21T03:57:46.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.094+0000 7fcc14295740 1 -- 172.21.15.46:0/2936851390 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560a0e4ab1b0 msgr2=0x560a0e88ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:46.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.094+0000 7fcc14295740 1 --2- 172.21.15.46:0/2936851390 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560a0e4ab1b0 0x560a0e88ae40 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fcbf802a930 tx=0x7fcbf80051c0 comp rx=0 tx=0).stop 2024-09-21T03:57:46.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.094+0000 7fcc14295740 1 -- 172.21.15.46:0/2936851390 shutdown_connections 2024-09-21T03:57:46.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.094+0000 7fcc14295740 1 --2- 172.21.15.46:0/2936851390 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560a0e4929f0 0x560a0e89cf00 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:46.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.094+0000 7fcc14295740 1 --2- 172.21.15.46:0/2936851390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a0e4d4070 0x560a0e897100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:46.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.094+0000 7fcc14295740 1 --2- 172.21.15.46:0/2936851390 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a0e4b3390 0x560a0e88b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:46.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.094+0000 7fcbe6ffd640 0 client.15843 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:57:46.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.094+0000 7fcc14295740 1 --2- 172.21.15.46:0/2936851390 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560a0e4ab1b0 0x560a0e88ae40 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:46.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.094+0000 7fcc14295740 1 -- 172.21.15.46:0/2936851390 >> 172.21.15.46:0/2936851390 conn(0x560a0e4c8460 msgr2=0x560a0e87ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:46.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.094+0000 7fcc14295740 1 -- 172.21.15.46:0/2936851390 shutdown_connections 2024-09-21T03:57:46.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.094+0000 7fcc14295740 1 -- 172.21.15.46:0/2936851390 wait complete. 2024-09-21T03:57:46.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.094+0000 7fcc14295740 20 client.15843 trim_cache size 0 max 16384 2024-09-21T03:57:46.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.107+0000 7fcc14295740 1 Processor -- start 2024-09-21T03:57:46.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.107+0000 7fcc14295740 1 -- start start 2024-09-21T03:57:46.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.107+0000 7fcc14295740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a0e4ab1b0 0x560a0e88cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:46.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.107+0000 7fcc14295740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a0e4b3390 0x560a0e87ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:46.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.107+0000 7fcc14295740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560a0e4d4070 0x560a0e897070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:46.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.107+0000 7fcc14295740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fcc081ab280 con 0x560a0e4d4070 2024-09-21T03:57:46.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.107+0000 7fcc14295740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcc081adae0 con 0x560a0e4b3390 2024-09-21T03:57:46.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.107+0000 7fcc14295740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcc081ab8d0 con 0x560a0e4ab1b0 2024-09-21T03:57:46.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.107+0000 7fcc07fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560a0e4d4070 0x560a0e897070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:46.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.108+0000 7fcc07fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560a0e4d4070 0x560a0e897070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57428/0 (socket says 172.21.15.46:57428) 2024-09-21T03:57:46.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.108+0000 7fcc07fff640 1 -- 172.21.15.46:0/1005500473 learned_addr learned my addr 172.21.15.46:0/1005500473 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:46.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.108+0000 7fcc077fe640 1 --2- 172.21.15.46:0/1005500473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a0e4ab1b0 0x560a0e88cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:46.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.108+0000 7fcc06ffd640 1 --2- 172.21.15.46:0/1005500473 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a0e4b3390 0x560a0e87ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:46.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.108+0000 7fcc07fff640 1 -- 172.21.15.46:0/1005500473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a0e4ab1b0 msgr2=0x560a0e88cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:46.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.108+0000 7fcc07fff640 1 --2- 172.21.15.46:0/1005500473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a0e4ab1b0 0x560a0e88cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:46.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.108+0000 7fcc07fff640 1 -- 172.21.15.46:0/1005500473 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a0e4b3390 msgr2=0x560a0e87ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:46.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.108+0000 7fcc07fff640 1 --2- 172.21.15.46:0/1005500473 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a0e4b3390 0x560a0e87ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:46.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.108+0000 7fcc07fff640 1 -- 172.21.15.46:0/1005500473 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a0e8733b0 con 0x560a0e4d4070 2024-09-21T03:57:46.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.108+0000 7fcc07fff640 1 --2- 172.21.15.46:0/1005500473 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560a0e4d4070 0x560a0e897070 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fcc00003f10 tx=0x7fcc00016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed26c8b165f2418 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:46.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.108+0000 7fcbfd7fa640 1 -- 172.21.15.46:0/1005500473 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc0002d070 con 0x560a0e4d4070 2024-09-21T03:57:46.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.108+0000 7fcbfd7fa640 1 -- 172.21.15.46:0/1005500473 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc0000be50 con 0x560a0e4d4070 2024-09-21T03:57:46.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.108+0000 7fcbfd7fa640 1 -- 172.21.15.46:0/1005500473 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc0001c600 con 0x560a0e4d4070 2024-09-21T03:57:46.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.109+0000 7fcc14295740 1 -- 172.21.15.46:0/1005500473 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560a0e4d4070 msgr2=0x560a0e897070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:46.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.109+0000 7fcc14295740 1 --2- 172.21.15.46:0/1005500473 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560a0e4d4070 0x560a0e897070 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fcc00003f10 tx=0x7fcc00016000 comp rx=0 tx=0).stop 2024-09-21T03:57:46.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.109+0000 7fcc14295740 1 -- 172.21.15.46:0/1005500473 shutdown_connections 2024-09-21T03:57:46.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.109+0000 7fcc14295740 1 --2- 172.21.15.46:0/1005500473 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560a0e4d4070 0x560a0e897070 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:46.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.109+0000 7fcc14295740 1 --2- 172.21.15.46:0/1005500473 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a0e4b3390 0x560a0e87ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:46.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.109+0000 7fcc14295740 1 --2- 172.21.15.46:0/1005500473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a0e4ab1b0 0x560a0e88cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:46.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.109+0000 7fcc14295740 1 -- 172.21.15.46:0/1005500473 >> 172.21.15.46:0/1005500473 conn(0x560a0e4c8460 msgr2=0x560a0e87c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:46.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.109+0000 7fcc14295740 1 -- 172.21.15.46:0/1005500473 shutdown_connections 2024-09-21T03:57:46.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.109+0000 7fcc14295740 1 -- 172.21.15.46:0/1005500473 wait complete. 2024-09-21T03:57:46.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.110+0000 7fcc14295740 1 -- start start 2024-09-21T03:57:46.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.110+0000 7fcc14295740 1 Processor -- start 2024-09-21T03:57:46.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.110+0000 7fcc14295740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560a0e4ab1b0 0x560a0e8fb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:46.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.110+0000 7fcc14295740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a0e4b3390 0x560a0e8fbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:46.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.110+0000 7fcc14295740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a0e4d4070 0x560a0e906690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:46.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.110+0000 7fcc14295740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fcc081abfa0 con 0x560a0e4ab1b0 2024-09-21T03:57:46.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.110+0000 7fcc14295740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcc081ad410 con 0x560a0e4b3390 2024-09-21T03:57:46.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.110+0000 7fcc14295740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcc081ac670 con 0x560a0e4d4070 2024-09-21T03:57:46.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.110+0000 7fcc14295740 10 client.0 _ll_register_callbacks cb 0x7fcc00004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:57:46.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.110+0000 7fcc077fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560a0e4ab1b0 0x560a0e8fb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:46.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.110+0000 7fcc077fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560a0e4ab1b0 0x560a0e8fb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57434/0 (socket says 172.21.15.46:57434) 2024-09-21T03:57:46.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.110+0000 7fcc077fe640 1 -- 172.21.15.46:0/670809662 learned_addr learned my addr 172.21.15.46:0/670809662 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:46.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.110+0000 7fcc06ffd640 1 --2- 172.21.15.46:0/670809662 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a0e4b3390 0x560a0e8fbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:46.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.110+0000 7fcc07fff640 1 --2- 172.21.15.46:0/670809662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a0e4d4070 0x560a0e906690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:46.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.111+0000 7fcc077fe640 1 -- 172.21.15.46:0/670809662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a0e4d4070 msgr2=0x560a0e906690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:46.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.111+0000 7fcc077fe640 1 --2- 172.21.15.46:0/670809662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a0e4d4070 0x560a0e906690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:46.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.111+0000 7fcc077fe640 1 -- 172.21.15.46:0/670809662 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a0e4b3390 msgr2=0x560a0e8fbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:46.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.111+0000 7fcc077fe640 1 --2- 172.21.15.46:0/670809662 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a0e4b3390 0x560a0e8fbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:46.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.111+0000 7fcc077fe640 1 -- 172.21.15.46:0/670809662 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a0e87c100 con 0x560a0e4ab1b0 2024-09-21T03:57:46.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.111+0000 7fcc07fff640 1 --2- 172.21.15.46:0/670809662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a0e4d4070 0x560a0e906690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:57:46.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.111+0000 7fcc077fe640 1 --2- 172.21.15.46:0/670809662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560a0e4ab1b0 0x560a0e8fb810 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x560a0e873580 tx=0x7fcbf8031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b721b36aae9066f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:46.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.111+0000 7fcbe6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:57:46.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.111+0000 7fcbe6ffd640 1 -- 172.21.15.46:0/670809662 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf804b070 con 0x560a0e4ab1b0 2024-09-21T03:57:46.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.111+0000 7fcbe6ffd640 1 -- 172.21.15.46:0/670809662 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fcbf8004440 con 0x560a0e4ab1b0 2024-09-21T03:57:46.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.111+0000 7fcc14295740 1 -- 172.21.15.46:0/670809662 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc0000be50 con 0x560a0e4ab1b0 2024-09-21T03:57:46.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.111+0000 7fcbe6ffd640 1 -- 172.21.15.46:0/670809662 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fcbf8060030 con 0x560a0e4ab1b0 2024-09-21T03:57:46.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.111+0000 7fcc14295740 10 client.15849 fetch_fsmap learned FSMap version 20 2024-09-21T03:57:46.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.111+0000 7fcc14295740 1 -- 172.21.15.46:0/670809662 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560a0e907c50 con 0x560a0e4ab1b0 2024-09-21T03:57:46.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.111+0000 7fcbe6ffd640 1 -- 172.21.15.46:0/670809662 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc0000be50 con 0x560a0e4ab1b0 2024-09-21T03:57:46.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.112+0000 7fcbe6ffd640 1 -- 172.21.15.46:0/670809662 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fcbf8031c10 con 0x560a0e4ab1b0 2024-09-21T03:57:46.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.112+0000 7fcc14295740 10 client.15849 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:57:46.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.112+0000 7fcc14295740 10 client.15849 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:57:46.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.112+0000 7fcc14295740 20 client.15849 populate_metadata read hostname 'smithi046' 2024-09-21T03:57:46.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.112+0000 7fcc14295740 1 --2- 172.21.15.46:0/670809662 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560a0e467da0 0x560a0e90a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:46.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.112+0000 7fcc14295740 4 client.15849 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:57:46.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.112+0000 7fcc14295740 1 -- 172.21.15.46:0/670809662 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560a0e7ef8a0 con 0x560a0e467da0 2024-09-21T03:57:46.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.112+0000 7fcc06ffd640 1 --2- 172.21.15.46:0/670809662 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560a0e467da0 0x560a0e90a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:46.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.112+0000 7fcc06ffd640 1 --2- 172.21.15.46:0/670809662 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560a0e467da0 0x560a0e90a390 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cad3b338f5eb5a04 server_cookie=ce41a20cb4e8a12b in_seq=0 out_seq=0 2024-09-21T03:57:46.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.112+0000 7fcbe6ffd640 10 client.15849 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:57:46.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.113+0000 7fcbe6ffd640 1 -- 172.21.15.46:0/670809662 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560a0e7ef8a0 con 0x560a0e467da0 2024-09-21T03:57:46.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.113+0000 7fcbe6ffd640 10 client.15849 handle_command_reply: tid=0 2024-09-21T03:57:46.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.113+0000 7fcc14295740 1 client.15849 shutdown 2024-09-21T03:57:46.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.113+0000 7fcc14295740 1 -- 172.21.15.46:0/670809662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560a0e4ab1b0 msgr2=0x560a0e8fb810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:46.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.113+0000 7fcc14295740 1 --2- 172.21.15.46:0/670809662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560a0e4ab1b0 0x560a0e8fb810 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x560a0e873580 tx=0x7fcbf8031400 comp rx=0 tx=0).stop 2024-09-21T03:57:46.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.113+0000 7fcc14295740 1 -- 172.21.15.46:0/670809662 shutdown_connections 2024-09-21T03:57:46.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.113+0000 7fcc14295740 1 --2- 172.21.15.46:0/670809662 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560a0e467da0 0x560a0e90a390 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:46.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.113+0000 7fcc14295740 1 --2- 172.21.15.46:0/670809662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560a0e4d4070 0x560a0e906690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:46.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.113+0000 7fcc14295740 1 --2- 172.21.15.46:0/670809662 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a0e4b3390 0x560a0e8fbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:46.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.113+0000 7fcbe6ffd640 0 client.15849 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:57:46.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.113+0000 7fcc14295740 1 --2- 172.21.15.46:0/670809662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560a0e4ab1b0 0x560a0e8fb810 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:46.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.113+0000 7fcc14295740 1 -- 172.21.15.46:0/670809662 >> 172.21.15.46:0/670809662 conn(0x560a0e4c8460 msgr2=0x560a0e88ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:46.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.113+0000 7fcc14295740 1 -- 172.21.15.46:0/670809662 shutdown_connections 2024-09-21T03:57:46.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.113+0000 7fcc14295740 1 -- 172.21.15.46:0/670809662 wait complete. 2024-09-21T03:57:46.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.113+0000 7fcc14295740 20 client.15849 trim_cache size 0 max 16384 2024-09-21T03:57:46.120 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-21T03:57:46.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.114+0000 7fcc0dd21640 1 -- 172.21.15.46:0/3708621119 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fcbf40b6680 msgr2=0x7fcbf40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:46.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.114+0000 7fcc0dd21640 1 --2- 172.21.15.46:0/3708621119 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fcbf40b6680 0x7fcbf40b8b90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fcc0000b7f0 tx=0x7fcc0000b2e0 comp rx=0 tx=0).stop 2024-09-21T03:57:46.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.114+0000 7fcc0dd21640 1 -- 172.21.15.46:0/3708621119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc081052d0 msgr2=0x7fcc0819aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:46.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.114+0000 7fcc0dd21640 1 --2- 172.21.15.46:0/3708621119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc081052d0 0x7fcc0819aab0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fcbf000b9c0 tx=0x7fcbf000be80 comp rx=0 tx=0).stop 2024-09-21T03:57:46.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.114+0000 7fcc0dd21640 1 -- 172.21.15.46:0/3708621119 shutdown_connections 2024-09-21T03:57:46.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.114+0000 7fcc0dd21640 1 --2- 172.21.15.46:0/3708621119 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc0810de50 0x7fcc0819fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:46.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.114+0000 7fcc0dd21640 1 --2- 172.21.15.46:0/3708621119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc081052d0 0x7fcc0819aab0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:46.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.114+0000 7fcc0dd21640 1 --2- 172.21.15.46:0/3708621119 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fcbf40b6680 0x7fcbf40b8b90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:46.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.114+0000 7fcc0dd21640 1 --2- 172.21.15.46:0/3708621119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc081048a0 0x7fcc0819a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:46.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.114+0000 7fcc0dd21640 1 -- 172.21.15.46:0/3708621119 >> 172.21.15.46:0/3708621119 conn(0x7fcc08079730 msgr2=0x7fcc08100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:46.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.114+0000 7fcc0dd21640 1 -- 172.21.15.46:0/3708621119 shutdown_connections 2024-09-21T03:57:46.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:46.114+0000 7fcc0dd21640 1 -- 172.21.15.46:0/3708621119 wait complete. 2024-09-21T03:57:46.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:45 smithi162 ceph-mon[35071]: pgmap v401: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:57:46.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:45 smithi105 ceph-mon[34773]: pgmap v401: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:57:47.906 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:57:47.906 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:57:48.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:47 smithi162 ceph-mon[35071]: pgmap v402: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:57:48.179 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:57:48.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:47 smithi046 ceph-mon[30954]: pgmap v402: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:57:48.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:47 smithi105 ceph-mon[34773]: pgmap v402: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:57:48.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.662+0000 7f5184246640 1 -- 172.21.15.46:0/3256779975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f517c109df0 msgr2=0x7f517c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:48.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.662+0000 7f5184246640 1 --2- 172.21.15.46:0/3256779975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f517c109df0 0x7f517c110620 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f5174009900 tx=0x7f517402a410 comp rx=0 tx=0).stop 2024-09-21T03:57:48.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.662+0000 7f5184246640 1 -- 172.21.15.46:0/3256779975 shutdown_connections 2024-09-21T03:57:48.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.662+0000 7f5184246640 1 --2- 172.21.15.46:0/3256779975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f517c109df0 0x7f517c110620 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:48.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.662+0000 7f5184246640 1 --2- 172.21.15.46:0/3256779975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f517c1094a0 0x7f517c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:48.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.662+0000 7f5184246640 1 --2- 172.21.15.46:0/3256779975 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f517c103b60 0x7f517c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:48.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.662+0000 7f5184246640 1 -- 172.21.15.46:0/3256779975 >> 172.21.15.46:0/3256779975 conn(0x7f517c07b850 msgr2=0x7f517c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:48.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.662+0000 7f5184246640 1 -- 172.21.15.46:0/3256779975 shutdown_connections 2024-09-21T03:57:48.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.662+0000 7f5184246640 1 -- 172.21.15.46:0/3256779975 wait complete. 2024-09-21T03:57:48.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.663+0000 7f5184246640 1 Processor -- start 2024-09-21T03:57:48.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.663+0000 7f5184246640 1 -- start start 2024-09-21T03:57:48.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.663+0000 7f5184246640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f517c103b60 0x7f517c19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:48.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.663+0000 7f5184246640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f517c1094a0 0x7f517c19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:48.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.663+0000 7f5184246640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f517c109df0 0x7f517c19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:48.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.664+0000 7f5184246640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f517c113ab0 con 0x7f517c1094a0 2024-09-21T03:57:48.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.664+0000 7f5184246640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f517c113930 con 0x7f517c109df0 2024-09-21T03:57:48.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.664+0000 7f5184246640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f517c113c30 con 0x7f517c103b60 2024-09-21T03:57:48.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.664+0000 7f51817e1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f517c1094a0 0x7f517c19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:48.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.664+0000 7f51817e1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f517c1094a0 0x7f517c19aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57450/0 (socket says 172.21.15.46:57450) 2024-09-21T03:57:48.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.664+0000 7f51817e1640 1 -- 172.21.15.46:0/4282356045 learned_addr learned my addr 172.21.15.46:0/4282356045 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:48.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.664+0000 7f51827e3640 1 --2- 172.21.15.46:0/4282356045 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f517c109df0 0x7f517c19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:48.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.664+0000 7f5181fe2640 1 --2- 172.21.15.46:0/4282356045 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f517c103b60 0x7f517c19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:48.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.664+0000 7f51817e1640 1 -- 172.21.15.46:0/4282356045 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f517c103b60 msgr2=0x7f517c19a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:48.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.664+0000 7f51817e1640 1 --2- 172.21.15.46:0/4282356045 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f517c103b60 0x7f517c19a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:48.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.664+0000 7f51817e1640 1 -- 172.21.15.46:0/4282356045 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f517c109df0 msgr2=0x7f517c19fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:48.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.664+0000 7f51817e1640 1 --2- 172.21.15.46:0/4282356045 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f517c109df0 0x7f517c19fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:48.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.664+0000 7f51817e1640 1 -- 172.21.15.46:0/4282356045 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f517c1a03f0 con 0x7f517c1094a0 2024-09-21T03:57:48.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.664+0000 7f51827e3640 1 --2- 172.21.15.46:0/4282356045 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f517c109df0 0x7f517c19fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:57:48.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.664+0000 7f51817e1640 1 --2- 172.21.15.46:0/4282356045 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f517c1094a0 0x7f517c19aa20 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f517000d750 tx=0x7f517000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:48.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.664+0000 7f517affd640 1 -- 172.21.15.46:0/4282356045 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5170017070 con 0x7f517c1094a0 2024-09-21T03:57:48.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.664+0000 7f517affd640 1 -- 172.21.15.46:0/4282356045 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51700054d0 con 0x7f517c1094a0 2024-09-21T03:57:48.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.664+0000 7f5184246640 1 -- 172.21.15.46:0/4282356045 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f517c1a06e0 con 0x7f517c1094a0 2024-09-21T03:57:48.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.664+0000 7f517affd640 1 -- 172.21.15.46:0/4282356045 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5170004c30 con 0x7f517c1094a0 2024-09-21T03:57:48.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.665+0000 7f5184246640 1 -- 172.21.15.46:0/4282356045 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f517c1a6e40 con 0x7f517c1094a0 2024-09-21T03:57:48.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.667+0000 7f518a7ba740 1 Processor -- start 2024-09-21T03:57:48.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.668+0000 7f518a7ba740 1 -- start start 2024-09-21T03:57:48.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.668+0000 7f517affd640 1 -- 172.21.15.46:0/4282356045 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f5170004dd0 con 0x7f517c1094a0 2024-09-21T03:57:48.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.668+0000 7f518a7ba740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55da4c794350 0x55da4cb3b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:48.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.668+0000 7f518a7ba740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55da4c76b490 0x55da4cb3b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:48.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.668+0000 7f518a7ba740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55da4c773670 0x55da4cb3beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:48.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.668+0000 7f518a7ba740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55da4cab1e60 con 0x55da4c794350 2024-09-21T03:57:48.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.668+0000 7f518a7ba740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55da4caa1290 con 0x55da4c76b490 2024-09-21T03:57:48.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.668+0000 7f518a7ba740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55da4caa50a0 con 0x55da4c773670 2024-09-21T03:57:48.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.668+0000 7f51827e3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55da4c794350 0x55da4cb3b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:48.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.668+0000 7f51827e3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55da4c794350 0x55da4cb3b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57464/0 (socket says 172.21.15.46:57464) 2024-09-21T03:57:48.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.668+0000 7f51827e3640 1 -- 172.21.15.46:0/2373988627 learned_addr learned my addr 172.21.15.46:0/2373988627 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:48.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.668+0000 7f5181fe2640 1 --2- 172.21.15.46:0/2373988627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55da4c76b490 0x55da4cb3b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:48.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.668+0000 7f51817e1640 1 --2- 172.21.15.46:0/2373988627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55da4c773670 0x55da4cb3beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:48.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.669+0000 7f51827e3640 1 -- 172.21.15.46:0/2373988627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55da4c773670 msgr2=0x55da4cb3beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:48.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.669+0000 7f51827e3640 1 --2- 172.21.15.46:0/2373988627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55da4c773670 0x55da4cb3beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:48.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.669+0000 7f51827e3640 1 -- 172.21.15.46:0/2373988627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55da4c76b490 msgr2=0x55da4cb3b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:48.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.669+0000 7f51827e3640 1 --2- 172.21.15.46:0/2373988627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55da4c76b490 0x55da4cb3b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:48.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.669+0000 7f51827e3640 1 -- 172.21.15.46:0/2373988627 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da4c7ff930 con 0x55da4c794350 2024-09-21T03:57:48.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.669+0000 7f5181fe2640 1 --2- 172.21.15.46:0/2373988627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55da4c76b490 0x55da4cb3b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:57:48.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.669+0000 7f517affd640 1 --2- 172.21.15.46:0/4282356045 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f51640b6700 0x7f51640b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:48.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.669+0000 7f51827e3640 1 --2- 172.21.15.46:0/2373988627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55da4c794350 0x55da4cb3b430 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5174009900 tx=0x7f5174032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3799ad24b606b807 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:48.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.669+0000 7f5181fe2640 1 --2- 172.21.15.46:0/4282356045 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f51640b6700 0x7f51640b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:48.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.669+0000 7f517affd640 1 -- 172.21.15.46:0/4282356045 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f51700e7030 con 0x7f517c1094a0 2024-09-21T03:57:48.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.669+0000 7f5163fff640 1 -- 172.21.15.46:0/2373988627 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517403f070 con 0x55da4c794350 2024-09-21T03:57:48.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.669+0000 7f5163fff640 1 -- 172.21.15.46:0/2373988627 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5174032e50 con 0x55da4c794350 2024-09-21T03:57:48.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.669+0000 7f5163fff640 1 -- 172.21.15.46:0/2373988627 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5174035070 con 0x55da4c794350 2024-09-21T03:57:48.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.670+0000 7f518a7ba740 1 -- 172.21.15.46:0/2373988627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55da4c794350 msgr2=0x55da4cb3b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:48.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.670+0000 7f5181fe2640 1 --2- 172.21.15.46:0/4282356045 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f51640b6700 0x7f51640b8c10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55da4cb3a0b0 tx=0x7f516c009660 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:48.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.670+0000 7f518a7ba740 1 --2- 172.21.15.46:0/2373988627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55da4c794350 0x55da4cb3b430 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5174009900 tx=0x7f5174032c60 comp rx=0 tx=0).stop 2024-09-21T03:57:48.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.670+0000 7f518a7ba740 1 -- 172.21.15.46:0/2373988627 shutdown_connections 2024-09-21T03:57:48.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.670+0000 7f518a7ba740 1 --2- 172.21.15.46:0/2373988627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55da4c773670 0x55da4cb3beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:48.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.670+0000 7f518a7ba740 1 --2- 172.21.15.46:0/2373988627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55da4c76b490 0x55da4cb3b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:48.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.670+0000 7f518a7ba740 1 --2- 172.21.15.46:0/2373988627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55da4c794350 0x55da4cb3b430 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:48.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.670+0000 7f518a7ba740 1 -- 172.21.15.46:0/2373988627 >> 172.21.15.46:0/2373988627 conn(0x55da4c788740 msgr2=0x55da4cb39320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:48.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.670+0000 7f518a7ba740 1 -- 172.21.15.46:0/2373988627 shutdown_connections 2024-09-21T03:57:48.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.670+0000 7f518a7ba740 1 -- 172.21.15.46:0/2373988627 wait complete. 2024-09-21T03:57:48.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.671+0000 7f518a7ba740 1 -- start start 2024-09-21T03:57:48.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.671+0000 7f518a7ba740 1 Processor -- start 2024-09-21T03:57:48.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.671+0000 7f518a7ba740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55da4c76b490 0x55da4cb4b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:48.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.671+0000 7f518a7ba740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55da4c773670 0x55da4cb4b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:48.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.671+0000 7f518a7ba740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55da4c794350 0x55da4cb57270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:48.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.671+0000 7f518a7ba740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55da4c902890 con 0x55da4c794350 2024-09-21T03:57:48.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.671+0000 7f518a7ba740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55da4ca3bd40 con 0x55da4c76b490 2024-09-21T03:57:48.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.671+0000 7f518a7ba740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55da4cb4df10 con 0x55da4c773670 2024-09-21T03:57:48.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.672+0000 7f518a7ba740 10 client.0 _ll_register_callbacks cb 0x55da4ca9fc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:57:48.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.672+0000 7f51827e3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55da4c794350 0x55da4cb57270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:48.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.672+0000 7f5181fe2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55da4c76b490 0x55da4cb4b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:48.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.672+0000 7f51817e1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55da4c773670 0x55da4cb4b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:48.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.672+0000 7f51827e3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55da4c794350 0x55da4cb57270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57480/0 (socket says 172.21.15.46:57480) 2024-09-21T03:57:48.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.672+0000 7f51827e3640 1 -- 172.21.15.46:0/2415626177 learned_addr learned my addr 172.21.15.46:0/2415626177 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:48.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.672+0000 7f51827e3640 1 -- 172.21.15.46:0/2415626177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55da4c773670 msgr2=0x55da4cb4b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:48.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.672+0000 7f51827e3640 1 --2- 172.21.15.46:0/2415626177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55da4c773670 0x55da4cb4b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:48.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.672+0000 7f51827e3640 1 -- 172.21.15.46:0/2415626177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55da4c76b490 msgr2=0x55da4cb4b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:48.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.672+0000 7f51827e3640 1 --2- 172.21.15.46:0/2415626177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55da4c76b490 0x55da4cb4b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:48.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.672+0000 7f51827e3640 1 -- 172.21.15.46:0/2415626177 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da4cb57830 con 0x55da4c794350 2024-09-21T03:57:48.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.672+0000 7f51827e3640 1 --2- 172.21.15.46:0/2415626177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55da4c794350 0x55da4cb57270 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f5174004600 tx=0x7f517402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d09239c69dd8ad4f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:48.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.672+0000 7f51617fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:57:48.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.672+0000 7f51617fa640 1 -- 172.21.15.46:0/2415626177 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517403f040 con 0x55da4c794350 2024-09-21T03:57:48.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.672+0000 7f51617fa640 1 -- 172.21.15.46:0/2415626177 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f5174004ad0 con 0x55da4c794350 2024-09-21T03:57:48.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.672+0000 7f518a7ba740 1 -- 172.21.15.46:0/2415626177 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5174032e50 con 0x55da4c794350 2024-09-21T03:57:48.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.673+0000 7f51617fa640 1 -- 172.21.15.46:0/2415626177 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5174035040 con 0x55da4c794350 2024-09-21T03:57:48.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.673+0000 7f518a7ba740 10 client.15861 fetch_fsmap learned FSMap version 20 2024-09-21T03:57:48.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.673+0000 7f518a7ba740 1 -- 172.21.15.46:0/2415626177 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55da4cb5a160 con 0x55da4c794350 2024-09-21T03:57:48.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.673+0000 7f51617fa640 1 -- 172.21.15.46:0/2415626177 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5174032e50 con 0x55da4c794350 2024-09-21T03:57:48.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.673+0000 7f51617fa640 1 -- 172.21.15.46:0/2415626177 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f517403b9d0 con 0x55da4c794350 2024-09-21T03:57:48.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.673+0000 7f518a7ba740 10 client.15861 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:57:48.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.673+0000 7f518a7ba740 10 client.15861 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:57:48.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.673+0000 7f518a7ba740 20 client.15861 populate_metadata read hostname 'smithi046' 2024-09-21T03:57:48.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.673+0000 7f518a7ba740 1 --2- 172.21.15.46:0/2415626177 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55da4c752cd0 0x55da4cb5d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:48.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.673+0000 7f518a7ba740 4 client.15861 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:57:48.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.673+0000 7f518a7ba740 1 -- 172.21.15.46:0/2415626177 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da4cab3db0 con 0x55da4c752cd0 2024-09-21T03:57:48.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.673+0000 7f5181fe2640 1 --2- 172.21.15.46:0/2415626177 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55da4c752cd0 0x55da4cb5d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:48.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.674+0000 7f51617fa640 10 client.15861 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:57:48.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.674+0000 7f5181fe2640 1 --2- 172.21.15.46:0/2415626177 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55da4c752cd0 0x55da4cb5d4c0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa0d78340c6a16a7 server_cookie=416b4a4e500aae3f in_seq=0 out_seq=0 2024-09-21T03:57:48.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.675+0000 7f51617fa640 1 -- 172.21.15.46:0/2415626177 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55da4cab3db0 con 0x55da4c752cd0 2024-09-21T03:57:48.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.675+0000 7f51617fa640 10 client.15861 handle_command_reply: tid=0 2024-09-21T03:57:48.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.675+0000 7f518a7ba740 1 client.15861 shutdown 2024-09-21T03:57:48.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.675+0000 7f518a7ba740 1 -- 172.21.15.46:0/2415626177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55da4c794350 msgr2=0x55da4cb57270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:48.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.675+0000 7f518a7ba740 1 --2- 172.21.15.46:0/2415626177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55da4c794350 0x55da4cb57270 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f5174004600 tx=0x7f517402a410 comp rx=0 tx=0).stop 2024-09-21T03:57:48.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.675+0000 7f518a7ba740 1 -- 172.21.15.46:0/2415626177 shutdown_connections 2024-09-21T03:57:48.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.675+0000 7f518a7ba740 1 --2- 172.21.15.46:0/2415626177 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55da4c752cd0 0x55da4cb5d4c0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:48.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.675+0000 7f518a7ba740 1 --2- 172.21.15.46:0/2415626177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55da4c794350 0x55da4cb57270 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:48.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.675+0000 7f518a7ba740 1 --2- 172.21.15.46:0/2415626177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55da4c773670 0x55da4cb4b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:48.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.675+0000 7f51617fa640 0 client.15861 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:57:48.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.675+0000 7f518a7ba740 1 --2- 172.21.15.46:0/2415626177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55da4c76b490 0x55da4cb4b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:48.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.675+0000 7f518a7ba740 1 -- 172.21.15.46:0/2415626177 >> 172.21.15.46:0/2415626177 conn(0x55da4c788740 msgr2=0x55da4cb3ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:48.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.675+0000 7f518a7ba740 1 -- 172.21.15.46:0/2415626177 shutdown_connections 2024-09-21T03:57:48.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.675+0000 7f518a7ba740 1 -- 172.21.15.46:0/2415626177 wait complete. 2024-09-21T03:57:48.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.675+0000 7f518a7ba740 20 client.15861 trim_cache size 0 max 16384 2024-09-21T03:57:48.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.693+0000 7f518a7ba740 1 Processor -- start 2024-09-21T03:57:48.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.693+0000 7f518a7ba740 1 -- start start 2024-09-21T03:57:48.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.693+0000 7f518a7ba740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55da4c76b490 0x55da4cb4b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:48.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.693+0000 7f518a7ba740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55da4c773670 0x55da4cb4b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.693+0000 7f518a7ba740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55da4c794350 0x55da4cb48400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.693+0000 7f518a7ba740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f517c1ab2d0 con 0x55da4c794350 2024-09-21T03:57:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.693+0000 7f518a7ba740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f517c1adb70 con 0x55da4c76b490 2024-09-21T03:57:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.693+0000 7f518a7ba740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f517c1ab960 con 0x55da4c773670 2024-09-21T03:57:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.693+0000 7f51827e3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55da4c794350 0x55da4cb48400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.693+0000 7f51827e3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55da4c794350 0x55da4cb48400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57488/0 (socket says 172.21.15.46:57488) 2024-09-21T03:57:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.693+0000 7f51827e3640 1 -- 172.21.15.46:0/3142161190 learned_addr learned my addr 172.21.15.46:0/3142161190 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.694+0000 7f5181fe2640 1 --2- 172.21.15.46:0/3142161190 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55da4c76b490 0x55da4cb4b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.694+0000 7f51817e1640 1 --2- 172.21.15.46:0/3142161190 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55da4c773670 0x55da4cb4b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.694+0000 7f51827e3640 1 -- 172.21.15.46:0/3142161190 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55da4c773670 msgr2=0x55da4cb4b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.694+0000 7f51827e3640 1 --2- 172.21.15.46:0/3142161190 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55da4c773670 0x55da4cb4b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.694+0000 7f51827e3640 1 -- 172.21.15.46:0/3142161190 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55da4c76b490 msgr2=0x55da4cb4b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.694+0000 7f51827e3640 1 --2- 172.21.15.46:0/3142161190 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55da4c76b490 0x55da4cb4b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:48.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.694+0000 7f51827e3640 1 -- 172.21.15.46:0/3142161190 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da4cb349e0 con 0x55da4c794350 2024-09-21T03:57:48.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.694+0000 7f5181fe2640 1 --2- 172.21.15.46:0/3142161190 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55da4c76b490 0x55da4cb4b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:57:48.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.694+0000 7f51827e3640 1 --2- 172.21.15.46:0/3142161190 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55da4c794350 0x55da4cb48400 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f5174004650 tx=0x7f517402aa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32be7421207b2be3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:48.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.694+0000 7f51637fe640 1 -- 172.21.15.46:0/3142161190 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517403f040 con 0x55da4c794350 2024-09-21T03:57:48.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.694+0000 7f51637fe640 1 -- 172.21.15.46:0/3142161190 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5174005d50 con 0x55da4c794350 2024-09-21T03:57:48.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.694+0000 7f51637fe640 1 -- 172.21.15.46:0/3142161190 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5174004bc0 con 0x55da4c794350 2024-09-21T03:57:48.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.695+0000 7f518a7ba740 1 -- 172.21.15.46:0/3142161190 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55da4c794350 msgr2=0x55da4cb48400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:48.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.695+0000 7f518a7ba740 1 --2- 172.21.15.46:0/3142161190 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55da4c794350 0x55da4cb48400 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f5174004650 tx=0x7f517402aa90 comp rx=0 tx=0).stop 2024-09-21T03:57:48.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.695+0000 7f518a7ba740 1 -- 172.21.15.46:0/3142161190 shutdown_connections 2024-09-21T03:57:48.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.695+0000 7f518a7ba740 1 --2- 172.21.15.46:0/3142161190 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55da4c794350 0x55da4cb48400 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:48.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.695+0000 7f518a7ba740 1 --2- 172.21.15.46:0/3142161190 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55da4c773670 0x55da4cb4b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:48.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.695+0000 7f518a7ba740 1 --2- 172.21.15.46:0/3142161190 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55da4c76b490 0x55da4cb4b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:48.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.695+0000 7f518a7ba740 1 -- 172.21.15.46:0/3142161190 >> 172.21.15.46:0/3142161190 conn(0x55da4c788740 msgr2=0x55da4cb49a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:48.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.695+0000 7f518a7ba740 1 -- 172.21.15.46:0/3142161190 shutdown_connections 2024-09-21T03:57:48.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.695+0000 7f518a7ba740 1 -- 172.21.15.46:0/3142161190 wait complete. 2024-09-21T03:57:48.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.695+0000 7f518a7ba740 1 -- start start 2024-09-21T03:57:48.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.696+0000 7f518a7ba740 1 Processor -- start 2024-09-21T03:57:48.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.696+0000 7f518a7ba740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55da4c76b490 0x55da4cb60ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:48.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.696+0000 7f518a7ba740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55da4c773670 0x55da4cb5efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:48.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.696+0000 7f518a7ba740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55da4c794350 0x55da4cb5f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:48.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.696+0000 7f518a7ba740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f517c1ac030 con 0x55da4c76b490 2024-09-21T03:57:48.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.696+0000 7f518a7ba740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f517c1ad4a0 con 0x55da4c773670 2024-09-21T03:57:48.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.696+0000 7f518a7ba740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f517c1ac700 con 0x55da4c794350 2024-09-21T03:57:48.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.696+0000 7f518a7ba740 10 client.0 _ll_register_callbacks cb 0x7f5174032bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:57:48.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.696+0000 7f5181fe2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55da4c76b490 0x55da4cb60ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:48.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.696+0000 7f5181fe2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55da4c76b490 0x55da4cb60ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57502/0 (socket says 172.21.15.46:57502) 2024-09-21T03:57:48.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.696+0000 7f5181fe2640 1 -- 172.21.15.46:0/1675476430 learned_addr learned my addr 172.21.15.46:0/1675476430 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:48.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.696+0000 7f51827e3640 1 --2- 172.21.15.46:0/1675476430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55da4c794350 0x55da4cb5f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:48.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.696+0000 7f51817e1640 1 --2- 172.21.15.46:0/1675476430 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55da4c773670 0x55da4cb5efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:48.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.696+0000 7f5181fe2640 1 -- 172.21.15.46:0/1675476430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55da4c794350 msgr2=0x55da4cb5f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:48.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.696+0000 7f5181fe2640 1 --2- 172.21.15.46:0/1675476430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55da4c794350 0x55da4cb5f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:48.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.696+0000 7f5181fe2640 1 -- 172.21.15.46:0/1675476430 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55da4c773670 msgr2=0x55da4cb5efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:48.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.697+0000 7f5181fe2640 1 --2- 172.21.15.46:0/1675476430 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55da4c773670 0x55da4cb5efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:48.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.697+0000 7f5181fe2640 1 -- 172.21.15.46:0/1675476430 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da4cb5fab0 con 0x55da4c76b490 2024-09-21T03:57:48.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.697+0000 7f5181fe2640 1 --2- 172.21.15.46:0/1675476430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55da4c76b490 0x55da4cb60ad0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f516c012010 tx=0x7f516c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802095b1b60768c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:48.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.697+0000 7f51617fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:57:48.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.697+0000 7f51617fa640 1 -- 172.21.15.46:0/1675476430 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f516c01fc80 con 0x55da4c76b490 2024-09-21T03:57:48.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.697+0000 7f518a7ba740 1 -- 172.21.15.46:0/1675476430 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5174005d50 con 0x55da4c76b490 2024-09-21T03:57:48.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.697+0000 7f51617fa640 1 -- 172.21.15.46:0/1675476430 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f516c003970 con 0x55da4c76b490 2024-09-21T03:57:48.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.697+0000 7f51617fa640 1 -- 172.21.15.46:0/1675476430 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f516c037050 con 0x55da4c76b490 2024-09-21T03:57:48.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.697+0000 7f518a7ba740 10 client.15867 fetch_fsmap learned FSMap version 20 2024-09-21T03:57:48.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.697+0000 7f518a7ba740 1 -- 172.21.15.46:0/1675476430 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55da4cbc8a50 con 0x55da4c76b490 2024-09-21T03:57:48.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.697+0000 7f51617fa640 1 -- 172.21.15.46:0/1675476430 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5174005d50 con 0x55da4c76b490 2024-09-21T03:57:48.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.698+0000 7f51617fa640 1 -- 172.21.15.46:0/1675476430 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f516c00f040 con 0x55da4c76b490 2024-09-21T03:57:48.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.698+0000 7f518a7ba740 10 client.15867 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:57:48.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.698+0000 7f518a7ba740 10 client.15867 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:57:48.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.698+0000 7f518a7ba740 20 client.15867 populate_metadata read hostname 'smithi046' 2024-09-21T03:57:48.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.698+0000 7f518a7ba740 1 --2- 172.21.15.46:0/1675476430 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55da4c728080 0x55da4cbcb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:48.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.698+0000 7f518a7ba740 4 client.15867 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:57:48.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.698+0000 7f518a7ba740 1 -- 172.21.15.46:0/1675476430 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55da4caaf860 con 0x55da4c728080 2024-09-21T03:57:48.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.698+0000 7f51817e1640 1 --2- 172.21.15.46:0/1675476430 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55da4c728080 0x55da4cbcb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:48.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.698+0000 7f51817e1640 1 --2- 172.21.15.46:0/1675476430 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55da4c728080 0x55da4cbcb1f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd2a90ed167a8e72 server_cookie=1a7e1546ad55d85a in_seq=0 out_seq=0 2024-09-21T03:57:48.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.698+0000 7f51617fa640 10 client.15867 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:57:48.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.700+0000 7f51617fa640 1 -- 172.21.15.46:0/1675476430 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55da4caaf860 con 0x55da4c728080 2024-09-21T03:57:48.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.700+0000 7f51617fa640 10 client.15867 handle_command_reply: tid=0 2024-09-21T03:57:48.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.700+0000 7f518a7ba740 1 client.15867 shutdown 2024-09-21T03:57:48.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.700+0000 7f518a7ba740 1 -- 172.21.15.46:0/1675476430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55da4c76b490 msgr2=0x55da4cb60ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:48.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.700+0000 7f518a7ba740 1 --2- 172.21.15.46:0/1675476430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55da4c76b490 0x55da4cb60ad0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f516c012010 tx=0x7f516c004a40 comp rx=0 tx=0).stop 2024-09-21T03:57:48.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.700+0000 7f518a7ba740 1 -- 172.21.15.46:0/1675476430 shutdown_connections 2024-09-21T03:57:48.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.700+0000 7f518a7ba740 1 --2- 172.21.15.46:0/1675476430 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55da4c728080 0x55da4cbcb1f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:48.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.700+0000 7f518a7ba740 1 --2- 172.21.15.46:0/1675476430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55da4c794350 0x55da4cb5f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:48.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.700+0000 7f518a7ba740 1 --2- 172.21.15.46:0/1675476430 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55da4c773670 0x55da4cb5efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:48.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.700+0000 7f518a7ba740 1 --2- 172.21.15.46:0/1675476430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55da4c76b490 0x55da4cb60ad0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:48.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.700+0000 7f518a7ba740 1 -- 172.21.15.46:0/1675476430 >> 172.21.15.46:0/1675476430 conn(0x55da4c788740 msgr2=0x55da4cb3c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:48.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.700+0000 7f51617fa640 0 client.15867 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:57:48.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.700+0000 7f518a7ba740 1 -- 172.21.15.46:0/1675476430 shutdown_connections 2024-09-21T03:57:48.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.700+0000 7f518a7ba740 1 -- 172.21.15.46:0/1675476430 wait complete. 2024-09-21T03:57:48.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.700+0000 7f518a7ba740 20 client.15867 trim_cache size 0 max 16384 2024-09-21T03:57:48.706 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T03:57:48.706 INFO:teuthology.orchestra.run.smithi046.stdout: "return_code": 0, 2024-09-21T03:57:48.706 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_tag": "c47f458a-de5e-4952-a575-a81261953667", 2024-09-21T03:57:48.706 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": "asynchronous" 2024-09-21T03:57:48.707 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T03:57:48.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.701+0000 7f5184246640 1 -- 172.21.15.46:0/4282356045 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f51640b6700 msgr2=0x7f51640b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:48.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.701+0000 7f5184246640 1 --2- 172.21.15.46:0/4282356045 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f51640b6700 0x7f51640b8c10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55da4cb3a0b0 tx=0x7f516c009660 comp rx=0 tx=0).stop 2024-09-21T03:57:48.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.701+0000 7f5184246640 1 -- 172.21.15.46:0/4282356045 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f517c1094a0 msgr2=0x7f517c19aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:48.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.701+0000 7f5184246640 1 --2- 172.21.15.46:0/4282356045 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f517c1094a0 0x7f517c19aa20 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f517000d750 tx=0x7f517000dc10 comp rx=0 tx=0).stop 2024-09-21T03:57:48.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.701+0000 7f5184246640 1 -- 172.21.15.46:0/4282356045 shutdown_connections 2024-09-21T03:57:48.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.701+0000 7f5184246640 1 --2- 172.21.15.46:0/4282356045 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f517c109df0 0x7f517c19fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:48.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.701+0000 7f5184246640 1 --2- 172.21.15.46:0/4282356045 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f517c1094a0 0x7f517c19aa20 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:48.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.701+0000 7f5184246640 1 --2- 172.21.15.46:0/4282356045 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f51640b6700 0x7f51640b8c10 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:48.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.701+0000 7f5184246640 1 --2- 172.21.15.46:0/4282356045 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f517c103b60 0x7f517c19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:48.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.701+0000 7f5184246640 1 -- 172.21.15.46:0/4282356045 >> 172.21.15.46:0/4282356045 conn(0x7f517c07b850 msgr2=0x7f517c107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:48.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.701+0000 7f5184246640 1 -- 172.21.15.46:0/4282356045 shutdown_connections 2024-09-21T03:57:48.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:48.701+0000 7f5184246640 1 -- 172.21.15.46:0/4282356045 wait complete. 2024-09-21T03:57:49.453 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:57:49.713 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:57:50.111 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:49 smithi046 ceph-mon[30954]: pgmap v403: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:57:50.111 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:49 smithi046 ceph-mon[30954]: scrub queued for path: / 2024-09-21T03:57:50.111 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:49 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T03:57:50.111 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:49 smithi046 ceph-mon[30954]: scrub summary: active paths [/] 2024-09-21T03:57:50.111 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:49 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T03:57:50.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:49 smithi162 ceph-mon[35071]: pgmap v403: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:57:50.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:49 smithi162 ceph-mon[35071]: scrub queued for path: / 2024-09-21T03:57:50.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:49 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T03:57:50.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:49 smithi162 ceph-mon[35071]: scrub summary: active paths [/] 2024-09-21T03:57:50.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:49 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T03:57:50.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.204+0000 7f54fe840640 1 -- 172.21.15.46:0/2860282259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54f81094a0 msgr2=0x7f54f81098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:50.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.204+0000 7f54fe840640 1 --2- 172.21.15.46:0/2860282259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54f81094a0 0x7f54f81098b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f54e0009900 tx=0x7f54e002a410 comp rx=0 tx=0).stop 2024-09-21T03:57:50.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.204+0000 7f54fe840640 1 -- 172.21.15.46:0/2860282259 shutdown_connections 2024-09-21T03:57:50.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.204+0000 7f54fe840640 1 --2- 172.21.15.46:0/2860282259 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54f8109df0 0x7f54f8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:50.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.204+0000 7f54fe840640 1 --2- 172.21.15.46:0/2860282259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54f81094a0 0x7f54f81098b0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:50.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.204+0000 7f54fe840640 1 --2- 172.21.15.46:0/2860282259 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54f8103b60 0x7f54f8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:50.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.204+0000 7f54fe840640 1 -- 172.21.15.46:0/2860282259 >> 172.21.15.46:0/2860282259 conn(0x7f54f807b850 msgr2=0x7f54f807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:50.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.204+0000 7f54fe840640 1 -- 172.21.15.46:0/2860282259 shutdown_connections 2024-09-21T03:57:50.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.204+0000 7f54fe840640 1 -- 172.21.15.46:0/2860282259 wait complete. 2024-09-21T03:57:50.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.205+0000 7f54fe840640 1 Processor -- start 2024-09-21T03:57:50.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.205+0000 7f54fe840640 1 -- start start 2024-09-21T03:57:50.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.205+0000 7f54fe840640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54f8103b60 0x7f54f819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:50.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.205+0000 7f54fe840640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54f81094a0 0x7f54f819aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:50.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.205+0000 7f54fe840640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54f8109df0 0x7f54f819fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:50.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.205+0000 7f54fe840640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f54f8113ab0 con 0x7f54f8103b60 2024-09-21T03:57:50.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.205+0000 7f54fe840640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f54f8113930 con 0x7f54f8109df0 2024-09-21T03:57:50.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.205+0000 7f54fe840640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f54f8113c30 con 0x7f54f81094a0 2024-09-21T03:57:50.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.205+0000 7f54f7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54f8103b60 0x7f54f819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:50.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.205+0000 7f54f7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54f8103b60 0x7f54f819a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57526/0 (socket says 172.21.15.46:57526) 2024-09-21T03:57:50.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.205+0000 7f54f7fff640 1 -- 172.21.15.46:0/1269582083 learned_addr learned my addr 172.21.15.46:0/1269582083 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:50.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.205+0000 7f54effff640 1 --2- 172.21.15.46:0/1269582083 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54f81094a0 0x7f54f819aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:50.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.206+0000 7f54fcddd640 1 --2- 172.21.15.46:0/1269582083 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54f8109df0 0x7f54f819fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:50.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.206+0000 7f54f7fff640 1 -- 172.21.15.46:0/1269582083 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54f81094a0 msgr2=0x7f54f819aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:50.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.206+0000 7f54f7fff640 1 --2- 172.21.15.46:0/1269582083 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54f81094a0 0x7f54f819aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:50.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.206+0000 7f54f7fff640 1 -- 172.21.15.46:0/1269582083 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54f8109df0 msgr2=0x7f54f819fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:50.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.206+0000 7f54f7fff640 1 --2- 172.21.15.46:0/1269582083 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54f8109df0 0x7f54f819fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:50.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.206+0000 7f54f7fff640 1 -- 172.21.15.46:0/1269582083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54f81a0430 con 0x7f54f8103b60 2024-09-21T03:57:50.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.206+0000 7f54fcddd640 1 --2- 172.21.15.46:0/1269582083 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54f8109df0 0x7f54f819fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:57:50.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.206+0000 7f54f7fff640 1 --2- 172.21.15.46:0/1269582083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54f8103b60 0x7f54f819a4c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f54e800d950 tx=0x7f54e800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:50.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.206+0000 7f54f5ffb640 1 -- 172.21.15.46:0/1269582083 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e8017070 con 0x7f54f8103b60 2024-09-21T03:57:50.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.206+0000 7f54f5ffb640 1 -- 172.21.15.46:0/1269582083 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54e8009c30 con 0x7f54f8103b60 2024-09-21T03:57:50.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.206+0000 7f54fe840640 1 -- 172.21.15.46:0/1269582083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54f81a0720 con 0x7f54f8103b60 2024-09-21T03:57:50.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.206+0000 7f54f5ffb640 1 -- 172.21.15.46:0/1269582083 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e800f620 con 0x7f54f8103b60 2024-09-21T03:57:50.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.206+0000 7f54fe840640 1 -- 172.21.15.46:0/1269582083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54f81a6e80 con 0x7f54f8103b60 2024-09-21T03:57:50.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.209+0000 7f5504db4740 1 Processor -- start 2024-09-21T03:57:50.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.209+0000 7f5504db4740 1 -- start start 2024-09-21T03:57:50.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.209+0000 7f54f5ffb640 1 -- 172.21.15.46:0/1269582083 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f54e8010460 con 0x7f54f8103b60 2024-09-21T03:57:50.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.209+0000 7f5504db4740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55709ac66070 0x55709b00d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:50.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.209+0000 7f5504db4740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55709ac3d1b0 0x55709b00d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:50.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.209+0000 7f5504db4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55709ac45390 0x55709b00dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:50.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.209+0000 7f5504db4740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55709af83e50 con 0x55709ac3d1b0 2024-09-21T03:57:50.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.209+0000 7f5504db4740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55709af73280 con 0x55709ac66070 2024-09-21T03:57:50.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.209+0000 7f5504db4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55709af77090 con 0x55709ac45390 2024-09-21T03:57:50.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.209+0000 7f54f7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55709ac3d1b0 0x55709b00d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:50.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.209+0000 7f54f7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55709ac3d1b0 0x55709b00d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57540/0 (socket says 172.21.15.46:57540) 2024-09-21T03:57:50.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.209+0000 7f54f7fff640 1 -- 172.21.15.46:0/1954933953 learned_addr learned my addr 172.21.15.46:0/1954933953 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:50.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.209+0000 7f54fcddd640 1 --2- 172.21.15.46:0/1954933953 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55709ac66070 0x55709b00d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:50.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.210+0000 7f54f7fff640 1 -- 172.21.15.46:0/1954933953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55709ac45390 msgr2=0x55709b00dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:50.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.210+0000 7f54f7fff640 1 --2- 172.21.15.46:0/1954933953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55709ac45390 0x55709b00dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:50.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.210+0000 7f54f7fff640 1 -- 172.21.15.46:0/1954933953 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55709ac66070 msgr2=0x55709b00d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:50.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.210+0000 7f54f7fff640 1 --2- 172.21.15.46:0/1954933953 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55709ac66070 0x55709b00d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:50.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.210+0000 7f54f7fff640 1 -- 172.21.15.46:0/1954933953 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55709acd1650 con 0x55709ac3d1b0 2024-09-21T03:57:50.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.210+0000 7f54f7fff640 1 --2- 172.21.15.46:0/1954933953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55709ac3d1b0 0x55709b00d7b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f54e80e4a20 tx=0x7f54e80ef990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e305233740a8b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:50.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.210+0000 7f54ee7fc640 1 -- 172.21.15.46:0/1954933953 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e80fb070 con 0x55709ac3d1b0 2024-09-21T03:57:50.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.210+0000 7f54f5ffb640 1 --2- 172.21.15.46:0/1269582083 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f54e40b6680 0x7f54e40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:50.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.210+0000 7f54ee7fc640 1 -- 172.21.15.46:0/1954933953 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54e80e94e0 con 0x55709ac3d1b0 2024-09-21T03:57:50.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.210+0000 7f54ee7fc640 1 -- 172.21.15.46:0/1954933953 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e80f3970 con 0x55709ac3d1b0 2024-09-21T03:57:50.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.211+0000 7f54fcddd640 1 --2- 172.21.15.46:0/1269582083 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f54e40b6680 0x7f54e40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:50.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.211+0000 7f54f5ffb640 1 -- 172.21.15.46:0/1269582083 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f54e80e72f0 con 0x7f54f8103b60 2024-09-21T03:57:50.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.211+0000 7f5504db4740 1 -- 172.21.15.46:0/1954933953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55709ac3d1b0 msgr2=0x55709b00d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:50.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.211+0000 7f54fcddd640 1 --2- 172.21.15.46:0/1269582083 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f54e40b6680 0x7f54e40b8b90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f54f0005fd0 tx=0x7f54f0008630 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:50.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.211+0000 7f5504db4740 1 --2- 172.21.15.46:0/1954933953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55709ac3d1b0 0x55709b00d7b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f54e80e4a20 tx=0x7f54e80ef990 comp rx=0 tx=0).stop 2024-09-21T03:57:50.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.211+0000 7f5504db4740 1 -- 172.21.15.46:0/1954933953 shutdown_connections 2024-09-21T03:57:50.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.211+0000 7f5504db4740 1 --2- 172.21.15.46:0/1954933953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55709ac45390 0x55709b00dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:50.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.211+0000 7f5504db4740 1 --2- 172.21.15.46:0/1954933953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55709ac3d1b0 0x55709b00d7b0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:50.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.211+0000 7f5504db4740 1 --2- 172.21.15.46:0/1954933953 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55709ac66070 0x55709b00d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:50.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.211+0000 7f5504db4740 1 -- 172.21.15.46:0/1954933953 >> 172.21.15.46:0/1954933953 conn(0x55709ac5a460 msgr2=0x55709b00b160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:50.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.211+0000 7f5504db4740 1 -- 172.21.15.46:0/1954933953 shutdown_connections 2024-09-21T03:57:50.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.211+0000 7f5504db4740 1 -- 172.21.15.46:0/1954933953 wait complete. 2024-09-21T03:57:50.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.212+0000 7f5504db4740 1 -- start start 2024-09-21T03:57:50.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.212+0000 7f5504db4740 1 Processor -- start 2024-09-21T03:57:50.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.212+0000 7f5504db4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55709ac3d1b0 0x55709b018950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:50.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.212+0000 7f5504db4740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55709ac45390 0x55709b018e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:50.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.212+0000 7f5504db4740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55709ac66070 0x55709b024d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:50.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.212+0000 7f5504db4740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55709add4700 con 0x55709ac66070 2024-09-21T03:57:50.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.212+0000 7f5504db4740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55709af0e110 con 0x55709ac45390 2024-09-21T03:57:50.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.212+0000 7f5504db4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55709b01ba50 con 0x55709ac3d1b0 2024-09-21T03:57:50.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.213+0000 7f5504db4740 10 client.0 _ll_register_callbacks cb 0x55709af27990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:57:50.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.213+0000 7f54fcddd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55709ac66070 0x55709b024d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:50.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.213+0000 7f54fcddd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55709ac66070 0x55709b024d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57556/0 (socket says 172.21.15.46:57556) 2024-09-21T03:57:50.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.213+0000 7f54fcddd640 1 -- 172.21.15.46:0/4065064164 learned_addr learned my addr 172.21.15.46:0/4065064164 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:50.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.213+0000 7f54f7fff640 1 --2- 172.21.15.46:0/4065064164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55709ac3d1b0 0x55709b018950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:50.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.213+0000 7f54effff640 1 --2- 172.21.15.46:0/4065064164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55709ac45390 0x55709b018e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:50.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.213+0000 7f54fcddd640 1 -- 172.21.15.46:0/4065064164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55709ac3d1b0 msgr2=0x55709b018950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:50.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.213+0000 7f54fcddd640 1 --2- 172.21.15.46:0/4065064164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55709ac3d1b0 0x55709b018950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:50.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.213+0000 7f54fcddd640 1 -- 172.21.15.46:0/4065064164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55709ac45390 msgr2=0x55709b018e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:50.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.213+0000 7f54fcddd640 1 --2- 172.21.15.46:0/4065064164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55709ac45390 0x55709b018e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:50.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.213+0000 7f54fcddd640 1 -- 172.21.15.46:0/4065064164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55709af3bc40 con 0x55709ac66070 2024-09-21T03:57:50.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.213+0000 7f54effff640 1 --2- 172.21.15.46:0/4065064164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55709ac45390 0x55709b018e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:57:50.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.213+0000 7f54fcddd640 1 --2- 172.21.15.46:0/4065064164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55709ac66070 0x55709b024d70 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f54f000ed80 tx=0x7f54f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=751e6a0f6b12575c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:50.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.213+0000 7f54d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:57:50.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.213+0000 7f54d77fe640 1 -- 172.21.15.46:0/4065064164 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f0025600 con 0x55709ac66070 2024-09-21T03:57:50.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.213+0000 7f54d77fe640 1 -- 172.21.15.46:0/4065064164 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f54f00257a0 con 0x55709ac66070 2024-09-21T03:57:50.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.213+0000 7f5504db4740 1 -- 172.21.15.46:0/4065064164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54e80e94e0 con 0x55709ac66070 2024-09-21T03:57:50.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.214+0000 7f54d77fe640 1 -- 172.21.15.46:0/4065064164 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f54f002a020 con 0x55709ac66070 2024-09-21T03:57:50.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.214+0000 7f5504db4740 10 client.15879 fetch_fsmap learned FSMap version 20 2024-09-21T03:57:50.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.214+0000 7f5504db4740 1 -- 172.21.15.46:0/4065064164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55709b0277b0 con 0x55709ac66070 2024-09-21T03:57:50.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.214+0000 7f54d77fe640 1 -- 172.21.15.46:0/4065064164 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54e80e94e0 con 0x55709ac66070 2024-09-21T03:57:50.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.214+0000 7f54d77fe640 1 -- 172.21.15.46:0/4065064164 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f54f002f870 con 0x55709ac66070 2024-09-21T03:57:50.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.214+0000 7f5504db4740 10 client.15879 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:57:50.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.214+0000 7f5504db4740 10 client.15879 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:57:50.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.214+0000 7f5504db4740 20 client.15879 populate_metadata read hostname 'smithi046' 2024-09-21T03:57:50.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.214+0000 7f5504db4740 1 --2- 172.21.15.46:0/4065064164 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55709ac249f0 0x55709b02ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:50.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.214+0000 7f5504db4740 4 client.15879 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:57:50.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.214+0000 7f5504db4740 1 -- 172.21.15.46:0/4065064164 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55709af85da0 con 0x55709ac249f0 2024-09-21T03:57:50.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.215+0000 7f54f7fff640 1 --2- 172.21.15.46:0/4065064164 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55709ac249f0 0x55709b02ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:50.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.215+0000 7f54f7fff640 1 --2- 172.21.15.46:0/4065064164 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55709ac249f0 0x55709b02ac50 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e176c072f0d1f200 server_cookie=54d2799839145f6 in_seq=0 out_seq=0 2024-09-21T03:57:50.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.215+0000 7f54d77fe640 10 client.15879 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:57:50.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.216+0000 7f54d77fe640 1 -- 172.21.15.46:0/4065064164 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55709af85da0 con 0x55709ac249f0 2024-09-21T03:57:50.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.216+0000 7f54d77fe640 10 client.15879 handle_command_reply: tid=0 2024-09-21T03:57:50.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.216+0000 7f5504db4740 1 client.15879 shutdown 2024-09-21T03:57:50.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.216+0000 7f5504db4740 1 -- 172.21.15.46:0/4065064164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55709ac66070 msgr2=0x55709b024d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:50.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.216+0000 7f5504db4740 1 --2- 172.21.15.46:0/4065064164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55709ac66070 0x55709b024d70 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f54f000ed80 tx=0x7f54f0004a40 comp rx=0 tx=0).stop 2024-09-21T03:57:50.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.216+0000 7f5504db4740 1 -- 172.21.15.46:0/4065064164 shutdown_connections 2024-09-21T03:57:50.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.216+0000 7f5504db4740 1 --2- 172.21.15.46:0/4065064164 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55709ac249f0 0x55709b02ac50 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:50.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.216+0000 7f5504db4740 1 --2- 172.21.15.46:0/4065064164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55709ac66070 0x55709b024d70 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:50.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.216+0000 7f5504db4740 1 --2- 172.21.15.46:0/4065064164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55709ac45390 0x55709b018e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:50.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.216+0000 7f54d77fe640 0 client.15879 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:57:50.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.216+0000 7f5504db4740 1 --2- 172.21.15.46:0/4065064164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55709ac3d1b0 0x55709b018950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:50.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.216+0000 7f5504db4740 1 -- 172.21.15.46:0/4065064164 >> 172.21.15.46:0/4065064164 conn(0x55709ac5a460 msgr2=0x55709b010400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:50.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.216+0000 7f5504db4740 1 -- 172.21.15.46:0/4065064164 shutdown_connections 2024-09-21T03:57:50.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.216+0000 7f5504db4740 1 -- 172.21.15.46:0/4065064164 wait complete. 2024-09-21T03:57:50.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.216+0000 7f5504db4740 20 client.15879 trim_cache size 0 max 16384 2024-09-21T03:57:50.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.234+0000 7f5504db4740 1 Processor -- start 2024-09-21T03:57:50.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.234+0000 7f5504db4740 1 -- start start 2024-09-21T03:57:50.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.234+0000 7f5504db4740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55709ac3d1b0 0x55709b01a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:50.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.234+0000 7f5504db4740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55709ac45390 0x55709b00e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:50.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.234+0000 7f5504db4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55709ac66070 0x55709b024c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:50.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.234+0000 7f5504db4740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f54f81ad5e0 con 0x55709ac3d1b0 2024-09-21T03:57:50.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.234+0000 7f5504db4740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f54f81afe80 con 0x55709ac45390 2024-09-21T03:57:50.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.234+0000 7f5504db4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f54f81adc70 con 0x55709ac66070 2024-09-21T03:57:50.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.234+0000 7f54f7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55709ac3d1b0 0x55709b01a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:50.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.234+0000 7f54f7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55709ac3d1b0 0x55709b01a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57560/0 (socket says 172.21.15.46:57560) 2024-09-21T03:57:50.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.234+0000 7f54f7fff640 1 -- 172.21.15.46:0/915730520 learned_addr learned my addr 172.21.15.46:0/915730520 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:50.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.234+0000 7f54fcddd640 1 --2- 172.21.15.46:0/915730520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55709ac66070 0x55709b024c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:50.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.234+0000 7f54effff640 1 --2- 172.21.15.46:0/915730520 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55709ac45390 0x55709b00e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:50.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.234+0000 7f54f7fff640 1 -- 172.21.15.46:0/915730520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55709ac66070 msgr2=0x55709b024c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:50.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.234+0000 7f54f7fff640 1 --2- 172.21.15.46:0/915730520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55709ac66070 0x55709b024c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:50.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.234+0000 7f54f7fff640 1 -- 172.21.15.46:0/915730520 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55709ac45390 msgr2=0x55709b00e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:50.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.234+0000 7f54f7fff640 1 --2- 172.21.15.46:0/915730520 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55709ac45390 0x55709b00e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:50.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.234+0000 7f54f7fff640 1 -- 172.21.15.46:0/915730520 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55709b019c10 con 0x55709ac3d1b0 2024-09-21T03:57:50.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.235+0000 7f54effff640 1 --2- 172.21.15.46:0/915730520 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55709ac45390 0x55709b00e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:57:50.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.235+0000 7f54f7fff640 1 --2- 172.21.15.46:0/915730520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55709ac3d1b0 0x55709b01a830 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f54e80efe90 tx=0x7f54e80b6040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58da9ac78c6635e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:50.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.235+0000 7f54edffb640 1 -- 172.21.15.46:0/915730520 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e8020040 con 0x55709ac3d1b0 2024-09-21T03:57:50.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.235+0000 7f54edffb640 1 -- 172.21.15.46:0/915730520 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54e80accf0 con 0x55709ac3d1b0 2024-09-21T03:57:50.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.235+0000 7f54edffb640 1 -- 172.21.15.46:0/915730520 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e80ac950 con 0x55709ac3d1b0 2024-09-21T03:57:50.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.236+0000 7f5504db4740 1 -- 172.21.15.46:0/915730520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55709ac3d1b0 msgr2=0x55709b01a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:50.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.236+0000 7f5504db4740 1 --2- 172.21.15.46:0/915730520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55709ac3d1b0 0x55709b01a830 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f54e80efe90 tx=0x7f54e80b6040 comp rx=0 tx=0).stop 2024-09-21T03:57:50.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.236+0000 7f5504db4740 1 -- 172.21.15.46:0/915730520 shutdown_connections 2024-09-21T03:57:50.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.236+0000 7f5504db4740 1 --2- 172.21.15.46:0/915730520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55709ac66070 0x55709b024c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:50.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.236+0000 7f5504db4740 1 --2- 172.21.15.46:0/915730520 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55709ac45390 0x55709b00e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:50.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.236+0000 7f5504db4740 1 --2- 172.21.15.46:0/915730520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55709ac3d1b0 0x55709b01a830 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:50.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.236+0000 7f5504db4740 1 -- 172.21.15.46:0/915730520 >> 172.21.15.46:0/915730520 conn(0x55709ac5a460 msgr2=0x55709b00e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:50.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.236+0000 7f5504db4740 1 -- 172.21.15.46:0/915730520 shutdown_connections 2024-09-21T03:57:50.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.236+0000 7f5504db4740 1 -- 172.21.15.46:0/915730520 wait complete. 2024-09-21T03:57:50.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.236+0000 7f5504db4740 1 -- start start 2024-09-21T03:57:50.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.236+0000 7f5504db4740 1 Processor -- start 2024-09-21T03:57:50.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.237+0000 7f5504db4740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55709ac3d1b0 0x55709b0214a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:50.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.237+0000 7f5504db4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55709ac45390 0x55709b01c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:50.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.237+0000 7f5504db4740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55709ac66070 0x55709b01ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:50.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.237+0000 7f5504db4740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f54f81ae340 con 0x55709ac66070 2024-09-21T03:57:50.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.237+0000 7f5504db4740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f54f81af7b0 con 0x55709ac3d1b0 2024-09-21T03:57:50.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.237+0000 7f5504db4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f54f81aea10 con 0x55709ac45390 2024-09-21T03:57:50.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.237+0000 7f5504db4740 10 client.0 _ll_register_callbacks cb 0x7f54f0008b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:57:50.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.237+0000 7f54fcddd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55709ac66070 0x55709b01ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:50.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.237+0000 7f54fcddd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55709ac66070 0x55709b01ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57576/0 (socket says 172.21.15.46:57576) 2024-09-21T03:57:50.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.237+0000 7f54fcddd640 1 -- 172.21.15.46:0/64318884 learned_addr learned my addr 172.21.15.46:0/64318884 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:57:50.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.237+0000 7f54effff640 1 --2- 172.21.15.46:0/64318884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55709ac45390 0x55709b01c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:50.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.237+0000 7f54f7fff640 1 --2- 172.21.15.46:0/64318884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55709ac3d1b0 0x55709b0214a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:50.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.237+0000 7f54fcddd640 1 -- 172.21.15.46:0/64318884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55709ac45390 msgr2=0x55709b01c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:50.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.237+0000 7f54fcddd640 1 --2- 172.21.15.46:0/64318884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55709ac45390 0x55709b01c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:50.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.237+0000 7f54fcddd640 1 -- 172.21.15.46:0/64318884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55709ac3d1b0 msgr2=0x55709b0214a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:57:50.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.237+0000 7f54fcddd640 1 --2- 172.21.15.46:0/64318884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55709ac3d1b0 0x55709b0214a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:50.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.237+0000 7f54fcddd640 1 -- 172.21.15.46:0/64318884 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55709b01d600 con 0x55709ac66070 2024-09-21T03:57:50.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.238+0000 7f54fcddd640 1 --2- 172.21.15.46:0/64318884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55709ac66070 0x55709b01ce90 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f54f002fcc0 tx=0x7f54f002fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34271ede981b809c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:50.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.238+0000 7f54d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:57:50.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.238+0000 7f54d77fe640 1 -- 172.21.15.46:0/64318884 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f0025810 con 0x55709ac66070 2024-09-21T03:57:50.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.238+0000 7f54d77fe640 1 -- 172.21.15.46:0/64318884 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f54f00259b0 con 0x55709ac66070 2024-09-21T03:57:50.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.238+0000 7f5504db4740 1 -- 172.21.15.46:0/64318884 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54e80accf0 con 0x55709ac66070 2024-09-21T03:57:50.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.238+0000 7f54d77fe640 1 -- 172.21.15.46:0/64318884 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f54f002fe60 con 0x55709ac66070 2024-09-21T03:57:50.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.238+0000 7f5504db4740 10 client.15885 fetch_fsmap learned FSMap version 20 2024-09-21T03:57:50.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.238+0000 7f5504db4740 1 -- 172.21.15.46:0/64318884 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55709b095490 con 0x55709ac66070 2024-09-21T03:57:50.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.238+0000 7f54d77fe640 1 -- 172.21.15.46:0/64318884 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54e80accf0 con 0x55709ac66070 2024-09-21T03:57:50.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.238+0000 7f54d77fe640 1 -- 172.21.15.46:0/64318884 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f54f001d9a0 con 0x55709ac66070 2024-09-21T03:57:50.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.238+0000 7f5504db4740 10 client.15885 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:57:50.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.238+0000 7f5504db4740 10 client.15885 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:57:50.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.238+0000 7f5504db4740 20 client.15885 populate_metadata read hostname 'smithi046' 2024-09-21T03:57:50.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.238+0000 7f5504db4740 1 --2- 172.21.15.46:0/64318884 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55709abf9da0 0x55709b097c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:50.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.238+0000 7f5504db4740 4 client.15885 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:57:50.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.238+0000 7f5504db4740 1 -- 172.21.15.46:0/64318884 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55709af81850 con 0x55709abf9da0 2024-09-21T03:57:50.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.239+0000 7f54f7fff640 1 --2- 172.21.15.46:0/64318884 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55709abf9da0 0x55709b097c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:50.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.239+0000 7f54f7fff640 1 --2- 172.21.15.46:0/64318884 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55709abf9da0 0x55709b097c40 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=579d945c767998b5 server_cookie=97ca3e5bde6181d6 in_seq=0 out_seq=0 2024-09-21T03:57:50.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.239+0000 7f54d77fe640 10 client.15885 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:57:50.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.239+0000 7f54d77fe640 1 -- 172.21.15.46:0/64318884 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x55709af81850 con 0x55709abf9da0 2024-09-21T03:57:50.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.239+0000 7f54d77fe640 10 client.15885 handle_command_reply: tid=0 2024-09-21T03:57:50.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.239+0000 7f5504db4740 1 client.15885 shutdown 2024-09-21T03:57:50.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.239+0000 7f5504db4740 1 -- 172.21.15.46:0/64318884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55709ac66070 msgr2=0x55709b01ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:50.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.239+0000 7f5504db4740 1 --2- 172.21.15.46:0/64318884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55709ac66070 0x55709b01ce90 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f54f002fcc0 tx=0x7f54f002fb60 comp rx=0 tx=0).stop 2024-09-21T03:57:50.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.240+0000 7f5504db4740 1 -- 172.21.15.46:0/64318884 shutdown_connections 2024-09-21T03:57:50.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.240+0000 7f5504db4740 1 --2- 172.21.15.46:0/64318884 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55709abf9da0 0x55709b097c40 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:50.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.240+0000 7f5504db4740 1 --2- 172.21.15.46:0/64318884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55709ac66070 0x55709b01ce90 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:50.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.240+0000 7f5504db4740 1 --2- 172.21.15.46:0/64318884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55709ac45390 0x55709b01c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:50.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.240+0000 7f5504db4740 1 --2- 172.21.15.46:0/64318884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55709ac3d1b0 0x55709b0214a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:50.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.240+0000 7f5504db4740 1 -- 172.21.15.46:0/64318884 >> 172.21.15.46:0/64318884 conn(0x55709ac5a460 msgr2=0x55709b01a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:50.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.240+0000 7f54d77fe640 0 client.15885 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:57:50.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.240+0000 7f5504db4740 1 -- 172.21.15.46:0/64318884 shutdown_connections 2024-09-21T03:57:50.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.240+0000 7f5504db4740 1 -- 172.21.15.46:0/64318884 wait complete. 2024-09-21T03:57:50.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.240+0000 7f5504db4740 20 client.15885 trim_cache size 0 max 16384 2024-09-21T03:57:50.247 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T03:57:50.247 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T03:57:50.247 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2024-09-21T03:57:50.248 INFO:teuthology.orchestra.run.smithi046.stdout: "c47f458a-de5e-4952-a575-a81261953667": { 2024-09-21T03:57:50.248 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:57:50.248 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "c47f458a-de5e-4952-a575-a81261953667", 2024-09-21T03:57:50.248 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2024-09-21T03:57:50.248 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:57:50.248 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:57:50.248 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_stats": { 2024-09-21T03:57:50.248 INFO:teuthology.orchestra.run.smithi046.stdout: "c47f458a-de5e-4952-a575-a81261953667": { 2024-09-21T03:57:50.248 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:48.699411+0000", 2024-09-21T03:57:50.248 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:57:50.249 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:57:50.249 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:57:50.249 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:57:50.249 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:57:50.249 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:57:50.249 INFO:teuthology.orchestra.run.smithi046.stdout: "e24ec8f1-0d13-478f-9c2c-b51798868ffc": { 2024-09-21T03:57:50.249 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:09.736194+0000", 2024-09-21T03:57:50.249 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:57:50.249 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:57:50.249 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:57:50.249 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:57:50.249 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:57:50.250 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:57:50.250 INFO:teuthology.orchestra.run.smithi046.stdout: "a871f724-0198-493c-b03e-b2de78aba243": { 2024-09-21T03:57:50.250 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:56:30.082991+0000", 2024-09-21T03:57:50.250 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:57:50.250 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:57:50.250 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:57:50.250 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:57:50.250 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:57:50.250 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:57:50.250 INFO:teuthology.orchestra.run.smithi046.stdout: "d49f33a7-3d5a-421b-94ba-8b19a4120db1": { 2024-09-21T03:57:50.250 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:50.480786+0000", 2024-09-21T03:57:50.251 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:57:50.251 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:57:50.251 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:57:50.251 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:57:50.251 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:57:50.251 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:57:50.251 INFO:teuthology.orchestra.run.smithi046.stdout: "3bbf7097-70d7-4743-bbce-41465502b35b": { 2024-09-21T03:57:50.251 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:10.661441+0000", 2024-09-21T03:57:50.251 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:57:50.251 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:57:50.251 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:57:50.251 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:57:50.252 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:57:50.252 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:57:50.252 INFO:teuthology.orchestra.run.smithi046.stdout: "08f0c962-df1a-4129-a1a2-b916240d9803": { 2024-09-21T03:57:50.252 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:02.937596+0000", 2024-09-21T03:57:50.252 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:57:50.252 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:57:50.252 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:57:50.252 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:57:50.252 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:57:50.252 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:57:50.252 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:57:50.253 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T03:57:50.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.240+0000 7f54fe840640 1 -- 172.21.15.46:0/1269582083 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f54e40b6680 msgr2=0x7f54e40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:50.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.240+0000 7f54fe840640 1 --2- 172.21.15.46:0/1269582083 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f54e40b6680 0x7f54e40b8b90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f54f0005fd0 tx=0x7f54f0008630 comp rx=0 tx=0).stop 2024-09-21T03:57:50.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.240+0000 7f54fe840640 1 -- 172.21.15.46:0/1269582083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54f8103b60 msgr2=0x7f54f819a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:50.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.240+0000 7f54fe840640 1 --2- 172.21.15.46:0/1269582083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54f8103b60 0x7f54f819a4c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f54e800d950 tx=0x7f54e800de10 comp rx=0 tx=0).stop 2024-09-21T03:57:50.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.240+0000 7f54fe840640 1 -- 172.21.15.46:0/1269582083 shutdown_connections 2024-09-21T03:57:50.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.240+0000 7f54fe840640 1 --2- 172.21.15.46:0/1269582083 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54f8109df0 0x7f54f819fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:50.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.240+0000 7f54fe840640 1 --2- 172.21.15.46:0/1269582083 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f54e40b6680 0x7f54e40b8b90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:50.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.240+0000 7f54fe840640 1 --2- 172.21.15.46:0/1269582083 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54f81094a0 0x7f54f819aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:50.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.240+0000 7f54fe840640 1 --2- 172.21.15.46:0/1269582083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54f8103b60 0x7f54f819a4c0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:50.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.240+0000 7f54fe840640 1 -- 172.21.15.46:0/1269582083 >> 172.21.15.46:0/1269582083 conn(0x7f54f807b850 msgr2=0x7f54f8105560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:50.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.241+0000 7f54fe840640 1 -- 172.21.15.46:0/1269582083 shutdown_connections 2024-09-21T03:57:50.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:57:50.241+0000 7f54fe840640 1 -- 172.21.15.46:0/1269582083 wait complete. 2024-09-21T03:57:50.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:49 smithi105 ceph-mon[34773]: pgmap v403: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:57:50.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:49 smithi105 ceph-mon[34773]: scrub queued for path: / 2024-09-21T03:57:50.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:49 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T03:57:50.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:49 smithi105 ceph-mon[34773]: scrub summary: active paths [/] 2024-09-21T03:57:50.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:49 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T03:57:51.138 INFO:tasks.cephfs.filesystem:scrub status for tag:c47f458a-de5e-4952-a575-a81261953667 - {'path': '/', 'tag': 'c47f458a-de5e-4952-a575-a81261953667', 'options': 'recursive,force'} 2024-09-21T03:57:52.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:51 smithi162 ceph-mon[35071]: pgmap v404: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:57:52.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:51 smithi046 ceph-mon[30954]: pgmap v404: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:57:52.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:51 smithi105 ceph-mon[34773]: pgmap v404: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:57:54.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:53 smithi162 ceph-mon[35071]: pgmap v405: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-21T03:57:54.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:53 smithi162 ceph-mon[35071]: scrub summary: idle 2024-09-21T03:57:54.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:53 smithi046 ceph-mon[30954]: pgmap v405: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-21T03:57:54.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:53 smithi046 ceph-mon[30954]: scrub summary: idle 2024-09-21T03:57:54.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:53 smithi105 ceph-mon[34773]: pgmap v405: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-21T03:57:54.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:53 smithi105 ceph-mon[34773]: scrub summary: idle 2024-09-21T03:57:56.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:55 smithi162 ceph-mon[35071]: pgmap v406: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T03:57:56.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:55 smithi046 ceph-mon[30954]: pgmap v406: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T03:57:56.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:55 smithi105 ceph-mon[34773]: pgmap v406: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T03:57:58.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:57 smithi162 ceph-mon[35071]: pgmap v407: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T03:57:58.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:57 smithi046 ceph-mon[30954]: pgmap v407: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T03:57:58.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:57 smithi105 ceph-mon[34773]: pgmap v407: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T03:58:00.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:57:59 smithi162 ceph-mon[35071]: pgmap v408: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T03:58:00.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:57:59 smithi046 ceph-mon[30954]: pgmap v408: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T03:58:00.317 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:57:59 smithi105 ceph-mon[34773]: pgmap v408: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T03:58:02.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:01 smithi162 ceph-mon[35071]: pgmap v409: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T03:58:02.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:01 smithi046 ceph-mon[30954]: pgmap v409: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T03:58:02.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:01 smithi105 ceph-mon[34773]: pgmap v409: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T03:58:04.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:03 smithi162 ceph-mon[35071]: pgmap v410: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 16 op/s 2024-09-21T03:58:04.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:03 smithi046 ceph-mon[30954]: pgmap v410: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 16 op/s 2024-09-21T03:58:04.317 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:03 smithi105 ceph-mon[34773]: pgmap v410: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 16 op/s 2024-09-21T03:58:06.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:05 smithi162 ceph-mon[35071]: pgmap v411: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T03:58:06.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:05 smithi046 ceph-mon[30954]: pgmap v411: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T03:58:06.317 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:05 smithi105 ceph-mon[34773]: pgmap v411: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T03:58:08.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:07 smithi162 ceph-mon[35071]: pgmap v412: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T03:58:08.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:07 smithi046 ceph-mon[30954]: pgmap v412: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T03:58:08.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:07 smithi105 ceph-mon[34773]: pgmap v412: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T03:58:10.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:09 smithi162 ceph-mon[35071]: pgmap v413: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T03:58:10.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:09 smithi046 ceph-mon[30954]: pgmap v413: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T03:58:10.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:09 smithi105 ceph-mon[34773]: pgmap v413: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T03:58:12.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:11 smithi162 ceph-mon[35071]: pgmap v414: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T03:58:12.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:11 smithi046 ceph-mon[30954]: pgmap v414: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T03:58:12.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:11 smithi105 ceph-mon[34773]: pgmap v414: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T03:58:14.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:13 smithi046 ceph-mon[30954]: pgmap v415: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T03:58:14.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:13 smithi105 ceph-mon[34773]: pgmap v415: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T03:58:14.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:13 smithi162 ceph-mon[35071]: pgmap v415: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T03:58:16.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:15 smithi046 ceph-mon[30954]: pgmap v416: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 11 KiB/s wr, 4 op/s 2024-09-21T03:58:16.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:15 smithi105 ceph-mon[34773]: pgmap v416: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 11 KiB/s wr, 4 op/s 2024-09-21T03:58:16.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:15 smithi162 ceph-mon[35071]: pgmap v416: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 11 KiB/s wr, 4 op/s 2024-09-21T03:58:18.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:17 smithi046 ceph-mon[30954]: pgmap v417: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T03:58:18.317 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:17 smithi105 ceph-mon[34773]: pgmap v417: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T03:58:18.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:17 smithi162 ceph-mon[35071]: pgmap v417: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T03:58:20.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:19 smithi046 ceph-mon[30954]: pgmap v418: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T03:58:20.317 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:19 smithi105 ceph-mon[34773]: pgmap v418: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T03:58:20.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:19 smithi162 ceph-mon[35071]: pgmap v418: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T03:58:21.139 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:58:21.422 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:58:22.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:21 smithi046 ceph-mon[30954]: pgmap v419: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T03:58:22.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.000+0000 7f6419db4640 1 -- 172.21.15.46:0/4119827030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6414102100 msgr2=0x7f6414102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:22.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.000+0000 7f6419db4640 1 --2- 172.21.15.46:0/4119827030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6414102100 0x7f6414102510 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6404009900 tx=0x7f640402a410 comp rx=0 tx=0).stop 2024-09-21T03:58:22.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.001+0000 7f6419db4640 1 -- 172.21.15.46:0/4119827030 shutdown_connections 2024-09-21T03:58:22.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.001+0000 7f6419db4640 1 --2- 172.21.15.46:0/4119827030 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6414107c50 0x7f6414110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:22.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.001+0000 7f6419db4640 1 --2- 172.21.15.46:0/4119827030 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6414107300 0x7f6414107710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:22.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.001+0000 7f6419db4640 1 --2- 172.21.15.46:0/4119827030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6414102100 0x7f6414102510 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:22.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.001+0000 7f6419db4640 1 -- 172.21.15.46:0/4119827030 >> 172.21.15.46:0/4119827030 conn(0x7f6414079e40 msgr2=0x7f641407a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:22.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.001+0000 7f6419db4640 1 -- 172.21.15.46:0/4119827030 shutdown_connections 2024-09-21T03:58:22.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.001+0000 7f6419db4640 1 -- 172.21.15.46:0/4119827030 wait complete. 2024-09-21T03:58:22.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.001+0000 7f6419db4640 1 Processor -- start 2024-09-21T03:58:22.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.002+0000 7f6419db4640 1 -- start start 2024-09-21T03:58:22.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.002+0000 7f6419db4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6414102100 0x7f641419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:22.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.002+0000 7f6419db4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6414107300 0x7f641419aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:22.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.002+0000 7f6419db4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6414107c50 0x7f641419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:22.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.002+0000 7f6419db4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6414113b00 con 0x7f6414107300 2024-09-21T03:58:22.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.002+0000 7f6419db4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6414113980 con 0x7f6414102100 2024-09-21T03:58:22.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.002+0000 7f6419db4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6414113c80 con 0x7f6414107c50 2024-09-21T03:58:22.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.002+0000 7f6412ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6414107300 0x7f641419aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:22.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.002+0000 7f6412ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6414107300 0x7f641419aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41310/0 (socket says 172.21.15.46:41310) 2024-09-21T03:58:22.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.002+0000 7f6412ffd640 1 -- 172.21.15.46:0/4036724182 learned_addr learned my addr 172.21.15.46:0/4036724182 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:22.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.002+0000 7f64137fe640 1 --2- 172.21.15.46:0/4036724182 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6414102100 0x7f641419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:22.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.002+0000 7f6413fff640 1 --2- 172.21.15.46:0/4036724182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6414107c50 0x7f641419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:22.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.002+0000 7f6412ffd640 1 -- 172.21.15.46:0/4036724182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6414107c50 msgr2=0x7f641419fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:22.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.002+0000 7f6412ffd640 1 --2- 172.21.15.46:0/4036724182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6414107c50 0x7f641419fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:22.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.002+0000 7f6412ffd640 1 -- 172.21.15.46:0/4036724182 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6414102100 msgr2=0x7f641419a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:22.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.002+0000 7f6412ffd640 1 --2- 172.21.15.46:0/4036724182 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6414102100 0x7f641419a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:22.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.002+0000 7f6412ffd640 1 -- 172.21.15.46:0/4036724182 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64141a0460 con 0x7f6414107300 2024-09-21T03:58:22.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.003+0000 7f6413fff640 1 --2- 172.21.15.46:0/4036724182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6414107c50 0x7f641419fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:58:22.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.003+0000 7f6412ffd640 1 --2- 172.21.15.46:0/4036724182 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6414107300 0x7f641419aa90 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f640800d750 tx=0x7f640800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:22.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.003+0000 7f6410ff9640 1 -- 172.21.15.46:0/4036724182 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6408017070 con 0x7f6414107300 2024-09-21T03:58:22.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.003+0000 7f6419db4640 1 -- 172.21.15.46:0/4036724182 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64141a0750 con 0x7f6414107300 2024-09-21T03:58:22.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.003+0000 7f6410ff9640 1 -- 172.21.15.46:0/4036724182 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64080054d0 con 0x7f6414107300 2024-09-21T03:58:22.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.003+0000 7f6410ff9640 1 -- 172.21.15.46:0/4036724182 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6408004c30 con 0x7f6414107300 2024-09-21T03:58:22.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.003+0000 7f6419db4640 1 -- 172.21.15.46:0/4036724182 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64141a6eb0 con 0x7f6414107300 2024-09-21T03:58:22.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.006+0000 7f6420328740 1 Processor -- start 2024-09-21T03:58:22.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.006+0000 7f6420328740 1 -- start start 2024-09-21T03:58:22.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.007+0000 7f6420328740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a8c624070 0x564a8c9cb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:22.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.007+0000 7f6420328740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564a8c5fb1b0 0x564a8c9cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:22.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.007+0000 7f6420328740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a8c603390 0x564a8c9cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:22.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.007+0000 7f6420328740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x564a8c941e50 con 0x564a8c624070 2024-09-21T03:58:22.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.007+0000 7f6420328740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x564a8c931280 con 0x564a8c5fb1b0 2024-09-21T03:58:22.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.007+0000 7f6420328740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564a8c935090 con 0x564a8c603390 2024-09-21T03:58:22.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.007+0000 7f6410ff9640 1 -- 172.21.15.46:0/4036724182 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f6408010460 con 0x7f6414107300 2024-09-21T03:58:22.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.007+0000 7f6413fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a8c624070 0x564a8c9cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:22.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.007+0000 7f6413fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a8c624070 0x564a8c9cb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41324/0 (socket says 172.21.15.46:41324) 2024-09-21T03:58:22.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.007+0000 7f6413fff640 1 -- 172.21.15.46:0/202664857 learned_addr learned my addr 172.21.15.46:0/202664857 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:22.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.007+0000 7f64137fe640 1 --2- 172.21.15.46:0/202664857 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564a8c5fb1b0 0x564a8c9cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:22.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.007+0000 7f6412ffd640 1 --2- 172.21.15.46:0/202664857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a8c603390 0x564a8c9cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:22.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.007+0000 7f6413fff640 1 -- 172.21.15.46:0/202664857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a8c603390 msgr2=0x564a8c9cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:22.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.007+0000 7f6413fff640 1 --2- 172.21.15.46:0/202664857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a8c603390 0x564a8c9cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:22.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.007+0000 7f6413fff640 1 -- 172.21.15.46:0/202664857 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564a8c5fb1b0 msgr2=0x564a8c9cbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:22.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.007+0000 7f6413fff640 1 --2- 172.21.15.46:0/202664857 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564a8c5fb1b0 0x564a8c9cbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:22.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.007+0000 7f6413fff640 1 -- 172.21.15.46:0/202664857 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a8c68f650 con 0x564a8c624070 2024-09-21T03:58:22.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.007+0000 7f6412ffd640 1 --2- 172.21.15.46:0/202664857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a8c603390 0x564a8c9cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:58:22.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.007+0000 7f6413fff640 1 --2- 172.21.15.46:0/202664857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a8c624070 0x564a8c9cb650 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f640c009fb0 tx=0x7f640c010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=123f62b9b5d7ca7d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:22.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.007+0000 7f63f9ffb640 1 -- 172.21.15.46:0/202664857 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640c016070 con 0x564a8c624070 2024-09-21T03:58:22.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.008+0000 7f63f9ffb640 1 -- 172.21.15.46:0/202664857 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f640c01bb10 con 0x564a8c624070 2024-09-21T03:58:22.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.008+0000 7f63f9ffb640 1 -- 172.21.15.46:0/202664857 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640c012b30 con 0x564a8c624070 2024-09-21T03:58:22.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.008+0000 7f6410ff9640 1 --2- 172.21.15.46:0/4036724182 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f63fc0b6680 0x7f63fc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:22.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.008+0000 7f64137fe640 1 --2- 172.21.15.46:0/4036724182 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f63fc0b6680 0x7f63fc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:22.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.008+0000 7f6410ff9640 1 -- 172.21.15.46:0/4036724182 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f64080e70c0 con 0x7f6414107300 2024-09-21T03:58:22.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.008+0000 7f6420328740 1 -- 172.21.15.46:0/202664857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a8c624070 msgr2=0x564a8c9cb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:22.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.008+0000 7f6420328740 1 --2- 172.21.15.46:0/202664857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a8c624070 0x564a8c9cb650 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f640c009fb0 tx=0x7f640c010800 comp rx=0 tx=0).stop 2024-09-21T03:58:22.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.008+0000 7f64137fe640 1 --2- 172.21.15.46:0/4036724182 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f63fc0b6680 0x7f63fc0b8b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6404031440 tx=0x7f6404009610 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:22.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.009+0000 7f6420328740 1 -- 172.21.15.46:0/202664857 shutdown_connections 2024-09-21T03:58:22.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.009+0000 7f6420328740 1 --2- 172.21.15.46:0/202664857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a8c603390 0x564a8c9cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:22.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.009+0000 7f6420328740 1 --2- 172.21.15.46:0/202664857 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564a8c5fb1b0 0x564a8c9cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:22.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.009+0000 7f6420328740 1 --2- 172.21.15.46:0/202664857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a8c624070 0x564a8c9cb650 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:22.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.009+0000 7f6420328740 1 -- 172.21.15.46:0/202664857 >> 172.21.15.46:0/202664857 conn(0x564a8c618460 msgr2=0x564a8c9c9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:22.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.009+0000 7f6420328740 1 -- 172.21.15.46:0/202664857 shutdown_connections 2024-09-21T03:58:22.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.009+0000 7f6420328740 1 -- 172.21.15.46:0/202664857 wait complete. 2024-09-21T03:58:22.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.009+0000 7f6420328740 1 -- start start 2024-09-21T03:58:22.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.009+0000 7f6420328740 1 Processor -- start 2024-09-21T03:58:22.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.009+0000 7f6420328740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a8c5fb1b0 0x564a8c9db170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:22.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.010+0000 7f6420328740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a8c603390 0x564a8c9db6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:22.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.010+0000 7f6420328740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564a8c624070 0x564a8c9e74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:22.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.010+0000 7f6420328740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x564a8c792700 con 0x564a8c5fb1b0 2024-09-21T03:58:22.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.010+0000 7f6420328740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x564a8c8cc110 con 0x564a8c624070 2024-09-21T03:58:22.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.010+0000 7f6420328740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564a8c9de190 con 0x564a8c603390 2024-09-21T03:58:22.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.010+0000 7f6420328740 10 client.0 _ll_register_callbacks cb 0x564a8c8e5990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:58:22.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.010+0000 7f64137fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a8c5fb1b0 0x564a8c9db170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:22.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.010+0000 7f64137fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a8c5fb1b0 0x564a8c9db170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57928/0 (socket says 172.21.15.46:57928) 2024-09-21T03:58:22.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.010+0000 7f64137fe640 1 -- 172.21.15.46:0/4279120643 learned_addr learned my addr 172.21.15.46:0/4279120643 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:22.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.010+0000 7f6412ffd640 1 --2- 172.21.15.46:0/4279120643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a8c603390 0x564a8c9db6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:22.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.010+0000 7f6413fff640 1 --2- 172.21.15.46:0/4279120643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564a8c624070 0x564a8c9e74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:22.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.010+0000 7f64137fe640 1 -- 172.21.15.46:0/4279120643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a8c603390 msgr2=0x564a8c9db6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:22.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.010+0000 7f64137fe640 1 --2- 172.21.15.46:0/4279120643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a8c603390 0x564a8c9db6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:22.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.010+0000 7f64137fe640 1 -- 172.21.15.46:0/4279120643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564a8c624070 msgr2=0x564a8c9e74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:22.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.010+0000 7f64137fe640 1 --2- 172.21.15.46:0/4279120643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564a8c624070 0x564a8c9e74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:22.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.010+0000 7f64137fe640 1 -- 172.21.15.46:0/4279120643 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a8c8f9c40 con 0x564a8c5fb1b0 2024-09-21T03:58:22.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.010+0000 7f6413fff640 1 --2- 172.21.15.46:0/4279120643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564a8c624070 0x564a8c9e74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:58:22.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.010+0000 7f64137fe640 1 --2- 172.21.15.46:0/4279120643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a8c5fb1b0 0x564a8c9db170 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6404009900 tx=0x7f6404009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e0d6ed4afa12af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:22.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.010+0000 7f63f2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:58:22.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.010+0000 7f63f2ffd640 1 -- 172.21.15.46:0/4279120643 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640404d070 con 0x564a8c5fb1b0 2024-09-21T03:58:22.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.010+0000 7f63f2ffd640 1 -- 172.21.15.46:0/4279120643 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f6404005030 con 0x564a8c5fb1b0 2024-09-21T03:58:22.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.010+0000 7f6420328740 1 -- 172.21.15.46:0/4279120643 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f640c01bb10 con 0x564a8c5fb1b0 2024-09-21T03:58:22.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.011+0000 7f63f2ffd640 1 -- 172.21.15.46:0/4279120643 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6404059050 con 0x564a8c5fb1b0 2024-09-21T03:58:22.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.011+0000 7f6420328740 10 client.15897 fetch_fsmap learned FSMap version 20 2024-09-21T03:58:22.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.011+0000 7f6420328740 1 -- 172.21.15.46:0/4279120643 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564a8c9e9f10 con 0x564a8c5fb1b0 2024-09-21T03:58:22.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.011+0000 7f63f2ffd640 1 -- 172.21.15.46:0/4279120643 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f640c01bb10 con 0x564a8c5fb1b0 2024-09-21T03:58:22.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.011+0000 7f63f2ffd640 1 -- 172.21.15.46:0/4279120643 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f64040035f0 con 0x564a8c5fb1b0 2024-09-21T03:58:22.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.011+0000 7f6420328740 10 client.15897 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:58:22.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.011+0000 7f6420328740 10 client.15897 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:58:22.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.011+0000 7f6420328740 20 client.15897 populate_metadata read hostname 'smithi046' 2024-09-21T03:58:22.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.011+0000 7f6420328740 1 --2- 172.21.15.46:0/4279120643 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x564a8c5e29f0 0x564a8c9ed410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:22.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.011+0000 7f6420328740 4 client.15897 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:58:22.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.011+0000 7f6420328740 1 -- 172.21.15.46:0/4279120643 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a8c943da0 con 0x564a8c5e29f0 2024-09-21T03:58:22.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.011+0000 7f6412ffd640 1 --2- 172.21.15.46:0/4279120643 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x564a8c5e29f0 0x564a8c9ed410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:22.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.012+0000 7f6412ffd640 1 --2- 172.21.15.46:0/4279120643 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x564a8c5e29f0 0x564a8c9ed410 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ddc9b87255cc2f5 server_cookie=e54d07d33348f955 in_seq=0 out_seq=0 2024-09-21T03:58:22.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.012+0000 7f63f2ffd640 10 client.15897 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:58:22.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.013+0000 7f63f2ffd640 1 -- 172.21.15.46:0/4279120643 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564a8c943da0 con 0x564a8c5e29f0 2024-09-21T03:58:22.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.013+0000 7f63f2ffd640 10 client.15897 handle_command_reply: tid=0 2024-09-21T03:58:22.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.013+0000 7f6420328740 1 client.15897 shutdown 2024-09-21T03:58:22.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.013+0000 7f6420328740 1 -- 172.21.15.46:0/4279120643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a8c5fb1b0 msgr2=0x564a8c9db170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:22.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.013+0000 7f6420328740 1 --2- 172.21.15.46:0/4279120643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a8c5fb1b0 0x564a8c9db170 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6404009900 tx=0x7f6404009260 comp rx=0 tx=0).stop 2024-09-21T03:58:22.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.013+0000 7f6420328740 1 -- 172.21.15.46:0/4279120643 shutdown_connections 2024-09-21T03:58:22.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.013+0000 7f6420328740 1 --2- 172.21.15.46:0/4279120643 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x564a8c5e29f0 0x564a8c9ed410 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:22.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.013+0000 7f6420328740 1 --2- 172.21.15.46:0/4279120643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564a8c624070 0x564a8c9e74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:22.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.013+0000 7f6420328740 1 --2- 172.21.15.46:0/4279120643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a8c603390 0x564a8c9db6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:22.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.013+0000 7f6420328740 1 --2- 172.21.15.46:0/4279120643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a8c5fb1b0 0x564a8c9db170 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:22.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.013+0000 7f63f2ffd640 0 client.15897 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:58:22.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.013+0000 7f6420328740 1 -- 172.21.15.46:0/4279120643 >> 172.21.15.46:0/4279120643 conn(0x564a8c618460 msgr2=0x564a8c9cd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:22.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.013+0000 7f6420328740 1 -- 172.21.15.46:0/4279120643 shutdown_connections 2024-09-21T03:58:22.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.013+0000 7f6420328740 1 -- 172.21.15.46:0/4279120643 wait complete. 2024-09-21T03:58:22.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.013+0000 7f6420328740 20 client.15897 trim_cache size 0 max 16384 2024-09-21T03:58:22.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.037+0000 7f6420328740 1 Processor -- start 2024-09-21T03:58:22.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.037+0000 7f6420328740 1 -- start start 2024-09-21T03:58:22.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.037+0000 7f6420328740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564a8c5fb1b0 0x564a8c9db6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:22.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.037+0000 7f6420328740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a8c603390 0x564a8c9dd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:22.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.037+0000 7f6420328740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a8c624070 0x564a8c9ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:22.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.037+0000 7f6420328740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f64141ab250 con 0x564a8c624070 2024-09-21T03:58:22.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.037+0000 7f6420328740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f64141adaf0 con 0x564a8c5fb1b0 2024-09-21T03:58:22.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.037+0000 7f6420328740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f64141ab8e0 con 0x564a8c603390 2024-09-21T03:58:22.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.037+0000 7f6413fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a8c624070 0x564a8c9ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:22.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.037+0000 7f6413fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a8c624070 0x564a8c9ccd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57934/0 (socket says 172.21.15.46:57934) 2024-09-21T03:58:22.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.037+0000 7f6413fff640 1 -- 172.21.15.46:0/258965435 learned_addr learned my addr 172.21.15.46:0/258965435 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:22.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.037+0000 7f6412ffd640 1 --2- 172.21.15.46:0/258965435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a8c603390 0x564a8c9dd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:22.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.037+0000 7f64137fe640 1 --2- 172.21.15.46:0/258965435 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564a8c5fb1b0 0x564a8c9db6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:22.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.037+0000 7f6413fff640 1 -- 172.21.15.46:0/258965435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a8c603390 msgr2=0x564a8c9dd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:22.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.038+0000 7f6413fff640 1 --2- 172.21.15.46:0/258965435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a8c603390 0x564a8c9dd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:22.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.038+0000 7f6413fff640 1 -- 172.21.15.46:0/258965435 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564a8c5fb1b0 msgr2=0x564a8c9db6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:22.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.038+0000 7f6413fff640 1 --2- 172.21.15.46:0/258965435 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564a8c5fb1b0 0x564a8c9db6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:22.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.038+0000 7f6413fff640 1 -- 172.21.15.46:0/258965435 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a8c9cc490 con 0x564a8c624070 2024-09-21T03:58:22.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.038+0000 7f64137fe640 1 --2- 172.21.15.46:0/258965435 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564a8c5fb1b0 0x564a8c9db6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:58:22.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.038+0000 7f6413fff640 1 --2- 172.21.15.46:0/258965435 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a8c624070 0x564a8c9ccd90 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f640c01a000 tx=0x7f640c009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e21bbb118cd8d60 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:22.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.038+0000 7f63f97fa640 1 -- 172.21.15.46:0/258965435 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640c02a070 con 0x564a8c624070 2024-09-21T03:58:22.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.038+0000 7f63f97fa640 1 -- 172.21.15.46:0/258965435 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f640c004cc0 con 0x564a8c624070 2024-09-21T03:58:22.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.038+0000 7f63f97fa640 1 -- 172.21.15.46:0/258965435 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640c016050 con 0x564a8c624070 2024-09-21T03:58:22.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.039+0000 7f6420328740 1 -- 172.21.15.46:0/258965435 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a8c624070 msgr2=0x564a8c9ccd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:22.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.039+0000 7f6420328740 1 --2- 172.21.15.46:0/258965435 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a8c624070 0x564a8c9ccd90 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f640c01a000 tx=0x7f640c009c50 comp rx=0 tx=0).stop 2024-09-21T03:58:22.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.039+0000 7f6420328740 1 -- 172.21.15.46:0/258965435 shutdown_connections 2024-09-21T03:58:22.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.039+0000 7f6420328740 1 --2- 172.21.15.46:0/258965435 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a8c624070 0x564a8c9ccd90 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:22.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.039+0000 7f6420328740 1 --2- 172.21.15.46:0/258965435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a8c603390 0x564a8c9dd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:22.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.039+0000 7f6420328740 1 --2- 172.21.15.46:0/258965435 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564a8c5fb1b0 0x564a8c9db6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:22.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.039+0000 7f6420328740 1 -- 172.21.15.46:0/258965435 >> 172.21.15.46:0/258965435 conn(0x564a8c618460 msgr2=0x564a8c9cc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:22.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.039+0000 7f6420328740 1 -- 172.21.15.46:0/258965435 shutdown_connections 2024-09-21T03:58:22.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.039+0000 7f6420328740 1 -- 172.21.15.46:0/258965435 wait complete. 2024-09-21T03:58:22.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.039+0000 7f6420328740 1 -- start start 2024-09-21T03:58:22.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.040+0000 7f6420328740 1 Processor -- start 2024-09-21T03:58:22.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.040+0000 7f6420328740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a8c5fb1b0 0x564a8c9e1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:22.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.040+0000 7f6420328740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a8c603390 0x564a8c9e1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:22.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.040+0000 7f6420328740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564a8c624070 0x564a8c9e1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:22.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.040+0000 7f6420328740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f64141abfb0 con 0x564a8c603390 2024-09-21T03:58:22.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.040+0000 7f6420328740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f64141ad420 con 0x564a8c624070 2024-09-21T03:58:22.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.040+0000 7f6420328740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f64141ac680 con 0x564a8c5fb1b0 2024-09-21T03:58:22.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.040+0000 7f6420328740 10 client.0 _ll_register_callbacks cb 0x7f6404005db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:58:22.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.040+0000 7f6412ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a8c603390 0x564a8c9e1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:22.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.040+0000 7f6412ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a8c603390 0x564a8c9e1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57942/0 (socket says 172.21.15.46:57942) 2024-09-21T03:58:22.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.040+0000 7f6412ffd640 1 -- 172.21.15.46:0/3090961889 learned_addr learned my addr 172.21.15.46:0/3090961889 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:22.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.040+0000 7f64137fe640 1 --2- 172.21.15.46:0/3090961889 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a8c5fb1b0 0x564a8c9e1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:22.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.040+0000 7f6412ffd640 1 -- 172.21.15.46:0/3090961889 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a8c5fb1b0 msgr2=0x564a8c9e1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:22.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.040+0000 7f6413fff640 1 --2- 172.21.15.46:0/3090961889 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564a8c624070 0x564a8c9e1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:22.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.040+0000 7f6412ffd640 1 --2- 172.21.15.46:0/3090961889 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a8c5fb1b0 0x564a8c9e1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:22.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.040+0000 7f6412ffd640 1 -- 172.21.15.46:0/3090961889 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564a8c624070 msgr2=0x564a8c9e1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:22.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.041+0000 7f6412ffd640 1 --2- 172.21.15.46:0/3090961889 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564a8c624070 0x564a8c9e1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:22.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.041+0000 7f6412ffd640 1 -- 172.21.15.46:0/3090961889 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a8ca56ee0 con 0x564a8c603390 2024-09-21T03:58:22.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.041+0000 7f6412ffd640 1 --2- 172.21.15.46:0/3090961889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a8c603390 0x564a8c9e1a40 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6408009610 tx=0x7f64080d0040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0706558645c0532 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:22.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.041+0000 7f63f2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:58:22.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.041+0000 7f63f2ffd640 1 -- 172.21.15.46:0/3090961889 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6408020040 con 0x564a8c603390 2024-09-21T03:58:22.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.041+0000 7f63f2ffd640 1 -- 172.21.15.46:0/3090961889 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f64080a9260 con 0x564a8c603390 2024-09-21T03:58:22.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.041+0000 7f6420328740 1 -- 172.21.15.46:0/3090961889 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f640c004cc0 con 0x564a8c603390 2024-09-21T03:58:22.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.041+0000 7f63f2ffd640 1 -- 172.21.15.46:0/3090961889 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f64080acb00 con 0x564a8c603390 2024-09-21T03:58:22.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.041+0000 7f6420328740 10 client.15903 fetch_fsmap learned FSMap version 20 2024-09-21T03:58:22.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.041+0000 7f6420328740 1 -- 172.21.15.46:0/3090961889 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564a8ca58150 con 0x564a8c603390 2024-09-21T03:58:22.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.041+0000 7f63f2ffd640 1 -- 172.21.15.46:0/3090961889 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f640c004cc0 con 0x564a8c603390 2024-09-21T03:58:22.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.041+0000 7f63f2ffd640 1 -- 172.21.15.46:0/3090961889 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f64080980d0 con 0x564a8c603390 2024-09-21T03:58:22.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.042+0000 7f6420328740 10 client.15903 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:58:22.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.042+0000 7f6420328740 10 client.15903 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:58:22.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.042+0000 7f6420328740 20 client.15903 populate_metadata read hostname 'smithi046' 2024-09-21T03:58:22.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.042+0000 7f6420328740 1 --2- 172.21.15.46:0/3090961889 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x564a8c5b7da0 0x564a8ca5a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:22.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.042+0000 7f6420328740 4 client.15903 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:58:22.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.042+0000 7f6420328740 1 -- 172.21.15.46:0/3090961889 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564a8c93f850 con 0x564a8c5b7da0 2024-09-21T03:58:22.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.042+0000 7f64137fe640 1 --2- 172.21.15.46:0/3090961889 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x564a8c5b7da0 0x564a8ca5a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:22.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.042+0000 7f63f2ffd640 10 client.15903 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:58:22.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.042+0000 7f64137fe640 1 --2- 172.21.15.46:0/3090961889 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x564a8c5b7da0 0x564a8ca5a7e0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=868082dfa420889d server_cookie=18976c2d1820a6e2 in_seq=0 out_seq=0 2024-09-21T03:58:22.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.043+0000 7f63f2ffd640 1 -- 172.21.15.46:0/3090961889 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1794 (crc 0 0 0) 0x564a8c93f850 con 0x564a8c5b7da0 2024-09-21T03:58:22.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.043+0000 7f63f2ffd640 10 client.15903 handle_command_reply: tid=0 2024-09-21T03:58:22.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.043+0000 7f6420328740 1 client.15903 shutdown 2024-09-21T03:58:22.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.043+0000 7f6420328740 1 -- 172.21.15.46:0/3090961889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a8c603390 msgr2=0x564a8c9e1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:22.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.043+0000 7f6420328740 1 --2- 172.21.15.46:0/3090961889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a8c603390 0x564a8c9e1a40 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6408009610 tx=0x7f64080d0040 comp rx=0 tx=0).stop 2024-09-21T03:58:22.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.043+0000 7f6420328740 1 -- 172.21.15.46:0/3090961889 shutdown_connections 2024-09-21T03:58:22.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.043+0000 7f6420328740 1 --2- 172.21.15.46:0/3090961889 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x564a8c5b7da0 0x564a8ca5a7e0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:22.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.043+0000 7f6420328740 1 --2- 172.21.15.46:0/3090961889 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564a8c624070 0x564a8c9e1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:22.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.043+0000 7f6420328740 1 --2- 172.21.15.46:0/3090961889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a8c603390 0x564a8c9e1a40 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:22.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.043+0000 7f6420328740 1 --2- 172.21.15.46:0/3090961889 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a8c5fb1b0 0x564a8c9e1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:22.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.043+0000 7f6420328740 1 -- 172.21.15.46:0/3090961889 >> 172.21.15.46:0/3090961889 conn(0x564a8c618460 msgr2=0x564a8c9dcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:22.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.043+0000 7f63f2ffd640 0 client.15903 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:58:22.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.043+0000 7f6420328740 1 -- 172.21.15.46:0/3090961889 shutdown_connections 2024-09-21T03:58:22.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.043+0000 7f6420328740 1 -- 172.21.15.46:0/3090961889 wait complete. 2024-09-21T03:58:22.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.043+0000 7f6420328740 20 client.15903 trim_cache size 0 max 16384 2024-09-21T03:58:22.052 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T03:58:22.052 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "no active scrubs running", 2024-09-21T03:58:22.052 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": {}, 2024-09-21T03:58:22.052 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_stats": { 2024-09-21T03:58:22.052 INFO:teuthology.orchestra.run.smithi046.stdout: "c47f458a-de5e-4952-a575-a81261953667": { 2024-09-21T03:58:22.053 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:48.699411+0000", 2024-09-21T03:58:22.053 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:58:22.053 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:58:22.053 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:58:22.053 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:58:22.053 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:58:22.053 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:58:22.054 INFO:teuthology.orchestra.run.smithi046.stdout: "e24ec8f1-0d13-478f-9c2c-b51798868ffc": { 2024-09-21T03:58:22.054 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:09.736194+0000", 2024-09-21T03:58:22.054 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:58:22.054 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:58:22.054 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:58:22.054 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:58:22.055 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:58:22.055 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:58:22.055 INFO:teuthology.orchestra.run.smithi046.stdout: "a871f724-0198-493c-b03e-b2de78aba243": { 2024-09-21T03:58:22.055 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:56:30.082991+0000", 2024-09-21T03:58:22.055 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:58:22.055 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:58:22.056 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:58:22.056 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:58:22.056 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:58:22.056 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:58:22.056 INFO:teuthology.orchestra.run.smithi046.stdout: "d49f33a7-3d5a-421b-94ba-8b19a4120db1": { 2024-09-21T03:58:22.056 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:50.480786+0000", 2024-09-21T03:58:22.057 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:58:22.057 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:58:22.057 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:58:22.057 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:58:22.057 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:58:22.057 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:58:22.057 INFO:teuthology.orchestra.run.smithi046.stdout: "3bbf7097-70d7-4743-bbce-41465502b35b": { 2024-09-21T03:58:22.058 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:10.661441+0000", 2024-09-21T03:58:22.058 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:58:22.058 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:58:22.058 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:58:22.058 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:58:22.058 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:58:22.059 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:58:22.059 INFO:teuthology.orchestra.run.smithi046.stdout: "08f0c962-df1a-4129-a1a2-b916240d9803": { 2024-09-21T03:58:22.059 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:02.937596+0000", 2024-09-21T03:58:22.059 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:58:22.059 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:58:22.059 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:58:22.060 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:58:22.060 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:58:22.060 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:58:22.060 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:58:22.060 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T03:58:22.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.044+0000 7f6419db4640 1 -- 172.21.15.46:0/4036724182 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f63fc0b6680 msgr2=0x7f63fc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:22.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.044+0000 7f6419db4640 1 --2- 172.21.15.46:0/4036724182 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f63fc0b6680 0x7f63fc0b8b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6404031440 tx=0x7f6404009610 comp rx=0 tx=0).stop 2024-09-21T03:58:22.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.044+0000 7f6419db4640 1 -- 172.21.15.46:0/4036724182 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6414107300 msgr2=0x7f641419aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:22.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.044+0000 7f6419db4640 1 --2- 172.21.15.46:0/4036724182 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6414107300 0x7f641419aa90 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f640800d750 tx=0x7f640800dc10 comp rx=0 tx=0).stop 2024-09-21T03:58:22.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.044+0000 7f6419db4640 1 -- 172.21.15.46:0/4036724182 shutdown_connections 2024-09-21T03:58:22.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.044+0000 7f6419db4640 1 --2- 172.21.15.46:0/4036724182 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f63fc0b6680 0x7f63fc0b8b90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:22.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.044+0000 7f6419db4640 1 --2- 172.21.15.46:0/4036724182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6414107c50 0x7f641419fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:22.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.044+0000 7f6419db4640 1 --2- 172.21.15.46:0/4036724182 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6414107300 0x7f641419aa90 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:22.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.044+0000 7f6419db4640 1 --2- 172.21.15.46:0/4036724182 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6414102100 0x7f641419a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:22.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.044+0000 7f6419db4640 1 -- 172.21.15.46:0/4036724182 >> 172.21.15.46:0/4036724182 conn(0x7f6414079e40 msgr2=0x7f6414106030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:22.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.044+0000 7f6419db4640 1 -- 172.21.15.46:0/4036724182 shutdown_connections 2024-09-21T03:58:22.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:22.044+0000 7f6419db4640 1 -- 172.21.15.46:0/4036724182 wait complete. 2024-09-21T03:58:22.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:21 smithi105 ceph-mon[34773]: pgmap v419: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T03:58:22.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:21 smithi162 ceph-mon[35071]: pgmap v419: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T03:58:22.861 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:58:22.861 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:58:23.122 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:58:23.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.631+0000 7f4df7575640 1 -- 172.21.15.46:0/2285759893 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df0109df0 msgr2=0x7f4df0110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:23.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.631+0000 7f4df7575640 1 --2- 172.21.15.46:0/2285759893 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df0109df0 0x7f4df0110620 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4de8009900 tx=0x7f4de802a410 comp rx=0 tx=0).stop 2024-09-21T03:58:23.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.631+0000 7f4df7575640 1 -- 172.21.15.46:0/2285759893 shutdown_connections 2024-09-21T03:58:23.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.631+0000 7f4df7575640 1 --2- 172.21.15.46:0/2285759893 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df0109df0 0x7f4df0110620 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:23.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.631+0000 7f4df7575640 1 --2- 172.21.15.46:0/2285759893 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4df01094a0 0x7f4df01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:23.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.631+0000 7f4df7575640 1 --2- 172.21.15.46:0/2285759893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4df0103b60 0x7f4df0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:23.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.631+0000 7f4df7575640 1 -- 172.21.15.46:0/2285759893 >> 172.21.15.46:0/2285759893 conn(0x7f4df007b850 msgr2=0x7f4df007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:23.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.631+0000 7f4df7575640 1 -- 172.21.15.46:0/2285759893 shutdown_connections 2024-09-21T03:58:23.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.631+0000 7f4df7575640 1 -- 172.21.15.46:0/2285759893 wait complete. 2024-09-21T03:58:23.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.632+0000 7f4df7575640 1 Processor -- start 2024-09-21T03:58:23.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.632+0000 7f4df7575640 1 -- start start 2024-09-21T03:58:23.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.632+0000 7f4df7575640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4df0103b60 0x7f4df019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:23.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.632+0000 7f4df7575640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4df01094a0 0x7f4df019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:23.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.632+0000 7f4df7575640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df0109df0 0x7f4df019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:23.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.632+0000 7f4df7575640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4df0113b10 con 0x7f4df0109df0 2024-09-21T03:58:23.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.632+0000 7f4df7575640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4df0113990 con 0x7f4df01094a0 2024-09-21T03:58:23.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.632+0000 7f4df7575640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4df0113c90 con 0x7f4df0103b60 2024-09-21T03:58:23.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.632+0000 7f4df5b12640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df0109df0 0x7f4df019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:23.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.632+0000 7f4df5b12640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df0109df0 0x7f4df019fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57968/0 (socket says 172.21.15.46:57968) 2024-09-21T03:58:23.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.632+0000 7f4df5b12640 1 -- 172.21.15.46:0/164647236 learned_addr learned my addr 172.21.15.46:0/164647236 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:23.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.632+0000 7f4df5311640 1 --2- 172.21.15.46:0/164647236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4df0103b60 0x7f4df019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:23.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.632+0000 7f4df4b10640 1 --2- 172.21.15.46:0/164647236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4df01094a0 0x7f4df019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:23.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.632+0000 7f4df5b12640 1 -- 172.21.15.46:0/164647236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4df0103b60 msgr2=0x7f4df019a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:23.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.632+0000 7f4df5b12640 1 --2- 172.21.15.46:0/164647236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4df0103b60 0x7f4df019a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:23.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.632+0000 7f4df5b12640 1 -- 172.21.15.46:0/164647236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4df01094a0 msgr2=0x7f4df019aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:23.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.632+0000 7f4df5b12640 1 --2- 172.21.15.46:0/164647236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4df01094a0 0x7f4df019aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:23.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.632+0000 7f4df5b12640 1 -- 172.21.15.46:0/164647236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df01a0410 con 0x7f4df0109df0 2024-09-21T03:58:23.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.633+0000 7f4df5311640 1 --2- 172.21.15.46:0/164647236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4df0103b60 0x7f4df019a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:58:23.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.633+0000 7f4df4b10640 1 --2- 172.21.15.46:0/164647236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4df01094a0 0x7f4df019aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:58:23.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.633+0000 7f4df5b12640 1 --2- 172.21.15.46:0/164647236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df0109df0 0x7f4df019fce0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f4de8004770 tx=0x7f4de8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:23.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.633+0000 7f4dee7fc640 1 -- 172.21.15.46:0/164647236 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de803f030 con 0x7f4df0109df0 2024-09-21T03:58:23.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.633+0000 7f4df7575640 1 -- 172.21.15.46:0/164647236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4df01a06a0 con 0x7f4df0109df0 2024-09-21T03:58:23.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.633+0000 7f4dee7fc640 1 -- 172.21.15.46:0/164647236 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4de8003aa0 con 0x7f4df0109df0 2024-09-21T03:58:23.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.633+0000 7f4dee7fc640 1 -- 172.21.15.46:0/164647236 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de8035070 con 0x7f4df0109df0 2024-09-21T03:58:23.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.633+0000 7f4df7575640 1 -- 172.21.15.46:0/164647236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4df01a6e60 con 0x7f4df0109df0 2024-09-21T03:58:23.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.634+0000 7f4df7575640 1 -- 172.21.15.46:0/164647236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4df0103f70 con 0x7f4df0109df0 2024-09-21T03:58:23.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.636+0000 7f4dee7fc640 1 -- 172.21.15.46:0/164647236 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f4de8042030 con 0x7f4df0109df0 2024-09-21T03:58:23.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.637+0000 7f4dee7fc640 1 --2- 172.21.15.46:0/164647236 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4dd80b6680 0x7f4dd80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:23.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.637+0000 7f4df5311640 1 --2- 172.21.15.46:0/164647236 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4dd80b6680 0x7f4dd80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:23.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.637+0000 7f4dee7fc640 1 -- 172.21.15.46:0/164647236 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f4de81080b0 con 0x7f4df0109df0 2024-09-21T03:58:23.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.638+0000 7f4df5311640 1 --2- 172.21.15.46:0/164647236 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4dd80b6680 0x7f4dd80b8b90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4de0005fd0 tx=0x7f4de0009520 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:23.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.641+0000 7f4dee7fc640 1 -- 172.21.15.46:0/164647236 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4de80ce6a0 con 0x7f4df0109df0 2024-09-21T03:58:23.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.870+0000 7f4df7575640 1 -- 172.21.15.46:0/164647236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4df019b5d0 con 0x7f4df0109df0 2024-09-21T03:58:23.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.871+0000 7f4dee7fc640 1 -- 172.21.15.46:0/164647236 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f4df019b5d0 con 0x7f4df0109df0 2024-09-21T03:58:23.873 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:58:23.873 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"btime":"2024-09-21T03:53:23:865820+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1766354184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1766354184},{"type":"v1","addr":"172.21.15.46:6839","nonce":1766354184}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/1901774207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":1901774207},{"type":"v1","addr":"172.21.15.46:6841","nonce":1901774207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3548633196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":3548633196},{"type":"v1","addr":"172.21.15.105:6837","nonce":3548633196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24652,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3551934241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3551934241},{"type":"v1","addr":"172.21.15.162:6835","nonce":3551934241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/48949822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":48949822},{"type":"v1","addr":"172.21.15.162:6837","nonce":48949822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:53:14.452819+0000","modified":"2024-09-21T03:53:23.593278+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24680},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/2196053213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2196053213},{"type":"v1","addr":"172.21.15.162:6839","nonce":2196053213}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.105:6839/3911438406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":3911438406},{"type":"v1","addr":"172.21.15.105:6839","nonce":3911438406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24680,"qdb_cluster":[24680]},"id":1}]} 2024-09-21T03:58:23.874 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T03:58:23.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.873+0000 7f4df7575640 1 -- 172.21.15.46:0/164647236 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4dd80b6680 msgr2=0x7f4dd80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:23.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.873+0000 7f4df7575640 1 --2- 172.21.15.46:0/164647236 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4dd80b6680 0x7f4dd80b8b90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4de0005fd0 tx=0x7f4de0009520 comp rx=0 tx=0).stop 2024-09-21T03:58:23.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.873+0000 7f4df7575640 1 -- 172.21.15.46:0/164647236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df0109df0 msgr2=0x7f4df019fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:23.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.873+0000 7f4df7575640 1 --2- 172.21.15.46:0/164647236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df0109df0 0x7f4df019fce0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f4de8004770 tx=0x7f4de8004270 comp rx=0 tx=0).stop 2024-09-21T03:58:23.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.873+0000 7f4df7575640 1 -- 172.21.15.46:0/164647236 shutdown_connections 2024-09-21T03:58:23.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.873+0000 7f4df7575640 1 --2- 172.21.15.46:0/164647236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df0109df0 0x7f4df019fce0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:23.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.873+0000 7f4df7575640 1 --2- 172.21.15.46:0/164647236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4df01094a0 0x7f4df019aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:23.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.873+0000 7f4df7575640 1 --2- 172.21.15.46:0/164647236 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f4dd80b6680 0x7f4dd80b8b90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:23.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.873+0000 7f4df7575640 1 --2- 172.21.15.46:0/164647236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4df0103b60 0x7f4df019a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:23.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.874+0000 7f4df7575640 1 -- 172.21.15.46:0/164647236 >> 172.21.15.46:0/164647236 conn(0x7f4df007b850 msgr2=0x7f4df0105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:23.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.874+0000 7f4df7575640 1 -- 172.21.15.46:0/164647236 shutdown_connections 2024-09-21T03:58:23.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:23.874+0000 7f4df7575640 1 -- 172.21.15.46:0/164647236 wait complete. 2024-09-21T03:58:24.237 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:23 smithi046 ceph-mon[30954]: pgmap v420: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 2 op/s 2024-09-21T03:58:24.238 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:23 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:58:24.238 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:23 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/164647236' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:58:24.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:23 smithi105 ceph-mon[34773]: pgmap v420: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 2 op/s 2024-09-21T03:58:24.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:23 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:58:24.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:23 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/164647236' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:58:24.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:23 smithi162 ceph-mon[35071]: pgmap v420: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 2 op/s 2024-09-21T03:58:24.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:23 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:58:24.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:23 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/164647236' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:58:24.655 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:58:24.916 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:58:25.186 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:24 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:58:25.186 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:24 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:58:25.186 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:24 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:58:25.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:24 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:58:25.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:24 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:58:25.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:24 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:58:25.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:24 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:58:25.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:24 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:58:25.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:24 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:58:25.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.429+0000 7fed1d43f640 1 -- 172.21.15.46:0/1206649285 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed18103b80 msgr2=0x7fed18103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:25.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.429+0000 7fed1d43f640 1 --2- 172.21.15.46:0/1206649285 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed18103b80 0x7fed18103f90 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fed08009900 tx=0x7fed0802a410 comp rx=0 tx=0).stop 2024-09-21T03:58:25.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.429+0000 7fed1d43f640 1 -- 172.21.15.46:0/1206649285 shutdown_connections 2024-09-21T03:58:25.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.429+0000 7fed1d43f640 1 --2- 172.21.15.46:0/1206649285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed18109e10 0x7fed18110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:25.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.429+0000 7fed1d43f640 1 --2- 172.21.15.46:0/1206649285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed181094c0 0x7fed181098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:25.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.429+0000 7fed1d43f640 1 --2- 172.21.15.46:0/1206649285 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed18103b80 0x7fed18103f90 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:25.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.429+0000 7fed1d43f640 1 -- 172.21.15.46:0/1206649285 >> 172.21.15.46:0/1206649285 conn(0x7fed180ff610 msgr2=0x7fed18101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:25.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.429+0000 7fed1d43f640 1 -- 172.21.15.46:0/1206649285 shutdown_connections 2024-09-21T03:58:25.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.429+0000 7fed1d43f640 1 -- 172.21.15.46:0/1206649285 wait complete. 2024-09-21T03:58:25.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.429+0000 7fed1d43f640 1 Processor -- start 2024-09-21T03:58:25.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.430+0000 7fed1d43f640 1 -- start start 2024-09-21T03:58:25.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.430+0000 7fed1d43f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed18103b80 0x7fed1819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:25.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.430+0000 7fed1d43f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed181094c0 0x7fed1819aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:25.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.430+0000 7fed1d43f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed18109e10 0x7fed1819fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:25.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.430+0000 7fed1d43f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fed18113ad0 con 0x7fed18103b80 2024-09-21T03:58:25.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.430+0000 7fed1d43f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fed18113950 con 0x7fed18109e10 2024-09-21T03:58:25.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.430+0000 7fed1d43f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fed18113c50 con 0x7fed181094c0 2024-09-21T03:58:25.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.430+0000 7fed16ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed18103b80 0x7fed1819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:25.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.430+0000 7fed16ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed18103b80 0x7fed1819a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57976/0 (socket says 172.21.15.46:57976) 2024-09-21T03:58:25.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.430+0000 7fed16ffd640 1 -- 172.21.15.46:0/456937830 learned_addr learned my addr 172.21.15.46:0/456937830 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:25.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.430+0000 7fed0e7fc640 1 --2- 172.21.15.46:0/456937830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed181094c0 0x7fed1819aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:25.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.430+0000 7fed177fe640 1 --2- 172.21.15.46:0/456937830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed18109e10 0x7fed1819fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:25.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.430+0000 7fed16ffd640 1 -- 172.21.15.46:0/456937830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed181094c0 msgr2=0x7fed1819aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:25.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.430+0000 7fed16ffd640 1 --2- 172.21.15.46:0/456937830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed181094c0 0x7fed1819aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:25.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.430+0000 7fed16ffd640 1 -- 172.21.15.46:0/456937830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed18109e10 msgr2=0x7fed1819fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:25.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.430+0000 7fed16ffd640 1 --2- 172.21.15.46:0/456937830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed18109e10 0x7fed1819fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:25.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.430+0000 7fed16ffd640 1 -- 172.21.15.46:0/456937830 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed181a0430 con 0x7fed18103b80 2024-09-21T03:58:25.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.431+0000 7fed16ffd640 1 --2- 172.21.15.46:0/456937830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed18103b80 0x7fed1819a4c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fed08005940 tx=0x7fed08004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:25.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.431+0000 7fed14ff9640 1 -- 172.21.15.46:0/456937830 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed0803f030 con 0x7fed18103b80 2024-09-21T03:58:25.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.431+0000 7fed14ff9640 1 -- 172.21.15.46:0/456937830 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed08003aa0 con 0x7fed18103b80 2024-09-21T03:58:25.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.431+0000 7fed1d43f640 1 -- 172.21.15.46:0/456937830 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed181a06c0 con 0x7fed18103b80 2024-09-21T03:58:25.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.431+0000 7fed14ff9640 1 -- 172.21.15.46:0/456937830 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed08035070 con 0x7fed18103b80 2024-09-21T03:58:25.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.431+0000 7fed1d43f640 1 -- 172.21.15.46:0/456937830 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed181a6e80 con 0x7fed18103b80 2024-09-21T03:58:25.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.433+0000 7fed239b3740 1 Processor -- start 2024-09-21T03:58:25.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.434+0000 7fed239b3740 1 -- start start 2024-09-21T03:58:25.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.434+0000 7fed239b3740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c90075070 0x557c9041c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:25.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.434+0000 7fed14ff9640 1 -- 172.21.15.46:0/456937830 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7fed08042030 con 0x7fed18103b80 2024-09-21T03:58:25.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.434+0000 7fed239b3740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557c9004c1b0 0x557c9041cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:25.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.434+0000 7fed239b3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c90054390 0x557c9041d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:25.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.434+0000 7fed239b3740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x557c90392ea0 con 0x557c9004c1b0 2024-09-21T03:58:25.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.434+0000 7fed239b3740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x557c903822d0 con 0x557c90075070 2024-09-21T03:58:25.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.434+0000 7fed239b3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557c903860e0 con 0x557c90054390 2024-09-21T03:58:25.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.434+0000 7fed16ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557c9004c1b0 0x557c9041cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:25.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.434+0000 7fed0e7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c90054390 0x557c9041d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:25.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.434+0000 7fed177fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c90075070 0x557c9041c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:25.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.434+0000 7fed0e7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c90054390 0x557c9041d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:59530/0 (socket says 172.21.15.46:59530) 2024-09-21T03:58:25.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.434+0000 7fed0e7fc640 1 -- 172.21.15.46:0/3203946030 learned_addr learned my addr 172.21.15.46:0/3203946030 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:25.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.434+0000 7fed16ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557c9004c1b0 0x557c9041cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57984/0 (socket says 172.21.15.46:57984) 2024-09-21T03:58:25.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.435+0000 7fed177fe640 1 -- 172.21.15.46:0/3203946030 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c90054390 msgr2=0x557c9041d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:25.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.435+0000 7fed177fe640 1 --2- 172.21.15.46:0/3203946030 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c90054390 0x557c9041d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:25.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.435+0000 7fed177fe640 1 -- 172.21.15.46:0/3203946030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557c9004c1b0 msgr2=0x557c9041cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:25.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.435+0000 7fed177fe640 1 --2- 172.21.15.46:0/3203946030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557c9004c1b0 0x557c9041cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:25.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.435+0000 7fed177fe640 1 -- 172.21.15.46:0/3203946030 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c900e0650 con 0x557c90075070 2024-09-21T03:58:25.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.435+0000 7fed0e7fc640 1 --2- 172.21.15.46:0/3203946030 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c90054390 0x557c9041d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:58:25.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.435+0000 7fed177fe640 1 --2- 172.21.15.46:0/3203946030 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c90075070 0x557c9041c6a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fed10009f50 tx=0x7fed10003e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d6a268772683225 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:25.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.435+0000 7fed14ff9640 1 --2- 172.21.15.46:0/456937830 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fed040b6680 0x7fed040b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:25.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.435+0000 7fed0d7fa640 1 -- 172.21.15.46:0/3203946030 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed10011440 con 0x557c90075070 2024-09-21T03:58:25.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.436+0000 7fed0d7fa640 1 -- 172.21.15.46:0/3203946030 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed10015030 con 0x557c90075070 2024-09-21T03:58:25.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.436+0000 7fed0d7fa640 1 -- 172.21.15.46:0/3203946030 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed10010920 con 0x557c90075070 2024-09-21T03:58:25.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.436+0000 7fed16ffd640 1 --2- 172.21.15.46:0/456937830 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fed040b6680 0x7fed040b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:25.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.436+0000 7fed14ff9640 1 -- 172.21.15.46:0/456937830 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fed08107af0 con 0x7fed18103b80 2024-09-21T03:58:25.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.437+0000 7fed239b3740 1 -- 172.21.15.46:0/3203946030 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c90075070 msgr2=0x557c9041c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:25.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.437+0000 7fed16ffd640 1 --2- 172.21.15.46:0/456937830 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fed040b6680 0x7fed040b8b90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x557c9041b320 tx=0x7fed0810b7f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:25.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.437+0000 7fed239b3740 1 --2- 172.21.15.46:0/3203946030 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c90075070 0x557c9041c6a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fed10009f50 tx=0x7fed10003e00 comp rx=0 tx=0).stop 2024-09-21T03:58:25.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.437+0000 7fed239b3740 1 -- 172.21.15.46:0/3203946030 shutdown_connections 2024-09-21T03:58:25.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.437+0000 7fed239b3740 1 --2- 172.21.15.46:0/3203946030 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c90054390 0x557c9041d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:25.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.437+0000 7fed239b3740 1 --2- 172.21.15.46:0/3203946030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557c9004c1b0 0x557c9041cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:25.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.437+0000 7fed239b3740 1 --2- 172.21.15.46:0/3203946030 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c90075070 0x557c9041c6a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:25.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.437+0000 7fed239b3740 1 -- 172.21.15.46:0/3203946030 >> 172.21.15.46:0/3203946030 conn(0x557c90069460 msgr2=0x557c9041a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:25.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.437+0000 7fed239b3740 1 -- 172.21.15.46:0/3203946030 shutdown_connections 2024-09-21T03:58:25.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.437+0000 7fed239b3740 1 -- 172.21.15.46:0/3203946030 wait complete. 2024-09-21T03:58:25.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.437+0000 7fed239b3740 1 -- start start 2024-09-21T03:58:25.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.438+0000 7fed239b3740 1 Processor -- start 2024-09-21T03:58:25.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.438+0000 7fed239b3740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557c9004c1b0 0x557c90427d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:25.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.438+0000 7fed239b3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c90054390 0x557c904282d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:25.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.438+0000 7fed239b3740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c90075070 0x557c904341a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:25.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.438+0000 7fed239b3740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x557c901e3700 con 0x557c9004c1b0 2024-09-21T03:58:25.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.438+0000 7fed239b3740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x557c9031d160 con 0x557c90075070 2024-09-21T03:58:25.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.438+0000 7fed239b3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557c9042ae80 con 0x557c90054390 2024-09-21T03:58:25.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.438+0000 7fed239b3740 10 client.0 _ll_register_callbacks cb 0x557c903369e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:58:25.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.438+0000 7fed177fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557c9004c1b0 0x557c90427d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:25.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.438+0000 7fed177fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557c9004c1b0 0x557c90427d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57992/0 (socket says 172.21.15.46:57992) 2024-09-21T03:58:25.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.438+0000 7fed177fe640 1 -- 172.21.15.46:0/57620486 learned_addr learned my addr 172.21.15.46:0/57620486 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:25.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.438+0000 7fed0e7fc640 1 --2- 172.21.15.46:0/57620486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c90054390 0x557c904282d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:25.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.438+0000 7fed177fe640 1 -- 172.21.15.46:0/57620486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c90054390 msgr2=0x557c904282d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:25.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.438+0000 7fed177fe640 1 --2- 172.21.15.46:0/57620486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c90054390 0x557c904282d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:25.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.438+0000 7fed177fe640 1 -- 172.21.15.46:0/57620486 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c90075070 msgr2=0x557c904341a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:25.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.438+0000 7fed177fe640 1 --2- 172.21.15.46:0/57620486 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c90075070 0x557c904341a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:25.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.439+0000 7fed177fe640 1 -- 172.21.15.46:0/57620486 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c9034ac90 con 0x557c9004c1b0 2024-09-21T03:58:25.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.439+0000 7fed177fe640 1 --2- 172.21.15.46:0/57620486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557c9004c1b0 0x557c90427d90 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fed10005cb0 tx=0x7fed10011e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e34a3010aa2feb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:25.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.439+0000 7fecfe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:58:25.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.439+0000 7fecfe7fc640 1 -- 172.21.15.46:0/57620486 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed10011440 con 0x557c9004c1b0 2024-09-21T03:58:25.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.439+0000 7fecfe7fc640 1 -- 172.21.15.46:0/57620486 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fed100115e0 con 0x557c9004c1b0 2024-09-21T03:58:25.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.439+0000 7fed239b3740 1 -- 172.21.15.46:0/57620486 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed10015030 con 0x557c9004c1b0 2024-09-21T03:58:25.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.439+0000 7fecfe7fc640 1 -- 172.21.15.46:0/57620486 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fed100117e0 con 0x557c9004c1b0 2024-09-21T03:58:25.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.439+0000 7fed239b3740 10 client.15921 fetch_fsmap learned FSMap version 20 2024-09-21T03:58:25.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.439+0000 7fed239b3740 1 -- 172.21.15.46:0/57620486 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557c90436b90 con 0x557c9004c1b0 2024-09-21T03:58:25.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.440+0000 7fecfe7fc640 1 -- 172.21.15.46:0/57620486 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed10015030 con 0x557c9004c1b0 2024-09-21T03:58:25.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.440+0000 7fecfe7fc640 1 -- 172.21.15.46:0/57620486 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fed1001a420 con 0x557c9004c1b0 2024-09-21T03:58:25.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.440+0000 7fed239b3740 10 client.15921 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:58:25.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.440+0000 7fed239b3740 10 client.15921 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:58:25.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.440+0000 7fed239b3740 20 client.15921 populate_metadata read hostname 'smithi046' 2024-09-21T03:58:25.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.440+0000 7fed239b3740 1 --2- 172.21.15.46:0/57620486 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x557c900339f0 0x557c90439fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:25.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.440+0000 7fed239b3740 4 client.15921 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:58:25.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.440+0000 7fed239b3740 1 -- 172.21.15.46:0/57620486 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c90394df0 con 0x557c900339f0 2024-09-21T03:58:25.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.440+0000 7fed0e7fc640 1 --2- 172.21.15.46:0/57620486 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x557c900339f0 0x557c90439fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:25.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.441+0000 7fed0e7fc640 1 --2- 172.21.15.46:0/57620486 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x557c900339f0 0x557c90439fa0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bf4b0354ae7b4e3 server_cookie=ecd02dca7b9fa115 in_seq=0 out_seq=0 2024-09-21T03:58:25.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.441+0000 7fecfe7fc640 10 client.15921 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:58:25.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.441+0000 7fecfe7fc640 1 -- 172.21.15.46:0/57620486 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557c90394df0 con 0x557c900339f0 2024-09-21T03:58:25.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.441+0000 7fecfe7fc640 10 client.15921 handle_command_reply: tid=0 2024-09-21T03:58:25.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.442+0000 7fed239b3740 1 client.15921 shutdown 2024-09-21T03:58:25.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.442+0000 7fed239b3740 1 -- 172.21.15.46:0/57620486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557c9004c1b0 msgr2=0x557c90427d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:25.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.442+0000 7fed239b3740 1 --2- 172.21.15.46:0/57620486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557c9004c1b0 0x557c90427d90 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fed10005cb0 tx=0x7fed10011e10 comp rx=0 tx=0).stop 2024-09-21T03:58:25.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.442+0000 7fed239b3740 1 -- 172.21.15.46:0/57620486 shutdown_connections 2024-09-21T03:58:25.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.442+0000 7fed239b3740 1 --2- 172.21.15.46:0/57620486 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x557c900339f0 0x557c90439fa0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:25.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.442+0000 7fed239b3740 1 --2- 172.21.15.46:0/57620486 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c90075070 0x557c904341a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:25.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.442+0000 7fed239b3740 1 --2- 172.21.15.46:0/57620486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c90054390 0x557c904282d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:25.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.442+0000 7fed239b3740 1 --2- 172.21.15.46:0/57620486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557c9004c1b0 0x557c90427d90 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:25.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.442+0000 7fed239b3740 1 -- 172.21.15.46:0/57620486 >> 172.21.15.46:0/57620486 conn(0x557c90069460 msgr2=0x557c9041f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:25.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.442+0000 7fecfe7fc640 0 client.15921 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:58:25.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.442+0000 7fed239b3740 1 -- 172.21.15.46:0/57620486 shutdown_connections 2024-09-21T03:58:25.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.442+0000 7fed239b3740 1 -- 172.21.15.46:0/57620486 wait complete. 2024-09-21T03:58:25.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.442+0000 7fed239b3740 20 client.15921 trim_cache size 0 max 16384 2024-09-21T03:58:25.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.455+0000 7fed239b3740 1 Processor -- start 2024-09-21T03:58:25.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.455+0000 7fed239b3740 1 -- start start 2024-09-21T03:58:25.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.456+0000 7fed239b3740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557c9004c1b0 0x557c9041e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:25.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.456+0000 7fed239b3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c90054390 0x557c904292b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:25.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.456+0000 7fed239b3740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c90075070 0x557c90434110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:25.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.456+0000 7fed239b3740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fed181ad4d0 con 0x557c9004c1b0 2024-09-21T03:58:25.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.456+0000 7fed239b3740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fed181afd70 con 0x557c90075070 2024-09-21T03:58:25.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.456+0000 7fed239b3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fed181adb60 con 0x557c90054390 2024-09-21T03:58:25.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.456+0000 7fed177fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557c9004c1b0 0x557c9041e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:25.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.456+0000 7fed177fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557c9004c1b0 0x557c9041e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58006/0 (socket says 172.21.15.46:58006) 2024-09-21T03:58:25.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.456+0000 7fed177fe640 1 -- 172.21.15.46:0/238451852 learned_addr learned my addr 172.21.15.46:0/238451852 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:25.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.456+0000 7fed0e7fc640 1 --2- 172.21.15.46:0/238451852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c90054390 0x557c904292b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:25.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.456+0000 7fed177fe640 1 -- 172.21.15.46:0/238451852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c90054390 msgr2=0x557c904292b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:25.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.456+0000 7fed177fe640 1 --2- 172.21.15.46:0/238451852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c90054390 0x557c904292b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:25.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.456+0000 7fed177fe640 1 -- 172.21.15.46:0/238451852 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c90075070 msgr2=0x557c90434110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:25.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.456+0000 7fed177fe640 1 --2- 172.21.15.46:0/238451852 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c90075070 0x557c90434110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:25.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.456+0000 7fed177fe640 1 -- 172.21.15.46:0/238451852 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c9042a160 con 0x557c9004c1b0 2024-09-21T03:58:25.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.456+0000 7fed177fe640 1 --2- 172.21.15.46:0/238451852 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557c9004c1b0 0x557c9041e090 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fed10003e40 tx=0x7fed10005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b2f51b4127d1791 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:25.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.457+0000 7fed0cff9640 1 -- 172.21.15.46:0/238451852 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed10033070 con 0x557c9004c1b0 2024-09-21T03:58:25.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.457+0000 7fed0cff9640 1 -- 172.21.15.46:0/238451852 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed10015050 con 0x557c9004c1b0 2024-09-21T03:58:25.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.457+0000 7fed0cff9640 1 -- 172.21.15.46:0/238451852 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed10011640 con 0x557c9004c1b0 2024-09-21T03:58:25.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.457+0000 7fed239b3740 1 -- 172.21.15.46:0/238451852 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557c9004c1b0 msgr2=0x557c9041e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:25.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.457+0000 7fed239b3740 1 --2- 172.21.15.46:0/238451852 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557c9004c1b0 0x557c9041e090 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fed10003e40 tx=0x7fed10005b00 comp rx=0 tx=0).stop 2024-09-21T03:58:25.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.458+0000 7fed239b3740 1 -- 172.21.15.46:0/238451852 shutdown_connections 2024-09-21T03:58:25.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.458+0000 7fed239b3740 1 --2- 172.21.15.46:0/238451852 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c90075070 0x557c90434110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:25.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.458+0000 7fed239b3740 1 --2- 172.21.15.46:0/238451852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c90054390 0x557c904292b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:25.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.458+0000 7fed239b3740 1 --2- 172.21.15.46:0/238451852 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557c9004c1b0 0x557c9041e090 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:25.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.458+0000 7fed239b3740 1 -- 172.21.15.46:0/238451852 >> 172.21.15.46:0/238451852 conn(0x557c90069460 msgr2=0x557c904217b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:25.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.458+0000 7fed239b3740 1 -- 172.21.15.46:0/238451852 shutdown_connections 2024-09-21T03:58:25.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.458+0000 7fed239b3740 1 -- 172.21.15.46:0/238451852 wait complete. 2024-09-21T03:58:25.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.458+0000 7fed239b3740 1 -- start start 2024-09-21T03:58:25.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.458+0000 7fed239b3740 1 Processor -- start 2024-09-21T03:58:25.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.458+0000 7fed239b3740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557c9004c1b0 0x557c9043afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:25.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.458+0000 7fed239b3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c90054390 0x557c9043b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:25.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.458+0000 7fed239b3740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c90075070 0x557c9043ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:25.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.458+0000 7fed239b3740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fed181ae230 con 0x557c9004c1b0 2024-09-21T03:58:25.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.458+0000 7fed239b3740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fed181af6a0 con 0x557c90075070 2024-09-21T03:58:25.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.458+0000 7fed239b3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fed181ae900 con 0x557c90054390 2024-09-21T03:58:25.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.458+0000 7fed239b3740 10 client.0 _ll_register_callbacks cb 0x7fed0810b6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:58:25.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.459+0000 7fed177fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557c9004c1b0 0x557c9043afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:25.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.459+0000 7fed177fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557c9004c1b0 0x557c9043afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58020/0 (socket says 172.21.15.46:58020) 2024-09-21T03:58:25.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.459+0000 7fed177fe640 1 -- 172.21.15.46:0/3263920354 learned_addr learned my addr 172.21.15.46:0/3263920354 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:25.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.459+0000 7fed0e7fc640 1 --2- 172.21.15.46:0/3263920354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c90054390 0x557c9043b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:25.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.459+0000 7fed177fe640 1 --2- 172.21.15.46:0/3263920354 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c90075070 0x557c9043ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:25.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.459+0000 7fed177fe640 1 -- 172.21.15.46:0/3263920354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c90054390 msgr2=0x557c9043b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:25.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.459+0000 7fed177fe640 1 --2- 172.21.15.46:0/3263920354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c90054390 0x557c9043b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:25.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.459+0000 7fed177fe640 1 -- 172.21.15.46:0/3263920354 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c90075070 msgr2=0x557c9043ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:25.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.459+0000 7fed177fe640 1 --2- 172.21.15.46:0/3263920354 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c90075070 0x557c9043ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:25.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.459+0000 7fed177fe640 1 -- 172.21.15.46:0/3263920354 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c904a3720 con 0x557c9004c1b0 2024-09-21T03:58:25.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.459+0000 7fed177fe640 1 --2- 172.21.15.46:0/3263920354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557c9004c1b0 0x557c9043afa0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fed10014040 tx=0x7fed100021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36ba5890ad30885a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:25.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.459+0000 7fecfe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:58:25.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.459+0000 7fecfe7fc640 1 -- 172.21.15.46:0/3263920354 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed10033050 con 0x557c9004c1b0 2024-09-21T03:58:25.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.459+0000 7fed239b3740 1 -- 172.21.15.46:0/3263920354 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed10015050 con 0x557c9004c1b0 2024-09-21T03:58:25.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.459+0000 7fecfe7fc640 1 -- 172.21.15.46:0/3263920354 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fed10011b90 con 0x557c9004c1b0 2024-09-21T03:58:25.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.460+0000 7fecfe7fc640 1 -- 172.21.15.46:0/3263920354 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fed10047050 con 0x557c9004c1b0 2024-09-21T03:58:25.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.460+0000 7fed239b3740 10 client.15927 fetch_fsmap learned FSMap version 20 2024-09-21T03:58:25.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.460+0000 7fed239b3740 1 -- 172.21.15.46:0/3263920354 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557c904a4970 con 0x557c9004c1b0 2024-09-21T03:58:25.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.460+0000 7fecfe7fc640 1 -- 172.21.15.46:0/3263920354 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed10015050 con 0x557c9004c1b0 2024-09-21T03:58:25.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.460+0000 7fecfe7fc640 1 -- 172.21.15.46:0/3263920354 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fed10037450 con 0x557c9004c1b0 2024-09-21T03:58:25.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.460+0000 7fed239b3740 10 client.15927 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:58:25.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.460+0000 7fed239b3740 10 client.15927 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:58:25.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.460+0000 7fed239b3740 20 client.15927 populate_metadata read hostname 'smithi046' 2024-09-21T03:58:25.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.460+0000 7fed239b3740 1 --2- 172.21.15.46:0/3263920354 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x557c90008da0 0x557c904a6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:25.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.460+0000 7fed239b3740 4 client.15927 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:58:25.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.460+0000 7fed239b3740 1 -- 172.21.15.46:0/3263920354 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557c903908a0 con 0x557c90008da0 2024-09-21T03:58:25.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.460+0000 7fed0e7fc640 1 --2- 172.21.15.46:0/3263920354 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x557c90008da0 0x557c904a6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:25.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.461+0000 7fed0e7fc640 1 --2- 172.21.15.46:0/3263920354 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x557c90008da0 0x557c904a6fe0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a589e9e16c8eb6ad server_cookie=dde8917627af72c in_seq=0 out_seq=0 2024-09-21T03:58:25.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.461+0000 7fecfe7fc640 10 client.15927 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:58:25.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.461+0000 7fecfe7fc640 1 -- 172.21.15.46:0/3263920354 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557c903908a0 con 0x557c90008da0 2024-09-21T03:58:25.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.461+0000 7fecfe7fc640 10 client.15927 handle_command_reply: tid=0 2024-09-21T03:58:25.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.461+0000 7fed239b3740 1 client.15927 shutdown 2024-09-21T03:58:25.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.461+0000 7fed239b3740 1 -- 172.21.15.46:0/3263920354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557c9004c1b0 msgr2=0x557c9043afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:25.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.461+0000 7fed239b3740 1 --2- 172.21.15.46:0/3263920354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557c9004c1b0 0x557c9043afa0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fed10014040 tx=0x7fed100021d0 comp rx=0 tx=0).stop 2024-09-21T03:58:25.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.461+0000 7fed239b3740 1 -- 172.21.15.46:0/3263920354 shutdown_connections 2024-09-21T03:58:25.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.461+0000 7fed239b3740 1 --2- 172.21.15.46:0/3263920354 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x557c90008da0 0x557c904a6fe0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:25.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.461+0000 7fed239b3740 1 --2- 172.21.15.46:0/3263920354 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557c90075070 0x557c9043ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:25.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.461+0000 7fed239b3740 1 --2- 172.21.15.46:0/3263920354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c90054390 0x557c9043b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:25.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.461+0000 7fed239b3740 1 --2- 172.21.15.46:0/3263920354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557c9004c1b0 0x557c9043afa0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:25.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.461+0000 7fed239b3740 1 -- 172.21.15.46:0/3263920354 >> 172.21.15.46:0/3263920354 conn(0x557c90069460 msgr2=0x557c9041ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:25.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.461+0000 7fecfe7fc640 0 client.15927 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:58:25.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.461+0000 7fed239b3740 1 -- 172.21.15.46:0/3263920354 shutdown_connections 2024-09-21T03:58:25.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.461+0000 7fed239b3740 1 -- 172.21.15.46:0/3263920354 wait complete. 2024-09-21T03:58:25.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.461+0000 7fed239b3740 20 client.15927 trim_cache size 0 max 16384 2024-09-21T03:58:25.470 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-21T03:58:25.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.462+0000 7fed1d43f640 1 -- 172.21.15.46:0/456937830 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fed040b6680 msgr2=0x7fed040b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:25.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.462+0000 7fed1d43f640 1 --2- 172.21.15.46:0/456937830 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fed040b6680 0x7fed040b8b90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x557c9041b320 tx=0x7fed0810b7f0 comp rx=0 tx=0).stop 2024-09-21T03:58:25.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.462+0000 7fed1d43f640 1 -- 172.21.15.46:0/456937830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed18103b80 msgr2=0x7fed1819a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:25.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.462+0000 7fed1d43f640 1 --2- 172.21.15.46:0/456937830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed18103b80 0x7fed1819a4c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fed08005940 tx=0x7fed08004270 comp rx=0 tx=0).stop 2024-09-21T03:58:25.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.462+0000 7fed1d43f640 1 -- 172.21.15.46:0/456937830 shutdown_connections 2024-09-21T03:58:25.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.462+0000 7fed1d43f640 1 --2- 172.21.15.46:0/456937830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed18109e10 0x7fed1819fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:25.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.462+0000 7fed1d43f640 1 --2- 172.21.15.46:0/456937830 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fed040b6680 0x7fed040b8b90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:25.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.462+0000 7fed1d43f640 1 --2- 172.21.15.46:0/456937830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed181094c0 0x7fed1819aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:25.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.462+0000 7fed1d43f640 1 --2- 172.21.15.46:0/456937830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed18103b80 0x7fed1819a4c0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:25.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.462+0000 7fed1d43f640 1 -- 172.21.15.46:0/456937830 >> 172.21.15.46:0/456937830 conn(0x7fed180ff610 msgr2=0x7fed18101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:25.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.462+0000 7fed1d43f640 1 -- 172.21.15.46:0/456937830 shutdown_connections 2024-09-21T03:58:25.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:25.462+0000 7fed1d43f640 1 -- 172.21.15.46:0/456937830 wait complete. 2024-09-21T03:58:26.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:25 smithi046 ceph-mon[30954]: pgmap v421: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:58:26.317 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:25 smithi105 ceph-mon[34773]: pgmap v421: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:58:26.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:25 smithi162 ceph-mon[35071]: pgmap v421: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:58:27.316 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:58:27.316 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:58:27.590 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:58:28.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:27 smithi046 ceph-mon[30954]: pgmap v422: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:58:28.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.124+0000 7fd848ce3640 1 -- 172.21.15.46:0/3153050551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd844103b60 msgr2=0x7fd844103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:28.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.124+0000 7fd848ce3640 1 --2- 172.21.15.46:0/3153050551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd844103b60 0x7fd844103f70 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fd834009900 tx=0x7fd83402a410 comp rx=0 tx=0).stop 2024-09-21T03:58:28.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.125+0000 7fd848ce3640 1 -- 172.21.15.46:0/3153050551 shutdown_connections 2024-09-21T03:58:28.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.125+0000 7fd848ce3640 1 --2- 172.21.15.46:0/3153050551 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd844109df0 0x7fd844110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:28.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.125+0000 7fd848ce3640 1 --2- 172.21.15.46:0/3153050551 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8441094a0 0x7fd8441098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:28.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.125+0000 7fd848ce3640 1 --2- 172.21.15.46:0/3153050551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd844103b60 0x7fd844103f70 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:28.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.125+0000 7fd848ce3640 1 -- 172.21.15.46:0/3153050551 >> 172.21.15.46:0/3153050551 conn(0x7fd84407b850 msgr2=0x7fd84407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:28.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.125+0000 7fd848ce3640 1 -- 172.21.15.46:0/3153050551 shutdown_connections 2024-09-21T03:58:28.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.125+0000 7fd848ce3640 1 -- 172.21.15.46:0/3153050551 wait complete. 2024-09-21T03:58:28.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.126+0000 7fd848ce3640 1 Processor -- start 2024-09-21T03:58:28.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.126+0000 7fd848ce3640 1 -- start start 2024-09-21T03:58:28.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.126+0000 7fd848ce3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd844103b60 0x7fd844075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:28.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.126+0000 7fd848ce3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8441094a0 0x7fd844075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:28.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.126+0000 7fd848ce3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd844109df0 0x7fd844076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:28.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.126+0000 7fd848ce3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd844113b00 con 0x7fd844103b60 2024-09-21T03:58:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.126+0000 7fd848ce3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd844113980 con 0x7fd8441094a0 2024-09-21T03:58:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.126+0000 7fd848ce3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd844113c80 con 0x7fd844109df0 2024-09-21T03:58:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.126+0000 7fd84259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd844103b60 0x7fd844075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.126+0000 7fd84259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd844103b60 0x7fd844075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58030/0 (socket says 172.21.15.46:58030) 2024-09-21T03:58:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.126+0000 7fd84259c640 1 -- 172.21.15.46:0/4191780960 learned_addr learned my addr 172.21.15.46:0/4191780960 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.126+0000 7fd842d9d640 1 --2- 172.21.15.46:0/4191780960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd844109df0 0x7fd844076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.126+0000 7fd841d9b640 1 --2- 172.21.15.46:0/4191780960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8441094a0 0x7fd844075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.126+0000 7fd84259c640 1 -- 172.21.15.46:0/4191780960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd844109df0 msgr2=0x7fd844076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.126+0000 7fd84259c640 1 --2- 172.21.15.46:0/4191780960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd844109df0 0x7fd844076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:28.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.126+0000 7fd84259c640 1 -- 172.21.15.46:0/4191780960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8441094a0 msgr2=0x7fd844075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:28.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.126+0000 7fd84259c640 1 --2- 172.21.15.46:0/4191780960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8441094a0 0x7fd844075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:28.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.126+0000 7fd84259c640 1 -- 172.21.15.46:0/4191780960 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8441a87d0 con 0x7fd844103b60 2024-09-21T03:58:28.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.126+0000 7fd841d9b640 1 --2- 172.21.15.46:0/4191780960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8441094a0 0x7fd844075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:58:28.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.127+0000 7fd84259c640 1 --2- 172.21.15.46:0/4191780960 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd844103b60 0x7fd844075710 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd834031440 tx=0x7fd834003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:28.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.127+0000 7fd8337fe640 1 -- 172.21.15.46:0/4191780960 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd83403f070 con 0x7fd844103b60 2024-09-21T03:58:28.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.127+0000 7fd8337fe640 1 -- 172.21.15.46:0/4191780960 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd834031d60 con 0x7fd844103b60 2024-09-21T03:58:28.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.127+0000 7fd848ce3640 1 -- 172.21.15.46:0/4191780960 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8441a8a60 con 0x7fd844103b60 2024-09-21T03:58:28.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.127+0000 7fd8337fe640 1 -- 172.21.15.46:0/4191780960 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd834035030 con 0x7fd844103b60 2024-09-21T03:58:28.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.127+0000 7fd848ce3640 1 -- 172.21.15.46:0/4191780960 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8441a8f40 con 0x7fd844103b60 2024-09-21T03:58:28.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.130+0000 7fd84f257740 1 Processor -- start 2024-09-21T03:58:28.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.130+0000 7fd84f257740 1 -- start start 2024-09-21T03:58:28.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.130+0000 7fd8337fe640 1 -- 172.21.15.46:0/4191780960 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7fd834042070 con 0x7fd844103b60 2024-09-21T03:58:28.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.130+0000 7fd84f257740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56543c84b350 0x56543cbf2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:28.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.130+0000 7fd84f257740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56543c822490 0x56543cbf2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:28.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.130+0000 7fd84f257740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56543c82a670 0x56543cbf2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:28.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.130+0000 7fd84f257740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x56543cb68e60 con 0x56543c84b350 2024-09-21T03:58:28.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.130+0000 7fd84f257740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56543cb58290 con 0x56543c822490 2024-09-21T03:58:28.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.130+0000 7fd84f257740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56543cb5c0a0 con 0x56543c82a670 2024-09-21T03:58:28.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.130+0000 7fd842d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56543c84b350 0x56543cbf2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:28.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.130+0000 7fd842d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56543c84b350 0x56543cbf2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58032/0 (socket says 172.21.15.46:58032) 2024-09-21T03:58:28.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.130+0000 7fd842d9d640 1 -- 172.21.15.46:0/826446194 learned_addr learned my addr 172.21.15.46:0/826446194 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:28.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.131+0000 7fd84259c640 1 --2- 172.21.15.46:0/826446194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56543c822490 0x56543cbf2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:28.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.131+0000 7fd841d9b640 1 --2- 172.21.15.46:0/826446194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56543c82a670 0x56543cbf2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:28.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.131+0000 7fd842d9d640 1 -- 172.21.15.46:0/826446194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56543c82a670 msgr2=0x56543cbf2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:28.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.131+0000 7fd842d9d640 1 --2- 172.21.15.46:0/826446194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56543c82a670 0x56543cbf2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:28.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.131+0000 7fd842d9d640 1 -- 172.21.15.46:0/826446194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56543c822490 msgr2=0x56543cbf2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:28.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.131+0000 7fd842d9d640 1 --2- 172.21.15.46:0/826446194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56543c822490 0x56543cbf2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:28.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.131+0000 7fd842d9d640 1 -- 172.21.15.46:0/826446194 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56543c8b6930 con 0x56543c84b350 2024-09-21T03:58:28.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.131+0000 7fd841d9b640 1 --2- 172.21.15.46:0/826446194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56543c82a670 0x56543cbf2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:58:28.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.131+0000 7fd842d9d640 1 --2- 172.21.15.46:0/826446194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56543c84b350 0x56543cbf2430 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fd83c009f20 tx=0x7fd83c00f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777809ec75c8a6a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:28.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.131+0000 7fd830ff9640 1 -- 172.21.15.46:0/826446194 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd83c015070 con 0x56543c84b350 2024-09-21T03:58:28.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.131+0000 7fd830ff9640 1 -- 172.21.15.46:0/826446194 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd83c01ab10 con 0x56543c84b350 2024-09-21T03:58:28.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.131+0000 7fd830ff9640 1 -- 172.21.15.46:0/826446194 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd83c011bb0 con 0x56543c84b350 2024-09-21T03:58:28.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.132+0000 7fd8337fe640 1 --2- 172.21.15.46:0/4191780960 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fd82c0b6680 0x7fd82c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:28.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.132+0000 7fd84259c640 1 --2- 172.21.15.46:0/4191780960 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fd82c0b6680 0x7fd82c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:28.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.132+0000 7fd8337fe640 1 -- 172.21.15.46:0/4191780960 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fd834108010 con 0x7fd844103b60 2024-09-21T03:58:28.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.132+0000 7fd84f257740 1 -- 172.21.15.46:0/826446194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56543c84b350 msgr2=0x56543cbf2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:28.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.132+0000 7fd84259c640 1 --2- 172.21.15.46:0/4191780960 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fd82c0b6680 0x7fd82c0b8b90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x56543cbf10b0 tx=0x7fd83410bb00 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:28.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.132+0000 7fd84f257740 1 --2- 172.21.15.46:0/826446194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56543c84b350 0x56543cbf2430 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fd83c009f20 tx=0x7fd83c00f7f0 comp rx=0 tx=0).stop 2024-09-21T03:58:28.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.132+0000 7fd84f257740 1 -- 172.21.15.46:0/826446194 shutdown_connections 2024-09-21T03:58:28.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.132+0000 7fd84f257740 1 --2- 172.21.15.46:0/826446194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56543c82a670 0x56543cbf2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:28.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.132+0000 7fd84f257740 1 --2- 172.21.15.46:0/826446194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56543c822490 0x56543cbf2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:28.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.132+0000 7fd84f257740 1 --2- 172.21.15.46:0/826446194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56543c84b350 0x56543cbf2430 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:28.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.132+0000 7fd84f257740 1 -- 172.21.15.46:0/826446194 >> 172.21.15.46:0/826446194 conn(0x56543c83f740 msgr2=0x56543cbf0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:28.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.133+0000 7fd84f257740 1 -- 172.21.15.46:0/826446194 shutdown_connections 2024-09-21T03:58:28.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.133+0000 7fd84f257740 1 -- 172.21.15.46:0/826446194 wait complete. 2024-09-21T03:58:28.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.133+0000 7fd84f257740 1 -- start start 2024-09-21T03:58:28.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.133+0000 7fd84f257740 1 Processor -- start 2024-09-21T03:58:28.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.134+0000 7fd84f257740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56543c822490 0x56543cbfe020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:28.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.134+0000 7fd84f257740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56543c82a670 0x56543cbfe560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:28.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.134+0000 7fd84f257740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56543c84b350 0x56543cc09f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:28.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.134+0000 7fd84f257740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x56543c9b9890 con 0x56543c84b350 2024-09-21T03:58:28.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.134+0000 7fd84f257740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56543caf2d40 con 0x56543c822490 2024-09-21T03:58:28.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.134+0000 7fd84f257740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56543cc00c10 con 0x56543c82a670 2024-09-21T03:58:28.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.134+0000 7fd84f257740 10 client.0 _ll_register_callbacks cb 0x56543cb56c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:58:28.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.134+0000 7fd842d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56543c84b350 0x56543cc09f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:28.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.134+0000 7fd842d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56543c84b350 0x56543cc09f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58046/0 (socket says 172.21.15.46:58046) 2024-09-21T03:58:28.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.134+0000 7fd842d9d640 1 -- 172.21.15.46:0/344879448 learned_addr learned my addr 172.21.15.46:0/344879448 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:28.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.134+0000 7fd841d9b640 1 --2- 172.21.15.46:0/344879448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56543c82a670 0x56543cbfe560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:28.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.134+0000 7fd842d9d640 1 --2- 172.21.15.46:0/344879448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56543c822490 0x56543cbfe020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:28.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.134+0000 7fd842d9d640 1 -- 172.21.15.46:0/344879448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56543c82a670 msgr2=0x56543cbfe560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:28.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.134+0000 7fd842d9d640 1 --2- 172.21.15.46:0/344879448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56543c82a670 0x56543cbfe560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:28.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.134+0000 7fd842d9d640 1 -- 172.21.15.46:0/344879448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56543c822490 msgr2=0x56543cbfe020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:28.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.134+0000 7fd842d9d640 1 --2- 172.21.15.46:0/344879448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56543c822490 0x56543cbfe020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:28.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.134+0000 7fd842d9d640 1 -- 172.21.15.46:0/344879448 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56543cc0a4c0 con 0x56543c84b350 2024-09-21T03:58:28.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.134+0000 7fd841d9b640 1 --2- 172.21.15.46:0/344879448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56543c82a670 0x56543cbfe560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:58:28.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.134+0000 7fd842d9d640 1 --2- 172.21.15.46:0/344879448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56543c84b350 0x56543cc09f30 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fd83c009ce0 tx=0x7fd83c011790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6944f0b7b51d2fc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:28.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.134+0000 7fd829ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:58:28.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.135+0000 7fd829ffb640 1 -- 172.21.15.46:0/344879448 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd83c01e020 con 0x56543c84b350 2024-09-21T03:58:28.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.135+0000 7fd829ffb640 1 -- 172.21.15.46:0/344879448 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fd83c01a870 con 0x56543c84b350 2024-09-21T03:58:28.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.135+0000 7fd84f257740 1 -- 172.21.15.46:0/344879448 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd83c01ab10 con 0x56543c84b350 2024-09-21T03:58:28.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.135+0000 7fd829ffb640 1 -- 172.21.15.46:0/344879448 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd83c015030 con 0x56543c84b350 2024-09-21T03:58:28.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.135+0000 7fd84f257740 10 client.15939 fetch_fsmap learned FSMap version 20 2024-09-21T03:58:28.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.135+0000 7fd84f257740 1 -- 172.21.15.46:0/344879448 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56543cc0cdf0 con 0x56543c84b350 2024-09-21T03:58:28.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.135+0000 7fd829ffb640 1 -- 172.21.15.46:0/344879448 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd83c01ab10 con 0x56543c84b350 2024-09-21T03:58:28.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.135+0000 7fd829ffb640 1 -- 172.21.15.46:0/344879448 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fd83c0108e0 con 0x56543c84b350 2024-09-21T03:58:28.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.135+0000 7fd84f257740 10 client.15939 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:58:28.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.135+0000 7fd84f257740 10 client.15939 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:58:28.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.135+0000 7fd84f257740 20 client.15939 populate_metadata read hostname 'smithi046' 2024-09-21T03:58:28.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.135+0000 7fd84f257740 1 --2- 172.21.15.46:0/344879448 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56543c809cd0 0x56543cc101b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:28.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.135+0000 7fd84f257740 4 client.15939 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:58:28.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.135+0000 7fd84f257740 1 -- 172.21.15.46:0/344879448 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56543cb6adb0 con 0x56543c809cd0 2024-09-21T03:58:28.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.136+0000 7fd841d9b640 1 --2- 172.21.15.46:0/344879448 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56543c809cd0 0x56543cc101b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:28.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.136+0000 7fd829ffb640 10 client.15939 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:58:28.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.136+0000 7fd841d9b640 1 --2- 172.21.15.46:0/344879448 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56543c809cd0 0x56543cc101b0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d85b761ed7e57061 server_cookie=50612309f10397f0 in_seq=0 out_seq=0 2024-09-21T03:58:28.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.137+0000 7fd829ffb640 1 -- 172.21.15.46:0/344879448 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56543cb6adb0 con 0x56543c809cd0 2024-09-21T03:58:28.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.137+0000 7fd829ffb640 10 client.15939 handle_command_reply: tid=0 2024-09-21T03:58:28.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.137+0000 7fd84f257740 1 client.15939 shutdown 2024-09-21T03:58:28.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.137+0000 7fd84f257740 1 -- 172.21.15.46:0/344879448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56543c84b350 msgr2=0x56543cc09f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:28.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.137+0000 7fd84f257740 1 --2- 172.21.15.46:0/344879448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56543c84b350 0x56543cc09f30 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fd83c009ce0 tx=0x7fd83c011790 comp rx=0 tx=0).stop 2024-09-21T03:58:28.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.137+0000 7fd84f257740 1 -- 172.21.15.46:0/344879448 shutdown_connections 2024-09-21T03:58:28.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.137+0000 7fd84f257740 1 --2- 172.21.15.46:0/344879448 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56543c809cd0 0x56543cc101b0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:28.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.137+0000 7fd84f257740 1 --2- 172.21.15.46:0/344879448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56543c84b350 0x56543cc09f30 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:28.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.137+0000 7fd84f257740 1 --2- 172.21.15.46:0/344879448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56543c82a670 0x56543cbfe560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:28.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.137+0000 7fd829ffb640 0 client.15939 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:58:28.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.137+0000 7fd84f257740 1 --2- 172.21.15.46:0/344879448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56543c822490 0x56543cbfe020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:28.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.137+0000 7fd84f257740 1 -- 172.21.15.46:0/344879448 >> 172.21.15.46:0/344879448 conn(0x56543c83f740 msgr2=0x56543cbf5610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:28.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.137+0000 7fd84f257740 1 -- 172.21.15.46:0/344879448 shutdown_connections 2024-09-21T03:58:28.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.137+0000 7fd84f257740 1 -- 172.21.15.46:0/344879448 wait complete. 2024-09-21T03:58:28.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.137+0000 7fd84f257740 20 client.15939 trim_cache size 0 max 16384 2024-09-21T03:58:28.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.155+0000 7fd84f257740 1 Processor -- start 2024-09-21T03:58:28.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.155+0000 7fd84f257740 1 -- start start 2024-09-21T03:58:28.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.155+0000 7fd84f257740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56543c822490 0x56543cbf3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:28.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.155+0000 7fd84f257740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56543c82a670 0x56543cbf76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:28.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.155+0000 7fd84f257740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56543c84b350 0x56543cbf7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:28.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.155+0000 7fd84f257740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd8441af7b0 con 0x56543c82a670 2024-09-21T03:58:28.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.155+0000 7fd84f257740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd8441b2050 con 0x56543c822490 2024-09-21T03:58:28.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.155+0000 7fd84f257740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd8441afe40 con 0x56543c84b350 2024-09-21T03:58:28.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.156+0000 7fd841d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56543c82a670 0x56543cbf76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:28.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.156+0000 7fd841d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56543c82a670 0x56543cbf76b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58056/0 (socket says 172.21.15.46:58056) 2024-09-21T03:58:28.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.156+0000 7fd841d9b640 1 -- 172.21.15.46:0/4012427139 learned_addr learned my addr 172.21.15.46:0/4012427139 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:28.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.156+0000 7fd842d9d640 1 --2- 172.21.15.46:0/4012427139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56543c822490 0x56543cbf3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:28.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.156+0000 7fd841d9b640 1 -- 172.21.15.46:0/4012427139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56543c84b350 msgr2=0x56543cbf7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:28.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.156+0000 7fd841d9b640 1 --2- 172.21.15.46:0/4012427139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56543c84b350 0x56543cbf7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:28.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.156+0000 7fd841d9b640 1 -- 172.21.15.46:0/4012427139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56543c822490 msgr2=0x56543cbf3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:28.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.156+0000 7fd841d9b640 1 --2- 172.21.15.46:0/4012427139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56543c822490 0x56543cbf3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:28.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.156+0000 7fd841d9b640 1 -- 172.21.15.46:0/4012427139 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56543cbf0860 con 0x56543c82a670 2024-09-21T03:58:28.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.156+0000 7fd841d9b640 1 --2- 172.21.15.46:0/4012427139 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56543c82a670 0x56543cbf76b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd838005940 tx=0x7fd83800e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e468c0b3a1079a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:28.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.156+0000 7fd82bfff640 1 -- 172.21.15.46:0/4012427139 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd838004020 con 0x56543c82a670 2024-09-21T03:58:28.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.156+0000 7fd82bfff640 1 -- 172.21.15.46:0/4012427139 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd83801f070 con 0x56543c82a670 2024-09-21T03:58:28.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.156+0000 7fd82bfff640 1 -- 172.21.15.46:0/4012427139 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd838003850 con 0x56543c82a670 2024-09-21T03:58:28.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.157+0000 7fd84f257740 1 -- 172.21.15.46:0/4012427139 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56543c82a670 msgr2=0x56543cbf76b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:28.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.157+0000 7fd84f257740 1 --2- 172.21.15.46:0/4012427139 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56543c82a670 0x56543cbf76b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd838005940 tx=0x7fd83800e420 comp rx=0 tx=0).stop 2024-09-21T03:58:28.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.157+0000 7fd84f257740 1 -- 172.21.15.46:0/4012427139 shutdown_connections 2024-09-21T03:58:28.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.157+0000 7fd84f257740 1 --2- 172.21.15.46:0/4012427139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56543c84b350 0x56543cbf7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:28.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.157+0000 7fd84f257740 1 --2- 172.21.15.46:0/4012427139 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56543c82a670 0x56543cbf76b0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:28.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.157+0000 7fd84f257740 1 --2- 172.21.15.46:0/4012427139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56543c822490 0x56543cbf3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:28.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.157+0000 7fd84f257740 1 -- 172.21.15.46:0/4012427139 >> 172.21.15.46:0/4012427139 conn(0x56543c83f740 msgr2=0x56543cbf5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:28.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.157+0000 7fd84f257740 1 -- 172.21.15.46:0/4012427139 shutdown_connections 2024-09-21T03:58:28.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.157+0000 7fd84f257740 1 -- 172.21.15.46:0/4012427139 wait complete. 2024-09-21T03:58:28.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.157+0000 7fd84f257740 1 -- start start 2024-09-21T03:58:28.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.158+0000 7fd84f257740 1 Processor -- start 2024-09-21T03:58:28.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.158+0000 7fd84f257740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56543c822490 0x56543cc112a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:28.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.158+0000 7fd84f257740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56543c82a670 0x56543cc117e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:28.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.158+0000 7fd84f257740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56543c84b350 0x56543cc11d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:28.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.158+0000 7fd84f257740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd8441b0510 con 0x56543c84b350 2024-09-21T03:58:28.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.158+0000 7fd84f257740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd8441b1980 con 0x56543c822490 2024-09-21T03:58:28.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.158+0000 7fd84f257740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd8441b0be0 con 0x56543c82a670 2024-09-21T03:58:28.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.158+0000 7fd84f257740 10 client.0 _ll_register_callbacks cb 0x7fd83410b9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:58:28.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.158+0000 7fd842d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56543c84b350 0x56543cc11d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:28.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.158+0000 7fd842d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56543c84b350 0x56543cc11d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58070/0 (socket says 172.21.15.46:58070) 2024-09-21T03:58:28.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.158+0000 7fd842d9d640 1 -- 172.21.15.46:0/67806711 learned_addr learned my addr 172.21.15.46:0/67806711 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:28.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.158+0000 7fd842d9d640 1 --2- 172.21.15.46:0/67806711 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56543c822490 0x56543cc112a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:28.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.158+0000 7fd841d9b640 1 --2- 172.21.15.46:0/67806711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56543c82a670 0x56543cc117e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:28.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.158+0000 7fd842d9d640 1 -- 172.21.15.46:0/67806711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56543c82a670 msgr2=0x56543cc117e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:28.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.158+0000 7fd842d9d640 1 --2- 172.21.15.46:0/67806711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56543c82a670 0x56543cc117e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:28.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.158+0000 7fd842d9d640 1 -- 172.21.15.46:0/67806711 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56543c822490 msgr2=0x56543cc112a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:28.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.158+0000 7fd842d9d640 1 --2- 172.21.15.46:0/67806711 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56543c822490 0x56543cc112a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:28.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.158+0000 7fd842d9d640 1 -- 172.21.15.46:0/67806711 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56543cc79a00 con 0x56543c84b350 2024-09-21T03:58:28.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.159+0000 7fd842d9d640 1 --2- 172.21.15.46:0/67806711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56543c84b350 0x56543cc11d20 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd83c002230 tx=0x7fd83c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=623857ecb9491cdb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:28.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.159+0000 7fd829ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:58:28.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.159+0000 7fd829ffb640 1 -- 172.21.15.46:0/67806711 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd83c01e040 con 0x56543c84b350 2024-09-21T03:58:28.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.159+0000 7fd829ffb640 1 -- 172.21.15.46:0/67806711 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fd83c01ab50 con 0x56543c84b350 2024-09-21T03:58:28.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.159+0000 7fd84f257740 1 -- 172.21.15.46:0/67806711 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd83801f070 con 0x56543c84b350 2024-09-21T03:58:28.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.159+0000 7fd829ffb640 1 -- 172.21.15.46:0/67806711 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd83c009b20 con 0x56543c84b350 2024-09-21T03:58:28.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.159+0000 7fd84f257740 10 client.15945 fetch_fsmap learned FSMap version 20 2024-09-21T03:58:28.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.159+0000 7fd84f257740 1 -- 172.21.15.46:0/67806711 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56543cc7acc0 con 0x56543c84b350 2024-09-21T03:58:28.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.159+0000 7fd829ffb640 1 -- 172.21.15.46:0/67806711 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd83801f070 con 0x56543c84b350 2024-09-21T03:58:28.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.159+0000 7fd829ffb640 1 -- 172.21.15.46:0/67806711 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fd83c010460 con 0x56543c84b350 2024-09-21T03:58:28.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.160+0000 7fd84f257740 10 client.15945 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:58:28.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.160+0000 7fd84f257740 10 client.15945 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:58:28.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.160+0000 7fd84f257740 20 client.15945 populate_metadata read hostname 'smithi046' 2024-09-21T03:58:28.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.160+0000 7fd84f257740 1 --2- 172.21.15.46:0/67806711 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56543c7df080 0x56543cc7d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:28.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.160+0000 7fd84f257740 4 client.15945 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:58:28.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.160+0000 7fd84f257740 1 -- 172.21.15.46:0/67806711 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56543cb66860 con 0x56543c7df080 2024-09-21T03:58:28.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.160+0000 7fd841d9b640 1 --2- 172.21.15.46:0/67806711 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56543c7df080 0x56543cc7d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:28.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.160+0000 7fd841d9b640 1 --2- 172.21.15.46:0/67806711 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56543c7df080 0x56543cc7d360 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e19685d53c02681a server_cookie=3032f6df03102e33 in_seq=0 out_seq=0 2024-09-21T03:58:28.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.160+0000 7fd829ffb640 10 client.15945 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:58:28.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.162+0000 7fd829ffb640 1 -- 172.21.15.46:0/67806711 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56543cb66860 con 0x56543c7df080 2024-09-21T03:58:28.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.162+0000 7fd829ffb640 10 client.15945 handle_command_reply: tid=0 2024-09-21T03:58:28.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.162+0000 7fd84f257740 1 client.15945 shutdown 2024-09-21T03:58:28.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.162+0000 7fd84f257740 1 -- 172.21.15.46:0/67806711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56543c84b350 msgr2=0x56543cc11d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:28.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.162+0000 7fd84f257740 1 --2- 172.21.15.46:0/67806711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56543c84b350 0x56543cc11d20 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd83c002230 tx=0x7fd83c005fd0 comp rx=0 tx=0).stop 2024-09-21T03:58:28.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.162+0000 7fd84f257740 1 -- 172.21.15.46:0/67806711 shutdown_connections 2024-09-21T03:58:28.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.162+0000 7fd84f257740 1 --2- 172.21.15.46:0/67806711 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56543c7df080 0x56543cc7d360 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:28.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.162+0000 7fd84f257740 1 --2- 172.21.15.46:0/67806711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56543c84b350 0x56543cc11d20 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:28.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.162+0000 7fd84f257740 1 --2- 172.21.15.46:0/67806711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56543c82a670 0x56543cc117e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:28.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.162+0000 7fd829ffb640 0 client.15945 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:58:28.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.162+0000 7fd84f257740 1 --2- 172.21.15.46:0/67806711 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56543c822490 0x56543cc112a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:28.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.162+0000 7fd84f257740 1 -- 172.21.15.46:0/67806711 >> 172.21.15.46:0/67806711 conn(0x56543c83f740 msgr2=0x56543cbf5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:28.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.162+0000 7fd84f257740 1 -- 172.21.15.46:0/67806711 shutdown_connections 2024-09-21T03:58:28.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.162+0000 7fd84f257740 1 -- 172.21.15.46:0/67806711 wait complete. 2024-09-21T03:58:28.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.163+0000 7fd84f257740 20 client.15945 trim_cache size 0 max 16384 2024-09-21T03:58:28.170 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T03:58:28.170 INFO:teuthology.orchestra.run.smithi046.stdout: "return_code": 0, 2024-09-21T03:58:28.170 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_tag": "dab67652-8894-4711-be64-cbdfea27a9ba", 2024-09-21T03:58:28.170 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": "asynchronous" 2024-09-21T03:58:28.170 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T03:58:28.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.163+0000 7fd848ce3640 1 -- 172.21.15.46:0/4191780960 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fd82c0b6680 msgr2=0x7fd82c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:28.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.163+0000 7fd848ce3640 1 --2- 172.21.15.46:0/4191780960 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fd82c0b6680 0x7fd82c0b8b90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x56543cbf10b0 tx=0x7fd83410bb00 comp rx=0 tx=0).stop 2024-09-21T03:58:28.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.163+0000 7fd848ce3640 1 -- 172.21.15.46:0/4191780960 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd844103b60 msgr2=0x7fd844075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:28.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.163+0000 7fd848ce3640 1 --2- 172.21.15.46:0/4191780960 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd844103b60 0x7fd844075710 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd834031440 tx=0x7fd834003c80 comp rx=0 tx=0).stop 2024-09-21T03:58:28.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.163+0000 7fd848ce3640 1 -- 172.21.15.46:0/4191780960 shutdown_connections 2024-09-21T03:58:28.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.163+0000 7fd848ce3640 1 --2- 172.21.15.46:0/4191780960 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fd82c0b6680 0x7fd82c0b8b90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:28.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.163+0000 7fd848ce3640 1 --2- 172.21.15.46:0/4191780960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd844109df0 0x7fd844076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:28.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.163+0000 7fd848ce3640 1 --2- 172.21.15.46:0/4191780960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8441094a0 0x7fd844075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:28.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.163+0000 7fd848ce3640 1 --2- 172.21.15.46:0/4191780960 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd844103b60 0x7fd844075710 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:28.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.163+0000 7fd848ce3640 1 -- 172.21.15.46:0/4191780960 >> 172.21.15.46:0/4191780960 conn(0x7fd84407b850 msgr2=0x7fd844107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:28.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.163+0000 7fd848ce3640 1 -- 172.21.15.46:0/4191780960 shutdown_connections 2024-09-21T03:58:28.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:28.163+0000 7fd848ce3640 1 -- 172.21.15.46:0/4191780960 wait complete. 2024-09-21T03:58:28.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:27 smithi105 ceph-mon[34773]: pgmap v422: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:58:28.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:27 smithi162 ceph-mon[35071]: pgmap v422: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:58:28.990 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:28 smithi046 ceph-mon[30954]: scrub queued for path: / 2024-09-21T03:58:28.990 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:28 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T03:58:28.990 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:28 smithi046 ceph-mon[30954]: scrub summary: active paths [/] 2024-09-21T03:58:28.990 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:28 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T03:58:28.990 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:28 smithi046 ceph-mon[30954]: scrub summary: idle 2024-09-21T03:58:28.991 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:58:29.251 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:58:29.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:28 smithi105 ceph-mon[34773]: scrub queued for path: / 2024-09-21T03:58:29.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:28 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T03:58:29.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:28 smithi105 ceph-mon[34773]: scrub summary: active paths [/] 2024-09-21T03:58:29.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:28 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T03:58:29.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:28 smithi105 ceph-mon[34773]: scrub summary: idle 2024-09-21T03:58:29.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:28 smithi162 ceph-mon[35071]: scrub queued for path: / 2024-09-21T03:58:29.441 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:28 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T03:58:29.441 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:28 smithi162 ceph-mon[35071]: scrub summary: active paths [/] 2024-09-21T03:58:29.441 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:28 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T03:58:29.441 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:28 smithi162 ceph-mon[35071]: scrub summary: idle 2024-09-21T03:58:29.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.774+0000 7f8844cbb640 1 -- 172.21.15.46:0/4119112303 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8840108d20 msgr2=0x7f884010f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:29.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.774+0000 7f8844cbb640 1 --2- 172.21.15.46:0/4119112303 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8840108d20 0x7f884010f550 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f8838009900 tx=0x7f883802a410 comp rx=0 tx=0).stop 2024-09-21T03:58:29.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.774+0000 7f8844cbb640 1 -- 172.21.15.46:0/4119112303 shutdown_connections 2024-09-21T03:58:29.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.774+0000 7f8844cbb640 1 --2- 172.21.15.46:0/4119112303 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8840108d20 0x7f884010f550 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:29.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.774+0000 7f8844cbb640 1 --2- 172.21.15.46:0/4119112303 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88401083d0 0x7f88401087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:29.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.774+0000 7f8844cbb640 1 --2- 172.21.15.46:0/4119112303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8840102ae0 0x7f8840102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:29.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.774+0000 7f8844cbb640 1 -- 172.21.15.46:0/4119112303 >> 172.21.15.46:0/4119112303 conn(0x7f8840079760 msgr2=0x7f8840079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:29.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.774+0000 7f8844cbb640 1 -- 172.21.15.46:0/4119112303 shutdown_connections 2024-09-21T03:58:29.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.774+0000 7f8844cbb640 1 -- 172.21.15.46:0/4119112303 wait complete. 2024-09-21T03:58:29.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.775+0000 7f8844cbb640 1 Processor -- start 2024-09-21T03:58:29.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.775+0000 7f8844cbb640 1 -- start start 2024-09-21T03:58:29.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.775+0000 7f8844cbb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8840102ae0 0x7f884019a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:29.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.775+0000 7f8844cbb640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88401083d0 0x7f884019aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:29.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.775+0000 7f8844cbb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8840108d20 0x7f884019fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:29.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.776+0000 7f8844cbb640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8840113ab0 con 0x7f8840108d20 2024-09-21T03:58:29.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.776+0000 7f8844cbb640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8840113930 con 0x7f8840102ae0 2024-09-21T03:58:29.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.776+0000 7f8844cbb640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8840113c30 con 0x7f88401083d0 2024-09-21T03:58:29.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.776+0000 7f883dd9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88401083d0 0x7f884019aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:29.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.776+0000 7f883ed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8840108d20 0x7f884019fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:29.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.776+0000 7f883dd9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88401083d0 0x7f884019aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:59630/0 (socket says 172.21.15.46:59630) 2024-09-21T03:58:29.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.776+0000 7f883dd9b640 1 -- 172.21.15.46:0/3958712264 learned_addr learned my addr 172.21.15.46:0/3958712264 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:29.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.776+0000 7f883ed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8840108d20 0x7f884019fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58094/0 (socket says 172.21.15.46:58094) 2024-09-21T03:58:29.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.776+0000 7f883e59c640 1 --2- 172.21.15.46:0/3958712264 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8840102ae0 0x7f884019a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:29.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.776+0000 7f883ed9d640 1 -- 172.21.15.46:0/3958712264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88401083d0 msgr2=0x7f884019aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:29.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.776+0000 7f883ed9d640 1 --2- 172.21.15.46:0/3958712264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88401083d0 0x7f884019aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:29.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.776+0000 7f883ed9d640 1 -- 172.21.15.46:0/3958712264 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8840102ae0 msgr2=0x7f884019a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:29.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.776+0000 7f883ed9d640 1 --2- 172.21.15.46:0/3958712264 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8840102ae0 0x7f884019a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:29.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.776+0000 7f883ed9d640 1 -- 172.21.15.46:0/3958712264 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88401a0330 con 0x7f8840108d20 2024-09-21T03:58:29.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.776+0000 7f883ed9d640 1 --2- 172.21.15.46:0/3958712264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8840108d20 0x7f884019fcc0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f8838005940 tx=0x7f88380042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:29.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.776+0000 7f882f7fe640 1 -- 172.21.15.46:0/3958712264 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883803f030 con 0x7f8840108d20 2024-09-21T03:58:29.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.777+0000 7f8844cbb640 1 -- 172.21.15.46:0/3958712264 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88401a05c0 con 0x7f8840108d20 2024-09-21T03:58:29.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.777+0000 7f882f7fe640 1 -- 172.21.15.46:0/3958712264 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8838003cb0 con 0x7f8840108d20 2024-09-21T03:58:29.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.777+0000 7f882f7fe640 1 -- 172.21.15.46:0/3958712264 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8838035070 con 0x7f8840108d20 2024-09-21T03:58:29.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.777+0000 7f8844cbb640 1 -- 172.21.15.46:0/3958712264 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88401a0aa0 con 0x7f8840108d20 2024-09-21T03:58:29.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.779+0000 7f884b22f740 1 Processor -- start 2024-09-21T03:58:29.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.779+0000 7f882f7fe640 1 -- 172.21.15.46:0/3958712264 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f8838042030 con 0x7f8840108d20 2024-09-21T03:58:29.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.780+0000 7f884b22f740 1 -- start start 2024-09-21T03:58:29.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.780+0000 7f884b22f740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5577ebc0b070 0x5577ebfb2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:29.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.780+0000 7f884b22f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577ebbe21b0 0x5577ebfb27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:29.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.780+0000 7f884b22f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577ebbea390 0x5577ebfb2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:29.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.780+0000 7f884b22f740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5577ebf28e50 con 0x5577ebc0b070 2024-09-21T03:58:29.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.780+0000 7f884b22f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5577ebf18280 con 0x5577ebbea390 2024-09-21T03:58:29.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.780+0000 7f884b22f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5577ebf1c090 con 0x5577ebbe21b0 2024-09-21T03:58:29.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.780+0000 7f883dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5577ebc0b070 0x5577ebfb2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:29.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.780+0000 7f883dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5577ebc0b070 0x5577ebfb2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58096/0 (socket says 172.21.15.46:58096) 2024-09-21T03:58:29.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.780+0000 7f883dd9b640 1 -- 172.21.15.46:0/2298375800 learned_addr learned my addr 172.21.15.46:0/2298375800 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:29.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.780+0000 7f883e59c640 1 --2- 172.21.15.46:0/2298375800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577ebbe21b0 0x5577ebfb27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:29.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.780+0000 7f883dd9b640 1 --2- 172.21.15.46:0/2298375800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577ebbea390 0x5577ebfb2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:29.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.780+0000 7f882f7fe640 1 --2- 172.21.15.46:0/3958712264 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f88280b66b0 0x7f88280b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:29.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.780+0000 7f883dd9b640 1 -- 172.21.15.46:0/2298375800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577ebbe21b0 msgr2=0x5577ebfb27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:29.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.780+0000 7f883dd9b640 1 --2- 172.21.15.46:0/2298375800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577ebbe21b0 0x5577ebfb27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:29.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.781+0000 7f883ed9d640 1 --2- 172.21.15.46:0/3958712264 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f88280b66b0 0x7f88280b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:29.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.781+0000 7f883dd9b640 1 -- 172.21.15.46:0/2298375800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577ebbea390 msgr2=0x5577ebfb2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:29.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.781+0000 7f883dd9b640 1 --2- 172.21.15.46:0/2298375800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577ebbea390 0x5577ebfb2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:29.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.781+0000 7f883dd9b640 1 -- 172.21.15.46:0/2298375800 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577ebc76650 con 0x5577ebc0b070 2024-09-21T03:58:29.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.781+0000 7f882f7fe640 1 -- 172.21.15.46:0/3958712264 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f88381079f0 con 0x7f8840108d20 2024-09-21T03:58:29.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.781+0000 7f883dd9b640 1 --2- 172.21.15.46:0/2298375800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5577ebc0b070 0x5577ebfb2270 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f88340049b0 tx=0x7f8834009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9967d880fbd10130 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:29.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.781+0000 7f882cff9640 1 -- 172.21.15.46:0/2298375800 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883400f860 con 0x5577ebc0b070 2024-09-21T03:58:29.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.781+0000 7f883ed9d640 1 --2- 172.21.15.46:0/3958712264 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f88280b66b0 0x7f88280b8bc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f88380cab50 tx=0x7f883809a590 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:29.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.781+0000 7f882cff9640 1 -- 172.21.15.46:0/2298375800 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8834011470 con 0x5577ebc0b070 2024-09-21T03:58:29.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.781+0000 7f882cff9640 1 -- 172.21.15.46:0/2298375800 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8834010630 con 0x5577ebc0b070 2024-09-21T03:58:29.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.782+0000 7f884b22f740 1 -- 172.21.15.46:0/2298375800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5577ebc0b070 msgr2=0x5577ebfb2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:29.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.782+0000 7f884b22f740 1 --2- 172.21.15.46:0/2298375800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5577ebc0b070 0x5577ebfb2270 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f88340049b0 tx=0x7f8834009d70 comp rx=0 tx=0).stop 2024-09-21T03:58:29.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.782+0000 7f884b22f740 1 -- 172.21.15.46:0/2298375800 shutdown_connections 2024-09-21T03:58:29.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.782+0000 7f884b22f740 1 --2- 172.21.15.46:0/2298375800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577ebbea390 0x5577ebfb2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:29.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.782+0000 7f884b22f740 1 --2- 172.21.15.46:0/2298375800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577ebbe21b0 0x5577ebfb27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:29.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.782+0000 7f884b22f740 1 --2- 172.21.15.46:0/2298375800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5577ebc0b070 0x5577ebfb2270 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:29.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.782+0000 7f884b22f740 1 -- 172.21.15.46:0/2298375800 >> 172.21.15.46:0/2298375800 conn(0x5577ebbff460 msgr2=0x5577ebfb0160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:29.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.782+0000 7f884b22f740 1 -- 172.21.15.46:0/2298375800 shutdown_connections 2024-09-21T03:58:29.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.782+0000 7f884b22f740 1 -- 172.21.15.46:0/2298375800 wait complete. 2024-09-21T03:58:29.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.783+0000 7f884b22f740 1 -- start start 2024-09-21T03:58:29.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.783+0000 7f884b22f740 1 Processor -- start 2024-09-21T03:58:29.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.783+0000 7f884b22f740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5577ebbe21b0 0x5577ebfbd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:29.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.783+0000 7f884b22f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577ebbea390 0x5577ebfbde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:29.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.783+0000 7f884b22f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577ebc0b070 0x5577ebfc9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:29.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.783+0000 7f884b22f740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5577ebd79700 con 0x5577ebbe21b0 2024-09-21T03:58:29.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.783+0000 7f884b22f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5577ebeb3110 con 0x5577ebbea390 2024-09-21T03:58:29.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.783+0000 7f884b22f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5577ebfc0a50 con 0x5577ebc0b070 2024-09-21T03:58:29.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.783+0000 7f884b22f740 10 client.0 _ll_register_callbacks cb 0x5577ebecc990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:58:29.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.783+0000 7f883dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5577ebbe21b0 0x5577ebfbd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:29.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.783+0000 7f883dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5577ebbe21b0 0x5577ebfbd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58112/0 (socket says 172.21.15.46:58112) 2024-09-21T03:58:29.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.783+0000 7f883dd9b640 1 -- 172.21.15.46:0/1325966543 learned_addr learned my addr 172.21.15.46:0/1325966543 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:29.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.783+0000 7f883e59c640 1 --2- 172.21.15.46:0/1325966543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577ebbea390 0x5577ebfbde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:29.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.784+0000 7f883dd9b640 1 --2- 172.21.15.46:0/1325966543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577ebc0b070 0x5577ebfc9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:29.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.784+0000 7f883dd9b640 1 -- 172.21.15.46:0/1325966543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577ebc0b070 msgr2=0x5577ebfc9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:29.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.784+0000 7f883dd9b640 1 --2- 172.21.15.46:0/1325966543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577ebc0b070 0x5577ebfc9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:29.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.784+0000 7f883dd9b640 1 -- 172.21.15.46:0/1325966543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577ebbea390 msgr2=0x5577ebfbde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:29.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.784+0000 7f883dd9b640 1 --2- 172.21.15.46:0/1325966543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577ebbea390 0x5577ebfbde90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:29.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.784+0000 7f883dd9b640 1 -- 172.21.15.46:0/1325966543 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577ebee0c40 con 0x5577ebbe21b0 2024-09-21T03:58:29.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.784+0000 7f883dd9b640 1 --2- 172.21.15.46:0/1325966543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5577ebbe21b0 0x5577ebfbd950 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f8834009d30 tx=0x7f8834009270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a33eaf0643cc09d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:29.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.784+0000 7f8825ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:58:29.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.784+0000 7f8825ffb640 1 -- 172.21.15.46:0/1325966543 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883402f060 con 0x5577ebbe21b0 2024-09-21T03:58:29.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.784+0000 7f8825ffb640 1 -- 172.21.15.46:0/1325966543 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f883400f860 con 0x5577ebbe21b0 2024-09-21T03:58:29.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.784+0000 7f884b22f740 1 -- 172.21.15.46:0/1325966543 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8834011470 con 0x5577ebbe21b0 2024-09-21T03:58:29.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.784+0000 7f8825ffb640 1 -- 172.21.15.46:0/1325966543 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f883400fa60 con 0x5577ebbe21b0 2024-09-21T03:58:29.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.784+0000 7f884b22f740 10 client.15957 fetch_fsmap learned FSMap version 20 2024-09-21T03:58:29.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.784+0000 7f884b22f740 1 -- 172.21.15.46:0/1325966543 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5577ebfcc750 con 0x5577ebbe21b0 2024-09-21T03:58:29.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.785+0000 7f8825ffb640 1 -- 172.21.15.46:0/1325966543 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8834011470 con 0x5577ebbe21b0 2024-09-21T03:58:29.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.785+0000 7f8825ffb640 1 -- 172.21.15.46:0/1325966543 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f883401e070 con 0x5577ebbe21b0 2024-09-21T03:58:29.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.785+0000 7f884b22f740 10 client.15957 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:58:29.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.785+0000 7f884b22f740 10 client.15957 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:58:29.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.785+0000 7f884b22f740 20 client.15957 populate_metadata read hostname 'smithi046' 2024-09-21T03:58:29.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.785+0000 7f884b22f740 1 --2- 172.21.15.46:0/1325966543 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5577ebbc99f0 0x5577ebfcfab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:29.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.785+0000 7f884b22f740 4 client.15957 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:58:29.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.785+0000 7f884b22f740 1 -- 172.21.15.46:0/1325966543 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577ebf2ada0 con 0x5577ebbc99f0 2024-09-21T03:58:29.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.785+0000 7f883e59c640 1 --2- 172.21.15.46:0/1325966543 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5577ebbc99f0 0x5577ebfcfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:29.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.786+0000 7f8825ffb640 10 client.15957 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:58:29.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.786+0000 7f883e59c640 1 --2- 172.21.15.46:0/1325966543 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5577ebbc99f0 0x5577ebfcfab0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=190257076d3659f9 server_cookie=779d26f7fe5feea0 in_seq=0 out_seq=0 2024-09-21T03:58:29.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.786+0000 7f8825ffb640 1 -- 172.21.15.46:0/1325966543 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5577ebf2ada0 con 0x5577ebbc99f0 2024-09-21T03:58:29.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.786+0000 7f8825ffb640 10 client.15957 handle_command_reply: tid=0 2024-09-21T03:58:29.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.786+0000 7f884b22f740 1 client.15957 shutdown 2024-09-21T03:58:29.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.787+0000 7f884b22f740 1 -- 172.21.15.46:0/1325966543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5577ebbe21b0 msgr2=0x5577ebfbd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:29.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.787+0000 7f884b22f740 1 --2- 172.21.15.46:0/1325966543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5577ebbe21b0 0x5577ebfbd950 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f8834009d30 tx=0x7f8834009270 comp rx=0 tx=0).stop 2024-09-21T03:58:29.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.787+0000 7f884b22f740 1 -- 172.21.15.46:0/1325966543 shutdown_connections 2024-09-21T03:58:29.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.787+0000 7f884b22f740 1 --2- 172.21.15.46:0/1325966543 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5577ebbc99f0 0x5577ebfcfab0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:29.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.787+0000 7f884b22f740 1 --2- 172.21.15.46:0/1325966543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577ebc0b070 0x5577ebfc9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:29.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.787+0000 7f884b22f740 1 --2- 172.21.15.46:0/1325966543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577ebbea390 0x5577ebfbde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:29.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.787+0000 7f8825ffb640 0 client.15957 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:58:29.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.787+0000 7f884b22f740 1 --2- 172.21.15.46:0/1325966543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5577ebbe21b0 0x5577ebfbd950 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:29.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.787+0000 7f884b22f740 1 -- 172.21.15.46:0/1325966543 >> 172.21.15.46:0/1325966543 conn(0x5577ebbff460 msgr2=0x5577ebfb5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:29.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.787+0000 7f884b22f740 1 -- 172.21.15.46:0/1325966543 shutdown_connections 2024-09-21T03:58:29.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.787+0000 7f884b22f740 1 -- 172.21.15.46:0/1325966543 wait complete. 2024-09-21T03:58:29.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.787+0000 7f884b22f740 20 client.15957 trim_cache size 0 max 16384 2024-09-21T03:58:29.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.804+0000 7f884b22f740 1 Processor -- start 2024-09-21T03:58:29.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.804+0000 7f884b22f740 1 -- start start 2024-09-21T03:58:29.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.805+0000 7f884b22f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577ebbe21b0 0x5577ebfbc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:29.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.805+0000 7f884b22f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577ebbea390 0x5577ebfbf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:29.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.805+0000 7f884b22f740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5577ebc0b070 0x5577ebfc9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:29.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.805+0000 7f884b22f740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f88401ad4c0 con 0x5577ebc0b070 2024-09-21T03:58:29.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.805+0000 7f884b22f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f88401afd40 con 0x5577ebbe21b0 2024-09-21T03:58:29.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.805+0000 7f884b22f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f88401adb30 con 0x5577ebbea390 2024-09-21T03:58:29.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.805+0000 7f883dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5577ebc0b070 0x5577ebfc9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:29.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.805+0000 7f883dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5577ebc0b070 0x5577ebfc9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58114/0 (socket says 172.21.15.46:58114) 2024-09-21T03:58:29.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.805+0000 7f883dd9b640 1 -- 172.21.15.46:0/831712172 learned_addr learned my addr 172.21.15.46:0/831712172 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:29.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.805+0000 7f883e59c640 1 --2- 172.21.15.46:0/831712172 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577ebbea390 0x5577ebfbf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:29.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.805+0000 7f883dd9b640 1 -- 172.21.15.46:0/831712172 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577ebbea390 msgr2=0x5577ebfbf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:29.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.805+0000 7f883dd9b640 1 --2- 172.21.15.46:0/831712172 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577ebbea390 0x5577ebfbf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:29.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.805+0000 7f883dd9b640 1 -- 172.21.15.46:0/831712172 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577ebbe21b0 msgr2=0x5577ebfbc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:29.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.805+0000 7f883dd9b640 1 --2- 172.21.15.46:0/831712172 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577ebbe21b0 0x5577ebfbc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:29.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.805+0000 7f883dd9b640 1 -- 172.21.15.46:0/831712172 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577ebfb4790 con 0x5577ebc0b070 2024-09-21T03:58:29.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.805+0000 7f883e59c640 1 --2- 172.21.15.46:0/831712172 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577ebbea390 0x5577ebfbf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:58:29.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.805+0000 7f883dd9b640 1 --2- 172.21.15.46:0/831712172 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5577ebc0b070 0x5577ebfc9c70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f88340133d0 tx=0x7f88340021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=317b57b86b8b7ae3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:29.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.805+0000 7f8827fff640 1 -- 172.21.15.46:0/831712172 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883402f040 con 0x5577ebc0b070 2024-09-21T03:58:29.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.805+0000 7f8827fff640 1 -- 172.21.15.46:0/831712172 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8834003e20 con 0x5577ebc0b070 2024-09-21T03:58:29.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.806+0000 7f8827fff640 1 -- 172.21.15.46:0/831712172 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883400fe60 con 0x5577ebc0b070 2024-09-21T03:58:29.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.806+0000 7f884b22f740 1 -- 172.21.15.46:0/831712172 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5577ebc0b070 msgr2=0x5577ebfc9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:29.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.806+0000 7f884b22f740 1 --2- 172.21.15.46:0/831712172 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5577ebc0b070 0x5577ebfc9c70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f88340133d0 tx=0x7f88340021f0 comp rx=0 tx=0).stop 2024-09-21T03:58:29.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.806+0000 7f884b22f740 1 -- 172.21.15.46:0/831712172 shutdown_connections 2024-09-21T03:58:29.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.806+0000 7f884b22f740 1 --2- 172.21.15.46:0/831712172 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5577ebc0b070 0x5577ebfc9c70 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:29.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.806+0000 7f884b22f740 1 --2- 172.21.15.46:0/831712172 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577ebbea390 0x5577ebfbf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:29.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.806+0000 7f884b22f740 1 --2- 172.21.15.46:0/831712172 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577ebbe21b0 0x5577ebfbc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:29.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.806+0000 7f884b22f740 1 -- 172.21.15.46:0/831712172 >> 172.21.15.46:0/831712172 conn(0x5577ebbff460 msgr2=0x5577ebfbee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:29.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.806+0000 7f884b22f740 1 -- 172.21.15.46:0/831712172 shutdown_connections 2024-09-21T03:58:29.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.806+0000 7f884b22f740 1 -- 172.21.15.46:0/831712172 wait complete. 2024-09-21T03:58:29.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.807+0000 7f884b22f740 1 -- start start 2024-09-21T03:58:29.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.807+0000 7f884b22f740 1 Processor -- start 2024-09-21T03:58:29.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.807+0000 7f884b22f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577ebbe21b0 0x5577ebfc64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:29.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.807+0000 7f884b22f740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5577ebbea390 0x5577ebfc19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:29.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.807+0000 7f884b22f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577ebc0b070 0x5577ebfc1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:29.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.807+0000 7f884b22f740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f88401ae200 con 0x5577ebbea390 2024-09-21T03:58:29.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.807+0000 7f884b22f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f88401af670 con 0x5577ebbe21b0 2024-09-21T03:58:29.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.807+0000 7f884b22f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f88401ae8d0 con 0x5577ebc0b070 2024-09-21T03:58:29.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.807+0000 7f884b22f740 10 client.0 _ll_register_callbacks cb 0x7f883000a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:58:29.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.807+0000 7f883e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5577ebbea390 0x5577ebfc19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:29.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.807+0000 7f883e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5577ebbea390 0x5577ebfc19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58118/0 (socket says 172.21.15.46:58118) 2024-09-21T03:58:29.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.807+0000 7f883e59c640 1 -- 172.21.15.46:0/352099187 learned_addr learned my addr 172.21.15.46:0/352099187 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:29.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.807+0000 7f883dd9b640 1 --2- 172.21.15.46:0/352099187 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577ebbe21b0 0x5577ebfc64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:29.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.808+0000 7f883dd9b640 1 --2- 172.21.15.46:0/352099187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577ebc0b070 0x5577ebfc1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:29.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.808+0000 7f883e59c640 1 -- 172.21.15.46:0/352099187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577ebc0b070 msgr2=0x5577ebfc1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:29.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.808+0000 7f883e59c640 1 --2- 172.21.15.46:0/352099187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577ebc0b070 0x5577ebfc1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:29.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.808+0000 7f883e59c640 1 -- 172.21.15.46:0/352099187 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577ebbe21b0 msgr2=0x5577ebfc64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:29.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.808+0000 7f883e59c640 1 --2- 172.21.15.46:0/352099187 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577ebbe21b0 0x5577ebfc64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:29.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.808+0000 7f883e59c640 1 -- 172.21.15.46:0/352099187 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577ebfc2680 con 0x5577ebbea390 2024-09-21T03:58:29.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.808+0000 7f883dd9b640 1 --2- 172.21.15.46:0/352099187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577ebc0b070 0x5577ebfc1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:58:29.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.808+0000 7f883e59c640 1 --2- 172.21.15.46:0/352099187 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5577ebbea390 0x5577ebfc19b0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x5577ebfd00f0 tx=0x7f8830010af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f48cac48d84b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:29.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.808+0000 7f8825ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:58:29.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.808+0000 7f8825ffb640 1 -- 172.21.15.46:0/352099187 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883000fb10 con 0x5577ebbea390 2024-09-21T03:58:29.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.808+0000 7f8825ffb640 1 -- 172.21.15.46:0/352099187 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f883000fcb0 con 0x5577ebbea390 2024-09-21T03:58:29.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.808+0000 7f884b22f740 1 -- 172.21.15.46:0/352099187 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8834003e20 con 0x5577ebbea390 2024-09-21T03:58:29.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.808+0000 7f8825ffb640 1 -- 172.21.15.46:0/352099187 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f883002e410 con 0x5577ebbea390 2024-09-21T03:58:29.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.808+0000 7f884b22f740 10 client.15963 fetch_fsmap learned FSMap version 20 2024-09-21T03:58:29.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.808+0000 7f884b22f740 1 -- 172.21.15.46:0/352099187 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5577ec03a310 con 0x5577ebbea390 2024-09-21T03:58:29.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.808+0000 7f8825ffb640 1 -- 172.21.15.46:0/352099187 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8834003e20 con 0x5577ebbea390 2024-09-21T03:58:29.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.809+0000 7f8825ffb640 1 -- 172.21.15.46:0/352099187 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f883002d490 con 0x5577ebbea390 2024-09-21T03:58:29.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.809+0000 7f884b22f740 10 client.15963 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:58:29.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.809+0000 7f884b22f740 10 client.15963 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:58:29.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.809+0000 7f884b22f740 20 client.15963 populate_metadata read hostname 'smithi046' 2024-09-21T03:58:29.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.809+0000 7f884b22f740 1 --2- 172.21.15.46:0/352099187 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5577ebb9eda0 0x5577ec03cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:29.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.809+0000 7f884b22f740 4 client.15963 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:58:29.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.809+0000 7f884b22f740 1 -- 172.21.15.46:0/352099187 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5577ebf26850 con 0x5577ebb9eda0 2024-09-21T03:58:29.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.809+0000 7f883dd9b640 1 --2- 172.21.15.46:0/352099187 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5577ebb9eda0 0x5577ec03cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:29.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.809+0000 7f883dd9b640 1 --2- 172.21.15.46:0/352099187 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5577ebb9eda0 0x5577ec03cb00 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=373665744ba4ad1c server_cookie=21d959c581c4a99c in_seq=0 out_seq=0 2024-09-21T03:58:29.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.809+0000 7f8825ffb640 10 client.15963 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:58:29.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.810+0000 7f8825ffb640 1 -- 172.21.15.46:0/352099187 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2078 (crc 0 0 0) 0x5577ebf26850 con 0x5577ebb9eda0 2024-09-21T03:58:29.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.810+0000 7f8825ffb640 10 client.15963 handle_command_reply: tid=0 2024-09-21T03:58:29.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.810+0000 7f884b22f740 1 client.15963 shutdown 2024-09-21T03:58:29.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.810+0000 7f884b22f740 1 -- 172.21.15.46:0/352099187 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5577ebbea390 msgr2=0x5577ebfc19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:29.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.810+0000 7f884b22f740 1 --2- 172.21.15.46:0/352099187 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5577ebbea390 0x5577ebfc19b0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x5577ebfd00f0 tx=0x7f8830010af0 comp rx=0 tx=0).stop 2024-09-21T03:58:29.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.810+0000 7f884b22f740 1 -- 172.21.15.46:0/352099187 shutdown_connections 2024-09-21T03:58:29.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.810+0000 7f884b22f740 1 --2- 172.21.15.46:0/352099187 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5577ebb9eda0 0x5577ec03cb00 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:29.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.810+0000 7f884b22f740 1 --2- 172.21.15.46:0/352099187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5577ebc0b070 0x5577ebfc1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:29.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.810+0000 7f884b22f740 1 --2- 172.21.15.46:0/352099187 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5577ebbea390 0x5577ebfc19b0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:29.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.810+0000 7f884b22f740 1 --2- 172.21.15.46:0/352099187 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577ebbe21b0 0x5577ebfc64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:29.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.810+0000 7f884b22f740 1 -- 172.21.15.46:0/352099187 >> 172.21.15.46:0/352099187 conn(0x5577ebbff460 msgr2=0x5577ebfbf5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:29.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.810+0000 7f8825ffb640 0 client.15963 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:58:29.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.810+0000 7f884b22f740 1 -- 172.21.15.46:0/352099187 shutdown_connections 2024-09-21T03:58:29.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.810+0000 7f884b22f740 1 -- 172.21.15.46:0/352099187 wait complete. 2024-09-21T03:58:29.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.810+0000 7f884b22f740 20 client.15963 trim_cache size 0 max 16384 2024-09-21T03:58:29.817 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T03:58:29.817 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "no active scrubs running", 2024-09-21T03:58:29.817 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": {}, 2024-09-21T03:58:29.817 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_stats": { 2024-09-21T03:58:29.818 INFO:teuthology.orchestra.run.smithi046.stdout: "dab67652-8894-4711-be64-cbdfea27a9ba": { 2024-09-21T03:58:29.818 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:28.161616+0000", 2024-09-21T03:58:29.818 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:58:29.818 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:58:29.818 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:58:29.818 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:58:29.818 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:58:29.818 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:58:29.818 INFO:teuthology.orchestra.run.smithi046.stdout: "c47f458a-de5e-4952-a575-a81261953667": { 2024-09-21T03:58:29.818 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:48.699411+0000", 2024-09-21T03:58:29.818 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:58:29.818 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:58:29.818 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:58:29.819 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:58:29.819 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:58:29.819 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:58:29.819 INFO:teuthology.orchestra.run.smithi046.stdout: "e24ec8f1-0d13-478f-9c2c-b51798868ffc": { 2024-09-21T03:58:29.819 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:09.736194+0000", 2024-09-21T03:58:29.819 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:58:29.819 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:58:29.819 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:58:29.819 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:58:29.819 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:58:29.819 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:58:29.819 INFO:teuthology.orchestra.run.smithi046.stdout: "a871f724-0198-493c-b03e-b2de78aba243": { 2024-09-21T03:58:29.819 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:56:30.082991+0000", 2024-09-21T03:58:29.819 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:58:29.820 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:58:29.820 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:58:29.820 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:58:29.820 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:58:29.820 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:58:29.820 INFO:teuthology.orchestra.run.smithi046.stdout: "d49f33a7-3d5a-421b-94ba-8b19a4120db1": { 2024-09-21T03:58:29.820 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:50.480786+0000", 2024-09-21T03:58:29.820 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:58:29.820 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:58:29.820 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:58:29.820 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:58:29.820 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:58:29.820 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:58:29.820 INFO:teuthology.orchestra.run.smithi046.stdout: "3bbf7097-70d7-4743-bbce-41465502b35b": { 2024-09-21T03:58:29.821 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:10.661441+0000", 2024-09-21T03:58:29.821 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:58:29.821 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:58:29.821 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:58:29.821 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:58:29.821 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:58:29.821 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:58:29.821 INFO:teuthology.orchestra.run.smithi046.stdout: "08f0c962-df1a-4129-a1a2-b916240d9803": { 2024-09-21T03:58:29.821 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:02.937596+0000", 2024-09-21T03:58:29.821 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:58:29.821 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:58:29.821 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:58:29.821 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:58:29.821 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:58:29.821 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:58:29.822 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:58:29.822 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T03:58:29.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.810+0000 7f8844cbb640 1 -- 172.21.15.46:0/3958712264 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f88280b66b0 msgr2=0x7f88280b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:29.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.810+0000 7f8844cbb640 1 --2- 172.21.15.46:0/3958712264 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f88280b66b0 0x7f88280b8bc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f88380cab50 tx=0x7f883809a590 comp rx=0 tx=0).stop 2024-09-21T03:58:29.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.810+0000 7f8844cbb640 1 -- 172.21.15.46:0/3958712264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8840108d20 msgr2=0x7f884019fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:29.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.810+0000 7f8844cbb640 1 --2- 172.21.15.46:0/3958712264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8840108d20 0x7f884019fcc0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f8838005940 tx=0x7f88380042f0 comp rx=0 tx=0).stop 2024-09-21T03:58:29.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.811+0000 7f8844cbb640 1 -- 172.21.15.46:0/3958712264 shutdown_connections 2024-09-21T03:58:29.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.811+0000 7f8844cbb640 1 --2- 172.21.15.46:0/3958712264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8840108d20 0x7f884019fcc0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:29.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.811+0000 7f8844cbb640 1 --2- 172.21.15.46:0/3958712264 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f88280b66b0 0x7f88280b8bc0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:29.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.811+0000 7f8844cbb640 1 --2- 172.21.15.46:0/3958712264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88401083d0 0x7f884019aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:29.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.811+0000 7f8844cbb640 1 --2- 172.21.15.46:0/3958712264 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8840102ae0 0x7f884019a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:29.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.811+0000 7f8844cbb640 1 -- 172.21.15.46:0/3958712264 >> 172.21.15.46:0/3958712264 conn(0x7f8840079760 msgr2=0x7f8840105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:29.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.811+0000 7f8844cbb640 1 -- 172.21.15.46:0/3958712264 shutdown_connections 2024-09-21T03:58:29.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:29.811+0000 7f8844cbb640 1 -- 172.21.15.46:0/3958712264 wait complete. 2024-09-21T03:58:30.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:29 smithi046 ceph-mon[30954]: pgmap v423: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:58:30.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:29 smithi105 ceph-mon[34773]: pgmap v423: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:58:30.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:29 smithi162 ceph-mon[35071]: pgmap v423: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:58:30.535 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:58:30.536 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:58:30.793 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:58:31.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.307+0000 7ff4682f3640 1 -- 172.21.15.46:0/1288432815 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4601094a0 msgr2=0x7ff4601098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:31.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.307+0000 7ff4682f3640 1 --2- 172.21.15.46:0/1288432815 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4601094a0 0x7ff4601098b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff454009900 tx=0x7ff45402a410 comp rx=0 tx=0).stop 2024-09-21T03:58:31.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.307+0000 7ff4682f3640 1 -- 172.21.15.46:0/1288432815 shutdown_connections 2024-09-21T03:58:31.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.307+0000 7ff4682f3640 1 --2- 172.21.15.46:0/1288432815 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff460109df0 0x7ff460110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:31.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.307+0000 7ff4682f3640 1 --2- 172.21.15.46:0/1288432815 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4601094a0 0x7ff4601098b0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:31.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.307+0000 7ff4682f3640 1 --2- 172.21.15.46:0/1288432815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff460103b60 0x7ff460103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:31.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.307+0000 7ff4682f3640 1 -- 172.21.15.46:0/1288432815 >> 172.21.15.46:0/1288432815 conn(0x7ff46007b850 msgr2=0x7ff46007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:31.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.307+0000 7ff4682f3640 1 -- 172.21.15.46:0/1288432815 shutdown_connections 2024-09-21T03:58:31.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.307+0000 7ff4682f3640 1 -- 172.21.15.46:0/1288432815 wait complete. 2024-09-21T03:58:31.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.308+0000 7ff4682f3640 1 Processor -- start 2024-09-21T03:58:31.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.308+0000 7ff4682f3640 1 -- start start 2024-09-21T03:58:31.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.308+0000 7ff4682f3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff460103b60 0x7ff46019a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:31.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.308+0000 7ff4682f3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4601094a0 0x7ff46019ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:31.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.308+0000 7ff4682f3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff460109df0 0x7ff46019fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:31.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.308+0000 7ff4682f3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff460113ab0 con 0x7ff4601094a0 2024-09-21T03:58:31.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.308+0000 7ff4682f3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff460113930 con 0x7ff460109df0 2024-09-21T03:58:31.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.308+0000 7ff4682f3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff460113c30 con 0x7ff460103b60 2024-09-21T03:58:31.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.309+0000 7ff46588e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4601094a0 0x7ff46019ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:31.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.309+0000 7ff46588e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4601094a0 0x7ff46019ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58136/0 (socket says 172.21.15.46:58136) 2024-09-21T03:58:31.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.309+0000 7ff46588e640 1 -- 172.21.15.46:0/1082934646 learned_addr learned my addr 172.21.15.46:0/1082934646 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:31.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.309+0000 7ff46608f640 1 --2- 172.21.15.46:0/1082934646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff460103b60 0x7ff46019a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:31.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.309+0000 7ff466890640 1 --2- 172.21.15.46:0/1082934646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff460109df0 0x7ff46019fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:31.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.309+0000 7ff46588e640 1 -- 172.21.15.46:0/1082934646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff460103b60 msgr2=0x7ff46019a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:31.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.309+0000 7ff46588e640 1 --2- 172.21.15.46:0/1082934646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff460103b60 0x7ff46019a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:31.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.309+0000 7ff46588e640 1 -- 172.21.15.46:0/1082934646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff460109df0 msgr2=0x7ff46019fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:31.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.309+0000 7ff46588e640 1 --2- 172.21.15.46:0/1082934646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff460109df0 0x7ff46019fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:31.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.309+0000 7ff46588e640 1 -- 172.21.15.46:0/1082934646 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4601a04f0 con 0x7ff4601094a0 2024-09-21T03:58:31.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.309+0000 7ff466890640 1 --2- 172.21.15.46:0/1082934646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff460109df0 0x7ff46019fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:58:31.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.309+0000 7ff46588e640 1 --2- 172.21.15.46:0/1082934646 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4601094a0 0x7ff46019ab20 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff45402a930 tx=0x7ff454004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:31.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.309+0000 7ff45f7fe640 1 -- 172.21.15.46:0/1082934646 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45403f030 con 0x7ff4601094a0 2024-09-21T03:58:31.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.309+0000 7ff45f7fe640 1 -- 172.21.15.46:0/1082934646 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff454003aa0 con 0x7ff4601094a0 2024-09-21T03:58:31.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.309+0000 7ff4682f3640 1 -- 172.21.15.46:0/1082934646 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4601a0780 con 0x7ff4601094a0 2024-09-21T03:58:31.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.309+0000 7ff45f7fe640 1 -- 172.21.15.46:0/1082934646 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff454035070 con 0x7ff4601094a0 2024-09-21T03:58:31.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.309+0000 7ff4682f3640 1 -- 172.21.15.46:0/1082934646 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4601a6f40 con 0x7ff4601094a0 2024-09-21T03:58:31.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.311+0000 7ff4682f3640 1 -- 172.21.15.46:0/1082934646 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff460104de0 con 0x7ff4601094a0 2024-09-21T03:58:31.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.313+0000 7ff45f7fe640 1 -- 172.21.15.46:0/1082934646 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7ff454042030 con 0x7ff4601094a0 2024-09-21T03:58:31.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.314+0000 7ff45f7fe640 1 --2- 172.21.15.46:0/1082934646 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff4480b6680 0x7ff4480b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:31.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.314+0000 7ff46608f640 1 --2- 172.21.15.46:0/1082934646 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff4480b6680 0x7ff4480b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:31.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.314+0000 7ff45f7fe640 1 -- 172.21.15.46:0/1082934646 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7ff4541081c0 con 0x7ff4601094a0 2024-09-21T03:58:31.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.314+0000 7ff46608f640 1 --2- 172.21.15.46:0/1082934646 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff4480b6680 0x7ff4480b8b90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff450005fd0 tx=0x7ff450009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:31.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.317+0000 7ff45f7fe640 1 -- 172.21.15.46:0/1082934646 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff4540ce770 con 0x7ff4601094a0 2024-09-21T03:58:31.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.544+0000 7ff4682f3640 1 -- 172.21.15.46:0/1082934646 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff46010bbc0 con 0x7ff4601094a0 2024-09-21T03:58:31.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.545+0000 7ff45f7fe640 1 -- 172.21.15.46:0/1082934646 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7ff4540d2b50 con 0x7ff4601094a0 2024-09-21T03:58:31.547 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:58:31.547 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"btime":"2024-09-21T03:53:23:865820+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1766354184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1766354184},{"type":"v1","addr":"172.21.15.46:6839","nonce":1766354184}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/1901774207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":1901774207},{"type":"v1","addr":"172.21.15.46:6841","nonce":1901774207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3548633196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":3548633196},{"type":"v1","addr":"172.21.15.105:6837","nonce":3548633196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24652,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3551934241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3551934241},{"type":"v1","addr":"172.21.15.162:6835","nonce":3551934241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/48949822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":48949822},{"type":"v1","addr":"172.21.15.162:6837","nonce":48949822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:53:14.452819+0000","modified":"2024-09-21T03:53:23.593278+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24680},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/2196053213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2196053213},{"type":"v1","addr":"172.21.15.162:6839","nonce":2196053213}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.105:6839/3911438406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":3911438406},{"type":"v1","addr":"172.21.15.105:6839","nonce":3911438406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24680,"qdb_cluster":[24680]},"id":1}]} 2024-09-21T03:58:31.547 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T03:58:31.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.547+0000 7ff4682f3640 1 -- 172.21.15.46:0/1082934646 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff4480b6680 msgr2=0x7ff4480b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:31.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.547+0000 7ff4682f3640 1 --2- 172.21.15.46:0/1082934646 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff4480b6680 0x7ff4480b8b90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff450005fd0 tx=0x7ff450009680 comp rx=0 tx=0).stop 2024-09-21T03:58:31.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.547+0000 7ff4682f3640 1 -- 172.21.15.46:0/1082934646 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4601094a0 msgr2=0x7ff46019ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:31.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.547+0000 7ff4682f3640 1 --2- 172.21.15.46:0/1082934646 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4601094a0 0x7ff46019ab20 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff45402a930 tx=0x7ff454004270 comp rx=0 tx=0).stop 2024-09-21T03:58:31.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.547+0000 7ff4682f3640 1 -- 172.21.15.46:0/1082934646 shutdown_connections 2024-09-21T03:58:31.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.547+0000 7ff4682f3640 1 --2- 172.21.15.46:0/1082934646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff460109df0 0x7ff46019fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:31.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.547+0000 7ff4682f3640 1 --2- 172.21.15.46:0/1082934646 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4601094a0 0x7ff46019ab20 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:31.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.547+0000 7ff4682f3640 1 --2- 172.21.15.46:0/1082934646 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff4480b6680 0x7ff4480b8b90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:31.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.547+0000 7ff4682f3640 1 --2- 172.21.15.46:0/1082934646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff460103b60 0x7ff46019a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:31.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.547+0000 7ff4682f3640 1 -- 172.21.15.46:0/1082934646 >> 172.21.15.46:0/1082934646 conn(0x7ff46007b850 msgr2=0x7ff460105580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:31.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.547+0000 7ff4682f3640 1 -- 172.21.15.46:0/1082934646 shutdown_connections 2024-09-21T03:58:31.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:31.547+0000 7ff4682f3640 1 -- 172.21.15.46:0/1082934646 wait complete. 2024-09-21T03:58:32.165 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:31 smithi046 ceph-mon[30954]: pgmap v424: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:58:32.165 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:31 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/1082934646' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:58:32.197 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:58:32.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:31 smithi105 ceph-mon[34773]: pgmap v424: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:58:32.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:31 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/1082934646' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:58:32.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:31 smithi162 ceph-mon[35071]: pgmap v424: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:58:32.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:31 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/1082934646' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:58:32.457 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:58:32.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.930+0000 7f8259da2640 1 -- 172.21.15.46:0/3486891640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8254104a30 msgr2=0x7f8254104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:32.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.930+0000 7f8259da2640 1 --2- 172.21.15.46:0/3486891640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8254104a30 0x7f8254104e40 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f8244009900 tx=0x7f824402a410 comp rx=0 tx=0).stop 2024-09-21T03:58:32.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.930+0000 7f8259da2640 1 -- 172.21.15.46:0/3486891640 shutdown_connections 2024-09-21T03:58:32.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.930+0000 7f8259da2640 1 --2- 172.21.15.46:0/3486891640 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f825410de60 0x7f8254110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:32.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.930+0000 7f8259da2640 1 --2- 172.21.15.46:0/3486891640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8254105380 0x7f825410d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:32.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.930+0000 7f8259da2640 1 --2- 172.21.15.46:0/3486891640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8254104a30 0x7f8254104e40 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:32.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.930+0000 7f8259da2640 1 -- 172.21.15.46:0/3486891640 >> 172.21.15.46:0/3486891640 conn(0x7f82540797b0 msgr2=0x7f8254079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:32.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.930+0000 7f8259da2640 1 -- 172.21.15.46:0/3486891640 shutdown_connections 2024-09-21T03:58:32.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.930+0000 7f8259da2640 1 -- 172.21.15.46:0/3486891640 wait complete. 2024-09-21T03:58:32.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.930+0000 7f8259da2640 1 Processor -- start 2024-09-21T03:58:32.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.931+0000 7f8259da2640 1 -- start start 2024-09-21T03:58:32.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.931+0000 7f8259da2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8254104a30 0x7f825419a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:32.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.931+0000 7f8259da2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8254105380 0x7f825419aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:32.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.931+0000 7f8259da2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f825410de60 0x7f825419fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:32.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.931+0000 7f8259da2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8254113aa0 con 0x7f825410de60 2024-09-21T03:58:32.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.931+0000 7f8259da2640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8254113920 con 0x7f8254104a30 2024-09-21T03:58:32.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.931+0000 7f8259da2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8254113c20 con 0x7f8254105380 2024-09-21T03:58:32.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.931+0000 7f8253fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f825410de60 0x7f825419fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:32.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.931+0000 7f8253fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f825410de60 0x7f825419fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42822/0 (socket says 172.21.15.46:42822) 2024-09-21T03:58:32.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.931+0000 7f8253fff640 1 -- 172.21.15.46:0/1695887743 learned_addr learned my addr 172.21.15.46:0/1695887743 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:32.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.931+0000 7f8252ffd640 1 --2- 172.21.15.46:0/1695887743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8254105380 0x7f825419aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:32.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.931+0000 7f82537fe640 1 --2- 172.21.15.46:0/1695887743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8254104a30 0x7f825419a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:32.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.931+0000 7f8253fff640 1 -- 172.21.15.46:0/1695887743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8254105380 msgr2=0x7f825419aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:32.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.931+0000 7f8253fff640 1 --2- 172.21.15.46:0/1695887743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8254105380 0x7f825419aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:32.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.931+0000 7f8253fff640 1 -- 172.21.15.46:0/1695887743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8254104a30 msgr2=0x7f825419a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:32.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.931+0000 7f8253fff640 1 --2- 172.21.15.46:0/1695887743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8254104a30 0x7f825419a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:32.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.931+0000 7f8253fff640 1 -- 172.21.15.46:0/1695887743 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82541a03c0 con 0x7f825410de60 2024-09-21T03:58:32.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.931+0000 7f8252ffd640 1 --2- 172.21.15.46:0/1695887743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8254105380 0x7f825419aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:58:32.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.931+0000 7f82537fe640 1 --2- 172.21.15.46:0/1695887743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8254104a30 0x7f825419a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:58:32.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.932+0000 7f8253fff640 1 --2- 172.21.15.46:0/1695887743 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f825410de60 0x7f825419fd50 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f824c00eaa0 tx=0x7f824c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:32.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.932+0000 7f8250ff9640 1 -- 172.21.15.46:0/1695887743 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824c00cdb0 con 0x7f825410de60 2024-09-21T03:58:32.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.932+0000 7f8250ff9640 1 -- 172.21.15.46:0/1695887743 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f824c005020 con 0x7f825410de60 2024-09-21T03:58:32.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.932+0000 7f8259da2640 1 -- 172.21.15.46:0/1695887743 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82541a06b0 con 0x7f825410de60 2024-09-21T03:58:32.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.932+0000 7f8250ff9640 1 -- 172.21.15.46:0/1695887743 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824c0116d0 con 0x7f825410de60 2024-09-21T03:58:32.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.932+0000 7f8259da2640 1 -- 172.21.15.46:0/1695887743 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82541a0ba0 con 0x7f825410de60 2024-09-21T03:58:32.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.934+0000 7f8260316740 1 Processor -- start 2024-09-21T03:58:32.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.935+0000 7f8250ff9640 1 -- 172.21.15.46:0/1695887743 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f824c0051d0 con 0x7f825410de60 2024-09-21T03:58:32.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.935+0000 7f8260316740 1 -- start start 2024-09-21T03:58:32.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.935+0000 7f8260316740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efae4bf070 0x55efae8666a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:32.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.935+0000 7f8260316740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efae4961b0 0x55efae866be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:32.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.935+0000 7f8260316740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efae49e390 0x55efae867120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:32.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.935+0000 7f8260316740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55efae7dcea0 con 0x55efae4bf070 2024-09-21T03:58:32.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.935+0000 7f8260316740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55efae7cc2d0 con 0x55efae49e390 2024-09-21T03:58:32.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.935+0000 7f8260316740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55efae7d00e0 con 0x55efae4961b0 2024-09-21T03:58:32.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.935+0000 7f8252ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efae4bf070 0x55efae8666a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:32.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.935+0000 7f8252ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efae4bf070 0x55efae8666a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42834/0 (socket says 172.21.15.46:42834) 2024-09-21T03:58:32.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.935+0000 7f8252ffd640 1 -- 172.21.15.46:0/3312376850 learned_addr learned my addr 172.21.15.46:0/3312376850 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:32.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.935+0000 7f82537fe640 1 --2- 172.21.15.46:0/3312376850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efae4961b0 0x55efae866be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:32.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.935+0000 7f8252ffd640 1 -- 172.21.15.46:0/3312376850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efae4961b0 msgr2=0x55efae866be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:32.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.935+0000 7f8252ffd640 1 --2- 172.21.15.46:0/3312376850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efae4961b0 0x55efae866be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:32.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.935+0000 7f8252ffd640 1 -- 172.21.15.46:0/3312376850 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efae49e390 msgr2=0x55efae867120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:32.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.935+0000 7f8252ffd640 1 --2- 172.21.15.46:0/3312376850 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efae49e390 0x55efae867120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:32.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.935+0000 7f8252ffd640 1 -- 172.21.15.46:0/3312376850 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efae52a650 con 0x55efae4bf070 2024-09-21T03:58:32.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.936+0000 7f8252ffd640 1 --2- 172.21.15.46:0/3312376850 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efae4bf070 0x55efae8666a0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f824800bc30 tx=0x7f824800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8012d17ca6e2177 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:32.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.936+0000 7f8250ff9640 1 --2- 172.21.15.46:0/1695887743 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f823c0b66b0 0x7f823c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:32.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.936+0000 7f82537fe640 1 --2- 172.21.15.46:0/1695887743 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f823c0b66b0 0x7f823c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:32.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.936+0000 7f8239ffb640 1 -- 172.21.15.46:0/3312376850 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8248005220 con 0x55efae4bf070 2024-09-21T03:58:32.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.936+0000 7f8250ff9640 1 -- 172.21.15.46:0/1695887743 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f824c0e7870 con 0x7f825410de60 2024-09-21T03:58:32.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.936+0000 7f8239ffb640 1 -- 172.21.15.46:0/3312376850 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8248004c50 con 0x55efae4bf070 2024-09-21T03:58:32.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.936+0000 7f8239ffb640 1 -- 172.21.15.46:0/3312376850 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8248011760 con 0x55efae4bf070 2024-09-21T03:58:32.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.937+0000 7f8260316740 1 -- 172.21.15.46:0/3312376850 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efae4bf070 msgr2=0x55efae8666a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:32.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.937+0000 7f82537fe640 1 --2- 172.21.15.46:0/1695887743 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f823c0b66b0 0x7f823c0b8bc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x55efae865320 tx=0x7f8244005ec0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:32.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.937+0000 7f8260316740 1 --2- 172.21.15.46:0/3312376850 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efae4bf070 0x55efae8666a0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f824800bc30 tx=0x7f824800f730 comp rx=0 tx=0).stop 2024-09-21T03:58:32.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.937+0000 7f8260316740 1 -- 172.21.15.46:0/3312376850 shutdown_connections 2024-09-21T03:58:32.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.937+0000 7f8260316740 1 --2- 172.21.15.46:0/3312376850 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efae49e390 0x55efae867120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:32.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.937+0000 7f8260316740 1 --2- 172.21.15.46:0/3312376850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efae4961b0 0x55efae866be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:32.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.937+0000 7f8260316740 1 --2- 172.21.15.46:0/3312376850 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efae4bf070 0x55efae8666a0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:32.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.937+0000 7f8260316740 1 -- 172.21.15.46:0/3312376850 >> 172.21.15.46:0/3312376850 conn(0x55efae4b3460 msgr2=0x55efae864590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:32.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.937+0000 7f8260316740 1 -- 172.21.15.46:0/3312376850 shutdown_connections 2024-09-21T03:58:32.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.937+0000 7f8260316740 1 -- 172.21.15.46:0/3312376850 wait complete. 2024-09-21T03:58:32.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.937+0000 7f8260316740 1 -- start start 2024-09-21T03:58:32.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.938+0000 7f8260316740 1 Processor -- start 2024-09-21T03:58:32.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.938+0000 7f8260316740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efae4961b0 0x55efae871ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:32.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.938+0000 7f8260316740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efae49e390 0x55efae872220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:32.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.938+0000 7f8260316740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efae4bf070 0x55efae8727a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:32.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.938+0000 7f8260316740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55efae62d700 con 0x55efae49e390 2024-09-21T03:58:32.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.938+0000 7f8260316740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55efae767160 con 0x55efae4961b0 2024-09-21T03:58:32.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.938+0000 7f8260316740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55efae874e80 con 0x55efae4bf070 2024-09-21T03:58:32.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.938+0000 7f8260316740 10 client.0 _ll_register_callbacks cb 0x55efae7809e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:58:32.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.938+0000 7f8252ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efae49e390 0x55efae872220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:32.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.938+0000 7f8252ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efae49e390 0x55efae872220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42844/0 (socket says 172.21.15.46:42844) 2024-09-21T03:58:32.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.938+0000 7f8252ffd640 1 -- 172.21.15.46:0/1998827682 learned_addr learned my addr 172.21.15.46:0/1998827682 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:32.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.938+0000 7f82537fe640 1 --2- 172.21.15.46:0/1998827682 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efae4961b0 0x55efae871ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:32.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.938+0000 7f8253fff640 1 --2- 172.21.15.46:0/1998827682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efae4bf070 0x55efae8727a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:32.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.939+0000 7f8252ffd640 1 -- 172.21.15.46:0/1998827682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efae4bf070 msgr2=0x55efae8727a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:32.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.939+0000 7f8252ffd640 1 --2- 172.21.15.46:0/1998827682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efae4bf070 0x55efae8727a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:32.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.939+0000 7f8252ffd640 1 -- 172.21.15.46:0/1998827682 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efae4961b0 msgr2=0x55efae871ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:32.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.939+0000 7f8252ffd640 1 --2- 172.21.15.46:0/1998827682 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efae4961b0 0x55efae871ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:32.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.939+0000 7f8252ffd640 1 -- 172.21.15.46:0/1998827682 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efae794c90 con 0x55efae49e390 2024-09-21T03:58:32.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.939+0000 7f8252ffd640 1 --2- 172.21.15.46:0/1998827682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efae49e390 0x55efae872220 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f82480056f0 tx=0x7f8248005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e7de0b31e22a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:32.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.939+0000 7f8232ffd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:58:32.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.939+0000 7f8232ffd640 1 -- 172.21.15.46:0/1998827682 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8248029060 con 0x55efae49e390 2024-09-21T03:58:32.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.939+0000 7f8260316740 1 -- 172.21.15.46:0/1998827682 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8248004c50 con 0x55efae49e390 2024-09-21T03:58:32.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.939+0000 7f8232ffd640 1 -- 172.21.15.46:0/1998827682 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f8248005230 con 0x55efae49e390 2024-09-21T03:58:32.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.939+0000 7f8232ffd640 1 -- 172.21.15.46:0/1998827682 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8248005430 con 0x55efae49e390 2024-09-21T03:58:32.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.939+0000 7f8260316740 10 client.15981 fetch_fsmap learned FSMap version 20 2024-09-21T03:58:32.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.939+0000 7f8260316740 1 -- 172.21.15.46:0/1998827682 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55efae880b20 con 0x55efae49e390 2024-09-21T03:58:32.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.939+0000 7f8232ffd640 1 -- 172.21.15.46:0/1998827682 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8248004c50 con 0x55efae49e390 2024-09-21T03:58:32.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.940+0000 7f8232ffd640 1 -- 172.21.15.46:0/1998827682 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f82480246a0 con 0x55efae49e390 2024-09-21T03:58:32.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.940+0000 7f8260316740 10 client.15981 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:58:32.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.940+0000 7f8260316740 10 client.15981 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:58:32.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.940+0000 7f8260316740 20 client.15981 populate_metadata read hostname 'smithi046' 2024-09-21T03:58:32.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.940+0000 7f8260316740 1 --2- 172.21.15.46:0/1998827682 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55efae47d9f0 0x55efae883f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:32.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.940+0000 7f8260316740 4 client.15981 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:58:32.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.940+0000 7f8260316740 1 -- 172.21.15.46:0/1998827682 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55efae7dedf0 con 0x55efae47d9f0 2024-09-21T03:58:32.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.940+0000 7f82537fe640 1 --2- 172.21.15.46:0/1998827682 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55efae47d9f0 0x55efae883f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:32.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.940+0000 7f8232ffd640 10 client.15981 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:58:32.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.940+0000 7f82537fe640 1 --2- 172.21.15.46:0/1998827682 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55efae47d9f0 0x55efae883f90 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=947e57a69361ed7d server_cookie=70078d083f5b9778 in_seq=0 out_seq=0 2024-09-21T03:58:32.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.941+0000 7f8232ffd640 1 -- 172.21.15.46:0/1998827682 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55efae7dedf0 con 0x55efae47d9f0 2024-09-21T03:58:32.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.941+0000 7f8232ffd640 10 client.15981 handle_command_reply: tid=0 2024-09-21T03:58:32.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.941+0000 7f8260316740 1 client.15981 shutdown 2024-09-21T03:58:32.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.941+0000 7f8260316740 1 -- 172.21.15.46:0/1998827682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efae49e390 msgr2=0x55efae872220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:32.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.941+0000 7f8260316740 1 --2- 172.21.15.46:0/1998827682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efae49e390 0x55efae872220 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f82480056f0 tx=0x7f8248005f10 comp rx=0 tx=0).stop 2024-09-21T03:58:32.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.942+0000 7f8260316740 1 -- 172.21.15.46:0/1998827682 shutdown_connections 2024-09-21T03:58:32.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.942+0000 7f8260316740 1 --2- 172.21.15.46:0/1998827682 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55efae47d9f0 0x55efae883f90 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:32.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.942+0000 7f8260316740 1 --2- 172.21.15.46:0/1998827682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efae4bf070 0x55efae8727a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:32.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.942+0000 7f8260316740 1 --2- 172.21.15.46:0/1998827682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efae49e390 0x55efae872220 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:32.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.942+0000 7f8232ffd640 0 client.15981 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:58:32.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.942+0000 7f8260316740 1 --2- 172.21.15.46:0/1998827682 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efae4961b0 0x55efae871ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:32.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.942+0000 7f8260316740 1 -- 172.21.15.46:0/1998827682 >> 172.21.15.46:0/1998827682 conn(0x55efae4b3460 msgr2=0x55efae869880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:32.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.942+0000 7f8260316740 1 -- 172.21.15.46:0/1998827682 shutdown_connections 2024-09-21T03:58:32.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.942+0000 7f8260316740 1 -- 172.21.15.46:0/1998827682 wait complete. 2024-09-21T03:58:32.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.942+0000 7f8260316740 20 client.15981 trim_cache size 0 max 16384 2024-09-21T03:58:32.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.955+0000 7f8260316740 1 Processor -- start 2024-09-21T03:58:32.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.956+0000 7f8260316740 1 -- start start 2024-09-21T03:58:32.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.956+0000 7f8260316740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efae4961b0 0x55efae873bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:32.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.956+0000 7f8260316740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efae49e390 0x55efae87d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:32.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.956+0000 7f8260316740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efae4bf070 0x55efae863bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:32.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.956+0000 7f8260316740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f82541ad530 con 0x55efae4bf070 2024-09-21T03:58:32.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.956+0000 7f8260316740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f82541afdd0 con 0x55efae49e390 2024-09-21T03:58:32.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.956+0000 7f8260316740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f82541adbc0 con 0x55efae4961b0 2024-09-21T03:58:32.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.956+0000 7f8253fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efae4bf070 0x55efae863bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:32.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.956+0000 7f8253fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efae4bf070 0x55efae863bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42854/0 (socket says 172.21.15.46:42854) 2024-09-21T03:58:32.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.956+0000 7f8253fff640 1 -- 172.21.15.46:0/292765352 learned_addr learned my addr 172.21.15.46:0/292765352 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:32.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.956+0000 7f8252ffd640 1 --2- 172.21.15.46:0/292765352 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efae49e390 0x55efae87d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:32.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.956+0000 7f82537fe640 1 --2- 172.21.15.46:0/292765352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efae4961b0 0x55efae873bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:32.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.956+0000 7f8253fff640 1 -- 172.21.15.46:0/292765352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efae4961b0 msgr2=0x55efae873bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:32.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.956+0000 7f8253fff640 1 --2- 172.21.15.46:0/292765352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efae4961b0 0x55efae873bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:32.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.956+0000 7f8253fff640 1 -- 172.21.15.46:0/292765352 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efae49e390 msgr2=0x55efae87d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:32.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.956+0000 7f8253fff640 1 --2- 172.21.15.46:0/292765352 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efae49e390 0x55efae87d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:32.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.956+0000 7f8253fff640 1 -- 172.21.15.46:0/292765352 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efae869500 con 0x55efae4bf070 2024-09-21T03:58:32.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.956+0000 7f82537fe640 1 --2- 172.21.15.46:0/292765352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efae4961b0 0x55efae873bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:58:32.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.957+0000 7f8253fff640 1 --2- 172.21.15.46:0/292765352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efae4bf070 0x55efae863bc0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f824c0aa9d0 tx=0x7f824c0adf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79df86989c81476 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:32.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.957+0000 7f82397fa640 1 -- 172.21.15.46:0/292765352 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824c01f070 con 0x55efae4bf070 2024-09-21T03:58:32.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.957+0000 7f82397fa640 1 -- 172.21.15.46:0/292765352 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f824c0b7180 con 0x55efae4bf070 2024-09-21T03:58:32.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.957+0000 7f82397fa640 1 -- 172.21.15.46:0/292765352 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824c0a7e60 con 0x55efae4bf070 2024-09-21T03:58:32.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.958+0000 7f8260316740 1 -- 172.21.15.46:0/292765352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efae4bf070 msgr2=0x55efae863bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:32.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.958+0000 7f8260316740 1 --2- 172.21.15.46:0/292765352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efae4bf070 0x55efae863bc0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f824c0aa9d0 tx=0x7f824c0adf70 comp rx=0 tx=0).stop 2024-09-21T03:58:32.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.958+0000 7f8260316740 1 -- 172.21.15.46:0/292765352 shutdown_connections 2024-09-21T03:58:32.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.958+0000 7f8260316740 1 --2- 172.21.15.46:0/292765352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efae4bf070 0x55efae863bc0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:32.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.958+0000 7f8260316740 1 --2- 172.21.15.46:0/292765352 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efae49e390 0x55efae87d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:32.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.958+0000 7f8260316740 1 --2- 172.21.15.46:0/292765352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efae4961b0 0x55efae873bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:32.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.958+0000 7f8260316740 1 -- 172.21.15.46:0/292765352 >> 172.21.15.46:0/292765352 conn(0x55efae4b3460 msgr2=0x55efae87d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:32.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.958+0000 7f8260316740 1 -- 172.21.15.46:0/292765352 shutdown_connections 2024-09-21T03:58:32.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.958+0000 7f8260316740 1 -- 172.21.15.46:0/292765352 wait complete. 2024-09-21T03:58:32.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.958+0000 7f8260316740 1 -- start start 2024-09-21T03:58:32.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.958+0000 7f8260316740 1 Processor -- start 2024-09-21T03:58:32.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.959+0000 7f8260316740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efae4961b0 0x55efae8879e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:32.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.959+0000 7f8260316740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efae49e390 0x55efae884f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:32.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.959+0000 7f8260316740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efae4bf070 0x55efae885620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:32.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.959+0000 7f8260316740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f82541ae290 con 0x55efae4961b0 2024-09-21T03:58:32.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.959+0000 7f8260316740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f82541af700 con 0x55efae49e390 2024-09-21T03:58:32.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.959+0000 7f8260316740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f82541ae960 con 0x55efae4bf070 2024-09-21T03:58:32.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.959+0000 7f8260316740 10 client.0 _ll_register_callbacks cb 0x7f824800bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:58:32.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.959+0000 7f82537fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efae4961b0 0x55efae8879e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:32.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.959+0000 7f82537fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efae4961b0 0x55efae8879e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42868/0 (socket says 172.21.15.46:42868) 2024-09-21T03:58:32.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.959+0000 7f82537fe640 1 -- 172.21.15.46:0/1174733276 learned_addr learned my addr 172.21.15.46:0/1174733276 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:32.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.959+0000 7f8252ffd640 1 --2- 172.21.15.46:0/1174733276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efae49e390 0x55efae884f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:32.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.959+0000 7f8253fff640 1 --2- 172.21.15.46:0/1174733276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efae4bf070 0x55efae885620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:32.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.959+0000 7f82537fe640 1 -- 172.21.15.46:0/1174733276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efae4bf070 msgr2=0x55efae885620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:32.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.959+0000 7f82537fe640 1 --2- 172.21.15.46:0/1174733276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efae4bf070 0x55efae885620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:32.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.959+0000 7f82537fe640 1 -- 172.21.15.46:0/1174733276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efae49e390 msgr2=0x55efae884f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:32.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.959+0000 7f82537fe640 1 --2- 172.21.15.46:0/1174733276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efae49e390 0x55efae884f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:32.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.959+0000 7f82537fe640 1 -- 172.21.15.46:0/1174733276 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efae8ed710 con 0x55efae4961b0 2024-09-21T03:58:32.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.959+0000 7f82537fe640 1 --2- 172.21.15.46:0/1174733276 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efae4961b0 0x55efae8879e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8244031670 tx=0x7f8244009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72508d2fc38a1d61 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:32.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.959+0000 7f8232ffd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:58:32.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.960+0000 7f8232ffd640 1 -- 172.21.15.46:0/1174733276 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8244035050 con 0x55efae4961b0 2024-09-21T03:58:32.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.960+0000 7f8232ffd640 1 -- 172.21.15.46:0/1174733276 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f824404e070 con 0x55efae4961b0 2024-09-21T03:58:32.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.960+0000 7f8260316740 1 -- 172.21.15.46:0/1174733276 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f824c0b7180 con 0x55efae4961b0 2024-09-21T03:58:32.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.960+0000 7f8232ffd640 1 -- 172.21.15.46:0/1174733276 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f82440043d0 con 0x55efae4961b0 2024-09-21T03:58:32.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.960+0000 7f8260316740 10 client.15987 fetch_fsmap learned FSMap version 20 2024-09-21T03:58:32.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.960+0000 7f8260316740 1 -- 172.21.15.46:0/1174733276 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55efae8ee800 con 0x55efae4961b0 2024-09-21T03:58:32.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.960+0000 7f8232ffd640 1 -- 172.21.15.46:0/1174733276 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f824c0b7180 con 0x55efae4961b0 2024-09-21T03:58:32.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.960+0000 7f8232ffd640 1 -- 172.21.15.46:0/1174733276 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f8244004aa0 con 0x55efae4961b0 2024-09-21T03:58:32.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.960+0000 7f8260316740 10 client.15987 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:58:32.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.960+0000 7f8260316740 10 client.15987 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:58:32.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.960+0000 7f8260316740 20 client.15987 populate_metadata read hostname 'smithi046' 2024-09-21T03:58:32.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.960+0000 7f8260316740 1 --2- 172.21.15.46:0/1174733276 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55efae452da0 0x55efae8f0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:32.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.960+0000 7f8260316740 4 client.15987 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:58:32.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.960+0000 7f8260316740 1 -- 172.21.15.46:0/1174733276 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55efae7da8a0 con 0x55efae452da0 2024-09-21T03:58:32.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.961+0000 7f8252ffd640 1 --2- 172.21.15.46:0/1174733276 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55efae452da0 0x55efae8f0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:32.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.961+0000 7f8232ffd640 10 client.15987 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:58:32.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.961+0000 7f8252ffd640 1 --2- 172.21.15.46:0/1174733276 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55efae452da0 0x55efae8f0f70 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55123615e8f24238 server_cookie=205187c19009e6e2 in_seq=0 out_seq=0 2024-09-21T03:58:32.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.961+0000 7f8232ffd640 1 -- 172.21.15.46:0/1174733276 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55efae7da8a0 con 0x55efae452da0 2024-09-21T03:58:32.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.961+0000 7f8232ffd640 10 client.15987 handle_command_reply: tid=0 2024-09-21T03:58:32.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.961+0000 7f8260316740 1 client.15987 shutdown 2024-09-21T03:58:32.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.961+0000 7f8260316740 1 -- 172.21.15.46:0/1174733276 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efae4961b0 msgr2=0x55efae8879e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:32.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.961+0000 7f8260316740 1 --2- 172.21.15.46:0/1174733276 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efae4961b0 0x55efae8879e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8244031670 tx=0x7f8244009260 comp rx=0 tx=0).stop 2024-09-21T03:58:32.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.962+0000 7f8260316740 1 -- 172.21.15.46:0/1174733276 shutdown_connections 2024-09-21T03:58:32.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.962+0000 7f8260316740 1 --2- 172.21.15.46:0/1174733276 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55efae452da0 0x55efae8f0f70 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:32.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.962+0000 7f8232ffd640 0 client.15987 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:58:32.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.962+0000 7f8260316740 1 --2- 172.21.15.46:0/1174733276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efae4bf070 0x55efae885620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:32.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.962+0000 7f8260316740 1 --2- 172.21.15.46:0/1174733276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efae49e390 0x55efae884f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:32.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.962+0000 7f8260316740 1 --2- 172.21.15.46:0/1174733276 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efae4961b0 0x55efae8879e0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:32.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.962+0000 7f8260316740 1 -- 172.21.15.46:0/1174733276 >> 172.21.15.46:0/1174733276 conn(0x55efae4b3460 msgr2=0x55efae873890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:32.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.962+0000 7f8260316740 1 -- 172.21.15.46:0/1174733276 shutdown_connections 2024-09-21T03:58:32.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.962+0000 7f8260316740 1 -- 172.21.15.46:0/1174733276 wait complete. 2024-09-21T03:58:32.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.962+0000 7f8260316740 20 client.15987 trim_cache size 0 max 16384 2024-09-21T03:58:32.974 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-21T03:58:32.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.962+0000 7f8259da2640 1 -- 172.21.15.46:0/1695887743 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f823c0b66b0 msgr2=0x7f823c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:32.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.962+0000 7f8259da2640 1 --2- 172.21.15.46:0/1695887743 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f823c0b66b0 0x7f823c0b8bc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x55efae865320 tx=0x7f8244005ec0 comp rx=0 tx=0).stop 2024-09-21T03:58:32.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.962+0000 7f8259da2640 1 -- 172.21.15.46:0/1695887743 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f825410de60 msgr2=0x7f825419fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:32.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.962+0000 7f8259da2640 1 --2- 172.21.15.46:0/1695887743 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f825410de60 0x7f825419fd50 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f824c00eaa0 tx=0x7f824c00ef60 comp rx=0 tx=0).stop 2024-09-21T03:58:32.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.962+0000 7f8259da2640 1 -- 172.21.15.46:0/1695887743 shutdown_connections 2024-09-21T03:58:32.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.962+0000 7f8259da2640 1 --2- 172.21.15.46:0/1695887743 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f825410de60 0x7f825419fd50 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:32.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.962+0000 7f8259da2640 1 --2- 172.21.15.46:0/1695887743 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f823c0b66b0 0x7f823c0b8bc0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:32.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.962+0000 7f8259da2640 1 --2- 172.21.15.46:0/1695887743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8254105380 0x7f825419aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:32.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.962+0000 7f8259da2640 1 --2- 172.21.15.46:0/1695887743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8254104a30 0x7f825419a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:32.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.962+0000 7f8259da2640 1 -- 172.21.15.46:0/1695887743 >> 172.21.15.46:0/1695887743 conn(0x7f82540797b0 msgr2=0x7f82541008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:32.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.963+0000 7f8259da2640 1 -- 172.21.15.46:0/1695887743 shutdown_connections 2024-09-21T03:58:32.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:32.963+0000 7f8259da2640 1 -- 172.21.15.46:0/1695887743 wait complete. 2024-09-21T03:58:34.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:33 smithi046 ceph-mon[30954]: pgmap v425: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-21T03:58:34.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:33 smithi105 ceph-mon[34773]: pgmap v425: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-21T03:58:34.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:33 smithi162 ceph-mon[35071]: pgmap v425: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-21T03:58:34.758 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:58:34.758 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:58:35.032 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:58:35.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.557+0000 7f0f980d2640 1 -- 172.21.15.46:0/2499894034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f901094c0 msgr2=0x7f0f901098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:35.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.557+0000 7f0f980d2640 1 --2- 172.21.15.46:0/2499894034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f901094c0 0x7f0f901098d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f0f80009900 tx=0x7f0f8002a410 comp rx=0 tx=0).stop 2024-09-21T03:58:35.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.558+0000 7f0f980d2640 1 -- 172.21.15.46:0/2499894034 shutdown_connections 2024-09-21T03:58:35.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.558+0000 7f0f980d2640 1 --2- 172.21.15.46:0/2499894034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f90109e10 0x7f0f90110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:35.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.558+0000 7f0f980d2640 1 --2- 172.21.15.46:0/2499894034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f901094c0 0x7f0f901098d0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:35.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.558+0000 7f0f980d2640 1 --2- 172.21.15.46:0/2499894034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f90103b80 0x7f0f90103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:35.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.558+0000 7f0f980d2640 1 -- 172.21.15.46:0/2499894034 >> 172.21.15.46:0/2499894034 conn(0x7f0f900ff610 msgr2=0x7f0f90101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:35.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.558+0000 7f0f980d2640 1 -- 172.21.15.46:0/2499894034 shutdown_connections 2024-09-21T03:58:35.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.558+0000 7f0f980d2640 1 -- 172.21.15.46:0/2499894034 wait complete. 2024-09-21T03:58:35.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.558+0000 7f0f980d2640 1 Processor -- start 2024-09-21T03:58:35.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.558+0000 7f0f980d2640 1 -- start start 2024-09-21T03:58:35.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.559+0000 7f0f980d2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f90103b80 0x7f0f9019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:35.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.559+0000 7f0f980d2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f901094c0 0x7f0f9019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:35.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.559+0000 7f0f980d2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f90109e10 0x7f0f9019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:35.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.559+0000 7f0f980d2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0f90113af0 con 0x7f0f901094c0 2024-09-21T03:58:35.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.559+0000 7f0f980d2640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0f90113970 con 0x7f0f90109e10 2024-09-21T03:58:35.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.559+0000 7f0f980d2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0f90113c70 con 0x7f0f90103b80 2024-09-21T03:58:35.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.559+0000 7f0f9566d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f901094c0 0x7f0f9019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:35.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.559+0000 7f0f9566d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f901094c0 0x7f0f9019aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42876/0 (socket says 172.21.15.46:42876) 2024-09-21T03:58:35.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.559+0000 7f0f9566d640 1 -- 172.21.15.46:0/3082791900 learned_addr learned my addr 172.21.15.46:0/3082791900 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:35.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.559+0000 7f0f95e6e640 1 --2- 172.21.15.46:0/3082791900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f90103b80 0x7f0f9019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:35.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.559+0000 7f0f9666f640 1 --2- 172.21.15.46:0/3082791900 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f90109e10 0x7f0f9019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:35.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.559+0000 7f0f9566d640 1 -- 172.21.15.46:0/3082791900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f90103b80 msgr2=0x7f0f9019a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:35.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.559+0000 7f0f9566d640 1 --2- 172.21.15.46:0/3082791900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f90103b80 0x7f0f9019a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:35.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.559+0000 7f0f9566d640 1 -- 172.21.15.46:0/3082791900 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f90109e10 msgr2=0x7f0f9019fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:35.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.559+0000 7f0f9566d640 1 --2- 172.21.15.46:0/3082791900 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f90109e10 0x7f0f9019fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:35.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.559+0000 7f0f9566d640 1 -- 172.21.15.46:0/3082791900 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f901a0450 con 0x7f0f901094c0 2024-09-21T03:58:35.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.559+0000 7f0f9666f640 1 --2- 172.21.15.46:0/3082791900 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f90109e10 0x7f0f9019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:58:35.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.559+0000 7f0f9566d640 1 --2- 172.21.15.46:0/3082791900 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f901094c0 0x7f0f9019aa80 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f0f8002a930 tx=0x7f0f80004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:35.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.560+0000 7f0f86ffd640 1 -- 172.21.15.46:0/3082791900 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8003f030 con 0x7f0f901094c0 2024-09-21T03:58:35.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.560+0000 7f0f86ffd640 1 -- 172.21.15.46:0/3082791900 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f80003cb0 con 0x7f0f901094c0 2024-09-21T03:58:35.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.560+0000 7f0f980d2640 1 -- 172.21.15.46:0/3082791900 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f901a06e0 con 0x7f0f901094c0 2024-09-21T03:58:35.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.560+0000 7f0f86ffd640 1 -- 172.21.15.46:0/3082791900 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f80035070 con 0x7f0f901094c0 2024-09-21T03:58:35.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.560+0000 7f0f980d2640 1 -- 172.21.15.46:0/3082791900 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f901a6ea0 con 0x7f0f901094c0 2024-09-21T03:58:35.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.562+0000 7f0f9e646740 1 Processor -- start 2024-09-21T03:58:35.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.562+0000 7f0f9e646740 1 -- start start 2024-09-21T03:58:35.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.562+0000 7f0f86ffd640 1 -- 172.21.15.46:0/3082791900 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f0f80042030 con 0x7f0f901094c0 2024-09-21T03:58:35.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.563+0000 7f0f9e646740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d328cab350 0x55d329052430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:35.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.563+0000 7f0f9e646740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d328c82490 0x55d329052970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:35.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.563+0000 7f0f9e646740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d328c8a670 0x55d329052eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:35.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.563+0000 7f0f9e646740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55d328fc8e60 con 0x55d328cab350 2024-09-21T03:58:35.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.563+0000 7f0f9e646740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55d328fb8290 con 0x55d328c8a670 2024-09-21T03:58:35.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.563+0000 7f0f9e646740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d328fbc0a0 con 0x55d328c82490 2024-09-21T03:58:35.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.563+0000 7f0f9666f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d328cab350 0x55d329052430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:35.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.563+0000 7f0f9666f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d328cab350 0x55d329052430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42878/0 (socket says 172.21.15.46:42878) 2024-09-21T03:58:35.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.563+0000 7f0f9666f640 1 -- 172.21.15.46:0/694244562 learned_addr learned my addr 172.21.15.46:0/694244562 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:35.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.563+0000 7f0f95e6e640 1 --2- 172.21.15.46:0/694244562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d328c82490 0x55d329052970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:35.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.563+0000 7f0f9566d640 1 --2- 172.21.15.46:0/694244562 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d328c8a670 0x55d329052eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:35.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.563+0000 7f0f9666f640 1 -- 172.21.15.46:0/694244562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d328c82490 msgr2=0x55d329052970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:35.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.563+0000 7f0f9666f640 1 --2- 172.21.15.46:0/694244562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d328c82490 0x55d329052970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:35.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.563+0000 7f0f9666f640 1 -- 172.21.15.46:0/694244562 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d328c8a670 msgr2=0x55d329052eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:35.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.563+0000 7f0f9666f640 1 --2- 172.21.15.46:0/694244562 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d328c8a670 0x55d329052eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:35.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.563+0000 7f0f9666f640 1 -- 172.21.15.46:0/694244562 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d328d16930 con 0x55d328cab350 2024-09-21T03:58:35.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.563+0000 7f0f95e6e640 1 --2- 172.21.15.46:0/694244562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d328c82490 0x55d329052970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:58:35.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.563+0000 7f0f9566d640 1 --2- 172.21.15.46:0/694244562 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d328c8a670 0x55d329052eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:58:35.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.563+0000 7f0f9666f640 1 --2- 172.21.15.46:0/694244562 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d328cab350 0x55d329052430 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f0f8800c450 tx=0x7f0f8800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=382beaa7b5c6897b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:35.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.564+0000 7f0f7bfff640 1 -- 172.21.15.46:0/694244562 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f88007430 con 0x55d328cab350 2024-09-21T03:58:35.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.564+0000 7f0f7bfff640 1 -- 172.21.15.46:0/694244562 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f88007a80 con 0x55d328cab350 2024-09-21T03:58:35.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.564+0000 7f0f7bfff640 1 -- 172.21.15.46:0/694244562 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8800a9f0 con 0x55d328cab350 2024-09-21T03:58:35.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.564+0000 7f0f86ffd640 1 --2- 172.21.15.46:0/3082791900 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f0f7c0b6700 0x7f0f7c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:35.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.564+0000 7f0f95e6e640 1 --2- 172.21.15.46:0/3082791900 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f0f7c0b6700 0x7f0f7c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:35.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.564+0000 7f0f86ffd640 1 -- 172.21.15.46:0/3082791900 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f0f80107c50 con 0x7f0f901094c0 2024-09-21T03:58:35.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.565+0000 7f0f9e646740 1 -- 172.21.15.46:0/694244562 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d328cab350 msgr2=0x55d329052430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:35.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.565+0000 7f0f95e6e640 1 --2- 172.21.15.46:0/3082791900 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f0f7c0b6700 0x7f0f7c0b8c10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x55d3290510b0 tx=0x7f0f8c00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:35.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.565+0000 7f0f9e646740 1 --2- 172.21.15.46:0/694244562 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d328cab350 0x55d329052430 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f0f8800c450 tx=0x7f0f8800c910 comp rx=0 tx=0).stop 2024-09-21T03:58:35.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.565+0000 7f0f9e646740 1 -- 172.21.15.46:0/694244562 shutdown_connections 2024-09-21T03:58:35.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.565+0000 7f0f9e646740 1 --2- 172.21.15.46:0/694244562 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d328c8a670 0x55d329052eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:35.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.565+0000 7f0f9e646740 1 --2- 172.21.15.46:0/694244562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d328c82490 0x55d329052970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:35.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.565+0000 7f0f9e646740 1 --2- 172.21.15.46:0/694244562 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d328cab350 0x55d329052430 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:35.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.565+0000 7f0f9e646740 1 -- 172.21.15.46:0/694244562 >> 172.21.15.46:0/694244562 conn(0x55d328c9f740 msgr2=0x55d329050320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:35.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.565+0000 7f0f9e646740 1 -- 172.21.15.46:0/694244562 shutdown_connections 2024-09-21T03:58:35.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.565+0000 7f0f9e646740 1 -- 172.21.15.46:0/694244562 wait complete. 2024-09-21T03:58:35.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.565+0000 7f0f9e646740 1 -- start start 2024-09-21T03:58:35.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.565+0000 7f0f9e646740 1 Processor -- start 2024-09-21T03:58:35.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.566+0000 7f0f9e646740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d328c82490 0x55d32905e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:35.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.566+0000 7f0f9e646740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d328c8a670 0x55d32905e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:35.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.566+0000 7f0f9e646740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d328cab350 0x55d329069f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:35.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.566+0000 7f0f9e646740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55d328e19890 con 0x55d328cab350 2024-09-21T03:58:35.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.566+0000 7f0f9e646740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55d328f52d40 con 0x55d328c8a670 2024-09-21T03:58:35.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.566+0000 7f0f9e646740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d329060c10 con 0x55d328c82490 2024-09-21T03:58:35.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.566+0000 7f0f9e646740 10 client.0 _ll_register_callbacks cb 0x55d328fb6c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:58:35.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.566+0000 7f0f9666f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d328cab350 0x55d329069f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:35.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.566+0000 7f0f9666f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d328cab350 0x55d329069f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42890/0 (socket says 172.21.15.46:42890) 2024-09-21T03:58:35.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.566+0000 7f0f9666f640 1 -- 172.21.15.46:0/2569581016 learned_addr learned my addr 172.21.15.46:0/2569581016 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:35.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.566+0000 7f0f95e6e640 1 --2- 172.21.15.46:0/2569581016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d328c82490 0x55d32905e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:35.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.566+0000 7f0f9566d640 1 --2- 172.21.15.46:0/2569581016 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d328c8a670 0x55d32905e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:35.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.566+0000 7f0f9666f640 1 -- 172.21.15.46:0/2569581016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d328c82490 msgr2=0x55d32905e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:35.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.566+0000 7f0f9666f640 1 --2- 172.21.15.46:0/2569581016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d328c82490 0x55d32905e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:35.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.566+0000 7f0f9666f640 1 -- 172.21.15.46:0/2569581016 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d328c8a670 msgr2=0x55d32905e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:35.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.566+0000 7f0f9666f640 1 --2- 172.21.15.46:0/2569581016 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d328c8a670 0x55d32905e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:35.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.566+0000 7f0f9666f640 1 -- 172.21.15.46:0/2569581016 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d32906a550 con 0x55d328cab350 2024-09-21T03:58:35.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.567+0000 7f0f9666f640 1 --2- 172.21.15.46:0/2569581016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d328cab350 0x55d329069f60 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f0f8800a570 tx=0x7f0f880076e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5065db6bdcbb0a49 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:35.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.567+0000 7f0f797fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:58:35.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.567+0000 7f0f797fa640 1 -- 172.21.15.46:0/2569581016 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f880078d0 con 0x55d328cab350 2024-09-21T03:58:35.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.567+0000 7f0f797fa640 1 -- 172.21.15.46:0/2569581016 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f0f88012040 con 0x55d328cab350 2024-09-21T03:58:35.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.567+0000 7f0f9e646740 1 -- 172.21.15.46:0/2569581016 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f88007a80 con 0x55d328cab350 2024-09-21T03:58:35.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.567+0000 7f0f797fa640 1 -- 172.21.15.46:0/2569581016 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0f8800a980 con 0x55d328cab350 2024-09-21T03:58:35.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.567+0000 7f0f9e646740 10 client.15999 fetch_fsmap learned FSMap version 20 2024-09-21T03:58:35.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.567+0000 7f0f9e646740 1 -- 172.21.15.46:0/2569581016 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55d32906cd40 con 0x55d328cab350 2024-09-21T03:58:35.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.567+0000 7f0f797fa640 1 -- 172.21.15.46:0/2569581016 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f88007a80 con 0x55d328cab350 2024-09-21T03:58:35.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.567+0000 7f0f797fa640 1 -- 172.21.15.46:0/2569581016 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f0f88016ac0 con 0x55d328cab350 2024-09-21T03:58:35.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.568+0000 7f0f9e646740 10 client.15999 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:58:35.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.568+0000 7f0f9e646740 10 client.15999 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:58:35.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.568+0000 7f0f9e646740 20 client.15999 populate_metadata read hostname 'smithi046' 2024-09-21T03:58:35.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.568+0000 7f0f9e646740 1 --2- 172.21.15.46:0/2569581016 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55d328c69cd0 0x55d3290700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:35.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.568+0000 7f0f9e646740 4 client.15999 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:58:35.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.568+0000 7f0f9e646740 1 -- 172.21.15.46:0/2569581016 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d328fcadb0 con 0x55d328c69cd0 2024-09-21T03:58:35.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.568+0000 7f0f95e6e640 1 --2- 172.21.15.46:0/2569581016 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55d328c69cd0 0x55d3290700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:35.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.568+0000 7f0f797fa640 10 client.15999 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:58:35.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.568+0000 7f0f95e6e640 1 --2- 172.21.15.46:0/2569581016 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55d328c69cd0 0x55d3290700a0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53a1424c318babff server_cookie=40c7c7e2f509f804 in_seq=0 out_seq=0 2024-09-21T03:58:35.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.569+0000 7f0f797fa640 1 -- 172.21.15.46:0/2569581016 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d328fcadb0 con 0x55d328c69cd0 2024-09-21T03:58:35.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.569+0000 7f0f797fa640 10 client.15999 handle_command_reply: tid=0 2024-09-21T03:58:35.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.569+0000 7f0f9e646740 1 client.15999 shutdown 2024-09-21T03:58:35.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.569+0000 7f0f9e646740 1 -- 172.21.15.46:0/2569581016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d328cab350 msgr2=0x55d329069f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:35.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.569+0000 7f0f9e646740 1 --2- 172.21.15.46:0/2569581016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d328cab350 0x55d329069f60 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f0f8800a570 tx=0x7f0f880076e0 comp rx=0 tx=0).stop 2024-09-21T03:58:35.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.569+0000 7f0f9e646740 1 -- 172.21.15.46:0/2569581016 shutdown_connections 2024-09-21T03:58:35.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.569+0000 7f0f9e646740 1 --2- 172.21.15.46:0/2569581016 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55d328c69cd0 0x55d3290700a0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:35.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.569+0000 7f0f9e646740 1 --2- 172.21.15.46:0/2569581016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d328cab350 0x55d329069f60 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:35.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.569+0000 7f0f9e646740 1 --2- 172.21.15.46:0/2569581016 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d328c8a670 0x55d32905e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:35.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.569+0000 7f0f797fa640 0 client.15999 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:58:35.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.569+0000 7f0f9e646740 1 --2- 172.21.15.46:0/2569581016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d328c82490 0x55d32905e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:35.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.569+0000 7f0f9e646740 1 -- 172.21.15.46:0/2569581016 >> 172.21.15.46:0/2569581016 conn(0x55d328c9f740 msgr2=0x55d329055610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:35.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.569+0000 7f0f9e646740 1 -- 172.21.15.46:0/2569581016 shutdown_connections 2024-09-21T03:58:35.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.570+0000 7f0f9e646740 1 -- 172.21.15.46:0/2569581016 wait complete. 2024-09-21T03:58:35.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.570+0000 7f0f9e646740 20 client.15999 trim_cache size 0 max 16384 2024-09-21T03:58:35.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.588+0000 7f0f9e646740 1 Processor -- start 2024-09-21T03:58:35.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.588+0000 7f0f9e646740 1 -- start start 2024-09-21T03:58:35.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.588+0000 7f0f9e646740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d328c82490 0x55d329069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:35.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.588+0000 7f0f9e646740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d328c8a670 0x55d32905d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:35.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.588+0000 7f0f9e646740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d328cab350 0x55d329057510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:35.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.588+0000 7f0f9e646740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0f901ad5b0 con 0x55d328c8a670 2024-09-21T03:58:35.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.588+0000 7f0f9e646740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0f901afe50 con 0x55d328c82490 2024-09-21T03:58:35.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.588+0000 7f0f9e646740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0f901adc40 con 0x55d328cab350 2024-09-21T03:58:35.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.588+0000 7f0f9566d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d328c8a670 0x55d32905d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:35.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.588+0000 7f0f9566d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d328c8a670 0x55d32905d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42898/0 (socket says 172.21.15.46:42898) 2024-09-21T03:58:35.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.588+0000 7f0f9566d640 1 -- 172.21.15.46:0/406437669 learned_addr learned my addr 172.21.15.46:0/406437669 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:35.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.588+0000 7f0f9666f640 1 --2- 172.21.15.46:0/406437669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d328cab350 0x55d329057510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:35.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.588+0000 7f0f95e6e640 1 --2- 172.21.15.46:0/406437669 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d328c82490 0x55d329069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:35.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.588+0000 7f0f9566d640 1 -- 172.21.15.46:0/406437669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d328cab350 msgr2=0x55d329057510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:35.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.588+0000 7f0f9566d640 1 --2- 172.21.15.46:0/406437669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d328cab350 0x55d329057510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:35.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.588+0000 7f0f9566d640 1 -- 172.21.15.46:0/406437669 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d328c82490 msgr2=0x55d329069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:35.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.588+0000 7f0f9566d640 1 --2- 172.21.15.46:0/406437669 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d328c82490 0x55d329069ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:35.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.589+0000 7f0f9566d640 1 -- 172.21.15.46:0/406437669 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3290552d0 con 0x55d328c8a670 2024-09-21T03:58:35.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.589+0000 7f0f95e6e640 1 --2- 172.21.15.46:0/406437669 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d328c82490 0x55d329069ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:58:35.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.589+0000 7f0f9566d640 1 --2- 172.21.15.46:0/406437669 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d328c8a670 0x55d32905d6e0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f0f801054a0 tx=0x7f0f800c9aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90785f335b853f1f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:35.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.589+0000 7f0f7b7fe640 1 -- 172.21.15.46:0/406437669 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f80049070 con 0x55d328c8a670 2024-09-21T03:58:35.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.589+0000 7f0f7b7fe640 1 -- 172.21.15.46:0/406437669 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f800cd650 con 0x55d328c8a670 2024-09-21T03:58:35.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.589+0000 7f0f7b7fe640 1 -- 172.21.15.46:0/406437669 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f800d7560 con 0x55d328c8a670 2024-09-21T03:58:35.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.590+0000 7f0f9e646740 1 -- 172.21.15.46:0/406437669 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d328c8a670 msgr2=0x55d32905d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:35.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.590+0000 7f0f9e646740 1 --2- 172.21.15.46:0/406437669 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d328c8a670 0x55d32905d6e0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f0f801054a0 tx=0x7f0f800c9aa0 comp rx=0 tx=0).stop 2024-09-21T03:58:35.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.590+0000 7f0f9e646740 1 -- 172.21.15.46:0/406437669 shutdown_connections 2024-09-21T03:58:35.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.590+0000 7f0f9e646740 1 --2- 172.21.15.46:0/406437669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d328cab350 0x55d329057510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:35.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.590+0000 7f0f9e646740 1 --2- 172.21.15.46:0/406437669 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d328c8a670 0x55d32905d6e0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:35.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.590+0000 7f0f9e646740 1 --2- 172.21.15.46:0/406437669 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d328c82490 0x55d329069ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:35.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.590+0000 7f0f9e646740 1 -- 172.21.15.46:0/406437669 >> 172.21.15.46:0/406437669 conn(0x55d328c9f740 msgr2=0x55d329055ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:35.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.590+0000 7f0f9e646740 1 -- 172.21.15.46:0/406437669 shutdown_connections 2024-09-21T03:58:35.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.590+0000 7f0f9e646740 1 -- 172.21.15.46:0/406437669 wait complete. 2024-09-21T03:58:35.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.590+0000 7f0f9e646740 1 -- start start 2024-09-21T03:58:35.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.590+0000 7f0f9e646740 1 Processor -- start 2024-09-21T03:58:35.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.591+0000 7f0f9e646740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d328c82490 0x55d32906fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:35.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.591+0000 7f0f9e646740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d328c8a670 0x55d329070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:35.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.591+0000 7f0f9e646740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d328cab350 0x55d3290d37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:35.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.591+0000 7f0f9e646740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0f901ae310 con 0x55d328c8a670 2024-09-21T03:58:35.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.591+0000 7f0f9e646740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0f901af780 con 0x55d328c82490 2024-09-21T03:58:35.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.591+0000 7f0f9e646740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0f901ae9e0 con 0x55d328cab350 2024-09-21T03:58:35.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.591+0000 7f0f9e646740 10 client.0 _ll_register_callbacks cb 0x7f0f88009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:58:35.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.591+0000 7f0f9566d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d328c8a670 0x55d329070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:35.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.591+0000 7f0f9566d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d328c8a670 0x55d329070070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42912/0 (socket says 172.21.15.46:42912) 2024-09-21T03:58:35.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.591+0000 7f0f9566d640 1 -- 172.21.15.46:0/2274006211 learned_addr learned my addr 172.21.15.46:0/2274006211 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:35.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.591+0000 7f0f95e6e640 1 --2- 172.21.15.46:0/2274006211 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d328c82490 0x55d32906fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:35.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.591+0000 7f0f9666f640 1 --2- 172.21.15.46:0/2274006211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d328cab350 0x55d3290d37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:35.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.591+0000 7f0f9566d640 1 -- 172.21.15.46:0/2274006211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d328cab350 msgr2=0x55d3290d37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:35.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.591+0000 7f0f9566d640 1 --2- 172.21.15.46:0/2274006211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d328cab350 0x55d3290d37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:35.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.591+0000 7f0f9566d640 1 -- 172.21.15.46:0/2274006211 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d328c82490 msgr2=0x55d32906fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:35.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.591+0000 7f0f9566d640 1 --2- 172.21.15.46:0/2274006211 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d328c82490 0x55d32906fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:35.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.591+0000 7f0f9566d640 1 -- 172.21.15.46:0/2274006211 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3290d3e50 con 0x55d328c8a670 2024-09-21T03:58:35.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.591+0000 7f0f95e6e640 1 --2- 172.21.15.46:0/2274006211 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d328c82490 0x55d32906fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:58:35.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.591+0000 7f0f9666f640 1 --2- 172.21.15.46:0/2274006211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d328cab350 0x55d3290d37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:58:35.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.592+0000 7f0f9566d640 1 --2- 172.21.15.46:0/2274006211 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d328c8a670 0x55d329070070 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0f80031440 tx=0x7f0f800c9b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e0b4a5db6525c1d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:35.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.592+0000 7f0f797fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:58:35.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.592+0000 7f0f797fa640 1 -- 172.21.15.46:0/2274006211 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f800d2070 con 0x55d328c8a670 2024-09-21T03:58:35.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.592+0000 7f0f9e646740 1 -- 172.21.15.46:0/2274006211 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f800cd650 con 0x55d328c8a670 2024-09-21T03:58:35.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.592+0000 7f0f797fa640 1 -- 172.21.15.46:0/2274006211 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f0f800d2210 con 0x55d328c8a670 2024-09-21T03:58:35.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.592+0000 7f0f797fa640 1 -- 172.21.15.46:0/2274006211 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0f80049070 con 0x55d328c8a670 2024-09-21T03:58:35.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.592+0000 7f0f9e646740 10 client.16005 fetch_fsmap learned FSMap version 20 2024-09-21T03:58:35.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.592+0000 7f0f9e646740 1 -- 172.21.15.46:0/2274006211 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55d3290db1d0 con 0x55d328c8a670 2024-09-21T03:58:35.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.592+0000 7f0f797fa640 1 -- 172.21.15.46:0/2274006211 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f800cd650 con 0x55d328c8a670 2024-09-21T03:58:35.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.592+0000 7f0f797fa640 1 -- 172.21.15.46:0/2274006211 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f0f8003bbe0 con 0x55d328c8a670 2024-09-21T03:58:35.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.592+0000 7f0f9e646740 10 client.16005 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:58:35.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.592+0000 7f0f9e646740 10 client.16005 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:58:35.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.592+0000 7f0f9e646740 20 client.16005 populate_metadata read hostname 'smithi046' 2024-09-21T03:58:35.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.592+0000 7f0f9e646740 1 --2- 172.21.15.46:0/2274006211 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55d328c3f080 0x55d3290dd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:35.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.592+0000 7f0f9e646740 4 client.16005 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:58:35.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.592+0000 7f0f9e646740 1 -- 172.21.15.46:0/2274006211 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d328fc6860 con 0x55d328c3f080 2024-09-21T03:58:35.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.593+0000 7f0f95e6e640 1 --2- 172.21.15.46:0/2274006211 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55d328c3f080 0x55d3290dd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:35.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.593+0000 7f0f95e6e640 1 --2- 172.21.15.46:0/2274006211 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55d328c3f080 0x55d3290dd880 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=918c65bc6aa73ed4 server_cookie=e8f041af47134aa8 in_seq=0 out_seq=0 2024-09-21T03:58:35.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.593+0000 7f0f797fa640 10 client.16005 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:58:35.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.595+0000 7f0f797fa640 1 -- 172.21.15.46:0/2274006211 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d328fc6860 con 0x55d328c3f080 2024-09-21T03:58:35.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.595+0000 7f0f797fa640 10 client.16005 handle_command_reply: tid=0 2024-09-21T03:58:35.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.595+0000 7f0f9e646740 1 client.16005 shutdown 2024-09-21T03:58:35.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.595+0000 7f0f9e646740 1 -- 172.21.15.46:0/2274006211 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d328c8a670 msgr2=0x55d329070070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:35.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.595+0000 7f0f9e646740 1 --2- 172.21.15.46:0/2274006211 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d328c8a670 0x55d329070070 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0f80031440 tx=0x7f0f800c9b10 comp rx=0 tx=0).stop 2024-09-21T03:58:35.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.595+0000 7f0f9e646740 1 -- 172.21.15.46:0/2274006211 shutdown_connections 2024-09-21T03:58:35.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.595+0000 7f0f9e646740 1 --2- 172.21.15.46:0/2274006211 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55d328c3f080 0x55d3290dd880 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:35.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.595+0000 7f0f9e646740 1 --2- 172.21.15.46:0/2274006211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d328cab350 0x55d3290d37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:35.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.595+0000 7f0f9e646740 1 --2- 172.21.15.46:0/2274006211 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d328c8a670 0x55d329070070 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:35.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.595+0000 7f0f9e646740 1 --2- 172.21.15.46:0/2274006211 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d328c82490 0x55d32906fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:35.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.595+0000 7f0f9e646740 1 -- 172.21.15.46:0/2274006211 >> 172.21.15.46:0/2274006211 conn(0x55d328c9f740 msgr2=0x55d329055ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:35.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.595+0000 7f0f797fa640 0 client.16005 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:58:35.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.595+0000 7f0f9e646740 1 -- 172.21.15.46:0/2274006211 shutdown_connections 2024-09-21T03:58:35.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.595+0000 7f0f9e646740 1 -- 172.21.15.46:0/2274006211 wait complete. 2024-09-21T03:58:35.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.595+0000 7f0f9e646740 20 client.16005 trim_cache size 0 max 16384 2024-09-21T03:58:35.602 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T03:58:35.602 INFO:teuthology.orchestra.run.smithi046.stdout: "return_code": 0, 2024-09-21T03:58:35.602 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_tag": "6103c660-8e77-4b06-ad6c-bb322c26035a", 2024-09-21T03:58:35.602 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": "asynchronous" 2024-09-21T03:58:35.602 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T03:58:35.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.596+0000 7f0f980d2640 1 -- 172.21.15.46:0/3082791900 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f0f7c0b6700 msgr2=0x7f0f7c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:35.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.596+0000 7f0f980d2640 1 --2- 172.21.15.46:0/3082791900 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f0f7c0b6700 0x7f0f7c0b8c10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x55d3290510b0 tx=0x7f0f8c00a2d0 comp rx=0 tx=0).stop 2024-09-21T03:58:35.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.596+0000 7f0f980d2640 1 -- 172.21.15.46:0/3082791900 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f901094c0 msgr2=0x7f0f9019aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:35.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.596+0000 7f0f980d2640 1 --2- 172.21.15.46:0/3082791900 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f901094c0 0x7f0f9019aa80 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f0f8002a930 tx=0x7f0f80004270 comp rx=0 tx=0).stop 2024-09-21T03:58:35.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.596+0000 7f0f980d2640 1 -- 172.21.15.46:0/3082791900 shutdown_connections 2024-09-21T03:58:35.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.596+0000 7f0f980d2640 1 --2- 172.21.15.46:0/3082791900 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f90109e10 0x7f0f9019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:35.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.596+0000 7f0f980d2640 1 --2- 172.21.15.46:0/3082791900 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f901094c0 0x7f0f9019aa80 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:35.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.596+0000 7f0f980d2640 1 --2- 172.21.15.46:0/3082791900 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f0f7c0b6700 0x7f0f7c0b8c10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:35.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.596+0000 7f0f980d2640 1 --2- 172.21.15.46:0/3082791900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f90103b80 0x7f0f9019a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:35.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.596+0000 7f0f980d2640 1 -- 172.21.15.46:0/3082791900 >> 172.21.15.46:0/3082791900 conn(0x7f0f900ff610 msgr2=0x7f0f90101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:35.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.596+0000 7f0f980d2640 1 -- 172.21.15.46:0/3082791900 shutdown_connections 2024-09-21T03:58:35.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:35.596+0000 7f0f980d2640 1 -- 172.21.15.46:0/3082791900 wait complete. 2024-09-21T03:58:36.189 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:35 smithi046 ceph-mon[30954]: pgmap v426: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T03:58:36.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:35 smithi105 ceph-mon[34773]: pgmap v426: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T03:58:36.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:35 smithi162 ceph-mon[35071]: pgmap v426: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T03:58:36.400 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:58:36.658 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:58:37.091 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:36 smithi046 ceph-mon[30954]: scrub queued for path: / 2024-09-21T03:58:37.091 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:36 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T03:58:37.091 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:36 smithi046 ceph-mon[30954]: scrub summary: active paths [/] 2024-09-21T03:58:37.091 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:36 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T03:58:37.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.183+0000 7f2b7c256640 1 -- 172.21.15.46:0/3728823754 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b74102650 msgr2=0x7f2b74102a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:37.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.183+0000 7f2b7c256640 1 --2- 172.21.15.46:0/3728823754 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b74102650 0x7f2b74102a60 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f2b70009900 tx=0x7f2b7002a480 comp rx=0 tx=0).stop 2024-09-21T03:58:37.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.183+0000 7f2b7c256640 1 -- 172.21.15.46:0/3728823754 shutdown_connections 2024-09-21T03:58:37.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.183+0000 7f2b7c256640 1 --2- 172.21.15.46:0/3728823754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b74110200 0x7f2b74112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:37.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.183+0000 7f2b7c256640 1 --2- 172.21.15.46:0/3728823754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b74102fa0 0x7f2b7410fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:37.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.183+0000 7f2b7c256640 1 --2- 172.21.15.46:0/3728823754 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b74102650 0x7f2b74102a60 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:37.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.183+0000 7f2b7c256640 1 -- 172.21.15.46:0/3728823754 >> 172.21.15.46:0/3728823754 conn(0x7f2b74079760 msgr2=0x7f2b74079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:37.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.183+0000 7f2b7c256640 1 -- 172.21.15.46:0/3728823754 shutdown_connections 2024-09-21T03:58:37.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.183+0000 7f2b7c256640 1 -- 172.21.15.46:0/3728823754 wait complete. 2024-09-21T03:58:37.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.184+0000 7f2b7c256640 1 Processor -- start 2024-09-21T03:58:37.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.184+0000 7f2b7c256640 1 -- start start 2024-09-21T03:58:37.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.184+0000 7f2b7c256640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b74102650 0x7f2b7419c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:37.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.184+0000 7f2b7c256640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b74102fa0 0x7f2b7419cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:37.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.184+0000 7f2b7c256640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b74110200 0x7f2b741a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:37.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.184+0000 7f2b7c256640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2b74115ca0 con 0x7f2b74102fa0 2024-09-21T03:58:37.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.184+0000 7f2b7c256640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2b74115b20 con 0x7f2b74102650 2024-09-21T03:58:37.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.184+0000 7f2b7c256640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2b74115e20 con 0x7f2b74110200 2024-09-21T03:58:37.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.184+0000 7f2b797f1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b74102fa0 0x7f2b7419cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:37.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.184+0000 7f2b797f1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b74102fa0 0x7f2b7419cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42928/0 (socket says 172.21.15.46:42928) 2024-09-21T03:58:37.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.184+0000 7f2b797f1640 1 -- 172.21.15.46:0/2061537414 learned_addr learned my addr 172.21.15.46:0/2061537414 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:37.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.184+0000 7f2b79ff2640 1 --2- 172.21.15.46:0/2061537414 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b74102650 0x7f2b7419c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:37.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.184+0000 7f2b7a7f3640 1 --2- 172.21.15.46:0/2061537414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b74110200 0x7f2b741a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:37.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.185+0000 7f2b797f1640 1 -- 172.21.15.46:0/2061537414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b74110200 msgr2=0x7f2b741a1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:37.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.185+0000 7f2b797f1640 1 --2- 172.21.15.46:0/2061537414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b74110200 0x7f2b741a1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:37.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.185+0000 7f2b797f1640 1 -- 172.21.15.46:0/2061537414 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b74102650 msgr2=0x7f2b7419c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:37.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.185+0000 7f2b797f1640 1 --2- 172.21.15.46:0/2061537414 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b74102650 0x7f2b7419c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:37.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.185+0000 7f2b797f1640 1 -- 172.21.15.46:0/2061537414 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b741a25e0 con 0x7f2b74102fa0 2024-09-21T03:58:37.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.185+0000 7f2b7a7f3640 1 --2- 172.21.15.46:0/2061537414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b74110200 0x7f2b741a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:58:37.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.185+0000 7f2b797f1640 1 --2- 172.21.15.46:0/2061537414 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b74102fa0 0x7f2b7419cc10 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f2b6400e9f0 tx=0x7f2b6400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:37.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.185+0000 7f2b6affd640 1 -- 172.21.15.46:0/2061537414 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6400cd80 con 0x7f2b74102fa0 2024-09-21T03:58:37.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.185+0000 7f2b7c256640 1 -- 172.21.15.46:0/2061537414 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b741a28d0 con 0x7f2b74102fa0 2024-09-21T03:58:37.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.185+0000 7f2b6affd640 1 -- 172.21.15.46:0/2061537414 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b640108e0 con 0x7f2b74102fa0 2024-09-21T03:58:37.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.185+0000 7f2b6affd640 1 -- 172.21.15.46:0/2061537414 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b64018980 con 0x7f2b74102fa0 2024-09-21T03:58:37.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.185+0000 7f2b7c256640 1 -- 172.21.15.46:0/2061537414 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b741a9030 con 0x7f2b74102fa0 2024-09-21T03:58:37.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.188+0000 7f2b827ca740 1 Processor -- start 2024-09-21T03:58:37.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.188+0000 7f2b827ca740 1 -- start start 2024-09-21T03:58:37.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.188+0000 7f2b6affd640 1 -- 172.21.15.46:0/2061537414 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f2b64010430 con 0x7f2b74102fa0 2024-09-21T03:58:37.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.188+0000 7f2b827ca740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586edb67070 0x5586edf0e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:37.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.188+0000 7f2b827ca740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586edb3e1b0 0x5586edf0eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:37.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.188+0000 7f2b827ca740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586edb46390 0x5586edf0f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:37.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.188+0000 7f2b827ca740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5586ede84e50 con 0x5586edb3e1b0 2024-09-21T03:58:37.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.188+0000 7f2b827ca740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5586ede74280 con 0x5586edb67070 2024-09-21T03:58:37.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.188+0000 7f2b827ca740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5586ede78090 con 0x5586edb46390 2024-09-21T03:58:37.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.188+0000 7f2b79ff2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586edb3e1b0 0x5586edf0eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:37.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.188+0000 7f2b79ff2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586edb3e1b0 0x5586edf0eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42934/0 (socket says 172.21.15.46:42934) 2024-09-21T03:58:37.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.188+0000 7f2b79ff2640 1 -- 172.21.15.46:0/3290174356 learned_addr learned my addr 172.21.15.46:0/3290174356 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:37.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.189+0000 7f2b7a7f3640 1 --2- 172.21.15.46:0/3290174356 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586edb67070 0x5586edf0e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:37.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.189+0000 7f2b797f1640 1 --2- 172.21.15.46:0/3290174356 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586edb46390 0x5586edf0f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:37.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.189+0000 7f2b79ff2640 1 -- 172.21.15.46:0/3290174356 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586edb46390 msgr2=0x5586edf0f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:37.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.189+0000 7f2b79ff2640 1 --2- 172.21.15.46:0/3290174356 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586edb46390 0x5586edf0f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:37.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.189+0000 7f2b79ff2640 1 -- 172.21.15.46:0/3290174356 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586edb67070 msgr2=0x5586edf0e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:37.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.189+0000 7f2b79ff2640 1 --2- 172.21.15.46:0/3290174356 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586edb67070 0x5586edf0e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:37.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.189+0000 7f2b79ff2640 1 -- 172.21.15.46:0/3290174356 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586edbd2650 con 0x5586edb3e1b0 2024-09-21T03:58:37.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.189+0000 7f2b79ff2640 1 --2- 172.21.15.46:0/3290174356 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586edb3e1b0 0x5586edf0eb90 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f2b70009900 tx=0x7f2b70032cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e2cc865038f9e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:37.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.189+0000 7f2b6affd640 1 --2- 172.21.15.46:0/2061537414 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f2b600b6680 0x7f2b600b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:37.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.189+0000 7f2b5ffff640 1 -- 172.21.15.46:0/3290174356 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b70040070 con 0x5586edb3e1b0 2024-09-21T03:58:37.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.189+0000 7f2b7a7f3640 1 --2- 172.21.15.46:0/2061537414 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f2b600b6680 0x7f2b600b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:37.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.189+0000 7f2b6affd640 1 -- 172.21.15.46:0/2061537414 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f2b640e7a60 con 0x7f2b74102fa0 2024-09-21T03:58:37.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.189+0000 7f2b5ffff640 1 -- 172.21.15.46:0/3290174356 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b700316a0 con 0x5586edb3e1b0 2024-09-21T03:58:37.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.189+0000 7f2b5ffff640 1 -- 172.21.15.46:0/3290174356 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b70035040 con 0x5586edb3e1b0 2024-09-21T03:58:37.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.190+0000 7f2b827ca740 1 -- 172.21.15.46:0/3290174356 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586edb3e1b0 msgr2=0x5586edf0eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:37.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.190+0000 7f2b7a7f3640 1 --2- 172.21.15.46:0/2061537414 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f2b600b6680 0x7f2b600b8b90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c005fd0 tx=0x7f2b6c008630 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:37.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.190+0000 7f2b827ca740 1 --2- 172.21.15.46:0/3290174356 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586edb3e1b0 0x5586edf0eb90 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f2b70009900 tx=0x7f2b70032cd0 comp rx=0 tx=0).stop 2024-09-21T03:58:37.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.190+0000 7f2b827ca740 1 -- 172.21.15.46:0/3290174356 shutdown_connections 2024-09-21T03:58:37.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.190+0000 7f2b827ca740 1 --2- 172.21.15.46:0/3290174356 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586edb46390 0x5586edf0f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:37.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.190+0000 7f2b827ca740 1 --2- 172.21.15.46:0/3290174356 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586edb3e1b0 0x5586edf0eb90 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:37.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.190+0000 7f2b827ca740 1 --2- 172.21.15.46:0/3290174356 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586edb67070 0x5586edf0e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:37.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.190+0000 7f2b827ca740 1 -- 172.21.15.46:0/3290174356 >> 172.21.15.46:0/3290174356 conn(0x5586edb5b460 msgr2=0x5586edf0c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:37.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.191+0000 7f2b827ca740 1 -- 172.21.15.46:0/3290174356 shutdown_connections 2024-09-21T03:58:37.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.191+0000 7f2b827ca740 1 -- 172.21.15.46:0/3290174356 wait complete. 2024-09-21T03:58:37.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.191+0000 7f2b827ca740 1 -- start start 2024-09-21T03:58:37.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.191+0000 7f2b827ca740 1 Processor -- start 2024-09-21T03:58:37.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.191+0000 7f2b827ca740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586edb3e1b0 0x5586edf19cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:37.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.192+0000 7f2b827ca740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586edb46390 0x5586edf1a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:37.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.192+0000 7f2b827ca740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586edb67070 0x5586edf1a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:37.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.192+0000 7f2b827ca740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5586edcd5700 con 0x5586edb46390 2024-09-21T03:58:37.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.192+0000 7f2b827ca740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5586ede0f110 con 0x5586edb67070 2024-09-21T03:58:37.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.192+0000 7f2b827ca740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5586edf1cdd0 con 0x5586edb3e1b0 2024-09-21T03:58:37.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.192+0000 7f2b827ca740 10 client.0 _ll_register_callbacks cb 0x5586ede28990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:58:37.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.192+0000 7f2b797f1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586edb46390 0x5586edf1a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:37.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.192+0000 7f2b797f1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586edb46390 0x5586edf1a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42940/0 (socket says 172.21.15.46:42940) 2024-09-21T03:58:37.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.192+0000 7f2b797f1640 1 -- 172.21.15.46:0/592602603 learned_addr learned my addr 172.21.15.46:0/592602603 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:37.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.192+0000 7f2b79ff2640 1 --2- 172.21.15.46:0/592602603 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586edb3e1b0 0x5586edf19cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:37.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.192+0000 7f2b7a7f3640 1 --2- 172.21.15.46:0/592602603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586edb67070 0x5586edf1a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:37.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.192+0000 7f2b797f1640 1 -- 172.21.15.46:0/592602603 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586edb3e1b0 msgr2=0x5586edf19cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:37.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.192+0000 7f2b797f1640 1 --2- 172.21.15.46:0/592602603 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586edb3e1b0 0x5586edf19cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:37.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.192+0000 7f2b797f1640 1 -- 172.21.15.46:0/592602603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586edb67070 msgr2=0x5586edf1a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:37.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.192+0000 7f2b797f1640 1 --2- 172.21.15.46:0/592602603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586edb67070 0x5586edf1a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:37.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.192+0000 7f2b797f1640 1 -- 172.21.15.46:0/592602603 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586ede3cc40 con 0x5586edb46390 2024-09-21T03:58:37.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.192+0000 7f2b797f1640 1 --2- 172.21.15.46:0/592602603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586edb46390 0x5586edf1a230 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f2b6400c6a0 tx=0x7f2b640a98b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f7788cfe3c583c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:37.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.192+0000 7f2b5d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:58:37.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.192+0000 7f2b5d7fa640 1 -- 172.21.15.46:0/592602603 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b640ad2a0 con 0x5586edb46390 2024-09-21T03:58:37.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.193+0000 7f2b5d7fa640 1 -- 172.21.15.46:0/592602603 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f2b64018d20 con 0x5586edb46390 2024-09-21T03:58:37.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.193+0000 7f2b827ca740 1 -- 172.21.15.46:0/592602603 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b700316a0 con 0x5586edb46390 2024-09-21T03:58:37.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.193+0000 7f2b5d7fa640 1 -- 172.21.15.46:0/592602603 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2b640e56e0 con 0x5586edb46390 2024-09-21T03:58:37.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.193+0000 7f2b827ca740 10 client.16017 fetch_fsmap learned FSMap version 20 2024-09-21T03:58:37.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.193+0000 7f2b827ca740 1 -- 172.21.15.46:0/592602603 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5586edf28aa0 con 0x5586edb46390 2024-09-21T03:58:37.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.193+0000 7f2b5d7fa640 1 -- 172.21.15.46:0/592602603 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b700316a0 con 0x5586edb46390 2024-09-21T03:58:37.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.193+0000 7f2b5d7fa640 1 -- 172.21.15.46:0/592602603 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f2b640b2080 con 0x5586edb46390 2024-09-21T03:58:37.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.193+0000 7f2b827ca740 10 client.16017 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:58:37.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.193+0000 7f2b827ca740 10 client.16017 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:58:37.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.193+0000 7f2b827ca740 20 client.16017 populate_metadata read hostname 'smithi046' 2024-09-21T03:58:37.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.193+0000 7f2b827ca740 1 --2- 172.21.15.46:0/592602603 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5586edb259f0 0x5586edf2bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:37.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.193+0000 7f2b827ca740 4 client.16017 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:58:37.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.193+0000 7f2b827ca740 1 -- 172.21.15.46:0/592602603 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586ede86da0 con 0x5586edb259f0 2024-09-21T03:58:37.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.193+0000 7f2b79ff2640 1 --2- 172.21.15.46:0/592602603 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5586edb259f0 0x5586edf2bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:37.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.194+0000 7f2b79ff2640 1 --2- 172.21.15.46:0/592602603 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5586edb259f0 0x5586edf2bfa0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b2fa3ce9c9a5f81 server_cookie=37d6eb539e8c7d36 in_seq=0 out_seq=0 2024-09-21T03:58:37.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.194+0000 7f2b5d7fa640 10 client.16017 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:58:37.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.195+0000 7f2b5d7fa640 1 -- 172.21.15.46:0/592602603 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5586ede86da0 con 0x5586edb259f0 2024-09-21T03:58:37.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.195+0000 7f2b5d7fa640 10 client.16017 handle_command_reply: tid=0 2024-09-21T03:58:37.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.195+0000 7f2b827ca740 1 client.16017 shutdown 2024-09-21T03:58:37.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.195+0000 7f2b827ca740 1 -- 172.21.15.46:0/592602603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586edb46390 msgr2=0x5586edf1a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:37.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.195+0000 7f2b827ca740 1 --2- 172.21.15.46:0/592602603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586edb46390 0x5586edf1a230 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f2b6400c6a0 tx=0x7f2b640a98b0 comp rx=0 tx=0).stop 2024-09-21T03:58:37.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.195+0000 7f2b827ca740 1 -- 172.21.15.46:0/592602603 shutdown_connections 2024-09-21T03:58:37.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.195+0000 7f2b827ca740 1 --2- 172.21.15.46:0/592602603 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5586edb259f0 0x5586edf2bfa0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:37.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.195+0000 7f2b827ca740 1 --2- 172.21.15.46:0/592602603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586edb67070 0x5586edf1a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:37.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.195+0000 7f2b827ca740 1 --2- 172.21.15.46:0/592602603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586edb46390 0x5586edf1a230 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:37.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.195+0000 7f2b5d7fa640 0 client.16017 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:58:37.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.195+0000 7f2b827ca740 1 --2- 172.21.15.46:0/592602603 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586edb3e1b0 0x5586edf19cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:37.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.195+0000 7f2b827ca740 1 -- 172.21.15.46:0/592602603 >> 172.21.15.46:0/592602603 conn(0x5586edb5b460 msgr2=0x5586edf117e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:37.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.195+0000 7f2b827ca740 1 -- 172.21.15.46:0/592602603 shutdown_connections 2024-09-21T03:58:37.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.195+0000 7f2b827ca740 1 -- 172.21.15.46:0/592602603 wait complete. 2024-09-21T03:58:37.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.195+0000 7f2b827ca740 20 client.16017 trim_cache size 0 max 16384 2024-09-21T03:58:37.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.213+0000 7f2b827ca740 1 Processor -- start 2024-09-21T03:58:37.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.213+0000 7f2b827ca740 1 -- start start 2024-09-21T03:58:37.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.213+0000 7f2b827ca740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586edb3e1b0 0x5586edf1bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:37.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.213+0000 7f2b827ca740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586edb46390 0x5586edf16ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:37.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.213+0000 7f2b827ca740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586edb67070 0x5586edf17420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:37.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.213+0000 7f2b827ca740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2b741af680 con 0x5586edb46390 2024-09-21T03:58:37.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.213+0000 7f2b827ca740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2b741b1f20 con 0x5586edb3e1b0 2024-09-21T03:58:37.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.213+0000 7f2b827ca740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2b741afd10 con 0x5586edb67070 2024-09-21T03:58:37.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.213+0000 7f2b797f1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586edb46390 0x5586edf16ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:37.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.213+0000 7f2b797f1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586edb46390 0x5586edf16ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42954/0 (socket says 172.21.15.46:42954) 2024-09-21T03:58:37.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.213+0000 7f2b797f1640 1 -- 172.21.15.46:0/2662446868 learned_addr learned my addr 172.21.15.46:0/2662446868 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:37.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.213+0000 7f2b7a7f3640 1 --2- 172.21.15.46:0/2662446868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586edb67070 0x5586edf17420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:37.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.213+0000 7f2b79ff2640 1 --2- 172.21.15.46:0/2662446868 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586edb3e1b0 0x5586edf1bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:37.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.213+0000 7f2b797f1640 1 -- 172.21.15.46:0/2662446868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586edb67070 msgr2=0x5586edf17420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:37.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.213+0000 7f2b797f1640 1 --2- 172.21.15.46:0/2662446868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586edb67070 0x5586edf17420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:37.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.213+0000 7f2b797f1640 1 -- 172.21.15.46:0/2662446868 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586edb3e1b0 msgr2=0x5586edf1bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:37.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.213+0000 7f2b797f1640 1 --2- 172.21.15.46:0/2662446868 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586edb3e1b0 0x5586edf1bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:37.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.213+0000 7f2b797f1640 1 -- 172.21.15.46:0/2662446868 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586edf0d300 con 0x5586edb46390 2024-09-21T03:58:37.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.214+0000 7f2b797f1640 1 --2- 172.21.15.46:0/2662446868 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586edb46390 0x5586edf16ee0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f2b640a9f20 tx=0x7f2b640a9920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c41f19419aed2b18 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:37.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.214+0000 7f2b5f7fe640 1 -- 172.21.15.46:0/2662446868 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b640a90c0 con 0x5586edb46390 2024-09-21T03:58:37.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.214+0000 7f2b5f7fe640 1 -- 172.21.15.46:0/2662446868 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b64098030 con 0x5586edb46390 2024-09-21T03:58:37.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.214+0000 7f2b5f7fe640 1 -- 172.21.15.46:0/2662446868 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b640ad0c0 con 0x5586edb46390 2024-09-21T03:58:37.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.214+0000 7f2b827ca740 1 -- 172.21.15.46:0/2662446868 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586edb46390 msgr2=0x5586edf16ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:37.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.214+0000 7f2b827ca740 1 --2- 172.21.15.46:0/2662446868 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586edb46390 0x5586edf16ee0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f2b640a9f20 tx=0x7f2b640a9920 comp rx=0 tx=0).stop 2024-09-21T03:58:37.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.215+0000 7f2b827ca740 1 -- 172.21.15.46:0/2662446868 shutdown_connections 2024-09-21T03:58:37.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.215+0000 7f2b827ca740 1 --2- 172.21.15.46:0/2662446868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586edb67070 0x5586edf17420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:37.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.215+0000 7f2b827ca740 1 --2- 172.21.15.46:0/2662446868 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586edb46390 0x5586edf16ee0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:37.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.215+0000 7f2b827ca740 1 --2- 172.21.15.46:0/2662446868 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586edb3e1b0 0x5586edf1bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:37.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.215+0000 7f2b827ca740 1 -- 172.21.15.46:0/2662446868 >> 172.21.15.46:0/2662446868 conn(0x5586edb5b460 msgr2=0x5586edf10040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:37.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.215+0000 7f2b827ca740 1 -- 172.21.15.46:0/2662446868 shutdown_connections 2024-09-21T03:58:37.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.215+0000 7f2b827ca740 1 -- 172.21.15.46:0/2662446868 wait complete. 2024-09-21T03:58:37.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.215+0000 7f2b827ca740 1 -- start start 2024-09-21T03:58:37.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.215+0000 7f2b827ca740 1 Processor -- start 2024-09-21T03:58:37.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.216+0000 7f2b827ca740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586edb3e1b0 0x5586edf228e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:37.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.216+0000 7f2b827ca740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586edb46390 0x5586edf1dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:37.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.216+0000 7f2b827ca740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586edb67070 0x5586edf1e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:37.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.216+0000 7f2b827ca740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2b741b03e0 con 0x5586edb3e1b0 2024-09-21T03:58:37.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.216+0000 7f2b827ca740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2b741b1850 con 0x5586edb67070 2024-09-21T03:58:37.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.216+0000 7f2b827ca740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2b741b0ab0 con 0x5586edb46390 2024-09-21T03:58:37.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.216+0000 7f2b827ca740 10 client.0 _ll_register_callbacks cb 0x7f2b640ec040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:58:37.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.216+0000 7f2b79ff2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586edb3e1b0 0x5586edf228e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:37.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.216+0000 7f2b79ff2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586edb3e1b0 0x5586edf228e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42966/0 (socket says 172.21.15.46:42966) 2024-09-21T03:58:37.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.216+0000 7f2b79ff2640 1 -- 172.21.15.46:0/3124660092 learned_addr learned my addr 172.21.15.46:0/3124660092 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:58:37.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.216+0000 7f2b7a7f3640 1 --2- 172.21.15.46:0/3124660092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586edb67070 0x5586edf1e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:37.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.216+0000 7f2b797f1640 1 --2- 172.21.15.46:0/3124660092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586edb46390 0x5586edf1dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:37.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.216+0000 7f2b79ff2640 1 -- 172.21.15.46:0/3124660092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586edb46390 msgr2=0x5586edf1dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:37.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.216+0000 7f2b79ff2640 1 --2- 172.21.15.46:0/3124660092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586edb46390 0x5586edf1dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:37.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.216+0000 7f2b79ff2640 1 -- 172.21.15.46:0/3124660092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586edb67070 msgr2=0x5586edf1e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:58:37.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.216+0000 7f2b79ff2640 1 --2- 172.21.15.46:0/3124660092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586edb67070 0x5586edf1e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:37.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.216+0000 7f2b79ff2640 1 -- 172.21.15.46:0/3124660092 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586edf1eb50 con 0x5586edb3e1b0 2024-09-21T03:58:37.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.216+0000 7f2b797f1640 1 --2- 172.21.15.46:0/3124660092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586edb46390 0x5586edf1dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:58:37.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.216+0000 7f2b79ff2640 1 --2- 172.21.15.46:0/3124660092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586edb3e1b0 0x5586edf228e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f2b700052a0 tx=0x7f2b70005230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a9b21c973243a77 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:37.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.216+0000 7f2b5d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:58:37.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.217+0000 7f2b5d7fa640 1 -- 172.21.15.46:0/3124660092 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b70051070 con 0x5586edb3e1b0 2024-09-21T03:58:37.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.217+0000 7f2b5d7fa640 1 -- 172.21.15.46:0/3124660092 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f2b70004040 con 0x5586edb3e1b0 2024-09-21T03:58:37.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.217+0000 7f2b827ca740 1 -- 172.21.15.46:0/3124660092 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b64098030 con 0x5586edb3e1b0 2024-09-21T03:58:37.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.217+0000 7f2b5d7fa640 1 -- 172.21.15.46:0/3124660092 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2b70035040 con 0x5586edb3e1b0 2024-09-21T03:58:37.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.217+0000 7f2b827ca740 10 client.16023 fetch_fsmap learned FSMap version 20 2024-09-21T03:58:37.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.217+0000 7f2b827ca740 1 -- 172.21.15.46:0/3124660092 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5586edf96950 con 0x5586edb3e1b0 2024-09-21T03:58:37.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.217+0000 7f2b5d7fa640 1 -- 172.21.15.46:0/3124660092 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b64098030 con 0x5586edb3e1b0 2024-09-21T03:58:37.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.217+0000 7f2b5d7fa640 1 -- 172.21.15.46:0/3124660092 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f2b70003b30 con 0x5586edb3e1b0 2024-09-21T03:58:37.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.217+0000 7f2b827ca740 10 client.16023 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:58:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.217+0000 7f2b827ca740 10 client.16023 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:58:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.217+0000 7f2b827ca740 20 client.16023 populate_metadata read hostname 'smithi046' 2024-09-21T03:58:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.217+0000 7f2b827ca740 1 --2- 172.21.15.46:0/3124660092 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5586edafada0 0x5586edf98b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.217+0000 7f2b827ca740 4 client.16023 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:58:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.217+0000 7f2b827ca740 1 -- 172.21.15.46:0/3124660092 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5586ede82850 con 0x5586edafada0 2024-09-21T03:58:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.217+0000 7f2b797f1640 1 --2- 172.21.15.46:0/3124660092 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5586edafada0 0x5586edf98b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.218+0000 7f2b5d7fa640 10 client.16023 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:58:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.218+0000 7f2b797f1640 1 --2- 172.21.15.46:0/3124660092 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5586edafada0 0x5586edf98b90 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78ee0b014472b739 server_cookie=ee311cb7fbe983f in_seq=0 out_seq=0 2024-09-21T03:58:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.218+0000 7f2b5d7fa640 1 -- 172.21.15.46:0/3124660092 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2558 (crc 0 0 0) 0x5586ede82850 con 0x5586edafada0 2024-09-21T03:58:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.218+0000 7f2b5d7fa640 10 client.16023 handle_command_reply: tid=0 2024-09-21T03:58:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.218+0000 7f2b827ca740 1 client.16023 shutdown 2024-09-21T03:58:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.218+0000 7f2b827ca740 1 -- 172.21.15.46:0/3124660092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586edb3e1b0 msgr2=0x5586edf228e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.218+0000 7f2b827ca740 1 --2- 172.21.15.46:0/3124660092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586edb3e1b0 0x5586edf228e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f2b700052a0 tx=0x7f2b70005230 comp rx=0 tx=0).stop 2024-09-21T03:58:37.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.218+0000 7f2b827ca740 1 -- 172.21.15.46:0/3124660092 shutdown_connections 2024-09-21T03:58:37.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.218+0000 7f2b827ca740 1 --2- 172.21.15.46:0/3124660092 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5586edafada0 0x5586edf98b90 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:37.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.218+0000 7f2b827ca740 1 --2- 172.21.15.46:0/3124660092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586edb67070 0x5586edf1e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:37.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.218+0000 7f2b5d7fa640 0 client.16023 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:58:37.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.218+0000 7f2b827ca740 1 --2- 172.21.15.46:0/3124660092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5586edb46390 0x5586edf1dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:37.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.218+0000 7f2b827ca740 1 --2- 172.21.15.46:0/3124660092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586edb3e1b0 0x5586edf228e0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:37.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.218+0000 7f2b827ca740 1 -- 172.21.15.46:0/3124660092 >> 172.21.15.46:0/3124660092 conn(0x5586edb5b460 msgr2=0x5586edf10040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:37.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.219+0000 7f2b827ca740 1 -- 172.21.15.46:0/3124660092 shutdown_connections 2024-09-21T03:58:37.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.219+0000 7f2b827ca740 1 -- 172.21.15.46:0/3124660092 wait complete. 2024-09-21T03:58:37.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.219+0000 7f2b827ca740 20 client.16023 trim_cache size 0 max 16384 2024-09-21T03:58:37.226 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T03:58:37.227 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T03:58:37.227 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2024-09-21T03:58:37.227 INFO:teuthology.orchestra.run.smithi046.stdout: "6103c660-8e77-4b06-ad6c-bb322c26035a": { 2024-09-21T03:58:37.227 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:58:37.227 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "6103c660-8e77-4b06-ad6c-bb322c26035a", 2024-09-21T03:58:37.227 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2024-09-21T03:58:37.227 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:58:37.227 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:58:37.227 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_stats": { 2024-09-21T03:58:37.227 INFO:teuthology.orchestra.run.smithi046.stdout: "6103c660-8e77-4b06-ad6c-bb322c26035a": { 2024-09-21T03:58:37.227 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:35.594467+0000", 2024-09-21T03:58:37.227 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:58:37.227 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:58:37.228 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:58:37.228 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:58:37.228 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:58:37.228 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:58:37.228 INFO:teuthology.orchestra.run.smithi046.stdout: "dab67652-8894-4711-be64-cbdfea27a9ba": { 2024-09-21T03:58:37.228 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:28.161616+0000", 2024-09-21T03:58:37.228 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:58:37.228 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:58:37.228 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:58:37.228 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:58:37.228 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:58:37.228 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:58:37.228 INFO:teuthology.orchestra.run.smithi046.stdout: "c47f458a-de5e-4952-a575-a81261953667": { 2024-09-21T03:58:37.228 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:48.699411+0000", 2024-09-21T03:58:37.229 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:58:37.229 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:58:37.229 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:58:37.229 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:58:37.229 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:58:37.229 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:58:37.229 INFO:teuthology.orchestra.run.smithi046.stdout: "e24ec8f1-0d13-478f-9c2c-b51798868ffc": { 2024-09-21T03:58:37.229 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:09.736194+0000", 2024-09-21T03:58:37.229 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:58:37.229 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:58:37.229 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:58:37.229 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:58:37.229 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:58:37.229 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:58:37.229 INFO:teuthology.orchestra.run.smithi046.stdout: "a871f724-0198-493c-b03e-b2de78aba243": { 2024-09-21T03:58:37.230 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:56:30.082991+0000", 2024-09-21T03:58:37.230 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:58:37.230 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:58:37.230 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:58:37.230 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:58:37.230 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:58:37.230 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:58:37.230 INFO:teuthology.orchestra.run.smithi046.stdout: "d49f33a7-3d5a-421b-94ba-8b19a4120db1": { 2024-09-21T03:58:37.230 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:50.480786+0000", 2024-09-21T03:58:37.230 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:58:37.230 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:58:37.230 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:58:37.230 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:58:37.230 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:58:37.231 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:58:37.231 INFO:teuthology.orchestra.run.smithi046.stdout: "3bbf7097-70d7-4743-bbce-41465502b35b": { 2024-09-21T03:58:37.231 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:10.661441+0000", 2024-09-21T03:58:37.231 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:58:37.231 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:58:37.231 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:58:37.231 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:58:37.231 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:58:37.231 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:58:37.231 INFO:teuthology.orchestra.run.smithi046.stdout: "08f0c962-df1a-4129-a1a2-b916240d9803": { 2024-09-21T03:58:37.231 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:02.937596+0000", 2024-09-21T03:58:37.231 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:58:37.231 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:58:37.231 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:58:37.232 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:58:37.232 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:58:37.232 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:58:37.232 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:58:37.232 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T03:58:37.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.219+0000 7f2b7c256640 1 -- 172.21.15.46:0/2061537414 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f2b600b6680 msgr2=0x7f2b600b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:37.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.219+0000 7f2b7c256640 1 --2- 172.21.15.46:0/2061537414 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f2b600b6680 0x7f2b600b8b90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c005fd0 tx=0x7f2b6c008630 comp rx=0 tx=0).stop 2024-09-21T03:58:37.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.219+0000 7f2b7c256640 1 -- 172.21.15.46:0/2061537414 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b74102fa0 msgr2=0x7f2b7419cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:37.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.219+0000 7f2b7c256640 1 --2- 172.21.15.46:0/2061537414 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b74102fa0 0x7f2b7419cc10 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f2b6400e9f0 tx=0x7f2b6400eeb0 comp rx=0 tx=0).stop 2024-09-21T03:58:37.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.219+0000 7f2b7c256640 1 -- 172.21.15.46:0/2061537414 shutdown_connections 2024-09-21T03:58:37.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.219+0000 7f2b7c256640 1 --2- 172.21.15.46:0/2061537414 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f2b600b6680 0x7f2b600b8b90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:37.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.219+0000 7f2b7c256640 1 --2- 172.21.15.46:0/2061537414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b74110200 0x7f2b741a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:37.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.219+0000 7f2b7c256640 1 --2- 172.21.15.46:0/2061537414 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b74102fa0 0x7f2b7419cc10 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:37.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.219+0000 7f2b7c256640 1 --2- 172.21.15.46:0/2061537414 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b74102650 0x7f2b7419c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:37.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.219+0000 7f2b7c256640 1 -- 172.21.15.46:0/2061537414 >> 172.21.15.46:0/2061537414 conn(0x7f2b74079760 msgr2=0x7f2b74108c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:37.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.219+0000 7f2b7c256640 1 -- 172.21.15.46:0/2061537414 shutdown_connections 2024-09-21T03:58:37.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:58:37.219+0000 7f2b7c256640 1 -- 172.21.15.46:0/2061537414 wait complete. 2024-09-21T03:58:37.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:36 smithi105 ceph-mon[34773]: scrub queued for path: / 2024-09-21T03:58:37.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:36 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T03:58:37.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:36 smithi105 ceph-mon[34773]: scrub summary: active paths [/] 2024-09-21T03:58:37.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:36 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T03:58:37.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:36 smithi162 ceph-mon[35071]: scrub queued for path: / 2024-09-21T03:58:37.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:36 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T03:58:37.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:36 smithi162 ceph-mon[35071]: scrub summary: active paths [/] 2024-09-21T03:58:37.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:36 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T03:58:38.094 INFO:tasks.cephfs.filesystem:scrub status for tag:6103c660-8e77-4b06-ad6c-bb322c26035a - {'path': '/', 'tag': '6103c660-8e77-4b06-ad6c-bb322c26035a', 'options': 'recursive,force'} 2024-09-21T03:58:38.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:37 smithi046 ceph-mon[30954]: pgmap v427: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2 op/s 2024-09-21T03:58:38.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:37 smithi105 ceph-mon[34773]: pgmap v427: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2 op/s 2024-09-21T03:58:38.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:37 smithi162 ceph-mon[35071]: pgmap v427: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2 op/s 2024-09-21T03:58:39.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:38 smithi046 ceph-mon[30954]: pgmap v428: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 4 op/s 2024-09-21T03:58:39.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:38 smithi046 ceph-mon[30954]: scrub summary: idle 2024-09-21T03:58:39.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:38 smithi105 ceph-mon[34773]: pgmap v428: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 4 op/s 2024-09-21T03:58:39.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:38 smithi105 ceph-mon[34773]: scrub summary: idle 2024-09-21T03:58:39.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:38 smithi162 ceph-mon[35071]: pgmap v428: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 4 op/s 2024-09-21T03:58:39.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:38 smithi162 ceph-mon[35071]: scrub summary: idle 2024-09-21T03:58:41.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:41 smithi046 ceph-mon[30954]: pgmap v429: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 3 op/s 2024-09-21T03:58:41.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:41 smithi105 ceph-mon[34773]: pgmap v429: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 3 op/s 2024-09-21T03:58:41.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:41 smithi162 ceph-mon[35071]: pgmap v429: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 3 op/s 2024-09-21T03:58:43.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:43 smithi046 ceph-mon[30954]: pgmap v430: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 4 op/s 2024-09-21T03:58:43.567 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:43 smithi105 ceph-mon[34773]: pgmap v430: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 4 op/s 2024-09-21T03:58:43.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:43 smithi162 ceph-mon[35071]: pgmap v430: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 4 op/s 2024-09-21T03:58:45.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:45 smithi046 ceph-mon[30954]: pgmap v431: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 3 op/s 2024-09-21T03:58:45.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:45 smithi105 ceph-mon[34773]: pgmap v431: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 3 op/s 2024-09-21T03:58:45.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:45 smithi162 ceph-mon[35071]: pgmap v431: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 3 op/s 2024-09-21T03:58:47.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:47 smithi046 ceph-mon[30954]: pgmap v432: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T03:58:47.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:47 smithi105 ceph-mon[34773]: pgmap v432: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T03:58:47.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:47 smithi162 ceph-mon[35071]: pgmap v432: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T03:58:49.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:49 smithi046 ceph-mon[30954]: pgmap v433: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-09-21T03:58:49.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:49 smithi105 ceph-mon[34773]: pgmap v433: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-09-21T03:58:49.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:49 smithi162 ceph-mon[35071]: pgmap v433: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-09-21T03:58:51.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:51 smithi046 ceph-mon[30954]: pgmap v434: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:58:51.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:51 smithi105 ceph-mon[34773]: pgmap v434: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:58:51.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:51 smithi162 ceph-mon[35071]: pgmap v434: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:58:53.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:53 smithi046 ceph-mon[30954]: pgmap v435: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T03:58:53.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:53 smithi105 ceph-mon[34773]: pgmap v435: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T03:58:53.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:53 smithi162 ceph-mon[35071]: pgmap v435: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T03:58:55.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:55 smithi046 ceph-mon[30954]: pgmap v436: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:58:55.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:55 smithi105 ceph-mon[34773]: pgmap v436: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:58:55.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:55 smithi162 ceph-mon[35071]: pgmap v436: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:58:57.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:57 smithi046 ceph-mon[30954]: pgmap v437: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:58:57.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:57 smithi105 ceph-mon[34773]: pgmap v437: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:58:57.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:57 smithi162 ceph-mon[35071]: pgmap v437: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:58:59.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:58:59 smithi046 ceph-mon[30954]: pgmap v438: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:58:59.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:58:59 smithi105 ceph-mon[34773]: pgmap v438: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:58:59.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:58:59 smithi162 ceph-mon[35071]: pgmap v438: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:59:01.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:01 smithi046 ceph-mon[30954]: pgmap v439: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:59:01.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:01 smithi105 ceph-mon[34773]: pgmap v439: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:59:01.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:01 smithi162 ceph-mon[35071]: pgmap v439: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:59:03.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:03 smithi046 ceph-mon[30954]: pgmap v440: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-21T03:59:03.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:03 smithi105 ceph-mon[34773]: pgmap v440: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-21T03:59:03.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:03 smithi162 ceph-mon[35071]: pgmap v440: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-21T03:59:05.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:05 smithi046 ceph-mon[30954]: pgmap v441: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T03:59:05.567 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:05 smithi105 ceph-mon[34773]: pgmap v441: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T03:59:05.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:05 smithi162 ceph-mon[35071]: pgmap v441: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T03:59:07.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:07 smithi046 ceph-mon[30954]: pgmap v442: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T03:59:07.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:07 smithi105 ceph-mon[34773]: pgmap v442: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T03:59:07.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:07 smithi162 ceph-mon[35071]: pgmap v442: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T03:59:08.096 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:59:08.373 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:59:08.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.921+0000 7f7a3d79e640 1 -- 172.21.15.46:0/4124797502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a38108420 msgr2=0x7f7a38108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:08.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.921+0000 7f7a3d79e640 1 --2- 172.21.15.46:0/4124797502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a38108420 0x7f7a38108830 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7a20009900 tx=0x7f7a2002a410 comp rx=0 tx=0).stop 2024-09-21T03:59:08.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.921+0000 7f7a3d79e640 1 -- 172.21.15.46:0/4124797502 shutdown_connections 2024-09-21T03:59:08.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.921+0000 7f7a3d79e640 1 --2- 172.21.15.46:0/4124797502 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a38108d70 0x7f7a3810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:08.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.921+0000 7f7a3d79e640 1 --2- 172.21.15.46:0/4124797502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a38108420 0x7f7a38108830 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:08.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.921+0000 7f7a3d79e640 1 --2- 172.21.15.46:0/4124797502 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a38102ae0 0x7f7a38102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:08.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.921+0000 7f7a3d79e640 1 -- 172.21.15.46:0/4124797502 >> 172.21.15.46:0/4124797502 conn(0x7f7a38079770 msgr2=0x7f7a38079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:08.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.921+0000 7f7a3d79e640 1 -- 172.21.15.46:0/4124797502 shutdown_connections 2024-09-21T03:59:08.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.921+0000 7f7a3d79e640 1 -- 172.21.15.46:0/4124797502 wait complete. 2024-09-21T03:59:08.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.921+0000 7f7a3d79e640 1 Processor -- start 2024-09-21T03:59:08.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.922+0000 7f7a3d79e640 1 -- start start 2024-09-21T03:59:08.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.922+0000 7f7a3d79e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a38102ae0 0x7f7a38110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:08.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.922+0000 7f7a3d79e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a38108420 0x7f7a381105c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:08.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.922+0000 7f7a3d79e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a38108d70 0x7f7a38110b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:08.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.922+0000 7f7a3d79e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7a38113b50 con 0x7f7a38108420 2024-09-21T03:59:08.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.922+0000 7f7a3d79e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7a381139d0 con 0x7f7a38102ae0 2024-09-21T03:59:08.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.922+0000 7f7a3d79e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7a38113cd0 con 0x7f7a38108d70 2024-09-21T03:59:08.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.922+0000 7f7a367fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a38108420 0x7f7a381105c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:08.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.922+0000 7f7a367fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a38108420 0x7f7a381105c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40208/0 (socket says 172.21.15.46:40208) 2024-09-21T03:59:08.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.922+0000 7f7a367fc640 1 -- 172.21.15.46:0/426792961 learned_addr learned my addr 172.21.15.46:0/426792961 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:08.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.922+0000 7f7a36ffd640 1 --2- 172.21.15.46:0/426792961 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a38102ae0 0x7f7a38110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:08.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.922+0000 7f7a377fe640 1 --2- 172.21.15.46:0/426792961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a38108d70 0x7f7a38110b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:08.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.923+0000 7f7a367fc640 1 -- 172.21.15.46:0/426792961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a38108d70 msgr2=0x7f7a38110b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:08.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.923+0000 7f7a367fc640 1 --2- 172.21.15.46:0/426792961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a38108d70 0x7f7a38110b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:08.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.923+0000 7f7a367fc640 1 -- 172.21.15.46:0/426792961 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a38102ae0 msgr2=0x7f7a38110080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:08.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.923+0000 7f7a367fc640 1 --2- 172.21.15.46:0/426792961 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a38102ae0 0x7f7a38110080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:08.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.923+0000 7f7a367fc640 1 -- 172.21.15.46:0/426792961 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a381a8820 con 0x7f7a38108420 2024-09-21T03:59:08.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.923+0000 7f7a36ffd640 1 --2- 172.21.15.46:0/426792961 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a38102ae0 0x7f7a38110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:59:08.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.923+0000 7f7a367fc640 1 --2- 172.21.15.46:0/426792961 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a38108420 0x7f7a381105c0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f7a2002a930 tx=0x7f7a20004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:08.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.923+0000 7f7a2ffff640 1 -- 172.21.15.46:0/426792961 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2003f030 con 0x7f7a38108420 2024-09-21T03:59:08.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.923+0000 7f7a3d79e640 1 -- 172.21.15.46:0/426792961 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a381a8ab0 con 0x7f7a38108420 2024-09-21T03:59:08.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.923+0000 7f7a2ffff640 1 -- 172.21.15.46:0/426792961 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a20003aa0 con 0x7f7a38108420 2024-09-21T03:59:08.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.923+0000 7f7a2ffff640 1 -- 172.21.15.46:0/426792961 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a20035070 con 0x7f7a38108420 2024-09-21T03:59:08.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.923+0000 7f7a3d79e640 1 -- 172.21.15.46:0/426792961 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a381a8f90 con 0x7f7a38108420 2024-09-21T03:59:08.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.926+0000 7f7a43d12740 1 Processor -- start 2024-09-21T03:59:08.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.926+0000 7f7a43d12740 1 -- start start 2024-09-21T03:59:08.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.926+0000 7f7a2ffff640 1 -- 172.21.15.46:0/426792961 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f7a20042030 con 0x7f7a38108420 2024-09-21T03:59:08.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.926+0000 7f7a43d12740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efd3269070 0x55efd3610650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:08.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.926+0000 7f7a43d12740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efd32401b0 0x55efd3610b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:08.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.926+0000 7f7a43d12740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efd3248390 0x55efd36110d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:08.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.926+0000 7f7a43d12740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55efd3586e50 con 0x55efd3269070 2024-09-21T03:59:08.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.926+0000 7f7a43d12740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55efd3576280 con 0x55efd3248390 2024-09-21T03:59:08.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.926+0000 7f7a43d12740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55efd357a090 con 0x55efd32401b0 2024-09-21T03:59:08.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.927+0000 7f7a377fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efd3269070 0x55efd3610650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:08.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.927+0000 7f7a377fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efd3269070 0x55efd3610650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40224/0 (socket says 172.21.15.46:40224) 2024-09-21T03:59:08.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.927+0000 7f7a377fe640 1 -- 172.21.15.46:0/3224417808 learned_addr learned my addr 172.21.15.46:0/3224417808 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:08.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.927+0000 7f7a36ffd640 1 --2- 172.21.15.46:0/3224417808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efd32401b0 0x55efd3610b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:08.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.927+0000 7f7a367fc640 1 --2- 172.21.15.46:0/3224417808 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efd3248390 0x55efd36110d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:08.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.927+0000 7f7a377fe640 1 -- 172.21.15.46:0/3224417808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efd32401b0 msgr2=0x55efd3610b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:08.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.927+0000 7f7a377fe640 1 --2- 172.21.15.46:0/3224417808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efd32401b0 0x55efd3610b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:08.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.927+0000 7f7a377fe640 1 -- 172.21.15.46:0/3224417808 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efd3248390 msgr2=0x55efd36110d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:08.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.927+0000 7f7a377fe640 1 --2- 172.21.15.46:0/3224417808 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efd3248390 0x55efd36110d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:08.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.927+0000 7f7a377fe640 1 -- 172.21.15.46:0/3224417808 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efd32d4650 con 0x55efd3269070 2024-09-21T03:59:08.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.927+0000 7f7a367fc640 1 --2- 172.21.15.46:0/3224417808 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efd3248390 0x55efd36110d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:59:08.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.927+0000 7f7a377fe640 1 --2- 172.21.15.46:0/3224417808 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efd3269070 0x55efd3610650 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f7a2800dc30 tx=0x7f7a2800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=998383e5ac853b7f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:08.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.927+0000 7f7a2ffff640 1 --2- 172.21.15.46:0/426792961 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7a240b6680 0x7f7a240b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:08.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.927+0000 7f7a2d7fa640 1 -- 172.21.15.46:0/3224417808 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a28004030 con 0x55efd3269070 2024-09-21T03:59:08.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.928+0000 7f7a36ffd640 1 --2- 172.21.15.46:0/426792961 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7a240b6680 0x7f7a240b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:08.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.928+0000 7f7a2d7fa640 1 -- 172.21.15.46:0/3224417808 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a280041d0 con 0x55efd3269070 2024-09-21T03:59:08.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.928+0000 7f7a2d7fa640 1 -- 172.21.15.46:0/3224417808 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a280116a0 con 0x55efd3269070 2024-09-21T03:59:08.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.928+0000 7f7a2ffff640 1 -- 172.21.15.46:0/426792961 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f7a20107e50 con 0x7f7a38108420 2024-09-21T03:59:08.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.928+0000 7f7a43d12740 1 -- 172.21.15.46:0/3224417808 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efd3269070 msgr2=0x55efd3610650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:08.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.928+0000 7f7a36ffd640 1 --2- 172.21.15.46:0/426792961 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7a240b6680 0x7f7a240b8b90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55efd360f2d0 tx=0x7f7a30009620 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:08.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.929+0000 7f7a43d12740 1 --2- 172.21.15.46:0/3224417808 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efd3269070 0x55efd3610650 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f7a2800dc30 tx=0x7f7a2800f730 comp rx=0 tx=0).stop 2024-09-21T03:59:08.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.929+0000 7f7a43d12740 1 -- 172.21.15.46:0/3224417808 shutdown_connections 2024-09-21T03:59:08.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.929+0000 7f7a43d12740 1 --2- 172.21.15.46:0/3224417808 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efd3248390 0x55efd36110d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:08.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.929+0000 7f7a43d12740 1 --2- 172.21.15.46:0/3224417808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efd32401b0 0x55efd3610b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:08.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.929+0000 7f7a43d12740 1 --2- 172.21.15.46:0/3224417808 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efd3269070 0x55efd3610650 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:08.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.929+0000 7f7a43d12740 1 -- 172.21.15.46:0/3224417808 >> 172.21.15.46:0/3224417808 conn(0x55efd325d460 msgr2=0x55efd360e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:08.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.929+0000 7f7a43d12740 1 -- 172.21.15.46:0/3224417808 shutdown_connections 2024-09-21T03:59:08.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.929+0000 7f7a43d12740 1 -- 172.21.15.46:0/3224417808 wait complete. 2024-09-21T03:59:08.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.929+0000 7f7a43d12740 1 -- start start 2024-09-21T03:59:08.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.929+0000 7f7a43d12740 1 Processor -- start 2024-09-21T03:59:08.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.930+0000 7f7a43d12740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efd32401b0 0x55efd361bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:08.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.930+0000 7f7a43d12740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efd3248390 0x55efd361c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:08.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.930+0000 7f7a43d12740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efd3269070 0x55efd361c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:08.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.930+0000 7f7a43d12740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55efd33d7700 con 0x55efd3248390 2024-09-21T03:59:08.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.930+0000 7f7a43d12740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55efd3511110 con 0x55efd3269070 2024-09-21T03:59:08.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.930+0000 7f7a43d12740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55efd361ee30 con 0x55efd32401b0 2024-09-21T03:59:08.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.930+0000 7f7a43d12740 10 client.0 _ll_register_callbacks cb 0x55efd352a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:59:08.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.930+0000 7f7a367fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efd3248390 0x55efd361c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:08.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.930+0000 7f7a367fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efd3248390 0x55efd361c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40238/0 (socket says 172.21.15.46:40238) 2024-09-21T03:59:08.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.930+0000 7f7a367fc640 1 -- 172.21.15.46:0/1418198653 learned_addr learned my addr 172.21.15.46:0/1418198653 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:08.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.930+0000 7f7a36ffd640 1 --2- 172.21.15.46:0/1418198653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efd32401b0 0x55efd361bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:08.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.930+0000 7f7a377fe640 1 --2- 172.21.15.46:0/1418198653 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efd3269070 0x55efd361c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:08.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.930+0000 7f7a367fc640 1 -- 172.21.15.46:0/1418198653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efd32401b0 msgr2=0x55efd361bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:08.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.930+0000 7f7a367fc640 1 --2- 172.21.15.46:0/1418198653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efd32401b0 0x55efd361bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:08.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.930+0000 7f7a367fc640 1 -- 172.21.15.46:0/1418198653 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efd3269070 msgr2=0x55efd361c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:08.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.930+0000 7f7a367fc640 1 --2- 172.21.15.46:0/1418198653 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efd3269070 0x55efd361c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:08.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.930+0000 7f7a367fc640 1 -- 172.21.15.46:0/1418198653 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efd353ec40 con 0x55efd3248390 2024-09-21T03:59:08.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.930+0000 7f7a367fc640 1 --2- 172.21.15.46:0/1418198653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efd3248390 0x55efd361c1f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f7a20031440 tx=0x7f7a2002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a39e05dca8b03c42 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:08.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.930+0000 7f7a1e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:59:08.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.931+0000 7f7a1e7fc640 1 -- 172.21.15.46:0/1418198653 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a20049030 con 0x55efd3248390 2024-09-21T03:59:08.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.931+0000 7f7a1e7fc640 1 -- 172.21.15.46:0/1418198653 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f7a200c9fb0 con 0x55efd3248390 2024-09-21T03:59:08.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.931+0000 7f7a43d12740 1 -- 172.21.15.46:0/1418198653 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a280041d0 con 0x55efd3248390 2024-09-21T03:59:08.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.931+0000 7f7a1e7fc640 1 -- 172.21.15.46:0/1418198653 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7a200cd690 con 0x55efd3248390 2024-09-21T03:59:08.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.931+0000 7f7a43d12740 10 client.16035 fetch_fsmap learned FSMap version 20 2024-09-21T03:59:08.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.931+0000 7f7a43d12740 1 -- 172.21.15.46:0/1418198653 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55efd362ab10 con 0x55efd3248390 2024-09-21T03:59:08.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.931+0000 7f7a1e7fc640 1 -- 172.21.15.46:0/1418198653 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a280041d0 con 0x55efd3248390 2024-09-21T03:59:08.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.931+0000 7f7a1e7fc640 1 -- 172.21.15.46:0/1418198653 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f7a201058c0 con 0x55efd3248390 2024-09-21T03:59:08.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.931+0000 7f7a43d12740 10 client.16035 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:59:08.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.931+0000 7f7a43d12740 10 client.16035 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:59:08.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.931+0000 7f7a43d12740 20 client.16035 populate_metadata read hostname 'smithi046' 2024-09-21T03:59:08.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.931+0000 7f7a43d12740 1 --2- 172.21.15.46:0/1418198653 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55efd32279f0 0x55efd362dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:08.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.931+0000 7f7a43d12740 4 client.16035 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:59:08.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.931+0000 7f7a43d12740 1 -- 172.21.15.46:0/1418198653 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55efd3588da0 con 0x55efd32279f0 2024-09-21T03:59:08.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.932+0000 7f7a36ffd640 1 --2- 172.21.15.46:0/1418198653 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55efd32279f0 0x55efd362dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:08.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.932+0000 7f7a1e7fc640 10 client.16035 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:59:08.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.932+0000 7f7a36ffd640 1 --2- 172.21.15.46:0/1418198653 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55efd32279f0 0x55efd362dfb0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f72f35d69c49a08 server_cookie=7282cfff8a419c0f in_seq=0 out_seq=0 2024-09-21T03:59:08.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.933+0000 7f7a1e7fc640 1 -- 172.21.15.46:0/1418198653 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55efd3588da0 con 0x55efd32279f0 2024-09-21T03:59:08.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.933+0000 7f7a1e7fc640 10 client.16035 handle_command_reply: tid=0 2024-09-21T03:59:08.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.933+0000 7f7a43d12740 1 client.16035 shutdown 2024-09-21T03:59:08.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.933+0000 7f7a43d12740 1 -- 172.21.15.46:0/1418198653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efd3248390 msgr2=0x55efd361c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:08.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.933+0000 7f7a43d12740 1 --2- 172.21.15.46:0/1418198653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efd3248390 0x55efd361c1f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f7a20031440 tx=0x7f7a2002a410 comp rx=0 tx=0).stop 2024-09-21T03:59:08.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.933+0000 7f7a43d12740 1 -- 172.21.15.46:0/1418198653 shutdown_connections 2024-09-21T03:59:08.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.933+0000 7f7a43d12740 1 --2- 172.21.15.46:0/1418198653 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55efd32279f0 0x55efd362dfb0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:08.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.933+0000 7f7a43d12740 1 --2- 172.21.15.46:0/1418198653 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efd3269070 0x55efd361c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:08.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.933+0000 7f7a43d12740 1 --2- 172.21.15.46:0/1418198653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efd3248390 0x55efd361c1f0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:08.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.933+0000 7f7a43d12740 1 --2- 172.21.15.46:0/1418198653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efd32401b0 0x55efd361bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:08.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.933+0000 7f7a43d12740 1 -- 172.21.15.46:0/1418198653 >> 172.21.15.46:0/1418198653 conn(0x55efd325d460 msgr2=0x55efd36137e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:08.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.933+0000 7f7a1e7fc640 0 client.16035 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:59:08.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.933+0000 7f7a43d12740 1 -- 172.21.15.46:0/1418198653 shutdown_connections 2024-09-21T03:59:08.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.933+0000 7f7a43d12740 1 -- 172.21.15.46:0/1418198653 wait complete. 2024-09-21T03:59:08.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.934+0000 7f7a43d12740 20 client.16035 trim_cache size 0 max 16384 2024-09-21T03:59:08.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.951+0000 7f7a43d12740 1 Processor -- start 2024-09-21T03:59:08.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.951+0000 7f7a43d12740 1 -- start start 2024-09-21T03:59:08.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.952+0000 7f7a43d12740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efd32401b0 0x55efd3611d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:08.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.952+0000 7f7a43d12740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efd3248390 0x55efd3618ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:08.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.952+0000 7f7a43d12740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efd3269070 0x55efd36193e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:08.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.952+0000 7f7a43d12740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7a381af730 con 0x55efd3269070 2024-09-21T03:59:08.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.952+0000 7f7a43d12740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7a381b1fd0 con 0x55efd3248390 2024-09-21T03:59:08.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.952+0000 7f7a43d12740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7a381afdc0 con 0x55efd32401b0 2024-09-21T03:59:08.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.952+0000 7f7a377fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efd3269070 0x55efd36193e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:08.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.952+0000 7f7a377fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efd3269070 0x55efd36193e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40244/0 (socket says 172.21.15.46:40244) 2024-09-21T03:59:08.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.952+0000 7f7a377fe640 1 -- 172.21.15.46:0/3998975090 learned_addr learned my addr 172.21.15.46:0/3998975090 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:08.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.952+0000 7f7a36ffd640 1 --2- 172.21.15.46:0/3998975090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efd32401b0 0x55efd3611d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:08.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.952+0000 7f7a367fc640 1 --2- 172.21.15.46:0/3998975090 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efd3248390 0x55efd3618ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:08.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.952+0000 7f7a377fe640 1 -- 172.21.15.46:0/3998975090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efd32401b0 msgr2=0x55efd3611d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:08.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.952+0000 7f7a377fe640 1 --2- 172.21.15.46:0/3998975090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efd32401b0 0x55efd3611d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:08.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.952+0000 7f7a377fe640 1 -- 172.21.15.46:0/3998975090 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efd3248390 msgr2=0x55efd3618ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:08.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.952+0000 7f7a377fe640 1 --2- 172.21.15.46:0/3998975090 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efd3248390 0x55efd3618ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:08.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.952+0000 7f7a377fe640 1 -- 172.21.15.46:0/3998975090 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efd3612b70 con 0x55efd3269070 2024-09-21T03:59:08.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.952+0000 7f7a367fc640 1 --2- 172.21.15.46:0/3998975090 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efd3248390 0x55efd3618ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:59:08.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.952+0000 7f7a377fe640 1 --2- 172.21.15.46:0/3998975090 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efd3269070 0x55efd36193e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f7a2800ded0 tx=0x7f7a2800df00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7029e2d1db2ec200 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:08.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.953+0000 7f7a2cff9640 1 -- 172.21.15.46:0/3998975090 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2802a070 con 0x55efd3269070 2024-09-21T03:59:08.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.953+0000 7f7a2cff9640 1 -- 172.21.15.46:0/3998975090 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a2800d800 con 0x55efd3269070 2024-09-21T03:59:08.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.953+0000 7f7a2cff9640 1 -- 172.21.15.46:0/3998975090 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a28003d20 con 0x55efd3269070 2024-09-21T03:59:08.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.953+0000 7f7a43d12740 1 -- 172.21.15.46:0/3998975090 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efd3269070 msgr2=0x55efd36193e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:08.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.953+0000 7f7a43d12740 1 --2- 172.21.15.46:0/3998975090 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efd3269070 0x55efd36193e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f7a2800ded0 tx=0x7f7a2800df00 comp rx=0 tx=0).stop 2024-09-21T03:59:08.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.954+0000 7f7a43d12740 1 -- 172.21.15.46:0/3998975090 shutdown_connections 2024-09-21T03:59:08.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.954+0000 7f7a43d12740 1 --2- 172.21.15.46:0/3998975090 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efd3269070 0x55efd36193e0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:08.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.954+0000 7f7a43d12740 1 --2- 172.21.15.46:0/3998975090 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efd3248390 0x55efd3618ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:08.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.954+0000 7f7a43d12740 1 --2- 172.21.15.46:0/3998975090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efd32401b0 0x55efd3611d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:08.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.954+0000 7f7a43d12740 1 -- 172.21.15.46:0/3998975090 >> 172.21.15.46:0/3998975090 conn(0x55efd325d460 msgr2=0x55efd3611680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:08.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.954+0000 7f7a43d12740 1 -- 172.21.15.46:0/3998975090 shutdown_connections 2024-09-21T03:59:08.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.954+0000 7f7a43d12740 1 -- 172.21.15.46:0/3998975090 wait complete. 2024-09-21T03:59:08.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.954+0000 7f7a43d12740 1 -- start start 2024-09-21T03:59:08.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.954+0000 7f7a43d12740 1 Processor -- start 2024-09-21T03:59:08.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.954+0000 7f7a43d12740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efd32401b0 0x55efd3624970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:08.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.954+0000 7f7a43d12740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efd3248390 0x55efd361fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:08.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.955+0000 7f7a43d12740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efd3269070 0x55efd36203e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:08.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.955+0000 7f7a43d12740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7a381b0490 con 0x55efd3248390 2024-09-21T03:59:08.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.955+0000 7f7a43d12740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7a381b1900 con 0x55efd3269070 2024-09-21T03:59:08.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.955+0000 7f7a43d12740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7a381b0b60 con 0x55efd32401b0 2024-09-21T03:59:08.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.955+0000 7f7a43d12740 10 client.0 _ll_register_callbacks cb 0x7f7a20005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:59:08.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.955+0000 7f7a367fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efd3248390 0x55efd361fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:08.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.955+0000 7f7a367fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efd3248390 0x55efd361fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40260/0 (socket says 172.21.15.46:40260) 2024-09-21T03:59:08.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.955+0000 7f7a367fc640 1 -- 172.21.15.46:0/4284835822 learned_addr learned my addr 172.21.15.46:0/4284835822 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:08.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.955+0000 7f7a377fe640 1 --2- 172.21.15.46:0/4284835822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efd3269070 0x55efd36203e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:08.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.955+0000 7f7a36ffd640 1 --2- 172.21.15.46:0/4284835822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efd32401b0 0x55efd3624970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:08.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.955+0000 7f7a367fc640 1 -- 172.21.15.46:0/4284835822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efd32401b0 msgr2=0x55efd3624970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:08.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.955+0000 7f7a367fc640 1 --2- 172.21.15.46:0/4284835822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efd32401b0 0x55efd3624970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:08.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.955+0000 7f7a367fc640 1 -- 172.21.15.46:0/4284835822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efd3269070 msgr2=0x55efd36203e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:08.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.955+0000 7f7a367fc640 1 --2- 172.21.15.46:0/4284835822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efd3269070 0x55efd36203e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:08.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.955+0000 7f7a367fc640 1 -- 172.21.15.46:0/4284835822 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efd3620b70 con 0x55efd3248390 2024-09-21T03:59:08.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.955+0000 7f7a367fc640 1 --2- 172.21.15.46:0/4284835822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efd3248390 0x55efd361fe20 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f7a200cdcd0 tx=0x7f7a20009670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b98c18b8d3289bfe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:08.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.955+0000 7f7a1e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:59:08.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.955+0000 7f7a1e7fc640 1 -- 172.21.15.46:0/4284835822 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a20049070 con 0x55efd3248390 2024-09-21T03:59:08.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.956+0000 7f7a1e7fc640 1 -- 172.21.15.46:0/4284835822 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f7a200035f0 con 0x55efd3248390 2024-09-21T03:59:08.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.956+0000 7f7a43d12740 1 -- 172.21.15.46:0/4284835822 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a2800d800 con 0x55efd3248390 2024-09-21T03:59:08.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.956+0000 7f7a1e7fc640 1 -- 172.21.15.46:0/4284835822 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7a200cd4b0 con 0x55efd3248390 2024-09-21T03:59:08.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.956+0000 7f7a43d12740 10 client.16041 fetch_fsmap learned FSMap version 20 2024-09-21T03:59:08.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.956+0000 7f7a43d12740 1 -- 172.21.15.46:0/4284835822 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55efd3620b70 con 0x55efd3248390 2024-09-21T03:59:08.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.956+0000 7f7a1e7fc640 1 -- 172.21.15.46:0/4284835822 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a2800d800 con 0x55efd3248390 2024-09-21T03:59:08.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.956+0000 7f7a1e7fc640 1 -- 172.21.15.46:0/4284835822 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f7a200b3b10 con 0x55efd3248390 2024-09-21T03:59:08.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.956+0000 7f7a43d12740 10 client.16041 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:59:08.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.956+0000 7f7a43d12740 10 client.16041 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:59:08.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.956+0000 7f7a43d12740 20 client.16041 populate_metadata read hostname 'smithi046' 2024-09-21T03:59:08.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.956+0000 7f7a43d12740 1 --2- 172.21.15.46:0/4284835822 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55efd31fcda0 0x55efd369acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:08.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.956+0000 7f7a43d12740 4 client.16041 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:59:08.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.956+0000 7f7a43d12740 1 -- 172.21.15.46:0/4284835822 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55efd3584850 con 0x55efd31fcda0 2024-09-21T03:59:08.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.957+0000 7f7a36ffd640 1 --2- 172.21.15.46:0/4284835822 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55efd31fcda0 0x55efd369acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:08.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.957+0000 7f7a1e7fc640 10 client.16041 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:59:08.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.957+0000 7f7a36ffd640 1 --2- 172.21.15.46:0/4284835822 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55efd31fcda0 0x55efd369acf0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3030b75fdbebd67b server_cookie=3c981759d7ea8f78 in_seq=0 out_seq=0 2024-09-21T03:59:08.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.957+0000 7f7a1e7fc640 1 -- 172.21.15.46:0/4284835822 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2362 (crc 0 0 0) 0x55efd3584850 con 0x55efd31fcda0 2024-09-21T03:59:08.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.957+0000 7f7a1e7fc640 10 client.16041 handle_command_reply: tid=0 2024-09-21T03:59:08.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.957+0000 7f7a43d12740 1 client.16041 shutdown 2024-09-21T03:59:08.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.957+0000 7f7a43d12740 1 -- 172.21.15.46:0/4284835822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efd3248390 msgr2=0x55efd361fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:08.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.957+0000 7f7a43d12740 1 --2- 172.21.15.46:0/4284835822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efd3248390 0x55efd361fe20 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f7a200cdcd0 tx=0x7f7a20009670 comp rx=0 tx=0).stop 2024-09-21T03:59:08.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.957+0000 7f7a43d12740 1 -- 172.21.15.46:0/4284835822 shutdown_connections 2024-09-21T03:59:08.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.957+0000 7f7a43d12740 1 --2- 172.21.15.46:0/4284835822 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55efd31fcda0 0x55efd369acf0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:08.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.957+0000 7f7a43d12740 1 --2- 172.21.15.46:0/4284835822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55efd3269070 0x55efd36203e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:08.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.957+0000 7f7a43d12740 1 --2- 172.21.15.46:0/4284835822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55efd3248390 0x55efd361fe20 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:08.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.958+0000 7f7a43d12740 1 --2- 172.21.15.46:0/4284835822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efd32401b0 0x55efd3624970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:08.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.958+0000 7f7a43d12740 1 -- 172.21.15.46:0/4284835822 >> 172.21.15.46:0/4284835822 conn(0x55efd325d460 msgr2=0x55efd361ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:08.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.958+0000 7f7a1e7fc640 0 client.16041 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:59:08.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.958+0000 7f7a43d12740 1 -- 172.21.15.46:0/4284835822 shutdown_connections 2024-09-21T03:59:08.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.958+0000 7f7a43d12740 1 -- 172.21.15.46:0/4284835822 wait complete. 2024-09-21T03:59:08.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.958+0000 7f7a43d12740 20 client.16041 trim_cache size 0 max 16384 2024-09-21T03:59:08.966 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T03:59:08.967 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "no active scrubs running", 2024-09-21T03:59:08.967 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": {}, 2024-09-21T03:59:08.967 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_stats": { 2024-09-21T03:59:08.967 INFO:teuthology.orchestra.run.smithi046.stdout: "6103c660-8e77-4b06-ad6c-bb322c26035a": { 2024-09-21T03:59:08.967 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:35.594467+0000", 2024-09-21T03:59:08.967 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:08.967 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:08.967 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:08.967 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:08.967 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:08.967 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:59:08.967 INFO:teuthology.orchestra.run.smithi046.stdout: "dab67652-8894-4711-be64-cbdfea27a9ba": { 2024-09-21T03:59:08.968 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:28.161616+0000", 2024-09-21T03:59:08.968 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:08.968 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:08.968 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:08.968 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:08.968 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:08.968 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:59:08.968 INFO:teuthology.orchestra.run.smithi046.stdout: "c47f458a-de5e-4952-a575-a81261953667": { 2024-09-21T03:59:08.968 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:48.699411+0000", 2024-09-21T03:59:08.968 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:08.968 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:08.968 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:08.968 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:08.968 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:08.969 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:59:08.969 INFO:teuthology.orchestra.run.smithi046.stdout: "e24ec8f1-0d13-478f-9c2c-b51798868ffc": { 2024-09-21T03:59:08.969 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:09.736194+0000", 2024-09-21T03:59:08.969 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:08.969 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:08.969 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:08.969 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:08.969 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:08.969 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:59:08.969 INFO:teuthology.orchestra.run.smithi046.stdout: "a871f724-0198-493c-b03e-b2de78aba243": { 2024-09-21T03:59:08.969 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:56:30.082991+0000", 2024-09-21T03:59:08.969 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:08.969 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:08.970 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:08.970 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:08.970 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:08.970 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:59:08.970 INFO:teuthology.orchestra.run.smithi046.stdout: "d49f33a7-3d5a-421b-94ba-8b19a4120db1": { 2024-09-21T03:59:08.970 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:50.480786+0000", 2024-09-21T03:59:08.970 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:08.970 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:08.970 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:08.970 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:08.970 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:08.970 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:59:08.971 INFO:teuthology.orchestra.run.smithi046.stdout: "3bbf7097-70d7-4743-bbce-41465502b35b": { 2024-09-21T03:59:08.971 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:10.661441+0000", 2024-09-21T03:59:08.971 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:08.971 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:08.971 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:08.971 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:08.971 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:08.971 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:59:08.971 INFO:teuthology.orchestra.run.smithi046.stdout: "08f0c962-df1a-4129-a1a2-b916240d9803": { 2024-09-21T03:59:08.971 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:02.937596+0000", 2024-09-21T03:59:08.971 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:08.971 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:08.971 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:08.971 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:08.972 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:08.972 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:59:08.972 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:59:08.972 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T03:59:08.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.958+0000 7f7a3d79e640 1 -- 172.21.15.46:0/426792961 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7a240b6680 msgr2=0x7f7a240b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:08.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.958+0000 7f7a3d79e640 1 --2- 172.21.15.46:0/426792961 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7a240b6680 0x7f7a240b8b90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55efd360f2d0 tx=0x7f7a30009620 comp rx=0 tx=0).stop 2024-09-21T03:59:08.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.958+0000 7f7a3d79e640 1 -- 172.21.15.46:0/426792961 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a38108420 msgr2=0x7f7a381105c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:08.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.958+0000 7f7a3d79e640 1 --2- 172.21.15.46:0/426792961 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a38108420 0x7f7a381105c0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f7a2002a930 tx=0x7f7a20004270 comp rx=0 tx=0).stop 2024-09-21T03:59:08.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.958+0000 7f7a3d79e640 1 -- 172.21.15.46:0/426792961 shutdown_connections 2024-09-21T03:59:08.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.958+0000 7f7a3d79e640 1 --2- 172.21.15.46:0/426792961 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7a240b6680 0x7f7a240b8b90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:08.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.958+0000 7f7a3d79e640 1 --2- 172.21.15.46:0/426792961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a38108d70 0x7f7a38110b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:08.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.958+0000 7f7a3d79e640 1 --2- 172.21.15.46:0/426792961 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a38108420 0x7f7a381105c0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:08.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.958+0000 7f7a3d79e640 1 --2- 172.21.15.46:0/426792961 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a38102ae0 0x7f7a38110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:08.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.958+0000 7f7a3d79e640 1 -- 172.21.15.46:0/426792961 >> 172.21.15.46:0/426792961 conn(0x7f7a38079770 msgr2=0x7f7a381044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:08.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.959+0000 7f7a3d79e640 1 -- 172.21.15.46:0/426792961 shutdown_connections 2024-09-21T03:59:08.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:08.959+0000 7f7a3d79e640 1 -- 172.21.15.46:0/426792961 wait complete. 2024-09-21T03:59:09.487 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:09 smithi046 ceph-mon[30954]: pgmap v443: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T03:59:09.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:09 smithi105 ceph-mon[34773]: pgmap v443: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T03:59:09.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:09 smithi162 ceph-mon[35071]: pgmap v443: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T03:59:09.798 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:59:09.799 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:59:10.060 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:59:10.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.626+0000 7f9990861640 1 -- 172.21.15.46:0/658601912 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f998c104a30 msgr2=0x7f998c104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:10.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.626+0000 7f9990861640 1 --2- 172.21.15.46:0/658601912 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f998c104a30 0x7f998c104e40 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f997c009900 tx=0x7f997c02a410 comp rx=0 tx=0).stop 2024-09-21T03:59:10.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.626+0000 7f9990861640 1 -- 172.21.15.46:0/658601912 shutdown_connections 2024-09-21T03:59:10.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.626+0000 7f9990861640 1 --2- 172.21.15.46:0/658601912 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f998c10de60 0x7f998c110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:10.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.626+0000 7f9990861640 1 --2- 172.21.15.46:0/658601912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f998c105380 0x7f998c10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:10.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.626+0000 7f9990861640 1 --2- 172.21.15.46:0/658601912 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f998c104a30 0x7f998c104e40 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:10.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.626+0000 7f9990861640 1 -- 172.21.15.46:0/658601912 >> 172.21.15.46:0/658601912 conn(0x7f998c079760 msgr2=0x7f998c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:10.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.626+0000 7f9990861640 1 -- 172.21.15.46:0/658601912 shutdown_connections 2024-09-21T03:59:10.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.626+0000 7f9990861640 1 -- 172.21.15.46:0/658601912 wait complete. 2024-09-21T03:59:10.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.627+0000 7f9990861640 1 Processor -- start 2024-09-21T03:59:10.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.627+0000 7f9990861640 1 -- start start 2024-09-21T03:59:10.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.627+0000 7f9990861640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f998c104a30 0x7f998c19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:10.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.627+0000 7f9990861640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f998c105380 0x7f998c19aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:10.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.627+0000 7f9990861640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f998c10de60 0x7f998c19fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:10.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.627+0000 7f9990861640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f998c113af0 con 0x7f998c105380 2024-09-21T03:59:10.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.627+0000 7f9990861640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f998c113970 con 0x7f998c104a30 2024-09-21T03:59:10.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.627+0000 7f9990861640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f998c113c70 con 0x7f998c10de60 2024-09-21T03:59:10.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.627+0000 7f9983fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f998c105380 0x7f998c19aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:10.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.627+0000 7f9983fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f998c105380 0x7f998c19aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40270/0 (socket says 172.21.15.46:40270) 2024-09-21T03:59:10.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.627+0000 7f9983fff640 1 -- 172.21.15.46:0/2918369505 learned_addr learned my addr 172.21.15.46:0/2918369505 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:10.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.627+0000 7f998a59c640 1 --2- 172.21.15.46:0/2918369505 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f998c104a30 0x7f998c19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:10.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.627+0000 7f998ad9d640 1 --2- 172.21.15.46:0/2918369505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f998c10de60 0x7f998c19fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:10.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.627+0000 7f9983fff640 1 -- 172.21.15.46:0/2918369505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f998c10de60 msgr2=0x7f998c19fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:10.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.628+0000 7f9983fff640 1 --2- 172.21.15.46:0/2918369505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f998c10de60 0x7f998c19fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:10.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.628+0000 7f9983fff640 1 -- 172.21.15.46:0/2918369505 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f998c104a30 msgr2=0x7f998c19a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:10.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.628+0000 7f9983fff640 1 --2- 172.21.15.46:0/2918369505 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f998c104a30 0x7f998c19a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:10.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.628+0000 7f9983fff640 1 -- 172.21.15.46:0/2918369505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f998c1a0390 con 0x7f998c105380 2024-09-21T03:59:10.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.628+0000 7f998ad9d640 1 --2- 172.21.15.46:0/2918369505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f998c10de60 0x7f998c19fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:59:10.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.628+0000 7f998a59c640 1 --2- 172.21.15.46:0/2918369505 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f998c104a30 0x7f998c19a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:59:10.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.628+0000 7f9983fff640 1 --2- 172.21.15.46:0/2918369505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f998c105380 0x7f998c19aa80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f997400c8c0 tx=0x7f997400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:10.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.628+0000 7f99837fe640 1 -- 172.21.15.46:0/2918369505 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9974007bb0 con 0x7f998c105380 2024-09-21T03:59:10.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.628+0000 7f9990861640 1 -- 172.21.15.46:0/2918369505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f998c1a0680 con 0x7f998c105380 2024-09-21T03:59:10.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.628+0000 7f99837fe640 1 -- 172.21.15.46:0/2918369505 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9974007d50 con 0x7f998c105380 2024-09-21T03:59:10.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.628+0000 7f99837fe640 1 -- 172.21.15.46:0/2918369505 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99740187c0 con 0x7f998c105380 2024-09-21T03:59:10.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.628+0000 7f9990861640 1 -- 172.21.15.46:0/2918369505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f998c1a6ea0 con 0x7f998c105380 2024-09-21T03:59:10.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.629+0000 7f9990861640 1 -- 172.21.15.46:0/2918369505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f998c06c1f0 con 0x7f998c105380 2024-09-21T03:59:10.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.631+0000 7f99837fe640 1 -- 172.21.15.46:0/2918369505 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f997400fa20 con 0x7f998c105380 2024-09-21T03:59:10.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.631+0000 7f99837fe640 1 --2- 172.21.15.46:0/2918369505 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f99780b66b0 0x7f99780b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:10.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.631+0000 7f998a59c640 1 --2- 172.21.15.46:0/2918369505 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f99780b66b0 0x7f99780b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:10.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.632+0000 7f99837fe640 1 -- 172.21.15.46:0/2918369505 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f99740e7a50 con 0x7f998c105380 2024-09-21T03:59:10.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.632+0000 7f998a59c640 1 --2- 172.21.15.46:0/2918369505 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f99780b66b0 0x7f99780b8bc0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f997c006010 tx=0x7f997c031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:10.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.635+0000 7f99837fe640 1 -- 172.21.15.46:0/2918369505 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9974014030 con 0x7f998c105380 2024-09-21T03:59:10.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.860+0000 7f9990861640 1 -- 172.21.15.46:0/2918369505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f998c19b610 con 0x7f998c105380 2024-09-21T03:59:10.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.860+0000 7f99837fe640 1 -- 172.21.15.46:0/2918369505 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f998c19b610 con 0x7f998c105380 2024-09-21T03:59:10.863 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:59:10.863 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"btime":"2024-09-21T03:53:23:865820+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1766354184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1766354184},{"type":"v1","addr":"172.21.15.46:6839","nonce":1766354184}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/1901774207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":1901774207},{"type":"v1","addr":"172.21.15.46:6841","nonce":1901774207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3548633196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":3548633196},{"type":"v1","addr":"172.21.15.105:6837","nonce":3548633196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24652,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3551934241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3551934241},{"type":"v1","addr":"172.21.15.162:6835","nonce":3551934241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/48949822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":48949822},{"type":"v1","addr":"172.21.15.162:6837","nonce":48949822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:53:14.452819+0000","modified":"2024-09-21T03:53:23.593278+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24680},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/2196053213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2196053213},{"type":"v1","addr":"172.21.15.162:6839","nonce":2196053213}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.105:6839/3911438406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":3911438406},{"type":"v1","addr":"172.21.15.105:6839","nonce":3911438406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24680,"qdb_cluster":[24680]},"id":1}]} 2024-09-21T03:59:10.864 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T03:59:10.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.863+0000 7f9990861640 1 -- 172.21.15.46:0/2918369505 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f99780b66b0 msgr2=0x7f99780b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:10.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.863+0000 7f9990861640 1 --2- 172.21.15.46:0/2918369505 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f99780b66b0 0x7f99780b8bc0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f997c006010 tx=0x7f997c031400 comp rx=0 tx=0).stop 2024-09-21T03:59:10.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.863+0000 7f9990861640 1 -- 172.21.15.46:0/2918369505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f998c105380 msgr2=0x7f998c19aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:10.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.863+0000 7f9990861640 1 --2- 172.21.15.46:0/2918369505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f998c105380 0x7f998c19aa80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f997400c8c0 tx=0x7f997400cd80 comp rx=0 tx=0).stop 2024-09-21T03:59:10.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.863+0000 7f9990861640 1 -- 172.21.15.46:0/2918369505 shutdown_connections 2024-09-21T03:59:10.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.863+0000 7f9990861640 1 --2- 172.21.15.46:0/2918369505 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f99780b66b0 0x7f99780b8bc0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:10.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.863+0000 7f9990861640 1 --2- 172.21.15.46:0/2918369505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f998c10de60 0x7f998c19fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:10.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.863+0000 7f9990861640 1 --2- 172.21.15.46:0/2918369505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f998c105380 0x7f998c19aa80 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:10.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.863+0000 7f9990861640 1 --2- 172.21.15.46:0/2918369505 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f998c104a30 0x7f998c19a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:10.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.863+0000 7f9990861640 1 -- 172.21.15.46:0/2918369505 >> 172.21.15.46:0/2918369505 conn(0x7f998c079760 msgr2=0x7f998c100850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:10.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.863+0000 7f9990861640 1 -- 172.21.15.46:0/2918369505 shutdown_connections 2024-09-21T03:59:10.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:10.863+0000 7f9990861640 1 -- 172.21.15.46:0/2918369505 wait complete. 2024-09-21T03:59:11.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:11 smithi046 ceph-mon[30954]: pgmap v444: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T03:59:11.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:11 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/2918369505' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:11.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:11 smithi105 ceph-mon[34773]: pgmap v444: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T03:59:11.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:11 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/2918369505' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:11.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:11 smithi162 ceph-mon[35071]: pgmap v444: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T03:59:11.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:11 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/2918369505' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:11.675 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:59:11.942 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:59:12.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.468+0000 7f177e69d640 1 -- 172.21.15.46:0/626919672 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1778108cf0 msgr2=0x7f177810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:12.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.468+0000 7f177e69d640 1 --2- 172.21.15.46:0/626919672 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1778108cf0 0x7f177810f520 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1770009ca0 tx=0x7f177002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.468+0000 7f177e69d640 1 -- 172.21.15.46:0/626919672 shutdown_connections 2024-09-21T03:59:12.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.468+0000 7f177e69d640 1 --2- 172.21.15.46:0/626919672 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1778108cf0 0x7f177810f520 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.468+0000 7f177e69d640 1 --2- 172.21.15.46:0/626919672 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17781083a0 0x7f17781087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.468+0000 7f177e69d640 1 --2- 172.21.15.46:0/626919672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1778102a60 0x7f1778102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.468+0000 7f177e69d640 1 -- 172.21.15.46:0/626919672 >> 172.21.15.46:0/626919672 conn(0x7f1778079730 msgr2=0x7f1778079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:12.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.468+0000 7f177e69d640 1 -- 172.21.15.46:0/626919672 shutdown_connections 2024-09-21T03:59:12.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.468+0000 7f177e69d640 1 -- 172.21.15.46:0/626919672 wait complete. 2024-09-21T03:59:12.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.469+0000 7f177e69d640 1 Processor -- start 2024-09-21T03:59:12.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.469+0000 7f177e69d640 1 -- start start 2024-09-21T03:59:12.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.470+0000 7f177e69d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1778102a60 0x7f17780ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:12.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.470+0000 7f177e69d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17781083a0 0x7f17780ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:12.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.470+0000 7f177e69d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1778108cf0 0x7f17781000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:12.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.470+0000 7f177e69d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1778112960 con 0x7f1778108cf0 2024-09-21T03:59:12.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.470+0000 7f177e69d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f17781127e0 con 0x7f17781083a0 2024-09-21T03:59:12.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.470+0000 7f177e69d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1778112ae0 con 0x7f1778102a60 2024-09-21T03:59:12.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.470+0000 7f177cc3a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1778108cf0 0x7f17781000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:12.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.470+0000 7f177cc3a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1778108cf0 0x7f17781000f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60926/0 (socket says 172.21.15.46:60926) 2024-09-21T03:59:12.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.470+0000 7f177cc3a640 1 -- 172.21.15.46:0/2091515809 learned_addr learned my addr 172.21.15.46:0/2091515809 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:12.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.470+0000 7f1777fff640 1 --2- 172.21.15.46:0/2091515809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1778102a60 0x7f17780ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:12.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.470+0000 7f17777fe640 1 --2- 172.21.15.46:0/2091515809 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17781083a0 0x7f17780ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:12.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.470+0000 7f177cc3a640 1 -- 172.21.15.46:0/2091515809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1778102a60 msgr2=0x7f17780ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:12.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.470+0000 7f177cc3a640 1 --2- 172.21.15.46:0/2091515809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1778102a60 0x7f17780ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.470+0000 7f177cc3a640 1 -- 172.21.15.46:0/2091515809 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17781083a0 msgr2=0x7f17780ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:12.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.470+0000 7f177cc3a640 1 --2- 172.21.15.46:0/2091515809 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17781083a0 0x7f17780ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.470+0000 7f177cc3a640 1 -- 172.21.15.46:0/2091515809 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17781a8780 con 0x7f1778108cf0 2024-09-21T03:59:12.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.470+0000 7f177cc3a640 1 --2- 172.21.15.46:0/2091515809 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1778108cf0 0x7f17781000f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f1770005cc0 tx=0x7f177002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:12.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.470+0000 7f17757fa640 1 -- 172.21.15.46:0/2091515809 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1770003bf0 con 0x7f1778108cf0 2024-09-21T03:59:12.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.470+0000 7f17757fa640 1 -- 172.21.15.46:0/2091515809 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1770003d90 con 0x7f1778108cf0 2024-09-21T03:59:12.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.470+0000 7f177e69d640 1 -- 172.21.15.46:0/2091515809 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17781a8a10 con 0x7f1778108cf0 2024-09-21T03:59:12.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.471+0000 7f17757fa640 1 -- 172.21.15.46:0/2091515809 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177002fbc0 con 0x7f1778108cf0 2024-09-21T03:59:12.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.471+0000 7f177e69d640 1 -- 172.21.15.46:0/2091515809 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17781a8f50 con 0x7f1778108cf0 2024-09-21T03:59:12.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.473+0000 7f1784c11740 1 Processor -- start 2024-09-21T03:59:12.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.473+0000 7f17757fa640 1 -- 172.21.15.46:0/2091515809 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f177002fd60 con 0x7f1778108cf0 2024-09-21T03:59:12.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.473+0000 7f1784c11740 1 -- start start 2024-09-21T03:59:12.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.474+0000 7f1784c11740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c7cd9d070 0x563c7d1442c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:12.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.474+0000 7f1784c11740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563c7cd741b0 0x563c7d144800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:12.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.474+0000 7f1784c11740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563c7cd7c390 0x563c7d144d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:12.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.474+0000 7f1784c11740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x563c7d0baea0 con 0x563c7cd7c390 2024-09-21T03:59:12.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.474+0000 7f1784c11740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x563c7d0aa2d0 con 0x563c7cd741b0 2024-09-21T03:59:12.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.474+0000 7f1784c11740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563c7d0ae0e0 con 0x563c7cd9d070 2024-09-21T03:59:12.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.474+0000 7f17777fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563c7cd7c390 0x563c7d144d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:12.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.474+0000 7f17777fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563c7cd7c390 0x563c7d144d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60938/0 (socket says 172.21.15.46:60938) 2024-09-21T03:59:12.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.474+0000 7f17777fe640 1 -- 172.21.15.46:0/1880594323 learned_addr learned my addr 172.21.15.46:0/1880594323 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:12.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.474+0000 7f1777fff640 1 --2- 172.21.15.46:0/1880594323 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563c7cd741b0 0x563c7d144800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:12.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.474+0000 7f17777fe640 1 --2- 172.21.15.46:0/1880594323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c7cd9d070 0x563c7d1442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:12.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.474+0000 7f17777fe640 1 -- 172.21.15.46:0/1880594323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c7cd9d070 msgr2=0x563c7d1442c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:12.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.474+0000 7f17777fe640 1 --2- 172.21.15.46:0/1880594323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c7cd9d070 0x563c7d1442c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.474+0000 7f17777fe640 1 -- 172.21.15.46:0/1880594323 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563c7cd741b0 msgr2=0x563c7d144800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:12.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.474+0000 7f17777fe640 1 --2- 172.21.15.46:0/1880594323 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563c7cd741b0 0x563c7d144800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.474+0000 7f17777fe640 1 -- 172.21.15.46:0/1880594323 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c7ce08650 con 0x563c7cd7c390 2024-09-21T03:59:12.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.474+0000 7f1777fff640 1 --2- 172.21.15.46:0/1880594323 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563c7cd741b0 0x563c7d144800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:59:12.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.474+0000 7f17757fa640 1 --2- 172.21.15.46:0/2091515809 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f17600b6680 0x7f17600b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:12.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.474+0000 7f17777fe640 1 --2- 172.21.15.46:0/1880594323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563c7cd7c390 0x563c7d144d40 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f176c00cf60 tx=0x7f176c00c610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5abde80968df14 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:12.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.475+0000 7f1777fff640 1 --2- 172.21.15.46:0/2091515809 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f17600b6680 0x7f17600b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:12.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.475+0000 7f175e7fc640 1 -- 172.21.15.46:0/1880594323 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176c019030 con 0x563c7cd7c390 2024-09-21T03:59:12.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.475+0000 7f17757fa640 1 -- 172.21.15.46:0/2091515809 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f1770108c00 con 0x7f1778108cf0 2024-09-21T03:59:12.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.475+0000 7f175e7fc640 1 -- 172.21.15.46:0/1880594323 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f176c0119d0 con 0x563c7cd7c390 2024-09-21T03:59:12.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.475+0000 7f175e7fc640 1 -- 172.21.15.46:0/1880594323 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176c00f9a0 con 0x563c7cd7c390 2024-09-21T03:59:12.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.476+0000 7f1784c11740 1 -- 172.21.15.46:0/1880594323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563c7cd7c390 msgr2=0x563c7d144d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:12.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.476+0000 7f1784c11740 1 --2- 172.21.15.46:0/1880594323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563c7cd7c390 0x563c7d144d40 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f176c00cf60 tx=0x7f176c00c610 comp rx=0 tx=0).stop 2024-09-21T03:59:12.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.476+0000 7f1777fff640 1 --2- 172.21.15.46:0/2091515809 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f17600b6680 0x7f17600b8b90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x563c7d142f40 tx=0x7f176800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:12.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.476+0000 7f1784c11740 1 -- 172.21.15.46:0/1880594323 shutdown_connections 2024-09-21T03:59:12.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.476+0000 7f1784c11740 1 --2- 172.21.15.46:0/1880594323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563c7cd7c390 0x563c7d144d40 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.476+0000 7f1784c11740 1 --2- 172.21.15.46:0/1880594323 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563c7cd741b0 0x563c7d144800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.476+0000 7f1784c11740 1 --2- 172.21.15.46:0/1880594323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c7cd9d070 0x563c7d1442c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.476+0000 7f1784c11740 1 -- 172.21.15.46:0/1880594323 >> 172.21.15.46:0/1880594323 conn(0x563c7cd91460 msgr2=0x563c7d1421b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:12.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.476+0000 7f1784c11740 1 -- 172.21.15.46:0/1880594323 shutdown_connections 2024-09-21T03:59:12.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.476+0000 7f1784c11740 1 -- 172.21.15.46:0/1880594323 wait complete. 2024-09-21T03:59:12.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.476+0000 7f1784c11740 1 -- start start 2024-09-21T03:59:12.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.476+0000 7f1784c11740 1 Processor -- start 2024-09-21T03:59:12.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.477+0000 7f1784c11740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563c7cd741b0 0x563c7d14f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:12.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.477+0000 7f1784c11740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563c7cd7c390 0x563c7d14ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:12.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.477+0000 7f1784c11740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c7cd9d070 0x563c7d15bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:12.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.477+0000 7f1784c11740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x563c7cf0b700 con 0x563c7cd741b0 2024-09-21T03:59:12.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.477+0000 7f1784c11740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x563c7d045160 con 0x563c7cd7c390 2024-09-21T03:59:12.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.477+0000 7f1784c11740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563c7d152aa0 con 0x563c7cd9d070 2024-09-21T03:59:12.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.477+0000 7f1784c11740 10 client.0 _ll_register_callbacks cb 0x563c7d05e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:59:12.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.477+0000 7f1777fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563c7cd741b0 0x563c7d14f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:12.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.477+0000 7f1777fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563c7cd741b0 0x563c7d14f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60950/0 (socket says 172.21.15.46:60950) 2024-09-21T03:59:12.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.477+0000 7f1777fff640 1 -- 172.21.15.46:0/3897539925 learned_addr learned my addr 172.21.15.46:0/3897539925 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:12.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.477+0000 7f17777fe640 1 --2- 172.21.15.46:0/3897539925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563c7cd7c390 0x563c7d14ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:12.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.477+0000 7f177cc3a640 1 --2- 172.21.15.46:0/3897539925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c7cd9d070 0x563c7d15bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:12.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.477+0000 7f1777fff640 1 -- 172.21.15.46:0/3897539925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c7cd9d070 msgr2=0x563c7d15bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:12.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.477+0000 7f1777fff640 1 --2- 172.21.15.46:0/3897539925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c7cd9d070 0x563c7d15bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.477+0000 7f1777fff640 1 -- 172.21.15.46:0/3897539925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563c7cd7c390 msgr2=0x563c7d14ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:12.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.477+0000 7f1777fff640 1 --2- 172.21.15.46:0/3897539925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563c7cd7c390 0x563c7d14ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.477+0000 7f1777fff640 1 -- 172.21.15.46:0/3897539925 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c7d072c90 con 0x563c7cd741b0 2024-09-21T03:59:12.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.477+0000 7f1777fff640 1 --2- 172.21.15.46:0/3897539925 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563c7cd741b0 0x563c7d14f9d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f1768010790 tx=0x7f17680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8df2ab93b5f47048 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:12.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.477+0000 7f17577fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:59:12.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.478+0000 7f17577fe640 1 -- 172.21.15.46:0/3897539925 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176800f990 con 0x563c7cd741b0 2024-09-21T03:59:12.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.478+0000 7f17577fe640 1 -- 172.21.15.46:0/3897539925 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f176800fb30 con 0x563c7cd741b0 2024-09-21T03:59:12.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.478+0000 7f1784c11740 1 -- 172.21.15.46:0/3897539925 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f176c0119d0 con 0x563c7cd741b0 2024-09-21T03:59:12.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.478+0000 7f17577fe640 1 -- 172.21.15.46:0/3897539925 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f176802c030 con 0x563c7cd741b0 2024-09-21T03:59:12.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.478+0000 7f1784c11740 10 client.16059 fetch_fsmap learned FSMap version 20 2024-09-21T03:59:12.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.478+0000 7f1784c11740 1 -- 172.21.15.46:0/3897539925 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x563c7d15e8f0 con 0x563c7cd741b0 2024-09-21T03:59:12.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.478+0000 7f17577fe640 1 -- 172.21.15.46:0/3897539925 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f176c0119d0 con 0x563c7cd741b0 2024-09-21T03:59:12.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.478+0000 7f17577fe640 1 -- 172.21.15.46:0/3897539925 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f1768027400 con 0x563c7cd741b0 2024-09-21T03:59:12.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.478+0000 7f1784c11740 10 client.16059 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:59:12.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.478+0000 7f1784c11740 10 client.16059 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:59:12.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.478+0000 7f1784c11740 20 client.16059 populate_metadata read hostname 'smithi046' 2024-09-21T03:59:12.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.478+0000 7f1784c11740 1 --2- 172.21.15.46:0/3897539925 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x563c7cd5b9f0 0x563c7d161e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:12.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.478+0000 7f1784c11740 4 client.16059 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:59:12.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.478+0000 7f1784c11740 1 -- 172.21.15.46:0/3897539925 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c7d0bcdf0 con 0x563c7cd5b9f0 2024-09-21T03:59:12.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.479+0000 7f17777fe640 1 --2- 172.21.15.46:0/3897539925 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x563c7cd5b9f0 0x563c7d161e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:12.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.479+0000 7f17777fe640 1 --2- 172.21.15.46:0/3897539925 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x563c7cd5b9f0 0x563c7d161e20 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5fb40b12cbf5643 server_cookie=42a13eb445b386f9 in_seq=0 out_seq=0 2024-09-21T03:59:12.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.479+0000 7f17577fe640 10 client.16059 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:59:12.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.480+0000 7f17577fe640 1 -- 172.21.15.46:0/3897539925 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563c7d0bcdf0 con 0x563c7cd5b9f0 2024-09-21T03:59:12.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.480+0000 7f17577fe640 10 client.16059 handle_command_reply: tid=0 2024-09-21T03:59:12.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.480+0000 7f1784c11740 1 client.16059 shutdown 2024-09-21T03:59:12.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.480+0000 7f1784c11740 1 -- 172.21.15.46:0/3897539925 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563c7cd741b0 msgr2=0x563c7d14f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:12.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.480+0000 7f1784c11740 1 --2- 172.21.15.46:0/3897539925 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563c7cd741b0 0x563c7d14f9d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f1768010790 tx=0x7f17680046c0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.480+0000 7f1784c11740 1 -- 172.21.15.46:0/3897539925 shutdown_connections 2024-09-21T03:59:12.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.480+0000 7f1784c11740 1 --2- 172.21.15.46:0/3897539925 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x563c7cd5b9f0 0x563c7d161e20 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.480+0000 7f1784c11740 1 --2- 172.21.15.46:0/3897539925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c7cd9d070 0x563c7d15bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.480+0000 7f1784c11740 1 --2- 172.21.15.46:0/3897539925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563c7cd7c390 0x563c7d14ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.480+0000 7f17577fe640 0 client.16059 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:59:12.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.480+0000 7f1784c11740 1 --2- 172.21.15.46:0/3897539925 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563c7cd741b0 0x563c7d14f9d0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.480+0000 7f1784c11740 1 -- 172.21.15.46:0/3897539925 >> 172.21.15.46:0/3897539925 conn(0x563c7cd91460 msgr2=0x563c7d147450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:12.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.480+0000 7f1784c11740 1 -- 172.21.15.46:0/3897539925 shutdown_connections 2024-09-21T03:59:12.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.481+0000 7f1784c11740 1 -- 172.21.15.46:0/3897539925 wait complete. 2024-09-21T03:59:12.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.481+0000 7f1784c11740 20 client.16059 trim_cache size 0 max 16384 2024-09-21T03:59:12.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.494+0000 7f1784c11740 1 Processor -- start 2024-09-21T03:59:12.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.494+0000 7f1784c11740 1 -- start start 2024-09-21T03:59:12.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.494+0000 7f1784c11740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c7cd5b9f0 0x563c7d14fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:12.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.494+0000 7f1784c11740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563c7cd741b0 0x563c7d1473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:12.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.494+0000 7f1784c11740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563c7cd7c390 0x563c7d147900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:12.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.494+0000 7f1784c11740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f17781af610 con 0x563c7cd741b0 2024-09-21T03:59:12.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.494+0000 7f1784c11740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f17781b1eb0 con 0x563c7cd7c390 2024-09-21T03:59:12.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.494+0000 7f1784c11740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f17781afca0 con 0x563c7cd5b9f0 2024-09-21T03:59:12.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.494+0000 7f17777fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563c7cd741b0 0x563c7d1473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:12.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.494+0000 7f17777fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563c7cd741b0 0x563c7d1473c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60954/0 (socket says 172.21.15.46:60954) 2024-09-21T03:59:12.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.494+0000 7f17777fe640 1 -- 172.21.15.46:0/1190510516 learned_addr learned my addr 172.21.15.46:0/1190510516 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:12.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.494+0000 7f177cc3a640 1 --2- 172.21.15.46:0/1190510516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563c7cd7c390 0x563c7d147900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:12.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.494+0000 7f1777fff640 1 --2- 172.21.15.46:0/1190510516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c7cd5b9f0 0x563c7d14fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:12.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.495+0000 7f17777fe640 1 -- 172.21.15.46:0/1190510516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c7cd5b9f0 msgr2=0x563c7d14fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:12.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.495+0000 7f17777fe640 1 --2- 172.21.15.46:0/1190510516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c7cd5b9f0 0x563c7d14fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.495+0000 7f17777fe640 1 -- 172.21.15.46:0/1190510516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563c7cd7c390 msgr2=0x563c7d147900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:12.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.495+0000 7f17777fe640 1 --2- 172.21.15.46:0/1190510516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563c7cd7c390 0x563c7d147900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.495+0000 7f17777fe640 1 -- 172.21.15.46:0/1190510516 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c7d14ec10 con 0x563c7cd741b0 2024-09-21T03:59:12.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.495+0000 7f177cc3a640 1 --2- 172.21.15.46:0/1190510516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563c7cd7c390 0x563c7d147900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:59:12.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.495+0000 7f17777fe640 1 --2- 172.21.15.46:0/1190510516 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563c7cd741b0 0x563c7d1473c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f176c015ff0 tx=0x7f176c00f440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f8c875687e1062a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:12.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.495+0000 7f175dffb640 1 -- 172.21.15.46:0/1190510516 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176c019040 con 0x563c7cd741b0 2024-09-21T03:59:12.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.495+0000 7f175dffb640 1 -- 172.21.15.46:0/1190510516 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f176c00fdf0 con 0x563c7cd741b0 2024-09-21T03:59:12.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.495+0000 7f175dffb640 1 -- 172.21.15.46:0/1190510516 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176c005470 con 0x563c7cd741b0 2024-09-21T03:59:12.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.496+0000 7f1784c11740 1 -- 172.21.15.46:0/1190510516 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563c7cd741b0 msgr2=0x563c7d1473c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:12.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.496+0000 7f1784c11740 1 --2- 172.21.15.46:0/1190510516 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563c7cd741b0 0x563c7d1473c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f176c015ff0 tx=0x7f176c00f440 comp rx=0 tx=0).stop 2024-09-21T03:59:12.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.496+0000 7f1784c11740 1 -- 172.21.15.46:0/1190510516 shutdown_connections 2024-09-21T03:59:12.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.496+0000 7f1784c11740 1 --2- 172.21.15.46:0/1190510516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563c7cd7c390 0x563c7d147900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.496+0000 7f1784c11740 1 --2- 172.21.15.46:0/1190510516 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563c7cd741b0 0x563c7d1473c0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.496+0000 7f1784c11740 1 --2- 172.21.15.46:0/1190510516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c7cd5b9f0 0x563c7d14fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.496+0000 7f1784c11740 1 -- 172.21.15.46:0/1190510516 >> 172.21.15.46:0/1190510516 conn(0x563c7cd91460 msgr2=0x563c7d14f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:12.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.496+0000 7f1784c11740 1 -- 172.21.15.46:0/1190510516 shutdown_connections 2024-09-21T03:59:12.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.496+0000 7f1784c11740 1 -- 172.21.15.46:0/1190510516 wait complete. 2024-09-21T03:59:12.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.496+0000 7f1784c11740 1 -- start start 2024-09-21T03:59:12.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.497+0000 7f1784c11740 1 Processor -- start 2024-09-21T03:59:12.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.497+0000 7f1784c11740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c7cd5b9f0 0x563c7d158720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:12.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.497+0000 7f1784c11740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563c7cd741b0 0x563c7d153c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:12.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.497+0000 7f1784c11740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563c7cd7c390 0x563c7d154320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:12.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.497+0000 7f1784c11740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f17781b0370 con 0x563c7cd7c390 2024-09-21T03:59:12.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.497+0000 7f1784c11740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f17781b17e0 con 0x563c7cd741b0 2024-09-21T03:59:12.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.497+0000 7f1784c11740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f17781b0a40 con 0x563c7cd5b9f0 2024-09-21T03:59:12.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.497+0000 7f1784c11740 10 client.0 _ll_register_callbacks cb 0x7f176800bee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:59:12.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.497+0000 7f177cc3a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563c7cd7c390 0x563c7d154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:12.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.497+0000 7f177cc3a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563c7cd7c390 0x563c7d154320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60958/0 (socket says 172.21.15.46:60958) 2024-09-21T03:59:12.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.497+0000 7f177cc3a640 1 -- 172.21.15.46:0/1041794425 learned_addr learned my addr 172.21.15.46:0/1041794425 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:12.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.497+0000 7f17777fe640 1 --2- 172.21.15.46:0/1041794425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563c7cd741b0 0x563c7d153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:12.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.497+0000 7f1777fff640 1 --2- 172.21.15.46:0/1041794425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c7cd5b9f0 0x563c7d158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:12.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.498+0000 7f177cc3a640 1 -- 172.21.15.46:0/1041794425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c7cd5b9f0 msgr2=0x563c7d158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:12.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.498+0000 7f177cc3a640 1 --2- 172.21.15.46:0/1041794425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c7cd5b9f0 0x563c7d158720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.498+0000 7f177cc3a640 1 -- 172.21.15.46:0/1041794425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563c7cd741b0 msgr2=0x563c7d153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:12.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.498+0000 7f177cc3a640 1 --2- 172.21.15.46:0/1041794425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563c7cd741b0 0x563c7d153c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.498+0000 7f177cc3a640 1 -- 172.21.15.46:0/1041794425 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c7d1cb7e0 con 0x563c7cd7c390 2024-09-21T03:59:12.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.498+0000 7f177cc3a640 1 --2- 172.21.15.46:0/1041794425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563c7cd7c390 0x563c7d154320 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f1770006010 tx=0x7f17700ce440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44271021b08d1ab0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:12.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.498+0000 7f17577fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:59:12.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.498+0000 7f17577fe640 1 -- 172.21.15.46:0/1041794425 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17700ce600 con 0x563c7cd7c390 2024-09-21T03:59:12.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.498+0000 7f17577fe640 1 -- 172.21.15.46:0/1041794425 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f1770106b40 con 0x563c7cd7c390 2024-09-21T03:59:12.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.498+0000 7f1784c11740 1 -- 172.21.15.46:0/1041794425 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f176c00fdf0 con 0x563c7cd7c390 2024-09-21T03:59:12.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.498+0000 7f17577fe640 1 -- 172.21.15.46:0/1041794425 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f17700cb140 con 0x563c7cd7c390 2024-09-21T03:59:12.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.498+0000 7f1784c11740 10 client.16065 fetch_fsmap learned FSMap version 20 2024-09-21T03:59:12.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.498+0000 7f1784c11740 1 -- 172.21.15.46:0/1041794425 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x563c7d1cc990 con 0x563c7cd7c390 2024-09-21T03:59:12.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.498+0000 7f17577fe640 1 -- 172.21.15.46:0/1041794425 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f176c00fdf0 con 0x563c7cd7c390 2024-09-21T03:59:12.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.499+0000 7f17577fe640 1 -- 172.21.15.46:0/1041794425 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f17700d3200 con 0x563c7cd7c390 2024-09-21T03:59:12.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.499+0000 7f1784c11740 10 client.16065 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:59:12.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.499+0000 7f1784c11740 10 client.16065 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:59:12.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.499+0000 7f1784c11740 20 client.16065 populate_metadata read hostname 'smithi046' 2024-09-21T03:59:12.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.499+0000 7f1784c11740 1 --2- 172.21.15.46:0/1041794425 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x563c7cd9d070 0x563c7d1cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:12.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.499+0000 7f1784c11740 4 client.16065 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:59:12.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.499+0000 7f1784c11740 1 -- 172.21.15.46:0/1041794425 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563c7d0b88a0 con 0x563c7cd9d070 2024-09-21T03:59:12.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.499+0000 7f1777fff640 1 --2- 172.21.15.46:0/1041794425 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x563c7cd9d070 0x563c7d1cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:12.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.499+0000 7f17577fe640 10 client.16065 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:59:12.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.499+0000 7f1777fff640 1 --2- 172.21.15.46:0/1041794425 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x563c7cd9d070 0x563c7d1cf0d0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7453537cc3d0d8b3 server_cookie=5742fbcd80385202 in_seq=0 out_seq=0 2024-09-21T03:59:12.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.500+0000 7f17577fe640 1 -- 172.21.15.46:0/1041794425 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563c7d0b88a0 con 0x563c7cd9d070 2024-09-21T03:59:12.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.500+0000 7f17577fe640 10 client.16065 handle_command_reply: tid=0 2024-09-21T03:59:12.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.500+0000 7f1784c11740 1 client.16065 shutdown 2024-09-21T03:59:12.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.500+0000 7f1784c11740 1 -- 172.21.15.46:0/1041794425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563c7cd7c390 msgr2=0x563c7d154320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:12.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.500+0000 7f1784c11740 1 --2- 172.21.15.46:0/1041794425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563c7cd7c390 0x563c7d154320 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f1770006010 tx=0x7f17700ce440 comp rx=0 tx=0).stop 2024-09-21T03:59:12.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.500+0000 7f1784c11740 1 -- 172.21.15.46:0/1041794425 shutdown_connections 2024-09-21T03:59:12.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.500+0000 7f1784c11740 1 --2- 172.21.15.46:0/1041794425 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x563c7cd9d070 0x563c7d1cf0d0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.500+0000 7f1784c11740 1 --2- 172.21.15.46:0/1041794425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563c7cd7c390 0x563c7d154320 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.500+0000 7f1784c11740 1 --2- 172.21.15.46:0/1041794425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563c7cd741b0 0x563c7d153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.500+0000 7f1784c11740 1 --2- 172.21.15.46:0/1041794425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563c7cd5b9f0 0x563c7d158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.500+0000 7f17577fe640 0 client.16065 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:59:12.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.500+0000 7f1784c11740 1 -- 172.21.15.46:0/1041794425 >> 172.21.15.46:0/1041794425 conn(0x563c7cd91460 msgr2=0x563c7d147390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:12.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.500+0000 7f1784c11740 1 -- 172.21.15.46:0/1041794425 shutdown_connections 2024-09-21T03:59:12.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.500+0000 7f1784c11740 1 -- 172.21.15.46:0/1041794425 wait complete. 2024-09-21T03:59:12.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.500+0000 7f1784c11740 20 client.16065 trim_cache size 0 max 16384 2024-09-21T03:59:12.508 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-21T03:59:12.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.501+0000 7f177e69d640 1 -- 172.21.15.46:0/2091515809 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f17600b6680 msgr2=0x7f17600b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:12.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.501+0000 7f177e69d640 1 --2- 172.21.15.46:0/2091515809 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f17600b6680 0x7f17600b8b90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x563c7d142f40 tx=0x7f176800b390 comp rx=0 tx=0).stop 2024-09-21T03:59:12.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.501+0000 7f177e69d640 1 -- 172.21.15.46:0/2091515809 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1778108cf0 msgr2=0x7f17781000f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:12.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.501+0000 7f177e69d640 1 --2- 172.21.15.46:0/2091515809 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1778108cf0 0x7f17781000f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f1770005cc0 tx=0x7f177002f380 comp rx=0 tx=0).stop 2024-09-21T03:59:12.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.501+0000 7f177e69d640 1 -- 172.21.15.46:0/2091515809 shutdown_connections 2024-09-21T03:59:12.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.501+0000 7f177e69d640 1 --2- 172.21.15.46:0/2091515809 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1778108cf0 0x7f17781000f0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.501+0000 7f177e69d640 1 --2- 172.21.15.46:0/2091515809 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17781083a0 0x7f17780ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.501+0000 7f177e69d640 1 --2- 172.21.15.46:0/2091515809 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f17600b6680 0x7f17600b8b90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.501+0000 7f177e69d640 1 --2- 172.21.15.46:0/2091515809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1778102a60 0x7f17780ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.501+0000 7f177e69d640 1 -- 172.21.15.46:0/2091515809 >> 172.21.15.46:0/2091515809 conn(0x7f1778079730 msgr2=0x7f1778101a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:12.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.501+0000 7f177e69d640 1 -- 172.21.15.46:0/2091515809 shutdown_connections 2024-09-21T03:59:12.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:12.501+0000 7f177e69d640 1 -- 172.21.15.46:0/2091515809 wait complete. 2024-09-21T03:59:13.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:13 smithi046 ceph-mon[30954]: pgmap v445: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T03:59:13.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:13 smithi105 ceph-mon[34773]: pgmap v445: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T03:59:13.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:13 smithi162 ceph-mon[35071]: pgmap v445: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T03:59:14.179 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:59:14.179 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:59:14.456 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:59:14.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.914+0000 7f6558f13640 1 -- 172.21.15.46:0/2634333104 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65541083a0 msgr2=0x7f65541087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:14.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.914+0000 7f6558f13640 1 --2- 172.21.15.46:0/2634333104 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65541083a0 0x7f65541087b0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f6548009900 tx=0x7f654802a410 comp rx=0 tx=0).stop 2024-09-21T03:59:14.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.914+0000 7f6558f13640 1 -- 172.21.15.46:0/2634333104 shutdown_connections 2024-09-21T03:59:14.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.914+0000 7f6558f13640 1 --2- 172.21.15.46:0/2634333104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6554108cf0 0x7f655410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.914+0000 7f6558f13640 1 --2- 172.21.15.46:0/2634333104 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65541083a0 0x7f65541087b0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.914+0000 7f6558f13640 1 --2- 172.21.15.46:0/2634333104 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6554102a60 0x7f6554102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.914+0000 7f6558f13640 1 -- 172.21.15.46:0/2634333104 >> 172.21.15.46:0/2634333104 conn(0x7f6554079730 msgr2=0x7f6554079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:14.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.914+0000 7f6558f13640 1 -- 172.21.15.46:0/2634333104 shutdown_connections 2024-09-21T03:59:14.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.914+0000 7f6558f13640 1 -- 172.21.15.46:0/2634333104 wait complete. 2024-09-21T03:59:14.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.915+0000 7f6558f13640 1 Processor -- start 2024-09-21T03:59:14.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.915+0000 7f6558f13640 1 -- start start 2024-09-21T03:59:14.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.915+0000 7f6558f13640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6554102a60 0x7f655419b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:14.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.915+0000 7f6558f13640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65541083a0 0x7f655419b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:14.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.915+0000 7f6558f13640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6554108cf0 0x7f655419bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:14.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.916+0000 7f6558f13640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6554112960 con 0x7f65541083a0 2024-09-21T03:59:14.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.916+0000 7f6558f13640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f65541127e0 con 0x7f6554108cf0 2024-09-21T03:59:14.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.916+0000 7f6558f13640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6554112ae0 con 0x7f6554102a60 2024-09-21T03:59:14.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.916+0000 7f6551d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65541083a0 0x7f655419b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:14.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.916+0000 7f6551d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65541083a0 0x7f655419b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60974/0 (socket says 172.21.15.46:60974) 2024-09-21T03:59:14.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.916+0000 7f6551d9b640 1 -- 172.21.15.46:0/2684346217 learned_addr learned my addr 172.21.15.46:0/2684346217 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:14.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.916+0000 7f655259c640 1 --2- 172.21.15.46:0/2684346217 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6554102a60 0x7f655419b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:14.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.916+0000 7f6552d9d640 1 --2- 172.21.15.46:0/2684346217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6554108cf0 0x7f655419bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:14.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.916+0000 7f6551d9b640 1 -- 172.21.15.46:0/2684346217 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6554102a60 msgr2=0x7f655419b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:14.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.916+0000 7f6551d9b640 1 --2- 172.21.15.46:0/2684346217 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6554102a60 0x7f655419b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.916+0000 7f6551d9b640 1 -- 172.21.15.46:0/2684346217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6554108cf0 msgr2=0x7f655419bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:14.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.916+0000 7f6551d9b640 1 --2- 172.21.15.46:0/2684346217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6554108cf0 0x7f655419bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.916+0000 7f6551d9b640 1 -- 172.21.15.46:0/2684346217 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65541a6580 con 0x7f65541083a0 2024-09-21T03:59:14.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.916+0000 7f6551d9b640 1 --2- 172.21.15.46:0/2684346217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65541083a0 0x7f655419b830 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f6548032fd0 tx=0x7f6548004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:14.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.917+0000 7f65437fe640 1 -- 172.21.15.46:0/2684346217 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f654803f030 con 0x7f65541083a0 2024-09-21T03:59:14.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.917+0000 7f6558f13640 1 -- 172.21.15.46:0/2684346217 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65541a6810 con 0x7f65541083a0 2024-09-21T03:59:14.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.917+0000 7f65437fe640 1 -- 172.21.15.46:0/2684346217 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6548004490 con 0x7f65541083a0 2024-09-21T03:59:14.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.917+0000 7f65437fe640 1 -- 172.21.15.46:0/2684346217 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6548035070 con 0x7f65541083a0 2024-09-21T03:59:14.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.917+0000 7f6558f13640 1 -- 172.21.15.46:0/2684346217 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65541a6cf0 con 0x7f65541083a0 2024-09-21T03:59:14.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.919+0000 7f655f487740 1 Processor -- start 2024-09-21T03:59:14.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.919+0000 7f655f487740 1 -- start start 2024-09-21T03:59:14.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.920+0000 7f65437fe640 1 -- 172.21.15.46:0/2684346217 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f6548042030 con 0x7f65541083a0 2024-09-21T03:59:14.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.920+0000 7f655f487740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0e9a53350 0x55a0e9dfa430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:14.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.920+0000 7f655f487740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0e9a2a490 0x55a0e9dfa970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:14.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.920+0000 7f655f487740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e9a32670 0x55a0e9dfaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:14.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.920+0000 7f655f487740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55a0e9d70e60 con 0x55a0e9a32670 2024-09-21T03:59:14.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.920+0000 7f655f487740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55a0e9d60290 con 0x55a0e9a53350 2024-09-21T03:59:14.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.920+0000 7f655f487740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a0e9d640a0 con 0x55a0e9a2a490 2024-09-21T03:59:14.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.920+0000 7f6551d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e9a32670 0x55a0e9dfaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:14.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.920+0000 7f6551d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e9a32670 0x55a0e9dfaeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60982/0 (socket says 172.21.15.46:60982) 2024-09-21T03:59:14.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.920+0000 7f6551d9b640 1 -- 172.21.15.46:0/2907102008 learned_addr learned my addr 172.21.15.46:0/2907102008 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:14.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.920+0000 7f6552d9d640 1 --2- 172.21.15.46:0/2907102008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0e9a53350 0x55a0e9dfa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:14.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.920+0000 7f655259c640 1 --2- 172.21.15.46:0/2907102008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0e9a2a490 0x55a0e9dfa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:14.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.920+0000 7f6551d9b640 1 -- 172.21.15.46:0/2907102008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0e9a2a490 msgr2=0x55a0e9dfa970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:14.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.920+0000 7f6551d9b640 1 --2- 172.21.15.46:0/2907102008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0e9a2a490 0x55a0e9dfa970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.920+0000 7f6551d9b640 1 -- 172.21.15.46:0/2907102008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0e9a53350 msgr2=0x55a0e9dfa430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:14.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.920+0000 7f6551d9b640 1 --2- 172.21.15.46:0/2907102008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0e9a53350 0x55a0e9dfa430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.920+0000 7f6551d9b640 1 -- 172.21.15.46:0/2907102008 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0e9abe930 con 0x55a0e9a32670 2024-09-21T03:59:14.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.921+0000 7f65437fe640 1 --2- 172.21.15.46:0/2684346217 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f653c0b66b0 0x7f653c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:14.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.921+0000 7f6551d9b640 1 --2- 172.21.15.46:0/2907102008 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e9a32670 0x55a0e9dfaeb0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f6548105200 tx=0x7f654810bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d837386ec1e2c02 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:14.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.921+0000 7f6552d9d640 1 --2- 172.21.15.46:0/2684346217 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f653c0b66b0 0x7f653c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:14.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.921+0000 7f65437fe640 1 -- 172.21.15.46:0/2684346217 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f6548107ad0 con 0x7f65541083a0 2024-09-21T03:59:14.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.921+0000 7f6540ff9640 1 -- 172.21.15.46:0/2907102008 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65480ca0c0 con 0x55a0e9a32670 2024-09-21T03:59:14.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.921+0000 7f6540ff9640 1 -- 172.21.15.46:0/2907102008 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f654810f040 con 0x55a0e9a32670 2024-09-21T03:59:14.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.921+0000 7f6540ff9640 1 -- 172.21.15.46:0/2907102008 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65480cd1e0 con 0x55a0e9a32670 2024-09-21T03:59:14.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.922+0000 7f655f487740 1 -- 172.21.15.46:0/2907102008 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e9a32670 msgr2=0x55a0e9dfaeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:14.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.922+0000 7f6552d9d640 1 --2- 172.21.15.46:0/2684346217 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f653c0b66b0 0x7f653c0b8bc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f654c00b6c0 tx=0x7f654c00b2e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:14.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.922+0000 7f655f487740 1 --2- 172.21.15.46:0/2907102008 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e9a32670 0x55a0e9dfaeb0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f6548105200 tx=0x7f654810bd40 comp rx=0 tx=0).stop 2024-09-21T03:59:14.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.922+0000 7f655f487740 1 -- 172.21.15.46:0/2907102008 shutdown_connections 2024-09-21T03:59:14.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.922+0000 7f655f487740 1 --2- 172.21.15.46:0/2907102008 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e9a32670 0x55a0e9dfaeb0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.922+0000 7f655f487740 1 --2- 172.21.15.46:0/2907102008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0e9a2a490 0x55a0e9dfa970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.922+0000 7f655f487740 1 --2- 172.21.15.46:0/2907102008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0e9a53350 0x55a0e9dfa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.922+0000 7f655f487740 1 -- 172.21.15.46:0/2907102008 >> 172.21.15.46:0/2907102008 conn(0x55a0e9a47740 msgr2=0x55a0e9df8320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:14.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.922+0000 7f655f487740 1 -- 172.21.15.46:0/2907102008 shutdown_connections 2024-09-21T03:59:14.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.922+0000 7f655f487740 1 -- 172.21.15.46:0/2907102008 wait complete. 2024-09-21T03:59:14.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.923+0000 7f655f487740 1 -- start start 2024-09-21T03:59:14.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.923+0000 7f655f487740 1 Processor -- start 2024-09-21T03:59:14.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.923+0000 7f655f487740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0e9a2a490 0x55a0e9e06040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:14.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.923+0000 7f655f487740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e9a32670 0x55a0e9e065c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:14.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.923+0000 7f655f487740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0e9a53350 0x55a0e9e11c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:14.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.923+0000 7f655f487740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55a0e9bc1890 con 0x55a0e9a32670 2024-09-21T03:59:14.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.923+0000 7f655f487740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55a0e9cfad40 con 0x55a0e9a53350 2024-09-21T03:59:14.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.923+0000 7f655f487740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a0e9e089d0 con 0x55a0e9a2a490 2024-09-21T03:59:14.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.923+0000 7f655f487740 10 client.0 _ll_register_callbacks cb 0x55a0e9d5ec80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:59:14.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.923+0000 7f6551d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e9a32670 0x55a0e9e065c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:14.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.923+0000 7f6551d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e9a32670 0x55a0e9e065c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60986/0 (socket says 172.21.15.46:60986) 2024-09-21T03:59:14.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.923+0000 7f6551d9b640 1 -- 172.21.15.46:0/256475714 learned_addr learned my addr 172.21.15.46:0/256475714 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:14.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.923+0000 7f655259c640 1 --2- 172.21.15.46:0/256475714 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0e9a2a490 0x55a0e9e06040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:14.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.923+0000 7f6552d9d640 1 --2- 172.21.15.46:0/256475714 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0e9a53350 0x55a0e9e11c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:14.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.924+0000 7f6551d9b640 1 -- 172.21.15.46:0/256475714 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0e9a2a490 msgr2=0x55a0e9e06040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:14.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.924+0000 7f6551d9b640 1 --2- 172.21.15.46:0/256475714 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0e9a2a490 0x55a0e9e06040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.924+0000 7f6551d9b640 1 -- 172.21.15.46:0/256475714 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0e9a53350 msgr2=0x55a0e9e11c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:14.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.924+0000 7f6551d9b640 1 --2- 172.21.15.46:0/256475714 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0e9a53350 0x55a0e9e11c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.924+0000 7f6551d9b640 1 -- 172.21.15.46:0/256475714 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0e9e12240 con 0x55a0e9a32670 2024-09-21T03:59:14.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.924+0000 7f6551d9b640 1 --2- 172.21.15.46:0/256475714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e9a32670 0x55a0e9e065c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f654803b690 tx=0x7f654803b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=240267432389ca9a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:14.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.924+0000 7f6539ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:59:14.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.924+0000 7f6539ffb640 1 -- 172.21.15.46:0/256475714 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6548049070 con 0x55a0e9a32670 2024-09-21T03:59:14.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.924+0000 7f6539ffb640 1 -- 172.21.15.46:0/256475714 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f6548105540 con 0x55a0e9a32670 2024-09-21T03:59:14.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.924+0000 7f655f487740 1 -- 172.21.15.46:0/256475714 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f654810f040 con 0x55a0e9a32670 2024-09-21T03:59:14.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.924+0000 7f6539ffb640 1 -- 172.21.15.46:0/256475714 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f65480c9070 con 0x55a0e9a32670 2024-09-21T03:59:14.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.924+0000 7f655f487740 10 client.16077 fetch_fsmap learned FSMap version 20 2024-09-21T03:59:14.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.924+0000 7f655f487740 1 -- 172.21.15.46:0/256475714 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a0e9e14b70 con 0x55a0e9a32670 2024-09-21T03:59:14.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.924+0000 7f6539ffb640 1 -- 172.21.15.46:0/256475714 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f654810f040 con 0x55a0e9a32670 2024-09-21T03:59:14.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.925+0000 7f6539ffb640 1 -- 172.21.15.46:0/256475714 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f654810b6b0 con 0x55a0e9a32670 2024-09-21T03:59:14.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.925+0000 7f655f487740 10 client.16077 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:59:14.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.925+0000 7f655f487740 10 client.16077 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:59:14.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.925+0000 7f655f487740 20 client.16077 populate_metadata read hostname 'smithi046' 2024-09-21T03:59:14.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.925+0000 7f655f487740 1 --2- 172.21.15.46:0/256475714 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55a0e9a11cd0 0x55a0e9e17ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:14.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.925+0000 7f655f487740 4 client.16077 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:59:14.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.925+0000 7f655f487740 1 -- 172.21.15.46:0/256475714 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0e9d72db0 con 0x55a0e9a11cd0 2024-09-21T03:59:14.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.925+0000 7f655259c640 1 --2- 172.21.15.46:0/256475714 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55a0e9a11cd0 0x55a0e9e17ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:14.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.926+0000 7f6539ffb640 10 client.16077 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:59:14.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.926+0000 7f655259c640 1 --2- 172.21.15.46:0/256475714 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55a0e9a11cd0 0x55a0e9e17ed0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f951c9deec18ee8 server_cookie=4c3ad15722215cf0 in_seq=0 out_seq=0 2024-09-21T03:59:14.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.926+0000 7f6539ffb640 1 -- 172.21.15.46:0/256475714 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a0e9d72db0 con 0x55a0e9a11cd0 2024-09-21T03:59:14.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.926+0000 7f6539ffb640 10 client.16077 handle_command_reply: tid=0 2024-09-21T03:59:14.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.926+0000 7f655f487740 1 client.16077 shutdown 2024-09-21T03:59:14.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.926+0000 7f655f487740 1 -- 172.21.15.46:0/256475714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e9a32670 msgr2=0x55a0e9e065c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:14.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.926+0000 7f655f487740 1 --2- 172.21.15.46:0/256475714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e9a32670 0x55a0e9e065c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f654803b690 tx=0x7f654803b720 comp rx=0 tx=0).stop 2024-09-21T03:59:14.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.927+0000 7f655f487740 1 -- 172.21.15.46:0/256475714 shutdown_connections 2024-09-21T03:59:14.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.927+0000 7f655f487740 1 --2- 172.21.15.46:0/256475714 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55a0e9a11cd0 0x55a0e9e17ed0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.927+0000 7f655f487740 1 --2- 172.21.15.46:0/256475714 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0e9a53350 0x55a0e9e11c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.927+0000 7f655f487740 1 --2- 172.21.15.46:0/256475714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e9a32670 0x55a0e9e065c0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.927+0000 7f655f487740 1 --2- 172.21.15.46:0/256475714 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0e9a2a490 0x55a0e9e06040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.927+0000 7f6539ffb640 0 client.16077 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:59:14.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.927+0000 7f655f487740 1 -- 172.21.15.46:0/256475714 >> 172.21.15.46:0/256475714 conn(0x55a0e9a47740 msgr2=0x55a0e9dfd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:14.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.927+0000 7f655f487740 1 -- 172.21.15.46:0/256475714 shutdown_connections 2024-09-21T03:59:14.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.927+0000 7f655f487740 1 -- 172.21.15.46:0/256475714 wait complete. 2024-09-21T03:59:14.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.927+0000 7f655f487740 20 client.16077 trim_cache size 0 max 16384 2024-09-21T03:59:14.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.944+0000 7f655f487740 1 Processor -- start 2024-09-21T03:59:14.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.944+0000 7f655f487740 1 -- start start 2024-09-21T03:59:14.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.945+0000 7f655f487740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0e9a2a490 0x55a0e9e015f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:14.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.945+0000 7f655f487740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e9a32670 0x55a0e9e07d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:14.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.945+0000 7f655f487740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0e9a53350 0x55a0e9e00550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:14.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.945+0000 7f655f487740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f65541ad5a0 con 0x55a0e9a32670 2024-09-21T03:59:14.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.945+0000 7f655f487740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f65541afe40 con 0x55a0e9a2a490 2024-09-21T03:59:14.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.945+0000 7f655f487740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f65541adc30 con 0x55a0e9a53350 2024-09-21T03:59:14.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.945+0000 7f6551d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e9a32670 0x55a0e9e07d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:14.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.945+0000 7f6551d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e9a32670 0x55a0e9e07d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32770/0 (socket says 172.21.15.46:32770) 2024-09-21T03:59:14.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.945+0000 7f6551d9b640 1 -- 172.21.15.46:0/2383845923 learned_addr learned my addr 172.21.15.46:0/2383845923 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:14.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.945+0000 7f655259c640 1 --2- 172.21.15.46:0/2383845923 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0e9a2a490 0x55a0e9e015f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:14.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.945+0000 7f6551d9b640 1 -- 172.21.15.46:0/2383845923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0e9a53350 msgr2=0x55a0e9e00550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:14.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.945+0000 7f6551d9b640 1 --2- 172.21.15.46:0/2383845923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0e9a53350 0x55a0e9e00550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.945+0000 7f6551d9b640 1 -- 172.21.15.46:0/2383845923 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0e9a2a490 msgr2=0x55a0e9e015f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:14.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.945+0000 7f6551d9b640 1 --2- 172.21.15.46:0/2383845923 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0e9a2a490 0x55a0e9e015f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.945+0000 7f6551d9b640 1 -- 172.21.15.46:0/2383845923 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0e9e07100 con 0x55a0e9a32670 2024-09-21T03:59:14.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.945+0000 7f6551d9b640 1 --2- 172.21.15.46:0/2383845923 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e9a32670 0x55a0e9e07d20 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f65480cda00 tx=0x7f654802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14b0959657ce78b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:14.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.945+0000 7f653bfff640 1 -- 172.21.15.46:0/2383845923 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6548049030 con 0x55a0e9a32670 2024-09-21T03:59:14.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.945+0000 7f653bfff640 1 -- 172.21.15.46:0/2383845923 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f654810b0f0 con 0x55a0e9a32670 2024-09-21T03:59:14.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.945+0000 7f653bfff640 1 -- 172.21.15.46:0/2383845923 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65480cd3c0 con 0x55a0e9a32670 2024-09-21T03:59:14.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.946+0000 7f655f487740 1 -- 172.21.15.46:0/2383845923 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e9a32670 msgr2=0x55a0e9e07d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:14.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.946+0000 7f655f487740 1 --2- 172.21.15.46:0/2383845923 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e9a32670 0x55a0e9e07d20 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f65480cda00 tx=0x7f654802a410 comp rx=0 tx=0).stop 2024-09-21T03:59:14.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.946+0000 7f655f487740 1 -- 172.21.15.46:0/2383845923 shutdown_connections 2024-09-21T03:59:14.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.946+0000 7f655f487740 1 --2- 172.21.15.46:0/2383845923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0e9a53350 0x55a0e9e00550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.946+0000 7f655f487740 1 --2- 172.21.15.46:0/2383845923 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e9a32670 0x55a0e9e07d20 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.946+0000 7f655f487740 1 --2- 172.21.15.46:0/2383845923 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0e9a2a490 0x55a0e9e015f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.946+0000 7f655f487740 1 -- 172.21.15.46:0/2383845923 >> 172.21.15.46:0/2383845923 conn(0x55a0e9a47740 msgr2=0x55a0e9dfb460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:14.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.946+0000 7f655f487740 1 -- 172.21.15.46:0/2383845923 shutdown_connections 2024-09-21T03:59:14.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.946+0000 7f655f487740 1 -- 172.21.15.46:0/2383845923 wait complete. 2024-09-21T03:59:14.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.947+0000 7f655f487740 1 -- start start 2024-09-21T03:59:14.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.947+0000 7f655f487740 1 Processor -- start 2024-09-21T03:59:14.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.947+0000 7f655f487740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0e9a2a490 0x55a0e9e0e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:14.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.947+0000 7f655f487740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0e9a32670 0x55a0e9e09760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:14.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.947+0000 7f655f487740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e9a53350 0x55a0e9e09d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:14.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.947+0000 7f655f487740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f65541ae300 con 0x55a0e9a53350 2024-09-21T03:59:14.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.947+0000 7f655f487740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f65541af770 con 0x55a0e9a2a490 2024-09-21T03:59:14.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.947+0000 7f655f487740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f65541ae9d0 con 0x55a0e9a32670 2024-09-21T03:59:14.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.947+0000 7f655f487740 10 client.0 _ll_register_callbacks cb 0x7f654c004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:59:14.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.947+0000 7f6552d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e9a53350 0x55a0e9e09d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:14.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.947+0000 7f6552d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e9a53350 0x55a0e9e09d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32786/0 (socket says 172.21.15.46:32786) 2024-09-21T03:59:14.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.947+0000 7f6552d9d640 1 -- 172.21.15.46:0/955448558 learned_addr learned my addr 172.21.15.46:0/955448558 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:14.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.948+0000 7f655259c640 1 --2- 172.21.15.46:0/955448558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0e9a2a490 0x55a0e9e0e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:14.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.948+0000 7f6551d9b640 1 --2- 172.21.15.46:0/955448558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0e9a32670 0x55a0e9e09760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:14.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.948+0000 7f6552d9d640 1 -- 172.21.15.46:0/955448558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0e9a32670 msgr2=0x55a0e9e09760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:14.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.948+0000 7f6552d9d640 1 --2- 172.21.15.46:0/955448558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0e9a32670 0x55a0e9e09760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.948+0000 7f6552d9d640 1 -- 172.21.15.46:0/955448558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0e9a2a490 msgr2=0x55a0e9e0e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:14.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.948+0000 7f6552d9d640 1 --2- 172.21.15.46:0/955448558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0e9a2a490 0x55a0e9e0e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.948+0000 7f6552d9d640 1 -- 172.21.15.46:0/955448558 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0e9e0a4b0 con 0x55a0e9a53350 2024-09-21T03:59:14.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.948+0000 7f655259c640 1 --2- 172.21.15.46:0/955448558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0e9a2a490 0x55a0e9e0e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:59:14.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.948+0000 7f6551d9b640 1 --2- 172.21.15.46:0/955448558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0e9a32670 0x55a0e9e09760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:59:14.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.948+0000 7f6552d9d640 1 --2- 172.21.15.46:0/955448558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e9a53350 0x55a0e9e09d20 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f654c003c00 tx=0x7f654c01f430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbe88ad37045bd49 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:14.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.948+0000 7f6539ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:59:14.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.948+0000 7f6539ffb640 1 -- 172.21.15.46:0/955448558 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f654c01fcb0 con 0x55a0e9a53350 2024-09-21T03:59:14.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.948+0000 7f6539ffb640 1 -- 172.21.15.46:0/955448558 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f654c017030 con 0x55a0e9a53350 2024-09-21T03:59:14.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.948+0000 7f655f487740 1 -- 172.21.15.46:0/955448558 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a0e9d6e860 con 0x55a0e9a53350 2024-09-21T03:59:14.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.948+0000 7f6539ffb640 1 -- 172.21.15.46:0/955448558 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f654c01fe50 con 0x55a0e9a53350 2024-09-21T03:59:14.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.948+0000 7f655f487740 10 client.16083 fetch_fsmap learned FSMap version 20 2024-09-21T03:59:14.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.948+0000 7f655f487740 1 -- 172.21.15.46:0/955448558 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a0e9e82760 con 0x55a0e9a53350 2024-09-21T03:59:14.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.949+0000 7f6539ffb640 1 -- 172.21.15.46:0/955448558 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a0e9d6e860 con 0x55a0e9a53350 2024-09-21T03:59:14.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.949+0000 7f6539ffb640 1 -- 172.21.15.46:0/955448558 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f654c032410 con 0x55a0e9a53350 2024-09-21T03:59:14.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.949+0000 7f655f487740 10 client.16083 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:59:14.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.949+0000 7f655f487740 10 client.16083 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:59:14.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.949+0000 7f655f487740 20 client.16083 populate_metadata read hostname 'smithi046' 2024-09-21T03:59:14.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.949+0000 7f655f487740 1 --2- 172.21.15.46:0/955448558 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55a0e99e7080 0x55a0e9e84fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:14.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.949+0000 7f655f487740 4 client.16083 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:59:14.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.949+0000 7f655f487740 1 -- 172.21.15.46:0/955448558 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a0e9d6bc90 con 0x55a0e99e7080 2024-09-21T03:59:14.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.949+0000 7f655259c640 1 --2- 172.21.15.46:0/955448558 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55a0e99e7080 0x55a0e9e84fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:14.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.950+0000 7f655259c640 1 --2- 172.21.15.46:0/955448558 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55a0e99e7080 0x55a0e9e84fd0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4a91b07c1b9aed1 server_cookie=e2bbc0749dc4f9e2 in_seq=0 out_seq=0 2024-09-21T03:59:14.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.950+0000 7f6539ffb640 10 client.16083 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:59:14.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.951+0000 7f6539ffb640 1 -- 172.21.15.46:0/955448558 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a0e9d6bc90 con 0x55a0e99e7080 2024-09-21T03:59:14.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.951+0000 7f6539ffb640 10 client.16083 handle_command_reply: tid=0 2024-09-21T03:59:14.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.951+0000 7f655f487740 1 client.16083 shutdown 2024-09-21T03:59:14.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.952+0000 7f655f487740 1 -- 172.21.15.46:0/955448558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e9a53350 msgr2=0x55a0e9e09d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:14.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.952+0000 7f655f487740 1 --2- 172.21.15.46:0/955448558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e9a53350 0x55a0e9e09d20 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f654c003c00 tx=0x7f654c01f430 comp rx=0 tx=0).stop 2024-09-21T03:59:14.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.952+0000 7f655f487740 1 -- 172.21.15.46:0/955448558 shutdown_connections 2024-09-21T03:59:14.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.952+0000 7f655f487740 1 --2- 172.21.15.46:0/955448558 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55a0e99e7080 0x55a0e9e84fd0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.952+0000 7f655f487740 1 --2- 172.21.15.46:0/955448558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e9a53350 0x55a0e9e09d20 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.952+0000 7f655f487740 1 --2- 172.21.15.46:0/955448558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0e9a32670 0x55a0e9e09760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.952+0000 7f655f487740 1 --2- 172.21.15.46:0/955448558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0e9a2a490 0x55a0e9e0e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.952+0000 7f655f487740 1 -- 172.21.15.46:0/955448558 >> 172.21.15.46:0/955448558 conn(0x55a0e9a47740 msgr2=0x55a0e9e07ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:14.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.952+0000 7f6539ffb640 0 client.16083 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:59:14.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.952+0000 7f655f487740 1 -- 172.21.15.46:0/955448558 shutdown_connections 2024-09-21T03:59:14.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.952+0000 7f655f487740 1 -- 172.21.15.46:0/955448558 wait complete. 2024-09-21T03:59:14.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.952+0000 7f655f487740 20 client.16083 trim_cache size 0 max 16384 2024-09-21T03:59:14.957 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T03:59:14.957 INFO:teuthology.orchestra.run.smithi046.stdout: "return_code": 0, 2024-09-21T03:59:14.958 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_tag": "46bb5415-6e16-47c6-a1e4-55f9c623ce90", 2024-09-21T03:59:14.958 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": "asynchronous" 2024-09-21T03:59:14.958 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T03:59:14.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.952+0000 7f6558f13640 1 -- 172.21.15.46:0/2684346217 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f653c0b66b0 msgr2=0x7f653c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:14.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.952+0000 7f6558f13640 1 --2- 172.21.15.46:0/2684346217 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f653c0b66b0 0x7f653c0b8bc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f654c00b6c0 tx=0x7f654c00b2e0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.952+0000 7f6558f13640 1 -- 172.21.15.46:0/2684346217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65541083a0 msgr2=0x7f655419b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:14.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.952+0000 7f6558f13640 1 --2- 172.21.15.46:0/2684346217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65541083a0 0x7f655419b830 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f6548032fd0 tx=0x7f6548004270 comp rx=0 tx=0).stop 2024-09-21T03:59:14.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.953+0000 7f6558f13640 1 -- 172.21.15.46:0/2684346217 shutdown_connections 2024-09-21T03:59:14.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.953+0000 7f6558f13640 1 --2- 172.21.15.46:0/2684346217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6554108cf0 0x7f655419bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.953+0000 7f6558f13640 1 --2- 172.21.15.46:0/2684346217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65541083a0 0x7f655419b830 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.953+0000 7f6558f13640 1 --2- 172.21.15.46:0/2684346217 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f653c0b66b0 0x7f653c0b8bc0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.953+0000 7f6558f13640 1 --2- 172.21.15.46:0/2684346217 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6554102a60 0x7f655419b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.953+0000 7f6558f13640 1 -- 172.21.15.46:0/2684346217 >> 172.21.15.46:0/2684346217 conn(0x7f6554079730 msgr2=0x7f65541044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:14.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.953+0000 7f6558f13640 1 -- 172.21.15.46:0/2684346217 shutdown_connections 2024-09-21T03:59:14.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:14.953+0000 7f6558f13640 1 -- 172.21.15.46:0/2684346217 wait complete. 2024-09-21T03:59:15.567 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:15 smithi105 ceph-mon[34773]: pgmap v446: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 11 KiB/s wr, 4 op/s 2024-09-21T03:59:15.586 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:15 smithi046 ceph-mon[30954]: pgmap v446: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 11 KiB/s wr, 4 op/s 2024-09-21T03:59:15.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:15 smithi162 ceph-mon[35071]: pgmap v446: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 11 KiB/s wr, 4 op/s 2024-09-21T03:59:15.740 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:59:16.000 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:59:16.398 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:16 smithi046 ceph-mon[30954]: scrub queued for path: / 2024-09-21T03:59:16.398 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:16 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T03:59:16.398 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:16 smithi046 ceph-mon[30954]: scrub summary: active paths [/] 2024-09-21T03:59:16.398 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:16 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T03:59:16.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.489+0000 7f62f801b640 1 -- 172.21.15.46:0/1322146717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62f0108cf0 msgr2=0x7f62f010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:16.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.489+0000 7f62f801b640 1 --2- 172.21.15.46:0/1322146717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62f0108cf0 0x7f62f010f520 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f62e8009ca0 tx=0x7f62e802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.489+0000 7f62f801b640 1 -- 172.21.15.46:0/1322146717 shutdown_connections 2024-09-21T03:59:16.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.489+0000 7f62f801b640 1 --2- 172.21.15.46:0/1322146717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62f0108cf0 0x7f62f010f520 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.489+0000 7f62f801b640 1 --2- 172.21.15.46:0/1322146717 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62f01083a0 0x7f62f01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.489+0000 7f62f801b640 1 --2- 172.21.15.46:0/1322146717 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62f0102a60 0x7f62f0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.489+0000 7f62f801b640 1 -- 172.21.15.46:0/1322146717 >> 172.21.15.46:0/1322146717 conn(0x7f62f0079730 msgr2=0x7f62f0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:16.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.489+0000 7f62f801b640 1 -- 172.21.15.46:0/1322146717 shutdown_connections 2024-09-21T03:59:16.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.489+0000 7f62f801b640 1 -- 172.21.15.46:0/1322146717 wait complete. 2024-09-21T03:59:16.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.490+0000 7f62f801b640 1 Processor -- start 2024-09-21T03:59:16.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.490+0000 7f62f801b640 1 -- start start 2024-09-21T03:59:16.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.490+0000 7f62f801b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62f0102a60 0x7f62f019a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:16.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.490+0000 7f62f801b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62f01083a0 0x7f62f019a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:16.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.490+0000 7f62f801b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62f0108cf0 0x7f62f019fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:16.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.490+0000 7f62f801b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f62f0113a80 con 0x7f62f0102a60 2024-09-21T03:59:16.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.490+0000 7f62f801b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f62f0113900 con 0x7f62f0108cf0 2024-09-21T03:59:16.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.490+0000 7f62f801b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f62f0113c00 con 0x7f62f01083a0 2024-09-21T03:59:16.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.490+0000 7f62f5db7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62f0102a60 0x7f62f019a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:16.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.490+0000 7f62f5db7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62f0102a60 0x7f62f019a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32814/0 (socket says 172.21.15.46:32814) 2024-09-21T03:59:16.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.490+0000 7f62f5db7640 1 -- 172.21.15.46:0/1763243966 learned_addr learned my addr 172.21.15.46:0/1763243966 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:16.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.490+0000 7f62f65b8640 1 --2- 172.21.15.46:0/1763243966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62f0108cf0 0x7f62f019fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:16.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.491+0000 7f62f55b6640 1 --2- 172.21.15.46:0/1763243966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62f01083a0 0x7f62f019a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:16.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.491+0000 7f62f5db7640 1 -- 172.21.15.46:0/1763243966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62f01083a0 msgr2=0x7f62f019a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:16.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.491+0000 7f62f5db7640 1 --2- 172.21.15.46:0/1763243966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62f01083a0 0x7f62f019a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.491+0000 7f62f5db7640 1 -- 172.21.15.46:0/1763243966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62f0108cf0 msgr2=0x7f62f019fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:16.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.491+0000 7f62f5db7640 1 --2- 172.21.15.46:0/1763243966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62f0108cf0 0x7f62f019fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.491+0000 7f62f5db7640 1 -- 172.21.15.46:0/1763243966 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f01a0260 con 0x7f62f0102a60 2024-09-21T03:59:16.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.491+0000 7f62f65b8640 1 --2- 172.21.15.46:0/1763243966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62f0108cf0 0x7f62f019fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:59:16.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.491+0000 7f62f5db7640 1 --2- 172.21.15.46:0/1763243966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62f0102a60 0x7f62f019a3b0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f62ec00c920 tx=0x7f62ec00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:16.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.491+0000 7f62e6ffd640 1 -- 172.21.15.46:0/1763243966 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ec007c70 con 0x7f62f0102a60 2024-09-21T03:59:16.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.491+0000 7f62f801b640 1 -- 172.21.15.46:0/1763243966 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62f01a0550 con 0x7f62f0102a60 2024-09-21T03:59:16.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.491+0000 7f62e6ffd640 1 -- 172.21.15.46:0/1763243966 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62ec007e10 con 0x7f62f0102a60 2024-09-21T03:59:16.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.491+0000 7f62e6ffd640 1 -- 172.21.15.46:0/1763243966 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ec018820 con 0x7f62f0102a60 2024-09-21T03:59:16.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.491+0000 7f62f801b640 1 -- 172.21.15.46:0/1763243966 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62f01a6d70 con 0x7f62f0102a60 2024-09-21T03:59:16.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.494+0000 7f62fe58f740 1 Processor -- start 2024-09-21T03:59:16.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.494+0000 7f62fe58f740 1 -- start start 2024-09-21T03:59:16.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.494+0000 7f62e6ffd640 1 -- 172.21.15.46:0/1763243966 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f62ec00f450 con 0x7f62f0102a60 2024-09-21T03:59:16.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.494+0000 7f62fe58f740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e92d617070 0x55e92d9be650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:16.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.494+0000 7f62fe58f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e92d5ee1b0 0x55e92d9beb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:16.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.494+0000 7f62fe58f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e92d5f6390 0x55e92d9bf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:16.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.494+0000 7f62fe58f740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55e92d934e50 con 0x55e92d617070 2024-09-21T03:59:16.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.494+0000 7f62fe58f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55e92d924280 con 0x55e92d5f6390 2024-09-21T03:59:16.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.494+0000 7f62fe58f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e92d928090 con 0x55e92d5ee1b0 2024-09-21T03:59:16.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.494+0000 7f62f65b8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e92d617070 0x55e92d9be650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:16.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.494+0000 7f62f65b8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e92d617070 0x55e92d9be650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32828/0 (socket says 172.21.15.46:32828) 2024-09-21T03:59:16.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.494+0000 7f62f65b8640 1 -- 172.21.15.46:0/2668746538 learned_addr learned my addr 172.21.15.46:0/2668746538 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:16.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.495+0000 7f62f5db7640 1 --2- 172.21.15.46:0/2668746538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e92d5ee1b0 0x55e92d9beb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:16.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.495+0000 7f62f55b6640 1 --2- 172.21.15.46:0/2668746538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e92d5f6390 0x55e92d9bf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:16.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.495+0000 7f62f65b8640 1 -- 172.21.15.46:0/2668746538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e92d5ee1b0 msgr2=0x55e92d9beb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:16.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.495+0000 7f62f65b8640 1 --2- 172.21.15.46:0/2668746538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e92d5ee1b0 0x55e92d9beb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.495+0000 7f62f65b8640 1 -- 172.21.15.46:0/2668746538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e92d5f6390 msgr2=0x55e92d9bf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:16.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.495+0000 7f62f65b8640 1 --2- 172.21.15.46:0/2668746538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e92d5f6390 0x55e92d9bf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.495+0000 7f62f65b8640 1 -- 172.21.15.46:0/2668746538 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e92d682650 con 0x55e92d617070 2024-09-21T03:59:16.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.495+0000 7f62e6ffd640 1 --2- 172.21.15.46:0/1763243966 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f62dc0b66b0 0x7f62dc0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:16.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.495+0000 7f62f65b8640 1 --2- 172.21.15.46:0/2668746538 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e92d617070 0x55e92d9be650 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f62e80099c0 tx=0x7f62e80099f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3404599143181137 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:16.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.495+0000 7f62f5db7640 1 --2- 172.21.15.46:0/1763243966 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f62dc0b66b0 0x7f62dc0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:16.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.495+0000 7f62dbfff640 1 -- 172.21.15.46:0/2668746538 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e8031710 con 0x55e92d617070 2024-09-21T03:59:16.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.495+0000 7f62e6ffd640 1 -- 172.21.15.46:0/1763243966 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f62ec0e7880 con 0x7f62f0102a60 2024-09-21T03:59:16.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.495+0000 7f62dbfff640 1 -- 172.21.15.46:0/2668746538 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62e8040070 con 0x55e92d617070 2024-09-21T03:59:16.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.495+0000 7f62dbfff640 1 -- 172.21.15.46:0/2668746538 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e80047b0 con 0x55e92d617070 2024-09-21T03:59:16.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.496+0000 7f62fe58f740 1 -- 172.21.15.46:0/2668746538 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e92d617070 msgr2=0x55e92d9be650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:16.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.496+0000 7f62f5db7640 1 --2- 172.21.15.46:0/1763243966 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f62dc0b66b0 0x7f62dc0b8bc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f62ec0aa9e0 tx=0x7f62ec0ed530 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:16.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.496+0000 7f62fe58f740 1 --2- 172.21.15.46:0/2668746538 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e92d617070 0x55e92d9be650 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f62e80099c0 tx=0x7f62e80099f0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.496+0000 7f62fe58f740 1 -- 172.21.15.46:0/2668746538 shutdown_connections 2024-09-21T03:59:16.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.496+0000 7f62fe58f740 1 --2- 172.21.15.46:0/2668746538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e92d5f6390 0x55e92d9bf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.496+0000 7f62fe58f740 1 --2- 172.21.15.46:0/2668746538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e92d5ee1b0 0x55e92d9beb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.496+0000 7f62fe58f740 1 --2- 172.21.15.46:0/2668746538 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e92d617070 0x55e92d9be650 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.496+0000 7f62fe58f740 1 -- 172.21.15.46:0/2668746538 >> 172.21.15.46:0/2668746538 conn(0x55e92d60b460 msgr2=0x55e92d9bc540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:16.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.496+0000 7f62fe58f740 1 -- 172.21.15.46:0/2668746538 shutdown_connections 2024-09-21T03:59:16.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.496+0000 7f62fe58f740 1 -- 172.21.15.46:0/2668746538 wait complete. 2024-09-21T03:59:16.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.497+0000 7f62fe58f740 1 -- start start 2024-09-21T03:59:16.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.497+0000 7f62fe58f740 1 Processor -- start 2024-09-21T03:59:16.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.497+0000 7f62fe58f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e92d5ee1b0 0x55e92d9ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:16.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.498+0000 7f62fe58f740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e92d5f6390 0x55e92d9ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:16.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.498+0000 7f62fe58f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e92d617070 0x55e92d9da430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:16.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.498+0000 7f62fe58f740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55e92d785700 con 0x55e92d5f6390 2024-09-21T03:59:16.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.498+0000 7f62fe58f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55e92d8bf110 con 0x55e92d5ee1b0 2024-09-21T03:59:16.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.498+0000 7f62fe58f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e92d9d1100 con 0x55e92d617070 2024-09-21T03:59:16.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.498+0000 7f62fe58f740 10 client.0 _ll_register_callbacks cb 0x55e92d8d8990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:59:16.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.498+0000 7f62f55b6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e92d5f6390 0x55e92d9ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:16.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.498+0000 7f62f55b6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e92d5f6390 0x55e92d9ce620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32830/0 (socket says 172.21.15.46:32830) 2024-09-21T03:59:16.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.498+0000 7f62f55b6640 1 -- 172.21.15.46:0/3034678367 learned_addr learned my addr 172.21.15.46:0/3034678367 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:16.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.498+0000 7f62f65b8640 1 --2- 172.21.15.46:0/3034678367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e92d5ee1b0 0x55e92d9ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:16.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.498+0000 7f62f65b8640 1 --2- 172.21.15.46:0/3034678367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e92d617070 0x55e92d9da430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:16.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.498+0000 7f62f55b6640 1 -- 172.21.15.46:0/3034678367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e92d617070 msgr2=0x55e92d9da430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:16.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.498+0000 7f62f55b6640 1 --2- 172.21.15.46:0/3034678367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e92d617070 0x55e92d9da430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.498+0000 7f62f55b6640 1 -- 172.21.15.46:0/3034678367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e92d5ee1b0 msgr2=0x55e92d9ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:16.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.498+0000 7f62f55b6640 1 --2- 172.21.15.46:0/3034678367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e92d5ee1b0 0x55e92d9ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.498+0000 7f62f55b6640 1 -- 172.21.15.46:0/3034678367 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e92d8ecc40 con 0x55e92d5f6390 2024-09-21T03:59:16.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.498+0000 7f62f65b8640 1 --2- 172.21.15.46:0/3034678367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e92d617070 0x55e92d9da430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:59:16.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.498+0000 7f62f55b6640 1 --2- 172.21.15.46:0/3034678367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e92d5f6390 0x55e92d9ce620 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f62e0004650 tx=0x7f62e00039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a200a834aa46300a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:16.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.498+0000 7f62d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:59:16.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.498+0000 7f62d97fa640 1 -- 172.21.15.46:0/3034678367 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e0011910 con 0x55e92d5f6390 2024-09-21T03:59:16.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.498+0000 7f62d97fa640 1 -- 172.21.15.46:0/3034678367 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f62e0011ab0 con 0x55e92d5f6390 2024-09-21T03:59:16.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.498+0000 7f62fe58f740 1 -- 172.21.15.46:0/3034678367 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62e8040070 con 0x55e92d5f6390 2024-09-21T03:59:16.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.498+0000 7f62d97fa640 1 -- 172.21.15.46:0/3034678367 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f62e0011cb0 con 0x55e92d5f6390 2024-09-21T03:59:16.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.499+0000 7f62fe58f740 10 client.16095 fetch_fsmap learned FSMap version 20 2024-09-21T03:59:16.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.499+0000 7f62fe58f740 1 -- 172.21.15.46:0/3034678367 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55e92d9dce70 con 0x55e92d5f6390 2024-09-21T03:59:16.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.499+0000 7f62d97fa640 1 -- 172.21.15.46:0/3034678367 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62e8040070 con 0x55e92d5f6390 2024-09-21T03:59:16.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.499+0000 7f62d97fa640 1 -- 172.21.15.46:0/3034678367 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f62e0018070 con 0x55e92d5f6390 2024-09-21T03:59:16.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.499+0000 7f62fe58f740 10 client.16095 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:59:16.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.499+0000 7f62fe58f740 10 client.16095 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:59:16.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.499+0000 7f62fe58f740 20 client.16095 populate_metadata read hostname 'smithi046' 2024-09-21T03:59:16.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.499+0000 7f62fe58f740 1 --2- 172.21.15.46:0/3034678367 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55e92d5d59f0 0x55e92d9e02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:16.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.499+0000 7f62fe58f740 4 client.16095 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:59:16.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.499+0000 7f62fe58f740 1 -- 172.21.15.46:0/3034678367 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e92d936da0 con 0x55e92d5d59f0 2024-09-21T03:59:16.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.499+0000 7f62f65b8640 1 --2- 172.21.15.46:0/3034678367 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55e92d5d59f0 0x55e92d9e02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:16.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.500+0000 7f62f65b8640 1 --2- 172.21.15.46:0/3034678367 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55e92d5d59f0 0x55e92d9e02e0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22e5c2d1a91c2c27 server_cookie=99004a5be024fb14 in_seq=0 out_seq=0 2024-09-21T03:59:16.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.500+0000 7f62d97fa640 10 client.16095 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:59:16.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.501+0000 7f62d97fa640 1 -- 172.21.15.46:0/3034678367 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e92d936da0 con 0x55e92d5d59f0 2024-09-21T03:59:16.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.501+0000 7f62d97fa640 10 client.16095 handle_command_reply: tid=0 2024-09-21T03:59:16.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.501+0000 7f62fe58f740 1 client.16095 shutdown 2024-09-21T03:59:16.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.501+0000 7f62fe58f740 1 -- 172.21.15.46:0/3034678367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e92d5f6390 msgr2=0x55e92d9ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:16.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.501+0000 7f62fe58f740 1 --2- 172.21.15.46:0/3034678367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e92d5f6390 0x55e92d9ce620 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f62e0004650 tx=0x7f62e00039c0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.501+0000 7f62fe58f740 1 -- 172.21.15.46:0/3034678367 shutdown_connections 2024-09-21T03:59:16.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.501+0000 7f62fe58f740 1 --2- 172.21.15.46:0/3034678367 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55e92d5d59f0 0x55e92d9e02e0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.501+0000 7f62fe58f740 1 --2- 172.21.15.46:0/3034678367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e92d617070 0x55e92d9da430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.501+0000 7f62fe58f740 1 --2- 172.21.15.46:0/3034678367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e92d5f6390 0x55e92d9ce620 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.501+0000 7f62d97fa640 0 client.16095 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:59:16.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.501+0000 7f62fe58f740 1 --2- 172.21.15.46:0/3034678367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e92d5ee1b0 0x55e92d9ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.501+0000 7f62fe58f740 1 -- 172.21.15.46:0/3034678367 >> 172.21.15.46:0/3034678367 conn(0x55e92d60b460 msgr2=0x55e92d9c17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:16.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.501+0000 7f62fe58f740 1 -- 172.21.15.46:0/3034678367 shutdown_connections 2024-09-21T03:59:16.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.501+0000 7f62fe58f740 1 -- 172.21.15.46:0/3034678367 wait complete. 2024-09-21T03:59:16.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.501+0000 7f62fe58f740 20 client.16095 trim_cache size 0 max 16384 2024-09-21T03:59:16.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.518+0000 7f62fe58f740 1 Processor -- start 2024-09-21T03:59:16.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.519+0000 7f62fe58f740 1 -- start start 2024-09-21T03:59:16.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.519+0000 7f62fe58f740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e92d5d59f0 0x55e92d9cfd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:16.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.519+0000 7f62fe58f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e92d5ee1b0 0x55e92d9bbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:16.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.519+0000 7f62fe58f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e92d5f6390 0x55e92d9bc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:16.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.519+0000 7f62fe58f740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f62f01ab1f0 con 0x55e92d5d59f0 2024-09-21T03:59:16.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.519+0000 7f62fe58f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f62f01ada90 con 0x55e92d5ee1b0 2024-09-21T03:59:16.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.519+0000 7f62fe58f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f62f01ab880 con 0x55e92d5f6390 2024-09-21T03:59:16.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.519+0000 7f62f65b8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e92d5d59f0 0x55e92d9cfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:16.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.519+0000 7f62f65b8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e92d5d59f0 0x55e92d9cfd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32846/0 (socket says 172.21.15.46:32846) 2024-09-21T03:59:16.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.519+0000 7f62f65b8640 1 -- 172.21.15.46:0/4174007587 learned_addr learned my addr 172.21.15.46:0/4174007587 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:16.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.519+0000 7f62f65b8640 1 -- 172.21.15.46:0/4174007587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e92d5f6390 msgr2=0x55e92d9bc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:16.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.519+0000 7f62f65b8640 1 --2- 172.21.15.46:0/4174007587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e92d5f6390 0x55e92d9bc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.519+0000 7f62f65b8640 1 -- 172.21.15.46:0/4174007587 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e92d5ee1b0 msgr2=0x55e92d9bbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:16.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.519+0000 7f62f65b8640 1 --2- 172.21.15.46:0/4174007587 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e92d5ee1b0 0x55e92d9bbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.519+0000 7f62f65b8640 1 -- 172.21.15.46:0/4174007587 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e92d9cc5e0 con 0x55e92d5d59f0 2024-09-21T03:59:16.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.519+0000 7f62f65b8640 1 --2- 172.21.15.46:0/4174007587 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e92d5d59f0 0x55e92d9cfd10 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f62e80043e0 tx=0x7f62e8005c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ce0403f79d8d07 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:16.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.520+0000 7f62db7fe640 1 -- 172.21.15.46:0/4174007587 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e80047d0 con 0x55e92d5d59f0 2024-09-21T03:59:16.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.520+0000 7f62db7fe640 1 -- 172.21.15.46:0/4174007587 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62e8056070 con 0x55e92d5d59f0 2024-09-21T03:59:16.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.520+0000 7f62db7fe640 1 -- 172.21.15.46:0/4174007587 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e8003d90 con 0x55e92d5d59f0 2024-09-21T03:59:16.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.520+0000 7f62fe58f740 1 -- 172.21.15.46:0/4174007587 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e92d5d59f0 msgr2=0x55e92d9cfd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:16.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.520+0000 7f62fe58f740 1 --2- 172.21.15.46:0/4174007587 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e92d5d59f0 0x55e92d9cfd10 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f62e80043e0 tx=0x7f62e8005c30 comp rx=0 tx=0).stop 2024-09-21T03:59:16.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.520+0000 7f62fe58f740 1 -- 172.21.15.46:0/4174007587 shutdown_connections 2024-09-21T03:59:16.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.520+0000 7f62fe58f740 1 --2- 172.21.15.46:0/4174007587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e92d5f6390 0x55e92d9bc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.520+0000 7f62fe58f740 1 --2- 172.21.15.46:0/4174007587 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e92d5ee1b0 0x55e92d9bbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.520+0000 7f62fe58f740 1 --2- 172.21.15.46:0/4174007587 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e92d5d59f0 0x55e92d9cfd10 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.520+0000 7f62fe58f740 1 -- 172.21.15.46:0/4174007587 >> 172.21.15.46:0/4174007587 conn(0x55e92d60b460 msgr2=0x55e92d9cf600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:16.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.520+0000 7f62fe58f740 1 -- 172.21.15.46:0/4174007587 shutdown_connections 2024-09-21T03:59:16.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.520+0000 7f62fe58f740 1 -- 172.21.15.46:0/4174007587 wait complete. 2024-09-21T03:59:16.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.521+0000 7f62fe58f740 1 -- start start 2024-09-21T03:59:16.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.521+0000 7f62fe58f740 1 Processor -- start 2024-09-21T03:59:16.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.521+0000 7f62fe58f740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e92d5d59f0 0x55e92d9d2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:16.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.521+0000 7f62fe58f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e92d5ee1b0 0x55e92d9d3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:16.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.521+0000 7f62fe58f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e92d5f6390 0x55e92da43d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:16.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.521+0000 7f62fe58f740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f62f01abf50 con 0x55e92d5d59f0 2024-09-21T03:59:16.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.521+0000 7f62fe58f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f62f01ad3c0 con 0x55e92d5ee1b0 2024-09-21T03:59:16.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.521+0000 7f62fe58f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f62f01ac620 con 0x55e92d5f6390 2024-09-21T03:59:16.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.521+0000 7f62fe58f740 10 client.0 _ll_register_callbacks cb 0x7f62e0004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:59:16.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.522+0000 7f62f65b8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e92d5d59f0 0x55e92d9d2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:16.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.522+0000 7f62f65b8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e92d5d59f0 0x55e92d9d2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32850/0 (socket says 172.21.15.46:32850) 2024-09-21T03:59:16.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.522+0000 7f62f65b8640 1 -- 172.21.15.46:0/1282535000 learned_addr learned my addr 172.21.15.46:0/1282535000 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:16.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.522+0000 7f62f55b6640 1 --2- 172.21.15.46:0/1282535000 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e92d5ee1b0 0x55e92d9d3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:16.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.522+0000 7f62f65b8640 1 --2- 172.21.15.46:0/1282535000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e92d5f6390 0x55e92da43d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:16.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.522+0000 7f62f65b8640 1 -- 172.21.15.46:0/1282535000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e92d5f6390 msgr2=0x55e92da43d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:16.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.522+0000 7f62f65b8640 1 --2- 172.21.15.46:0/1282535000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e92d5f6390 0x55e92da43d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.522+0000 7f62f65b8640 1 -- 172.21.15.46:0/1282535000 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e92d5ee1b0 msgr2=0x55e92d9d3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:16.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.522+0000 7f62f65b8640 1 --2- 172.21.15.46:0/1282535000 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e92d5ee1b0 0x55e92d9d3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.522+0000 7f62f65b8640 1 -- 172.21.15.46:0/1282535000 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e92da44390 con 0x55e92d5d59f0 2024-09-21T03:59:16.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.522+0000 7f62f65b8640 1 --2- 172.21.15.46:0/1282535000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e92d5d59f0 0x55e92d9d2d30 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f62e802f550 tx=0x7f62e802af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1882ed3a153d9b8f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:16.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.522+0000 7f62d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:59:16.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.522+0000 7f62d97fa640 1 -- 172.21.15.46:0/1282535000 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e80318a0 con 0x55e92d5d59f0 2024-09-21T03:59:16.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.522+0000 7f62d97fa640 1 -- 172.21.15.46:0/1282535000 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f62e8003b30 con 0x55e92d5d59f0 2024-09-21T03:59:16.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.522+0000 7f62fe58f740 1 -- 172.21.15.46:0/1282535000 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62e8056070 con 0x55e92d5d59f0 2024-09-21T03:59:16.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.523+0000 7f62d97fa640 1 -- 172.21.15.46:0/1282535000 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f62e8003d30 con 0x55e92d5d59f0 2024-09-21T03:59:16.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.523+0000 7f62fe58f740 10 client.16101 fetch_fsmap learned FSMap version 20 2024-09-21T03:59:16.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.523+0000 7f62fe58f740 1 -- 172.21.15.46:0/1282535000 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55e92da4b6e0 con 0x55e92d5d59f0 2024-09-21T03:59:16.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.523+0000 7f62d97fa640 1 -- 172.21.15.46:0/1282535000 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62e8056070 con 0x55e92d5d59f0 2024-09-21T03:59:16.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.523+0000 7f62d97fa640 1 -- 172.21.15.46:0/1282535000 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f62e80305c0 con 0x55e92d5d59f0 2024-09-21T03:59:16.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.523+0000 7f62fe58f740 10 client.16101 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:59:16.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.523+0000 7f62fe58f740 10 client.16101 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:59:16.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.523+0000 7f62fe58f740 20 client.16101 populate_metadata read hostname 'smithi046' 2024-09-21T03:59:16.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.523+0000 7f62fe58f740 1 --2- 172.21.15.46:0/1282535000 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55e92d617070 0x55e92da4d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:16.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.523+0000 7f62fe58f740 4 client.16101 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:59:16.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.523+0000 7f62fe58f740 1 -- 172.21.15.46:0/1282535000 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e92d932850 con 0x55e92d617070 2024-09-21T03:59:16.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.523+0000 7f62f55b6640 1 --2- 172.21.15.46:0/1282535000 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55e92d617070 0x55e92da4d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:16.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.524+0000 7f62f55b6640 1 --2- 172.21.15.46:0/1282535000 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55e92d617070 0x55e92da4d9c0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=228f5addd8f04346 server_cookie=511779bf741789a2 in_seq=0 out_seq=0 2024-09-21T03:59:16.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.524+0000 7f62d97fa640 10 client.16101 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:59:16.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.524+0000 7f62d97fa640 1 -- 172.21.15.46:0/1282535000 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2842 (crc 0 0 0) 0x55e92d932850 con 0x55e92d617070 2024-09-21T03:59:16.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.524+0000 7f62d97fa640 10 client.16101 handle_command_reply: tid=0 2024-09-21T03:59:16.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.524+0000 7f62fe58f740 1 client.16101 shutdown 2024-09-21T03:59:16.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.524+0000 7f62fe58f740 1 -- 172.21.15.46:0/1282535000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e92d5d59f0 msgr2=0x55e92d9d2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:16.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.524+0000 7f62fe58f740 1 --2- 172.21.15.46:0/1282535000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e92d5d59f0 0x55e92d9d2d30 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f62e802f550 tx=0x7f62e802af40 comp rx=0 tx=0).stop 2024-09-21T03:59:16.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.524+0000 7f62fe58f740 1 -- 172.21.15.46:0/1282535000 shutdown_connections 2024-09-21T03:59:16.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.524+0000 7f62fe58f740 1 --2- 172.21.15.46:0/1282535000 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55e92d617070 0x55e92da4d9c0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.524+0000 7f62fe58f740 1 --2- 172.21.15.46:0/1282535000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e92d5f6390 0x55e92da43d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.524+0000 7f62fe58f740 1 --2- 172.21.15.46:0/1282535000 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e92d5ee1b0 0x55e92d9d3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.524+0000 7f62d97fa640 0 client.16101 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:59:16.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.524+0000 7f62fe58f740 1 --2- 172.21.15.46:0/1282535000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e92d5d59f0 0x55e92d9d2d30 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.524+0000 7f62fe58f740 1 -- 172.21.15.46:0/1282535000 >> 172.21.15.46:0/1282535000 conn(0x55e92d60b460 msgr2=0x55e92d9c0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:16.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.524+0000 7f62fe58f740 1 -- 172.21.15.46:0/1282535000 shutdown_connections 2024-09-21T03:59:16.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.524+0000 7f62fe58f740 1 -- 172.21.15.46:0/1282535000 wait complete. 2024-09-21T03:59:16.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.525+0000 7f62fe58f740 20 client.16101 trim_cache size 0 max 16384 2024-09-21T03:59:16.531 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T03:59:16.531 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T03:59:16.531 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2024-09-21T03:59:16.532 INFO:teuthology.orchestra.run.smithi046.stdout: "46bb5415-6e16-47c6-a1e4-55f9c623ce90": { 2024-09-21T03:59:16.532 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:16.532 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "46bb5415-6e16-47c6-a1e4-55f9c623ce90", 2024-09-21T03:59:16.532 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2024-09-21T03:59:16.532 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:59:16.532 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:59:16.532 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_stats": { 2024-09-21T03:59:16.532 INFO:teuthology.orchestra.run.smithi046.stdout: "46bb5415-6e16-47c6-a1e4-55f9c623ce90": { 2024-09-21T03:59:16.532 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:14.950674+0000", 2024-09-21T03:59:16.532 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:16.532 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:16.532 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:16.532 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:16.532 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:16.533 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:59:16.533 INFO:teuthology.orchestra.run.smithi046.stdout: "6103c660-8e77-4b06-ad6c-bb322c26035a": { 2024-09-21T03:59:16.533 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:35.594467+0000", 2024-09-21T03:59:16.533 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:16.533 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:16.533 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:16.533 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:16.533 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:16.533 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:59:16.533 INFO:teuthology.orchestra.run.smithi046.stdout: "dab67652-8894-4711-be64-cbdfea27a9ba": { 2024-09-21T03:59:16.533 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:28.161616+0000", 2024-09-21T03:59:16.533 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:16.533 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:16.533 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:16.534 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:16.534 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:16.534 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:59:16.534 INFO:teuthology.orchestra.run.smithi046.stdout: "c47f458a-de5e-4952-a575-a81261953667": { 2024-09-21T03:59:16.534 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:48.699411+0000", 2024-09-21T03:59:16.534 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:16.534 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:16.534 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:16.534 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:16.534 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:16.534 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:59:16.534 INFO:teuthology.orchestra.run.smithi046.stdout: "e24ec8f1-0d13-478f-9c2c-b51798868ffc": { 2024-09-21T03:59:16.534 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:09.736194+0000", 2024-09-21T03:59:16.535 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:16.535 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:16.535 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:16.535 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:16.535 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:16.535 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:59:16.535 INFO:teuthology.orchestra.run.smithi046.stdout: "a871f724-0198-493c-b03e-b2de78aba243": { 2024-09-21T03:59:16.535 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:56:30.082991+0000", 2024-09-21T03:59:16.535 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:16.535 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:16.535 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:16.535 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:16.535 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:16.535 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:59:16.536 INFO:teuthology.orchestra.run.smithi046.stdout: "d49f33a7-3d5a-421b-94ba-8b19a4120db1": { 2024-09-21T03:59:16.536 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:50.480786+0000", 2024-09-21T03:59:16.536 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:16.536 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:16.536 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:16.536 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:16.536 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:16.536 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:59:16.536 INFO:teuthology.orchestra.run.smithi046.stdout: "3bbf7097-70d7-4743-bbce-41465502b35b": { 2024-09-21T03:59:16.536 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:10.661441+0000", 2024-09-21T03:59:16.536 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:16.536 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:16.536 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:16.537 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:16.537 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:16.537 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:59:16.537 INFO:teuthology.orchestra.run.smithi046.stdout: "08f0c962-df1a-4129-a1a2-b916240d9803": { 2024-09-21T03:59:16.537 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:02.937596+0000", 2024-09-21T03:59:16.537 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:16.537 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:16.537 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:16.537 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:16.537 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:16.537 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:59:16.537 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:59:16.537 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T03:59:16.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.525+0000 7f62f801b640 1 -- 172.21.15.46:0/1763243966 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f62dc0b66b0 msgr2=0x7f62dc0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:16.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.525+0000 7f62f801b640 1 --2- 172.21.15.46:0/1763243966 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f62dc0b66b0 0x7f62dc0b8bc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f62ec0aa9e0 tx=0x7f62ec0ed530 comp rx=0 tx=0).stop 2024-09-21T03:59:16.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.525+0000 7f62f801b640 1 -- 172.21.15.46:0/1763243966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62f0102a60 msgr2=0x7f62f019a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:16.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.525+0000 7f62f801b640 1 --2- 172.21.15.46:0/1763243966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62f0102a60 0x7f62f019a3b0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f62ec00c920 tx=0x7f62ec00cde0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.525+0000 7f62f801b640 1 -- 172.21.15.46:0/1763243966 shutdown_connections 2024-09-21T03:59:16.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.525+0000 7f62f801b640 1 --2- 172.21.15.46:0/1763243966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62f0108cf0 0x7f62f019fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.525+0000 7f62f801b640 1 --2- 172.21.15.46:0/1763243966 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f62dc0b66b0 0x7f62dc0b8bc0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.525+0000 7f62f801b640 1 --2- 172.21.15.46:0/1763243966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62f01083a0 0x7f62f019a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.525+0000 7f62f801b640 1 --2- 172.21.15.46:0/1763243966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62f0102a60 0x7f62f019a3b0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.525+0000 7f62f801b640 1 -- 172.21.15.46:0/1763243966 >> 172.21.15.46:0/1763243966 conn(0x7f62f0079730 msgr2=0x7f62f0105200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:16.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.525+0000 7f62f801b640 1 -- 172.21.15.46:0/1763243966 shutdown_connections 2024-09-21T03:59:16.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:16.525+0000 7f62f801b640 1 -- 172.21.15.46:0/1763243966 wait complete. 2024-09-21T03:59:16.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:16 smithi105 ceph-mon[34773]: scrub queued for path: / 2024-09-21T03:59:16.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:16 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T03:59:16.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:16 smithi105 ceph-mon[34773]: scrub summary: active paths [/] 2024-09-21T03:59:16.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:16 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T03:59:16.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:16 smithi162 ceph-mon[35071]: scrub queued for path: / 2024-09-21T03:59:16.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:16 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T03:59:16.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:16 smithi162 ceph-mon[35071]: scrub summary: active paths [/] 2024-09-21T03:59:16.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:16 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T03:59:17.426 INFO:tasks.cephfs.filesystem:scrub status for tag:46bb5415-6e16-47c6-a1e4-55f9c623ce90 - {'path': '/', 'tag': '46bb5415-6e16-47c6-a1e4-55f9c623ce90', 'options': 'recursive,force'} 2024-09-21T03:59:17.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:17 smithi105 ceph-mon[34773]: pgmap v447: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T03:59:17.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:17 smithi162 ceph-mon[35071]: pgmap v447: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T03:59:17.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:17 smithi046 ceph-mon[30954]: pgmap v447: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T03:59:19.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:19 smithi105 ceph-mon[34773]: pgmap v448: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T03:59:19.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:19 smithi105 ceph-mon[34773]: scrub summary: idle 2024-09-21T03:59:19.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:19 smithi162 ceph-mon[35071]: pgmap v448: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T03:59:19.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:19 smithi162 ceph-mon[35071]: scrub summary: idle 2024-09-21T03:59:19.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:19 smithi046 ceph-mon[30954]: pgmap v448: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-21T03:59:19.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:19 smithi046 ceph-mon[30954]: scrub summary: idle 2024-09-21T03:59:21.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:21 smithi105 ceph-mon[34773]: pgmap v449: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-21T03:59:21.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:21 smithi162 ceph-mon[35071]: pgmap v449: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-21T03:59:21.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:21 smithi046 ceph-mon[30954]: pgmap v449: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-21T03:59:23.567 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:23 smithi105 ceph-mon[34773]: pgmap v450: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-21T03:59:23.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:23 smithi162 ceph-mon[35071]: pgmap v450: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-21T03:59:23.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:23 smithi046 ceph-mon[30954]: pgmap v450: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-21T03:59:24.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:24 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:59:24.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:24 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:59:24.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:24 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:59:25.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:25 smithi105 ceph-mon[34773]: pgmap v451: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T03:59:25.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:25 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:25.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:25 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:59:25.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:25 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:59:25.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:25 smithi162 ceph-mon[35071]: pgmap v451: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T03:59:25.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:25 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:25.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:25 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:59:25.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:25 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:59:25.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:25 smithi046 ceph-mon[30954]: pgmap v451: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T03:59:25.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:25 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:25.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:25 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:59:25.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:25 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T03:59:27.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:27 smithi105 ceph-mon[34773]: pgmap v452: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T03:59:27.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:27 smithi162 ceph-mon[35071]: pgmap v452: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T03:59:27.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:27 smithi046 ceph-mon[30954]: pgmap v452: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T03:59:29.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:29 smithi105 ceph-mon[34773]: pgmap v453: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-09-21T03:59:29.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:29 smithi162 ceph-mon[35071]: pgmap v453: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-09-21T03:59:29.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:29 smithi046 ceph-mon[30954]: pgmap v453: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-09-21T03:59:31.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:31 smithi105 ceph-mon[34773]: pgmap v454: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:59:31.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:31 smithi162 ceph-mon[35071]: pgmap v454: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:59:31.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:31 smithi046 ceph-mon[30954]: pgmap v454: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:59:33.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:33 smithi105 ceph-mon[34773]: pgmap v455: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T03:59:33.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:33 smithi162 ceph-mon[35071]: pgmap v455: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T03:59:33.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:33 smithi046 ceph-mon[30954]: pgmap v455: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T03:59:35.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:35 smithi105 ceph-mon[34773]: pgmap v456: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:59:35.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:35 smithi162 ceph-mon[35071]: pgmap v456: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:59:35.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:35 smithi046 ceph-mon[30954]: pgmap v456: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:59:37.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:37 smithi105 ceph-mon[34773]: pgmap v457: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:59:37.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:37 smithi162 ceph-mon[35071]: pgmap v457: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:59:37.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:37 smithi046 ceph-mon[30954]: pgmap v457: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:59:39.570 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:39 smithi105 ceph-mon[34773]: pgmap v458: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:59:39.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:39 smithi162 ceph-mon[35071]: pgmap v458: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:59:39.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:39 smithi046 ceph-mon[30954]: pgmap v458: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:59:41.553 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:41 smithi046 ceph-mon[30954]: pgmap v459: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:59:41.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:41 smithi105 ceph-mon[34773]: pgmap v459: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:59:41.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:41 smithi162 ceph-mon[35071]: pgmap v459: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:59:43.567 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:43 smithi105 ceph-mon[34773]: pgmap v460: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T03:59:43.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:43 smithi162 ceph-mon[35071]: pgmap v460: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T03:59:43.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:43 smithi046 ceph-mon[30954]: pgmap v460: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T03:59:45.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:45 smithi105 ceph-mon[34773]: pgmap v461: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:59:45.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:45 smithi162 ceph-mon[35071]: pgmap v461: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:59:45.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:45 smithi046 ceph-mon[30954]: pgmap v461: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:59:47.427 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:59:47.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:47 smithi105 ceph-mon[34773]: pgmap v462: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:59:47.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:47 smithi162 ceph-mon[35071]: pgmap v462: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:59:47.703 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:59:47.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:47 smithi046 ceph-mon[30954]: pgmap v462: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:59:48.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.171+0000 7f1bfc4cb640 1 -- 172.21.15.46:0/1359207692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1bf4109df0 msgr2=0x7f1bf4110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:48.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.171+0000 7f1bfc4cb640 1 --2- 172.21.15.46:0/1359207692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1bf4109df0 0x7f1bf4110620 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f1bec009ca0 tx=0x7f1bec02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.171+0000 7f1bfc4cb640 1 -- 172.21.15.46:0/1359207692 shutdown_connections 2024-09-21T03:59:48.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.171+0000 7f1bfc4cb640 1 --2- 172.21.15.46:0/1359207692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1bf4109df0 0x7f1bf4110620 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.171+0000 7f1bfc4cb640 1 --2- 172.21.15.46:0/1359207692 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1bf41094a0 0x7f1bf41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.171+0000 7f1bfc4cb640 1 --2- 172.21.15.46:0/1359207692 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bf4103b60 0x7f1bf4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.171+0000 7f1bfc4cb640 1 -- 172.21.15.46:0/1359207692 >> 172.21.15.46:0/1359207692 conn(0x7f1bf407b850 msgr2=0x7f1bf407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:48.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.171+0000 7f1bfc4cb640 1 -- 172.21.15.46:0/1359207692 shutdown_connections 2024-09-21T03:59:48.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.171+0000 7f1bfc4cb640 1 -- 172.21.15.46:0/1359207692 wait complete. 2024-09-21T03:59:48.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.172+0000 7f1bfc4cb640 1 Processor -- start 2024-09-21T03:59:48.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.172+0000 7f1bfc4cb640 1 -- start start 2024-09-21T03:59:48.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.172+0000 7f1bfc4cb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1bf4103b60 0x7f1bf4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:48.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.172+0000 7f1bfc4cb640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bf41094a0 0x7f1bf4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:48.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.172+0000 7f1bfc4cb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1bf4109df0 0x7f1bf4076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:48.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.172+0000 7f1bfc4cb640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf4113ab0 con 0x7f1bf4109df0 2024-09-21T03:59:48.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.172+0000 7f1bfc4cb640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf4113930 con 0x7f1bf4103b60 2024-09-21T03:59:48.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.172+0000 7f1bfc4cb640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf4113c30 con 0x7f1bf41094a0 2024-09-21T03:59:48.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.172+0000 7f1bfaa68640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1bf4109df0 0x7f1bf4076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:48.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.172+0000 7f1bfaa68640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1bf4109df0 0x7f1bf4076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33142/0 (socket says 172.21.15.46:33142) 2024-09-21T03:59:48.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.172+0000 7f1bfaa68640 1 -- 172.21.15.46:0/1571891348 learned_addr learned my addr 172.21.15.46:0/1571891348 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:48.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.172+0000 7f1bfa267640 1 --2- 172.21.15.46:0/1571891348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1bf4103b60 0x7f1bf4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:48.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.172+0000 7f1bf9a66640 1 --2- 172.21.15.46:0/1571891348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bf41094a0 0x7f1bf4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:48.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.173+0000 7f1bfaa68640 1 -- 172.21.15.46:0/1571891348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bf41094a0 msgr2=0x7f1bf4075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:48.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.173+0000 7f1bfaa68640 1 --2- 172.21.15.46:0/1571891348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bf41094a0 0x7f1bf4075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.173+0000 7f1bfaa68640 1 -- 172.21.15.46:0/1571891348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1bf4103b60 msgr2=0x7f1bf4075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:48.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.173+0000 7f1bfaa68640 1 --2- 172.21.15.46:0/1571891348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1bf4103b60 0x7f1bf4075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.173+0000 7f1bfaa68640 1 -- 172.21.15.46:0/1571891348 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bf41a8740 con 0x7f1bf4109df0 2024-09-21T03:59:48.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.173+0000 7f1bfaa68640 1 --2- 172.21.15.46:0/1571891348 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1bf4109df0 0x7f1bf4076190 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f1bec005cc0 tx=0x7f1bec02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:48.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.173+0000 7f1beb7fe640 1 -- 172.21.15.46:0/1571891348 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bec003bf0 con 0x7f1bf4109df0 2024-09-21T03:59:48.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.173+0000 7f1beb7fe640 1 -- 172.21.15.46:0/1571891348 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bec003d90 con 0x7f1bf4109df0 2024-09-21T03:59:48.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.173+0000 7f1bfc4cb640 1 -- 172.21.15.46:0/1571891348 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bf41a89d0 con 0x7f1bf4109df0 2024-09-21T03:59:48.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.173+0000 7f1beb7fe640 1 -- 172.21.15.46:0/1571891348 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bec02fbc0 con 0x7f1bf4109df0 2024-09-21T03:59:48.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.173+0000 7f1bfc4cb640 1 -- 172.21.15.46:0/1571891348 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bf41a8f10 con 0x7f1bf4109df0 2024-09-21T03:59:48.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.176+0000 7f1c02a3f740 1 Processor -- start 2024-09-21T03:59:48.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.176+0000 7f1beb7fe640 1 -- 172.21.15.46:0/1571891348 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f1bec02fd60 con 0x7f1bf4109df0 2024-09-21T03:59:48.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.176+0000 7f1c02a3f740 1 -- start start 2024-09-21T03:59:48.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.177+0000 7f1c02a3f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56364daeb070 0x56364de92650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:48.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.177+0000 7f1c02a3f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56364dac21b0 0x56364de92b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:48.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.177+0000 7f1c02a3f740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56364daca390 0x56364de930d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:48.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.177+0000 7f1c02a3f740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x56364de08e50 con 0x56364daca390 2024-09-21T03:59:48.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.177+0000 7f1c02a3f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56364ddf8280 con 0x56364daeb070 2024-09-21T03:59:48.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.177+0000 7f1c02a3f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56364ddfc090 con 0x56364dac21b0 2024-09-21T03:59:48.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.177+0000 7f1bf9a66640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56364daca390 0x56364de930d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:48.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.177+0000 7f1bf9a66640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56364daca390 0x56364de930d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33144/0 (socket says 172.21.15.46:33144) 2024-09-21T03:59:48.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.177+0000 7f1bf9a66640 1 -- 172.21.15.46:0/7505045 learned_addr learned my addr 172.21.15.46:0/7505045 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:48.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.177+0000 7f1bf9a66640 1 --2- 172.21.15.46:0/7505045 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56364daeb070 0x56364de92650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:48.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.177+0000 7f1bfa267640 1 --2- 172.21.15.46:0/7505045 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56364dac21b0 0x56364de92b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:48.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.177+0000 7f1beb7fe640 1 --2- 172.21.15.46:0/1571891348 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f1be00b6680 0x7f1be00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:48.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.177+0000 7f1bf9a66640 1 -- 172.21.15.46:0/7505045 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56364dac21b0 msgr2=0x56364de92b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:48.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.177+0000 7f1bf9a66640 1 --2- 172.21.15.46:0/7505045 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56364dac21b0 0x56364de92b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.177+0000 7f1bf9a66640 1 -- 172.21.15.46:0/7505045 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56364daeb070 msgr2=0x56364de92650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:48.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.177+0000 7f1bf9a66640 1 --2- 172.21.15.46:0/7505045 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56364daeb070 0x56364de92650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.177+0000 7f1bf9a66640 1 -- 172.21.15.46:0/7505045 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56364db56650 con 0x56364daca390 2024-09-21T03:59:48.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.177+0000 7f1bfaa68640 1 --2- 172.21.15.46:0/1571891348 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f1be00b6680 0x7f1be00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:48.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.177+0000 7f1beb7fe640 1 -- 172.21.15.46:0/1571891348 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f1bec108b50 con 0x7f1bf4109df0 2024-09-21T03:59:48.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.177+0000 7f1bf9a66640 1 --2- 172.21.15.46:0/7505045 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56364daca390 0x56364de930d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f1be4005d00 tx=0x7f1be4005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c62f27fbeb1ade9f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:48.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.178+0000 7f1be8ff9640 1 -- 172.21.15.46:0/7505045 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be4012ca0 con 0x56364daca390 2024-09-21T03:59:48.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.178+0000 7f1be8ff9640 1 -- 172.21.15.46:0/7505045 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1be4012e40 con 0x56364daca390 2024-09-21T03:59:48.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.178+0000 7f1be8ff9640 1 -- 172.21.15.46:0/7505045 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be4004a00 con 0x56364daca390 2024-09-21T03:59:48.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.179+0000 7f1c02a3f740 1 -- 172.21.15.46:0/7505045 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56364daca390 msgr2=0x56364de930d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:48.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.179+0000 7f1c02a3f740 1 --2- 172.21.15.46:0/7505045 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56364daca390 0x56364de930d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f1be4005d00 tx=0x7f1be4005c90 comp rx=0 tx=0).stop 2024-09-21T03:59:48.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.179+0000 7f1bfaa68640 1 --2- 172.21.15.46:0/1571891348 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f1be00b6680 0x7f1be00b8b90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1bec0cbcb0 tx=0x7f1bec09b800 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:48.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.179+0000 7f1c02a3f740 1 -- 172.21.15.46:0/7505045 shutdown_connections 2024-09-21T03:59:48.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.179+0000 7f1c02a3f740 1 --2- 172.21.15.46:0/7505045 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56364daca390 0x56364de930d0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.179+0000 7f1c02a3f740 1 --2- 172.21.15.46:0/7505045 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56364dac21b0 0x56364de92b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.179+0000 7f1c02a3f740 1 --2- 172.21.15.46:0/7505045 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56364daeb070 0x56364de92650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.179+0000 7f1c02a3f740 1 -- 172.21.15.46:0/7505045 >> 172.21.15.46:0/7505045 conn(0x56364dadf460 msgr2=0x56364de90540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:48.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.179+0000 7f1c02a3f740 1 -- 172.21.15.46:0/7505045 shutdown_connections 2024-09-21T03:59:48.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.179+0000 7f1c02a3f740 1 -- 172.21.15.46:0/7505045 wait complete. 2024-09-21T03:59:48.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.179+0000 7f1c02a3f740 1 -- start start 2024-09-21T03:59:48.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.179+0000 7f1c02a3f740 1 Processor -- start 2024-09-21T03:59:48.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.180+0000 7f1c02a3f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56364dac21b0 0x56364de9dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:48.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.180+0000 7f1c02a3f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56364daca390 0x56364de9e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:48.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.180+0000 7f1c02a3f740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56364daeb070 0x56364de9e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:48.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.180+0000 7f1c02a3f740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x56364dc59700 con 0x56364daeb070 2024-09-21T03:59:48.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.180+0000 7f1c02a3f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56364dd93110 con 0x56364dac21b0 2024-09-21T03:59:48.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.180+0000 7f1c02a3f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56364dea0e30 con 0x56364daca390 2024-09-21T03:59:48.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.180+0000 7f1c02a3f740 10 client.0 _ll_register_callbacks cb 0x56364ddac990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:59:48.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.180+0000 7f1bf9a66640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56364daeb070 0x56364de9e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:48.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.180+0000 7f1bf9a66640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56364daeb070 0x56364de9e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33152/0 (socket says 172.21.15.46:33152) 2024-09-21T03:59:48.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.180+0000 7f1bf9a66640 1 -- 172.21.15.46:0/2554878276 learned_addr learned my addr 172.21.15.46:0/2554878276 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:48.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.180+0000 7f1bf9a66640 1 --2- 172.21.15.46:0/2554878276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56364dac21b0 0x56364de9dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:48.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.180+0000 7f1bfa267640 1 --2- 172.21.15.46:0/2554878276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56364daca390 0x56364de9e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:48.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.180+0000 7f1bf9a66640 1 -- 172.21.15.46:0/2554878276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56364daca390 msgr2=0x56364de9e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:48.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.180+0000 7f1bf9a66640 1 --2- 172.21.15.46:0/2554878276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56364daca390 0x56364de9e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.180+0000 7f1bf9a66640 1 -- 172.21.15.46:0/2554878276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56364dac21b0 msgr2=0x56364de9dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:48.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.180+0000 7f1bf9a66640 1 --2- 172.21.15.46:0/2554878276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56364dac21b0 0x56364de9dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.180+0000 7f1bf9a66640 1 -- 172.21.15.46:0/2554878276 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56364ddc0c40 con 0x56364daeb070 2024-09-21T03:59:48.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.180+0000 7f1bf9a66640 1 --2- 172.21.15.46:0/2554878276 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56364daeb070 0x56364de9e740 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x56364de94f70 tx=0x7f1be4014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc42dcd0e25639d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:48.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.180+0000 7f1bddffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:59:48.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.181+0000 7f1bddffb640 1 -- 172.21.15.46:0/2554878276 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be4005180 con 0x56364daeb070 2024-09-21T03:59:48.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.181+0000 7f1bddffb640 1 -- 172.21.15.46:0/2554878276 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f1be4004260 con 0x56364daeb070 2024-09-21T03:59:48.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.181+0000 7f1c02a3f740 1 -- 172.21.15.46:0/2554878276 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56364de0ada0 con 0x56364daeb070 2024-09-21T03:59:48.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.181+0000 7f1bddffb640 1 -- 172.21.15.46:0/2554878276 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1be4033050 con 0x56364daeb070 2024-09-21T03:59:48.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.181+0000 7f1c02a3f740 10 client.16113 fetch_fsmap learned FSMap version 20 2024-09-21T03:59:48.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.181+0000 7f1c02a3f740 1 -- 172.21.15.46:0/2554878276 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56364deacb30 con 0x56364daeb070 2024-09-21T03:59:48.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.181+0000 7f1bddffb640 1 -- 172.21.15.46:0/2554878276 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56364de0ada0 con 0x56364daeb070 2024-09-21T03:59:48.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.181+0000 7f1bddffb640 1 -- 172.21.15.46:0/2554878276 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f1be4004850 con 0x56364daeb070 2024-09-21T03:59:48.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.181+0000 7f1c02a3f740 10 client.16113 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:59:48.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.181+0000 7f1c02a3f740 10 client.16113 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:59:48.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.181+0000 7f1c02a3f740 20 client.16113 populate_metadata read hostname 'smithi046' 2024-09-21T03:59:48.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.181+0000 7f1c02a3f740 1 --2- 172.21.15.46:0/2554878276 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56364daa99f0 0x56364deafe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:48.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.181+0000 7f1c02a3f740 4 client.16113 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:59:48.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.181+0000 7f1c02a3f740 1 -- 172.21.15.46:0/2554878276 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56364de06850 con 0x56364daa99f0 2024-09-21T03:59:48.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.182+0000 7f1bfa267640 1 --2- 172.21.15.46:0/2554878276 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56364daa99f0 0x56364deafe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:48.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.182+0000 7f1bfa267640 1 --2- 172.21.15.46:0/2554878276 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56364daa99f0 0x56364deafe90 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2e89f3a20bb690f server_cookie=594caf658ded0609 in_seq=0 out_seq=0 2024-09-21T03:59:48.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.182+0000 7f1bddffb640 10 client.16113 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:59:48.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.183+0000 7f1bddffb640 1 -- 172.21.15.46:0/2554878276 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56364de06850 con 0x56364daa99f0 2024-09-21T03:59:48.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.183+0000 7f1bddffb640 10 client.16113 handle_command_reply: tid=0 2024-09-21T03:59:48.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.183+0000 7f1c02a3f740 1 client.16113 shutdown 2024-09-21T03:59:48.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.183+0000 7f1c02a3f740 1 -- 172.21.15.46:0/2554878276 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56364daeb070 msgr2=0x56364de9e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:48.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.183+0000 7f1c02a3f740 1 --2- 172.21.15.46:0/2554878276 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56364daeb070 0x56364de9e740 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x56364de94f70 tx=0x7f1be4014040 comp rx=0 tx=0).stop 2024-09-21T03:59:48.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.183+0000 7f1c02a3f740 1 -- 172.21.15.46:0/2554878276 shutdown_connections 2024-09-21T03:59:48.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.183+0000 7f1c02a3f740 1 --2- 172.21.15.46:0/2554878276 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56364daa99f0 0x56364deafe90 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.183+0000 7f1c02a3f740 1 --2- 172.21.15.46:0/2554878276 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56364daeb070 0x56364de9e740 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.183+0000 7f1c02a3f740 1 --2- 172.21.15.46:0/2554878276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56364daca390 0x56364de9e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.183+0000 7f1bddffb640 0 client.16113 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:59:48.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.183+0000 7f1c02a3f740 1 --2- 172.21.15.46:0/2554878276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56364dac21b0 0x56364de9dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.183+0000 7f1c02a3f740 1 -- 172.21.15.46:0/2554878276 >> 172.21.15.46:0/2554878276 conn(0x56364dadf460 msgr2=0x56364de957e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.183+0000 7f1c02a3f740 1 -- 172.21.15.46:0/2554878276 shutdown_connections 2024-09-21T03:59:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.183+0000 7f1c02a3f740 1 -- 172.21.15.46:0/2554878276 wait complete. 2024-09-21T03:59:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.183+0000 7f1c02a3f740 20 client.16113 trim_cache size 0 max 16384 2024-09-21T03:59:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.201+0000 7f1c02a3f740 1 Processor -- start 2024-09-21T03:59:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.201+0000 7f1c02a3f740 1 -- start start 2024-09-21T03:59:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.201+0000 7f1c02a3f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56364dac21b0 0x56364de9f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.201+0000 7f1c02a3f740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56364daca390 0x56364de9ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.201+0000 7f1c02a3f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56364daeb070 0x56364de9b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.201+0000 7f1c02a3f740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf41af6c0 con 0x56364daca390 2024-09-21T03:59:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.201+0000 7f1c02a3f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf41b1f60 con 0x56364daeb070 2024-09-21T03:59:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.201+0000 7f1c02a3f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf41afd50 con 0x56364dac21b0 2024-09-21T03:59:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.201+0000 7f1bfa267640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56364daca390 0x56364de9ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:48.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.201+0000 7f1bfa267640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56364daca390 0x56364de9ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33156/0 (socket says 172.21.15.46:33156) 2024-09-21T03:59:48.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.201+0000 7f1bfa267640 1 -- 172.21.15.46:0/2850991812 learned_addr learned my addr 172.21.15.46:0/2850991812 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:48.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.201+0000 7f1bfa267640 1 -- 172.21.15.46:0/2850991812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56364dac21b0 msgr2=0x56364de9f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:48.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.201+0000 7f1bfa267640 1 --2- 172.21.15.46:0/2850991812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56364dac21b0 0x56364de9f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.201+0000 7f1bfa267640 1 -- 172.21.15.46:0/2850991812 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56364daeb070 msgr2=0x56364de9b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:48.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.201+0000 7f1bfa267640 1 --2- 172.21.15.46:0/2850991812 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56364daeb070 0x56364de9b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.201+0000 7f1bfa267640 1 -- 172.21.15.46:0/2850991812 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56364de9cbe0 con 0x56364daca390 2024-09-21T03:59:48.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.201+0000 7f1bfa267640 1 --2- 172.21.15.46:0/2850991812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56364daca390 0x56364de9ae70 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x56364de912d0 tx=0x7f1bf000bc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4476d09d971a32da server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:48.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.202+0000 7f1bdffff640 1 -- 172.21.15.46:0/2850991812 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0003b20 con 0x56364daca390 2024-09-21T03:59:48.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.202+0000 7f1bdffff640 1 -- 172.21.15.46:0/2850991812 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bf0003cc0 con 0x56364daca390 2024-09-21T03:59:48.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.202+0000 7f1bdffff640 1 -- 172.21.15.46:0/2850991812 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf00116a0 con 0x56364daca390 2024-09-21T03:59:48.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.202+0000 7f1c02a3f740 1 -- 172.21.15.46:0/2850991812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56364daca390 msgr2=0x56364de9ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:48.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.202+0000 7f1c02a3f740 1 --2- 172.21.15.46:0/2850991812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56364daca390 0x56364de9ae70 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x56364de912d0 tx=0x7f1bf000bc60 comp rx=0 tx=0).stop 2024-09-21T03:59:48.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.202+0000 7f1c02a3f740 1 -- 172.21.15.46:0/2850991812 shutdown_connections 2024-09-21T03:59:48.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.202+0000 7f1c02a3f740 1 --2- 172.21.15.46:0/2850991812 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56364daeb070 0x56364de9b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.202+0000 7f1c02a3f740 1 --2- 172.21.15.46:0/2850991812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56364daca390 0x56364de9ae70 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.202+0000 7f1c02a3f740 1 --2- 172.21.15.46:0/2850991812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56364dac21b0 0x56364de9f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.202+0000 7f1c02a3f740 1 -- 172.21.15.46:0/2850991812 >> 172.21.15.46:0/2850991812 conn(0x56364dadf460 msgr2=0x56364de9f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:48.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.202+0000 7f1c02a3f740 1 -- 172.21.15.46:0/2850991812 shutdown_connections 2024-09-21T03:59:48.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.202+0000 7f1c02a3f740 1 -- 172.21.15.46:0/2850991812 wait complete. 2024-09-21T03:59:48.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.203+0000 7f1c02a3f740 1 -- start start 2024-09-21T03:59:48.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.203+0000 7f1c02a3f740 1 Processor -- start 2024-09-21T03:59:48.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.203+0000 7f1c02a3f740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56364dac21b0 0x56364dea65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:48.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.203+0000 7f1c02a3f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56364daca390 0x56364dea1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:48.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.203+0000 7f1c02a3f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56364daeb070 0x56364dea1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:48.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.203+0000 7f1c02a3f740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf41b0420 con 0x56364dac21b0 2024-09-21T03:59:48.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.203+0000 7f1c02a3f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf41b1890 con 0x56364daca390 2024-09-21T03:59:48.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.203+0000 7f1c02a3f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf41b0af0 con 0x56364daeb070 2024-09-21T03:59:48.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.203+0000 7f1c02a3f740 10 client.0 _ll_register_callbacks cb 0x7f1be400be40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:59:48.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.203+0000 7f1bf9a66640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56364dac21b0 0x56364dea65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:48.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.203+0000 7f1bf9a66640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56364dac21b0 0x56364dea65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33166/0 (socket says 172.21.15.46:33166) 2024-09-21T03:59:48.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.203+0000 7f1bf9a66640 1 -- 172.21.15.46:0/890874219 learned_addr learned my addr 172.21.15.46:0/890874219 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:48.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.203+0000 7f1bf9a66640 1 -- 172.21.15.46:0/890874219 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56364daeb070 msgr2=0x56364dea1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:48.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.203+0000 7f1bf9a66640 1 --2- 172.21.15.46:0/890874219 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56364daeb070 0x56364dea1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.203+0000 7f1bf9a66640 1 -- 172.21.15.46:0/890874219 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56364daca390 msgr2=0x56364dea1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:48.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.203+0000 7f1bfa267640 1 --2- 172.21.15.46:0/890874219 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56364daca390 0x56364dea1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:48.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.204+0000 7f1bf9a66640 1 --2- 172.21.15.46:0/890874219 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56364daca390 0x56364dea1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.204+0000 7f1bf9a66640 1 -- 172.21.15.46:0/890874219 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56364dea2510 con 0x56364dac21b0 2024-09-21T03:59:48.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.204+0000 7f1bf9a66640 1 --2- 172.21.15.46:0/890874219 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56364dac21b0 0x56364dea65e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f1be4004c20 tx=0x7f1be4012460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=690faf82655a373c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:48.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.204+0000 7f1bddffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:59:48.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.204+0000 7f1bddffb640 1 -- 172.21.15.46:0/890874219 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be400ba60 con 0x56364dac21b0 2024-09-21T03:59:48.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.204+0000 7f1bddffb640 1 -- 172.21.15.46:0/890874219 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f1be4004e10 con 0x56364dac21b0 2024-09-21T03:59:48.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.204+0000 7f1c02a3f740 1 -- 172.21.15.46:0/890874219 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bf0003cc0 con 0x56364dac21b0 2024-09-21T03:59:48.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.204+0000 7f1bddffb640 1 -- 172.21.15.46:0/890874219 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1be4005460 con 0x56364dac21b0 2024-09-21T03:59:48.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.204+0000 7f1c02a3f740 10 client.16119 fetch_fsmap learned FSMap version 20 2024-09-21T03:59:48.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.204+0000 7f1c02a3f740 1 -- 172.21.15.46:0/890874219 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56364df1a380 con 0x56364dac21b0 2024-09-21T03:59:48.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.204+0000 7f1bddffb640 1 -- 172.21.15.46:0/890874219 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bf0003cc0 con 0x56364dac21b0 2024-09-21T03:59:48.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.205+0000 7f1bddffb640 1 -- 172.21.15.46:0/890874219 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f1be4004360 con 0x56364dac21b0 2024-09-21T03:59:48.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.205+0000 7f1c02a3f740 10 client.16119 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:59:48.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.205+0000 7f1c02a3f740 10 client.16119 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:59:48.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.205+0000 7f1c02a3f740 20 client.16119 populate_metadata read hostname 'smithi046' 2024-09-21T03:59:48.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.205+0000 7f1c02a3f740 1 --2- 172.21.15.46:0/890874219 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56364da7eda0 0x56364df1cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:48.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.205+0000 7f1c02a3f740 4 client.16119 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:59:48.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.205+0000 7f1c02a3f740 1 -- 172.21.15.46:0/890874219 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56364de03c80 con 0x56364da7eda0 2024-09-21T03:59:48.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.205+0000 7f1bfa267640 1 --2- 172.21.15.46:0/890874219 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56364da7eda0 0x56364df1cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:48.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.205+0000 7f1bfa267640 1 --2- 172.21.15.46:0/890874219 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56364da7eda0 0x56364df1cb20 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a1dbfd165c527c server_cookie=6e50607f849edcc1 in_seq=0 out_seq=0 2024-09-21T03:59:48.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.205+0000 7f1bddffb640 10 client.16119 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:59:48.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.206+0000 7f1bddffb640 1 -- 172.21.15.46:0/890874219 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2646 (crc 0 0 0) 0x56364de03c80 con 0x56364da7eda0 2024-09-21T03:59:48.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.206+0000 7f1bddffb640 10 client.16119 handle_command_reply: tid=0 2024-09-21T03:59:48.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.206+0000 7f1c02a3f740 1 client.16119 shutdown 2024-09-21T03:59:48.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.206+0000 7f1c02a3f740 1 -- 172.21.15.46:0/890874219 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56364dac21b0 msgr2=0x56364dea65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:48.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.206+0000 7f1c02a3f740 1 --2- 172.21.15.46:0/890874219 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56364dac21b0 0x56364dea65e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f1be4004c20 tx=0x7f1be4012460 comp rx=0 tx=0).stop 2024-09-21T03:59:48.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.206+0000 7f1c02a3f740 1 -- 172.21.15.46:0/890874219 shutdown_connections 2024-09-21T03:59:48.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.206+0000 7f1c02a3f740 1 --2- 172.21.15.46:0/890874219 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56364da7eda0 0x56364df1cb20 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.206+0000 7f1c02a3f740 1 --2- 172.21.15.46:0/890874219 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56364daeb070 0x56364dea1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.206+0000 7f1c02a3f740 1 --2- 172.21.15.46:0/890874219 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56364daca390 0x56364dea1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.206+0000 7f1bddffb640 0 client.16119 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:59:48.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.206+0000 7f1c02a3f740 1 --2- 172.21.15.46:0/890874219 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56364dac21b0 0x56364dea65e0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.206+0000 7f1c02a3f740 1 -- 172.21.15.46:0/890874219 >> 172.21.15.46:0/890874219 conn(0x56364dadf460 msgr2=0x56364dea9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:48.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.206+0000 7f1c02a3f740 1 -- 172.21.15.46:0/890874219 shutdown_connections 2024-09-21T03:59:48.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.206+0000 7f1c02a3f740 1 -- 172.21.15.46:0/890874219 wait complete. 2024-09-21T03:59:48.336 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T03:59:48.336 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "no active scrubs running", 2024-09-21T03:59:48.336 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": {}, 2024-09-21T03:59:48.336 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_stats": { 2024-09-21T03:59:48.336 INFO:teuthology.orchestra.run.smithi046.stdout: "46bb5415-6e16-47c6-a1e4-55f9c623ce90": { 2024-09-21T03:59:48.336 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:14.950674+0000", 2024-09-21T03:59:48.336 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:48.336 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:48.337 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:48.337 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:48.337 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:48.337 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:59:48.337 INFO:teuthology.orchestra.run.smithi046.stdout: "6103c660-8e77-4b06-ad6c-bb322c26035a": { 2024-09-21T03:59:48.337 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:35.594467+0000", 2024-09-21T03:59:48.337 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:48.337 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:48.337 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:48.337 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:48.337 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:48.337 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:59:48.337 INFO:teuthology.orchestra.run.smithi046.stdout: "dab67652-8894-4711-be64-cbdfea27a9ba": { 2024-09-21T03:59:48.337 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:28.161616+0000", 2024-09-21T03:59:48.338 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:48.338 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:48.338 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:48.338 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:48.338 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:48.338 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:59:48.338 INFO:teuthology.orchestra.run.smithi046.stdout: "c47f458a-de5e-4952-a575-a81261953667": { 2024-09-21T03:59:48.338 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:48.699411+0000", 2024-09-21T03:59:48.338 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:48.338 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:48.338 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:48.338 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:48.338 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:48.338 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:59:48.339 INFO:teuthology.orchestra.run.smithi046.stdout: "e24ec8f1-0d13-478f-9c2c-b51798868ffc": { 2024-09-21T03:59:48.339 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:09.736194+0000", 2024-09-21T03:59:48.339 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:48.339 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:48.339 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:48.339 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:48.339 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:48.339 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:59:48.339 INFO:teuthology.orchestra.run.smithi046.stdout: "a871f724-0198-493c-b03e-b2de78aba243": { 2024-09-21T03:59:48.339 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:56:30.082991+0000", 2024-09-21T03:59:48.339 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:48.339 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:48.339 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:48.339 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:48.340 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:48.340 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:59:48.340 INFO:teuthology.orchestra.run.smithi046.stdout: "d49f33a7-3d5a-421b-94ba-8b19a4120db1": { 2024-09-21T03:59:48.340 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:50.480786+0000", 2024-09-21T03:59:48.340 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:48.340 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:48.340 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:48.340 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:48.340 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:48.340 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:59:48.340 INFO:teuthology.orchestra.run.smithi046.stdout: "3bbf7097-70d7-4743-bbce-41465502b35b": { 2024-09-21T03:59:48.340 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:10.661441+0000", 2024-09-21T03:59:48.340 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:48.340 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:48.341 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:48.341 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:48.341 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:48.341 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:59:48.341 INFO:teuthology.orchestra.run.smithi046.stdout: "08f0c962-df1a-4129-a1a2-b916240d9803": { 2024-09-21T03:59:48.341 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:02.937596+0000", 2024-09-21T03:59:48.341 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:48.341 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:48.341 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:48.341 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:48.341 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:48.341 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:59:48.341 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:59:48.341 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T03:59:48.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.206+0000 7f1c02a3f740 20 client.16119 trim_cache size 0 max 16384 2024-09-21T03:59:48.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.206+0000 7f1bfc4cb640 1 -- 172.21.15.46:0/1571891348 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f1be00b6680 msgr2=0x7f1be00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:48.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.206+0000 7f1bfc4cb640 1 --2- 172.21.15.46:0/1571891348 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f1be00b6680 0x7f1be00b8b90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1bec0cbcb0 tx=0x7f1bec09b800 comp rx=0 tx=0).stop 2024-09-21T03:59:48.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.206+0000 7f1bfc4cb640 1 -- 172.21.15.46:0/1571891348 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1bf4109df0 msgr2=0x7f1bf4076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:48.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.206+0000 7f1bfc4cb640 1 --2- 172.21.15.46:0/1571891348 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1bf4109df0 0x7f1bf4076190 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f1bec005cc0 tx=0x7f1bec02f380 comp rx=0 tx=0).stop 2024-09-21T03:59:48.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.206+0000 7f1bfc4cb640 1 -- 172.21.15.46:0/1571891348 shutdown_connections 2024-09-21T03:59:48.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.206+0000 7f1bfc4cb640 1 --2- 172.21.15.46:0/1571891348 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1bf4109df0 0x7f1bf4076190 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.206+0000 7f1bfc4cb640 1 --2- 172.21.15.46:0/1571891348 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f1be00b6680 0x7f1be00b8b90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.206+0000 7f1bfc4cb640 1 --2- 172.21.15.46:0/1571891348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bf41094a0 0x7f1bf4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.206+0000 7f1bfc4cb640 1 --2- 172.21.15.46:0/1571891348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1bf4103b60 0x7f1bf4075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.206+0000 7f1bfc4cb640 1 -- 172.21.15.46:0/1571891348 >> 172.21.15.46:0/1571891348 conn(0x7f1bf407b850 msgr2=0x7f1bf4105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:48.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.207+0000 7f1bfc4cb640 1 -- 172.21.15.46:0/1571891348 shutdown_connections 2024-09-21T03:59:48.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:48.207+0000 7f1bfc4cb640 1 -- 172.21.15.46:0/1571891348 wait complete. 2024-09-21T03:59:49.124 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:59:49.124 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:59:49.390 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:59:49.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:49 smithi046 ceph-mon[30954]: pgmap v463: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:59:49.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:49 smithi105 ceph-mon[34773]: pgmap v463: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:59:49.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:49 smithi162 ceph-mon[35071]: pgmap v463: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:59:49.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.878+0000 7fc47a537640 1 -- 172.21.15.46:0/194705639 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4741094a0 msgr2=0x7fc4741098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:49.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.878+0000 7fc47a537640 1 --2- 172.21.15.46:0/194705639 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4741094a0 0x7fc4741098b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fc468009900 tx=0x7fc46802a410 comp rx=0 tx=0).stop 2024-09-21T03:59:49.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.878+0000 7fc47a537640 1 -- 172.21.15.46:0/194705639 shutdown_connections 2024-09-21T03:59:49.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.878+0000 7fc47a537640 1 --2- 172.21.15.46:0/194705639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc474109df0 0x7fc474110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:49.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.878+0000 7fc47a537640 1 --2- 172.21.15.46:0/194705639 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4741094a0 0x7fc4741098b0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:49.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.878+0000 7fc47a537640 1 --2- 172.21.15.46:0/194705639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc474103b60 0x7fc474103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:49.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.878+0000 7fc47a537640 1 -- 172.21.15.46:0/194705639 >> 172.21.15.46:0/194705639 conn(0x7fc47407b850 msgr2=0x7fc47407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:49.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.878+0000 7fc47a537640 1 -- 172.21.15.46:0/194705639 shutdown_connections 2024-09-21T03:59:49.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.878+0000 7fc47a537640 1 -- 172.21.15.46:0/194705639 wait complete. 2024-09-21T03:59:49.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.879+0000 7fc47a537640 1 Processor -- start 2024-09-21T03:59:49.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.879+0000 7fc47a537640 1 -- start start 2024-09-21T03:59:49.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.879+0000 7fc47a537640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc474103b60 0x7fc47419a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:49.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.879+0000 7fc47a537640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4741094a0 0x7fc47419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:49.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.879+0000 7fc47a537640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc474109df0 0x7fc47419fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:49.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.879+0000 7fc47a537640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc474113ab0 con 0x7fc474109df0 2024-09-21T03:59:49.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.879+0000 7fc47a537640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc474113930 con 0x7fc474103b60 2024-09-21T03:59:49.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.879+0000 7fc47a537640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc474113c30 con 0x7fc4741094a0 2024-09-21T03:59:49.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.879+0000 7fc478ad4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc474109df0 0x7fc47419fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:49.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.879+0000 7fc478ad4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc474109df0 0x7fc47419fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33186/0 (socket says 172.21.15.46:33186) 2024-09-21T03:59:49.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.880+0000 7fc478ad4640 1 -- 172.21.15.46:0/717645023 learned_addr learned my addr 172.21.15.46:0/717645023 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:49.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.880+0000 7fc4737fe640 1 --2- 172.21.15.46:0/717645023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4741094a0 0x7fc47419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:49.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.880+0000 7fc473fff640 1 --2- 172.21.15.46:0/717645023 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc474103b60 0x7fc47419a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:49.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.880+0000 7fc478ad4640 1 -- 172.21.15.46:0/717645023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4741094a0 msgr2=0x7fc47419ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:49.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.880+0000 7fc478ad4640 1 --2- 172.21.15.46:0/717645023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4741094a0 0x7fc47419ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:49.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.880+0000 7fc478ad4640 1 -- 172.21.15.46:0/717645023 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc474103b60 msgr2=0x7fc47419a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:49.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.880+0000 7fc478ad4640 1 --2- 172.21.15.46:0/717645023 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc474103b60 0x7fc47419a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:49.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.880+0000 7fc478ad4640 1 -- 172.21.15.46:0/717645023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4741a04f0 con 0x7fc474109df0 2024-09-21T03:59:49.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.880+0000 7fc473fff640 1 --2- 172.21.15.46:0/717645023 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc474103b60 0x7fc47419a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:59:49.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.880+0000 7fc478ad4640 1 --2- 172.21.15.46:0/717645023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc474109df0 0x7fc47419fdc0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fc46c009fd0 tx=0x7fc46c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:49.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.880+0000 7fc4717fa640 1 -- 172.21.15.46:0/717645023 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46c017070 con 0x7fc474109df0 2024-09-21T03:59:49.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.880+0000 7fc47a537640 1 -- 172.21.15.46:0/717645023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4741a07e0 con 0x7fc474109df0 2024-09-21T03:59:49.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.880+0000 7fc4717fa640 1 -- 172.21.15.46:0/717645023 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc46c003e20 con 0x7fc474109df0 2024-09-21T03:59:49.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.880+0000 7fc4717fa640 1 -- 172.21.15.46:0/717645023 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46c010460 con 0x7fc474109df0 2024-09-21T03:59:49.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.880+0000 7fc47a537640 1 -- 172.21.15.46:0/717645023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4741a6f40 con 0x7fc474109df0 2024-09-21T03:59:49.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.881+0000 7fc47a537640 1 -- 172.21.15.46:0/717645023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc474103f70 con 0x7fc474109df0 2024-09-21T03:59:49.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.883+0000 7fc4717fa640 1 -- 172.21.15.46:0/717645023 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7fc46c003970 con 0x7fc474109df0 2024-09-21T03:59:49.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.884+0000 7fc4717fa640 1 --2- 172.21.15.46:0/717645023 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc45c0b6680 0x7fc45c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:49.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.884+0000 7fc473fff640 1 --2- 172.21.15.46:0/717645023 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc45c0b6680 0x7fc45c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:49.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.884+0000 7fc4717fa640 1 -- 172.21.15.46:0/717645023 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fc46c0e73a0 con 0x7fc474109df0 2024-09-21T03:59:49.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.884+0000 7fc473fff640 1 --2- 172.21.15.46:0/717645023 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc45c0b6680 0x7fc45c0b8b90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc464009c20 tx=0x7fc464005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:49.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:49.887+0000 7fc4717fa640 1 -- 172.21.15.46:0/717645023 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc46c0ad950 con 0x7fc474109df0 2024-09-21T03:59:50.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:50.110+0000 7fc47a537640 1 -- 172.21.15.46:0/717645023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc47410bbc0 con 0x7fc474109df0 2024-09-21T03:59:50.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:50.111+0000 7fc4717fa640 1 -- 172.21.15.46:0/717645023 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7fc46c0b1d30 con 0x7fc474109df0 2024-09-21T03:59:50.114 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T03:59:50.114 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"btime":"2024-09-21T03:53:23:865820+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1766354184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1766354184},{"type":"v1","addr":"172.21.15.46:6839","nonce":1766354184}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/1901774207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":1901774207},{"type":"v1","addr":"172.21.15.46:6841","nonce":1901774207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3548633196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":3548633196},{"type":"v1","addr":"172.21.15.105:6837","nonce":3548633196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24652,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3551934241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3551934241},{"type":"v1","addr":"172.21.15.162:6835","nonce":3551934241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/48949822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":48949822},{"type":"v1","addr":"172.21.15.162:6837","nonce":48949822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:53:14.452819+0000","modified":"2024-09-21T03:53:23.593278+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24680},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/2196053213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2196053213},{"type":"v1","addr":"172.21.15.162:6839","nonce":2196053213}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.105:6839/3911438406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":3911438406},{"type":"v1","addr":"172.21.15.105:6839","nonce":3911438406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24680,"qdb_cluster":[24680]},"id":1}]} 2024-09-21T03:59:50.114 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T03:59:50.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:50.113+0000 7fc47a537640 1 -- 172.21.15.46:0/717645023 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc45c0b6680 msgr2=0x7fc45c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:50.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:50.113+0000 7fc47a537640 1 --2- 172.21.15.46:0/717645023 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc45c0b6680 0x7fc45c0b8b90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc464009c20 tx=0x7fc464005f90 comp rx=0 tx=0).stop 2024-09-21T03:59:50.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:50.113+0000 7fc47a537640 1 -- 172.21.15.46:0/717645023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc474109df0 msgr2=0x7fc47419fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:50.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:50.113+0000 7fc47a537640 1 --2- 172.21.15.46:0/717645023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc474109df0 0x7fc47419fdc0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fc46c009fd0 tx=0x7fc46c00b260 comp rx=0 tx=0).stop 2024-09-21T03:59:50.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:50.114+0000 7fc47a537640 1 -- 172.21.15.46:0/717645023 shutdown_connections 2024-09-21T03:59:50.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:50.114+0000 7fc47a537640 1 --2- 172.21.15.46:0/717645023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc474109df0 0x7fc47419fdc0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:50.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:50.114+0000 7fc47a537640 1 --2- 172.21.15.46:0/717645023 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc45c0b6680 0x7fc45c0b8b90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:50.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:50.114+0000 7fc47a537640 1 --2- 172.21.15.46:0/717645023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4741094a0 0x7fc47419ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:50.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:50.114+0000 7fc47a537640 1 --2- 172.21.15.46:0/717645023 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc474103b60 0x7fc47419a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:50.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:50.114+0000 7fc47a537640 1 -- 172.21.15.46:0/717645023 >> 172.21.15.46:0/717645023 conn(0x7fc47407b850 msgr2=0x7fc474105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:50.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:50.114+0000 7fc47a537640 1 -- 172.21.15.46:0/717645023 shutdown_connections 2024-09-21T03:59:50.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:50.114+0000 7fc47a537640 1 -- 172.21.15.46:0/717645023 wait complete. 2024-09-21T03:59:50.440 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:50 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/717645023' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:50.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:50 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/717645023' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:50.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:50 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/717645023' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:50.876 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:59:51.135 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:59:51.590 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:51 smithi046 ceph-mon[30954]: pgmap v464: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:59:51.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.589+0000 7f54f3507640 1 -- 172.21.15.46:0/1217175400 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54ec1094a0 msgr2=0x7f54ec1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:51.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.589+0000 7f54f3507640 1 --2- 172.21.15.46:0/1217175400 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54ec1094a0 0x7f54ec1098b0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f54e0009900 tx=0x7f54e002a410 comp rx=0 tx=0).stop 2024-09-21T03:59:51.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.589+0000 7f54f3507640 1 -- 172.21.15.46:0/1217175400 shutdown_connections 2024-09-21T03:59:51.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.589+0000 7f54f3507640 1 --2- 172.21.15.46:0/1217175400 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54ec109df0 0x7f54ec110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:51.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.589+0000 7f54f3507640 1 --2- 172.21.15.46:0/1217175400 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54ec1094a0 0x7f54ec1098b0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:51.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.589+0000 7f54f3507640 1 --2- 172.21.15.46:0/1217175400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54ec103b60 0x7f54ec103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:51.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.589+0000 7f54f3507640 1 -- 172.21.15.46:0/1217175400 >> 172.21.15.46:0/1217175400 conn(0x7f54ec07b850 msgr2=0x7f54ec07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:51.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.589+0000 7f54f3507640 1 -- 172.21.15.46:0/1217175400 shutdown_connections 2024-09-21T03:59:51.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.589+0000 7f54f3507640 1 -- 172.21.15.46:0/1217175400 wait complete. 2024-09-21T03:59:51.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.590+0000 7f54f3507640 1 Processor -- start 2024-09-21T03:59:51.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.590+0000 7f54f3507640 1 -- start start 2024-09-21T03:59:51.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.590+0000 7f54f3507640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54ec103b60 0x7f54ec19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:51.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.590+0000 7f54f3507640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54ec1094a0 0x7f54ec19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:51.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.590+0000 7f54f3507640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54ec109df0 0x7f54ec19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:51.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.590+0000 7f54f3507640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec113ab0 con 0x7f54ec103b60 2024-09-21T03:59:51.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.590+0000 7f54f3507640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec113930 con 0x7f54ec1094a0 2024-09-21T03:59:51.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.590+0000 7f54f3507640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec113c30 con 0x7f54ec109df0 2024-09-21T03:59:51.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.590+0000 7f54f12a3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54ec103b60 0x7f54ec19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:51.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.590+0000 7f54f0aa2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54ec1094a0 0x7f54ec19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:51.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.590+0000 7f54f12a3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54ec103b60 0x7f54ec19a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33206/0 (socket says 172.21.15.46:33206) 2024-09-21T03:59:51.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.590+0000 7f54f12a3640 1 -- 172.21.15.46:0/1136583915 learned_addr learned my addr 172.21.15.46:0/1136583915 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:51.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.591+0000 7f54f1aa4640 1 --2- 172.21.15.46:0/1136583915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54ec109df0 0x7f54ec19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:51.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.591+0000 7f54f12a3640 1 -- 172.21.15.46:0/1136583915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54ec109df0 msgr2=0x7f54ec19fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:51.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.591+0000 7f54f12a3640 1 --2- 172.21.15.46:0/1136583915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54ec109df0 0x7f54ec19fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:51.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.591+0000 7f54f12a3640 1 -- 172.21.15.46:0/1136583915 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54ec1094a0 msgr2=0x7f54ec19aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:51.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.591+0000 7f54f12a3640 1 --2- 172.21.15.46:0/1136583915 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54ec1094a0 0x7f54ec19aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:51.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.591+0000 7f54f12a3640 1 -- 172.21.15.46:0/1136583915 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54ec1a0330 con 0x7f54ec103b60 2024-09-21T03:59:51.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.591+0000 7f54f12a3640 1 --2- 172.21.15.46:0/1136583915 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54ec103b60 0x7f54ec19a480 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f54e800d770 tx=0x7f54e800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:51.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.591+0000 7f54de7fc640 1 -- 172.21.15.46:0/1136583915 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e8017070 con 0x7f54ec103b60 2024-09-21T03:59:51.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.591+0000 7f54de7fc640 1 -- 172.21.15.46:0/1136583915 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54e80054d0 con 0x7f54ec103b60 2024-09-21T03:59:51.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.591+0000 7f54f3507640 1 -- 172.21.15.46:0/1136583915 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54ec1a0620 con 0x7f54ec103b60 2024-09-21T03:59:51.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.591+0000 7f54de7fc640 1 -- 172.21.15.46:0/1136583915 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e8004c30 con 0x7f54ec103b60 2024-09-21T03:59:51.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.591+0000 7f54f3507640 1 -- 172.21.15.46:0/1136583915 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54ec1a6e40 con 0x7f54ec103b60 2024-09-21T03:59:51.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.595+0000 7f54f9a7b740 1 Processor -- start 2024-09-21T03:59:51.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.595+0000 7f54f9a7b740 1 -- start start 2024-09-21T03:59:51.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.595+0000 7f54f9a7b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e69d2aa070 0x55e69d6512c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:51.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.595+0000 7f54f9a7b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e69d2811b0 0x55e69d651800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:51.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.595+0000 7f54f9a7b740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e69d289390 0x55e69d651d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:51.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.595+0000 7f54f9a7b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55e69d5c7ea0 con 0x55e69d2811b0 2024-09-21T03:59:51.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.595+0000 7f54f9a7b740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55e69d5b72d0 con 0x55e69d289390 2024-09-21T03:59:51.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.595+0000 7f54f9a7b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e69d5bb0e0 con 0x55e69d2aa070 2024-09-21T03:59:51.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.595+0000 7f54de7fc640 1 -- 172.21.15.46:0/1136583915 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f54e8004dd0 con 0x7f54ec103b60 2024-09-21T03:59:51.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.595+0000 7f54f1aa4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e69d2aa070 0x55e69d6512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:51.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.595+0000 7f54f0aa2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e69d289390 0x55e69d651d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:51.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.596+0000 7f54f1aa4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e69d2aa070 0x55e69d6512c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:55508/0 (socket says 172.21.15.46:55508) 2024-09-21T03:59:51.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.596+0000 7f54f1aa4640 1 -- 172.21.15.46:0/2537806745 learned_addr learned my addr 172.21.15.46:0/2537806745 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:51.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.596+0000 7f54f12a3640 1 --2- 172.21.15.46:0/2537806745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e69d2811b0 0x55e69d651800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:51.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.596+0000 7f54f1aa4640 1 -- 172.21.15.46:0/2537806745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e69d289390 msgr2=0x55e69d651d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:51.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.596+0000 7f54f1aa4640 1 --2- 172.21.15.46:0/2537806745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e69d289390 0x55e69d651d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:51.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.596+0000 7f54f1aa4640 1 -- 172.21.15.46:0/2537806745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e69d2811b0 msgr2=0x55e69d651800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:51.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.596+0000 7f54f1aa4640 1 --2- 172.21.15.46:0/2537806745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e69d2811b0 0x55e69d651800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:51.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.596+0000 7f54f1aa4640 1 -- 172.21.15.46:0/2537806745 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e69d315650 con 0x55e69d2aa070 2024-09-21T03:59:51.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.596+0000 7f54f1aa4640 1 --2- 172.21.15.46:0/2537806745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e69d2aa070 0x55e69d6512c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f54e4007f40 tx=0x7f54e400f850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=371898660318fb4c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:51.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.596+0000 7f54de7fc640 1 --2- 172.21.15.46:0/1136583915 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f54d80b6730 0x7f54d80b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:51.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.597+0000 7f54f12a3640 1 --2- 172.21.15.46:0/1136583915 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f54d80b6730 0x7f54d80b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:51.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.597+0000 7f54d77fe640 1 -- 172.21.15.46:0/2537806745 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e4010900 con 0x55e69d2aa070 2024-09-21T03:59:51.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.597+0000 7f54d77fe640 1 -- 172.21.15.46:0/2537806745 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54e40183f0 con 0x55e69d2aa070 2024-09-21T03:59:51.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.597+0000 7f54d77fe640 1 -- 172.21.15.46:0/2537806745 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e4017600 con 0x55e69d2aa070 2024-09-21T03:59:51.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.597+0000 7f54de7fc640 1 -- 172.21.15.46:0/1136583915 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f54e80e7000 con 0x7f54ec103b60 2024-09-21T03:59:51.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.598+0000 7f54f9a7b740 1 -- 172.21.15.46:0/2537806745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e69d2aa070 msgr2=0x55e69d6512c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:51.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.598+0000 7f54f12a3640 1 --2- 172.21.15.46:0/1136583915 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f54d80b6730 0x7f54d80b8c40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x55e69d64ff40 tx=0x7f54e8094040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:51.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.598+0000 7f54f9a7b740 1 --2- 172.21.15.46:0/2537806745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e69d2aa070 0x55e69d6512c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f54e4007f40 tx=0x7f54e400f850 comp rx=0 tx=0).stop 2024-09-21T03:59:51.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.598+0000 7f54f9a7b740 1 -- 172.21.15.46:0/2537806745 shutdown_connections 2024-09-21T03:59:51.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.598+0000 7f54f9a7b740 1 --2- 172.21.15.46:0/2537806745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e69d289390 0x55e69d651d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:51.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.598+0000 7f54f9a7b740 1 --2- 172.21.15.46:0/2537806745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e69d2811b0 0x55e69d651800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:51.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.598+0000 7f54f9a7b740 1 --2- 172.21.15.46:0/2537806745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e69d2aa070 0x55e69d6512c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:51.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.598+0000 7f54f9a7b740 1 -- 172.21.15.46:0/2537806745 >> 172.21.15.46:0/2537806745 conn(0x55e69d29e460 msgr2=0x55e69d64f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:51.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.598+0000 7f54f9a7b740 1 -- 172.21.15.46:0/2537806745 shutdown_connections 2024-09-21T03:59:51.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.598+0000 7f54f9a7b740 1 -- 172.21.15.46:0/2537806745 wait complete. 2024-09-21T03:59:51.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.598+0000 7f54f9a7b740 1 -- start start 2024-09-21T03:59:51.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.598+0000 7f54f9a7b740 1 Processor -- start 2024-09-21T03:59:51.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.599+0000 7f54f9a7b740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e69d2811b0 0x55e69d65c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:51.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.599+0000 7f54f9a7b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e69d289390 0x55e69d65ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:51.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.599+0000 7f54f9a7b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e69d2aa070 0x55e69d65d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:51.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.599+0000 7f54f9a7b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55e69d418700 con 0x55e69d2aa070 2024-09-21T03:59:51.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.599+0000 7f54f9a7b740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55e69d552160 con 0x55e69d2811b0 2024-09-21T03:59:51.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.599+0000 7f54f9a7b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e69d663eb0 con 0x55e69d289390 2024-09-21T03:59:51.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.599+0000 7f54f9a7b740 10 client.0 _ll_register_callbacks cb 0x55e69d56b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:59:51.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.599+0000 7f54f1aa4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e69d2aa070 0x55e69d65d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:51.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.599+0000 7f54f1aa4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e69d2aa070 0x55e69d65d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33220/0 (socket says 172.21.15.46:33220) 2024-09-21T03:59:51.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.599+0000 7f54f1aa4640 1 -- 172.21.15.46:0/1912062955 learned_addr learned my addr 172.21.15.46:0/1912062955 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:51.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.599+0000 7f54f0aa2640 1 --2- 172.21.15.46:0/1912062955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e69d289390 0x55e69d65ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:51.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.599+0000 7f54f1aa4640 1 --2- 172.21.15.46:0/1912062955 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e69d2811b0 0x55e69d65c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:51.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.599+0000 7f54f1aa4640 1 -- 172.21.15.46:0/1912062955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e69d289390 msgr2=0x55e69d65ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:51.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.599+0000 7f54f1aa4640 1 --2- 172.21.15.46:0/1912062955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e69d289390 0x55e69d65ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:51.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.599+0000 7f54f1aa4640 1 -- 172.21.15.46:0/1912062955 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e69d2811b0 msgr2=0x55e69d65c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:51.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.599+0000 7f54f1aa4640 1 --2- 172.21.15.46:0/1912062955 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e69d2811b0 0x55e69d65c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:51.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.599+0000 7f54f1aa4640 1 -- 172.21.15.46:0/1912062955 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e69d57fc90 con 0x55e69d2aa070 2024-09-21T03:59:51.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.600+0000 7f54f1aa4640 1 --2- 172.21.15.46:0/1912062955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e69d2aa070 0x55e69d65d350 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f54e40173a0 tx=0x7f54e4012040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b4cf1e444063735 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:51.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.600+0000 7f54d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:59:51.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.600+0000 7f54d4ff9640 1 -- 172.21.15.46:0/1912062955 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e4004c40 con 0x55e69d2aa070 2024-09-21T03:59:51.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.600+0000 7f54d4ff9640 1 -- 172.21.15.46:0/1912062955 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f54e4004de0 con 0x55e69d2aa070 2024-09-21T03:59:51.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.600+0000 7f54f9a7b740 1 -- 172.21.15.46:0/1912062955 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54e40183f0 con 0x55e69d2aa070 2024-09-21T03:59:51.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.600+0000 7f54d4ff9640 1 -- 172.21.15.46:0/1912062955 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f54e4003970 con 0x55e69d2aa070 2024-09-21T03:59:51.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.600+0000 7f54f9a7b740 10 client.16137 fetch_fsmap learned FSMap version 20 2024-09-21T03:59:51.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.600+0000 7f54f9a7b740 1 -- 172.21.15.46:0/1912062955 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55e69d66fb10 con 0x55e69d2aa070 2024-09-21T03:59:51.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.600+0000 7f54d4ff9640 1 -- 172.21.15.46:0/1912062955 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54e40183f0 con 0x55e69d2aa070 2024-09-21T03:59:51.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.600+0000 7f54d4ff9640 1 -- 172.21.15.46:0/1912062955 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f54e4010820 con 0x55e69d2aa070 2024-09-21T03:59:51.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.600+0000 7f54f9a7b740 10 client.16137 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:59:51.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.600+0000 7f54f9a7b740 10 client.16137 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:59:51.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.600+0000 7f54f9a7b740 20 client.16137 populate_metadata read hostname 'smithi046' 2024-09-21T03:59:51.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.601+0000 7f54f9a7b740 1 --2- 172.21.15.46:0/1912062955 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55e69d2689f0 0x55e69d672f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:51.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.601+0000 7f54f9a7b740 4 client.16137 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:59:51.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.601+0000 7f54f9a7b740 1 -- 172.21.15.46:0/1912062955 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e69d5c9df0 con 0x55e69d2689f0 2024-09-21T03:59:51.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.601+0000 7f54f0aa2640 1 --2- 172.21.15.46:0/1912062955 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55e69d2689f0 0x55e69d672f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:51.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.601+0000 7f54d4ff9640 10 client.16137 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:59:51.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.601+0000 7f54f0aa2640 1 --2- 172.21.15.46:0/1912062955 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55e69d2689f0 0x55e69d672f80 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c8f23f7a0c9c3a4 server_cookie=d341ba6e3369d8a1 in_seq=0 out_seq=0 2024-09-21T03:59:51.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.602+0000 7f54d4ff9640 1 -- 172.21.15.46:0/1912062955 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e69d5c9df0 con 0x55e69d2689f0 2024-09-21T03:59:51.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.602+0000 7f54d4ff9640 10 client.16137 handle_command_reply: tid=0 2024-09-21T03:59:51.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.602+0000 7f54f9a7b740 1 client.16137 shutdown 2024-09-21T03:59:51.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.602+0000 7f54f9a7b740 1 -- 172.21.15.46:0/1912062955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e69d2aa070 msgr2=0x55e69d65d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:51.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.602+0000 7f54f9a7b740 1 --2- 172.21.15.46:0/1912062955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e69d2aa070 0x55e69d65d350 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f54e40173a0 tx=0x7f54e4012040 comp rx=0 tx=0).stop 2024-09-21T03:59:51.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.602+0000 7f54f9a7b740 1 -- 172.21.15.46:0/1912062955 shutdown_connections 2024-09-21T03:59:51.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.602+0000 7f54f9a7b740 1 --2- 172.21.15.46:0/1912062955 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55e69d2689f0 0x55e69d672f80 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:51.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.602+0000 7f54f9a7b740 1 --2- 172.21.15.46:0/1912062955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e69d2aa070 0x55e69d65d350 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:51.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.602+0000 7f54f9a7b740 1 --2- 172.21.15.46:0/1912062955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e69d289390 0x55e69d65ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:51.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.602+0000 7f54f9a7b740 1 --2- 172.21.15.46:0/1912062955 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e69d2811b0 0x55e69d65c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:51.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.602+0000 7f54f9a7b740 1 -- 172.21.15.46:0/1912062955 >> 172.21.15.46:0/1912062955 conn(0x55e69d29e460 msgr2=0x55e69d654450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:51.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.602+0000 7f54d4ff9640 0 client.16137 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:59:51.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.603+0000 7f54f9a7b740 1 -- 172.21.15.46:0/1912062955 shutdown_connections 2024-09-21T03:59:51.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.603+0000 7f54f9a7b740 1 -- 172.21.15.46:0/1912062955 wait complete. 2024-09-21T03:59:51.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.603+0000 7f54f9a7b740 20 client.16137 trim_cache size 0 max 16384 2024-09-21T03:59:51.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.616+0000 7f54f9a7b740 1 Processor -- start 2024-09-21T03:59:51.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.616+0000 7f54f9a7b740 1 -- start start 2024-09-21T03:59:51.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.616+0000 7f54f9a7b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e69d2811b0 0x55e69d652dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:51.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.616+0000 7f54f9a7b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e69d289390 0x55e69d65e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:51.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.616+0000 7f54f9a7b740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e69d2aa070 0x55e69d66c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:51.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.616+0000 7f54f9a7b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec1ab270 con 0x55e69d2811b0 2024-09-21T03:59:51.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.616+0000 7f54f9a7b740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec1adb10 con 0x55e69d2aa070 2024-09-21T03:59:51.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.616+0000 7f54f9a7b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec1ab900 con 0x55e69d289390 2024-09-21T03:59:51.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.616+0000 7f54f1aa4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e69d2811b0 0x55e69d652dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:51.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.616+0000 7f54f1aa4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e69d2811b0 0x55e69d652dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33234/0 (socket says 172.21.15.46:33234) 2024-09-21T03:59:51.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.616+0000 7f54f1aa4640 1 -- 172.21.15.46:0/1414658463 learned_addr learned my addr 172.21.15.46:0/1414658463 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:51.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.616+0000 7f54f0aa2640 1 --2- 172.21.15.46:0/1414658463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e69d289390 0x55e69d65e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:51.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.617+0000 7f54f1aa4640 1 -- 172.21.15.46:0/1414658463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e69d289390 msgr2=0x55e69d65e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:51.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.617+0000 7f54f1aa4640 1 --2- 172.21.15.46:0/1414658463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e69d289390 0x55e69d65e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:51.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.617+0000 7f54f1aa4640 1 -- 172.21.15.46:0/1414658463 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e69d2aa070 msgr2=0x55e69d66c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:51.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.617+0000 7f54f1aa4640 1 --2- 172.21.15.46:0/1414658463 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e69d2aa070 0x55e69d66c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:51.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.617+0000 7f54f1aa4640 1 -- 172.21.15.46:0/1414658463 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e69d65db90 con 0x55e69d2811b0 2024-09-21T03:59:51.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.617+0000 7f54f1aa4640 1 --2- 172.21.15.46:0/1414658463 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e69d2811b0 0x55e69d652dc0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f54e4010c40 tx=0x7f54e4005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5772481441ecb3b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:51.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.617+0000 7f54d6ffd640 1 -- 172.21.15.46:0/1414658463 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e4003d10 con 0x55e69d2811b0 2024-09-21T03:59:51.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.617+0000 7f54d6ffd640 1 -- 172.21.15.46:0/1414658463 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54e4007a90 con 0x55e69d2811b0 2024-09-21T03:59:51.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.617+0000 7f54d6ffd640 1 -- 172.21.15.46:0/1414658463 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e40183f0 con 0x55e69d2811b0 2024-09-21T03:59:51.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.618+0000 7f54f9a7b740 1 -- 172.21.15.46:0/1414658463 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e69d2811b0 msgr2=0x55e69d652dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:51.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.618+0000 7f54f9a7b740 1 --2- 172.21.15.46:0/1414658463 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e69d2811b0 0x55e69d652dc0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f54e4010c40 tx=0x7f54e4005fd0 comp rx=0 tx=0).stop 2024-09-21T03:59:51.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.618+0000 7f54f9a7b740 1 -- 172.21.15.46:0/1414658463 shutdown_connections 2024-09-21T03:59:51.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.618+0000 7f54f9a7b740 1 --2- 172.21.15.46:0/1414658463 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e69d2aa070 0x55e69d66c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:51.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.618+0000 7f54f9a7b740 1 --2- 172.21.15.46:0/1414658463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e69d289390 0x55e69d65e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:51.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.618+0000 7f54f9a7b740 1 --2- 172.21.15.46:0/1414658463 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e69d2811b0 0x55e69d652dc0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:51.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.618+0000 7f54f9a7b740 1 -- 172.21.15.46:0/1414658463 >> 172.21.15.46:0/1414658463 conn(0x55e69d29e460 msgr2=0x55e69d66c160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:51.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.618+0000 7f54f9a7b740 1 -- 172.21.15.46:0/1414658463 shutdown_connections 2024-09-21T03:59:51.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.618+0000 7f54f9a7b740 1 -- 172.21.15.46:0/1414658463 wait complete. 2024-09-21T03:59:51.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.618+0000 7f54f9a7b740 1 -- start start 2024-09-21T03:59:51.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.618+0000 7f54f9a7b740 1 Processor -- start 2024-09-21T03:59:51.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.619+0000 7f54f9a7b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e69d2811b0 0x55e69d6766a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:51.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.619+0000 7f54f9a7b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e69d289390 0x55e69d673b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:51.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.619+0000 7f54f9a7b740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e69d2aa070 0x55e69d6740b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:51.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.619+0000 7f54f9a7b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec1abfd0 con 0x55e69d289390 2024-09-21T03:59:51.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.619+0000 7f54f9a7b740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec1ad440 con 0x55e69d2aa070 2024-09-21T03:59:51.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.619+0000 7f54f9a7b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec1ac6a0 con 0x55e69d2811b0 2024-09-21T03:59:51.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.619+0000 7f54f9a7b740 10 client.0 _ll_register_callbacks cb 0x7f54e0009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:59:51.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.619+0000 7f54f0aa2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e69d289390 0x55e69d673b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:51.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.619+0000 7f54f0aa2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e69d289390 0x55e69d673b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33244/0 (socket says 172.21.15.46:33244) 2024-09-21T03:59:51.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.619+0000 7f54f0aa2640 1 -- 172.21.15.46:0/852477274 learned_addr learned my addr 172.21.15.46:0/852477274 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:51.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.619+0000 7f54f1aa4640 1 --2- 172.21.15.46:0/852477274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e69d2811b0 0x55e69d6766a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:51.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.619+0000 7f54f1aa4640 1 --2- 172.21.15.46:0/852477274 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e69d2aa070 0x55e69d6740b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:51.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.619+0000 7f54f0aa2640 1 -- 172.21.15.46:0/852477274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e69d2811b0 msgr2=0x55e69d6766a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:51.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.619+0000 7f54f0aa2640 1 --2- 172.21.15.46:0/852477274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e69d2811b0 0x55e69d6766a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:51.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.619+0000 7f54f0aa2640 1 -- 172.21.15.46:0/852477274 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e69d2aa070 msgr2=0x55e69d6740b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:51.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.619+0000 7f54f0aa2640 1 --2- 172.21.15.46:0/852477274 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e69d2aa070 0x55e69d6740b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:51.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.619+0000 7f54f0aa2640 1 -- 172.21.15.46:0/852477274 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e69d674750 con 0x55e69d289390 2024-09-21T03:59:51.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.619+0000 7f54f1aa4640 1 --2- 172.21.15.46:0/852477274 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e69d2aa070 0x55e69d6740b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:59:51.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.620+0000 7f54f0aa2640 1 --2- 172.21.15.46:0/852477274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e69d289390 0x55e69d673b70 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f54e0009230 tx=0x7f54e00058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=729de8c4efc3d5c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:51.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.620+0000 7f54d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:59:51.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.620+0000 7f54d4ff9640 1 -- 172.21.15.46:0/852477274 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e0035040 con 0x55e69d289390 2024-09-21T03:59:51.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.620+0000 7f54d4ff9640 1 -- 172.21.15.46:0/852477274 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f54e0005040 con 0x55e69d289390 2024-09-21T03:59:51.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.620+0000 7f54f9a7b740 1 -- 172.21.15.46:0/852477274 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54e4007a90 con 0x55e69d289390 2024-09-21T03:59:51.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.620+0000 7f54d4ff9640 1 -- 172.21.15.46:0/852477274 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f54e0054050 con 0x55e69d289390 2024-09-21T03:59:51.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.620+0000 7f54f9a7b740 10 client.16143 fetch_fsmap learned FSMap version 20 2024-09-21T03:59:51.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.620+0000 7f54f9a7b740 1 -- 172.21.15.46:0/852477274 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55e69d6dd5b0 con 0x55e69d289390 2024-09-21T03:59:51.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.620+0000 7f54d4ff9640 1 -- 172.21.15.46:0/852477274 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54e4007a90 con 0x55e69d289390 2024-09-21T03:59:51.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.620+0000 7f54d4ff9640 1 -- 172.21.15.46:0/852477274 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f54e00035f0 con 0x55e69d289390 2024-09-21T03:59:51.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.620+0000 7f54f9a7b740 10 client.16143 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:59:51.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.620+0000 7f54f9a7b740 10 client.16143 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:59:51.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.620+0000 7f54f9a7b740 20 client.16143 populate_metadata read hostname 'smithi046' 2024-09-21T03:59:51.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.620+0000 7f54f9a7b740 1 --2- 172.21.15.46:0/852477274 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55e69d23dda0 0x55e69d6dfd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:51.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.620+0000 7f54f9a7b740 4 client.16143 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:59:51.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.620+0000 7f54f9a7b740 1 -- 172.21.15.46:0/852477274 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e69d5c58a0 con 0x55e69d23dda0 2024-09-21T03:59:51.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.621+0000 7f54f1aa4640 1 --2- 172.21.15.46:0/852477274 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55e69d23dda0 0x55e69d6dfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:51.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.621+0000 7f54f1aa4640 1 --2- 172.21.15.46:0/852477274 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55e69d23dda0 0x55e69d6dfd10 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c582928ce8d462c server_cookie=9251b8389ce68b76 in_seq=0 out_seq=0 2024-09-21T03:59:51.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.621+0000 7f54d4ff9640 10 client.16143 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:59:51.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.621+0000 7f54d4ff9640 1 -- 172.21.15.46:0/852477274 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e69d5c58a0 con 0x55e69d23dda0 2024-09-21T03:59:51.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.621+0000 7f54d4ff9640 10 client.16143 handle_command_reply: tid=0 2024-09-21T03:59:51.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.621+0000 7f54f9a7b740 1 client.16143 shutdown 2024-09-21T03:59:51.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.622+0000 7f54f9a7b740 1 -- 172.21.15.46:0/852477274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e69d289390 msgr2=0x55e69d673b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:51.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.622+0000 7f54f9a7b740 1 --2- 172.21.15.46:0/852477274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e69d289390 0x55e69d673b70 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f54e0009230 tx=0x7f54e00058d0 comp rx=0 tx=0).stop 2024-09-21T03:59:51.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.622+0000 7f54f9a7b740 1 -- 172.21.15.46:0/852477274 shutdown_connections 2024-09-21T03:59:51.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.622+0000 7f54f9a7b740 1 --2- 172.21.15.46:0/852477274 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55e69d23dda0 0x55e69d6dfd10 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:51.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.622+0000 7f54f9a7b740 1 --2- 172.21.15.46:0/852477274 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e69d2aa070 0x55e69d6740b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:51.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.622+0000 7f54f9a7b740 1 --2- 172.21.15.46:0/852477274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e69d289390 0x55e69d673b70 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:51.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.622+0000 7f54f9a7b740 1 --2- 172.21.15.46:0/852477274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e69d2811b0 0x55e69d6766a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:51.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.622+0000 7f54f9a7b740 1 -- 172.21.15.46:0/852477274 >> 172.21.15.46:0/852477274 conn(0x55e69d29e460 msgr2=0x55e69d66cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:51.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.622+0000 7f54d4ff9640 0 client.16143 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:59:51.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.622+0000 7f54f9a7b740 1 -- 172.21.15.46:0/852477274 shutdown_connections 2024-09-21T03:59:51.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.622+0000 7f54f9a7b740 1 -- 172.21.15.46:0/852477274 wait complete. 2024-09-21T03:59:51.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.622+0000 7f54f9a7b740 20 client.16143 trim_cache size 0 max 16384 2024-09-21T03:59:51.639 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-21T03:59:51.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.622+0000 7f54f3507640 1 -- 172.21.15.46:0/1136583915 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f54d80b6730 msgr2=0x7f54d80b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:51.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.622+0000 7f54f3507640 1 --2- 172.21.15.46:0/1136583915 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f54d80b6730 0x7f54d80b8c40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x55e69d64ff40 tx=0x7f54e8094040 comp rx=0 tx=0).stop 2024-09-21T03:59:51.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.622+0000 7f54f3507640 1 -- 172.21.15.46:0/1136583915 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54ec103b60 msgr2=0x7f54ec19a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:51.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.622+0000 7f54f3507640 1 --2- 172.21.15.46:0/1136583915 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54ec103b60 0x7f54ec19a480 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f54e800d770 tx=0x7f54e800dc30 comp rx=0 tx=0).stop 2024-09-21T03:59:51.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.622+0000 7f54f3507640 1 -- 172.21.15.46:0/1136583915 shutdown_connections 2024-09-21T03:59:51.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.623+0000 7f54f3507640 1 --2- 172.21.15.46:0/1136583915 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f54d80b6730 0x7f54d80b8c40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:51.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.623+0000 7f54f3507640 1 --2- 172.21.15.46:0/1136583915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54ec109df0 0x7f54ec19fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:51.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.623+0000 7f54f3507640 1 --2- 172.21.15.46:0/1136583915 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54ec1094a0 0x7f54ec19aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:51.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.623+0000 7f54f3507640 1 --2- 172.21.15.46:0/1136583915 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54ec103b60 0x7f54ec19a480 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:51.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.623+0000 7f54f3507640 1 -- 172.21.15.46:0/1136583915 >> 172.21.15.46:0/1136583915 conn(0x7f54ec07b850 msgr2=0x7f54ec105520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:51.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.623+0000 7f54f3507640 1 -- 172.21.15.46:0/1136583915 shutdown_connections 2024-09-21T03:59:51.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:51.623+0000 7f54f3507640 1 -- 172.21.15.46:0/1136583915 wait complete. 2024-09-21T03:59:51.643 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:51 smithi162 ceph-mon[35071]: pgmap v464: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:59:51.817 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:51 smithi105 ceph-mon[34773]: pgmap v464: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T03:59:53.442 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:59:53.442 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:59:53.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:53 smithi162 ceph-mon[35071]: pgmap v465: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T03:59:53.718 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:59:53.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:53 smithi046 ceph-mon[30954]: pgmap v465: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T03:59:53.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:53 smithi105 ceph-mon[34773]: pgmap v465: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T03:59:54.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.153+0000 7f240cb4f640 1 -- 172.21.15.46:0/1564317211 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24081094c0 msgr2=0x7f24081098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:54.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.153+0000 7f240cb4f640 1 --2- 172.21.15.46:0/1564317211 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24081094c0 0x7f24081098d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f23fc009900 tx=0x7f23fc02a410 comp rx=0 tx=0).stop 2024-09-21T03:59:54.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.154+0000 7f240cb4f640 1 -- 172.21.15.46:0/1564317211 shutdown_connections 2024-09-21T03:59:54.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.154+0000 7f240cb4f640 1 --2- 172.21.15.46:0/1564317211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2408109e10 0x7f2408110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:54.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.154+0000 7f240cb4f640 1 --2- 172.21.15.46:0/1564317211 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24081094c0 0x7f24081098d0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:54.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.154+0000 7f240cb4f640 1 --2- 172.21.15.46:0/1564317211 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2408103b80 0x7f2408103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:54.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.154+0000 7f240cb4f640 1 -- 172.21.15.46:0/1564317211 >> 172.21.15.46:0/1564317211 conn(0x7f24080ff5d0 msgr2=0x7f2408101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:54.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.154+0000 7f240cb4f640 1 -- 172.21.15.46:0/1564317211 shutdown_connections 2024-09-21T03:59:54.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.154+0000 7f240cb4f640 1 -- 172.21.15.46:0/1564317211 wait complete. 2024-09-21T03:59:54.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.154+0000 7f240cb4f640 1 Processor -- start 2024-09-21T03:59:54.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.155+0000 7f240cb4f640 1 -- start start 2024-09-21T03:59:54.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.155+0000 7f240cb4f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2408103b80 0x7f240819a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:54.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.155+0000 7f240cb4f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24081094c0 0x7f240819aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:54.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.155+0000 7f240cb4f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2408109e10 0x7f240819fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:54.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.155+0000 7f240cb4f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2408113af0 con 0x7f24081094c0 2024-09-21T03:59:54.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.155+0000 7f240cb4f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2408113970 con 0x7f2408103b80 2024-09-21T03:59:54.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.155+0000 7f240cb4f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2408113c70 con 0x7f2408109e10 2024-09-21T03:59:54.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.155+0000 7f2405d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24081094c0 0x7f240819aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:54.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.155+0000 7f2405d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24081094c0 0x7f240819aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56942/0 (socket says 172.21.15.46:56942) 2024-09-21T03:59:54.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.155+0000 7f2405d9b640 1 -- 172.21.15.46:0/1453497585 learned_addr learned my addr 172.21.15.46:0/1453497585 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:54.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.155+0000 7f240659c640 1 --2- 172.21.15.46:0/1453497585 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2408103b80 0x7f240819a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:54.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.155+0000 7f2406d9d640 1 --2- 172.21.15.46:0/1453497585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2408109e10 0x7f240819fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:54.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.155+0000 7f2405d9b640 1 -- 172.21.15.46:0/1453497585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2408109e10 msgr2=0x7f240819fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:54.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.155+0000 7f2405d9b640 1 --2- 172.21.15.46:0/1453497585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2408109e10 0x7f240819fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:54.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.155+0000 7f2405d9b640 1 -- 172.21.15.46:0/1453497585 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2408103b80 msgr2=0x7f240819a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:54.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.155+0000 7f2405d9b640 1 --2- 172.21.15.46:0/1453497585 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2408103b80 0x7f240819a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:54.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.155+0000 7f2405d9b640 1 -- 172.21.15.46:0/1453497585 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24081a0470 con 0x7f24081094c0 2024-09-21T03:59:54.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.155+0000 7f2406d9d640 1 --2- 172.21.15.46:0/1453497585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2408109e10 0x7f240819fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:59:54.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.155+0000 7f240659c640 1 --2- 172.21.15.46:0/1453497585 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2408103b80 0x7f240819a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:59:54.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.156+0000 7f2405d9b640 1 --2- 172.21.15.46:0/1453497585 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24081094c0 0x7f240819aaa0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f23fc02a930 tx=0x7f23fc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:54.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.156+0000 7f23f77fe640 1 -- 172.21.15.46:0/1453497585 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23fc03f030 con 0x7f24081094c0 2024-09-21T03:59:54.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.156+0000 7f23f77fe640 1 -- 172.21.15.46:0/1453497585 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23fc003cb0 con 0x7f24081094c0 2024-09-21T03:59:54.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.156+0000 7f23f77fe640 1 -- 172.21.15.46:0/1453497585 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23fc035070 con 0x7f24081094c0 2024-09-21T03:59:54.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.156+0000 7f240cb4f640 1 -- 172.21.15.46:0/1453497585 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24081a0700 con 0x7f24081094c0 2024-09-21T03:59:54.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.156+0000 7f240cb4f640 1 -- 172.21.15.46:0/1453497585 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24081a6ec0 con 0x7f24081094c0 2024-09-21T03:59:54.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.158+0000 7f24130c3740 1 Processor -- start 2024-09-21T03:59:54.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.159+0000 7f24130c3740 1 -- start start 2024-09-21T03:59:54.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.159+0000 7f24130c3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56510d406350 0x56510d7ad430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:54.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.159+0000 7f24130c3740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56510d3dd490 0x56510d7ad970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:54.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.159+0000 7f24130c3740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56510d3e5670 0x56510d7adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:54.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.159+0000 7f24130c3740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x56510d723e60 con 0x56510d3dd490 2024-09-21T03:59:54.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.159+0000 7f24130c3740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56510d713290 con 0x56510d3e5670 2024-09-21T03:59:54.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.159+0000 7f24130c3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56510d7170a0 con 0x56510d406350 2024-09-21T03:59:54.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.159+0000 7f23f77fe640 1 -- 172.21.15.46:0/1453497585 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f23fc042030 con 0x7f24081094c0 2024-09-21T03:59:54.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.159+0000 7f240659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56510d3dd490 0x56510d7ad970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:54.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.159+0000 7f240659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56510d3dd490 0x56510d7ad970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56956/0 (socket says 172.21.15.46:56956) 2024-09-21T03:59:54.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.159+0000 7f240659c640 1 -- 172.21.15.46:0/2662883374 learned_addr learned my addr 172.21.15.46:0/2662883374 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:54.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.159+0000 7f2406d9d640 1 --2- 172.21.15.46:0/2662883374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56510d406350 0x56510d7ad430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:54.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.159+0000 7f2405d9b640 1 --2- 172.21.15.46:0/2662883374 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56510d3e5670 0x56510d7adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:54.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.160+0000 7f240659c640 1 -- 172.21.15.46:0/2662883374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56510d406350 msgr2=0x56510d7ad430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:54.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.160+0000 7f240659c640 1 --2- 172.21.15.46:0/2662883374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56510d406350 0x56510d7ad430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:54.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.160+0000 7f240659c640 1 -- 172.21.15.46:0/2662883374 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56510d3e5670 msgr2=0x56510d7adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:54.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.160+0000 7f240659c640 1 --2- 172.21.15.46:0/2662883374 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56510d3e5670 0x56510d7adeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:54.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.160+0000 7f240659c640 1 -- 172.21.15.46:0/2662883374 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56510d471930 con 0x56510d3dd490 2024-09-21T03:59:54.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.160+0000 7f240659c640 1 --2- 172.21.15.46:0/2662883374 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56510d3dd490 0x56510d7ad970 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f23f800cca0 tx=0x7f23f800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81a8cc44db5469d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:54.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.160+0000 7f23f4ff9640 1 -- 172.21.15.46:0/2662883374 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f8005220 con 0x56510d3dd490 2024-09-21T03:59:54.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.160+0000 7f23f77fe640 1 --2- 172.21.15.46:0/1453497585 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f23f00b6680 0x7f23f00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:54.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.160+0000 7f23f4ff9640 1 -- 172.21.15.46:0/2662883374 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23f8004c50 con 0x56510d3dd490 2024-09-21T03:59:54.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.160+0000 7f23f4ff9640 1 -- 172.21.15.46:0/2662883374 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f8010770 con 0x56510d3dd490 2024-09-21T03:59:54.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.160+0000 7f2406d9d640 1 --2- 172.21.15.46:0/1453497585 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f23f00b6680 0x7f23f00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:54.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.160+0000 7f23f77fe640 1 -- 172.21.15.46:0/1453497585 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f23fc107d90 con 0x7f24081094c0 2024-09-21T03:59:54.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.161+0000 7f24130c3740 1 -- 172.21.15.46:0/2662883374 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56510d3dd490 msgr2=0x56510d7ad970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:54.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.161+0000 7f2406d9d640 1 --2- 172.21.15.46:0/1453497585 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f23f00b6680 0x7f23f00b8b90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f240000f4c0 tx=0x7f2400007740 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:54.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.161+0000 7f24130c3740 1 --2- 172.21.15.46:0/2662883374 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56510d3dd490 0x56510d7ad970 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f23f800cca0 tx=0x7f23f800e720 comp rx=0 tx=0).stop 2024-09-21T03:59:54.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.161+0000 7f24130c3740 1 -- 172.21.15.46:0/2662883374 shutdown_connections 2024-09-21T03:59:54.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.161+0000 7f24130c3740 1 --2- 172.21.15.46:0/2662883374 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56510d3e5670 0x56510d7adeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:54.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.161+0000 7f24130c3740 1 --2- 172.21.15.46:0/2662883374 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56510d3dd490 0x56510d7ad970 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:54.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.161+0000 7f24130c3740 1 --2- 172.21.15.46:0/2662883374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56510d406350 0x56510d7ad430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:54.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.161+0000 7f24130c3740 1 -- 172.21.15.46:0/2662883374 >> 172.21.15.46:0/2662883374 conn(0x56510d3fa740 msgr2=0x56510d7ab320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:54.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.162+0000 7f24130c3740 1 -- 172.21.15.46:0/2662883374 shutdown_connections 2024-09-21T03:59:54.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.162+0000 7f24130c3740 1 -- 172.21.15.46:0/2662883374 wait complete. 2024-09-21T03:59:54.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.162+0000 7f24130c3740 1 -- start start 2024-09-21T03:59:54.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.162+0000 7f24130c3740 1 Processor -- start 2024-09-21T03:59:54.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.162+0000 7f24130c3740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56510d3dd490 0x56510d7bd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:54.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.162+0000 7f24130c3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56510d3e5670 0x56510d7bd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:54.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.162+0000 7f24130c3740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56510d406350 0x56510d7c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:54.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.162+0000 7f24130c3740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x56510d574890 con 0x56510d406350 2024-09-21T03:59:54.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.162+0000 7f24130c3740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56510d6add40 con 0x56510d3dd490 2024-09-21T03:59:54.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.162+0000 7f24130c3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56510d7bff70 con 0x56510d3e5670 2024-09-21T03:59:54.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.163+0000 7f24130c3740 10 client.0 _ll_register_callbacks cb 0x56510d711c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:59:54.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.163+0000 7f2406d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56510d406350 0x56510d7c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:54.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.163+0000 7f240659c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56510d3dd490 0x56510d7bd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:54.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.163+0000 7f2406d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56510d406350 0x56510d7c92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56964/0 (socket says 172.21.15.46:56964) 2024-09-21T03:59:54.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.163+0000 7f2406d9d640 1 -- 172.21.15.46:0/1838968832 learned_addr learned my addr 172.21.15.46:0/1838968832 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:54.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.163+0000 7f2405d9b640 1 --2- 172.21.15.46:0/1838968832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56510d3e5670 0x56510d7bd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:54.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.163+0000 7f2406d9d640 1 -- 172.21.15.46:0/1838968832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56510d3e5670 msgr2=0x56510d7bd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:54.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.163+0000 7f2406d9d640 1 --2- 172.21.15.46:0/1838968832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56510d3e5670 0x56510d7bd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:54.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.163+0000 7f2406d9d640 1 -- 172.21.15.46:0/1838968832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56510d3dd490 msgr2=0x56510d7bd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:54.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.163+0000 7f2406d9d640 1 --2- 172.21.15.46:0/1838968832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56510d3dd490 0x56510d7bd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:54.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.163+0000 7f2406d9d640 1 -- 172.21.15.46:0/1838968832 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56510d7c9810 con 0x56510d406350 2024-09-21T03:59:54.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.163+0000 7f2406d9d640 1 --2- 172.21.15.46:0/1838968832 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56510d406350 0x56510d7c92d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f2400010eb0 tx=0x7f2400004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ad0d617fe2fea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:54.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.163+0000 7f23edffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:59:54.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.163+0000 7f23edffb640 1 -- 172.21.15.46:0/1838968832 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2400026680 con 0x56510d406350 2024-09-21T03:59:54.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.163+0000 7f23edffb640 1 -- 172.21.15.46:0/1838968832 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f2400026820 con 0x56510d406350 2024-09-21T03:59:54.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.163+0000 7f24130c3740 1 -- 172.21.15.46:0/1838968832 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23f8004c50 con 0x56510d406350 2024-09-21T03:59:54.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.164+0000 7f23edffb640 1 -- 172.21.15.46:0/1838968832 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f240002b030 con 0x56510d406350 2024-09-21T03:59:54.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.164+0000 7f24130c3740 10 client.16155 fetch_fsmap learned FSMap version 20 2024-09-21T03:59:54.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.164+0000 7f24130c3740 1 -- 172.21.15.46:0/1838968832 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56510d7cc180 con 0x56510d406350 2024-09-21T03:59:54.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.164+0000 7f23edffb640 1 -- 172.21.15.46:0/1838968832 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23f8004c50 con 0x56510d406350 2024-09-21T03:59:54.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.164+0000 7f23edffb640 1 -- 172.21.15.46:0/1838968832 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f2400030b90 con 0x56510d406350 2024-09-21T03:59:54.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.164+0000 7f24130c3740 10 client.16155 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:59:54.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.164+0000 7f24130c3740 10 client.16155 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:59:54.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.164+0000 7f24130c3740 20 client.16155 populate_metadata read hostname 'smithi046' 2024-09-21T03:59:54.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.164+0000 7f24130c3740 1 --2- 172.21.15.46:0/1838968832 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56510d3c4cd0 0x56510d7cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:54.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.164+0000 7f24130c3740 4 client.16155 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:59:54.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.164+0000 7f24130c3740 1 -- 172.21.15.46:0/1838968832 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56510d725db0 con 0x56510d3c4cd0 2024-09-21T03:59:54.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.165+0000 7f240659c640 1 --2- 172.21.15.46:0/1838968832 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56510d3c4cd0 0x56510d7cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:54.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.165+0000 7f240659c640 1 --2- 172.21.15.46:0/1838968832 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56510d3c4cd0 0x56510d7cf720 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe8c67736d8955e server_cookie=5080bb72a5231fc5 in_seq=0 out_seq=0 2024-09-21T03:59:54.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.165+0000 7f23edffb640 10 client.16155 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:59:54.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.166+0000 7f23edffb640 1 -- 172.21.15.46:0/1838968832 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56510d725db0 con 0x56510d3c4cd0 2024-09-21T03:59:54.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.166+0000 7f23edffb640 10 client.16155 handle_command_reply: tid=0 2024-09-21T03:59:54.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.166+0000 7f24130c3740 1 client.16155 shutdown 2024-09-21T03:59:54.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.166+0000 7f24130c3740 1 -- 172.21.15.46:0/1838968832 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56510d406350 msgr2=0x56510d7c92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:54.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.166+0000 7f24130c3740 1 --2- 172.21.15.46:0/1838968832 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56510d406350 0x56510d7c92d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f2400010eb0 tx=0x7f2400004b50 comp rx=0 tx=0).stop 2024-09-21T03:59:54.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.166+0000 7f24130c3740 1 -- 172.21.15.46:0/1838968832 shutdown_connections 2024-09-21T03:59:54.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.166+0000 7f24130c3740 1 --2- 172.21.15.46:0/1838968832 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56510d3c4cd0 0x56510d7cf720 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:54.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.166+0000 7f24130c3740 1 --2- 172.21.15.46:0/1838968832 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56510d406350 0x56510d7c92d0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:54.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.166+0000 7f24130c3740 1 --2- 172.21.15.46:0/1838968832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56510d3e5670 0x56510d7bd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:54.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.166+0000 7f24130c3740 1 --2- 172.21.15.46:0/1838968832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56510d3dd490 0x56510d7bd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:54.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.166+0000 7f23edffb640 0 client.16155 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:59:54.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.166+0000 7f24130c3740 1 -- 172.21.15.46:0/1838968832 >> 172.21.15.46:0/1838968832 conn(0x56510d3fa740 msgr2=0x56510d7aee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:54.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.166+0000 7f24130c3740 1 -- 172.21.15.46:0/1838968832 shutdown_connections 2024-09-21T03:59:54.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.166+0000 7f24130c3740 1 -- 172.21.15.46:0/1838968832 wait complete. 2024-09-21T03:59:54.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.166+0000 7f24130c3740 20 client.16155 trim_cache size 0 max 16384 2024-09-21T03:59:54.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.184+0000 7f24130c3740 1 Processor -- start 2024-09-21T03:59:54.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.184+0000 7f24130c3740 1 -- start start 2024-09-21T03:59:54.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.184+0000 7f24130c3740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56510d3dd490 0x56510d7bba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:54.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.184+0000 7f24130c3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56510d3e5670 0x56510d7bbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:54.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.184+0000 7f24130c3740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56510d406350 0x56510d7aa860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:54.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.184+0000 7f24130c3740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f24081ab460 con 0x56510d3dd490 2024-09-21T03:59:54.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.184+0000 7f24130c3740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f24081add00 con 0x56510d406350 2024-09-21T03:59:54.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.184+0000 7f24130c3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f24081abaf0 con 0x56510d3e5670 2024-09-21T03:59:54.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.185+0000 7f240659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56510d3dd490 0x56510d7bba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:54.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.185+0000 7f240659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56510d3dd490 0x56510d7bba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56976/0 (socket says 172.21.15.46:56976) 2024-09-21T03:59:54.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.185+0000 7f240659c640 1 -- 172.21.15.46:0/593461404 learned_addr learned my addr 172.21.15.46:0/593461404 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:54.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.185+0000 7f2406d9d640 1 --2- 172.21.15.46:0/593461404 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56510d406350 0x56510d7aa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:54.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.185+0000 7f2405d9b640 1 --2- 172.21.15.46:0/593461404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56510d3e5670 0x56510d7bbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:54.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.185+0000 7f240659c640 1 -- 172.21.15.46:0/593461404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56510d3e5670 msgr2=0x56510d7bbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:54.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.185+0000 7f240659c640 1 --2- 172.21.15.46:0/593461404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56510d3e5670 0x56510d7bbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:54.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.185+0000 7f240659c640 1 -- 172.21.15.46:0/593461404 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56510d406350 msgr2=0x56510d7aa860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:54.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.185+0000 7f240659c640 1 --2- 172.21.15.46:0/593461404 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56510d406350 0x56510d7aa860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:54.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.185+0000 7f240659c640 1 -- 172.21.15.46:0/593461404 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56510d7a69e0 con 0x56510d3dd490 2024-09-21T03:59:54.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.185+0000 7f240659c640 1 --2- 172.21.15.46:0/593461404 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56510d3dd490 0x56510d7bba10 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f23f800cca0 tx=0x7f23f80056c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff35efea5f81044 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:54.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.185+0000 7f23effff640 1 -- 172.21.15.46:0/593461404 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f8004220 con 0x56510d3dd490 2024-09-21T03:59:54.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.185+0000 7f23effff640 1 -- 172.21.15.46:0/593461404 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23f80043c0 con 0x56510d3dd490 2024-09-21T03:59:54.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.185+0000 7f23effff640 1 -- 172.21.15.46:0/593461404 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f8003850 con 0x56510d3dd490 2024-09-21T03:59:54.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.186+0000 7f24130c3740 1 -- 172.21.15.46:0/593461404 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56510d3dd490 msgr2=0x56510d7bba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:54.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.186+0000 7f24130c3740 1 --2- 172.21.15.46:0/593461404 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56510d3dd490 0x56510d7bba10 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f23f800cca0 tx=0x7f23f80056c0 comp rx=0 tx=0).stop 2024-09-21T03:59:54.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.186+0000 7f24130c3740 1 -- 172.21.15.46:0/593461404 shutdown_connections 2024-09-21T03:59:54.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.186+0000 7f24130c3740 1 --2- 172.21.15.46:0/593461404 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56510d406350 0x56510d7aa860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:54.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.186+0000 7f24130c3740 1 --2- 172.21.15.46:0/593461404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56510d3e5670 0x56510d7bbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:54.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.186+0000 7f24130c3740 1 --2- 172.21.15.46:0/593461404 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56510d3dd490 0x56510d7bba10 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:54.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.186+0000 7f24130c3740 1 -- 172.21.15.46:0/593461404 >> 172.21.15.46:0/593461404 conn(0x56510d3fa740 msgr2=0x56510d7b82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:54.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.186+0000 7f24130c3740 1 -- 172.21.15.46:0/593461404 shutdown_connections 2024-09-21T03:59:54.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.186+0000 7f24130c3740 1 -- 172.21.15.46:0/593461404 wait complete. 2024-09-21T03:59:54.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.187+0000 7f24130c3740 1 -- start start 2024-09-21T03:59:54.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.187+0000 7f24130c3740 1 Processor -- start 2024-09-21T03:59:54.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.187+0000 7f24130c3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56510d3dd490 0x56510d7c1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:54.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.187+0000 7f24130c3740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56510d3e5670 0x56510d7c2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:54.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.187+0000 7f24130c3740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56510d406350 0x56510d8330b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:54.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.187+0000 7f24130c3740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f24081ac1c0 con 0x56510d3e5670 2024-09-21T03:59:54.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.187+0000 7f24130c3740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f24081ad630 con 0x56510d406350 2024-09-21T03:59:54.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.187+0000 7f24130c3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f24081ac890 con 0x56510d3dd490 2024-09-21T03:59:54.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.187+0000 7f24130c3740 10 client.0 _ll_register_callbacks cb 0x7f2400007cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:59:54.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.187+0000 7f2405d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56510d3e5670 0x56510d7c2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:54.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.187+0000 7f2405d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56510d3e5670 0x56510d7c2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56982/0 (socket says 172.21.15.46:56982) 2024-09-21T03:59:54.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.187+0000 7f2405d9b640 1 -- 172.21.15.46:0/3916330623 learned_addr learned my addr 172.21.15.46:0/3916330623 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:54.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.187+0000 7f2406d9d640 1 --2- 172.21.15.46:0/3916330623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56510d406350 0x56510d8330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:54.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.187+0000 7f240659c640 1 --2- 172.21.15.46:0/3916330623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56510d3dd490 0x56510d7c1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:54.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.187+0000 7f2405d9b640 1 -- 172.21.15.46:0/3916330623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56510d3dd490 msgr2=0x56510d7c1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:54.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.187+0000 7f2405d9b640 1 --2- 172.21.15.46:0/3916330623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56510d3dd490 0x56510d7c1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:54.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.188+0000 7f2405d9b640 1 -- 172.21.15.46:0/3916330623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56510d406350 msgr2=0x56510d8330b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:54.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.188+0000 7f2405d9b640 1 --2- 172.21.15.46:0/3916330623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56510d406350 0x56510d8330b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:54.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.188+0000 7f2405d9b640 1 -- 172.21.15.46:0/3916330623 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56510d833720 con 0x56510d3e5670 2024-09-21T03:59:54.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.188+0000 7f2405d9b640 1 --2- 172.21.15.46:0/3916330623 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56510d3e5670 0x56510d7c2150 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f23fc0cd980 tx=0x7f23fc02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf1736081d5ec929 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:54.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.188+0000 7f23edffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:59:54.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.188+0000 7f23edffb640 1 -- 172.21.15.46:0/3916330623 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23fc049040 con 0x56510d3e5670 2024-09-21T03:59:54.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.188+0000 7f23edffb640 1 -- 172.21.15.46:0/3916330623 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f23fc03bbe0 con 0x56510d3e5670 2024-09-21T03:59:54.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.188+0000 7f24130c3740 1 -- 172.21.15.46:0/3916330623 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23f80043c0 con 0x56510d3e5670 2024-09-21T03:59:54.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.188+0000 7f23edffb640 1 -- 172.21.15.46:0/3916330623 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f23fc0cd3f0 con 0x56510d3e5670 2024-09-21T03:59:54.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.188+0000 7f24130c3740 10 client.16161 fetch_fsmap learned FSMap version 20 2024-09-21T03:59:54.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.188+0000 7f24130c3740 1 -- 172.21.15.46:0/3916330623 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56510d83ab30 con 0x56510d3e5670 2024-09-21T03:59:54.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.188+0000 7f23edffb640 1 -- 172.21.15.46:0/3916330623 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23f80043c0 con 0x56510d3e5670 2024-09-21T03:59:54.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.188+0000 7f23edffb640 1 -- 172.21.15.46:0/3916330623 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f23fc0f10b0 con 0x56510d3e5670 2024-09-21T03:59:54.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.189+0000 7f24130c3740 10 client.16161 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:59:54.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.189+0000 7f24130c3740 10 client.16161 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:59:54.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.189+0000 7f24130c3740 20 client.16161 populate_metadata read hostname 'smithi046' 2024-09-21T03:59:54.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.189+0000 7f24130c3740 1 --2- 172.21.15.46:0/3916330623 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56510d39a080 0x56510d83d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:54.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.189+0000 7f24130c3740 4 client.16161 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:59:54.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.189+0000 7f24130c3740 1 -- 172.21.15.46:0/3916330623 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56510d721860 con 0x56510d39a080 2024-09-21T03:59:54.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.189+0000 7f240659c640 1 --2- 172.21.15.46:0/3916330623 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56510d39a080 0x56510d83d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:54.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.189+0000 7f240659c640 1 --2- 172.21.15.46:0/3916330623 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56510d39a080 0x56510d83d2f0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=469adfca294a5d69 server_cookie=658fa0eddadfbd92 in_seq=0 out_seq=0 2024-09-21T03:59:54.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.189+0000 7f23edffb640 10 client.16161 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:59:54.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.191+0000 7f23edffb640 1 -- 172.21.15.46:0/3916330623 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56510d721860 con 0x56510d39a080 2024-09-21T03:59:54.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.191+0000 7f23edffb640 10 client.16161 handle_command_reply: tid=0 2024-09-21T03:59:54.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.191+0000 7f24130c3740 1 client.16161 shutdown 2024-09-21T03:59:54.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.191+0000 7f24130c3740 1 -- 172.21.15.46:0/3916330623 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56510d3e5670 msgr2=0x56510d7c2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:54.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.191+0000 7f24130c3740 1 --2- 172.21.15.46:0/3916330623 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56510d3e5670 0x56510d7c2150 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f23fc0cd980 tx=0x7f23fc02a410 comp rx=0 tx=0).stop 2024-09-21T03:59:54.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.191+0000 7f24130c3740 1 -- 172.21.15.46:0/3916330623 shutdown_connections 2024-09-21T03:59:54.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.191+0000 7f24130c3740 1 --2- 172.21.15.46:0/3916330623 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56510d39a080 0x56510d83d2f0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:54.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.191+0000 7f24130c3740 1 --2- 172.21.15.46:0/3916330623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56510d406350 0x56510d8330b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:54.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.191+0000 7f24130c3740 1 --2- 172.21.15.46:0/3916330623 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56510d3e5670 0x56510d7c2150 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:54.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.191+0000 7f23edffb640 0 client.16161 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:59:54.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.191+0000 7f24130c3740 1 --2- 172.21.15.46:0/3916330623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56510d3dd490 0x56510d7c1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:54.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.191+0000 7f24130c3740 1 -- 172.21.15.46:0/3916330623 >> 172.21.15.46:0/3916330623 conn(0x56510d3fa740 msgr2=0x56510d7bb5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:54.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.191+0000 7f24130c3740 1 -- 172.21.15.46:0/3916330623 shutdown_connections 2024-09-21T03:59:54.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.191+0000 7f24130c3740 1 -- 172.21.15.46:0/3916330623 wait complete. 2024-09-21T03:59:54.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.191+0000 7f24130c3740 20 client.16161 trim_cache size 0 max 16384 2024-09-21T03:59:54.197 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T03:59:54.198 INFO:teuthology.orchestra.run.smithi046.stdout: "return_code": 0, 2024-09-21T03:59:54.198 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_tag": "326aaecf-f38a-4946-988a-d83f25556995", 2024-09-21T03:59:54.198 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": "asynchronous" 2024-09-21T03:59:54.198 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T03:59:54.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.192+0000 7f240cb4f640 1 -- 172.21.15.46:0/1453497585 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f23f00b6680 msgr2=0x7f23f00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:54.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.192+0000 7f240cb4f640 1 --2- 172.21.15.46:0/1453497585 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f23f00b6680 0x7f23f00b8b90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f240000f4c0 tx=0x7f2400007740 comp rx=0 tx=0).stop 2024-09-21T03:59:54.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.192+0000 7f240cb4f640 1 -- 172.21.15.46:0/1453497585 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24081094c0 msgr2=0x7f240819aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:54.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.192+0000 7f240cb4f640 1 --2- 172.21.15.46:0/1453497585 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24081094c0 0x7f240819aaa0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f23fc02a930 tx=0x7f23fc004270 comp rx=0 tx=0).stop 2024-09-21T03:59:54.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.192+0000 7f240cb4f640 1 -- 172.21.15.46:0/1453497585 shutdown_connections 2024-09-21T03:59:54.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.192+0000 7f240cb4f640 1 --2- 172.21.15.46:0/1453497585 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f23f00b6680 0x7f23f00b8b90 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:54.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.192+0000 7f240cb4f640 1 --2- 172.21.15.46:0/1453497585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2408109e10 0x7f240819fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:54.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.192+0000 7f240cb4f640 1 --2- 172.21.15.46:0/1453497585 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24081094c0 0x7f240819aaa0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:54.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.192+0000 7f240cb4f640 1 --2- 172.21.15.46:0/1453497585 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2408103b80 0x7f240819a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:54.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.192+0000 7f240cb4f640 1 -- 172.21.15.46:0/1453497585 >> 172.21.15.46:0/1453497585 conn(0x7f24080ff5d0 msgr2=0x7f24081019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:54.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.192+0000 7f240cb4f640 1 -- 172.21.15.46:0/1453497585 shutdown_connections 2024-09-21T03:59:54.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:54.192+0000 7f240cb4f640 1 -- 172.21.15.46:0/1453497585 wait complete. 2024-09-21T03:59:54.970 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:59:55.227 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:59:55.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:55 smithi162 ceph-mon[35071]: pgmap v466: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:59:55.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:55 smithi162 ceph-mon[35071]: scrub queued for path: / 2024-09-21T03:59:55.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:55 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T03:59:55.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:55 smithi162 ceph-mon[35071]: scrub summary: active paths [/] 2024-09-21T03:59:55.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:55 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T03:59:55.637 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:55 smithi046 ceph-mon[30954]: pgmap v466: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:59:55.637 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:55 smithi046 ceph-mon[30954]: scrub queued for path: / 2024-09-21T03:59:55.637 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:55 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T03:59:55.637 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:55 smithi046 ceph-mon[30954]: scrub summary: active paths [/] 2024-09-21T03:59:55.637 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:55 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T03:59:55.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.730+0000 7fe91015b640 1 -- 172.21.15.46:0/3852115109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe908102650 msgr2=0x7fe908102a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:55.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.730+0000 7fe91015b640 1 --2- 172.21.15.46:0/3852115109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe908102650 0x7fe908102a60 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fe904009900 tx=0x7fe90402a480 comp rx=0 tx=0).stop 2024-09-21T03:59:55.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.730+0000 7fe91015b640 1 -- 172.21.15.46:0/3852115109 shutdown_connections 2024-09-21T03:59:55.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.730+0000 7fe91015b640 1 --2- 172.21.15.46:0/3852115109 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe908110200 0x7fe908112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:55.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.730+0000 7fe91015b640 1 --2- 172.21.15.46:0/3852115109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe908102fa0 0x7fe90810fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:55.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.730+0000 7fe91015b640 1 --2- 172.21.15.46:0/3852115109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe908102650 0x7fe908102a60 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:55.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.730+0000 7fe91015b640 1 -- 172.21.15.46:0/3852115109 >> 172.21.15.46:0/3852115109 conn(0x7fe908079760 msgr2=0x7fe908079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:55.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.730+0000 7fe91015b640 1 -- 172.21.15.46:0/3852115109 shutdown_connections 2024-09-21T03:59:55.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.730+0000 7fe91015b640 1 -- 172.21.15.46:0/3852115109 wait complete. 2024-09-21T03:59:55.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.731+0000 7fe91015b640 1 Processor -- start 2024-09-21T03:59:55.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.731+0000 7fe91015b640 1 -- start start 2024-09-21T03:59:55.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.731+0000 7fe91015b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe908102650 0x7fe90819c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:55.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.731+0000 7fe91015b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe908102fa0 0x7fe90819cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:55.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.731+0000 7fe91015b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe908110200 0x7fe9081a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:55.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.731+0000 7fe91015b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe908115ca0 con 0x7fe908102650 2024-09-21T03:59:55.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.731+0000 7fe91015b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe908115b20 con 0x7fe908110200 2024-09-21T03:59:55.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.731+0000 7fe91015b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe908115e20 con 0x7fe908102fa0 2024-09-21T03:59:55.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.731+0000 7fe90def7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe908102650 0x7fe90819c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:55.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.731+0000 7fe90def7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe908102650 0x7fe90819c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57010/0 (socket says 172.21.15.46:57010) 2024-09-21T03:59:55.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.731+0000 7fe90def7640 1 -- 172.21.15.46:0/2197859243 learned_addr learned my addr 172.21.15.46:0/2197859243 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:55.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.731+0000 7fe90d6f6640 1 --2- 172.21.15.46:0/2197859243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe908102fa0 0x7fe90819cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:55.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.731+0000 7fe90def7640 1 -- 172.21.15.46:0/2197859243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe908102fa0 msgr2=0x7fe90819cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:55.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.731+0000 7fe90e6f8640 1 --2- 172.21.15.46:0/2197859243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe908110200 0x7fe9081a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:55.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.731+0000 7fe90def7640 1 --2- 172.21.15.46:0/2197859243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe908102fa0 0x7fe90819cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:55.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.731+0000 7fe90def7640 1 -- 172.21.15.46:0/2197859243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe908110200 msgr2=0x7fe9081a1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:55.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.731+0000 7fe90def7640 1 --2- 172.21.15.46:0/2197859243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe908110200 0x7fe9081a1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:55.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.731+0000 7fe90def7640 1 -- 172.21.15.46:0/2197859243 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9081a25a0 con 0x7fe908102650 2024-09-21T03:59:55.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.732+0000 7fe90def7640 1 --2- 172.21.15.46:0/2197859243 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe908102650 0x7fe90819c630 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe904005940 tx=0x7fe9040042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:55.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.732+0000 7fe8feffd640 1 -- 172.21.15.46:0/2197859243 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90403f030 con 0x7fe908102650 2024-09-21T03:59:55.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.732+0000 7fe91015b640 1 -- 172.21.15.46:0/2197859243 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9081a2830 con 0x7fe908102650 2024-09-21T03:59:55.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.732+0000 7fe8feffd640 1 -- 172.21.15.46:0/2197859243 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe904003cb0 con 0x7fe908102650 2024-09-21T03:59:55.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.732+0000 7fe8feffd640 1 -- 172.21.15.46:0/2197859243 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe904035070 con 0x7fe908102650 2024-09-21T03:59:55.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.732+0000 7fe91015b640 1 -- 172.21.15.46:0/2197859243 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9081a8ff0 con 0x7fe908102650 2024-09-21T03:59:55.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.734+0000 7fe9166cf740 1 Processor -- start 2024-09-21T03:59:55.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.735+0000 7fe9166cf740 1 -- start start 2024-09-21T03:59:55.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.735+0000 7fe8feffd640 1 -- 172.21.15.46:0/2197859243 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7fe904042030 con 0x7fe908102650 2024-09-21T03:59:55.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.735+0000 7fe9166cf740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556608b1f070 0x556608ec6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:55.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.735+0000 7fe9166cf740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556608af61b0 0x556608ec67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:55.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.735+0000 7fe9166cf740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556608afe390 0x556608ec6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:55.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.735+0000 7fe9166cf740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x556608e3ce50 con 0x556608af61b0 2024-09-21T03:59:55.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.735+0000 7fe9166cf740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x556608e2c280 con 0x556608b1f070 2024-09-21T03:59:55.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.735+0000 7fe9166cf740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556608e30090 con 0x556608afe390 2024-09-21T03:59:55.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.735+0000 7fe90def7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556608af61b0 0x556608ec67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:55.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.735+0000 7fe90def7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556608af61b0 0x556608ec67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57022/0 (socket says 172.21.15.46:57022) 2024-09-21T03:59:55.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.735+0000 7fe90def7640 1 -- 172.21.15.46:0/3457798742 learned_addr learned my addr 172.21.15.46:0/3457798742 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:55.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.735+0000 7fe90e6f8640 1 --2- 172.21.15.46:0/3457798742 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556608b1f070 0x556608ec6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:55.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.735+0000 7fe90d6f6640 1 --2- 172.21.15.46:0/3457798742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556608afe390 0x556608ec6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:55.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.735+0000 7fe90def7640 1 -- 172.21.15.46:0/3457798742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556608afe390 msgr2=0x556608ec6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:55.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.735+0000 7fe90def7640 1 --2- 172.21.15.46:0/3457798742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556608afe390 0x556608ec6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:55.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.735+0000 7fe90def7640 1 -- 172.21.15.46:0/3457798742 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556608b1f070 msgr2=0x556608ec6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:55.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.735+0000 7fe90def7640 1 --2- 172.21.15.46:0/3457798742 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556608b1f070 0x556608ec6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:55.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.735+0000 7fe90def7640 1 -- 172.21.15.46:0/3457798742 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556608b8a650 con 0x556608af61b0 2024-09-21T03:59:55.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.736+0000 7fe8feffd640 1 --2- 172.21.15.46:0/2197859243 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe8f40b6680 0x7fe8f40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:55.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.736+0000 7fe90def7640 1 --2- 172.21.15.46:0/3457798742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556608af61b0 0x556608ec67b0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fe904105710 tx=0x7fe9041102a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2962fb709d47edc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:55.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.736+0000 7fe90e6f8640 1 --2- 172.21.15.46:0/2197859243 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe8f40b6680 0x7fe8f40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:55.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.736+0000 7fe8feffd640 1 -- 172.21.15.46:0/2197859243 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fe904107fe0 con 0x7fe908102650 2024-09-21T03:59:55.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.736+0000 7fe8f3fff640 1 -- 172.21.15.46:0/3457798742 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9040ca520 con 0x556608af61b0 2024-09-21T03:59:55.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.736+0000 7fe8f3fff640 1 -- 172.21.15.46:0/3457798742 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9040cd9e0 con 0x556608af61b0 2024-09-21T03:59:55.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.736+0000 7fe8f3fff640 1 -- 172.21.15.46:0/3457798742 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9040cd640 con 0x556608af61b0 2024-09-21T03:59:55.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.737+0000 7fe9166cf740 1 -- 172.21.15.46:0/3457798742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556608af61b0 msgr2=0x556608ec67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:55.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.737+0000 7fe90e6f8640 1 --2- 172.21.15.46:0/2197859243 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe8f40b6680 0x7fe8f40b8b90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe900005fd0 tx=0x7fe900009620 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:55.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.737+0000 7fe9166cf740 1 --2- 172.21.15.46:0/3457798742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556608af61b0 0x556608ec67b0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fe904105710 tx=0x7fe9041102a0 comp rx=0 tx=0).stop 2024-09-21T03:59:55.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.737+0000 7fe9166cf740 1 -- 172.21.15.46:0/3457798742 shutdown_connections 2024-09-21T03:59:55.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.737+0000 7fe9166cf740 1 --2- 172.21.15.46:0/3457798742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556608afe390 0x556608ec6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:55.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.737+0000 7fe9166cf740 1 --2- 172.21.15.46:0/3457798742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556608af61b0 0x556608ec67b0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:55.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.737+0000 7fe9166cf740 1 --2- 172.21.15.46:0/3457798742 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556608b1f070 0x556608ec6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:55.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.737+0000 7fe9166cf740 1 -- 172.21.15.46:0/3457798742 >> 172.21.15.46:0/3457798742 conn(0x556608b13460 msgr2=0x556608ec4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:55.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.737+0000 7fe9166cf740 1 -- 172.21.15.46:0/3457798742 shutdown_connections 2024-09-21T03:59:55.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.737+0000 7fe9166cf740 1 -- 172.21.15.46:0/3457798742 wait complete. 2024-09-21T03:59:55.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.737+0000 7fe9166cf740 1 -- start start 2024-09-21T03:59:55.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.738+0000 7fe9166cf740 1 Processor -- start 2024-09-21T03:59:55.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.738+0000 7fe9166cf740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556608af61b0 0x556608ed1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:55.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.738+0000 7fe9166cf740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556608afe390 0x556608ed1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:55.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.738+0000 7fe9166cf740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556608b1f070 0x556608edda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:55.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.738+0000 7fe9166cf740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x556608c8d700 con 0x556608b1f070 2024-09-21T03:59:55.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.738+0000 7fe9166cf740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x556608dc7110 con 0x556608af61b0 2024-09-21T03:59:55.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.738+0000 7fe9166cf740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556608ed4810 con 0x556608afe390 2024-09-21T03:59:55.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.738+0000 7fe9166cf740 10 client.0 _ll_register_callbacks cb 0x556608de0990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:59:55.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.738+0000 7fe90e6f8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556608b1f070 0x556608edda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:55.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.738+0000 7fe90e6f8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556608b1f070 0x556608edda70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57028/0 (socket says 172.21.15.46:57028) 2024-09-21T03:59:55.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.738+0000 7fe90e6f8640 1 -- 172.21.15.46:0/2626011784 learned_addr learned my addr 172.21.15.46:0/2626011784 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:55.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.738+0000 7fe90d6f6640 1 --2- 172.21.15.46:0/2626011784 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556608afe390 0x556608ed1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:55.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.738+0000 7fe90def7640 1 --2- 172.21.15.46:0/2626011784 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556608af61b0 0x556608ed1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:55.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.738+0000 7fe90e6f8640 1 -- 172.21.15.46:0/2626011784 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556608afe390 msgr2=0x556608ed1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:55.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.738+0000 7fe90e6f8640 1 --2- 172.21.15.46:0/2626011784 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556608afe390 0x556608ed1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:55.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.738+0000 7fe90e6f8640 1 -- 172.21.15.46:0/2626011784 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556608af61b0 msgr2=0x556608ed1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:55.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.738+0000 7fe90e6f8640 1 --2- 172.21.15.46:0/2626011784 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556608af61b0 0x556608ed1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:55.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.738+0000 7fe90e6f8640 1 -- 172.21.15.46:0/2626011784 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556608df4c40 con 0x556608b1f070 2024-09-21T03:59:55.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.738+0000 7fe90def7640 1 --2- 172.21.15.46:0/2626011784 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556608af61b0 0x556608ed1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:59:55.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.738+0000 7fe90d6f6640 1 --2- 172.21.15.46:0/2626011784 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556608afe390 0x556608ed1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:59:55.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.739+0000 7fe90e6f8640 1 --2- 172.21.15.46:0/2626011784 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556608b1f070 0x556608edda70 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe900012840 tx=0x7fe900004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b1ab2f1df5d18b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:55.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.739+0000 7fe8f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:59:55.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.739+0000 7fe8f17fa640 1 -- 172.21.15.46:0/2626011784 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90000fae0 con 0x556608b1f070 2024-09-21T03:59:55.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.739+0000 7fe8f17fa640 1 -- 172.21.15.46:0/2626011784 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fe90000fc80 con 0x556608b1f070 2024-09-21T03:59:55.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.739+0000 7fe9166cf740 1 -- 172.21.15.46:0/2626011784 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9040cd9e0 con 0x556608b1f070 2024-09-21T03:59:55.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.739+0000 7fe8f17fa640 1 -- 172.21.15.46:0/2626011784 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe90002c020 con 0x556608b1f070 2024-09-21T03:59:55.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.739+0000 7fe9166cf740 10 client.16173 fetch_fsmap learned FSMap version 20 2024-09-21T03:59:55.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.739+0000 7fe9166cf740 1 -- 172.21.15.46:0/2626011784 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x556608ee04b0 con 0x556608b1f070 2024-09-21T03:59:55.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.739+0000 7fe8f17fa640 1 -- 172.21.15.46:0/2626011784 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9040cd9e0 con 0x556608b1f070 2024-09-21T03:59:55.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.739+0000 7fe8f17fa640 1 -- 172.21.15.46:0/2626011784 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fe90001f540 con 0x556608b1f070 2024-09-21T03:59:55.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.740+0000 7fe9166cf740 10 client.16173 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:59:55.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.740+0000 7fe9166cf740 10 client.16173 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:59:55.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.740+0000 7fe9166cf740 20 client.16173 populate_metadata read hostname 'smithi046' 2024-09-21T03:59:55.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.740+0000 7fe9166cf740 1 --2- 172.21.15.46:0/2626011784 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x556608add9f0 0x556608ee3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:55.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.740+0000 7fe9166cf740 4 client.16173 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:59:55.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.740+0000 7fe9166cf740 1 -- 172.21.15.46:0/2626011784 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556608e3eda0 con 0x556608add9f0 2024-09-21T03:59:55.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.740+0000 7fe90def7640 1 --2- 172.21.15.46:0/2626011784 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x556608add9f0 0x556608ee3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:55.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.740+0000 7fe90def7640 1 --2- 172.21.15.46:0/2626011784 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x556608add9f0 0x556608ee3920 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c33f852b7184d831 server_cookie=25ec0efd41e87654 in_seq=0 out_seq=0 2024-09-21T03:59:55.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.740+0000 7fe8f17fa640 10 client.16173 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:59:55.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.741+0000 7fe8f17fa640 1 -- 172.21.15.46:0/2626011784 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556608e3eda0 con 0x556608add9f0 2024-09-21T03:59:55.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.741+0000 7fe8f17fa640 10 client.16173 handle_command_reply: tid=0 2024-09-21T03:59:55.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.741+0000 7fe9166cf740 1 client.16173 shutdown 2024-09-21T03:59:55.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.742+0000 7fe9166cf740 1 -- 172.21.15.46:0/2626011784 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556608b1f070 msgr2=0x556608edda70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:55.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.742+0000 7fe9166cf740 1 --2- 172.21.15.46:0/2626011784 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556608b1f070 0x556608edda70 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe900012840 tx=0x7fe900004a40 comp rx=0 tx=0).stop 2024-09-21T03:59:55.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.742+0000 7fe9166cf740 1 -- 172.21.15.46:0/2626011784 shutdown_connections 2024-09-21T03:59:55.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.742+0000 7fe9166cf740 1 --2- 172.21.15.46:0/2626011784 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x556608add9f0 0x556608ee3920 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:55.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.742+0000 7fe9166cf740 1 --2- 172.21.15.46:0/2626011784 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556608b1f070 0x556608edda70 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:55.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.742+0000 7fe8f17fa640 0 client.16173 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:59:55.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.742+0000 7fe9166cf740 1 --2- 172.21.15.46:0/2626011784 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556608afe390 0x556608ed1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:55.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.742+0000 7fe9166cf740 1 --2- 172.21.15.46:0/2626011784 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556608af61b0 0x556608ed1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:55.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.742+0000 7fe9166cf740 1 -- 172.21.15.46:0/2626011784 >> 172.21.15.46:0/2626011784 conn(0x556608b13460 msgr2=0x556608ec9400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:55.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.742+0000 7fe9166cf740 1 -- 172.21.15.46:0/2626011784 shutdown_connections 2024-09-21T03:59:55.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.742+0000 7fe9166cf740 1 -- 172.21.15.46:0/2626011784 wait complete. 2024-09-21T03:59:55.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.742+0000 7fe9166cf740 20 client.16173 trim_cache size 0 max 16384 2024-09-21T03:59:55.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.759+0000 7fe9166cf740 1 Processor -- start 2024-09-21T03:59:55.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.759+0000 7fe9166cf740 1 -- start start 2024-09-21T03:59:55.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.760+0000 7fe9166cf740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556608af61b0 0x556608ed1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:55.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.760+0000 7fe9166cf740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556608afe390 0x556608edd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:55.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.760+0000 7fe9166cf740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556608b1f070 0x556608eceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:55.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.760+0000 7fe9166cf740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe9081af6b0 con 0x556608b1f070 2024-09-21T03:59:55.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.760+0000 7fe9166cf740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe9081b1f50 con 0x556608af61b0 2024-09-21T03:59:55.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.760+0000 7fe9166cf740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe9081afd40 con 0x556608afe390 2024-09-21T03:59:55.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.760+0000 7fe90e6f8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556608b1f070 0x556608eceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:55.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.760+0000 7fe90e6f8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556608b1f070 0x556608eceb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57040/0 (socket says 172.21.15.46:57040) 2024-09-21T03:59:55.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.760+0000 7fe90e6f8640 1 -- 172.21.15.46:0/1344460823 learned_addr learned my addr 172.21.15.46:0/1344460823 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:55.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.760+0000 7fe90def7640 1 --2- 172.21.15.46:0/1344460823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556608af61b0 0x556608ed1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:55.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.760+0000 7fe90d6f6640 1 --2- 172.21.15.46:0/1344460823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556608afe390 0x556608edd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:55.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.760+0000 7fe90e6f8640 1 -- 172.21.15.46:0/1344460823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556608afe390 msgr2=0x556608edd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:55.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.760+0000 7fe90e6f8640 1 --2- 172.21.15.46:0/1344460823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556608afe390 0x556608edd970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:55.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.760+0000 7fe90e6f8640 1 -- 172.21.15.46:0/1344460823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556608af61b0 msgr2=0x556608ed1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:55.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.760+0000 7fe90e6f8640 1 --2- 172.21.15.46:0/1344460823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556608af61b0 0x556608ed1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:55.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.760+0000 7fe90e6f8640 1 -- 172.21.15.46:0/1344460823 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556608ed3f00 con 0x556608b1f070 2024-09-21T03:59:55.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.760+0000 7fe90d6f6640 1 --2- 172.21.15.46:0/1344460823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556608afe390 0x556608edd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:59:55.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.760+0000 7fe90e6f8640 1 --2- 172.21.15.46:0/1344460823 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556608b1f070 0x556608eceb30 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fe900011c40 tx=0x7fe90001fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e5cca23824527a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:55.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.761+0000 7fe8f37fe640 1 -- 172.21.15.46:0/1344460823 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90001f620 con 0x556608b1f070 2024-09-21T03:59:55.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.761+0000 7fe8f37fe640 1 -- 172.21.15.46:0/1344460823 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe900003970 con 0x556608b1f070 2024-09-21T03:59:55.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.761+0000 7fe8f37fe640 1 -- 172.21.15.46:0/1344460823 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90000faf0 con 0x556608b1f070 2024-09-21T03:59:55.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.761+0000 7fe9166cf740 1 -- 172.21.15.46:0/1344460823 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556608b1f070 msgr2=0x556608eceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:55.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.761+0000 7fe9166cf740 1 --2- 172.21.15.46:0/1344460823 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556608b1f070 0x556608eceb30 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fe900011c40 tx=0x7fe90001fc80 comp rx=0 tx=0).stop 2024-09-21T03:59:55.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.761+0000 7fe9166cf740 1 -- 172.21.15.46:0/1344460823 shutdown_connections 2024-09-21T03:59:55.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.761+0000 7fe9166cf740 1 --2- 172.21.15.46:0/1344460823 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556608b1f070 0x556608eceb30 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:55.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.761+0000 7fe9166cf740 1 --2- 172.21.15.46:0/1344460823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556608afe390 0x556608edd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:55.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.761+0000 7fe9166cf740 1 --2- 172.21.15.46:0/1344460823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556608af61b0 0x556608ed1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:55.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.761+0000 7fe9166cf740 1 -- 172.21.15.46:0/1344460823 >> 172.21.15.46:0/1344460823 conn(0x556608b13460 msgr2=0x556608ed16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:55.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.761+0000 7fe9166cf740 1 -- 172.21.15.46:0/1344460823 shutdown_connections 2024-09-21T03:59:55.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.761+0000 7fe9166cf740 1 -- 172.21.15.46:0/1344460823 wait complete. 2024-09-21T03:59:55.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.762+0000 7fe9166cf740 1 -- start start 2024-09-21T03:59:55.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.762+0000 7fe9166cf740 1 Processor -- start 2024-09-21T03:59:55.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.762+0000 7fe9166cf740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556608af61b0 0x556608ed5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:55.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.762+0000 7fe9166cf740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556608afe390 0x556608ed5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:55.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.762+0000 7fe9166cf740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556608b1f070 0x556608ed6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:55.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.762+0000 7fe9166cf740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe9081b0410 con 0x556608afe390 2024-09-21T03:59:55.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.762+0000 7fe9166cf740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe9081b1880 con 0x556608b1f070 2024-09-21T03:59:55.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.762+0000 7fe9166cf740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe9081b0ae0 con 0x556608af61b0 2024-09-21T03:59:55.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.762+0000 7fe9166cf740 10 client.0 _ll_register_callbacks cb 0x7fe900009860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:59:55.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.763+0000 7fe90d6f6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556608afe390 0x556608ed5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:55.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.763+0000 7fe90d6f6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556608afe390 0x556608ed5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57048/0 (socket says 172.21.15.46:57048) 2024-09-21T03:59:55.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.763+0000 7fe90d6f6640 1 -- 172.21.15.46:0/4037912882 learned_addr learned my addr 172.21.15.46:0/4037912882 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T03:59:55.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.763+0000 7fe90def7640 1 --2- 172.21.15.46:0/4037912882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556608af61b0 0x556608ed5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:55.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.763+0000 7fe90e6f8640 1 --2- 172.21.15.46:0/4037912882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556608b1f070 0x556608ed6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:55.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.763+0000 7fe90d6f6640 1 -- 172.21.15.46:0/4037912882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556608af61b0 msgr2=0x556608ed5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:55.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.763+0000 7fe90d6f6640 1 --2- 172.21.15.46:0/4037912882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556608af61b0 0x556608ed5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:55.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.763+0000 7fe90d6f6640 1 -- 172.21.15.46:0/4037912882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556608b1f070 msgr2=0x556608ed6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:59:55.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.763+0000 7fe90d6f6640 1 --2- 172.21.15.46:0/4037912882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556608b1f070 0x556608ed6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:55.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.763+0000 7fe90d6f6640 1 -- 172.21.15.46:0/4037912882 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556608f4d2e0 con 0x556608afe390 2024-09-21T03:59:55.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.763+0000 7fe90d6f6640 1 --2- 172.21.15.46:0/4037912882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556608afe390 0x556608ed5ed0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8011e80 tx=0x7fe8f80137d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b31daef1f7297c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:55.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.763+0000 7fe8f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T03:59:55.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.763+0000 7fe8f17fa640 1 -- 172.21.15.46:0/4037912882 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8005220 con 0x556608afe390 2024-09-21T03:59:55.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.763+0000 7fe8f17fa640 1 -- 172.21.15.46:0/4037912882 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fe8f80053c0 con 0x556608afe390 2024-09-21T03:59:55.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.763+0000 7fe9166cf740 1 -- 172.21.15.46:0/4037912882 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe900003970 con 0x556608afe390 2024-09-21T03:59:55.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.763+0000 7fe8f17fa640 1 -- 172.21.15.46:0/4037912882 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe8f80055c0 con 0x556608afe390 2024-09-21T03:59:55.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.764+0000 7fe9166cf740 10 client.16179 fetch_fsmap learned FSMap version 20 2024-09-21T03:59:55.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.764+0000 7fe9166cf740 1 -- 172.21.15.46:0/4037912882 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x556608f4e4d0 con 0x556608afe390 2024-09-21T03:59:55.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.764+0000 7fe8f17fa640 1 -- 172.21.15.46:0/4037912882 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe900003970 con 0x556608afe390 2024-09-21T03:59:55.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.764+0000 7fe8f17fa640 1 -- 172.21.15.46:0/4037912882 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fe8f800f040 con 0x556608afe390 2024-09-21T03:59:55.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.764+0000 7fe9166cf740 10 client.16179 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T03:59:55.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.764+0000 7fe9166cf740 10 client.16179 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:59:55.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.764+0000 7fe9166cf740 20 client.16179 populate_metadata read hostname 'smithi046' 2024-09-21T03:59:55.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.764+0000 7fe9166cf740 1 --2- 172.21.15.46:0/4037912882 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x556608ab2da0 0x556608f50cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:55.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.764+0000 7fe9166cf740 4 client.16179 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:59:55.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.764+0000 7fe9166cf740 1 -- 172.21.15.46:0/4037912882 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556608e3a850 con 0x556608ab2da0 2024-09-21T03:59:55.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.764+0000 7fe90def7640 1 --2- 172.21.15.46:0/4037912882 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x556608ab2da0 0x556608f50cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:55.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.765+0000 7fe8f17fa640 10 client.16179 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T03:59:55.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.765+0000 7fe90def7640 1 --2- 172.21.15.46:0/4037912882 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x556608ab2da0 0x556608f50cf0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e57613eb4056c06f server_cookie=9364d33ab33ea2ca in_seq=0 out_seq=0 2024-09-21T03:59:55.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.765+0000 7fe8f17fa640 1 -- 172.21.15.46:0/4037912882 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3126 (crc 0 0 0) 0x556608e3a850 con 0x556608ab2da0 2024-09-21T03:59:55.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.765+0000 7fe8f17fa640 10 client.16179 handle_command_reply: tid=0 2024-09-21T03:59:55.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.765+0000 7fe9166cf740 1 client.16179 shutdown 2024-09-21T03:59:55.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.765+0000 7fe9166cf740 1 -- 172.21.15.46:0/4037912882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556608afe390 msgr2=0x556608ed5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:55.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.765+0000 7fe9166cf740 1 --2- 172.21.15.46:0/4037912882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556608afe390 0x556608ed5ed0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8011e80 tx=0x7fe8f80137d0 comp rx=0 tx=0).stop 2024-09-21T03:59:55.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.766+0000 7fe9166cf740 1 -- 172.21.15.46:0/4037912882 shutdown_connections 2024-09-21T03:59:55.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.766+0000 7fe9166cf740 1 --2- 172.21.15.46:0/4037912882 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x556608ab2da0 0x556608f50cf0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:55.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.766+0000 7fe9166cf740 1 --2- 172.21.15.46:0/4037912882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556608b1f070 0x556608ed6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:55.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.766+0000 7fe9166cf740 1 --2- 172.21.15.46:0/4037912882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556608afe390 0x556608ed5ed0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:55.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.766+0000 7fe9166cf740 1 --2- 172.21.15.46:0/4037912882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556608af61b0 0x556608ed5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:55.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.766+0000 7fe8f17fa640 0 client.16179 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T03:59:55.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.766+0000 7fe9166cf740 1 -- 172.21.15.46:0/4037912882 >> 172.21.15.46:0/4037912882 conn(0x556608b13460 msgr2=0x556608ed2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:55.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.766+0000 7fe9166cf740 1 -- 172.21.15.46:0/4037912882 shutdown_connections 2024-09-21T03:59:55.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.766+0000 7fe9166cf740 1 -- 172.21.15.46:0/4037912882 wait complete. 2024-09-21T03:59:55.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.766+0000 7fe9166cf740 20 client.16179 trim_cache size 0 max 16384 2024-09-21T03:59:55.776 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T03:59:55.777 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T03:59:55.777 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2024-09-21T03:59:55.777 INFO:teuthology.orchestra.run.smithi046.stdout: "326aaecf-f38a-4946-988a-d83f25556995": { 2024-09-21T03:59:55.777 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:55.777 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "326aaecf-f38a-4946-988a-d83f25556995", 2024-09-21T03:59:55.777 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2024-09-21T03:59:55.777 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:59:55.777 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:59:55.777 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_stats": { 2024-09-21T03:59:55.778 INFO:teuthology.orchestra.run.smithi046.stdout: "326aaecf-f38a-4946-988a-d83f25556995": { 2024-09-21T03:59:55.778 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:54.189884+0000", 2024-09-21T03:59:55.778 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:55.778 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:55.778 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:55.778 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:55.778 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:55.778 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:59:55.778 INFO:teuthology.orchestra.run.smithi046.stdout: "46bb5415-6e16-47c6-a1e4-55f9c623ce90": { 2024-09-21T03:59:55.778 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:14.950674+0000", 2024-09-21T03:59:55.778 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:55.779 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:55.779 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:55.779 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:55.779 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:55.779 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:59:55.779 INFO:teuthology.orchestra.run.smithi046.stdout: "6103c660-8e77-4b06-ad6c-bb322c26035a": { 2024-09-21T03:59:55.779 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:35.594467+0000", 2024-09-21T03:59:55.779 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:55.779 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:55.779 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:55.779 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:55.780 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:55.780 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:59:55.780 INFO:teuthology.orchestra.run.smithi046.stdout: "dab67652-8894-4711-be64-cbdfea27a9ba": { 2024-09-21T03:59:55.780 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:28.161616+0000", 2024-09-21T03:59:55.780 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:55.780 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:55.780 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:55.780 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:55.780 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:55.780 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:59:55.780 INFO:teuthology.orchestra.run.smithi046.stdout: "c47f458a-de5e-4952-a575-a81261953667": { 2024-09-21T03:59:55.780 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:48.699411+0000", 2024-09-21T03:59:55.781 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:55.781 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:55.781 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:55.781 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:55.781 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:55.781 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:59:55.781 INFO:teuthology.orchestra.run.smithi046.stdout: "e24ec8f1-0d13-478f-9c2c-b51798868ffc": { 2024-09-21T03:59:55.781 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:09.736194+0000", 2024-09-21T03:59:55.781 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:55.781 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:55.781 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:55.781 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:55.782 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:55.782 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:59:55.782 INFO:teuthology.orchestra.run.smithi046.stdout: "a871f724-0198-493c-b03e-b2de78aba243": { 2024-09-21T03:59:55.782 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:56:30.082991+0000", 2024-09-21T03:59:55.782 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:55.782 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:55.782 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:55.782 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:55.782 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:55.782 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:59:55.782 INFO:teuthology.orchestra.run.smithi046.stdout: "d49f33a7-3d5a-421b-94ba-8b19a4120db1": { 2024-09-21T03:59:55.783 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:50.480786+0000", 2024-09-21T03:59:55.783 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:55.783 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:55.783 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:55.783 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:55.783 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:55.783 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:59:55.783 INFO:teuthology.orchestra.run.smithi046.stdout: "3bbf7097-70d7-4743-bbce-41465502b35b": { 2024-09-21T03:59:55.783 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:10.661441+0000", 2024-09-21T03:59:55.783 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:55.783 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:55.783 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:55.784 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:55.784 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:55.784 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T03:59:55.784 INFO:teuthology.orchestra.run.smithi046.stdout: "08f0c962-df1a-4129-a1a2-b916240d9803": { 2024-09-21T03:59:55.784 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:02.937596+0000", 2024-09-21T03:59:55.784 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T03:59:55.784 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T03:59:55.784 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T03:59:55.784 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T03:59:55.784 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T03:59:55.784 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:59:55.784 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T03:59:55.785 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T03:59:55.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.766+0000 7fe91015b640 1 -- 172.21.15.46:0/2197859243 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe8f40b6680 msgr2=0x7fe8f40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:55.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.766+0000 7fe91015b640 1 --2- 172.21.15.46:0/2197859243 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe8f40b6680 0x7fe8f40b8b90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe900005fd0 tx=0x7fe900009620 comp rx=0 tx=0).stop 2024-09-21T03:59:55.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.766+0000 7fe91015b640 1 -- 172.21.15.46:0/2197859243 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe908102650 msgr2=0x7fe90819c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:55.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.766+0000 7fe91015b640 1 --2- 172.21.15.46:0/2197859243 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe908102650 0x7fe90819c630 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe904005940 tx=0x7fe9040042f0 comp rx=0 tx=0).stop 2024-09-21T03:59:55.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.766+0000 7fe91015b640 1 -- 172.21.15.46:0/2197859243 shutdown_connections 2024-09-21T03:59:55.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.766+0000 7fe91015b640 1 --2- 172.21.15.46:0/2197859243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe908110200 0x7fe9081a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:55.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.766+0000 7fe91015b640 1 --2- 172.21.15.46:0/2197859243 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe8f40b6680 0x7fe8f40b8b90 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:55.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.766+0000 7fe91015b640 1 --2- 172.21.15.46:0/2197859243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe908102fa0 0x7fe90819cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:55.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.766+0000 7fe91015b640 1 --2- 172.21.15.46:0/2197859243 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe908102650 0x7fe90819c630 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:55.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.766+0000 7fe91015b640 1 -- 172.21.15.46:0/2197859243 >> 172.21.15.46:0/2197859243 conn(0x7fe908079760 msgr2=0x7fe908108cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:55.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.767+0000 7fe91015b640 1 -- 172.21.15.46:0/2197859243 shutdown_connections 2024-09-21T03:59:55.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T03:59:55.767+0000 7fe91015b640 1 -- 172.21.15.46:0/2197859243 wait complete. 2024-09-21T03:59:55.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:55 smithi105 ceph-mon[34773]: pgmap v466: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T03:59:55.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:55 smithi105 ceph-mon[34773]: scrub queued for path: / 2024-09-21T03:59:55.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:55 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T03:59:55.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:55 smithi105 ceph-mon[34773]: scrub summary: active paths [/] 2024-09-21T03:59:55.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:55 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T03:59:56.565 INFO:tasks.cephfs.filesystem:scrub status for tag:326aaecf-f38a-4946-988a-d83f25556995 - {'path': '/', 'tag': '326aaecf-f38a-4946-988a-d83f25556995', 'options': 'recursive,force'} 2024-09-21T03:59:57.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:57 smithi162 ceph-mon[35071]: pgmap v467: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T03:59:57.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:57 smithi046 ceph-mon[30954]: pgmap v467: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T03:59:57.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:57 smithi105 ceph-mon[34773]: pgmap v467: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T03:59:59.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:59 smithi162 ceph-mon[35071]: pgmap v468: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T03:59:59.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 03:59:59 smithi162 ceph-mon[35071]: scrub summary: idle 2024-09-21T03:59:59.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:59 smithi046 ceph-mon[30954]: pgmap v468: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T03:59:59.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 03:59:59 smithi046 ceph-mon[30954]: scrub summary: idle 2024-09-21T03:59:59.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:59 smithi105 ceph-mon[34773]: pgmap v468: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T03:59:59.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 03:59:59 smithi105 ceph-mon[34773]: scrub summary: idle 2024-09-21T04:00:00.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:00 smithi162 ceph-mon[35071]: overall HEALTH_OK 2024-09-21T04:00:00.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:00 smithi046 ceph-mon[30954]: overall HEALTH_OK 2024-09-21T04:00:00.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:00 smithi105 ceph-mon[34773]: overall HEALTH_OK 2024-09-21T04:00:01.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:01 smithi162 ceph-mon[35071]: pgmap v469: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T04:00:01.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:01 smithi046 ceph-mon[30954]: pgmap v469: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T04:00:01.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:01 smithi105 ceph-mon[34773]: pgmap v469: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T04:00:03.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:03 smithi162 ceph-mon[35071]: pgmap v470: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 16 op/s 2024-09-21T04:00:03.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:03 smithi046 ceph-mon[30954]: pgmap v470: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 16 op/s 2024-09-21T04:00:03.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:03 smithi105 ceph-mon[34773]: pgmap v470: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 16 op/s 2024-09-21T04:00:05.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:05 smithi162 ceph-mon[35071]: pgmap v471: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T04:00:05.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:05 smithi046 ceph-mon[30954]: pgmap v471: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T04:00:05.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:05 smithi105 ceph-mon[34773]: pgmap v471: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T04:00:07.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:07 smithi162 ceph-mon[35071]: pgmap v472: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T04:00:07.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:07 smithi046 ceph-mon[30954]: pgmap v472: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T04:00:07.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:07 smithi105 ceph-mon[34773]: pgmap v472: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T04:00:09.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:09 smithi162 ceph-mon[35071]: pgmap v473: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-09-21T04:00:09.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:09 smithi046 ceph-mon[30954]: pgmap v473: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-09-21T04:00:09.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:09 smithi105 ceph-mon[34773]: pgmap v473: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-09-21T04:00:11.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:11 smithi162 ceph-mon[35071]: pgmap v474: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T04:00:11.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:11 smithi046 ceph-mon[30954]: pgmap v474: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T04:00:11.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:11 smithi105 ceph-mon[34773]: pgmap v474: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T04:00:13.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:13 smithi162 ceph-mon[35071]: pgmap v475: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T04:00:13.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:13 smithi046 ceph-mon[30954]: pgmap v475: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T04:00:13.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:13 smithi105 ceph-mon[34773]: pgmap v475: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T04:00:15.621 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:15 smithi105 ceph-mon[34773]: pgmap v476: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 11 KiB/s wr, 4 op/s 2024-09-21T04:00:15.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:15 smithi162 ceph-mon[35071]: pgmap v476: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 11 KiB/s wr, 4 op/s 2024-09-21T04:00:15.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:15 smithi046 ceph-mon[30954]: pgmap v476: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 11 KiB/s wr, 4 op/s 2024-09-21T04:00:17.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:17 smithi162 ceph-mon[35071]: pgmap v477: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T04:00:17.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:17 smithi046 ceph-mon[30954]: pgmap v477: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T04:00:17.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:17 smithi105 ceph-mon[34773]: pgmap v477: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T04:00:19.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:19 smithi046 ceph-mon[30954]: pgmap v478: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T04:00:19.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:19 smithi105 ceph-mon[34773]: pgmap v478: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T04:00:19.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:19 smithi162 ceph-mon[35071]: pgmap v478: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T04:00:21.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:21 smithi046 ceph-mon[30954]: pgmap v479: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T04:00:21.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:21 smithi105 ceph-mon[34773]: pgmap v479: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T04:00:21.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:21 smithi162 ceph-mon[35071]: pgmap v479: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T04:00:23.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:23 smithi046 ceph-mon[30954]: pgmap v480: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 2 op/s 2024-09-21T04:00:23.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:23 smithi105 ceph-mon[34773]: pgmap v480: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 2 op/s 2024-09-21T04:00:23.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:23 smithi162 ceph-mon[35071]: pgmap v480: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 2 op/s 2024-09-21T04:00:25.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:25 smithi162 ceph-mon[35071]: pgmap v481: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:00:25.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:25 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:00:25.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:25 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:00:25.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:25 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:00:25.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:25 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:00:25.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:25 smithi046 ceph-mon[30954]: pgmap v481: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:00:25.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:25 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:00:25.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:25 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:00:25.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:25 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:00:25.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:25 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:00:25.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:25 smithi105 ceph-mon[34773]: pgmap v481: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:00:25.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:25 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:00:25.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:25 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:00:25.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:25 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:00:25.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:25 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:00:26.565 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T04:00:26.838 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:27.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.316+0000 7fc5c4941640 1 -- 172.21.15.46:0/4057959769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5c01083d0 msgr2=0x7fc5c01087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:27.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.316+0000 7fc5c4941640 1 --2- 172.21.15.46:0/4057959769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5c01083d0 0x7fc5c01087e0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4009900 tx=0x7fc5b402a410 comp rx=0 tx=0).stop 2024-09-21T04:00:27.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.316+0000 7fc5c4941640 1 -- 172.21.15.46:0/4057959769 shutdown_connections 2024-09-21T04:00:27.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.316+0000 7fc5c4941640 1 --2- 172.21.15.46:0/4057959769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5c0108d20 0x7fc5c010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.316+0000 7fc5c4941640 1 --2- 172.21.15.46:0/4057959769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5c01083d0 0x7fc5c01087e0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.316+0000 7fc5c4941640 1 --2- 172.21.15.46:0/4057959769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5c0102ae0 0x7fc5c0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.316+0000 7fc5c4941640 1 -- 172.21.15.46:0/4057959769 >> 172.21.15.46:0/4057959769 conn(0x7fc5c0079760 msgr2=0x7fc5c0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:27.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.316+0000 7fc5c4941640 1 -- 172.21.15.46:0/4057959769 shutdown_connections 2024-09-21T04:00:27.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.316+0000 7fc5c4941640 1 -- 172.21.15.46:0/4057959769 wait complete. 2024-09-21T04:00:27.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.317+0000 7fc5c4941640 1 Processor -- start 2024-09-21T04:00:27.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.317+0000 7fc5c4941640 1 -- start start 2024-09-21T04:00:27.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.317+0000 7fc5c4941640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5c0102ae0 0x7fc5c0199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:27.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.317+0000 7fc5c4941640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5c01083d0 0x7fc5c0199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:27.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.317+0000 7fc5c4941640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5c0108d20 0x7fc5c019eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:27.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.317+0000 7fc5c4941640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c0112990 con 0x7fc5c0108d20 2024-09-21T04:00:27.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.317+0000 7fc5c4941640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c0112810 con 0x7fc5c0102ae0 2024-09-21T04:00:27.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.317+0000 7fc5c4941640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c0112b10 con 0x7fc5c01083d0 2024-09-21T04:00:27.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.317+0000 7fc5bed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5c0108d20 0x7fc5c019eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:27.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.317+0000 7fc5bed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5c0108d20 0x7fc5c019eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36054/0 (socket says 172.21.15.46:36054) 2024-09-21T04:00:27.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.317+0000 7fc5bed9d640 1 -- 172.21.15.46:0/3623462731 learned_addr learned my addr 172.21.15.46:0/3623462731 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:27.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.317+0000 7fc5bdd9b640 1 --2- 172.21.15.46:0/3623462731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5c01083d0 0x7fc5c0199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:27.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.317+0000 7fc5be59c640 1 --2- 172.21.15.46:0/3623462731 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5c0102ae0 0x7fc5c0199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:27.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.318+0000 7fc5bed9d640 1 -- 172.21.15.46:0/3623462731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5c01083d0 msgr2=0x7fc5c0199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:27.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.318+0000 7fc5bed9d640 1 --2- 172.21.15.46:0/3623462731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5c01083d0 0x7fc5c0199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.318+0000 7fc5bed9d640 1 -- 172.21.15.46:0/3623462731 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5c0102ae0 msgr2=0x7fc5c0199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:27.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.318+0000 7fc5bed9d640 1 --2- 172.21.15.46:0/3623462731 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5c0102ae0 0x7fc5c0199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.318+0000 7fc5bed9d640 1 -- 172.21.15.46:0/3623462731 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c019f2d0 con 0x7fc5c0108d20 2024-09-21T04:00:27.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.318+0000 7fc5be59c640 1 --2- 172.21.15.46:0/3623462731 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5c0102ae0 0x7fc5c0199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:00:27.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.318+0000 7fc5bed9d640 1 --2- 172.21.15.46:0/3623462731 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5c0108d20 0x7fc5c019eba0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8009fd0 tx=0x7fc5b800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:27.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.318+0000 7fc5af7fe640 1 -- 172.21.15.46:0/3623462731 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b8017070 con 0x7fc5c0108d20 2024-09-21T04:00:27.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.318+0000 7fc5c4941640 1 -- 172.21.15.46:0/3623462731 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5c019f5c0 con 0x7fc5c0108d20 2024-09-21T04:00:27.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.318+0000 7fc5af7fe640 1 -- 172.21.15.46:0/3623462731 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5b8003e20 con 0x7fc5c0108d20 2024-09-21T04:00:27.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.318+0000 7fc5af7fe640 1 -- 172.21.15.46:0/3623462731 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b8010460 con 0x7fc5c0108d20 2024-09-21T04:00:27.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.318+0000 7fc5c4941640 1 -- 172.21.15.46:0/3623462731 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5c006bb40 con 0x7fc5c0108d20 2024-09-21T04:00:27.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.321+0000 7fc5caeb5740 1 Processor -- start 2024-09-21T04:00:27.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.321+0000 7fc5af7fe640 1 -- 172.21.15.46:0/3623462731 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7fc5b8010720 con 0x7fc5c0108d20 2024-09-21T04:00:27.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.321+0000 7fc5caeb5740 1 -- start start 2024-09-21T04:00:27.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.321+0000 7fc5caeb5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56175efca070 0x56175f371650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:27.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.321+0000 7fc5caeb5740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56175efa11b0 0x56175f371b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:27.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.321+0000 7fc5caeb5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56175efa9390 0x56175f3720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:27.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.321+0000 7fc5caeb5740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x56175f2e7e50 con 0x56175efa11b0 2024-09-21T04:00:27.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.321+0000 7fc5caeb5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56175f2d7280 con 0x56175efa9390 2024-09-21T04:00:27.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.321+0000 7fc5caeb5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56175f2db090 con 0x56175efca070 2024-09-21T04:00:27.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.322+0000 7fc5be59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56175efa11b0 0x56175f371b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:27.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.322+0000 7fc5be59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56175efa11b0 0x56175f371b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36064/0 (socket says 172.21.15.46:36064) 2024-09-21T04:00:27.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.322+0000 7fc5be59c640 1 -- 172.21.15.46:0/841468660 learned_addr learned my addr 172.21.15.46:0/841468660 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:27.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.322+0000 7fc5bdd9b640 1 --2- 172.21.15.46:0/841468660 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56175efa9390 0x56175f3720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:27.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.322+0000 7fc5bdd9b640 1 --2- 172.21.15.46:0/841468660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56175efca070 0x56175f371650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:27.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.322+0000 7fc5af7fe640 1 --2- 172.21.15.46:0/3623462731 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc5a80b6680 0x7fc5a80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:27.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.322+0000 7fc5be59c640 1 -- 172.21.15.46:0/841468660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56175efca070 msgr2=0x56175f371650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:27.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.322+0000 7fc5be59c640 1 --2- 172.21.15.46:0/841468660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56175efca070 0x56175f371650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.322+0000 7fc5be59c640 1 -- 172.21.15.46:0/841468660 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56175efa9390 msgr2=0x56175f3720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:27.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.322+0000 7fc5be59c640 1 --2- 172.21.15.46:0/841468660 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56175efa9390 0x56175f3720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.322+0000 7fc5be59c640 1 -- 172.21.15.46:0/841468660 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56175f035650 con 0x56175efa11b0 2024-09-21T04:00:27.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.322+0000 7fc5bdd9b640 1 --2- 172.21.15.46:0/841468660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56175efca070 0x56175f371650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:00:27.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.322+0000 7fc5bed9d640 1 --2- 172.21.15.46:0/3623462731 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc5a80b6680 0x7fc5a80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:27.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.322+0000 7fc5be59c640 1 --2- 172.21.15.46:0/841468660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56175efa11b0 0x56175f371b90 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0009d40 tx=0x7fc5b00117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79b2f1fd3f9070db server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:27.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.322+0000 7fc5af7fe640 1 -- 172.21.15.46:0/3623462731 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fc5b80e7480 con 0x7fc5c0108d20 2024-09-21T04:00:27.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.322+0000 7fc5acff9640 1 -- 172.21.15.46:0/841468660 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b0012650 con 0x56175efa11b0 2024-09-21T04:00:27.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.323+0000 7fc5acff9640 1 -- 172.21.15.46:0/841468660 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5b0009e30 con 0x56175efa11b0 2024-09-21T04:00:27.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.323+0000 7fc5acff9640 1 -- 172.21.15.46:0/841468660 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b000fc20 con 0x56175efa11b0 2024-09-21T04:00:27.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.323+0000 7fc5caeb5740 1 -- 172.21.15.46:0/841468660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56175efa11b0 msgr2=0x56175f371b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:27.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.323+0000 7fc5bed9d640 1 --2- 172.21.15.46:0/3623462731 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc5a80b6680 0x7fc5a80b8b90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc5b80a9940 tx=0x7fc5b8076dc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:27.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.323+0000 7fc5caeb5740 1 --2- 172.21.15.46:0/841468660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56175efa11b0 0x56175f371b90 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0009d40 tx=0x7fc5b00117b0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.324+0000 7fc5caeb5740 1 -- 172.21.15.46:0/841468660 shutdown_connections 2024-09-21T04:00:27.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.324+0000 7fc5caeb5740 1 --2- 172.21.15.46:0/841468660 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56175efa9390 0x56175f3720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.324+0000 7fc5caeb5740 1 --2- 172.21.15.46:0/841468660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56175efa11b0 0x56175f371b90 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.324+0000 7fc5caeb5740 1 --2- 172.21.15.46:0/841468660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56175efca070 0x56175f371650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.324+0000 7fc5caeb5740 1 -- 172.21.15.46:0/841468660 >> 172.21.15.46:0/841468660 conn(0x56175efbe460 msgr2=0x56175f36f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:27.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.324+0000 7fc5caeb5740 1 -- 172.21.15.46:0/841468660 shutdown_connections 2024-09-21T04:00:27.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.324+0000 7fc5caeb5740 1 -- 172.21.15.46:0/841468660 wait complete. 2024-09-21T04:00:27.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.324+0000 7fc5caeb5740 1 -- start start 2024-09-21T04:00:27.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.324+0000 7fc5caeb5740 1 Processor -- start 2024-09-21T04:00:27.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.324+0000 7fc5caeb5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56175efa11b0 0x56175f381090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:27.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.324+0000 7fc5caeb5740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56175efa9390 0x56175f3815d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:27.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.324+0000 7fc5caeb5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56175efca070 0x56175f381b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:27.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.325+0000 7fc5caeb5740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x56175f138700 con 0x56175efa9390 2024-09-21T04:00:27.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.325+0000 7fc5caeb5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56175f272110 con 0x56175efa11b0 2024-09-21T04:00:27.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.325+0000 7fc5caeb5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56175f384190 con 0x56175efca070 2024-09-21T04:00:27.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.325+0000 7fc5caeb5740 10 client.0 _ll_register_callbacks cb 0x56175f28b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:00:27.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.325+0000 7fc5be59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56175efa9390 0x56175f3815d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:27.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.325+0000 7fc5be59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56175efa9390 0x56175f3815d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36072/0 (socket says 172.21.15.46:36072) 2024-09-21T04:00:27.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.325+0000 7fc5be59c640 1 -- 172.21.15.46:0/3007056177 learned_addr learned my addr 172.21.15.46:0/3007056177 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:27.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.325+0000 7fc5bdd9b640 1 --2- 172.21.15.46:0/3007056177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56175efa11b0 0x56175f381090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:27.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.325+0000 7fc5bdd9b640 1 --2- 172.21.15.46:0/3007056177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56175efca070 0x56175f381b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:27.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.325+0000 7fc5be59c640 1 -- 172.21.15.46:0/3007056177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56175efca070 msgr2=0x56175f381b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:27.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.325+0000 7fc5be59c640 1 --2- 172.21.15.46:0/3007056177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56175efca070 0x56175f381b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.325+0000 7fc5be59c640 1 -- 172.21.15.46:0/3007056177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56175efa11b0 msgr2=0x56175f381090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:27.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.325+0000 7fc5be59c640 1 --2- 172.21.15.46:0/3007056177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56175efa11b0 0x56175f381090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.325+0000 7fc5be59c640 1 -- 172.21.15.46:0/3007056177 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56175f29fc40 con 0x56175efa9390 2024-09-21T04:00:27.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.325+0000 7fc5bdd9b640 1 --2- 172.21.15.46:0/3007056177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56175efa11b0 0x56175f381090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:00:27.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.325+0000 7fc5be59c640 1 --2- 172.21.15.46:0/3007056177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56175efa9390 0x56175f3815d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fc5b001c040 tx=0x7fc5b000f4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6ac1a371f2d2596 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:27.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.325+0000 7fc5a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:00:27.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.325+0000 7fc5a5ffb640 1 -- 172.21.15.46:0/3007056177 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b0028020 con 0x56175efa9390 2024-09-21T04:00:27.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.325+0000 7fc5a5ffb640 1 -- 172.21.15.46:0/3007056177 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fc5b0005240 con 0x56175efa9390 2024-09-21T04:00:27.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.326+0000 7fc5caeb5740 1 -- 172.21.15.46:0/3007056177 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5b0009e30 con 0x56175efa9390 2024-09-21T04:00:27.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.326+0000 7fc5a5ffb640 1 -- 172.21.15.46:0/3007056177 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc5b0033050 con 0x56175efa9390 2024-09-21T04:00:27.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.326+0000 7fc5caeb5740 10 client.16191 fetch_fsmap learned FSMap version 20 2024-09-21T04:00:27.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.326+0000 7fc5caeb5740 1 -- 172.21.15.46:0/3007056177 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56175f38fe20 con 0x56175efa9390 2024-09-21T04:00:27.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.326+0000 7fc5a5ffb640 1 -- 172.21.15.46:0/3007056177 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5b0009e30 con 0x56175efa9390 2024-09-21T04:00:27.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.326+0000 7fc5a5ffb640 1 -- 172.21.15.46:0/3007056177 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc5b00124e0 con 0x56175efa9390 2024-09-21T04:00:27.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.326+0000 7fc5caeb5740 10 client.16191 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:00:27.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.326+0000 7fc5caeb5740 10 client.16191 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:00:27.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.326+0000 7fc5caeb5740 20 client.16191 populate_metadata read hostname 'smithi046' 2024-09-21T04:00:27.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.326+0000 7fc5caeb5740 1 --2- 172.21.15.46:0/3007056177 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56175ef889f0 0x56175f393290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:27.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.326+0000 7fc5caeb5740 4 client.16191 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:00:27.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.326+0000 7fc5caeb5740 1 -- 172.21.15.46:0/3007056177 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56175f2e9da0 con 0x56175ef889f0 2024-09-21T04:00:27.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.327+0000 7fc5bdd9b640 1 --2- 172.21.15.46:0/3007056177 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56175ef889f0 0x56175f393290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:27.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.327+0000 7fc5bdd9b640 1 --2- 172.21.15.46:0/3007056177 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56175ef889f0 0x56175f393290 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7697fd9f0eb96eda server_cookie=cf71ad9322b1cac4 in_seq=0 out_seq=0 2024-09-21T04:00:27.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.327+0000 7fc5a5ffb640 10 client.16191 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:00:27.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.328+0000 7fc5a5ffb640 1 -- 172.21.15.46:0/3007056177 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56175f2e9da0 con 0x56175ef889f0 2024-09-21T04:00:27.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.328+0000 7fc5a5ffb640 10 client.16191 handle_command_reply: tid=0 2024-09-21T04:00:27.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.328+0000 7fc5caeb5740 1 client.16191 shutdown 2024-09-21T04:00:27.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.328+0000 7fc5caeb5740 1 -- 172.21.15.46:0/3007056177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56175efa9390 msgr2=0x56175f3815d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:27.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.328+0000 7fc5caeb5740 1 --2- 172.21.15.46:0/3007056177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56175efa9390 0x56175f3815d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fc5b001c040 tx=0x7fc5b000f4e0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.328+0000 7fc5caeb5740 1 -- 172.21.15.46:0/3007056177 shutdown_connections 2024-09-21T04:00:27.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.328+0000 7fc5caeb5740 1 --2- 172.21.15.46:0/3007056177 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56175ef889f0 0x56175f393290 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.328+0000 7fc5caeb5740 1 --2- 172.21.15.46:0/3007056177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56175efca070 0x56175f381b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.328+0000 7fc5caeb5740 1 --2- 172.21.15.46:0/3007056177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56175efa9390 0x56175f3815d0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.328+0000 7fc5caeb5740 1 --2- 172.21.15.46:0/3007056177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56175efa11b0 0x56175f381090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.328+0000 7fc5caeb5740 1 -- 172.21.15.46:0/3007056177 >> 172.21.15.46:0/3007056177 conn(0x56175efbe460 msgr2=0x56175f36db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:27.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.328+0000 7fc5a5ffb640 0 client.16191 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:00:27.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.328+0000 7fc5caeb5740 1 -- 172.21.15.46:0/3007056177 shutdown_connections 2024-09-21T04:00:27.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.328+0000 7fc5caeb5740 1 -- 172.21.15.46:0/3007056177 wait complete. 2024-09-21T04:00:27.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.328+0000 7fc5caeb5740 20 client.16191 trim_cache size 0 max 16384 2024-09-21T04:00:27.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.345+0000 7fc5caeb5740 1 Processor -- start 2024-09-21T04:00:27.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.345+0000 7fc5caeb5740 1 -- start start 2024-09-21T04:00:27.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.346+0000 7fc5caeb5740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56175efa11b0 0x56175f373040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:27.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.346+0000 7fc5caeb5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56175efa9390 0x56175f382cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:27.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.346+0000 7fc5caeb5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56175efca070 0x56175f37e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:27.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.346+0000 7fc5caeb5740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c01ab270 con 0x56175efa11b0 2024-09-21T04:00:27.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.346+0000 7fc5caeb5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c01adad0 con 0x56175efa9390 2024-09-21T04:00:27.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.346+0000 7fc5caeb5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c01ab8c0 con 0x56175efca070 2024-09-21T04:00:27.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.346+0000 7fc5bdd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56175efa11b0 0x56175f373040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:27.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.346+0000 7fc5bdd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56175efa11b0 0x56175f373040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36076/0 (socket says 172.21.15.46:36076) 2024-09-21T04:00:27.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.346+0000 7fc5bdd9b640 1 -- 172.21.15.46:0/4133039829 learned_addr learned my addr 172.21.15.46:0/4133039829 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:27.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.346+0000 7fc5be59c640 1 --2- 172.21.15.46:0/4133039829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56175efa9390 0x56175f382cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:27.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.346+0000 7fc5bdd9b640 1 -- 172.21.15.46:0/4133039829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56175efca070 msgr2=0x56175f37e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:27.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.346+0000 7fc5bdd9b640 1 --2- 172.21.15.46:0/4133039829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56175efca070 0x56175f37e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.346+0000 7fc5bdd9b640 1 -- 172.21.15.46:0/4133039829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56175efa9390 msgr2=0x56175f382cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:27.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.346+0000 7fc5bdd9b640 1 --2- 172.21.15.46:0/4133039829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56175efa9390 0x56175f382cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.346+0000 7fc5bdd9b640 1 -- 172.21.15.46:0/4133039829 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56175f383bc0 con 0x56175efa11b0 2024-09-21T04:00:27.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.346+0000 7fc5bdd9b640 1 --2- 172.21.15.46:0/4133039829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56175efa11b0 0x56175f373040 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fc5c006b680 tx=0x7fc5b4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a7a467919699cf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:27.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.347+0000 7fc5a7fff640 1 -- 172.21.15.46:0/4133039829 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4035070 con 0x56175efa11b0 2024-09-21T04:00:27.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.347+0000 7fc5a7fff640 1 -- 172.21.15.46:0/4133039829 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5b404e030 con 0x56175efa11b0 2024-09-21T04:00:27.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.347+0000 7fc5a7fff640 1 -- 172.21.15.46:0/4133039829 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b40039c0 con 0x56175efa11b0 2024-09-21T04:00:27.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.347+0000 7fc5caeb5740 1 -- 172.21.15.46:0/4133039829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56175efa11b0 msgr2=0x56175f373040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:27.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.347+0000 7fc5caeb5740 1 --2- 172.21.15.46:0/4133039829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56175efa11b0 0x56175f373040 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fc5c006b680 tx=0x7fc5b4009260 comp rx=0 tx=0).stop 2024-09-21T04:00:27.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.347+0000 7fc5caeb5740 1 -- 172.21.15.46:0/4133039829 shutdown_connections 2024-09-21T04:00:27.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.347+0000 7fc5caeb5740 1 --2- 172.21.15.46:0/4133039829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56175efca070 0x56175f37e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.347+0000 7fc5caeb5740 1 --2- 172.21.15.46:0/4133039829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56175efa9390 0x56175f382cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.347+0000 7fc5caeb5740 1 --2- 172.21.15.46:0/4133039829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56175efa11b0 0x56175f373040 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.347+0000 7fc5caeb5740 1 -- 172.21.15.46:0/4133039829 >> 172.21.15.46:0/4133039829 conn(0x56175efbe460 msgr2=0x56175f3825b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:27.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.347+0000 7fc5caeb5740 1 -- 172.21.15.46:0/4133039829 shutdown_connections 2024-09-21T04:00:27.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.347+0000 7fc5caeb5740 1 -- 172.21.15.46:0/4133039829 wait complete. 2024-09-21T04:00:27.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.348+0000 7fc5caeb5740 1 -- start start 2024-09-21T04:00:27.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.348+0000 7fc5caeb5740 1 Processor -- start 2024-09-21T04:00:27.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.348+0000 7fc5caeb5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56175efa11b0 0x56175f396000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:27.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.348+0000 7fc5caeb5740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56175efa9390 0x56175f3965e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:27.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.348+0000 7fc5caeb5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56175efca070 0x56175f3f5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:27.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.348+0000 7fc5caeb5740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c01abf90 con 0x56175efa9390 2024-09-21T04:00:27.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.348+0000 7fc5caeb5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c01ad400 con 0x56175efca070 2024-09-21T04:00:27.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.348+0000 7fc5caeb5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c01ac660 con 0x56175efa11b0 2024-09-21T04:00:27.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.348+0000 7fc5caeb5740 10 client.0 _ll_register_callbacks cb 0x7fc5b4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:00:27.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.348+0000 7fc5be59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56175efa9390 0x56175f3965e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:27.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.348+0000 7fc5be59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56175efa9390 0x56175f3965e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36092/0 (socket says 172.21.15.46:36092) 2024-09-21T04:00:27.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.348+0000 7fc5be59c640 1 -- 172.21.15.46:0/1222317998 learned_addr learned my addr 172.21.15.46:0/1222317998 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:27.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.348+0000 7fc5bdd9b640 1 --2- 172.21.15.46:0/1222317998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56175efa11b0 0x56175f396000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:27.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.349+0000 7fc5bdd9b640 1 --2- 172.21.15.46:0/1222317998 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56175efca070 0x56175f3f5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:27.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.349+0000 7fc5be59c640 1 -- 172.21.15.46:0/1222317998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56175efa11b0 msgr2=0x56175f396000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:27.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.349+0000 7fc5be59c640 1 --2- 172.21.15.46:0/1222317998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56175efa11b0 0x56175f396000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.349+0000 7fc5be59c640 1 -- 172.21.15.46:0/1222317998 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56175efca070 msgr2=0x56175f3f5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:27.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.349+0000 7fc5be59c640 1 --2- 172.21.15.46:0/1222317998 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56175efca070 0x56175f3f5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.349+0000 7fc5be59c640 1 -- 172.21.15.46:0/1222317998 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56175f372440 con 0x56175efa9390 2024-09-21T04:00:27.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.349+0000 7fc5be59c640 1 --2- 172.21.15.46:0/1222317998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56175efa9390 0x56175f3965e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0009780 tx=0x7fc5b0009c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e134bb94153eadec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:27.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.349+0000 7fc5a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:00:27.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.349+0000 7fc5a5ffb640 1 -- 172.21.15.46:0/1222317998 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b003c060 con 0x56175efa9390 2024-09-21T04:00:27.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.349+0000 7fc5a5ffb640 1 -- 172.21.15.46:0/1222317998 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fc5b0012650 con 0x56175efa9390 2024-09-21T04:00:27.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.349+0000 7fc5caeb5740 1 -- 172.21.15.46:0/1222317998 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5b404e030 con 0x56175efa9390 2024-09-21T04:00:27.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.349+0000 7fc5a5ffb640 1 -- 172.21.15.46:0/1222317998 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc5b0028070 con 0x56175efa9390 2024-09-21T04:00:27.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.349+0000 7fc5caeb5740 10 client.16197 fetch_fsmap learned FSMap version 20 2024-09-21T04:00:27.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.349+0000 7fc5caeb5740 1 -- 172.21.15.46:0/1222317998 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56175f374480 con 0x56175efa9390 2024-09-21T04:00:27.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.350+0000 7fc5a5ffb640 1 -- 172.21.15.46:0/1222317998 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5b404e030 con 0x56175efa9390 2024-09-21T04:00:27.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.350+0000 7fc5a5ffb640 1 -- 172.21.15.46:0/1222317998 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc5b0004660 con 0x56175efa9390 2024-09-21T04:00:27.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.350+0000 7fc5caeb5740 10 client.16197 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:00:27.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.350+0000 7fc5caeb5740 10 client.16197 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:00:27.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.350+0000 7fc5caeb5740 20 client.16197 populate_metadata read hostname 'smithi046' 2024-09-21T04:00:27.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.350+0000 7fc5caeb5740 1 --2- 172.21.15.46:0/1222317998 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56175ef5dda0 0x56175f3ffb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:27.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.350+0000 7fc5caeb5740 4 client.16197 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T04:00:27.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.350+0000 7fc5caeb5740 1 -- 172.21.15.46:0/1222317998 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56175f2e5850 con 0x56175ef5dda0 2024-09-21T04:00:27.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.350+0000 7fc5bdd9b640 1 --2- 172.21.15.46:0/1222317998 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56175ef5dda0 0x56175f3ffb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:27.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.351+0000 7fc5bdd9b640 1 --2- 172.21.15.46:0/1222317998 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56175ef5dda0 0x56175f3ffb20 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c894d5caa46fca45 server_cookie=2c6534b09f383d5b in_seq=0 out_seq=0 2024-09-21T04:00:27.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.351+0000 7fc5a5ffb640 10 client.16197 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:00:27.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.351+0000 7fc5a5ffb640 1 -- 172.21.15.46:0/1222317998 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2930 (crc 0 0 0) 0x56175f2e5850 con 0x56175ef5dda0 2024-09-21T04:00:27.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.351+0000 7fc5a5ffb640 10 client.16197 handle_command_reply: tid=0 2024-09-21T04:00:27.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.351+0000 7fc5caeb5740 1 client.16197 shutdown 2024-09-21T04:00:27.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.351+0000 7fc5caeb5740 1 -- 172.21.15.46:0/1222317998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56175efa9390 msgr2=0x56175f3965e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:27.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.351+0000 7fc5caeb5740 1 --2- 172.21.15.46:0/1222317998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56175efa9390 0x56175f3965e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0009780 tx=0x7fc5b0009c10 comp rx=0 tx=0).stop 2024-09-21T04:00:27.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.351+0000 7fc5caeb5740 1 -- 172.21.15.46:0/1222317998 shutdown_connections 2024-09-21T04:00:27.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.351+0000 7fc5caeb5740 1 --2- 172.21.15.46:0/1222317998 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56175ef5dda0 0x56175f3ffb20 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.351+0000 7fc5caeb5740 1 --2- 172.21.15.46:0/1222317998 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56175efca070 0x56175f3f5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.351+0000 7fc5caeb5740 1 --2- 172.21.15.46:0/1222317998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56175efa9390 0x56175f3965e0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.351+0000 7fc5a5ffb640 0 client.16197 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:00:27.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.351+0000 7fc5caeb5740 1 --2- 172.21.15.46:0/1222317998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56175efa11b0 0x56175f396000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.351+0000 7fc5caeb5740 1 -- 172.21.15.46:0/1222317998 >> 172.21.15.46:0/1222317998 conn(0x56175efbe460 msgr2=0x56175f372e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:27.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.351+0000 7fc5caeb5740 1 -- 172.21.15.46:0/1222317998 shutdown_connections 2024-09-21T04:00:27.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.351+0000 7fc5caeb5740 1 -- 172.21.15.46:0/1222317998 wait complete. 2024-09-21T04:00:27.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.351+0000 7fc5caeb5740 20 client.16197 trim_cache size 0 max 16384 2024-09-21T04:00:27.359 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T04:00:27.359 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "no active scrubs running", 2024-09-21T04:00:27.359 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": {}, 2024-09-21T04:00:27.359 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_stats": { 2024-09-21T04:00:27.359 INFO:teuthology.orchestra.run.smithi046.stdout: "326aaecf-f38a-4946-988a-d83f25556995": { 2024-09-21T04:00:27.359 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:54.189884+0000", 2024-09-21T04:00:27.359 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:00:27.360 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:00:27.360 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:00:27.360 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:00:27.360 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:00:27.360 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:00:27.360 INFO:teuthology.orchestra.run.smithi046.stdout: "46bb5415-6e16-47c6-a1e4-55f9c623ce90": { 2024-09-21T04:00:27.360 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:14.950674+0000", 2024-09-21T04:00:27.360 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:00:27.360 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:00:27.361 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:00:27.361 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:00:27.361 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:00:27.361 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:00:27.361 INFO:teuthology.orchestra.run.smithi046.stdout: "6103c660-8e77-4b06-ad6c-bb322c26035a": { 2024-09-21T04:00:27.361 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:35.594467+0000", 2024-09-21T04:00:27.361 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:00:27.361 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:00:27.361 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:00:27.361 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:00:27.362 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:00:27.362 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:00:27.362 INFO:teuthology.orchestra.run.smithi046.stdout: "dab67652-8894-4711-be64-cbdfea27a9ba": { 2024-09-21T04:00:27.362 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:28.161616+0000", 2024-09-21T04:00:27.362 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:00:27.362 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:00:27.362 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:00:27.362 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:00:27.362 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:00:27.362 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:00:27.362 INFO:teuthology.orchestra.run.smithi046.stdout: "c47f458a-de5e-4952-a575-a81261953667": { 2024-09-21T04:00:27.363 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:48.699411+0000", 2024-09-21T04:00:27.363 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:00:27.363 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:00:27.363 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:00:27.363 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:00:27.363 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:00:27.363 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:00:27.363 INFO:teuthology.orchestra.run.smithi046.stdout: "e24ec8f1-0d13-478f-9c2c-b51798868ffc": { 2024-09-21T04:00:27.363 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:09.736194+0000", 2024-09-21T04:00:27.363 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:00:27.363 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:00:27.363 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:00:27.363 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:00:27.363 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:00:27.364 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:00:27.364 INFO:teuthology.orchestra.run.smithi046.stdout: "a871f724-0198-493c-b03e-b2de78aba243": { 2024-09-21T04:00:27.364 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:56:30.082991+0000", 2024-09-21T04:00:27.364 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:00:27.364 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:00:27.364 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:00:27.364 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:00:27.364 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:00:27.364 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:00:27.364 INFO:teuthology.orchestra.run.smithi046.stdout: "d49f33a7-3d5a-421b-94ba-8b19a4120db1": { 2024-09-21T04:00:27.364 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:50.480786+0000", 2024-09-21T04:00:27.364 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:00:27.364 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:00:27.364 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:00:27.365 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:00:27.365 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:00:27.365 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:00:27.365 INFO:teuthology.orchestra.run.smithi046.stdout: "3bbf7097-70d7-4743-bbce-41465502b35b": { 2024-09-21T04:00:27.365 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:10.661441+0000", 2024-09-21T04:00:27.365 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:00:27.365 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:00:27.365 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:00:27.365 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:00:27.365 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:00:27.365 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:00:27.365 INFO:teuthology.orchestra.run.smithi046.stdout: "08f0c962-df1a-4129-a1a2-b916240d9803": { 2024-09-21T04:00:27.365 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:02.937596+0000", 2024-09-21T04:00:27.366 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:00:27.366 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:00:27.366 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:00:27.366 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:00:27.366 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:00:27.366 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:00:27.366 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:00:27.366 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T04:00:27.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.352+0000 7fc5c4941640 1 -- 172.21.15.46:0/3623462731 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc5a80b6680 msgr2=0x7fc5a80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:27.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.352+0000 7fc5c4941640 1 --2- 172.21.15.46:0/3623462731 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc5a80b6680 0x7fc5a80b8b90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc5b80a9940 tx=0x7fc5b8076dc0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.352+0000 7fc5c4941640 1 -- 172.21.15.46:0/3623462731 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5c0108d20 msgr2=0x7fc5c019eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:27.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.352+0000 7fc5c4941640 1 --2- 172.21.15.46:0/3623462731 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5c0108d20 0x7fc5c019eba0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8009fd0 tx=0x7fc5b800b260 comp rx=0 tx=0).stop 2024-09-21T04:00:27.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.352+0000 7fc5c4941640 1 -- 172.21.15.46:0/3623462731 shutdown_connections 2024-09-21T04:00:27.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.352+0000 7fc5c4941640 1 --2- 172.21.15.46:0/3623462731 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5c0108d20 0x7fc5c019eba0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.352+0000 7fc5c4941640 1 --2- 172.21.15.46:0/3623462731 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc5a80b6680 0x7fc5a80b8b90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.352+0000 7fc5c4941640 1 --2- 172.21.15.46:0/3623462731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5c01083d0 0x7fc5c0199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.352+0000 7fc5c4941640 1 --2- 172.21.15.46:0/3623462731 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5c0102ae0 0x7fc5c0199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.352+0000 7fc5c4941640 1 -- 172.21.15.46:0/3623462731 >> 172.21.15.46:0/3623462731 conn(0x7fc5c0079760 msgr2=0x7fc5c0104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:27.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.352+0000 7fc5c4941640 1 -- 172.21.15.46:0/3623462731 shutdown_connections 2024-09-21T04:00:27.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:27.352+0000 7fc5c4941640 1 -- 172.21.15.46:0/3623462731 wait complete. 2024-09-21T04:00:27.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:27 smithi046 ceph-mon[30954]: pgmap v482: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:00:27.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:27 smithi105 ceph-mon[34773]: pgmap v482: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:00:27.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:27 smithi162 ceph-mon[35071]: pgmap v482: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:00:28.167 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T04:00:28.167 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:00:28.428 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:28.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.930+0000 7f7b0dfa0640 1 -- 172.21.15.46:0/1508814611 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b08102d40 msgr2=0x7f7b0810fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:28.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.930+0000 7f7b0dfa0640 1 --2- 172.21.15.46:0/1508814611 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b08102d40 0x7f7b0810fa60 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f7af4009900 tx=0x7f7af402a480 comp rx=0 tx=0).stop 2024-09-21T04:00:28.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.930+0000 7f7b0dfa0640 1 -- 172.21.15.46:0/1508814611 shutdown_connections 2024-09-21T04:00:28.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.930+0000 7f7b0dfa0640 1 --2- 172.21.15.46:0/1508814611 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b0810ffa0 0x7f7b081123c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:28.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.930+0000 7f7b0dfa0640 1 --2- 172.21.15.46:0/1508814611 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b08102d40 0x7f7b0810fa60 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:28.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.930+0000 7f7b0dfa0640 1 --2- 172.21.15.46:0/1508814611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b081023f0 0x7f7b08102800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:28.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.930+0000 7f7b0dfa0640 1 -- 172.21.15.46:0/1508814611 >> 172.21.15.46:0/1508814611 conn(0x7f7b080fe2d0 msgr2=0x7f7b08100720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:28.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.930+0000 7f7b0dfa0640 1 -- 172.21.15.46:0/1508814611 shutdown_connections 2024-09-21T04:00:28.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.930+0000 7f7b0dfa0640 1 -- 172.21.15.46:0/1508814611 wait complete. 2024-09-21T04:00:28.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.930+0000 7f7b0dfa0640 1 Processor -- start 2024-09-21T04:00:28.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.931+0000 7f7b0dfa0640 1 -- start start 2024-09-21T04:00:28.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.931+0000 7f7b0dfa0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b081023f0 0x7f7b0819c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:28.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.931+0000 7f7b0dfa0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b08102d40 0x7f7b0819ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:28.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.931+0000 7f7b0dfa0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b0810ffa0 0x7f7b081a1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:28.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.931+0000 7f7b0dfa0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7b08115a90 con 0x7f7b0810ffa0 2024-09-21T04:00:28.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.931+0000 7f7b0dfa0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7b08115910 con 0x7f7b08102d40 2024-09-21T04:00:28.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.931+0000 7f7b0dfa0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7b08115c10 con 0x7f7b081023f0 2024-09-21T04:00:28.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.931+0000 7f7b0d79f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b0810ffa0 0x7f7b081a1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:28.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.931+0000 7f7b0d79f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b0810ffa0 0x7f7b081a1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36108/0 (socket says 172.21.15.46:36108) 2024-09-21T04:00:28.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.931+0000 7f7b0d79f640 1 -- 172.21.15.46:0/730608498 learned_addr learned my addr 172.21.15.46:0/730608498 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:28.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.931+0000 7f7b0cf9e640 1 --2- 172.21.15.46:0/730608498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b081023f0 0x7f7b0819c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:28.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.931+0000 7f7b07fff640 1 --2- 172.21.15.46:0/730608498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b08102d40 0x7f7b0819ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:28.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.931+0000 7f7b0d79f640 1 -- 172.21.15.46:0/730608498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b081023f0 msgr2=0x7f7b0819c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:28.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.931+0000 7f7b0d79f640 1 --2- 172.21.15.46:0/730608498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b081023f0 0x7f7b0819c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:28.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.931+0000 7f7b0d79f640 1 -- 172.21.15.46:0/730608498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b08102d40 msgr2=0x7f7b0819ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:28.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.931+0000 7f7b0d79f640 1 --2- 172.21.15.46:0/730608498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b08102d40 0x7f7b0819ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:28.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.931+0000 7f7b0d79f640 1 -- 172.21.15.46:0/730608498 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b081a2410 con 0x7f7b0810ffa0 2024-09-21T04:00:28.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.931+0000 7f7b0d79f640 1 --2- 172.21.15.46:0/730608498 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b0810ffa0 0x7f7b081a1ce0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f7b00009fd0 tx=0x7f7b0000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:28.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.932+0000 7f7b05ffb640 1 -- 172.21.15.46:0/730608498 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b00017070 con 0x7f7b0810ffa0 2024-09-21T04:00:28.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.932+0000 7f7b0dfa0640 1 -- 172.21.15.46:0/730608498 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b081a2700 con 0x7f7b0810ffa0 2024-09-21T04:00:28.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.932+0000 7f7b05ffb640 1 -- 172.21.15.46:0/730608498 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b00003e20 con 0x7f7b0810ffa0 2024-09-21T04:00:28.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.932+0000 7f7b05ffb640 1 -- 172.21.15.46:0/730608498 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b00010460 con 0x7f7b0810ffa0 2024-09-21T04:00:28.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.932+0000 7f7b0dfa0640 1 -- 172.21.15.46:0/730608498 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b081a8e60 con 0x7f7b0810ffa0 2024-09-21T04:00:28.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.933+0000 7f7b0dfa0640 1 -- 172.21.15.46:0/730608498 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b08102800 con 0x7f7b0810ffa0 2024-09-21T04:00:28.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.935+0000 7f7b05ffb640 1 -- 172.21.15.46:0/730608498 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f7b00003970 con 0x7f7b0810ffa0 2024-09-21T04:00:28.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.935+0000 7f7b05ffb640 1 --2- 172.21.15.46:0/730608498 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7af80b6680 0x7f7af80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:28.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.935+0000 7f7b05ffb640 1 -- 172.21.15.46:0/730608498 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f7b000e74e0 con 0x7f7b0810ffa0 2024-09-21T04:00:28.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.935+0000 7f7b0cf9e640 1 --2- 172.21.15.46:0/730608498 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7af80b6680 0x7f7af80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:28.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.936+0000 7f7b0cf9e640 1 --2- 172.21.15.46:0/730608498 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7af80b6680 0x7f7af80b8b90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7afc005fd0 tx=0x7f7afc005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:28.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:28.939+0000 7f7b05ffb640 1 -- 172.21.15.46:0/730608498 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7b000adad0 con 0x7f7b0810ffa0 2024-09-21T04:00:29.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:29.164+0000 7f7b0dfa0640 1 -- 172.21.15.46:0/730608498 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b0819d5d0 con 0x7f7b0810ffa0 2024-09-21T04:00:29.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:29.164+0000 7f7b05ffb640 1 -- 172.21.15.46:0/730608498 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f7b0819d5d0 con 0x7f7b0810ffa0 2024-09-21T04:00:29.167 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T04:00:29.167 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"btime":"2024-09-21T03:53:23:865820+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1766354184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1766354184},{"type":"v1","addr":"172.21.15.46:6839","nonce":1766354184}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/1901774207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":1901774207},{"type":"v1","addr":"172.21.15.46:6841","nonce":1901774207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3548633196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":3548633196},{"type":"v1","addr":"172.21.15.105:6837","nonce":3548633196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24652,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3551934241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3551934241},{"type":"v1","addr":"172.21.15.162:6835","nonce":3551934241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/48949822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":48949822},{"type":"v1","addr":"172.21.15.162:6837","nonce":48949822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:53:14.452819+0000","modified":"2024-09-21T03:53:23.593278+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24680},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/2196053213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2196053213},{"type":"v1","addr":"172.21.15.162:6839","nonce":2196053213}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.105:6839/3911438406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":3911438406},{"type":"v1","addr":"172.21.15.105:6839","nonce":3911438406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24680,"qdb_cluster":[24680]},"id":1}]} 2024-09-21T04:00:29.168 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T04:00:29.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:29.167+0000 7f7b0dfa0640 1 -- 172.21.15.46:0/730608498 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7af80b6680 msgr2=0x7f7af80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:29.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:29.167+0000 7f7b0dfa0640 1 --2- 172.21.15.46:0/730608498 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7af80b6680 0x7f7af80b8b90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7afc005fd0 tx=0x7f7afc005850 comp rx=0 tx=0).stop 2024-09-21T04:00:29.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:29.167+0000 7f7b0dfa0640 1 -- 172.21.15.46:0/730608498 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b0810ffa0 msgr2=0x7f7b081a1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:29.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:29.167+0000 7f7b0dfa0640 1 --2- 172.21.15.46:0/730608498 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b0810ffa0 0x7f7b081a1ce0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f7b00009fd0 tx=0x7f7b0000b260 comp rx=0 tx=0).stop 2024-09-21T04:00:29.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:29.167+0000 7f7b0dfa0640 1 -- 172.21.15.46:0/730608498 shutdown_connections 2024-09-21T04:00:29.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:29.167+0000 7f7b0dfa0640 1 --2- 172.21.15.46:0/730608498 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b0810ffa0 0x7f7b081a1ce0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:29.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:29.167+0000 7f7b0dfa0640 1 --2- 172.21.15.46:0/730608498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b08102d40 0x7f7b0819ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:29.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:29.167+0000 7f7b0dfa0640 1 --2- 172.21.15.46:0/730608498 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7af80b6680 0x7f7af80b8b90 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:29.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:29.167+0000 7f7b0dfa0640 1 --2- 172.21.15.46:0/730608498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b081023f0 0x7f7b0819c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:29.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:29.167+0000 7f7b0dfa0640 1 -- 172.21.15.46:0/730608498 >> 172.21.15.46:0/730608498 conn(0x7f7b080fe2d0 msgr2=0x7f7b08112190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:29.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:29.167+0000 7f7b0dfa0640 1 -- 172.21.15.46:0/730608498 shutdown_connections 2024-09-21T04:00:29.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:29.167+0000 7f7b0dfa0640 1 -- 172.21.15.46:0/730608498 wait complete. 2024-09-21T04:00:29.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:29 smithi046 ceph-mon[30954]: pgmap v483: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:00:29.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:29 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/730608498' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:00:29.804 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T04:00:29.817 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:29 smithi105 ceph-mon[34773]: pgmap v483: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:00:29.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:29 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/730608498' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:00:29.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:29 smithi162 ceph-mon[35071]: pgmap v483: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:00:29.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:29 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/730608498' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:00:30.065 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:30.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.601+0000 7f3179cfe640 1 -- 172.21.15.46:0/1599810265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3174109e10 msgr2=0x7f3174110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:30.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.601+0000 7f3179cfe640 1 --2- 172.21.15.46:0/1599810265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3174109e10 0x7f3174110640 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f316c009ca0 tx=0x7f316c02a8c0 comp rx=0 tx=0).stop 2024-09-21T04:00:30.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.601+0000 7f3179cfe640 1 -- 172.21.15.46:0/1599810265 shutdown_connections 2024-09-21T04:00:30.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.601+0000 7f3179cfe640 1 --2- 172.21.15.46:0/1599810265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3174109e10 0x7f3174110640 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:30.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.601+0000 7f3179cfe640 1 --2- 172.21.15.46:0/1599810265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31741094c0 0x7f31741098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:30.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.602+0000 7f3179cfe640 1 --2- 172.21.15.46:0/1599810265 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3174103b80 0x7f3174103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:30.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.602+0000 7f3179cfe640 1 -- 172.21.15.46:0/1599810265 >> 172.21.15.46:0/1599810265 conn(0x7f31740ff5d0 msgr2=0x7f3174101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:30.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.602+0000 7f3179cfe640 1 -- 172.21.15.46:0/1599810265 shutdown_connections 2024-09-21T04:00:30.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.602+0000 7f3179cfe640 1 -- 172.21.15.46:0/1599810265 wait complete. 2024-09-21T04:00:30.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.602+0000 7f3179cfe640 1 Processor -- start 2024-09-21T04:00:30.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.602+0000 7f3179cfe640 1 -- start start 2024-09-21T04:00:30.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.603+0000 7f3179cfe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3174103b80 0x7f317419c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:30.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.603+0000 7f3179cfe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31741094c0 0x7f317419cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:30.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.603+0000 7f3179cfe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3174109e10 0x7f31741a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:30.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.603+0000 7f3179cfe640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3174113ad0 con 0x7f3174109e10 2024-09-21T04:00:30.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.603+0000 7f3179cfe640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3174113950 con 0x7f31741094c0 2024-09-21T04:00:30.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.603+0000 7f3179cfe640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3174113c50 con 0x7f3174103b80 2024-09-21T04:00:30.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.603+0000 7f3173fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3174109e10 0x7f31741a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:30.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.603+0000 7f3173fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3174109e10 0x7f31741a1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36128/0 (socket says 172.21.15.46:36128) 2024-09-21T04:00:30.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.603+0000 7f3173fff640 1 -- 172.21.15.46:0/2582595094 learned_addr learned my addr 172.21.15.46:0/2582595094 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:30.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.603+0000 7f3172ffd640 1 --2- 172.21.15.46:0/2582595094 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31741094c0 0x7f317419cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:30.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.603+0000 7f31737fe640 1 --2- 172.21.15.46:0/2582595094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3174103b80 0x7f317419c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:30.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.603+0000 7f3173fff640 1 -- 172.21.15.46:0/2582595094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3174103b80 msgr2=0x7f317419c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:30.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.603+0000 7f3173fff640 1 --2- 172.21.15.46:0/2582595094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3174103b80 0x7f317419c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:30.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.603+0000 7f3173fff640 1 -- 172.21.15.46:0/2582595094 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31741094c0 msgr2=0x7f317419cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:30.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.603+0000 7f3173fff640 1 --2- 172.21.15.46:0/2582595094 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31741094c0 0x7f317419cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:30.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.603+0000 7f3173fff640 1 -- 172.21.15.46:0/2582595094 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31741a24f0 con 0x7f3174109e10 2024-09-21T04:00:30.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.603+0000 7f3173fff640 1 --2- 172.21.15.46:0/2582595094 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3174109e10 0x7f31741a1e80 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f316c005cc0 tx=0x7f316c02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:30.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.604+0000 7f3170ff9640 1 -- 172.21.15.46:0/2582595094 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c003bf0 con 0x7f3174109e10 2024-09-21T04:00:30.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.604+0000 7f3170ff9640 1 -- 172.21.15.46:0/2582595094 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f316c003d90 con 0x7f3174109e10 2024-09-21T04:00:30.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.604+0000 7f3179cfe640 1 -- 172.21.15.46:0/2582595094 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31741a2780 con 0x7f3174109e10 2024-09-21T04:00:30.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.604+0000 7f3170ff9640 1 -- 172.21.15.46:0/2582595094 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c02fbc0 con 0x7f3174109e10 2024-09-21T04:00:30.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.604+0000 7f3179cfe640 1 -- 172.21.15.46:0/2582595094 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31741a9000 con 0x7f3174109e10 2024-09-21T04:00:30.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.606+0000 7f3180272740 1 Processor -- start 2024-09-21T04:00:30.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.607+0000 7f3170ff9640 1 -- 172.21.15.46:0/2582595094 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f316c02fd60 con 0x7f3174109e10 2024-09-21T04:00:30.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.607+0000 7f3180272740 1 -- start start 2024-09-21T04:00:30.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.607+0000 7f3180272740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560089171070 0x5600895186a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:30.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.607+0000 7f3180272740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5600891481b0 0x560089518be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:30.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.607+0000 7f3180272740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560089150390 0x560089519120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:30.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.607+0000 7f3180272740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x56008948eea0 con 0x5600891481b0 2024-09-21T04:00:30.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.607+0000 7f3180272740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56008947e2d0 con 0x560089150390 2024-09-21T04:00:30.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.607+0000 7f3180272740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5600894820e0 con 0x560089171070 2024-09-21T04:00:30.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.607+0000 7f31737fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5600891481b0 0x560089518be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:30.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.607+0000 7f31737fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5600891481b0 0x560089518be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36134/0 (socket says 172.21.15.46:36134) 2024-09-21T04:00:30.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.607+0000 7f31737fe640 1 -- 172.21.15.46:0/4045489284 learned_addr learned my addr 172.21.15.46:0/4045489284 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:30.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.607+0000 7f3172ffd640 1 --2- 172.21.15.46:0/4045489284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560089171070 0x5600895186a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:30.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.608+0000 7f3172ffd640 1 --2- 172.21.15.46:0/4045489284 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560089150390 0x560089519120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:30.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.608+0000 7f31737fe640 1 -- 172.21.15.46:0/4045489284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560089171070 msgr2=0x5600895186a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:30.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.608+0000 7f31737fe640 1 --2- 172.21.15.46:0/4045489284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560089171070 0x5600895186a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:30.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.608+0000 7f31737fe640 1 -- 172.21.15.46:0/4045489284 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560089150390 msgr2=0x560089519120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:30.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.608+0000 7f31737fe640 1 --2- 172.21.15.46:0/4045489284 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560089150390 0x560089519120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:30.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.608+0000 7f31737fe640 1 -- 172.21.15.46:0/4045489284 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600891dc650 con 0x5600891481b0 2024-09-21T04:00:30.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.608+0000 7f3170ff9640 1 --2- 172.21.15.46:0/2582595094 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f315c0b6730 0x7f315c0b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:30.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.608+0000 7f3172ffd640 1 --2- 172.21.15.46:0/2582595094 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f315c0b6730 0x7f315c0b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:30.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.608+0000 7f31737fe640 1 --2- 172.21.15.46:0/4045489284 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5600891481b0 0x560089518be0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f316400cc60 tx=0x7f316400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de17552e235b2e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:30.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.608+0000 7f3170ff9640 1 -- 172.21.15.46:0/2582595094 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f316c108a20 con 0x7f3174109e10 2024-09-21T04:00:30.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.608+0000 7f3159ffb640 1 -- 172.21.15.46:0/4045489284 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3164014070 con 0x5600891481b0 2024-09-21T04:00:30.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.608+0000 7f3159ffb640 1 -- 172.21.15.46:0/4045489284 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31640047a0 con 0x5600891481b0 2024-09-21T04:00:30.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.608+0000 7f3159ffb640 1 -- 172.21.15.46:0/4045489284 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3164010690 con 0x5600891481b0 2024-09-21T04:00:30.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.609+0000 7f3180272740 1 -- 172.21.15.46:0/4045489284 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5600891481b0 msgr2=0x560089518be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:30.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.609+0000 7f3180272740 1 --2- 172.21.15.46:0/4045489284 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5600891481b0 0x560089518be0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f316400cc60 tx=0x7f316400e720 comp rx=0 tx=0).stop 2024-09-21T04:00:30.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.609+0000 7f3172ffd640 1 --2- 172.21.15.46:0/2582595094 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f315c0b6730 0x7f315c0b8c40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3174108f10 tx=0x7f31680046c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:30.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.609+0000 7f3180272740 1 -- 172.21.15.46:0/4045489284 shutdown_connections 2024-09-21T04:00:30.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.609+0000 7f3180272740 1 --2- 172.21.15.46:0/4045489284 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560089150390 0x560089519120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:30.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.609+0000 7f3180272740 1 --2- 172.21.15.46:0/4045489284 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5600891481b0 0x560089518be0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:30.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.609+0000 7f3180272740 1 --2- 172.21.15.46:0/4045489284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560089171070 0x5600895186a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:30.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.609+0000 7f3180272740 1 -- 172.21.15.46:0/4045489284 >> 172.21.15.46:0/4045489284 conn(0x560089165460 msgr2=0x560089516590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:30.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.609+0000 7f3180272740 1 -- 172.21.15.46:0/4045489284 shutdown_connections 2024-09-21T04:00:30.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.609+0000 7f3180272740 1 -- 172.21.15.46:0/4045489284 wait complete. 2024-09-21T04:00:30.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.610+0000 7f3180272740 1 -- start start 2024-09-21T04:00:30.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.610+0000 7f3180272740 1 Processor -- start 2024-09-21T04:00:30.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.610+0000 7f3180272740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600891481b0 0x560089523d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:30.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.610+0000 7f3180272740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560089150390 0x5600895242a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:30.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.610+0000 7f3180272740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560089171070 0x560089530170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:30.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.610+0000 7f3180272740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5600892df700 con 0x560089150390 2024-09-21T04:00:30.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.610+0000 7f3180272740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x560089419160 con 0x560089171070 2024-09-21T04:00:30.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.610+0000 7f3180272740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560089526e80 con 0x5600891481b0 2024-09-21T04:00:30.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.611+0000 7f3172ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560089150390 0x5600895242a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:30.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.611+0000 7f3172ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560089150390 0x5600895242a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36140/0 (socket says 172.21.15.46:36140) 2024-09-21T04:00:30.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.611+0000 7f3180272740 10 client.0 _ll_register_callbacks cb 0x5600894329e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:00:30.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.611+0000 7f3172ffd640 1 -- 172.21.15.46:0/1158126006 learned_addr learned my addr 172.21.15.46:0/1158126006 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:30.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.611+0000 7f31737fe640 1 --2- 172.21.15.46:0/1158126006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600891481b0 0x560089523d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:30.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.611+0000 7f3173fff640 1 --2- 172.21.15.46:0/1158126006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560089171070 0x560089530170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:30.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.611+0000 7f3172ffd640 1 -- 172.21.15.46:0/1158126006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600891481b0 msgr2=0x560089523d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:30.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.611+0000 7f3172ffd640 1 --2- 172.21.15.46:0/1158126006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600891481b0 0x560089523d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:30.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.611+0000 7f3172ffd640 1 -- 172.21.15.46:0/1158126006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560089171070 msgr2=0x560089530170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:30.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.611+0000 7f3172ffd640 1 --2- 172.21.15.46:0/1158126006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560089171070 0x560089530170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:30.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.611+0000 7f3172ffd640 1 -- 172.21.15.46:0/1158126006 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560089446c90 con 0x560089150390 2024-09-21T04:00:30.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.611+0000 7f3172ffd640 1 --2- 172.21.15.46:0/1158126006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560089150390 0x5600895242a0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f3168011b80 tx=0x7f3168004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daafc741a9c9cfe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:30.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.611+0000 7f3152ffd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:00:30.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.611+0000 7f3152ffd640 1 -- 172.21.15.46:0/1158126006 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3168019070 con 0x560089150390 2024-09-21T04:00:30.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.611+0000 7f3152ffd640 1 -- 172.21.15.46:0/1158126006 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f316800fd50 con 0x560089150390 2024-09-21T04:00:30.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.611+0000 7f3180272740 1 -- 172.21.15.46:0/1158126006 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31640047a0 con 0x560089150390 2024-09-21T04:00:30.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.612+0000 7f3152ffd640 1 -- 172.21.15.46:0/1158126006 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f316802d030 con 0x560089150390 2024-09-21T04:00:30.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.612+0000 7f3180272740 10 client.16215 fetch_fsmap learned FSMap version 20 2024-09-21T04:00:30.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.612+0000 7f3180272740 1 -- 172.21.15.46:0/1158126006 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560089532bf0 con 0x560089150390 2024-09-21T04:00:30.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.612+0000 7f3152ffd640 1 -- 172.21.15.46:0/1158126006 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31640047a0 con 0x560089150390 2024-09-21T04:00:30.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.612+0000 7f3152ffd640 1 -- 172.21.15.46:0/1158126006 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f3168028500 con 0x560089150390 2024-09-21T04:00:30.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.612+0000 7f3180272740 10 client.16215 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:00:30.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.612+0000 7f3180272740 10 client.16215 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:00:30.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.612+0000 7f3180272740 20 client.16215 populate_metadata read hostname 'smithi046' 2024-09-21T04:00:30.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.612+0000 7f3180272740 1 --2- 172.21.15.46:0/1158126006 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56008912f9f0 0x560089536160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:30.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.612+0000 7f3180272740 4 client.16215 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:00:30.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.612+0000 7f3180272740 1 -- 172.21.15.46:0/1158126006 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560089490df0 con 0x56008912f9f0 2024-09-21T04:00:30.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.612+0000 7f31737fe640 1 --2- 172.21.15.46:0/1158126006 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56008912f9f0 0x560089536160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:30.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.613+0000 7f31737fe640 1 --2- 172.21.15.46:0/1158126006 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56008912f9f0 0x560089536160 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df743f1f93eb14f3 server_cookie=bd9f0899b1621a36 in_seq=0 out_seq=0 2024-09-21T04:00:30.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.613+0000 7f3152ffd640 10 client.16215 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:00:30.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.614+0000 7f3152ffd640 1 -- 172.21.15.46:0/1158126006 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560089490df0 con 0x56008912f9f0 2024-09-21T04:00:30.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.614+0000 7f3152ffd640 10 client.16215 handle_command_reply: tid=0 2024-09-21T04:00:30.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.614+0000 7f3180272740 1 client.16215 shutdown 2024-09-21T04:00:30.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.614+0000 7f3180272740 1 -- 172.21.15.46:0/1158126006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560089150390 msgr2=0x5600895242a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:30.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.614+0000 7f3180272740 1 --2- 172.21.15.46:0/1158126006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560089150390 0x5600895242a0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f3168011b80 tx=0x7f3168004730 comp rx=0 tx=0).stop 2024-09-21T04:00:30.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.614+0000 7f3180272740 1 -- 172.21.15.46:0/1158126006 shutdown_connections 2024-09-21T04:00:30.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.614+0000 7f3180272740 1 --2- 172.21.15.46:0/1158126006 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56008912f9f0 0x560089536160 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:30.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.614+0000 7f3180272740 1 --2- 172.21.15.46:0/1158126006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560089171070 0x560089530170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:30.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.614+0000 7f3180272740 1 --2- 172.21.15.46:0/1158126006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560089150390 0x5600895242a0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:30.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.614+0000 7f3180272740 1 --2- 172.21.15.46:0/1158126006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5600891481b0 0x560089523d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:30.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.614+0000 7f3152ffd640 0 client.16215 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:00:30.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.614+0000 7f3180272740 1 -- 172.21.15.46:0/1158126006 >> 172.21.15.46:0/1158126006 conn(0x560089165460 msgr2=0x56008951b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:30.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.614+0000 7f3180272740 1 -- 172.21.15.46:0/1158126006 shutdown_connections 2024-09-21T04:00:30.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.614+0000 7f3180272740 1 -- 172.21.15.46:0/1158126006 wait complete. 2024-09-21T04:00:30.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.614+0000 7f3180272740 20 client.16215 trim_cache size 0 max 16384 2024-09-21T04:00:30.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.627+0000 7f3180272740 1 Processor -- start 2024-09-21T04:00:30.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.627+0000 7f3180272740 1 -- start start 2024-09-21T04:00:30.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.628+0000 7f3180272740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5600891481b0 0x560089524220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:30.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.628+0000 7f3180272740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560089150390 0x560089530070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:30.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.628+0000 7f3180272740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560089171070 0x560089520f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:30.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.628+0000 7f3180272740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f31741af630 con 0x5600891481b0 2024-09-21T04:00:30.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.628+0000 7f3180272740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f31741b1ed0 con 0x560089150390 2024-09-21T04:00:30.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.628+0000 7f3180272740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f31741afcc0 con 0x560089171070 2024-09-21T04:00:30.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.628+0000 7f31737fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5600891481b0 0x560089524220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:30.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.628+0000 7f31737fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5600891481b0 0x560089524220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36144/0 (socket says 172.21.15.46:36144) 2024-09-21T04:00:30.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.628+0000 7f31737fe640 1 -- 172.21.15.46:0/1372802585 learned_addr learned my addr 172.21.15.46:0/1372802585 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:30.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.628+0000 7f3172ffd640 1 --2- 172.21.15.46:0/1372802585 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560089150390 0x560089530070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:30.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.628+0000 7f3173fff640 1 --2- 172.21.15.46:0/1372802585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560089171070 0x560089520f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:30.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.628+0000 7f31737fe640 1 -- 172.21.15.46:0/1372802585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560089171070 msgr2=0x560089520f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:30.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.628+0000 7f31737fe640 1 --2- 172.21.15.46:0/1372802585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560089171070 0x560089520f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:30.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.628+0000 7f31737fe640 1 -- 172.21.15.46:0/1372802585 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560089150390 msgr2=0x560089530070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:30.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.628+0000 7f31737fe640 1 --2- 172.21.15.46:0/1372802585 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560089150390 0x560089530070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:30.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.628+0000 7f31737fe640 1 -- 172.21.15.46:0/1372802585 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56008951b500 con 0x5600891481b0 2024-09-21T04:00:30.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.628+0000 7f31737fe640 1 --2- 172.21.15.46:0/1372802585 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5600891481b0 0x560089524220 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x560089517320 tx=0x7f316400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd59e587dc745471 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:30.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.629+0000 7f31597fa640 1 -- 172.21.15.46:0/1372802585 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3164014040 con 0x5600891481b0 2024-09-21T04:00:30.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.629+0000 7f31597fa640 1 -- 172.21.15.46:0/1372802585 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3164005580 con 0x5600891481b0 2024-09-21T04:00:30.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.629+0000 7f31597fa640 1 -- 172.21.15.46:0/1372802585 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31640266b0 con 0x5600891481b0 2024-09-21T04:00:30.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.629+0000 7f3180272740 1 -- 172.21.15.46:0/1372802585 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5600891481b0 msgr2=0x560089524220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:30.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.629+0000 7f3180272740 1 --2- 172.21.15.46:0/1372802585 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5600891481b0 0x560089524220 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x560089517320 tx=0x7f316400c810 comp rx=0 tx=0).stop 2024-09-21T04:00:30.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.629+0000 7f3180272740 1 -- 172.21.15.46:0/1372802585 shutdown_connections 2024-09-21T04:00:30.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.629+0000 7f3180272740 1 --2- 172.21.15.46:0/1372802585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560089171070 0x560089520f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:30.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.629+0000 7f3180272740 1 --2- 172.21.15.46:0/1372802585 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560089150390 0x560089530070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:30.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.629+0000 7f3180272740 1 --2- 172.21.15.46:0/1372802585 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5600891481b0 0x560089524220 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:30.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.629+0000 7f3180272740 1 -- 172.21.15.46:0/1372802585 >> 172.21.15.46:0/1372802585 conn(0x560089165460 msgr2=0x560089523b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:30.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.630+0000 7f3180272740 1 -- 172.21.15.46:0/1372802585 shutdown_connections 2024-09-21T04:00:30.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.630+0000 7f3180272740 1 -- 172.21.15.46:0/1372802585 wait complete. 2024-09-21T04:00:30.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.630+0000 7f3180272740 1 -- start start 2024-09-21T04:00:30.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.630+0000 7f3180272740 1 Processor -- start 2024-09-21T04:00:30.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.630+0000 7f3180272740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5600891481b0 0x560089528250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:30.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.630+0000 7f3180272740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560089150390 0x560089528790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:30.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.630+0000 7f3180272740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560089171070 0x560089528cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:30.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.630+0000 7f3180272740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f31741b0390 con 0x560089150390 2024-09-21T04:00:30.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.630+0000 7f3180272740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f31741b1800 con 0x5600891481b0 2024-09-21T04:00:30.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.630+0000 7f3180272740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f31741b0a60 con 0x560089171070 2024-09-21T04:00:30.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.631+0000 7f3180272740 10 client.0 _ll_register_callbacks cb 0x7f3168012f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:00:30.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.631+0000 7f3172ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560089150390 0x560089528790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:30.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.631+0000 7f3172ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560089150390 0x560089528790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36152/0 (socket says 172.21.15.46:36152) 2024-09-21T04:00:30.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.631+0000 7f3172ffd640 1 -- 172.21.15.46:0/2753682901 learned_addr learned my addr 172.21.15.46:0/2753682901 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:30.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.631+0000 7f3173fff640 1 --2- 172.21.15.46:0/2753682901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560089171070 0x560089528cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:30.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.631+0000 7f31737fe640 1 --2- 172.21.15.46:0/2753682901 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5600891481b0 0x560089528250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:30.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.631+0000 7f3172ffd640 1 -- 172.21.15.46:0/2753682901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560089171070 msgr2=0x560089528cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:30.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.631+0000 7f3172ffd640 1 --2- 172.21.15.46:0/2753682901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560089171070 0x560089528cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:30.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.631+0000 7f3172ffd640 1 -- 172.21.15.46:0/2753682901 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5600891481b0 msgr2=0x560089528250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:30.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.631+0000 7f3172ffd640 1 --2- 172.21.15.46:0/2753682901 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5600891481b0 0x560089528250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:30.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.631+0000 7f3172ffd640 1 -- 172.21.15.46:0/2753682901 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56008959fcd0 con 0x560089150390 2024-09-21T04:00:30.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.631+0000 7f3172ffd640 1 --2- 172.21.15.46:0/2753682901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560089150390 0x560089528790 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f3168011b50 tx=0x7f3168028ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8924f0f18c34808 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:30.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.631+0000 7f3152ffd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:00:30.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.631+0000 7f3152ffd640 1 -- 172.21.15.46:0/2753682901 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3168019040 con 0x560089150390 2024-09-21T04:00:30.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.631+0000 7f3152ffd640 1 -- 172.21.15.46:0/2753682901 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f316802e070 con 0x560089150390 2024-09-21T04:00:30.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.631+0000 7f3180272740 1 -- 172.21.15.46:0/2753682901 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3164005580 con 0x560089150390 2024-09-21T04:00:30.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.632+0000 7f3152ffd640 1 -- 172.21.15.46:0/2753682901 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3168028610 con 0x560089150390 2024-09-21T04:00:30.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.632+0000 7f3180272740 10 client.16221 fetch_fsmap learned FSMap version 20 2024-09-21T04:00:30.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.632+0000 7f3180272740 1 -- 172.21.15.46:0/2753682901 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5600895a0f50 con 0x560089150390 2024-09-21T04:00:30.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.632+0000 7f3152ffd640 1 -- 172.21.15.46:0/2753682901 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3164005580 con 0x560089150390 2024-09-21T04:00:30.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.632+0000 7f3152ffd640 1 -- 172.21.15.46:0/2753682901 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f3168032a30 con 0x560089150390 2024-09-21T04:00:30.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.632+0000 7f3180272740 10 client.16221 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:00:30.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.632+0000 7f3180272740 10 client.16221 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:00:30.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.632+0000 7f3180272740 20 client.16221 populate_metadata read hostname 'smithi046' 2024-09-21T04:00:30.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.632+0000 7f3180272740 1 --2- 172.21.15.46:0/2753682901 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560089104da0 0x5600895a3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:30.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.632+0000 7f3180272740 4 client.16221 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T04:00:30.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.632+0000 7f3180272740 1 -- 172.21.15.46:0/2753682901 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56008948c8a0 con 0x560089104da0 2024-09-21T04:00:30.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.632+0000 7f31737fe640 1 --2- 172.21.15.46:0/2753682901 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560089104da0 0x5600895a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:30.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.633+0000 7f31737fe640 1 --2- 172.21.15.46:0/2753682901 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560089104da0 0x5600895a3770 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44e4f4e59381881b server_cookie=3d2f758a78de9b98 in_seq=0 out_seq=0 2024-09-21T04:00:30.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.633+0000 7f3152ffd640 10 client.16221 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:00:30.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.633+0000 7f3152ffd640 1 -- 172.21.15.46:0/2753682901 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56008948c8a0 con 0x560089104da0 2024-09-21T04:00:30.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.633+0000 7f3152ffd640 10 client.16221 handle_command_reply: tid=0 2024-09-21T04:00:30.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.633+0000 7f3180272740 1 client.16221 shutdown 2024-09-21T04:00:30.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.633+0000 7f3180272740 1 -- 172.21.15.46:0/2753682901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560089150390 msgr2=0x560089528790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:30.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.633+0000 7f3180272740 1 --2- 172.21.15.46:0/2753682901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560089150390 0x560089528790 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f3168011b50 tx=0x7f3168028ec0 comp rx=0 tx=0).stop 2024-09-21T04:00:30.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.633+0000 7f3180272740 1 -- 172.21.15.46:0/2753682901 shutdown_connections 2024-09-21T04:00:30.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.633+0000 7f3180272740 1 --2- 172.21.15.46:0/2753682901 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560089104da0 0x5600895a3770 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:30.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.633+0000 7f3152ffd640 0 client.16221 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:00:30.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.633+0000 7f3180272740 1 --2- 172.21.15.46:0/2753682901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560089171070 0x560089528cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:30.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.633+0000 7f3180272740 1 --2- 172.21.15.46:0/2753682901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560089150390 0x560089528790 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:30.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.633+0000 7f3180272740 1 --2- 172.21.15.46:0/2753682901 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5600891481b0 0x560089528250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:30.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.634+0000 7f3180272740 1 -- 172.21.15.46:0/2753682901 >> 172.21.15.46:0/2753682901 conn(0x560089165460 msgr2=0x5600895196d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:30.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.634+0000 7f3180272740 1 -- 172.21.15.46:0/2753682901 shutdown_connections 2024-09-21T04:00:30.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.634+0000 7f3180272740 1 -- 172.21.15.46:0/2753682901 wait complete. 2024-09-21T04:00:30.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.634+0000 7f3180272740 20 client.16221 trim_cache size 0 max 16384 2024-09-21T04:00:30.640 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-21T04:00:30.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.634+0000 7f3179cfe640 1 -- 172.21.15.46:0/2582595094 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f315c0b6730 msgr2=0x7f315c0b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:30.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.634+0000 7f3179cfe640 1 --2- 172.21.15.46:0/2582595094 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f315c0b6730 0x7f315c0b8c40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3174108f10 tx=0x7f31680046c0 comp rx=0 tx=0).stop 2024-09-21T04:00:30.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.634+0000 7f3179cfe640 1 -- 172.21.15.46:0/2582595094 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3174109e10 msgr2=0x7f31741a1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:30.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.634+0000 7f3179cfe640 1 --2- 172.21.15.46:0/2582595094 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3174109e10 0x7f31741a1e80 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f316c005cc0 tx=0x7f316c02f380 comp rx=0 tx=0).stop 2024-09-21T04:00:30.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.634+0000 7f3179cfe640 1 -- 172.21.15.46:0/2582595094 shutdown_connections 2024-09-21T04:00:30.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.634+0000 7f3179cfe640 1 --2- 172.21.15.46:0/2582595094 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3174109e10 0x7f31741a1e80 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:30.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.634+0000 7f3179cfe640 1 --2- 172.21.15.46:0/2582595094 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31741094c0 0x7f317419cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:30.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.634+0000 7f3179cfe640 1 --2- 172.21.15.46:0/2582595094 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f315c0b6730 0x7f315c0b8c40 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:30.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.634+0000 7f3179cfe640 1 --2- 172.21.15.46:0/2582595094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3174103b80 0x7f317419c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:30.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.634+0000 7f3179cfe640 1 -- 172.21.15.46:0/2582595094 >> 172.21.15.46:0/2582595094 conn(0x7f31740ff5d0 msgr2=0x7f317410e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:30.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.635+0000 7f3179cfe640 1 -- 172.21.15.46:0/2582595094 shutdown_connections 2024-09-21T04:00:30.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:30.635+0000 7f3179cfe640 1 -- 172.21.15.46:0/2582595094 wait complete. 2024-09-21T04:00:31.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:31 smithi046 ceph-mon[30954]: pgmap v484: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:00:31.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:31 smithi105 ceph-mon[34773]: pgmap v484: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:00:31.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:31 smithi162 ceph-mon[35071]: pgmap v484: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:00:32.296 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T04:00:32.297 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T04:00:32.572 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:33.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.062+0000 7fcea447f640 1 -- 172.21.15.46:0/3860617267 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce9c102ae0 msgr2=0x7fce9c102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:33.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.062+0000 7fcea447f640 1 --2- 172.21.15.46:0/3860617267 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce9c102ae0 0x7fce9c102ef0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fce98009900 tx=0x7fce9802a410 comp rx=0 tx=0).stop 2024-09-21T04:00:33.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.062+0000 7fcea447f640 1 -- 172.21.15.46:0/3860617267 shutdown_connections 2024-09-21T04:00:33.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.062+0000 7fcea447f640 1 --2- 172.21.15.46:0/3860617267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce9c108d20 0x7fce9c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.063+0000 7fcea447f640 1 --2- 172.21.15.46:0/3860617267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce9c1083d0 0x7fce9c1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.063+0000 7fcea447f640 1 --2- 172.21.15.46:0/3860617267 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce9c102ae0 0x7fce9c102ef0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.063+0000 7fcea447f640 1 -- 172.21.15.46:0/3860617267 >> 172.21.15.46:0/3860617267 conn(0x7fce9c079760 msgr2=0x7fce9c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:33.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.063+0000 7fcea447f640 1 -- 172.21.15.46:0/3860617267 shutdown_connections 2024-09-21T04:00:33.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.063+0000 7fcea447f640 1 -- 172.21.15.46:0/3860617267 wait complete. 2024-09-21T04:00:33.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.063+0000 7fcea447f640 1 Processor -- start 2024-09-21T04:00:33.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.063+0000 7fcea447f640 1 -- start start 2024-09-21T04:00:33.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.064+0000 7fcea447f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce9c102ae0 0x7fce9c19a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:33.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.064+0000 7fcea447f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce9c1083d0 0x7fce9c19aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:33.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.064+0000 7fcea447f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce9c108d20 0x7fce9c19fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:33.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.064+0000 7fcea447f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c112990 con 0x7fce9c1083d0 2024-09-21T04:00:33.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.064+0000 7fcea447f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c112810 con 0x7fce9c102ae0 2024-09-21T04:00:33.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.064+0000 7fcea447f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c112b10 con 0x7fce9c108d20 2024-09-21T04:00:33.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.064+0000 7fcea1a1a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce9c1083d0 0x7fce9c19aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:33.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.064+0000 7fcea1a1a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce9c1083d0 0x7fce9c19aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53844/0 (socket says 172.21.15.46:53844) 2024-09-21T04:00:33.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.064+0000 7fcea1a1a640 1 -- 172.21.15.46:0/1222269931 learned_addr learned my addr 172.21.15.46:0/1222269931 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:33.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.064+0000 7fcea2a1c640 1 --2- 172.21.15.46:0/1222269931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce9c108d20 0x7fce9c19fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:33.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.064+0000 7fcea221b640 1 --2- 172.21.15.46:0/1222269931 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce9c102ae0 0x7fce9c19a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:33.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.064+0000 7fcea1a1a640 1 -- 172.21.15.46:0/1222269931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce9c108d20 msgr2=0x7fce9c19fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:33.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.064+0000 7fcea1a1a640 1 --2- 172.21.15.46:0/1222269931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce9c108d20 0x7fce9c19fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.064+0000 7fcea1a1a640 1 -- 172.21.15.46:0/1222269931 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce9c102ae0 msgr2=0x7fce9c19a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:33.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.064+0000 7fcea1a1a640 1 --2- 172.21.15.46:0/1222269931 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce9c102ae0 0x7fce9c19a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.064+0000 7fcea1a1a640 1 -- 172.21.15.46:0/1222269931 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce9c1a0400 con 0x7fce9c1083d0 2024-09-21T04:00:33.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.064+0000 7fcea221b640 1 --2- 172.21.15.46:0/1222269931 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce9c102ae0 0x7fce9c19a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:00:33.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.064+0000 7fcea1a1a640 1 --2- 172.21.15.46:0/1222269931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce9c1083d0 0x7fce9c19aa30 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00d770 tx=0x7fce8c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:33.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.065+0000 7fce937fe640 1 -- 172.21.15.46:0/1222269931 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c017070 con 0x7fce9c1083d0 2024-09-21T04:00:33.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.065+0000 7fce937fe640 1 -- 172.21.15.46:0/1222269931 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce8c009c30 con 0x7fce9c1083d0 2024-09-21T04:00:33.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.065+0000 7fcea447f640 1 -- 172.21.15.46:0/1222269931 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce9c1a06f0 con 0x7fce9c1083d0 2024-09-21T04:00:33.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.065+0000 7fce937fe640 1 -- 172.21.15.46:0/1222269931 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c00f620 con 0x7fce9c1083d0 2024-09-21T04:00:33.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.065+0000 7fcea447f640 1 -- 172.21.15.46:0/1222269931 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce9c1a6e50 con 0x7fce9c1083d0 2024-09-21T04:00:33.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.067+0000 7fceaa9f3740 1 Processor -- start 2024-09-21T04:00:33.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.068+0000 7fceaa9f3740 1 -- start start 2024-09-21T04:00:33.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.068+0000 7fce937fe640 1 -- 172.21.15.46:0/1222269931 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7fce8c01a070 con 0x7fce9c1083d0 2024-09-21T04:00:33.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.068+0000 7fceaa9f3740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56205823c350 0x5620585e3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:33.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.068+0000 7fceaa9f3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562058213490 0x5620585e3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:33.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.068+0000 7fceaa9f3740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56205821b670 0x5620585e3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:33.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.068+0000 7fceaa9f3740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x562058559e60 con 0x56205823c350 2024-09-21T04:00:33.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.068+0000 7fceaa9f3740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x562058549290 con 0x56205821b670 2024-09-21T04:00:33.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.068+0000 7fceaa9f3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56205854d0a0 con 0x562058213490 2024-09-21T04:00:33.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.068+0000 7fcea2a1c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56205823c350 0x5620585e3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:33.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.068+0000 7fcea2a1c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56205823c350 0x5620585e3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53856/0 (socket says 172.21.15.46:53856) 2024-09-21T04:00:33.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.068+0000 7fcea2a1c640 1 -- 172.21.15.46:0/2212328589 learned_addr learned my addr 172.21.15.46:0/2212328589 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:33.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.068+0000 7fcea221b640 1 --2- 172.21.15.46:0/2212328589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562058213490 0x5620585e3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:33.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.068+0000 7fcea1a1a640 1 --2- 172.21.15.46:0/2212328589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56205821b670 0x5620585e3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:33.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.068+0000 7fcea2a1c640 1 -- 172.21.15.46:0/2212328589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562058213490 msgr2=0x5620585e3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:33.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.068+0000 7fcea2a1c640 1 --2- 172.21.15.46:0/2212328589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562058213490 0x5620585e3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.068+0000 7fcea2a1c640 1 -- 172.21.15.46:0/2212328589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56205821b670 msgr2=0x5620585e3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:33.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.068+0000 7fcea2a1c640 1 --2- 172.21.15.46:0/2212328589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56205821b670 0x5620585e3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.068+0000 7fcea2a1c640 1 -- 172.21.15.46:0/2212328589 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620582a7930 con 0x56205823c350 2024-09-21T04:00:33.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.068+0000 7fcea221b640 1 --2- 172.21.15.46:0/2212328589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562058213490 0x5620585e3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:00:33.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.068+0000 7fcea1a1a640 1 --2- 172.21.15.46:0/2212328589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56205821b670 0x5620585e3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:00:33.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.069+0000 7fcea2a1c640 1 --2- 172.21.15.46:0/2212328589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56205823c350 0x5620585e3430 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fce9400ae90 tx=0x7fce9400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7da5cf922b5fa86 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:33.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.069+0000 7fce90d9a640 1 -- 172.21.15.46:0/2212328589 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce94003b70 con 0x56205823c350 2024-09-21T04:00:33.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.069+0000 7fce90d9a640 1 -- 172.21.15.46:0/2212328589 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce94003d10 con 0x56205823c350 2024-09-21T04:00:33.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.069+0000 7fce90d9a640 1 -- 172.21.15.46:0/2212328589 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce94010ab0 con 0x56205823c350 2024-09-21T04:00:33.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.069+0000 7fce937fe640 1 --2- 172.21.15.46:0/1222269931 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fce880b6680 0x7fce880b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:33.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.069+0000 7fcea221b640 1 --2- 172.21.15.46:0/1222269931 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fce880b6680 0x7fce880b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:33.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.069+0000 7fce937fe640 1 -- 172.21.15.46:0/1222269931 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fce8c0e71d0 con 0x7fce9c1083d0 2024-09-21T04:00:33.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.070+0000 7fceaa9f3740 1 -- 172.21.15.46:0/2212328589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56205823c350 msgr2=0x5620585e3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:33.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.070+0000 7fcea221b640 1 --2- 172.21.15.46:0/1222269931 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fce880b6680 0x7fce880b8b90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fce98031440 tx=0x7fce980058b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:33.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.070+0000 7fceaa9f3740 1 --2- 172.21.15.46:0/2212328589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56205823c350 0x5620585e3430 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fce9400ae90 tx=0x7fce9400f790 comp rx=0 tx=0).stop 2024-09-21T04:00:33.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.070+0000 7fceaa9f3740 1 -- 172.21.15.46:0/2212328589 shutdown_connections 2024-09-21T04:00:33.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.070+0000 7fceaa9f3740 1 --2- 172.21.15.46:0/2212328589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56205821b670 0x5620585e3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.070+0000 7fceaa9f3740 1 --2- 172.21.15.46:0/2212328589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562058213490 0x5620585e3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.070+0000 7fceaa9f3740 1 --2- 172.21.15.46:0/2212328589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56205823c350 0x5620585e3430 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.070+0000 7fceaa9f3740 1 -- 172.21.15.46:0/2212328589 >> 172.21.15.46:0/2212328589 conn(0x562058230740 msgr2=0x5620585e1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:33.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.070+0000 7fceaa9f3740 1 -- 172.21.15.46:0/2212328589 shutdown_connections 2024-09-21T04:00:33.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.070+0000 7fceaa9f3740 1 -- 172.21.15.46:0/2212328589 wait complete. 2024-09-21T04:00:33.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.071+0000 7fceaa9f3740 1 -- start start 2024-09-21T04:00:33.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.071+0000 7fceaa9f3740 1 Processor -- start 2024-09-21T04:00:33.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.071+0000 7fceaa9f3740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562058213490 0x5620585ef050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:33.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.071+0000 7fceaa9f3740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56205821b670 0x5620585ef590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:33.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.071+0000 7fceaa9f3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56205823c350 0x5620585ff340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:33.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.071+0000 7fceaa9f3740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5620583aa890 con 0x562058213490 2024-09-21T04:00:33.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.071+0000 7fceaa9f3740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5620584e3d40 con 0x56205821b670 2024-09-21T04:00:33.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.071+0000 7fceaa9f3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5620585f6020 con 0x56205823c350 2024-09-21T04:00:33.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.071+0000 7fcea221b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562058213490 0x5620585ef050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:33.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.071+0000 7fcea221b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562058213490 0x5620585ef050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53862/0 (socket says 172.21.15.46:53862) 2024-09-21T04:00:33.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.071+0000 7fceaa9f3740 10 client.0 _ll_register_callbacks cb 0x562058547c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:00:33.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.071+0000 7fcea221b640 1 -- 172.21.15.46:0/1533633462 learned_addr learned my addr 172.21.15.46:0/1533633462 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:33.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.071+0000 7fcea1a1a640 1 --2- 172.21.15.46:0/1533633462 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56205821b670 0x5620585ef590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:33.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.071+0000 7fcea2a1c640 1 --2- 172.21.15.46:0/1533633462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56205823c350 0x5620585ff340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:33.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.072+0000 7fcea221b640 1 -- 172.21.15.46:0/1533633462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56205823c350 msgr2=0x5620585ff340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:33.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.072+0000 7fcea221b640 1 --2- 172.21.15.46:0/1533633462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56205823c350 0x5620585ff340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.072+0000 7fcea221b640 1 -- 172.21.15.46:0/1533633462 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56205821b670 msgr2=0x5620585ef590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:33.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.072+0000 7fcea221b640 1 --2- 172.21.15.46:0/1533633462 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56205821b670 0x5620585ef590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.072+0000 7fcea221b640 1 -- 172.21.15.46:0/1533633462 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620585ff930 con 0x562058213490 2024-09-21T04:00:33.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.072+0000 7fcea1a1a640 1 --2- 172.21.15.46:0/1533633462 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56205821b670 0x5620585ef590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:00:33.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.072+0000 7fcea221b640 1 --2- 172.21.15.46:0/1533633462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562058213490 0x5620585ef050 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fce98005940 tx=0x7fce9802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d460135a8dd166b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:33.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.072+0000 7fce85ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:00:33.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.072+0000 7fce85ffb640 1 -- 172.21.15.46:0/1533633462 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9804b020 con 0x562058213490 2024-09-21T04:00:33.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.072+0000 7fce85ffb640 1 -- 172.21.15.46:0/1533633462 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fce98005030 con 0x562058213490 2024-09-21T04:00:33.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.072+0000 7fceaa9f3740 1 -- 172.21.15.46:0/1533633462 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce94003d10 con 0x562058213490 2024-09-21T04:00:33.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.072+0000 7fce85ffb640 1 -- 172.21.15.46:0/1533633462 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fce98056050 con 0x562058213490 2024-09-21T04:00:33.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.072+0000 7fceaa9f3740 10 client.16233 fetch_fsmap learned FSMap version 20 2024-09-21T04:00:33.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.072+0000 7fceaa9f3740 1 -- 172.21.15.46:0/1533633462 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x562058602120 con 0x562058213490 2024-09-21T04:00:33.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.072+0000 7fce85ffb640 1 -- 172.21.15.46:0/1533633462 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce94003d10 con 0x562058213490 2024-09-21T04:00:33.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.073+0000 7fce85ffb640 1 -- 172.21.15.46:0/1533633462 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fce980035f0 con 0x562058213490 2024-09-21T04:00:33.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.073+0000 7fceaa9f3740 10 client.16233 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:00:33.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.073+0000 7fceaa9f3740 10 client.16233 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:00:33.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.073+0000 7fceaa9f3740 20 client.16233 populate_metadata read hostname 'smithi046' 2024-09-21T04:00:33.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.073+0000 7fceaa9f3740 1 --2- 172.21.15.46:0/1533633462 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5620581facd0 0x562058605760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:33.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.073+0000 7fceaa9f3740 4 client.16233 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:00:33.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.073+0000 7fceaa9f3740 1 -- 172.21.15.46:0/1533633462 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56205855bdb0 con 0x5620581facd0 2024-09-21T04:00:33.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.073+0000 7fcea1a1a640 1 --2- 172.21.15.46:0/1533633462 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5620581facd0 0x562058605760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:33.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.074+0000 7fce85ffb640 10 client.16233 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:00:33.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.074+0000 7fcea1a1a640 1 --2- 172.21.15.46:0/1533633462 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5620581facd0 0x562058605760 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=314e81c96d37c8 server_cookie=852841dd9759b6a8 in_seq=0 out_seq=0 2024-09-21T04:00:33.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.074+0000 7fce85ffb640 1 -- 172.21.15.46:0/1533633462 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56205855bdb0 con 0x5620581facd0 2024-09-21T04:00:33.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.074+0000 7fce85ffb640 10 client.16233 handle_command_reply: tid=0 2024-09-21T04:00:33.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.074+0000 7fceaa9f3740 1 client.16233 shutdown 2024-09-21T04:00:33.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.074+0000 7fceaa9f3740 1 -- 172.21.15.46:0/1533633462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562058213490 msgr2=0x5620585ef050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:33.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.074+0000 7fceaa9f3740 1 --2- 172.21.15.46:0/1533633462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562058213490 0x5620585ef050 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fce98005940 tx=0x7fce9802a410 comp rx=0 tx=0).stop 2024-09-21T04:00:33.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.075+0000 7fceaa9f3740 1 -- 172.21.15.46:0/1533633462 shutdown_connections 2024-09-21T04:00:33.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.075+0000 7fceaa9f3740 1 --2- 172.21.15.46:0/1533633462 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5620581facd0 0x562058605760 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.075+0000 7fce85ffb640 0 client.16233 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:00:33.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.075+0000 7fceaa9f3740 1 --2- 172.21.15.46:0/1533633462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56205823c350 0x5620585ff340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.075+0000 7fceaa9f3740 1 --2- 172.21.15.46:0/1533633462 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56205821b670 0x5620585ef590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.075+0000 7fceaa9f3740 1 --2- 172.21.15.46:0/1533633462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562058213490 0x5620585ef050 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.075+0000 7fceaa9f3740 1 -- 172.21.15.46:0/1533633462 >> 172.21.15.46:0/1533633462 conn(0x562058230740 msgr2=0x5620585e6610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:33.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.075+0000 7fceaa9f3740 1 -- 172.21.15.46:0/1533633462 shutdown_connections 2024-09-21T04:00:33.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.075+0000 7fceaa9f3740 1 -- 172.21.15.46:0/1533633462 wait complete. 2024-09-21T04:00:33.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.075+0000 7fceaa9f3740 20 client.16233 trim_cache size 0 max 16384 2024-09-21T04:00:33.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.092+0000 7fceaa9f3740 1 Processor -- start 2024-09-21T04:00:33.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.092+0000 7fceaa9f3740 1 -- start start 2024-09-21T04:00:33.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.093+0000 7fceaa9f3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620581facd0 0x5620585e8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:33.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.093+0000 7fceaa9f3740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562058213490 0x5620585ff240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:33.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.093+0000 7fceaa9f3740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56205821b670 0x5620585ec040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:33.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.093+0000 7fceaa9f3740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c1ab340 con 0x562058213490 2024-09-21T04:00:33.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.093+0000 7fceaa9f3740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c1adbe0 con 0x56205821b670 2024-09-21T04:00:33.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.093+0000 7fceaa9f3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c1ab9d0 con 0x5620581facd0 2024-09-21T04:00:33.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.093+0000 7fcea1a1a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562058213490 0x5620585ff240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:33.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.093+0000 7fcea1a1a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562058213490 0x5620585ff240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53870/0 (socket says 172.21.15.46:53870) 2024-09-21T04:00:33.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.093+0000 7fcea1a1a640 1 -- 172.21.15.46:0/3622947794 learned_addr learned my addr 172.21.15.46:0/3622947794 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:33.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.093+0000 7fcea221b640 1 --2- 172.21.15.46:0/3622947794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620581facd0 0x5620585e8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:33.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.093+0000 7fcea2a1c640 1 --2- 172.21.15.46:0/3622947794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56205821b670 0x5620585ec040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:33.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.093+0000 7fcea1a1a640 1 -- 172.21.15.46:0/3622947794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620581facd0 msgr2=0x5620585e8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:33.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.093+0000 7fcea1a1a640 1 --2- 172.21.15.46:0/3622947794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620581facd0 0x5620585e8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.093+0000 7fcea1a1a640 1 -- 172.21.15.46:0/3622947794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56205821b670 msgr2=0x5620585ec040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:33.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.093+0000 7fcea1a1a640 1 --2- 172.21.15.46:0/3622947794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56205821b670 0x5620585ec040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.093+0000 7fcea1a1a640 1 -- 172.21.15.46:0/3622947794 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620585e5cc0 con 0x562058213490 2024-09-21T04:00:33.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.093+0000 7fcea221b640 1 --2- 172.21.15.46:0/3622947794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620581facd0 0x5620585e8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:00:33.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.093+0000 7fcea1a1a640 1 --2- 172.21.15.46:0/3622947794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562058213490 0x5620585ff240 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00d740 tx=0x7fce8c0e9660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f276d558e58a0192 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:33.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.093+0000 7fce87fff640 1 -- 172.21.15.46:0/3622947794 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c021040 con 0x562058213490 2024-09-21T04:00:33.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.094+0000 7fce87fff640 1 -- 172.21.15.46:0/3622947794 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce8c009de0 con 0x562058213490 2024-09-21T04:00:33.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.094+0000 7fce87fff640 1 -- 172.21.15.46:0/3622947794 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c0981d0 con 0x562058213490 2024-09-21T04:00:33.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.094+0000 7fceaa9f3740 1 -- 172.21.15.46:0/3622947794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562058213490 msgr2=0x5620585ff240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:33.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.094+0000 7fceaa9f3740 1 --2- 172.21.15.46:0/3622947794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562058213490 0x5620585ff240 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00d740 tx=0x7fce8c0e9660 comp rx=0 tx=0).stop 2024-09-21T04:00:33.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.094+0000 7fceaa9f3740 1 -- 172.21.15.46:0/3622947794 shutdown_connections 2024-09-21T04:00:33.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.094+0000 7fceaa9f3740 1 --2- 172.21.15.46:0/3622947794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56205821b670 0x5620585ec040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.094+0000 7fceaa9f3740 1 --2- 172.21.15.46:0/3622947794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562058213490 0x5620585ff240 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.094+0000 7fceaa9f3740 1 --2- 172.21.15.46:0/3622947794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620581facd0 0x5620585e8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.094+0000 7fceaa9f3740 1 -- 172.21.15.46:0/3622947794 >> 172.21.15.46:0/3622947794 conn(0x562058230740 msgr2=0x5620585e8540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:33.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.094+0000 7fceaa9f3740 1 -- 172.21.15.46:0/3622947794 shutdown_connections 2024-09-21T04:00:33.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.094+0000 7fceaa9f3740 1 -- 172.21.15.46:0/3622947794 wait complete. 2024-09-21T04:00:33.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.095+0000 7fceaa9f3740 1 -- start start 2024-09-21T04:00:33.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.095+0000 7fceaa9f3740 1 Processor -- start 2024-09-21T04:00:33.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.095+0000 7fceaa9f3740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5620581facd0 0x5620585f8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:33.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.095+0000 7fceaa9f3740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562058213490 0x5620585f8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:33.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.095+0000 7fceaa9f3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56205821b670 0x5620585f8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:33.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.095+0000 7fceaa9f3740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c1ac0a0 con 0x5620581facd0 2024-09-21T04:00:33.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.095+0000 7fceaa9f3740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c1ad510 con 0x562058213490 2024-09-21T04:00:33.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.095+0000 7fceaa9f3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c1ac770 con 0x56205821b670 2024-09-21T04:00:33.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.096+0000 7fceaa9f3740 10 client.0 _ll_register_callbacks cb 0x7fce9803f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:00:33.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.096+0000 7fcea221b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5620581facd0 0x5620585f8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:33.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.096+0000 7fcea221b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5620581facd0 0x5620585f8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53880/0 (socket says 172.21.15.46:53880) 2024-09-21T04:00:33.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.096+0000 7fcea221b640 1 -- 172.21.15.46:0/1294246222 learned_addr learned my addr 172.21.15.46:0/1294246222 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:33.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.096+0000 7fcea1a1a640 1 --2- 172.21.15.46:0/1294246222 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562058213490 0x5620585f8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:33.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.096+0000 7fcea2a1c640 1 --2- 172.21.15.46:0/1294246222 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56205821b670 0x5620585f8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:33.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.096+0000 7fcea221b640 1 -- 172.21.15.46:0/1294246222 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56205821b670 msgr2=0x5620585f8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:33.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.096+0000 7fcea221b640 1 --2- 172.21.15.46:0/1294246222 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56205821b670 0x5620585f8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.096+0000 7fcea221b640 1 -- 172.21.15.46:0/1294246222 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562058213490 msgr2=0x5620585f8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:33.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.096+0000 7fcea221b640 1 --2- 172.21.15.46:0/1294246222 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562058213490 0x5620585f8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.096+0000 7fcea221b640 1 -- 172.21.15.46:0/1294246222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562058670170 con 0x5620581facd0 2024-09-21T04:00:33.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.096+0000 7fcea221b640 1 --2- 172.21.15.46:0/1294246222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5620581facd0 0x5620585f8210 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fce98005700 tx=0x7fce980035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff650a9e87a84712 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:33.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.096+0000 7fce85ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:00:33.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.096+0000 7fce85ffb640 1 -- 172.21.15.46:0/1294246222 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9805e020 con 0x5620581facd0 2024-09-21T04:00:33.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.096+0000 7fce85ffb640 1 -- 172.21.15.46:0/1294246222 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fce98003e30 con 0x5620581facd0 2024-09-21T04:00:33.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.096+0000 7fceaa9f3740 1 -- 172.21.15.46:0/1294246222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce8c009de0 con 0x5620581facd0 2024-09-21T04:00:33.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.096+0000 7fce85ffb640 1 -- 172.21.15.46:0/1294246222 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fce98069050 con 0x5620581facd0 2024-09-21T04:00:33.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.096+0000 7fceaa9f3740 10 client.16239 fetch_fsmap learned FSMap version 20 2024-09-21T04:00:33.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.097+0000 7fceaa9f3740 1 -- 172.21.15.46:0/1294246222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5620586713c0 con 0x5620581facd0 2024-09-21T04:00:33.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.097+0000 7fce85ffb640 1 -- 172.21.15.46:0/1294246222 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce8c009de0 con 0x5620581facd0 2024-09-21T04:00:33.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.097+0000 7fce85ffb640 1 -- 172.21.15.46:0/1294246222 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fce9803b550 con 0x5620581facd0 2024-09-21T04:00:33.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.097+0000 7fceaa9f3740 10 client.16239 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:00:33.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.097+0000 7fceaa9f3740 10 client.16239 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:00:33.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.097+0000 7fceaa9f3740 20 client.16239 populate_metadata read hostname 'smithi046' 2024-09-21T04:00:33.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.097+0000 7fceaa9f3740 1 --2- 172.21.15.46:0/1294246222 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56205823c350 0x562058673bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:33.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.097+0000 7fceaa9f3740 4 client.16239 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T04:00:33.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.097+0000 7fceaa9f3740 1 -- 172.21.15.46:0/1294246222 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562058557860 con 0x56205823c350 2024-09-21T04:00:33.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.097+0000 7fcea1a1a640 1 --2- 172.21.15.46:0/1294246222 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56205823c350 0x562058673bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:33.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.098+0000 7fcea1a1a640 1 --2- 172.21.15.46:0/1294246222 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56205823c350 0x562058673bd0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29d7257f306181ed server_cookie=c7d74879ee54bebe in_seq=0 out_seq=0 2024-09-21T04:00:33.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.098+0000 7fce85ffb640 10 client.16239 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:00:33.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.099+0000 7fce85ffb640 1 -- 172.21.15.46:0/1294246222 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562058557860 con 0x56205823c350 2024-09-21T04:00:33.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.099+0000 7fce85ffb640 10 client.16239 handle_command_reply: tid=0 2024-09-21T04:00:33.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.099+0000 7fceaa9f3740 1 client.16239 shutdown 2024-09-21T04:00:33.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.099+0000 7fceaa9f3740 1 -- 172.21.15.46:0/1294246222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5620581facd0 msgr2=0x5620585f8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:33.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.099+0000 7fceaa9f3740 1 --2- 172.21.15.46:0/1294246222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5620581facd0 0x5620585f8210 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fce98005700 tx=0x7fce980035f0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.100+0000 7fceaa9f3740 1 -- 172.21.15.46:0/1294246222 shutdown_connections 2024-09-21T04:00:33.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.100+0000 7fceaa9f3740 1 --2- 172.21.15.46:0/1294246222 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56205823c350 0x562058673bd0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.100+0000 7fceaa9f3740 1 --2- 172.21.15.46:0/1294246222 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56205821b670 0x5620585f8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.100+0000 7fce85ffb640 0 client.16239 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:00:33.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.100+0000 7fceaa9f3740 1 --2- 172.21.15.46:0/1294246222 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562058213490 0x5620585f8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.100+0000 7fceaa9f3740 1 --2- 172.21.15.46:0/1294246222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5620581facd0 0x5620585f8210 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.100+0000 7fceaa9f3740 1 -- 172.21.15.46:0/1294246222 >> 172.21.15.46:0/1294246222 conn(0x562058230740 msgr2=0x5620585e4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:33.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.100+0000 7fceaa9f3740 1 -- 172.21.15.46:0/1294246222 shutdown_connections 2024-09-21T04:00:33.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.100+0000 7fceaa9f3740 1 -- 172.21.15.46:0/1294246222 wait complete. 2024-09-21T04:00:33.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.100+0000 7fceaa9f3740 20 client.16239 trim_cache size 0 max 16384 2024-09-21T04:00:33.106 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T04:00:33.106 INFO:teuthology.orchestra.run.smithi046.stdout: "return_code": 0, 2024-09-21T04:00:33.106 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_tag": "0d781b95-cf5e-46f2-9875-2923181385e2", 2024-09-21T04:00:33.107 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": "asynchronous" 2024-09-21T04:00:33.107 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T04:00:33.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.100+0000 7fcea447f640 1 -- 172.21.15.46:0/1222269931 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fce880b6680 msgr2=0x7fce880b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:33.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.100+0000 7fcea447f640 1 --2- 172.21.15.46:0/1222269931 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fce880b6680 0x7fce880b8b90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fce98031440 tx=0x7fce980058b0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.100+0000 7fcea447f640 1 -- 172.21.15.46:0/1222269931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce9c1083d0 msgr2=0x7fce9c19aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:33.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.100+0000 7fcea447f640 1 --2- 172.21.15.46:0/1222269931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce9c1083d0 0x7fce9c19aa30 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00d770 tx=0x7fce8c00dc30 comp rx=0 tx=0).stop 2024-09-21T04:00:33.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.101+0000 7fcea447f640 1 -- 172.21.15.46:0/1222269931 shutdown_connections 2024-09-21T04:00:33.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.101+0000 7fcea447f640 1 --2- 172.21.15.46:0/1222269931 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fce880b6680 0x7fce880b8b90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.101+0000 7fcea447f640 1 --2- 172.21.15.46:0/1222269931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce9c108d20 0x7fce9c19fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.101+0000 7fcea447f640 1 --2- 172.21.15.46:0/1222269931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce9c1083d0 0x7fce9c19aa30 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.101+0000 7fcea447f640 1 --2- 172.21.15.46:0/1222269931 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce9c102ae0 0x7fce9c19a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.101+0000 7fcea447f640 1 -- 172.21.15.46:0/1222269931 >> 172.21.15.46:0/1222269931 conn(0x7fce9c079760 msgr2=0x7fce9c101b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:33.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.101+0000 7fcea447f640 1 -- 172.21.15.46:0/1222269931 shutdown_connections 2024-09-21T04:00:33.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:33.101+0000 7fcea447f640 1 -- 172.21.15.46:0/1222269931 wait complete. 2024-09-21T04:00:33.822 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T04:00:34.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:33 smithi046 ceph-mon[30954]: pgmap v485: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T04:00:34.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:33 smithi046 ceph-mon[30954]: scrub queued for path: / 2024-09-21T04:00:34.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:33 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T04:00:34.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:33 smithi046 ceph-mon[30954]: scrub summary: active paths [/] 2024-09-21T04:00:34.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:33 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T04:00:34.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:33 smithi046 ceph-mon[30954]: scrub summary: idle 2024-09-21T04:00:34.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:33 smithi105 ceph-mon[34773]: pgmap v485: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T04:00:34.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:33 smithi105 ceph-mon[34773]: scrub queued for path: / 2024-09-21T04:00:34.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:33 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T04:00:34.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:33 smithi105 ceph-mon[34773]: scrub summary: active paths [/] 2024-09-21T04:00:34.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:33 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T04:00:34.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:33 smithi105 ceph-mon[34773]: scrub summary: idle 2024-09-21T04:00:34.084 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:34.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:33 smithi162 ceph-mon[35071]: pgmap v485: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T04:00:34.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:33 smithi162 ceph-mon[35071]: scrub queued for path: / 2024-09-21T04:00:34.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:33 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T04:00:34.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:33 smithi162 ceph-mon[35071]: scrub summary: active paths [/] 2024-09-21T04:00:34.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:33 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T04:00:34.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:33 smithi162 ceph-mon[35071]: scrub summary: idle 2024-09-21T04:00:34.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.570+0000 7efbfee85640 1 -- 172.21.15.46:0/1548530341 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efbf8108d20 msgr2=0x7efbf810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:34.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.570+0000 7efbfee85640 1 --2- 172.21.15.46:0/1548530341 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efbf8108d20 0x7efbf810f550 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7efbf0009ca0 tx=0x7efbf002a8c0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.570+0000 7efbfee85640 1 -- 172.21.15.46:0/1548530341 shutdown_connections 2024-09-21T04:00:34.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.570+0000 7efbfee85640 1 --2- 172.21.15.46:0/1548530341 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efbf8108d20 0x7efbf810f550 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.570+0000 7efbfee85640 1 --2- 172.21.15.46:0/1548530341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efbf81083d0 0x7efbf81087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.570+0000 7efbfee85640 1 --2- 172.21.15.46:0/1548530341 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efbf8102ae0 0x7efbf8102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.570+0000 7efbfee85640 1 -- 172.21.15.46:0/1548530341 >> 172.21.15.46:0/1548530341 conn(0x7efbf8079760 msgr2=0x7efbf8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:34.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.570+0000 7efbfee85640 1 -- 172.21.15.46:0/1548530341 shutdown_connections 2024-09-21T04:00:34.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.570+0000 7efbfee85640 1 -- 172.21.15.46:0/1548530341 wait complete. 2024-09-21T04:00:34.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.571+0000 7efbfee85640 1 Processor -- start 2024-09-21T04:00:34.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.571+0000 7efbfee85640 1 -- start start 2024-09-21T04:00:34.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.571+0000 7efbfee85640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efbf8102ae0 0x7efbf819b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:34.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.571+0000 7efbfee85640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efbf81083d0 0x7efbf819b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:34.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.571+0000 7efbfee85640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efbf8108d20 0x7efbf819bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:34.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.571+0000 7efbfee85640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7efbf8112990 con 0x7efbf81083d0 2024-09-21T04:00:34.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.571+0000 7efbfee85640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efbf8112810 con 0x7efbf8108d20 2024-09-21T04:00:34.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.571+0000 7efbfee85640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efbf8112b10 con 0x7efbf8102ae0 2024-09-21T04:00:34.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.571+0000 7efbeffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efbf81083d0 0x7efbf819b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:34.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.571+0000 7efbeffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efbf81083d0 0x7efbf819b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53898/0 (socket says 172.21.15.46:53898) 2024-09-21T04:00:34.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.571+0000 7efbeffff640 1 -- 172.21.15.46:0/895974167 learned_addr learned my addr 172.21.15.46:0/895974167 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:34.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.571+0000 7efbfcc21640 1 --2- 172.21.15.46:0/895974167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efbf8102ae0 0x7efbf819b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:34.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.571+0000 7efbfd422640 1 --2- 172.21.15.46:0/895974167 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efbf8108d20 0x7efbf819bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:34.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.571+0000 7efbeffff640 1 -- 172.21.15.46:0/895974167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efbf8102ae0 msgr2=0x7efbf819b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:34.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.571+0000 7efbeffff640 1 --2- 172.21.15.46:0/895974167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efbf8102ae0 0x7efbf819b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.571+0000 7efbeffff640 1 -- 172.21.15.46:0/895974167 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efbf8108d20 msgr2=0x7efbf819bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:34.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.571+0000 7efbeffff640 1 --2- 172.21.15.46:0/895974167 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efbf8108d20 0x7efbf819bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.571+0000 7efbeffff640 1 -- 172.21.15.46:0/895974167 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbf81a6460 con 0x7efbf81083d0 2024-09-21T04:00:34.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.571+0000 7efbfcc21640 1 --2- 172.21.15.46:0/895974167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efbf8102ae0 0x7efbf819b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:00:34.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.571+0000 7efbfd422640 1 --2- 172.21.15.46:0/895974167 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efbf8108d20 0x7efbf819bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:00:34.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.572+0000 7efbeffff640 1 --2- 172.21.15.46:0/895974167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efbf81083d0 0x7efbf819b7a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7efbe800c970 tx=0x7efbe800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:34.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.572+0000 7efbedffb640 1 -- 172.21.15.46:0/895974167 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbe8007bb0 con 0x7efbf81083d0 2024-09-21T04:00:34.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.572+0000 7efbedffb640 1 -- 172.21.15.46:0/895974167 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efbe8007d50 con 0x7efbf81083d0 2024-09-21T04:00:34.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.572+0000 7efbfee85640 1 -- 172.21.15.46:0/895974167 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efbf81a6750 con 0x7efbf81083d0 2024-09-21T04:00:34.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.572+0000 7efbedffb640 1 -- 172.21.15.46:0/895974167 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbe8018730 con 0x7efbf81083d0 2024-09-21T04:00:34.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.572+0000 7efbfee85640 1 -- 172.21.15.46:0/895974167 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efbf81a6c40 con 0x7efbf81083d0 2024-09-21T04:00:34.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.575+0000 7efc053f9740 1 Processor -- start 2024-09-21T04:00:34.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.575+0000 7efbedffb640 1 -- 172.21.15.46:0/895974167 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7efbe800f990 con 0x7efbf81083d0 2024-09-21T04:00:34.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.575+0000 7efc053f9740 1 -- start start 2024-09-21T04:00:34.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.575+0000 7efc053f9740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560b31629070 0x560b319d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:34.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.575+0000 7efc053f9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b316001b0 0x560b319d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:34.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.575+0000 7efc053f9740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560b31608390 0x560b319d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:34.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.575+0000 7efc053f9740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x560b31946e50 con 0x560b31629070 2024-09-21T04:00:34.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.575+0000 7efc053f9740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x560b31936280 con 0x560b31608390 2024-09-21T04:00:34.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.575+0000 7efc053f9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560b3193a090 con 0x560b316001b0 2024-09-21T04:00:34.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.575+0000 7efbfd422640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560b31629070 0x560b319d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:34.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.575+0000 7efbfd422640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560b31629070 0x560b319d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53900/0 (socket says 172.21.15.46:53900) 2024-09-21T04:00:34.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.575+0000 7efbfd422640 1 -- 172.21.15.46:0/2766807222 learned_addr learned my addr 172.21.15.46:0/2766807222 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:34.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.575+0000 7efbfcc21640 1 --2- 172.21.15.46:0/2766807222 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b316001b0 0x560b319d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:34.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.575+0000 7efbeffff640 1 --2- 172.21.15.46:0/2766807222 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560b31608390 0x560b319d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:34.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.576+0000 7efbfd422640 1 -- 172.21.15.46:0/2766807222 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b316001b0 msgr2=0x560b319d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:34.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.576+0000 7efbfd422640 1 --2- 172.21.15.46:0/2766807222 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b316001b0 0x560b319d07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.576+0000 7efbfd422640 1 -- 172.21.15.46:0/2766807222 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560b31608390 msgr2=0x560b319d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:34.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.576+0000 7efbfd422640 1 --2- 172.21.15.46:0/2766807222 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560b31608390 0x560b319d0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.576+0000 7efbfd422640 1 -- 172.21.15.46:0/2766807222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b31694650 con 0x560b31629070 2024-09-21T04:00:34.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.576+0000 7efbeffff640 1 --2- 172.21.15.46:0/2766807222 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560b31608390 0x560b319d0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:00:34.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.576+0000 7efbedffb640 1 --2- 172.21.15.46:0/895974167 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7efbe00b66b0 0x7efbe00b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:34.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.576+0000 7efbfd422640 1 --2- 172.21.15.46:0/2766807222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560b31629070 0x560b319d0270 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7efbf002f500 tx=0x7efbf0009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58261151f5df58b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:34.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.576+0000 7efbfcc21640 1 --2- 172.21.15.46:0/895974167 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7efbe00b66b0 0x7efbe00b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:34.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.576+0000 7efbedffb640 1 -- 172.21.15.46:0/895974167 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7efbe80e7760 con 0x7efbf81083d0 2024-09-21T04:00:34.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.576+0000 7efbdeffd640 1 -- 172.21.15.46:0/2766807222 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf0031450 con 0x560b31629070 2024-09-21T04:00:34.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.576+0000 7efbdeffd640 1 -- 172.21.15.46:0/2766807222 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efbf0036070 con 0x560b31629070 2024-09-21T04:00:34.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.576+0000 7efbdeffd640 1 -- 172.21.15.46:0/2766807222 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf00043c0 con 0x560b31629070 2024-09-21T04:00:34.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.577+0000 7efc053f9740 1 -- 172.21.15.46:0/2766807222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560b31629070 msgr2=0x560b319d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:34.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.577+0000 7efc053f9740 1 --2- 172.21.15.46:0/2766807222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560b31629070 0x560b319d0270 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7efbf002f500 tx=0x7efbf0009a20 comp rx=0 tx=0).stop 2024-09-21T04:00:34.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.577+0000 7efbfcc21640 1 --2- 172.21.15.46:0/895974167 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7efbe00b66b0 0x7efbe00b8bc0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x560b319ceef0 tx=0x7efbf400b470 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:34.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.577+0000 7efc053f9740 1 -- 172.21.15.46:0/2766807222 shutdown_connections 2024-09-21T04:00:34.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.577+0000 7efc053f9740 1 --2- 172.21.15.46:0/2766807222 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560b31608390 0x560b319d0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.577+0000 7efc053f9740 1 --2- 172.21.15.46:0/2766807222 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b316001b0 0x560b319d07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.577+0000 7efc053f9740 1 --2- 172.21.15.46:0/2766807222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560b31629070 0x560b319d0270 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.577+0000 7efc053f9740 1 -- 172.21.15.46:0/2766807222 >> 172.21.15.46:0/2766807222 conn(0x560b3161d460 msgr2=0x560b319ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:34.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.577+0000 7efc053f9740 1 -- 172.21.15.46:0/2766807222 shutdown_connections 2024-09-21T04:00:34.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.577+0000 7efc053f9740 1 -- 172.21.15.46:0/2766807222 wait complete. 2024-09-21T04:00:34.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.578+0000 7efc053f9740 1 -- start start 2024-09-21T04:00:34.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.578+0000 7efc053f9740 1 Processor -- start 2024-09-21T04:00:34.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.578+0000 7efc053f9740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560b316001b0 0x560b319db910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:34.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.578+0000 7efc053f9740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560b31608390 0x560b319dbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:34.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.578+0000 7efc053f9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b31629070 0x560b319e7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:34.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.578+0000 7efc053f9740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x560b31797700 con 0x560b31608390 2024-09-21T04:00:34.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.578+0000 7efc053f9740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x560b318d1110 con 0x560b316001b0 2024-09-21T04:00:34.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.578+0000 7efc053f9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560b319de9f0 con 0x560b31629070 2024-09-21T04:00:34.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.578+0000 7efc053f9740 10 client.0 _ll_register_callbacks cb 0x560b318ea990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:00:34.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.578+0000 7efbeffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560b31608390 0x560b319dbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:34.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.578+0000 7efbeffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560b31608390 0x560b319dbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53902/0 (socket says 172.21.15.46:53902) 2024-09-21T04:00:34.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.578+0000 7efbeffff640 1 -- 172.21.15.46:0/877104351 learned_addr learned my addr 172.21.15.46:0/877104351 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:34.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.578+0000 7efbfd422640 1 --2- 172.21.15.46:0/877104351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b31629070 0x560b319e7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:34.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.579+0000 7efbfcc21640 1 --2- 172.21.15.46:0/877104351 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560b316001b0 0x560b319db910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:34.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.579+0000 7efbeffff640 1 -- 172.21.15.46:0/877104351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b31629070 msgr2=0x560b319e7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:34.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.579+0000 7efbeffff640 1 --2- 172.21.15.46:0/877104351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b31629070 0x560b319e7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.579+0000 7efbeffff640 1 -- 172.21.15.46:0/877104351 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560b316001b0 msgr2=0x560b319db910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:34.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.579+0000 7efbeffff640 1 --2- 172.21.15.46:0/877104351 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560b316001b0 0x560b319db910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.579+0000 7efbeffff640 1 -- 172.21.15.46:0/877104351 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b318fec40 con 0x560b31608390 2024-09-21T04:00:34.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.579+0000 7efbfcc21640 1 --2- 172.21.15.46:0/877104351 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560b316001b0 0x560b319db910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:00:34.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.579+0000 7efbeffff640 1 --2- 172.21.15.46:0/877104351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560b31608390 0x560b319dbe50 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7efbe80058c0 tx=0x7efbe80b6fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b313ca1ce432cd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:34.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.579+0000 7efbd7fff640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:00:34.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.579+0000 7efbd7fff640 1 -- 172.21.15.46:0/877104351 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbe80acfa0 con 0x560b31608390 2024-09-21T04:00:34.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.579+0000 7efbd7fff640 1 -- 172.21.15.46:0/877104351 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7efbe800f450 con 0x560b31608390 2024-09-21T04:00:34.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.579+0000 7efc053f9740 1 -- 172.21.15.46:0/877104351 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efbf0036070 con 0x560b31608390 2024-09-21T04:00:34.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.579+0000 7efbd7fff640 1 -- 172.21.15.46:0/877104351 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7efbe80acdc0 con 0x560b31608390 2024-09-21T04:00:34.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.579+0000 7efc053f9740 10 client.16251 fetch_fsmap learned FSMap version 20 2024-09-21T04:00:34.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.579+0000 7efc053f9740 1 -- 172.21.15.46:0/877104351 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560b319ea650 con 0x560b31608390 2024-09-21T04:00:34.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.579+0000 7efbd7fff640 1 -- 172.21.15.46:0/877104351 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efbf0036070 con 0x560b31608390 2024-09-21T04:00:34.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.580+0000 7efbd7fff640 1 -- 172.21.15.46:0/877104351 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7efbe8020030 con 0x560b31608390 2024-09-21T04:00:34.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.580+0000 7efc053f9740 10 client.16251 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:00:34.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.580+0000 7efc053f9740 10 client.16251 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:00:34.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.580+0000 7efc053f9740 20 client.16251 populate_metadata read hostname 'smithi046' 2024-09-21T04:00:34.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.580+0000 7efc053f9740 1 --2- 172.21.15.46:0/877104351 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560b315e79f0 0x560b319edb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:34.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.580+0000 7efc053f9740 4 client.16251 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:00:34.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.580+0000 7efc053f9740 1 -- 172.21.15.46:0/877104351 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b31948da0 con 0x560b315e79f0 2024-09-21T04:00:34.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.580+0000 7efbfcc21640 1 --2- 172.21.15.46:0/877104351 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560b315e79f0 0x560b319edb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:34.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.581+0000 7efbd7fff640 10 client.16251 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:00:34.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.581+0000 7efbfcc21640 1 --2- 172.21.15.46:0/877104351 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560b315e79f0 0x560b319edb70 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26c6828a4a2f04f6 server_cookie=13fb01ac386a1783 in_seq=0 out_seq=0 2024-09-21T04:00:34.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.581+0000 7efbd7fff640 1 -- 172.21.15.46:0/877104351 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560b31948da0 con 0x560b315e79f0 2024-09-21T04:00:34.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.581+0000 7efbd7fff640 10 client.16251 handle_command_reply: tid=0 2024-09-21T04:00:34.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.581+0000 7efc053f9740 1 client.16251 shutdown 2024-09-21T04:00:34.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.582+0000 7efc053f9740 1 -- 172.21.15.46:0/877104351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560b31608390 msgr2=0x560b319dbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:34.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.582+0000 7efc053f9740 1 --2- 172.21.15.46:0/877104351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560b31608390 0x560b319dbe50 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7efbe80058c0 tx=0x7efbe80b6fa0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.582+0000 7efc053f9740 1 -- 172.21.15.46:0/877104351 shutdown_connections 2024-09-21T04:00:34.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.582+0000 7efc053f9740 1 --2- 172.21.15.46:0/877104351 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560b315e79f0 0x560b319edb70 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.582+0000 7efc053f9740 1 --2- 172.21.15.46:0/877104351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b31629070 0x560b319e7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.582+0000 7efc053f9740 1 --2- 172.21.15.46:0/877104351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560b31608390 0x560b319dbe50 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.582+0000 7efbd7fff640 0 client.16251 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:00:34.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.582+0000 7efc053f9740 1 --2- 172.21.15.46:0/877104351 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560b316001b0 0x560b319db910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.582+0000 7efc053f9740 1 -- 172.21.15.46:0/877104351 >> 172.21.15.46:0/877104351 conn(0x560b3161d460 msgr2=0x560b319d3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:34.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.582+0000 7efc053f9740 1 -- 172.21.15.46:0/877104351 shutdown_connections 2024-09-21T04:00:34.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.582+0000 7efc053f9740 1 -- 172.21.15.46:0/877104351 wait complete. 2024-09-21T04:00:34.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.582+0000 7efc053f9740 20 client.16251 trim_cache size 0 max 16384 2024-09-21T04:00:34.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.599+0000 7efc053f9740 1 Processor -- start 2024-09-21T04:00:34.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.600+0000 7efc053f9740 1 -- start start 2024-09-21T04:00:34.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.600+0000 7efc053f9740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560b316001b0 0x560b319dd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:34.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.600+0000 7efc053f9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b31608390 0x560b319e7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:34.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.600+0000 7efc053f9740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560b31629070 0x560b319d8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:34.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.600+0000 7efc053f9740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7efbf81ad320 con 0x560b31629070 2024-09-21T04:00:34.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.600+0000 7efc053f9740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efbf81afbc0 con 0x560b316001b0 2024-09-21T04:00:34.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.600+0000 7efc053f9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efbf81ad9b0 con 0x560b31608390 2024-09-21T04:00:34.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.600+0000 7efbfd422640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560b31629070 0x560b319d8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:34.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.600+0000 7efbfd422640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560b31629070 0x560b319d8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53918/0 (socket says 172.21.15.46:53918) 2024-09-21T04:00:34.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.600+0000 7efbfd422640 1 -- 172.21.15.46:0/386476823 learned_addr learned my addr 172.21.15.46:0/386476823 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:34.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.600+0000 7efbeffff640 1 --2- 172.21.15.46:0/386476823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b31608390 0x560b319e7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:34.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.600+0000 7efbfcc21640 1 --2- 172.21.15.46:0/386476823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560b316001b0 0x560b319dd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:34.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.600+0000 7efbfd422640 1 -- 172.21.15.46:0/386476823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b31608390 msgr2=0x560b319e7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:34.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.600+0000 7efbfd422640 1 --2- 172.21.15.46:0/386476823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b31608390 0x560b319e7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.600+0000 7efbfd422640 1 -- 172.21.15.46:0/386476823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560b316001b0 msgr2=0x560b319dd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:34.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.600+0000 7efbfd422640 1 --2- 172.21.15.46:0/386476823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560b316001b0 0x560b319dd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.600+0000 7efbfd422640 1 -- 172.21.15.46:0/386476823 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b319dcbd0 con 0x560b31629070 2024-09-21T04:00:34.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.600+0000 7efbfcc21640 1 --2- 172.21.15.46:0/386476823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560b316001b0 0x560b319dd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:00:34.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.600+0000 7efbeffff640 1 --2- 172.21.15.46:0/386476823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b31608390 0x560b319e7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:00:34.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.601+0000 7efbfd422640 1 --2- 172.21.15.46:0/386476823 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560b31629070 0x560b319d8b00 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7efbf0003f00 tx=0x7efbf0003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c2017050d1b676 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:34.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.601+0000 7efbde7fc640 1 -- 172.21.15.46:0/386476823 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf0003970 con 0x560b31629070 2024-09-21T04:00:34.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.601+0000 7efbde7fc640 1 -- 172.21.15.46:0/386476823 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efbf0036070 con 0x560b31629070 2024-09-21T04:00:34.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.601+0000 7efbde7fc640 1 -- 172.21.15.46:0/386476823 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf00046c0 con 0x560b31629070 2024-09-21T04:00:34.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.602+0000 7efc053f9740 1 -- 172.21.15.46:0/386476823 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560b31629070 msgr2=0x560b319d8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:34.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.602+0000 7efc053f9740 1 --2- 172.21.15.46:0/386476823 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560b31629070 0x560b319d8b00 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7efbf0003f00 tx=0x7efbf0003f30 comp rx=0 tx=0).stop 2024-09-21T04:00:34.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.602+0000 7efc053f9740 1 -- 172.21.15.46:0/386476823 shutdown_connections 2024-09-21T04:00:34.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.602+0000 7efc053f9740 1 --2- 172.21.15.46:0/386476823 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560b31629070 0x560b319d8b00 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.602+0000 7efc053f9740 1 --2- 172.21.15.46:0/386476823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b31608390 0x560b319e7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.602+0000 7efc053f9740 1 --2- 172.21.15.46:0/386476823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560b316001b0 0x560b319dd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.602+0000 7efc053f9740 1 -- 172.21.15.46:0/386476823 >> 172.21.15.46:0/386476823 conn(0x560b3161d460 msgr2=0x560b319d5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:34.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.602+0000 7efc053f9740 1 -- 172.21.15.46:0/386476823 shutdown_connections 2024-09-21T04:00:34.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.602+0000 7efc053f9740 1 -- 172.21.15.46:0/386476823 wait complete. 2024-09-21T04:00:34.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.602+0000 7efc053f9740 1 -- start start 2024-09-21T04:00:34.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.602+0000 7efc053f9740 1 Processor -- start 2024-09-21T04:00:34.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.603+0000 7efc053f9740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560b316001b0 0x560b319e4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:34.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.603+0000 7efc053f9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b31608390 0x560b319e0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:34.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.603+0000 7efc053f9740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560b31629070 0x560b319e0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:34.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.603+0000 7efc053f9740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7efbf81ae080 con 0x560b316001b0 2024-09-21T04:00:34.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.603+0000 7efc053f9740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efbf81af4f0 con 0x560b31629070 2024-09-21T04:00:34.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.603+0000 7efc053f9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efbf81ae750 con 0x560b31608390 2024-09-21T04:00:34.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.603+0000 7efc053f9740 10 client.0 _ll_register_callbacks cb 0x7efbe800c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:00:34.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.603+0000 7efbfcc21640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560b316001b0 0x560b319e4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:34.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.603+0000 7efbfcc21640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560b316001b0 0x560b319e4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53922/0 (socket says 172.21.15.46:53922) 2024-09-21T04:00:34.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.603+0000 7efbfcc21640 1 -- 172.21.15.46:0/3289002620 learned_addr learned my addr 172.21.15.46:0/3289002620 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:34.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.603+0000 7efbeffff640 1 --2- 172.21.15.46:0/3289002620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b31608390 0x560b319e0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:34.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.603+0000 7efbfd422640 1 --2- 172.21.15.46:0/3289002620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560b31629070 0x560b319e0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:34.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.603+0000 7efbfcc21640 1 -- 172.21.15.46:0/3289002620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b31608390 msgr2=0x560b319e0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:34.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.603+0000 7efbfcc21640 1 --2- 172.21.15.46:0/3289002620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b31608390 0x560b319e0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.603+0000 7efbfcc21640 1 -- 172.21.15.46:0/3289002620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560b31629070 msgr2=0x560b319e0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:34.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.603+0000 7efbfcc21640 1 --2- 172.21.15.46:0/3289002620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560b31629070 0x560b319e0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.603+0000 7efbfcc21640 1 -- 172.21.15.46:0/3289002620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b319e14b0 con 0x560b316001b0 2024-09-21T04:00:34.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.603+0000 7efbfcc21640 1 --2- 172.21.15.46:0/3289002620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560b316001b0 0x560b319e4370 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7efbf401d530 tx=0x7efbf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ffdab840e30df4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:34.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.603+0000 7efbd7fff640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:00:34.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.604+0000 7efbd7fff640 1 -- 172.21.15.46:0/3289002620 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf401b810 con 0x560b316001b0 2024-09-21T04:00:34.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.604+0000 7efbd7fff640 1 -- 172.21.15.46:0/3289002620 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7efbf401b9b0 con 0x560b316001b0 2024-09-21T04:00:34.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.604+0000 7efc053f9740 1 -- 172.21.15.46:0/3289002620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efbf0036070 con 0x560b316001b0 2024-09-21T04:00:34.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.604+0000 7efbd7fff640 1 -- 172.21.15.46:0/3289002620 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7efbf4034020 con 0x560b316001b0 2024-09-21T04:00:34.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.604+0000 7efc053f9740 10 client.16257 fetch_fsmap learned FSMap version 20 2024-09-21T04:00:34.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.604+0000 7efc053f9740 1 -- 172.21.15.46:0/3289002620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560b31a59470 con 0x560b316001b0 2024-09-21T04:00:34.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.604+0000 7efbd7fff640 1 -- 172.21.15.46:0/3289002620 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efbf0036070 con 0x560b316001b0 2024-09-21T04:00:34.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.604+0000 7efbd7fff640 1 -- 172.21.15.46:0/3289002620 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7efbf4039c50 con 0x560b316001b0 2024-09-21T04:00:34.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.604+0000 7efc053f9740 10 client.16257 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:00:34.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.604+0000 7efc053f9740 10 client.16257 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:00:34.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.604+0000 7efc053f9740 20 client.16257 populate_metadata read hostname 'smithi046' 2024-09-21T04:00:34.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.604+0000 7efc053f9740 1 --2- 172.21.15.46:0/3289002620 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560b315bcda0 0x560b31a5bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:34.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.604+0000 7efc053f9740 4 client.16257 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T04:00:34.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.604+0000 7efc053f9740 1 -- 172.21.15.46:0/3289002620 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560b31944850 con 0x560b315bcda0 2024-09-21T04:00:34.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.605+0000 7efbeffff640 1 --2- 172.21.15.46:0/3289002620 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560b315bcda0 0x560b31a5bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:34.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.605+0000 7efbd7fff640 10 client.16257 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:00:34.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.605+0000 7efbeffff640 1 --2- 172.21.15.46:0/3289002620 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560b315bcda0 0x560b31a5bbc0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38e21e1526c2705d server_cookie=f6a894b710d8710b in_seq=0 out_seq=0 2024-09-21T04:00:34.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.605+0000 7efbd7fff640 1 -- 172.21.15.46:0/3289002620 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3214 (crc 0 0 0) 0x560b31944850 con 0x560b315bcda0 2024-09-21T04:00:34.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.605+0000 7efbd7fff640 10 client.16257 handle_command_reply: tid=0 2024-09-21T04:00:34.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.605+0000 7efc053f9740 1 client.16257 shutdown 2024-09-21T04:00:34.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.605+0000 7efc053f9740 1 -- 172.21.15.46:0/3289002620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560b316001b0 msgr2=0x560b319e4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:34.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.605+0000 7efc053f9740 1 --2- 172.21.15.46:0/3289002620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560b316001b0 0x560b319e4370 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7efbf401d530 tx=0x7efbf40046c0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.605+0000 7efc053f9740 1 -- 172.21.15.46:0/3289002620 shutdown_connections 2024-09-21T04:00:34.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.605+0000 7efc053f9740 1 --2- 172.21.15.46:0/3289002620 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560b315bcda0 0x560b31a5bbc0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.605+0000 7efc053f9740 1 --2- 172.21.15.46:0/3289002620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560b31629070 0x560b319e0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.605+0000 7efc053f9740 1 --2- 172.21.15.46:0/3289002620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b31608390 0x560b319e0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.605+0000 7efbd7fff640 0 client.16257 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:00:34.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.605+0000 7efc053f9740 1 --2- 172.21.15.46:0/3289002620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560b316001b0 0x560b319e4370 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.606+0000 7efc053f9740 1 -- 172.21.15.46:0/3289002620 >> 172.21.15.46:0/3289002620 conn(0x560b3161d460 msgr2=0x560b319e6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:34.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.606+0000 7efc053f9740 1 -- 172.21.15.46:0/3289002620 shutdown_connections 2024-09-21T04:00:34.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.606+0000 7efc053f9740 1 -- 172.21.15.46:0/3289002620 wait complete. 2024-09-21T04:00:34.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.606+0000 7efc053f9740 20 client.16257 trim_cache size 0 max 16384 2024-09-21T04:00:34.613 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T04:00:34.614 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "no active scrubs running", 2024-09-21T04:00:34.614 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": {}, 2024-09-21T04:00:34.614 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_stats": { 2024-09-21T04:00:34.614 INFO:teuthology.orchestra.run.smithi046.stdout: "0d781b95-cf5e-46f2-9875-2923181385e2": { 2024-09-21T04:00:34.614 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:00:33.099094+0000", 2024-09-21T04:00:34.614 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:00:34.614 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:00:34.614 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:00:34.614 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:00:34.614 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:00:34.614 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:00:34.614 INFO:teuthology.orchestra.run.smithi046.stdout: "326aaecf-f38a-4946-988a-d83f25556995": { 2024-09-21T04:00:34.614 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:54.189884+0000", 2024-09-21T04:00:34.615 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:00:34.615 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:00:34.615 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:00:34.615 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:00:34.615 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:00:34.615 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:00:34.615 INFO:teuthology.orchestra.run.smithi046.stdout: "46bb5415-6e16-47c6-a1e4-55f9c623ce90": { 2024-09-21T04:00:34.615 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:14.950674+0000", 2024-09-21T04:00:34.615 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:00:34.615 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:00:34.615 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:00:34.615 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:00:34.616 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:00:34.616 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:00:34.616 INFO:teuthology.orchestra.run.smithi046.stdout: "6103c660-8e77-4b06-ad6c-bb322c26035a": { 2024-09-21T04:00:34.616 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:35.594467+0000", 2024-09-21T04:00:34.616 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:00:34.616 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:00:34.616 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:00:34.616 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:00:34.616 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:00:34.616 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:00:34.616 INFO:teuthology.orchestra.run.smithi046.stdout: "dab67652-8894-4711-be64-cbdfea27a9ba": { 2024-09-21T04:00:34.616 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:28.161616+0000", 2024-09-21T04:00:34.616 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:00:34.616 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:00:34.616 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:00:34.617 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:00:34.617 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:00:34.617 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:00:34.617 INFO:teuthology.orchestra.run.smithi046.stdout: "c47f458a-de5e-4952-a575-a81261953667": { 2024-09-21T04:00:34.617 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:48.699411+0000", 2024-09-21T04:00:34.617 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:00:34.617 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:00:34.617 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:00:34.617 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:00:34.617 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:00:34.617 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:00:34.617 INFO:teuthology.orchestra.run.smithi046.stdout: "e24ec8f1-0d13-478f-9c2c-b51798868ffc": { 2024-09-21T04:00:34.617 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:09.736194+0000", 2024-09-21T04:00:34.617 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:00:34.618 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:00:34.618 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:00:34.618 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:00:34.618 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:00:34.618 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:00:34.618 INFO:teuthology.orchestra.run.smithi046.stdout: "a871f724-0198-493c-b03e-b2de78aba243": { 2024-09-21T04:00:34.618 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:56:30.082991+0000", 2024-09-21T04:00:34.618 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:00:34.618 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:00:34.618 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:00:34.618 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:00:34.618 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:00:34.618 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:00:34.618 INFO:teuthology.orchestra.run.smithi046.stdout: "d49f33a7-3d5a-421b-94ba-8b19a4120db1": { 2024-09-21T04:00:34.619 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:50.480786+0000", 2024-09-21T04:00:34.619 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:00:34.619 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:00:34.619 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:00:34.619 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:00:34.619 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:00:34.619 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:00:34.619 INFO:teuthology.orchestra.run.smithi046.stdout: "3bbf7097-70d7-4743-bbce-41465502b35b": { 2024-09-21T04:00:34.619 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:10.661441+0000", 2024-09-21T04:00:34.619 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:00:34.619 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:00:34.619 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:00:34.619 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:00:34.619 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:00:34.619 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:00:34.620 INFO:teuthology.orchestra.run.smithi046.stdout: "08f0c962-df1a-4129-a1a2-b916240d9803": { 2024-09-21T04:00:34.620 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:02.937596+0000", 2024-09-21T04:00:34.620 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:00:34.620 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:00:34.620 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:00:34.620 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:00:34.620 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:00:34.621 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:00:34.621 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:00:34.621 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T04:00:34.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.606+0000 7efbfee85640 1 -- 172.21.15.46:0/895974167 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7efbe00b66b0 msgr2=0x7efbe00b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:34.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.606+0000 7efbfee85640 1 --2- 172.21.15.46:0/895974167 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7efbe00b66b0 0x7efbe00b8bc0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x560b319ceef0 tx=0x7efbf400b470 comp rx=0 tx=0).stop 2024-09-21T04:00:34.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.606+0000 7efbfee85640 1 -- 172.21.15.46:0/895974167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efbf81083d0 msgr2=0x7efbf819b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:34.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.606+0000 7efbfee85640 1 --2- 172.21.15.46:0/895974167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efbf81083d0 0x7efbf819b7a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7efbe800c970 tx=0x7efbe800ce30 comp rx=0 tx=0).stop 2024-09-21T04:00:34.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.606+0000 7efbfee85640 1 -- 172.21.15.46:0/895974167 shutdown_connections 2024-09-21T04:00:34.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.606+0000 7efbfee85640 1 --2- 172.21.15.46:0/895974167 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efbf8108d20 0x7efbf819bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.606+0000 7efbfee85640 1 --2- 172.21.15.46:0/895974167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efbf81083d0 0x7efbf819b7a0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.606+0000 7efbfee85640 1 --2- 172.21.15.46:0/895974167 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7efbe00b66b0 0x7efbe00b8bc0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.606+0000 7efbfee85640 1 --2- 172.21.15.46:0/895974167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efbf8102ae0 0x7efbf819b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.606+0000 7efbfee85640 1 -- 172.21.15.46:0/895974167 >> 172.21.15.46:0/895974167 conn(0x7efbf8079760 msgr2=0x7efbf8104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:34.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.607+0000 7efbfee85640 1 -- 172.21.15.46:0/895974167 shutdown_connections 2024-09-21T04:00:34.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:34.607+0000 7efbfee85640 1 -- 172.21.15.46:0/895974167 wait complete. 2024-09-21T04:00:35.350 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T04:00:35.351 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:00:35.612 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:36.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:35 smithi046 ceph-mon[30954]: pgmap v486: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:00:36.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:35 smithi105 ceph-mon[34773]: pgmap v486: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:00:36.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.102+0000 7f46a6964640 1 -- 172.21.15.46:0/2940708326 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46a0102ae0 msgr2=0x7f46a0102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:36.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.102+0000 7f46a6964640 1 --2- 172.21.15.46:0/2940708326 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46a0102ae0 0x7f46a0102ef0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f4690009900 tx=0x7f469002a410 comp rx=0 tx=0).stop 2024-09-21T04:00:36.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.102+0000 7f46a6964640 1 -- 172.21.15.46:0/2940708326 shutdown_connections 2024-09-21T04:00:36.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.102+0000 7f46a6964640 1 --2- 172.21.15.46:0/2940708326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46a0108d20 0x7f46a010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:36.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.102+0000 7f46a6964640 1 --2- 172.21.15.46:0/2940708326 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46a01083d0 0x7f46a01087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:36.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.102+0000 7f46a6964640 1 --2- 172.21.15.46:0/2940708326 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46a0102ae0 0x7f46a0102ef0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:36.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.102+0000 7f46a6964640 1 -- 172.21.15.46:0/2940708326 >> 172.21.15.46:0/2940708326 conn(0x7f46a0079760 msgr2=0x7f46a0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:36.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.102+0000 7f46a6964640 1 -- 172.21.15.46:0/2940708326 shutdown_connections 2024-09-21T04:00:36.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.102+0000 7f46a6964640 1 -- 172.21.15.46:0/2940708326 wait complete. 2024-09-21T04:00:36.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.103+0000 7f46a6964640 1 Processor -- start 2024-09-21T04:00:36.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.103+0000 7f46a6964640 1 -- start start 2024-09-21T04:00:36.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.103+0000 7f46a6964640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46a0102ae0 0x7f46a019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:36.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.103+0000 7f46a6964640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46a01083d0 0x7f46a019aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:36.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.103+0000 7f46a6964640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46a0108d20 0x7f46a019fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:36.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.103+0000 7f46a6964640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f46a0112990 con 0x7f46a0108d20 2024-09-21T04:00:36.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.103+0000 7f46a6964640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f46a0112810 con 0x7f46a01083d0 2024-09-21T04:00:36.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.103+0000 7f46a6964640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f46a0112b10 con 0x7f46a0102ae0 2024-09-21T04:00:36.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.103+0000 7f46a4f01640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46a0108d20 0x7f46a019fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:36.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.103+0000 7f46a4f01640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46a0108d20 0x7f46a019fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53930/0 (socket says 172.21.15.46:53930) 2024-09-21T04:00:36.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.103+0000 7f46a4f01640 1 -- 172.21.15.46:0/3897182415 learned_addr learned my addr 172.21.15.46:0/3897182415 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:36.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.104+0000 7f469ffff640 1 --2- 172.21.15.46:0/3897182415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46a0102ae0 0x7f46a019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:36.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.104+0000 7f469f7fe640 1 --2- 172.21.15.46:0/3897182415 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46a01083d0 0x7f46a019aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:36.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.104+0000 7f46a4f01640 1 -- 172.21.15.46:0/3897182415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46a0102ae0 msgr2=0x7f46a019a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:36.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.104+0000 7f46a4f01640 1 --2- 172.21.15.46:0/3897182415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46a0102ae0 0x7f46a019a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:36.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.104+0000 7f46a4f01640 1 -- 172.21.15.46:0/3897182415 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46a01083d0 msgr2=0x7f46a019aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:36.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.104+0000 7f46a4f01640 1 --2- 172.21.15.46:0/3897182415 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46a01083d0 0x7f46a019aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:36.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.104+0000 7f46a4f01640 1 -- 172.21.15.46:0/3897182415 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a01a0340 con 0x7f46a0108d20 2024-09-21T04:00:36.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.104+0000 7f46a4f01640 1 --2- 172.21.15.46:0/3897182415 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46a0108d20 0x7f46a019fcd0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f469800cad0 tx=0x7f469800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:36.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.104+0000 7f469d7fa640 1 -- 172.21.15.46:0/3897182415 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469800ad60 con 0x7f46a0108d20 2024-09-21T04:00:36.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.104+0000 7f469d7fa640 1 -- 172.21.15.46:0/3897182415 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4698005020 con 0x7f46a0108d20 2024-09-21T04:00:36.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.104+0000 7f46a6964640 1 -- 172.21.15.46:0/3897182415 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46a01a0630 con 0x7f46a0108d20 2024-09-21T04:00:36.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.104+0000 7f469d7fa640 1 -- 172.21.15.46:0/3897182415 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469800f6b0 con 0x7f46a0108d20 2024-09-21T04:00:36.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.104+0000 7f46a6964640 1 -- 172.21.15.46:0/3897182415 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46a01a6e50 con 0x7f46a0108d20 2024-09-21T04:00:36.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.106+0000 7f46a6964640 1 -- 172.21.15.46:0/3897182415 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46a0102ef0 con 0x7f46a0108d20 2024-09-21T04:00:36.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.107+0000 7f469d7fa640 1 -- 172.21.15.46:0/3897182415 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f46980051d0 con 0x7f46a0108d20 2024-09-21T04:00:36.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.108+0000 7f469d7fa640 1 --2- 172.21.15.46:0/3897182415 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f46880b6730 0x7f46880b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:36.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.108+0000 7f469ffff640 1 --2- 172.21.15.46:0/3897182415 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f46880b6730 0x7f46880b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:36.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.108+0000 7f469d7fa640 1 -- 172.21.15.46:0/3897182415 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f46980e78f0 con 0x7f46a0108d20 2024-09-21T04:00:36.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.108+0000 7f469ffff640 1 --2- 172.21.15.46:0/3897182415 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f46880b6730 0x7f46880b8c40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4690031440 tx=0x7f4690005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:36.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.111+0000 7f469d7fa640 1 -- 172.21.15.46:0/3897182415 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4698014030 con 0x7f46a0108d20 2024-09-21T04:00:36.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:35 smithi162 ceph-mon[35071]: pgmap v486: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:00:36.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.344+0000 7f46a6964640 1 -- 172.21.15.46:0/3897182415 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f46a019b5c0 con 0x7f46a0108d20 2024-09-21T04:00:36.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.345+0000 7f469d7fa640 1 -- 172.21.15.46:0/3897182415 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f46a019b5c0 con 0x7f46a0108d20 2024-09-21T04:00:36.348 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T04:00:36.348 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"btime":"2024-09-21T03:53:23:865820+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1766354184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1766354184},{"type":"v1","addr":"172.21.15.46:6839","nonce":1766354184}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/1901774207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":1901774207},{"type":"v1","addr":"172.21.15.46:6841","nonce":1901774207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3548633196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":3548633196},{"type":"v1","addr":"172.21.15.105:6837","nonce":3548633196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24652,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3551934241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3551934241},{"type":"v1","addr":"172.21.15.162:6835","nonce":3551934241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/48949822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":48949822},{"type":"v1","addr":"172.21.15.162:6837","nonce":48949822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:53:14.452819+0000","modified":"2024-09-21T03:53:23.593278+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24680},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/2196053213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2196053213},{"type":"v1","addr":"172.21.15.162:6839","nonce":2196053213}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.105:6839/3911438406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":3911438406},{"type":"v1","addr":"172.21.15.105:6839","nonce":3911438406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24680,"qdb_cluster":[24680]},"id":1}]} 2024-09-21T04:00:36.349 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T04:00:36.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.348+0000 7f46a6964640 1 -- 172.21.15.46:0/3897182415 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f46880b6730 msgr2=0x7f46880b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:36.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.348+0000 7f46a6964640 1 --2- 172.21.15.46:0/3897182415 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f46880b6730 0x7f46880b8c40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4690031440 tx=0x7f4690005e80 comp rx=0 tx=0).stop 2024-09-21T04:00:36.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.348+0000 7f46a6964640 1 -- 172.21.15.46:0/3897182415 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46a0108d20 msgr2=0x7f46a019fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:36.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.348+0000 7f46a6964640 1 --2- 172.21.15.46:0/3897182415 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46a0108d20 0x7f46a019fcd0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f469800cad0 tx=0x7f469800ced0 comp rx=0 tx=0).stop 2024-09-21T04:00:36.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.348+0000 7f46a6964640 1 -- 172.21.15.46:0/3897182415 shutdown_connections 2024-09-21T04:00:36.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.348+0000 7f46a6964640 1 --2- 172.21.15.46:0/3897182415 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46a0108d20 0x7f46a019fcd0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:36.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.348+0000 7f46a6964640 1 --2- 172.21.15.46:0/3897182415 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46a01083d0 0x7f46a019aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:36.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.348+0000 7f46a6964640 1 --2- 172.21.15.46:0/3897182415 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f46880b6730 0x7f46880b8c40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:36.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.348+0000 7f46a6964640 1 --2- 172.21.15.46:0/3897182415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46a0102ae0 0x7f46a019a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:36.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.348+0000 7f46a6964640 1 -- 172.21.15.46:0/3897182415 >> 172.21.15.46:0/3897182415 conn(0x7f46a0079760 msgr2=0x7f46a01066a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:36.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.348+0000 7f46a6964640 1 -- 172.21.15.46:0/3897182415 shutdown_connections 2024-09-21T04:00:36.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:36.348+0000 7f46a6964640 1 -- 172.21.15.46:0/3897182415 wait complete. 2024-09-21T04:00:36.904 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:36 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3897182415' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:00:36.906 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T04:00:37.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:36 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3897182415' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:00:37.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:36 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3897182415' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:00:37.162 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:37.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.657+0000 7f559b59e640 1 -- 172.21.15.46:0/3591243130 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f559c108b10 msgr2=0x7f559c10f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:37.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.657+0000 7f559b59e640 1 --2- 172.21.15.46:0/3591243130 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f559c108b10 0x7f559c10f340 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f5594009ca0 tx=0x7f559402a8e0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.657+0000 7f559b59e640 1 -- 172.21.15.46:0/3591243130 shutdown_connections 2024-09-21T04:00:37.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.657+0000 7f559b59e640 1 --2- 172.21.15.46:0/3591243130 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f559c108b10 0x7f559c10f340 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.657+0000 7f559b59e640 1 --2- 172.21.15.46:0/3591243130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f559c1081c0 0x7f559c1085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.657+0000 7f559b59e640 1 --2- 172.21.15.46:0/3591243130 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f559c102880 0x7f559c102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.657+0000 7f559b59e640 1 -- 172.21.15.46:0/3591243130 >> 172.21.15.46:0/3591243130 conn(0x7f559c0fe2d0 msgr2=0x7f559c100720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:37.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.657+0000 7f559b59e640 1 -- 172.21.15.46:0/3591243130 shutdown_connections 2024-09-21T04:00:37.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.657+0000 7f559b59e640 1 -- 172.21.15.46:0/3591243130 wait complete. 2024-09-21T04:00:37.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.658+0000 7f559b59e640 1 Processor -- start 2024-09-21T04:00:37.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.658+0000 7f559b59e640 1 -- start start 2024-09-21T04:00:37.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.658+0000 7f559b59e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f559c102880 0x7f559c19b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:37.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.659+0000 7f559b59e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f559c1081c0 0x7f559c19b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:37.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.659+0000 7f559b59e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f559c108b10 0x7f559c19bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:37.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.659+0000 7f559b59e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f559c1128e0 con 0x7f559c108b10 2024-09-21T04:00:37.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.659+0000 7f559b59e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f559c112760 con 0x7f559c102880 2024-09-21T04:00:37.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.659+0000 7f559b59e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f559c112a60 con 0x7f559c1081c0 2024-09-21T04:00:37.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.659+0000 7f559ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f559c108b10 0x7f559c19bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:37.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.659+0000 7f559ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f559c108b10 0x7f559c19bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53952/0 (socket says 172.21.15.46:53952) 2024-09-21T04:00:37.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.659+0000 7f559ad9d640 1 -- 172.21.15.46:0/2271036193 learned_addr learned my addr 172.21.15.46:0/2271036193 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:37.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.659+0000 7f559a59c640 1 --2- 172.21.15.46:0/2271036193 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f559c102880 0x7f559c19b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:37.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.659+0000 7f5599d9b640 1 --2- 172.21.15.46:0/2271036193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f559c1081c0 0x7f559c19b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:37.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.659+0000 7f559ad9d640 1 -- 172.21.15.46:0/2271036193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f559c1081c0 msgr2=0x7f559c19b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:37.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.659+0000 7f559ad9d640 1 --2- 172.21.15.46:0/2271036193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f559c1081c0 0x7f559c19b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.659+0000 7f559ad9d640 1 -- 172.21.15.46:0/2271036193 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f559c102880 msgr2=0x7f559c19b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:37.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.659+0000 7f559ad9d640 1 --2- 172.21.15.46:0/2271036193 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f559c102880 0x7f559c19b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.659+0000 7f559ad9d640 1 -- 172.21.15.46:0/2271036193 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f559c1a6500 con 0x7f559c108b10 2024-09-21T04:00:37.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.659+0000 7f559ad9d640 1 --2- 172.21.15.46:0/2271036193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f559c108b10 0x7f559c19bc70 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f5594003bd0 tx=0x7f5594003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:37.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.659+0000 7f558b7fe640 1 -- 172.21.15.46:0/2271036193 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5594004240 con 0x7f559c108b10 2024-09-21T04:00:37.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.660+0000 7f559b59e640 1 -- 172.21.15.46:0/2271036193 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f559c1a6790 con 0x7f559c108b10 2024-09-21T04:00:37.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.660+0000 7f558b7fe640 1 -- 172.21.15.46:0/2271036193 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5594003e20 con 0x7f559c108b10 2024-09-21T04:00:37.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.660+0000 7f558b7fe640 1 -- 172.21.15.46:0/2271036193 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5594030eb0 con 0x7f559c108b10 2024-09-21T04:00:37.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.660+0000 7f559b59e640 1 -- 172.21.15.46:0/2271036193 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f559c1a6cd0 con 0x7f559c108b10 2024-09-21T04:00:37.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.662+0000 7f55a6f74740 1 Processor -- start 2024-09-21T04:00:37.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.662+0000 7f558b7fe640 1 -- 172.21.15.46:0/2271036193 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f55940305e0 con 0x7f559c108b10 2024-09-21T04:00:37.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.662+0000 7f55a6f74740 1 -- start start 2024-09-21T04:00:37.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.663+0000 7f55a6f74740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56302f51e070 0x56302f8c5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:37.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.663+0000 7f55a6f74740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56302f4f51b0 0x56302f8c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:37.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.663+0000 7f55a6f74740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56302f4fd390 0x56302f8c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:37.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.663+0000 7f55a6f74740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x56302f83bea0 con 0x56302f51e070 2024-09-21T04:00:37.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.663+0000 7f55a6f74740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56302f82b2d0 con 0x56302f4f51b0 2024-09-21T04:00:37.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.663+0000 7f55a6f74740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56302f82f0e0 con 0x56302f4fd390 2024-09-21T04:00:37.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.663+0000 7f5599d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56302f51e070 0x56302f8c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:37.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.663+0000 7f5599d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56302f51e070 0x56302f8c5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53964/0 (socket says 172.21.15.46:53964) 2024-09-21T04:00:37.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.663+0000 7f5599d9b640 1 -- 172.21.15.46:0/2180799156 learned_addr learned my addr 172.21.15.46:0/2180799156 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:37.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.663+0000 7f5599d9b640 1 --2- 172.21.15.46:0/2180799156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56302f4fd390 0x56302f8c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:37.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.663+0000 7f559a59c640 1 --2- 172.21.15.46:0/2180799156 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56302f4f51b0 0x56302f8c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:37.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.663+0000 7f558b7fe640 1 --2- 172.21.15.46:0/2271036193 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f55840b6680 0x7f55840b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:37.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.663+0000 7f5599d9b640 1 -- 172.21.15.46:0/2180799156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56302f4fd390 msgr2=0x56302f8c62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:37.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.664+0000 7f5599d9b640 1 --2- 172.21.15.46:0/2180799156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56302f4fd390 0x56302f8c62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.664+0000 7f5599d9b640 1 -- 172.21.15.46:0/2180799156 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56302f4f51b0 msgr2=0x56302f8c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:37.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.664+0000 7f5599d9b640 1 --2- 172.21.15.46:0/2180799156 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56302f4f51b0 0x56302f8c5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.664+0000 7f5599d9b640 1 -- 172.21.15.46:0/2180799156 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56302f589650 con 0x56302f51e070 2024-09-21T04:00:37.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.664+0000 7f559ad9d640 1 --2- 172.21.15.46:0/2271036193 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f55840b6680 0x7f55840b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:37.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.664+0000 7f5599d9b640 1 --2- 172.21.15.46:0/2180799156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56302f51e070 0x56302f8c5860 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f5590006aa0 tx=0x7f559000b1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee6f5f69ea2ecf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:37.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.664+0000 7f558b7fe640 1 -- 172.21.15.46:0/2271036193 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f5594108a20 con 0x7f559c108b10 2024-09-21T04:00:37.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.664+0000 7f5588ff9640 1 -- 172.21.15.46:0/2180799156 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559001d070 con 0x56302f51e070 2024-09-21T04:00:37.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.664+0000 7f5588ff9640 1 -- 172.21.15.46:0/2180799156 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5590010040 con 0x56302f51e070 2024-09-21T04:00:37.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.664+0000 7f5588ff9640 1 -- 172.21.15.46:0/2180799156 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55900188f0 con 0x56302f51e070 2024-09-21T04:00:37.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.665+0000 7f55a6f74740 1 -- 172.21.15.46:0/2180799156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56302f51e070 msgr2=0x56302f8c5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:37.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.665+0000 7f55a6f74740 1 --2- 172.21.15.46:0/2180799156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56302f51e070 0x56302f8c5860 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f5590006aa0 tx=0x7f559000b1a0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.665+0000 7f559ad9d640 1 --2- 172.21.15.46:0/2271036193 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f55840b6680 0x7f55840b8b90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f55940cbb80 tx=0x7f559409b5c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:37.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.665+0000 7f55a6f74740 1 -- 172.21.15.46:0/2180799156 shutdown_connections 2024-09-21T04:00:37.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.665+0000 7f55a6f74740 1 --2- 172.21.15.46:0/2180799156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56302f4fd390 0x56302f8c62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.665+0000 7f55a6f74740 1 --2- 172.21.15.46:0/2180799156 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56302f4f51b0 0x56302f8c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.665+0000 7f55a6f74740 1 --2- 172.21.15.46:0/2180799156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56302f51e070 0x56302f8c5860 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.665+0000 7f55a6f74740 1 -- 172.21.15.46:0/2180799156 >> 172.21.15.46:0/2180799156 conn(0x56302f512460 msgr2=0x56302f8c3750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:37.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.665+0000 7f55a6f74740 1 -- 172.21.15.46:0/2180799156 shutdown_connections 2024-09-21T04:00:37.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.665+0000 7f55a6f74740 1 -- 172.21.15.46:0/2180799156 wait complete. 2024-09-21T04:00:37.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.666+0000 7f55a6f74740 1 -- start start 2024-09-21T04:00:37.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.666+0000 7f55a6f74740 1 Processor -- start 2024-09-21T04:00:37.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.666+0000 7f55a6f74740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56302f4f51b0 0x56302f8d53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:37.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.666+0000 7f55a6f74740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56302f4fd390 0x56302f8d5920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:37.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.666+0000 7f55a6f74740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56302f51e070 0x56302f8e1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:37.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.666+0000 7f55a6f74740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x56302f68c700 con 0x56302f4f51b0 2024-09-21T04:00:37.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.666+0000 7f55a6f74740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56302f7c6160 con 0x56302f51e070 2024-09-21T04:00:37.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.666+0000 7f55a6f74740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56302f8d8340 con 0x56302f4fd390 2024-09-21T04:00:37.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.666+0000 7f55a6f74740 10 client.0 _ll_register_callbacks cb 0x56302f7df9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:00:37.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.666+0000 7f5599d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56302f4f51b0 0x56302f8d53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:37.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.666+0000 7f5599d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56302f4f51b0 0x56302f8d53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53978/0 (socket says 172.21.15.46:53978) 2024-09-21T04:00:37.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.666+0000 7f5599d9b640 1 -- 172.21.15.46:0/1347279243 learned_addr learned my addr 172.21.15.46:0/1347279243 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:37.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.666+0000 7f559a59c640 1 --2- 172.21.15.46:0/1347279243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56302f4fd390 0x56302f8d5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:37.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.667+0000 7f5599d9b640 1 -- 172.21.15.46:0/1347279243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56302f4fd390 msgr2=0x56302f8d5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:37.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.667+0000 7f5599d9b640 1 --2- 172.21.15.46:0/1347279243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56302f4fd390 0x56302f8d5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.667+0000 7f5599d9b640 1 -- 172.21.15.46:0/1347279243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56302f51e070 msgr2=0x56302f8e1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:37.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.667+0000 7f5599d9b640 1 --2- 172.21.15.46:0/1347279243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56302f51e070 0x56302f8e1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.667+0000 7f5599d9b640 1 -- 172.21.15.46:0/1347279243 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56302f7f3c90 con 0x56302f4f51b0 2024-09-21T04:00:37.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.667+0000 7f5599d9b640 1 --2- 172.21.15.46:0/1347279243 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56302f4f51b0 0x56302f8d53e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f559001b040 tx=0x7f5590016ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c1dfe68ba0614b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:37.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.667+0000 7f5581ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:00:37.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.667+0000 7f5581ffb640 1 -- 172.21.15.46:0/1347279243 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559001d040 con 0x56302f4f51b0 2024-09-21T04:00:37.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.667+0000 7f5581ffb640 1 -- 172.21.15.46:0/1347279243 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f55900059c0 con 0x56302f4f51b0 2024-09-21T04:00:37.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.667+0000 7f55a6f74740 1 -- 172.21.15.46:0/1347279243 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5590010040 con 0x56302f4f51b0 2024-09-21T04:00:37.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.667+0000 7f5581ffb640 1 -- 172.21.15.46:0/1347279243 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5590018420 con 0x56302f4f51b0 2024-09-21T04:00:37.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.667+0000 7f55a6f74740 10 client.16275 fetch_fsmap learned FSMap version 20 2024-09-21T04:00:37.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.667+0000 7f55a6f74740 1 -- 172.21.15.46:0/1347279243 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56302f8e4110 con 0x56302f4f51b0 2024-09-21T04:00:37.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.667+0000 7f5581ffb640 1 -- 172.21.15.46:0/1347279243 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5590010040 con 0x56302f4f51b0 2024-09-21T04:00:37.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.668+0000 7f5581ffb640 1 -- 172.21.15.46:0/1347279243 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f5590020070 con 0x56302f4f51b0 2024-09-21T04:00:37.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.668+0000 7f55a6f74740 10 client.16275 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:00:37.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.668+0000 7f55a6f74740 10 client.16275 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:00:37.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.668+0000 7f55a6f74740 20 client.16275 populate_metadata read hostname 'smithi046' 2024-09-21T04:00:37.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.668+0000 7f55a6f74740 1 --2- 172.21.15.46:0/1347279243 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56302f4dc9f0 0x56302f8e74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:37.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.668+0000 7f55a6f74740 4 client.16275 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:00:37.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.668+0000 7f55a6f74740 1 -- 172.21.15.46:0/1347279243 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56302f83ddf0 con 0x56302f4dc9f0 2024-09-21T04:00:37.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.668+0000 7f559a59c640 1 --2- 172.21.15.46:0/1347279243 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56302f4dc9f0 0x56302f8e74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:37.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.668+0000 7f5581ffb640 10 client.16275 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:00:37.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.668+0000 7f559a59c640 1 --2- 172.21.15.46:0/1347279243 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56302f4dc9f0 0x56302f8e74c0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=520be5374dbd034d server_cookie=95f49b6c043f9694 in_seq=0 out_seq=0 2024-09-21T04:00:37.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.669+0000 7f5581ffb640 1 -- 172.21.15.46:0/1347279243 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56302f83ddf0 con 0x56302f4dc9f0 2024-09-21T04:00:37.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.669+0000 7f5581ffb640 10 client.16275 handle_command_reply: tid=0 2024-09-21T04:00:37.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.669+0000 7f55a6f74740 1 client.16275 shutdown 2024-09-21T04:00:37.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.669+0000 7f55a6f74740 1 -- 172.21.15.46:0/1347279243 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56302f4f51b0 msgr2=0x56302f8d53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:37.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.669+0000 7f55a6f74740 1 --2- 172.21.15.46:0/1347279243 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56302f4f51b0 0x56302f8d53e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f559001b040 tx=0x7f5590016ef0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.669+0000 7f55a6f74740 1 -- 172.21.15.46:0/1347279243 shutdown_connections 2024-09-21T04:00:37.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.669+0000 7f55a6f74740 1 --2- 172.21.15.46:0/1347279243 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56302f4dc9f0 0x56302f8e74c0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.669+0000 7f55a6f74740 1 --2- 172.21.15.46:0/1347279243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56302f51e070 0x56302f8e1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.669+0000 7f55a6f74740 1 --2- 172.21.15.46:0/1347279243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56302f4fd390 0x56302f8d5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.669+0000 7f55a6f74740 1 --2- 172.21.15.46:0/1347279243 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56302f4f51b0 0x56302f8d53e0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.669+0000 7f55a6f74740 1 -- 172.21.15.46:0/1347279243 >> 172.21.15.46:0/1347279243 conn(0x56302f512460 msgr2=0x56302f8c1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:37.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.670+0000 7f5581ffb640 0 client.16275 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:00:37.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.670+0000 7f55a6f74740 1 -- 172.21.15.46:0/1347279243 shutdown_connections 2024-09-21T04:00:37.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.670+0000 7f55a6f74740 1 -- 172.21.15.46:0/1347279243 wait complete. 2024-09-21T04:00:37.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.670+0000 7f55a6f74740 20 client.16275 trim_cache size 0 max 16384 2024-09-21T04:00:37.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.683+0000 7f55a6f74740 1 Processor -- start 2024-09-21T04:00:37.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.683+0000 7f55a6f74740 1 -- start start 2024-09-21T04:00:37.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.683+0000 7f55a6f74740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56302f4f51b0 0x56302f8c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:37.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.683+0000 7f55a6f74740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56302f4fd390 0x56302f8d7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:37.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.683+0000 7f55a6f74740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56302f51e070 0x56302f8e1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:37.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.683+0000 7f55a6f74740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f559c1ab210 con 0x56302f4fd390 2024-09-21T04:00:37.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.683+0000 7f55a6f74740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f559c1ada90 con 0x56302f4f51b0 2024-09-21T04:00:37.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.683+0000 7f55a6f74740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f559c1ab880 con 0x56302f51e070 2024-09-21T04:00:37.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.683+0000 7f559a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56302f4fd390 0x56302f8d7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:37.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.683+0000 7f559a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56302f4fd390 0x56302f8d7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53984/0 (socket says 172.21.15.46:53984) 2024-09-21T04:00:37.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.683+0000 7f559a59c640 1 -- 172.21.15.46:0/2634703669 learned_addr learned my addr 172.21.15.46:0/2634703669 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:37.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.683+0000 7f5599d9b640 1 --2- 172.21.15.46:0/2634703669 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56302f4f51b0 0x56302f8c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:37.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.683+0000 7f559a59c640 1 -- 172.21.15.46:0/2634703669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56302f51e070 msgr2=0x56302f8e1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:37.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.683+0000 7f559a59c640 1 --2- 172.21.15.46:0/2634703669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56302f51e070 0x56302f8e1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.683+0000 7f559a59c640 1 -- 172.21.15.46:0/2634703669 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56302f4f51b0 msgr2=0x56302f8c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:37.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.683+0000 7f559a59c640 1 --2- 172.21.15.46:0/2634703669 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56302f4f51b0 0x56302f8c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.683+0000 7f559a59c640 1 -- 172.21.15.46:0/2634703669 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56302f8c8690 con 0x56302f4fd390 2024-09-21T04:00:37.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.684+0000 7f5599d9b640 1 --2- 172.21.15.46:0/2634703669 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56302f4f51b0 0x56302f8c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:00:37.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.684+0000 7f559a59c640 1 --2- 172.21.15.46:0/2634703669 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56302f4fd390 0x56302f8d7010 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f559c06c4c0 tx=0x7f558c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7fec2386d0acdf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:37.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.684+0000 7f5583fff640 1 -- 172.21.15.46:0/2634703669 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558c009d50 con 0x56302f4fd390 2024-09-21T04:00:37.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.684+0000 7f5583fff640 1 -- 172.21.15.46:0/2634703669 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f558c021030 con 0x56302f4fd390 2024-09-21T04:00:37.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.684+0000 7f5583fff640 1 -- 172.21.15.46:0/2634703669 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558c0153c0 con 0x56302f4fd390 2024-09-21T04:00:37.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.685+0000 7f55a6f74740 1 -- 172.21.15.46:0/2634703669 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56302f4fd390 msgr2=0x56302f8d7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:37.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.685+0000 7f55a6f74740 1 --2- 172.21.15.46:0/2634703669 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56302f4fd390 0x56302f8d7010 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f559c06c4c0 tx=0x7f558c008040 comp rx=0 tx=0).stop 2024-09-21T04:00:37.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.685+0000 7f55a6f74740 1 -- 172.21.15.46:0/2634703669 shutdown_connections 2024-09-21T04:00:37.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.685+0000 7f55a6f74740 1 --2- 172.21.15.46:0/2634703669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56302f51e070 0x56302f8e1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.685+0000 7f55a6f74740 1 --2- 172.21.15.46:0/2634703669 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56302f4fd390 0x56302f8d7010 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.685+0000 7f55a6f74740 1 --2- 172.21.15.46:0/2634703669 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56302f4f51b0 0x56302f8c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.685+0000 7f55a6f74740 1 -- 172.21.15.46:0/2634703669 >> 172.21.15.46:0/2634703669 conn(0x56302f512460 msgr2=0x56302f8d6900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:37.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.685+0000 7f55a6f74740 1 -- 172.21.15.46:0/2634703669 shutdown_connections 2024-09-21T04:00:37.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.685+0000 7f55a6f74740 1 -- 172.21.15.46:0/2634703669 wait complete. 2024-09-21T04:00:37.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.685+0000 7f55a6f74740 1 -- start start 2024-09-21T04:00:37.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.685+0000 7f55a6f74740 1 Processor -- start 2024-09-21T04:00:37.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.686+0000 7f55a6f74740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56302f4f51b0 0x56302f8d94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:37.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.686+0000 7f55a6f74740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56302f4fd390 0x56302f8d9a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:37.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.686+0000 7f55a6f74740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56302f51e070 0x56302f8d9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:37.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.686+0000 7f55a6f74740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f559c1abf50 con 0x56302f51e070 2024-09-21T04:00:37.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.686+0000 7f55a6f74740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f559c1ad3c0 con 0x56302f4fd390 2024-09-21T04:00:37.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.686+0000 7f55a6f74740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f559c1ac620 con 0x56302f4f51b0 2024-09-21T04:00:37.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.686+0000 7f55a6f74740 10 client.0 _ll_register_callbacks cb 0x7f559001b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:00:37.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.686+0000 7f5599d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56302f51e070 0x56302f8d9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:37.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.686+0000 7f5599d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56302f51e070 0x56302f8d9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54000/0 (socket says 172.21.15.46:54000) 2024-09-21T04:00:37.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.686+0000 7f5599d9b640 1 -- 172.21.15.46:0/2463438536 learned_addr learned my addr 172.21.15.46:0/2463438536 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:37.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.686+0000 7f5599d9b640 1 --2- 172.21.15.46:0/2463438536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56302f4f51b0 0x56302f8d94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:37.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.686+0000 7f559a59c640 1 --2- 172.21.15.46:0/2463438536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56302f4fd390 0x56302f8d9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:37.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.686+0000 7f5599d9b640 1 -- 172.21.15.46:0/2463438536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56302f4f51b0 msgr2=0x56302f8d94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:37.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.686+0000 7f5599d9b640 1 --2- 172.21.15.46:0/2463438536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56302f4f51b0 0x56302f8d94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.686+0000 7f5599d9b640 1 -- 172.21.15.46:0/2463438536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56302f4fd390 msgr2=0x56302f8d9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:37.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.686+0000 7f5599d9b640 1 --2- 172.21.15.46:0/2463438536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56302f4fd390 0x56302f8d9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.686+0000 7f5599d9b640 1 -- 172.21.15.46:0/2463438536 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56302f950d20 con 0x56302f51e070 2024-09-21T04:00:37.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.686+0000 7f5599d9b640 1 --2- 172.21.15.46:0/2463438536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56302f51e070 0x56302f8d9f70 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f5590001eb0 tx=0x7f55900047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77844f7bc0ed30af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:37.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.686+0000 7f5581ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:00:37.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.686+0000 7f5581ffb640 1 -- 172.21.15.46:0/2463438536 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559001d030 con 0x56302f51e070 2024-09-21T04:00:37.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.687+0000 7f5581ffb640 1 -- 172.21.15.46:0/2463438536 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f5590005bd0 con 0x56302f51e070 2024-09-21T04:00:37.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.687+0000 7f55a6f74740 1 -- 172.21.15.46:0/2463438536 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f558c021030 con 0x56302f51e070 2024-09-21T04:00:37.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.687+0000 7f5581ffb640 1 -- 172.21.15.46:0/2463438536 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f559003e020 con 0x56302f51e070 2024-09-21T04:00:37.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.687+0000 7f55a6f74740 10 client.16281 fetch_fsmap learned FSMap version 20 2024-09-21T04:00:37.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.687+0000 7f55a6f74740 1 -- 172.21.15.46:0/2463438536 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56302f951e50 con 0x56302f51e070 2024-09-21T04:00:37.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.687+0000 7f5581ffb640 1 -- 172.21.15.46:0/2463438536 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f558c021030 con 0x56302f51e070 2024-09-21T04:00:37.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.687+0000 7f5581ffb640 1 -- 172.21.15.46:0/2463438536 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f5590010070 con 0x56302f51e070 2024-09-21T04:00:37.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.687+0000 7f55a6f74740 10 client.16281 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:00:37.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.687+0000 7f55a6f74740 10 client.16281 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:00:37.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.687+0000 7f55a6f74740 20 client.16281 populate_metadata read hostname 'smithi046' 2024-09-21T04:00:37.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.687+0000 7f55a6f74740 1 --2- 172.21.15.46:0/2463438536 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56302f4b1da0 0x56302f954540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:37.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.687+0000 7f55a6f74740 4 client.16281 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T04:00:37.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.687+0000 7f55a6f74740 1 -- 172.21.15.46:0/2463438536 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56302f8398a0 con 0x56302f4b1da0 2024-09-21T04:00:37.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.688+0000 7f559a59c640 1 --2- 172.21.15.46:0/2463438536 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56302f4b1da0 0x56302f954540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:37.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.688+0000 7f559a59c640 1 --2- 172.21.15.46:0/2463438536 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56302f4b1da0 0x56302f954540 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=568d31e7c55b8471 server_cookie=52c9ce4ab2e71c8d in_seq=0 out_seq=0 2024-09-21T04:00:37.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.688+0000 7f5581ffb640 10 client.16281 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:00:37.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.688+0000 7f5581ffb640 1 -- 172.21.15.46:0/2463438536 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56302f8398a0 con 0x56302f4b1da0 2024-09-21T04:00:37.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.688+0000 7f5581ffb640 10 client.16281 handle_command_reply: tid=0 2024-09-21T04:00:37.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.688+0000 7f55a6f74740 1 client.16281 shutdown 2024-09-21T04:00:37.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.688+0000 7f55a6f74740 1 -- 172.21.15.46:0/2463438536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56302f51e070 msgr2=0x56302f8d9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:37.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.688+0000 7f55a6f74740 1 --2- 172.21.15.46:0/2463438536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56302f51e070 0x56302f8d9f70 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f5590001eb0 tx=0x7f55900047d0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.688+0000 7f55a6f74740 1 -- 172.21.15.46:0/2463438536 shutdown_connections 2024-09-21T04:00:37.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.688+0000 7f55a6f74740 1 --2- 172.21.15.46:0/2463438536 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56302f4b1da0 0x56302f954540 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.688+0000 7f55a6f74740 1 --2- 172.21.15.46:0/2463438536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56302f51e070 0x56302f8d9f70 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.688+0000 7f55a6f74740 1 --2- 172.21.15.46:0/2463438536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56302f4fd390 0x56302f8d9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.688+0000 7f55a6f74740 1 --2- 172.21.15.46:0/2463438536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56302f4f51b0 0x56302f8d94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.688+0000 7f55a6f74740 1 -- 172.21.15.46:0/2463438536 >> 172.21.15.46:0/2463438536 conn(0x56302f512460 msgr2=0x56302f8c7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:37.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.688+0000 7f5581ffb640 0 client.16281 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:00:37.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.688+0000 7f55a6f74740 1 -- 172.21.15.46:0/2463438536 shutdown_connections 2024-09-21T04:00:37.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.688+0000 7f55a6f74740 1 -- 172.21.15.46:0/2463438536 wait complete. 2024-09-21T04:00:37.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.689+0000 7f55a6f74740 20 client.16281 trim_cache size 0 max 16384 2024-09-21T04:00:37.697 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-21T04:00:37.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.689+0000 7f559b59e640 1 -- 172.21.15.46:0/2271036193 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f55840b6680 msgr2=0x7f55840b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:37.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.689+0000 7f559b59e640 1 --2- 172.21.15.46:0/2271036193 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f55840b6680 0x7f55840b8b90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f55940cbb80 tx=0x7f559409b5c0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.689+0000 7f559b59e640 1 -- 172.21.15.46:0/2271036193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f559c108b10 msgr2=0x7f559c19bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:37.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.689+0000 7f559b59e640 1 --2- 172.21.15.46:0/2271036193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f559c108b10 0x7f559c19bc70 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f5594003bd0 tx=0x7f5594003c00 comp rx=0 tx=0).stop 2024-09-21T04:00:37.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.689+0000 7f559b59e640 1 -- 172.21.15.46:0/2271036193 shutdown_connections 2024-09-21T04:00:37.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.689+0000 7f559b59e640 1 --2- 172.21.15.46:0/2271036193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f559c108b10 0x7f559c19bc70 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.689+0000 7f559b59e640 1 --2- 172.21.15.46:0/2271036193 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f55840b6680 0x7f55840b8b90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.689+0000 7f559b59e640 1 --2- 172.21.15.46:0/2271036193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f559c1081c0 0x7f559c19b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.689+0000 7f559b59e640 1 --2- 172.21.15.46:0/2271036193 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f559c102880 0x7f559c19b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:37.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.689+0000 7f559b59e640 1 -- 172.21.15.46:0/2271036193 >> 172.21.15.46:0/2271036193 conn(0x7f559c0fe2d0 msgr2=0x7f559c1006f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:37.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.689+0000 7f559b59e640 1 -- 172.21.15.46:0/2271036193 shutdown_connections 2024-09-21T04:00:37.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:37.689+0000 7f559b59e640 1 -- 172.21.15.46:0/2271036193 wait complete. 2024-09-21T04:00:38.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:37 smithi046 ceph-mon[30954]: pgmap v487: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T04:00:38.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:37 smithi105 ceph-mon[34773]: pgmap v487: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T04:00:38.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:37 smithi162 ceph-mon[35071]: pgmap v487: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T04:00:39.388 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T04:00:39.388 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T04:00:39.659 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:40.050 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:39 smithi046 ceph-mon[30954]: pgmap v488: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T04:00:40.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:39 smithi105 ceph-mon[34773]: pgmap v488: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T04:00:40.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:39 smithi162 ceph-mon[35071]: pgmap v488: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T04:00:40.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.144+0000 7ffbc9f28640 1 -- 172.21.15.46:0/3276144925 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbc4108d20 msgr2=0x7ffbc410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:40.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.144+0000 7ffbc9f28640 1 --2- 172.21.15.46:0/3276144925 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbc4108d20 0x7ffbc410f550 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc009ca0 tx=0x7ffbbc02a8c0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.144+0000 7ffbc9f28640 1 -- 172.21.15.46:0/3276144925 shutdown_connections 2024-09-21T04:00:40.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.144+0000 7ffbc9f28640 1 --2- 172.21.15.46:0/3276144925 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbc4108d20 0x7ffbc410f550 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.144+0000 7ffbc9f28640 1 --2- 172.21.15.46:0/3276144925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffbc41083d0 0x7ffbc41087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.144+0000 7ffbc9f28640 1 --2- 172.21.15.46:0/3276144925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbc4102ae0 0x7ffbc4102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.144+0000 7ffbc9f28640 1 -- 172.21.15.46:0/3276144925 >> 172.21.15.46:0/3276144925 conn(0x7ffbc4079760 msgr2=0x7ffbc4079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:40.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.145+0000 7ffbc9f28640 1 -- 172.21.15.46:0/3276144925 shutdown_connections 2024-09-21T04:00:40.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.145+0000 7ffbc9f28640 1 -- 172.21.15.46:0/3276144925 wait complete. 2024-09-21T04:00:40.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.145+0000 7ffbc9f28640 1 Processor -- start 2024-09-21T04:00:40.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.145+0000 7ffbc9f28640 1 -- start start 2024-09-21T04:00:40.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.146+0000 7ffbc9f28640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbc4102ae0 0x7ffbc419a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:40.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.146+0000 7ffbc9f28640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffbc41083d0 0x7ffbc419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:40.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.146+0000 7ffbc9f28640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbc4108d20 0x7ffbc419fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:40.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.146+0000 7ffbc9f28640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc4112990 con 0x7ffbc4102ae0 2024-09-21T04:00:40.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.146+0000 7ffbc9f28640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc4112810 con 0x7ffbc41083d0 2024-09-21T04:00:40.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.146+0000 7ffbc9f28640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc4112b10 con 0x7ffbc4108d20 2024-09-21T04:00:40.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.146+0000 7ffbc37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbc4102ae0 0x7ffbc419a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:40.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.146+0000 7ffbc37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbc4102ae0 0x7ffbc419a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54022/0 (socket says 172.21.15.46:54022) 2024-09-21T04:00:40.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.146+0000 7ffbc37fe640 1 -- 172.21.15.46:0/2282001523 learned_addr learned my addr 172.21.15.46:0/2282001523 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:40.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.146+0000 7ffbc2ffd640 1 --2- 172.21.15.46:0/2282001523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffbc41083d0 0x7ffbc419a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:40.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.146+0000 7ffbc3fff640 1 --2- 172.21.15.46:0/2282001523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbc4108d20 0x7ffbc419fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:40.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.146+0000 7ffbc37fe640 1 -- 172.21.15.46:0/2282001523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbc4108d20 msgr2=0x7ffbc419fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:40.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.146+0000 7ffbc37fe640 1 --2- 172.21.15.46:0/2282001523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbc4108d20 0x7ffbc419fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.146+0000 7ffbc37fe640 1 -- 172.21.15.46:0/2282001523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffbc41083d0 msgr2=0x7ffbc419a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:40.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.146+0000 7ffbc37fe640 1 --2- 172.21.15.46:0/2282001523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffbc41083d0 0x7ffbc419a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.146+0000 7ffbc37fe640 1 -- 172.21.15.46:0/2282001523 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc41a03a0 con 0x7ffbc4102ae0 2024-09-21T04:00:40.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.147+0000 7ffbc37fe640 1 --2- 172.21.15.46:0/2282001523 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbc4102ae0 0x7ffbc419a430 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ffbb400d950 tx=0x7ffbb400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:40.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.147+0000 7ffbc0ff9640 1 -- 172.21.15.46:0/2282001523 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb4017070 con 0x7ffbc4102ae0 2024-09-21T04:00:40.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.147+0000 7ffbc0ff9640 1 -- 172.21.15.46:0/2282001523 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbb4009c30 con 0x7ffbc4102ae0 2024-09-21T04:00:40.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.147+0000 7ffbc0ff9640 1 -- 172.21.15.46:0/2282001523 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb400f620 con 0x7ffbc4102ae0 2024-09-21T04:00:40.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.147+0000 7ffbc9f28640 1 -- 172.21.15.46:0/2282001523 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbc41a0690 con 0x7ffbc4102ae0 2024-09-21T04:00:40.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.147+0000 7ffbc9f28640 1 -- 172.21.15.46:0/2282001523 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbc41a6df0 con 0x7ffbc4102ae0 2024-09-21T04:00:40.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.149+0000 7ffbd049c740 1 Processor -- start 2024-09-21T04:00:40.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.149+0000 7ffbd049c740 1 -- start start 2024-09-21T04:00:40.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.149+0000 7ffbc0ff9640 1 -- 172.21.15.46:0/2282001523 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7ffbb4010460 con 0x7ffbc4102ae0 2024-09-21T04:00:40.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.150+0000 7ffbd049c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cbf23b8350 0x55cbf275f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:40.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.150+0000 7ffbd049c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbf238f490 0x55cbf275f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:40.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.150+0000 7ffbd049c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cbf2397670 0x55cbf275feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:40.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.150+0000 7ffbd049c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55cbf26d5e60 con 0x55cbf2397670 2024-09-21T04:00:40.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.150+0000 7ffbd049c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55cbf26c5290 con 0x55cbf23b8350 2024-09-21T04:00:40.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.150+0000 7ffbd049c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cbf26c90a0 con 0x55cbf238f490 2024-09-21T04:00:40.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.150+0000 7ffbc2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cbf2397670 0x55cbf275feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:40.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.150+0000 7ffbc2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cbf2397670 0x55cbf275feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54026/0 (socket says 172.21.15.46:54026) 2024-09-21T04:00:40.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.150+0000 7ffbc2ffd640 1 -- 172.21.15.46:0/2007175324 learned_addr learned my addr 172.21.15.46:0/2007175324 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:40.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.150+0000 7ffbc3fff640 1 --2- 172.21.15.46:0/2007175324 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cbf23b8350 0x55cbf275f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:40.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.150+0000 7ffbc37fe640 1 --2- 172.21.15.46:0/2007175324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbf238f490 0x55cbf275f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:40.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.150+0000 7ffbc2ffd640 1 -- 172.21.15.46:0/2007175324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbf238f490 msgr2=0x55cbf275f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:40.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.150+0000 7ffbc2ffd640 1 --2- 172.21.15.46:0/2007175324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbf238f490 0x55cbf275f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.150+0000 7ffbc2ffd640 1 -- 172.21.15.46:0/2007175324 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cbf23b8350 msgr2=0x55cbf275f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:40.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.150+0000 7ffbc2ffd640 1 --2- 172.21.15.46:0/2007175324 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cbf23b8350 0x55cbf275f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.150+0000 7ffbc2ffd640 1 -- 172.21.15.46:0/2007175324 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbf2423930 con 0x55cbf2397670 2024-09-21T04:00:40.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.150+0000 7ffbc3fff640 1 --2- 172.21.15.46:0/2007175324 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cbf23b8350 0x55cbf275f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:00:40.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.150+0000 7ffbc2ffd640 1 --2- 172.21.15.46:0/2007175324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cbf2397670 0x55cbf275feb0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8009c60 tx=0x7ffbb8011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d55066c9cde12a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:40.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.150+0000 7ffbc0ff9640 1 --2- 172.21.15.46:0/2282001523 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ffbac0b6680 0x7ffbac0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:40.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.151+0000 7ffbc3fff640 1 --2- 172.21.15.46:0/2282001523 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ffbac0b6680 0x7ffbac0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:40.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.151+0000 7ffba9ffb640 1 -- 172.21.15.46:0/2007175324 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8004230 con 0x55cbf2397670 2024-09-21T04:00:40.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.151+0000 7ffbc0ff9640 1 -- 172.21.15.46:0/2282001523 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7ffbb40e7240 con 0x7ffbc4102ae0 2024-09-21T04:00:40.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.151+0000 7ffba9ffb640 1 -- 172.21.15.46:0/2007175324 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbb80043d0 con 0x55cbf2397670 2024-09-21T04:00:40.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.151+0000 7ffba9ffb640 1 -- 172.21.15.46:0/2007175324 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8004cc0 con 0x55cbf2397670 2024-09-21T04:00:40.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.152+0000 7ffbd049c740 1 -- 172.21.15.46:0/2007175324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cbf2397670 msgr2=0x55cbf275feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:40.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.152+0000 7ffbc3fff640 1 --2- 172.21.15.46:0/2282001523 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ffbac0b6680 0x7ffbac0b8b90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc02f500 tx=0x7ffbbc02f310 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:40.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.152+0000 7ffbd049c740 1 --2- 172.21.15.46:0/2007175324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cbf2397670 0x55cbf275feb0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8009c60 tx=0x7ffbb8011810 comp rx=0 tx=0).stop 2024-09-21T04:00:40.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.152+0000 7ffbd049c740 1 -- 172.21.15.46:0/2007175324 shutdown_connections 2024-09-21T04:00:40.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.152+0000 7ffbd049c740 1 --2- 172.21.15.46:0/2007175324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cbf2397670 0x55cbf275feb0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.152+0000 7ffbd049c740 1 --2- 172.21.15.46:0/2007175324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbf238f490 0x55cbf275f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.152+0000 7ffbd049c740 1 --2- 172.21.15.46:0/2007175324 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cbf23b8350 0x55cbf275f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.152+0000 7ffbd049c740 1 -- 172.21.15.46:0/2007175324 >> 172.21.15.46:0/2007175324 conn(0x55cbf23ac740 msgr2=0x55cbf275d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:40.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.152+0000 7ffbd049c740 1 -- 172.21.15.46:0/2007175324 shutdown_connections 2024-09-21T04:00:40.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.152+0000 7ffbd049c740 1 -- 172.21.15.46:0/2007175324 wait complete. 2024-09-21T04:00:40.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.152+0000 7ffbd049c740 1 -- start start 2024-09-21T04:00:40.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.152+0000 7ffbd049c740 1 Processor -- start 2024-09-21T04:00:40.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.153+0000 7ffbd049c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbf238f490 0x55cbf276afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:40.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.153+0000 7ffbd049c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cbf2397670 0x55cbf276b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:40.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.153+0000 7ffbd049c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cbf23b8350 0x55cbf277b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:40.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.153+0000 7ffbd049c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55cbf2526890 con 0x55cbf23b8350 2024-09-21T04:00:40.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.153+0000 7ffbd049c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55cbf265fd40 con 0x55cbf2397670 2024-09-21T04:00:40.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.153+0000 7ffbd049c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cbf2772020 con 0x55cbf238f490 2024-09-21T04:00:40.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.153+0000 7ffbd049c740 10 client.0 _ll_register_callbacks cb 0x55cbf26c3c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:00:40.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.153+0000 7ffbc3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cbf23b8350 0x55cbf277b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:40.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.153+0000 7ffbc3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cbf23b8350 0x55cbf277b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54034/0 (socket says 172.21.15.46:54034) 2024-09-21T04:00:40.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.153+0000 7ffbc3fff640 1 -- 172.21.15.46:0/174551052 learned_addr learned my addr 172.21.15.46:0/174551052 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:40.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.153+0000 7ffbc37fe640 1 --2- 172.21.15.46:0/174551052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbf238f490 0x55cbf276afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:40.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.153+0000 7ffbc2ffd640 1 --2- 172.21.15.46:0/174551052 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cbf2397670 0x55cbf276b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:40.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.153+0000 7ffbc3fff640 1 -- 172.21.15.46:0/174551052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbf238f490 msgr2=0x55cbf276afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:40.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.153+0000 7ffbc3fff640 1 --2- 172.21.15.46:0/174551052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbf238f490 0x55cbf276afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.153+0000 7ffbc3fff640 1 -- 172.21.15.46:0/174551052 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cbf2397670 msgr2=0x55cbf276b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:40.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.153+0000 7ffbc3fff640 1 --2- 172.21.15.46:0/174551052 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cbf2397670 0x55cbf276b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.153+0000 7ffbc3fff640 1 -- 172.21.15.46:0/174551052 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbf277b900 con 0x55cbf23b8350 2024-09-21T04:00:40.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.153+0000 7ffbc37fe640 1 --2- 172.21.15.46:0/174551052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbf238f490 0x55cbf276afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:00:40.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.153+0000 7ffbc2ffd640 1 --2- 172.21.15.46:0/174551052 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cbf2397670 0x55cbf276b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:00:40.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.153+0000 7ffbc3fff640 1 --2- 172.21.15.46:0/174551052 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cbf23b8350 0x55cbf277b340 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc0316d0 tx=0x7ffbbc0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5109c7d36e4f03b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:40.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.153+0000 7ffba2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:00:40.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.154+0000 7ffba2ffd640 1 -- 172.21.15.46:0/174551052 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc004240 con 0x55cbf23b8350 2024-09-21T04:00:40.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.154+0000 7ffba2ffd640 1 -- 172.21.15.46:0/174551052 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7ffbbc0043e0 con 0x55cbf23b8350 2024-09-21T04:00:40.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.154+0000 7ffbd049c740 1 -- 172.21.15.46:0/174551052 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffbb80043d0 con 0x55cbf23b8350 2024-09-21T04:00:40.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.154+0000 7ffba2ffd640 1 -- 172.21.15.46:0/174551052 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ffbbc031910 con 0x55cbf23b8350 2024-09-21T04:00:40.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.154+0000 7ffbd049c740 10 client.16293 fetch_fsmap learned FSMap version 20 2024-09-21T04:00:40.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.154+0000 7ffbd049c740 1 -- 172.21.15.46:0/174551052 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55cbf277e1a0 con 0x55cbf23b8350 2024-09-21T04:00:40.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.154+0000 7ffba2ffd640 1 -- 172.21.15.46:0/174551052 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbb80043d0 con 0x55cbf23b8350 2024-09-21T04:00:40.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.154+0000 7ffba2ffd640 1 -- 172.21.15.46:0/174551052 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ffbbc044040 con 0x55cbf23b8350 2024-09-21T04:00:40.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.154+0000 7ffbd049c740 10 client.16293 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:00:40.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.154+0000 7ffbd049c740 10 client.16293 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:00:40.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.154+0000 7ffbd049c740 20 client.16293 populate_metadata read hostname 'smithi046' 2024-09-21T04:00:40.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.154+0000 7ffbd049c740 1 --2- 172.21.15.46:0/174551052 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55cbf2376cd0 0x55cbf2781760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:40.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.154+0000 7ffbd049c740 4 client.16293 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:00:40.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.154+0000 7ffbd049c740 1 -- 172.21.15.46:0/174551052 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cbf26d7db0 con 0x55cbf2376cd0 2024-09-21T04:00:40.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.155+0000 7ffbc37fe640 1 --2- 172.21.15.46:0/174551052 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55cbf2376cd0 0x55cbf2781760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:40.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.155+0000 7ffba2ffd640 10 client.16293 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:00:40.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.155+0000 7ffbc37fe640 1 --2- 172.21.15.46:0/174551052 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55cbf2376cd0 0x55cbf2781760 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b96785a69153a0ff server_cookie=eae8ebdb9809430b in_seq=0 out_seq=0 2024-09-21T04:00:40.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.156+0000 7ffba2ffd640 1 -- 172.21.15.46:0/174551052 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cbf26d7db0 con 0x55cbf2376cd0 2024-09-21T04:00:40.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.156+0000 7ffba2ffd640 10 client.16293 handle_command_reply: tid=0 2024-09-21T04:00:40.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.156+0000 7ffbd049c740 1 client.16293 shutdown 2024-09-21T04:00:40.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.156+0000 7ffbd049c740 1 -- 172.21.15.46:0/174551052 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cbf23b8350 msgr2=0x55cbf277b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:40.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.156+0000 7ffbd049c740 1 --2- 172.21.15.46:0/174551052 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cbf23b8350 0x55cbf277b340 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc0316d0 tx=0x7ffbbc0095c0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.156+0000 7ffbd049c740 1 -- 172.21.15.46:0/174551052 shutdown_connections 2024-09-21T04:00:40.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.156+0000 7ffbd049c740 1 --2- 172.21.15.46:0/174551052 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55cbf2376cd0 0x55cbf2781760 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.156+0000 7ffbd049c740 1 --2- 172.21.15.46:0/174551052 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cbf23b8350 0x55cbf277b340 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.156+0000 7ffbd049c740 1 --2- 172.21.15.46:0/174551052 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cbf2397670 0x55cbf276b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.156+0000 7ffba2ffd640 0 client.16293 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:00:40.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.156+0000 7ffbd049c740 1 --2- 172.21.15.46:0/174551052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbf238f490 0x55cbf276afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.156+0000 7ffbd049c740 1 -- 172.21.15.46:0/174551052 >> 172.21.15.46:0/174551052 conn(0x55cbf23ac740 msgr2=0x55cbf27625c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:40.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.156+0000 7ffbd049c740 1 -- 172.21.15.46:0/174551052 shutdown_connections 2024-09-21T04:00:40.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.156+0000 7ffbd049c740 1 -- 172.21.15.46:0/174551052 wait complete. 2024-09-21T04:00:40.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.156+0000 7ffbd049c740 20 client.16293 trim_cache size 0 max 16384 2024-09-21T04:00:40.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.175+0000 7ffbd049c740 1 Processor -- start 2024-09-21T04:00:40.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.175+0000 7ffbd049c740 1 -- start start 2024-09-21T04:00:40.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.175+0000 7ffbd049c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cbf238f490 0x55cbf2765550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:40.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.175+0000 7ffbd049c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cbf2397670 0x55cbf277b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:40.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.175+0000 7ffbd049c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbf23b8350 0x55cbf2767fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:40.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.175+0000 7ffbd049c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc41ab210 con 0x55cbf2397670 2024-09-21T04:00:40.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.175+0000 7ffbd049c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc41adab0 con 0x55cbf238f490 2024-09-21T04:00:40.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.175+0000 7ffbd049c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc41ab8a0 con 0x55cbf23b8350 2024-09-21T04:00:40.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.175+0000 7ffbc2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cbf2397670 0x55cbf277b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:40.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.175+0000 7ffbc2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cbf2397670 0x55cbf277b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54042/0 (socket says 172.21.15.46:54042) 2024-09-21T04:00:40.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.175+0000 7ffbc2ffd640 1 -- 172.21.15.46:0/756580110 learned_addr learned my addr 172.21.15.46:0/756580110 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:40.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.175+0000 7ffbc37fe640 1 --2- 172.21.15.46:0/756580110 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cbf238f490 0x55cbf2765550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:40.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.175+0000 7ffbc2ffd640 1 -- 172.21.15.46:0/756580110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbf23b8350 msgr2=0x55cbf2767fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:40.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.175+0000 7ffbc3fff640 1 --2- 172.21.15.46:0/756580110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbf23b8350 0x55cbf2767fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:40.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.175+0000 7ffbc2ffd640 1 --2- 172.21.15.46:0/756580110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbf23b8350 0x55cbf2767fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.175+0000 7ffbc2ffd640 1 -- 172.21.15.46:0/756580110 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cbf238f490 msgr2=0x55cbf2765550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:40.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.175+0000 7ffbc2ffd640 1 --2- 172.21.15.46:0/756580110 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cbf238f490 0x55cbf2765550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.176+0000 7ffbc2ffd640 1 -- 172.21.15.46:0/756580110 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbf27692e0 con 0x55cbf2397670 2024-09-21T04:00:40.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.176+0000 7ffbc37fe640 1 --2- 172.21.15.46:0/756580110 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cbf238f490 0x55cbf2765550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:00:40.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.176+0000 7ffbc3fff640 1 --2- 172.21.15.46:0/756580110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbf23b8350 0x55cbf2767fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:00:40.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.176+0000 7ffbc2ffd640 1 --2- 172.21.15.46:0/756580110 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cbf2397670 0x55cbf277b240 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8005bc0 tx=0x7ffbb80096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f4ff819791532d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:40.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.176+0000 7ffba97fa640 1 -- 172.21.15.46:0/756580110 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb801e040 con 0x55cbf2397670 2024-09-21T04:00:40.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.176+0000 7ffba97fa640 1 -- 172.21.15.46:0/756580110 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbb8028070 con 0x55cbf2397670 2024-09-21T04:00:40.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.176+0000 7ffba97fa640 1 -- 172.21.15.46:0/756580110 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8023670 con 0x55cbf2397670 2024-09-21T04:00:40.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.177+0000 7ffbd049c740 1 -- 172.21.15.46:0/756580110 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cbf2397670 msgr2=0x55cbf277b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:40.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.177+0000 7ffbd049c740 1 --2- 172.21.15.46:0/756580110 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cbf2397670 0x55cbf277b240 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8005bc0 tx=0x7ffbb80096a0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.177+0000 7ffbd049c740 1 -- 172.21.15.46:0/756580110 shutdown_connections 2024-09-21T04:00:40.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.177+0000 7ffbd049c740 1 --2- 172.21.15.46:0/756580110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbf23b8350 0x55cbf2767fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.177+0000 7ffbd049c740 1 --2- 172.21.15.46:0/756580110 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cbf2397670 0x55cbf277b240 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.177+0000 7ffbd049c740 1 --2- 172.21.15.46:0/756580110 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cbf238f490 0x55cbf2765550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.177+0000 7ffbd049c740 1 -- 172.21.15.46:0/756580110 >> 172.21.15.46:0/756580110 conn(0x55cbf23ac740 msgr2=0x55cbf2769660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:40.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.177+0000 7ffbd049c740 1 -- 172.21.15.46:0/756580110 shutdown_connections 2024-09-21T04:00:40.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.177+0000 7ffbd049c740 1 -- 172.21.15.46:0/756580110 wait complete. 2024-09-21T04:00:40.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.177+0000 7ffbd049c740 1 -- start start 2024-09-21T04:00:40.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.178+0000 7ffbd049c740 1 Processor -- start 2024-09-21T04:00:40.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.178+0000 7ffbd049c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbf238f490 0x55cbf276f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:40.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.178+0000 7ffbd049c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cbf2397670 0x55cbf276fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:40.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.178+0000 7ffbd049c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cbf23b8350 0x55cbf27772a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:40.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.178+0000 7ffbd049c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc41abf70 con 0x55cbf23b8350 2024-09-21T04:00:40.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.178+0000 7ffbd049c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc41ad3e0 con 0x55cbf2397670 2024-09-21T04:00:40.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.178+0000 7ffbd049c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc41ac640 con 0x55cbf238f490 2024-09-21T04:00:40.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.178+0000 7ffbd049c740 10 client.0 _ll_register_callbacks cb 0x7ffbbc009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:00:40.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.178+0000 7ffbc3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cbf23b8350 0x55cbf27772a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:40.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.178+0000 7ffbc3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cbf23b8350 0x55cbf27772a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54052/0 (socket says 172.21.15.46:54052) 2024-09-21T04:00:40.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.178+0000 7ffbc3fff640 1 -- 172.21.15.46:0/10473436 learned_addr learned my addr 172.21.15.46:0/10473436 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:40.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.178+0000 7ffbc2ffd640 1 --2- 172.21.15.46:0/10473436 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cbf2397670 0x55cbf276fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:40.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.178+0000 7ffbc37fe640 1 --2- 172.21.15.46:0/10473436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbf238f490 0x55cbf276f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:40.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.179+0000 7ffbc3fff640 1 -- 172.21.15.46:0/10473436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbf238f490 msgr2=0x55cbf276f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:40.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.179+0000 7ffbc3fff640 1 --2- 172.21.15.46:0/10473436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbf238f490 0x55cbf276f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.179+0000 7ffbc3fff640 1 -- 172.21.15.46:0/10473436 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cbf2397670 msgr2=0x55cbf276fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:40.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.179+0000 7ffbc3fff640 1 --2- 172.21.15.46:0/10473436 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cbf2397670 0x55cbf276fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.179+0000 7ffbc3fff640 1 -- 172.21.15.46:0/10473436 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbf27778b0 con 0x55cbf23b8350 2024-09-21T04:00:40.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.179+0000 7ffbc37fe640 1 --2- 172.21.15.46:0/10473436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbf238f490 0x55cbf276f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:00:40.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.179+0000 7ffbc2ffd640 1 --2- 172.21.15.46:0/10473436 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cbf2397670 0x55cbf276fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:00:40.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.179+0000 7ffbc3fff640 1 --2- 172.21.15.46:0/10473436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cbf23b8350 0x55cbf27772a0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc005e30 tx=0x7ffbbc0098c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d784d7cd46e1f7c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:40.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.179+0000 7ffba2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:00:40.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.179+0000 7ffba2ffd640 1 -- 172.21.15.46:0/10473436 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc004d40 con 0x55cbf23b8350 2024-09-21T04:00:40.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.179+0000 7ffba2ffd640 1 -- 172.21.15.46:0/10473436 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7ffbbc0043e0 con 0x55cbf23b8350 2024-09-21T04:00:40.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.179+0000 7ffbd049c740 1 -- 172.21.15.46:0/10473436 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffbb8028070 con 0x55cbf23b8350 2024-09-21T04:00:40.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.179+0000 7ffba2ffd640 1 -- 172.21.15.46:0/10473436 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ffbbc0045e0 con 0x55cbf23b8350 2024-09-21T04:00:40.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.179+0000 7ffbd049c740 10 client.16299 fetch_fsmap learned FSMap version 20 2024-09-21T04:00:40.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.179+0000 7ffbd049c740 1 -- 172.21.15.46:0/10473436 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55cbf27f11c0 con 0x55cbf23b8350 2024-09-21T04:00:40.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.180+0000 7ffba2ffd640 1 -- 172.21.15.46:0/10473436 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbb8028070 con 0x55cbf23b8350 2024-09-21T04:00:40.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.180+0000 7ffba2ffd640 1 -- 172.21.15.46:0/10473436 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ffbbc044070 con 0x55cbf23b8350 2024-09-21T04:00:40.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.180+0000 7ffbd049c740 10 client.16299 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:00:40.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.180+0000 7ffbd049c740 10 client.16299 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:00:40.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.180+0000 7ffbd049c740 20 client.16299 populate_metadata read hostname 'smithi046' 2024-09-21T04:00:40.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.180+0000 7ffbd049c740 1 --2- 172.21.15.46:0/10473436 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55cbf234c080 0x55cbf27f39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:40.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.180+0000 7ffbd049c740 4 client.16299 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T04:00:40.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.180+0000 7ffbd049c740 1 -- 172.21.15.46:0/10473436 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55cbf26d3860 con 0x55cbf234c080 2024-09-21T04:00:40.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.180+0000 7ffbc37fe640 1 --2- 172.21.15.46:0/10473436 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55cbf234c080 0x55cbf27f39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:40.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.181+0000 7ffbc37fe640 1 --2- 172.21.15.46:0/10473436 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55cbf234c080 0x55cbf27f39b0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff8ac20b5f6bd215 server_cookie=d41e4db0d28878e in_seq=0 out_seq=0 2024-09-21T04:00:40.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.181+0000 7ffba2ffd640 10 client.16299 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:00:40.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.182+0000 7ffba2ffd640 1 -- 172.21.15.46:0/10473436 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55cbf26d3860 con 0x55cbf234c080 2024-09-21T04:00:40.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.182+0000 7ffba2ffd640 10 client.16299 handle_command_reply: tid=0 2024-09-21T04:00:40.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.182+0000 7ffbd049c740 1 client.16299 shutdown 2024-09-21T04:00:40.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.183+0000 7ffbd049c740 1 -- 172.21.15.46:0/10473436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cbf23b8350 msgr2=0x55cbf27772a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:40.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.183+0000 7ffbd049c740 1 --2- 172.21.15.46:0/10473436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cbf23b8350 0x55cbf27772a0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc005e30 tx=0x7ffbbc0098c0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.183+0000 7ffbd049c740 1 -- 172.21.15.46:0/10473436 shutdown_connections 2024-09-21T04:00:40.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.183+0000 7ffbd049c740 1 --2- 172.21.15.46:0/10473436 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55cbf234c080 0x55cbf27f39b0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.183+0000 7ffbd049c740 1 --2- 172.21.15.46:0/10473436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cbf23b8350 0x55cbf27772a0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.183+0000 7ffbd049c740 1 --2- 172.21.15.46:0/10473436 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cbf2397670 0x55cbf276fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.183+0000 7ffba2ffd640 0 client.16299 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:00:40.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.183+0000 7ffbd049c740 1 --2- 172.21.15.46:0/10473436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cbf238f490 0x55cbf276f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.183+0000 7ffbd049c740 1 -- 172.21.15.46:0/10473436 >> 172.21.15.46:0/10473436 conn(0x55cbf23ac740 msgr2=0x55cbf276c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:40.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.183+0000 7ffbd049c740 1 -- 172.21.15.46:0/10473436 shutdown_connections 2024-09-21T04:00:40.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.183+0000 7ffbd049c740 1 -- 172.21.15.46:0/10473436 wait complete. 2024-09-21T04:00:40.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.183+0000 7ffbd049c740 20 client.16299 trim_cache size 0 max 16384 2024-09-21T04:00:40.190 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T04:00:40.190 INFO:teuthology.orchestra.run.smithi046.stdout: "return_code": 0, 2024-09-21T04:00:40.191 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_tag": "edc4b8c7-b702-489d-a925-ae7ad0ff0d9a", 2024-09-21T04:00:40.191 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": "asynchronous" 2024-09-21T04:00:40.191 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T04:00:40.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.184+0000 7ffbc9f28640 1 -- 172.21.15.46:0/2282001523 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ffbac0b6680 msgr2=0x7ffbac0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:40.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.184+0000 7ffbc9f28640 1 --2- 172.21.15.46:0/2282001523 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ffbac0b6680 0x7ffbac0b8b90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc02f500 tx=0x7ffbbc02f310 comp rx=0 tx=0).stop 2024-09-21T04:00:40.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.184+0000 7ffbc9f28640 1 -- 172.21.15.46:0/2282001523 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbc4102ae0 msgr2=0x7ffbc419a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:40.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.184+0000 7ffbc9f28640 1 --2- 172.21.15.46:0/2282001523 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbc4102ae0 0x7ffbc419a430 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ffbb400d950 tx=0x7ffbb400de10 comp rx=0 tx=0).stop 2024-09-21T04:00:40.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.184+0000 7ffbc9f28640 1 -- 172.21.15.46:0/2282001523 shutdown_connections 2024-09-21T04:00:40.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.184+0000 7ffbc9f28640 1 --2- 172.21.15.46:0/2282001523 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ffbac0b6680 0x7ffbac0b8b90 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.184+0000 7ffbc9f28640 1 --2- 172.21.15.46:0/2282001523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbc4108d20 0x7ffbc419fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.184+0000 7ffbc9f28640 1 --2- 172.21.15.46:0/2282001523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffbc41083d0 0x7ffbc419a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.184+0000 7ffbc9f28640 1 --2- 172.21.15.46:0/2282001523 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbc4102ae0 0x7ffbc419a430 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.184+0000 7ffbc9f28640 1 -- 172.21.15.46:0/2282001523 >> 172.21.15.46:0/2282001523 conn(0x7ffbc4079760 msgr2=0x7ffbc4101aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:40.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.184+0000 7ffbc9f28640 1 -- 172.21.15.46:0/2282001523 shutdown_connections 2024-09-21T04:00:40.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:40.184+0000 7ffbc9f28640 1 -- 172.21.15.46:0/2282001523 wait complete. 2024-09-21T04:00:40.988 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T04:00:41.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:40 smithi105 ceph-mon[34773]: scrub queued for path: / 2024-09-21T04:00:41.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:40 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T04:00:41.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:40 smithi105 ceph-mon[34773]: scrub summary: active paths [/] 2024-09-21T04:00:41.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:40 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T04:00:41.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:40 smithi162 ceph-mon[35071]: scrub queued for path: / 2024-09-21T04:00:41.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:40 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T04:00:41.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:40 smithi162 ceph-mon[35071]: scrub summary: active paths [/] 2024-09-21T04:00:41.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:40 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T04:00:41.248 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:41.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:40 smithi046 ceph-mon[30954]: scrub queued for path: / 2024-09-21T04:00:41.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:40 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T04:00:41.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:40 smithi046 ceph-mon[30954]: scrub summary: active paths [/] 2024-09-21T04:00:41.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:40 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T04:00:41.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.762+0000 7fc435a09640 1 -- 172.21.15.46:0/644916816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc430109e10 msgr2=0x7fc430110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:41.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.762+0000 7fc435a09640 1 --2- 172.21.15.46:0/644916816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc430109e10 0x7fc430110640 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fc428009ca0 tx=0x7fc42802a8c0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.762+0000 7fc435a09640 1 -- 172.21.15.46:0/644916816 shutdown_connections 2024-09-21T04:00:41.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.762+0000 7fc435a09640 1 --2- 172.21.15.46:0/644916816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc430109e10 0x7fc430110640 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.762+0000 7fc435a09640 1 --2- 172.21.15.46:0/644916816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4301094c0 0x7fc4301098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.762+0000 7fc435a09640 1 --2- 172.21.15.46:0/644916816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc430101fe0 0x7fc4301023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.762+0000 7fc435a09640 1 -- 172.21.15.46:0/644916816 >> 172.21.15.46:0/644916816 conn(0x7fc430077bc0 msgr2=0x7fc430078000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:41.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.762+0000 7fc435a09640 1 -- 172.21.15.46:0/644916816 shutdown_connections 2024-09-21T04:00:41.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.762+0000 7fc435a09640 1 -- 172.21.15.46:0/644916816 wait complete. 2024-09-21T04:00:41.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.762+0000 7fc435a09640 1 Processor -- start 2024-09-21T04:00:41.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.762+0000 7fc435a09640 1 -- start start 2024-09-21T04:00:41.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.762+0000 7fc435a09640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc430101fe0 0x7fc43019a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:41.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.762+0000 7fc435a09640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4301094c0 0x7fc43019a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:41.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.762+0000 7fc435a09640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc430109e10 0x7fc43019fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:41.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.763+0000 7fc435a09640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc430113a80 con 0x7fc430109e10 2024-09-21T04:00:41.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.763+0000 7fc435a09640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc430113900 con 0x7fc430101fe0 2024-09-21T04:00:41.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.763+0000 7fc435a09640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc430113c00 con 0x7fc4301094c0 2024-09-21T04:00:41.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.763+0000 7fc42f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc430109e10 0x7fc43019fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:41.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.763+0000 7fc42f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc430109e10 0x7fc43019fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54082/0 (socket says 172.21.15.46:54082) 2024-09-21T04:00:41.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.763+0000 7fc42f7fe640 1 -- 172.21.15.46:0/2166903410 learned_addr learned my addr 172.21.15.46:0/2166903410 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:41.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.763+0000 7fc42effd640 1 --2- 172.21.15.46:0/2166903410 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc430101fe0 0x7fc43019a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:41.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.763+0000 7fc4267fc640 1 --2- 172.21.15.46:0/2166903410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4301094c0 0x7fc43019a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:41.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.763+0000 7fc42f7fe640 1 -- 172.21.15.46:0/2166903410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4301094c0 msgr2=0x7fc43019a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:41.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.763+0000 7fc42f7fe640 1 --2- 172.21.15.46:0/2166903410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4301094c0 0x7fc43019a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.763+0000 7fc42f7fe640 1 -- 172.21.15.46:0/2166903410 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc430101fe0 msgr2=0x7fc43019a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:41.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.763+0000 7fc42f7fe640 1 --2- 172.21.15.46:0/2166903410 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc430101fe0 0x7fc43019a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.763+0000 7fc42f7fe640 1 -- 172.21.15.46:0/2166903410 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4301a0360 con 0x7fc430109e10 2024-09-21T04:00:41.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.763+0000 7fc4267fc640 1 --2- 172.21.15.46:0/2166903410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4301094c0 0x7fc43019a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:00:41.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.763+0000 7fc42f7fe640 1 --2- 172.21.15.46:0/2166903410 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc430109e10 0x7fc43019fc30 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fc428005cc0 tx=0x7fc428031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:41.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.764+0000 7fc434a07640 1 -- 172.21.15.46:0/2166903410 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc428003b70 con 0x7fc430109e10 2024-09-21T04:00:41.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.764+0000 7fc435a09640 1 -- 172.21.15.46:0/2166903410 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4301a05f0 con 0x7fc430109e10 2024-09-21T04:00:41.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.764+0000 7fc434a07640 1 -- 172.21.15.46:0/2166903410 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4280318f0 con 0x7fc430109e10 2024-09-21T04:00:41.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.764+0000 7fc434a07640 1 -- 172.21.15.46:0/2166903410 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42802f950 con 0x7fc430109e10 2024-09-21T04:00:41.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.764+0000 7fc435a09640 1 -- 172.21.15.46:0/2166903410 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4301a6db0 con 0x7fc430109e10 2024-09-21T04:00:41.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.766+0000 7fc43bf7d740 1 Processor -- start 2024-09-21T04:00:41.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.767+0000 7fc434a07640 1 -- 172.21.15.46:0/2166903410 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7fc42802fb50 con 0x7fc430109e10 2024-09-21T04:00:41.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.767+0000 7fc43bf7d740 1 -- start start 2024-09-21T04:00:41.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.767+0000 7fc43bf7d740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d62d30070 0x563d630d7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:41.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.767+0000 7fc43bf7d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d62d071b0 0x563d630d77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:41.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.767+0000 7fc43bf7d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d62d0f390 0x563d630d7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:41.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.767+0000 7fc43bf7d740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x563d6304de50 con 0x563d62d30070 2024-09-21T04:00:41.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.767+0000 7fc43bf7d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x563d6303d280 con 0x563d62d0f390 2024-09-21T04:00:41.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.767+0000 7fc43bf7d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563d63041090 con 0x563d62d071b0 2024-09-21T04:00:41.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.767+0000 7fc4267fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d62d30070 0x563d630d7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:41.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.767+0000 7fc4267fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d62d30070 0x563d630d7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54084/0 (socket says 172.21.15.46:54084) 2024-09-21T04:00:41.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.767+0000 7fc4267fc640 1 -- 172.21.15.46:0/2138575824 learned_addr learned my addr 172.21.15.46:0/2138575824 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:41.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.767+0000 7fc42effd640 1 --2- 172.21.15.46:0/2138575824 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d62d071b0 0x563d630d77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:41.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.768+0000 7fc4267fc640 1 -- 172.21.15.46:0/2138575824 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d62d071b0 msgr2=0x563d630d77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:41.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.768+0000 7fc4267fc640 1 --2- 172.21.15.46:0/2138575824 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d62d071b0 0x563d630d77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.768+0000 7fc4267fc640 1 -- 172.21.15.46:0/2138575824 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d62d0f390 msgr2=0x563d630d7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:41.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.768+0000 7fc4267fc640 1 --2- 172.21.15.46:0/2138575824 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d62d0f390 0x563d630d7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.768+0000 7fc4267fc640 1 -- 172.21.15.46:0/2138575824 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d62d9b650 con 0x563d62d30070 2024-09-21T04:00:41.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.768+0000 7fc434a07640 1 --2- 172.21.15.46:0/2166903410 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc41c0b6680 0x7fc41c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:41.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.768+0000 7fc42effd640 1 --2- 172.21.15.46:0/2166903410 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc41c0b6680 0x7fc41c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:41.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.768+0000 7fc4267fc640 1 --2- 172.21.15.46:0/2138575824 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d62d30070 0x563d630d7270 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fc418009db0 tx=0x7fc4180117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e9ca288c0b9dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:41.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.768+0000 7fc434a07640 1 -- 172.21.15.46:0/2166903410 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fc428108800 con 0x7fc430109e10 2024-09-21T04:00:41.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.768+0000 7fc425ffb640 1 -- 172.21.15.46:0/2138575824 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc418005220 con 0x563d62d30070 2024-09-21T04:00:41.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.768+0000 7fc425ffb640 1 -- 172.21.15.46:0/2138575824 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc418004c50 con 0x563d62d30070 2024-09-21T04:00:41.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.768+0000 7fc425ffb640 1 -- 172.21.15.46:0/2138575824 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4180127d0 con 0x563d62d30070 2024-09-21T04:00:41.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.769+0000 7fc43bf7d740 1 -- 172.21.15.46:0/2138575824 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d62d30070 msgr2=0x563d630d7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:41.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.769+0000 7fc42effd640 1 --2- 172.21.15.46:0/2166903410 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc41c0b6680 0x7fc41c0b8b90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x563d630d5ef0 tx=0x7fc420005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:41.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.769+0000 7fc43bf7d740 1 --2- 172.21.15.46:0/2138575824 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d62d30070 0x563d630d7270 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fc418009db0 tx=0x7fc4180117b0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.769+0000 7fc43bf7d740 1 -- 172.21.15.46:0/2138575824 shutdown_connections 2024-09-21T04:00:41.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.769+0000 7fc43bf7d740 1 --2- 172.21.15.46:0/2138575824 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d62d0f390 0x563d630d7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.769+0000 7fc43bf7d740 1 --2- 172.21.15.46:0/2138575824 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d62d071b0 0x563d630d77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.769+0000 7fc43bf7d740 1 --2- 172.21.15.46:0/2138575824 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d62d30070 0x563d630d7270 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.769+0000 7fc43bf7d740 1 -- 172.21.15.46:0/2138575824 >> 172.21.15.46:0/2138575824 conn(0x563d62d24460 msgr2=0x563d630d5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:41.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.769+0000 7fc43bf7d740 1 -- 172.21.15.46:0/2138575824 shutdown_connections 2024-09-21T04:00:41.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.769+0000 7fc43bf7d740 1 -- 172.21.15.46:0/2138575824 wait complete. 2024-09-21T04:00:41.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.770+0000 7fc43bf7d740 1 -- start start 2024-09-21T04:00:41.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.770+0000 7fc43bf7d740 1 Processor -- start 2024-09-21T04:00:41.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.770+0000 7fc43bf7d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d62d071b0 0x563d630e2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:41.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.770+0000 7fc43bf7d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d62d0f390 0x563d630e2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:41.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.770+0000 7fc43bf7d740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d62d30070 0x563d630e33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:41.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.770+0000 7fc43bf7d740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x563d62e9e700 con 0x563d62d30070 2024-09-21T04:00:41.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.770+0000 7fc43bf7d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x563d62fd8110 con 0x563d62d0f390 2024-09-21T04:00:41.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.770+0000 7fc43bf7d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563d630e5a50 con 0x563d62d071b0 2024-09-21T04:00:41.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.770+0000 7fc43bf7d740 10 client.0 _ll_register_callbacks cb 0x563d62ff1990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:00:41.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.770+0000 7fc42f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d62d30070 0x563d630e33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:41.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.770+0000 7fc42f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d62d30070 0x563d630e33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54086/0 (socket says 172.21.15.46:54086) 2024-09-21T04:00:41.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.770+0000 7fc42f7fe640 1 -- 172.21.15.46:0/2635035031 learned_addr learned my addr 172.21.15.46:0/2635035031 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:41.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.770+0000 7fc42effd640 1 --2- 172.21.15.46:0/2635035031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d62d071b0 0x563d630e2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:41.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.770+0000 7fc4267fc640 1 --2- 172.21.15.46:0/2635035031 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d62d0f390 0x563d630e2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:41.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.771+0000 7fc42f7fe640 1 -- 172.21.15.46:0/2635035031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d62d071b0 msgr2=0x563d630e2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:41.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.771+0000 7fc42f7fe640 1 --2- 172.21.15.46:0/2635035031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d62d071b0 0x563d630e2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.771+0000 7fc42f7fe640 1 -- 172.21.15.46:0/2635035031 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d62d0f390 msgr2=0x563d630e2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:41.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.771+0000 7fc42f7fe640 1 --2- 172.21.15.46:0/2635035031 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d62d0f390 0x563d630e2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.771+0000 7fc42f7fe640 1 -- 172.21.15.46:0/2635035031 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d63005c40 con 0x563d62d30070 2024-09-21T04:00:41.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.771+0000 7fc42f7fe640 1 --2- 172.21.15.46:0/2635035031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d62d30070 0x563d630e33c0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fc42802f550 tx=0x7fc428003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ac3c9878cba4d6d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:41.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.771+0000 7fc40effd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:00:41.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.771+0000 7fc40effd640 1 -- 172.21.15.46:0/2635035031 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4280d31d0 con 0x563d62d30070 2024-09-21T04:00:41.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.771+0000 7fc40effd640 1 -- 172.21.15.46:0/2635035031 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fc4280ca960 con 0x563d62d30070 2024-09-21T04:00:41.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.771+0000 7fc43bf7d740 1 -- 172.21.15.46:0/2635035031 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc418004c50 con 0x563d62d30070 2024-09-21T04:00:41.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.771+0000 7fc40effd640 1 -- 172.21.15.46:0/2635035031 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc4280d8110 con 0x563d62d30070 2024-09-21T04:00:41.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.771+0000 7fc43bf7d740 10 client.16311 fetch_fsmap learned FSMap version 20 2024-09-21T04:00:41.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.771+0000 7fc43bf7d740 1 -- 172.21.15.46:0/2635035031 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x563d630f1750 con 0x563d62d30070 2024-09-21T04:00:41.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.772+0000 7fc40effd640 1 -- 172.21.15.46:0/2635035031 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc418004c50 con 0x563d62d30070 2024-09-21T04:00:41.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.772+0000 7fc40effd640 1 -- 172.21.15.46:0/2635035031 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc4280cd9e0 con 0x563d62d30070 2024-09-21T04:00:41.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.772+0000 7fc43bf7d740 10 client.16311 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:00:41.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.772+0000 7fc43bf7d740 10 client.16311 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:00:41.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.772+0000 7fc43bf7d740 20 client.16311 populate_metadata read hostname 'smithi046' 2024-09-21T04:00:41.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.772+0000 7fc43bf7d740 1 --2- 172.21.15.46:0/2635035031 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x563d62cee9f0 0x563d630f4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:41.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.772+0000 7fc43bf7d740 4 client.16311 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:00:41.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.772+0000 7fc43bf7d740 1 -- 172.21.15.46:0/2635035031 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d6304fda0 con 0x563d62cee9f0 2024-09-21T04:00:41.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.772+0000 7fc42effd640 1 --2- 172.21.15.46:0/2635035031 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x563d62cee9f0 0x563d630f4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:41.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.773+0000 7fc40effd640 10 client.16311 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:00:41.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.773+0000 7fc42effd640 1 --2- 172.21.15.46:0/2635035031 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x563d62cee9f0 0x563d630f4cb0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d23f780540c6ea3e server_cookie=f58b69c8d1723d1b in_seq=0 out_seq=0 2024-09-21T04:00:41.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.773+0000 7fc40effd640 1 -- 172.21.15.46:0/2635035031 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563d6304fda0 con 0x563d62cee9f0 2024-09-21T04:00:41.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.773+0000 7fc40effd640 10 client.16311 handle_command_reply: tid=0 2024-09-21T04:00:41.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.775+0000 7fc43bf7d740 1 client.16311 shutdown 2024-09-21T04:00:41.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.775+0000 7fc43bf7d740 1 -- 172.21.15.46:0/2635035031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d62d30070 msgr2=0x563d630e33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:41.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.775+0000 7fc43bf7d740 1 --2- 172.21.15.46:0/2635035031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d62d30070 0x563d630e33c0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fc42802f550 tx=0x7fc428003f90 comp rx=0 tx=0).stop 2024-09-21T04:00:41.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.775+0000 7fc43bf7d740 1 -- 172.21.15.46:0/2635035031 shutdown_connections 2024-09-21T04:00:41.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.775+0000 7fc43bf7d740 1 --2- 172.21.15.46:0/2635035031 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x563d62cee9f0 0x563d630f4cb0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.775+0000 7fc43bf7d740 1 --2- 172.21.15.46:0/2635035031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d62d30070 0x563d630e33c0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.775+0000 7fc43bf7d740 1 --2- 172.21.15.46:0/2635035031 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d62d0f390 0x563d630e2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.775+0000 7fc43bf7d740 1 --2- 172.21.15.46:0/2635035031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d62d071b0 0x563d630e2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.775+0000 7fc43bf7d740 1 -- 172.21.15.46:0/2635035031 >> 172.21.15.46:0/2635035031 conn(0x563d62d24460 msgr2=0x563d630da450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:41.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.775+0000 7fc40effd640 0 client.16311 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:00:41.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.775+0000 7fc43bf7d740 1 -- 172.21.15.46:0/2635035031 shutdown_connections 2024-09-21T04:00:41.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.775+0000 7fc43bf7d740 1 -- 172.21.15.46:0/2635035031 wait complete. 2024-09-21T04:00:41.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.775+0000 7fc43bf7d740 20 client.16311 trim_cache size 0 max 16384 2024-09-21T04:00:41.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.791+0000 7fc43bf7d740 1 Processor -- start 2024-09-21T04:00:41.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.792+0000 7fc43bf7d740 1 -- start start 2024-09-21T04:00:41.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.792+0000 7fc43bf7d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d62d071b0 0x563d630e4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:41.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.792+0000 7fc43bf7d740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d62d0f390 0x563d630dfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:41.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.792+0000 7fc43bf7d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d62d30070 0x563d630e0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:41.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.792+0000 7fc43bf7d740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc4301ad3f0 con 0x563d62d0f390 2024-09-21T04:00:41.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.792+0000 7fc43bf7d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc4301afc50 con 0x563d62d30070 2024-09-21T04:00:41.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.792+0000 7fc43bf7d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc4301ada40 con 0x563d62d071b0 2024-09-21T04:00:41.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.792+0000 7fc4267fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d62d0f390 0x563d630dfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:41.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.792+0000 7fc4267fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d62d0f390 0x563d630dfaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54090/0 (socket says 172.21.15.46:54090) 2024-09-21T04:00:41.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.792+0000 7fc4267fc640 1 -- 172.21.15.46:0/81392105 learned_addr learned my addr 172.21.15.46:0/81392105 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:41.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.792+0000 7fc42effd640 1 --2- 172.21.15.46:0/81392105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d62d071b0 0x563d630e4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:41.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.792+0000 7fc42f7fe640 1 --2- 172.21.15.46:0/81392105 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d62d30070 0x563d630e0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:41.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.792+0000 7fc4267fc640 1 -- 172.21.15.46:0/81392105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d62d071b0 msgr2=0x563d630e4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:41.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.792+0000 7fc4267fc640 1 --2- 172.21.15.46:0/81392105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d62d071b0 0x563d630e4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.792+0000 7fc4267fc640 1 -- 172.21.15.46:0/81392105 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d62d30070 msgr2=0x563d630e0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:41.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.792+0000 7fc4267fc640 1 --2- 172.21.15.46:0/81392105 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d62d30070 0x563d630e0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.792+0000 7fc4267fc640 1 -- 172.21.15.46:0/81392105 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d630e1860 con 0x563d62d0f390 2024-09-21T04:00:41.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.793+0000 7fc4267fc640 1 --2- 172.21.15.46:0/81392105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d62d0f390 0x563d630dfaf0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fc418011cb0 tx=0x7fc4180097f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=321106c42f62f74f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:41.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.793+0000 7fc4257fa640 1 -- 172.21.15.46:0/81392105 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc418029070 con 0x563d62d0f390 2024-09-21T04:00:41.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.793+0000 7fc4257fa640 1 -- 172.21.15.46:0/81392105 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4180054d0 con 0x563d62d0f390 2024-09-21T04:00:41.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.793+0000 7fc4257fa640 1 -- 172.21.15.46:0/81392105 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc418004e60 con 0x563d62d0f390 2024-09-21T04:00:41.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.794+0000 7fc43bf7d740 1 -- 172.21.15.46:0/81392105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d62d0f390 msgr2=0x563d630dfaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:41.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.794+0000 7fc43bf7d740 1 --2- 172.21.15.46:0/81392105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d62d0f390 0x563d630dfaf0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fc418011cb0 tx=0x7fc4180097f0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.794+0000 7fc43bf7d740 1 -- 172.21.15.46:0/81392105 shutdown_connections 2024-09-21T04:00:41.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.794+0000 7fc43bf7d740 1 --2- 172.21.15.46:0/81392105 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d62d30070 0x563d630e0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.794+0000 7fc43bf7d740 1 --2- 172.21.15.46:0/81392105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d62d0f390 0x563d630dfaf0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.794+0000 7fc43bf7d740 1 --2- 172.21.15.46:0/81392105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d62d071b0 0x563d630e4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.794+0000 7fc43bf7d740 1 -- 172.21.15.46:0/81392105 >> 172.21.15.46:0/81392105 conn(0x563d62d24460 msgr2=0x563d630e3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:41.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.794+0000 7fc43bf7d740 1 -- 172.21.15.46:0/81392105 shutdown_connections 2024-09-21T04:00:41.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.794+0000 7fc43bf7d740 1 -- 172.21.15.46:0/81392105 wait complete. 2024-09-21T04:00:41.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.794+0000 7fc43bf7d740 1 -- start start 2024-09-21T04:00:41.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.795+0000 7fc43bf7d740 1 Processor -- start 2024-09-21T04:00:41.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.795+0000 7fc43bf7d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d62d071b0 0x563d630eb620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:41.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.795+0000 7fc43bf7d740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d62d0f390 0x563d630e6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:41.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.795+0000 7fc43bf7d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d62d30070 0x563d630e71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:41.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.795+0000 7fc43bf7d740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc4301ae110 con 0x563d62d0f390 2024-09-21T04:00:41.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.795+0000 7fc43bf7d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc4301af580 con 0x563d62d071b0 2024-09-21T04:00:41.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.795+0000 7fc43bf7d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc4301ae7e0 con 0x563d62d30070 2024-09-21T04:00:41.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.795+0000 7fc43bf7d740 10 client.0 _ll_register_callbacks cb 0x7fc428009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:00:41.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.795+0000 7fc4267fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d62d0f390 0x563d630e6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:41.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.795+0000 7fc4267fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d62d0f390 0x563d630e6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54104/0 (socket says 172.21.15.46:54104) 2024-09-21T04:00:41.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.795+0000 7fc4267fc640 1 -- 172.21.15.46:0/2457113142 learned_addr learned my addr 172.21.15.46:0/2457113142 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:00:41.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.795+0000 7fc42f7fe640 1 --2- 172.21.15.46:0/2457113142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d62d30070 0x563d630e71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:41.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.795+0000 7fc4267fc640 1 -- 172.21.15.46:0/2457113142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d62d30070 msgr2=0x563d630e71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:41.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.795+0000 7fc4267fc640 1 --2- 172.21.15.46:0/2457113142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d62d30070 0x563d630e71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.795+0000 7fc42effd640 1 --2- 172.21.15.46:0/2457113142 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d62d071b0 0x563d630eb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:41.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.795+0000 7fc4267fc640 1 -- 172.21.15.46:0/2457113142 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d62d071b0 msgr2=0x563d630eb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:41.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.796+0000 7fc4267fc640 1 --2- 172.21.15.46:0/2457113142 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d62d071b0 0x563d630eb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.796+0000 7fc4267fc640 1 -- 172.21.15.46:0/2457113142 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d630e7930 con 0x563d62d0f390 2024-09-21T04:00:41.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.796+0000 7fc42effd640 1 --2- 172.21.15.46:0/2457113142 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d62d071b0 0x563d630eb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:00:41.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.796+0000 7fc4267fc640 1 --2- 172.21.15.46:0/2457113142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d62d0f390 0x563d630e6b20 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fc418006010 tx=0x7fc4180057e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e457ab5a5e0a525f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:41.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.796+0000 7fc40effd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:00:41.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.796+0000 7fc40effd640 1 -- 172.21.15.46:0/2457113142 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc418029040 con 0x563d62d0f390 2024-09-21T04:00:41.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.796+0000 7fc40effd640 1 -- 172.21.15.46:0/2457113142 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fc418004930 con 0x563d62d0f390 2024-09-21T04:00:41.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.796+0000 7fc43bf7d740 1 -- 172.21.15.46:0/2457113142 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4180054d0 con 0x563d62d0f390 2024-09-21T04:00:41.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.797+0000 7fc40effd640 1 -- 172.21.15.46:0/2457113142 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc418004b30 con 0x563d62d0f390 2024-09-21T04:00:41.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.797+0000 7fc43bf7d740 10 client.16317 fetch_fsmap learned FSMap version 20 2024-09-21T04:00:41.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.797+0000 7fc43bf7d740 1 -- 172.21.15.46:0/2457113142 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x563d6315f700 con 0x563d62d0f390 2024-09-21T04:00:41.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.797+0000 7fc40effd640 1 -- 172.21.15.46:0/2457113142 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4180054d0 con 0x563d62d0f390 2024-09-21T04:00:41.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.797+0000 7fc40effd640 1 -- 172.21.15.46:0/2457113142 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc418025600 con 0x563d62d0f390 2024-09-21T04:00:41.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.797+0000 7fc43bf7d740 10 client.16317 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:00:41.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.797+0000 7fc43bf7d740 10 client.16317 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:00:41.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.797+0000 7fc43bf7d740 20 client.16317 populate_metadata read hostname 'smithi046' 2024-09-21T04:00:41.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.797+0000 7fc43bf7d740 1 --2- 172.21.15.46:0/2457113142 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x563d62cc3da0 0x563d63161c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:41.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.797+0000 7fc43bf7d740 4 client.16317 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T04:00:41.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.797+0000 7fc43bf7d740 1 -- 172.21.15.46:0/2457113142 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563d6304b850 con 0x563d62cc3da0 2024-09-21T04:00:41.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.798+0000 7fc42effd640 1 --2- 172.21.15.46:0/2457113142 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x563d62cc3da0 0x563d63161c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:41.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.798+0000 7fc42effd640 1 --2- 172.21.15.46:0/2457113142 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x563d62cc3da0 0x563d63161c20 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7216ddc9ae1bf604 server_cookie=b6c647f34c252f8f in_seq=0 out_seq=0 2024-09-21T04:00:41.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.798+0000 7fc40effd640 10 client.16317 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:00:41.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.799+0000 7fc40effd640 1 -- 172.21.15.46:0/2457113142 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3694 (crc 0 0 0) 0x563d6304b850 con 0x563d62cc3da0 2024-09-21T04:00:41.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.799+0000 7fc40effd640 10 client.16317 handle_command_reply: tid=0 2024-09-21T04:00:41.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.799+0000 7fc43bf7d740 1 client.16317 shutdown 2024-09-21T04:00:41.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.799+0000 7fc43bf7d740 1 -- 172.21.15.46:0/2457113142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d62d0f390 msgr2=0x563d630e6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:41.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.799+0000 7fc43bf7d740 1 --2- 172.21.15.46:0/2457113142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d62d0f390 0x563d630e6b20 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fc418006010 tx=0x7fc4180057e0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.799+0000 7fc43bf7d740 1 -- 172.21.15.46:0/2457113142 shutdown_connections 2024-09-21T04:00:41.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.799+0000 7fc43bf7d740 1 --2- 172.21.15.46:0/2457113142 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x563d62cc3da0 0x563d63161c20 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.799+0000 7fc40effd640 0 client.16317 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:00:41.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.799+0000 7fc43bf7d740 1 --2- 172.21.15.46:0/2457113142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563d62d30070 0x563d630e71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.799+0000 7fc43bf7d740 1 --2- 172.21.15.46:0/2457113142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d62d0f390 0x563d630e6b20 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.799+0000 7fc43bf7d740 1 --2- 172.21.15.46:0/2457113142 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563d62d071b0 0x563d630eb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.799+0000 7fc43bf7d740 1 -- 172.21.15.46:0/2457113142 >> 172.21.15.46:0/2457113142 conn(0x563d62d24460 msgr2=0x563d630d82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:41.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.799+0000 7fc43bf7d740 1 -- 172.21.15.46:0/2457113142 shutdown_connections 2024-09-21T04:00:41.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.799+0000 7fc43bf7d740 1 -- 172.21.15.46:0/2457113142 wait complete. 2024-09-21T04:00:41.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.799+0000 7fc43bf7d740 20 client.16317 trim_cache size 0 max 16384 2024-09-21T04:00:41.806 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T04:00:41.806 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T04:00:41.806 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2024-09-21T04:00:41.806 INFO:teuthology.orchestra.run.smithi046.stdout: "edc4b8c7-b702-489d-a925-ae7ad0ff0d9a": { 2024-09-21T04:00:41.806 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:00:41.806 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "edc4b8c7-b702-489d-a925-ae7ad0ff0d9a", 2024-09-21T04:00:41.807 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2024-09-21T04:00:41.807 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:00:41.807 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:00:41.807 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_stats": { 2024-09-21T04:00:41.807 INFO:teuthology.orchestra.run.smithi046.stdout: "0d781b95-cf5e-46f2-9875-2923181385e2": { 2024-09-21T04:00:41.807 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:00:33.099094+0000", 2024-09-21T04:00:41.807 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:00:41.807 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:00:41.807 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:00:41.807 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:00:41.807 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:00:41.807 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:00:41.807 INFO:teuthology.orchestra.run.smithi046.stdout: "326aaecf-f38a-4946-988a-d83f25556995": { 2024-09-21T04:00:41.807 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:54.189884+0000", 2024-09-21T04:00:41.808 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:00:41.808 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:00:41.808 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:00:41.808 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:00:41.808 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:00:41.808 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:00:41.808 INFO:teuthology.orchestra.run.smithi046.stdout: "46bb5415-6e16-47c6-a1e4-55f9c623ce90": { 2024-09-21T04:00:41.808 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:14.950674+0000", 2024-09-21T04:00:41.808 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:00:41.808 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:00:41.808 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:00:41.808 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:00:41.808 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:00:41.809 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:00:41.809 INFO:teuthology.orchestra.run.smithi046.stdout: "6103c660-8e77-4b06-ad6c-bb322c26035a": { 2024-09-21T04:00:41.809 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:35.594467+0000", 2024-09-21T04:00:41.809 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:00:41.809 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:00:41.809 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:00:41.809 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:00:41.809 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:00:41.809 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:00:41.809 INFO:teuthology.orchestra.run.smithi046.stdout: "dab67652-8894-4711-be64-cbdfea27a9ba": { 2024-09-21T04:00:41.809 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:28.161616+0000", 2024-09-21T04:00:41.809 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:00:41.809 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:00:41.809 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:00:41.810 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:00:41.810 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:00:41.810 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:00:41.810 INFO:teuthology.orchestra.run.smithi046.stdout: "c47f458a-de5e-4952-a575-a81261953667": { 2024-09-21T04:00:41.810 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:48.699411+0000", 2024-09-21T04:00:41.810 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:00:41.810 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:00:41.810 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:00:41.810 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:00:41.810 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:00:41.810 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:00:41.810 INFO:teuthology.orchestra.run.smithi046.stdout: "e24ec8f1-0d13-478f-9c2c-b51798868ffc": { 2024-09-21T04:00:41.811 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:09.736194+0000", 2024-09-21T04:00:41.811 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:00:41.811 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:00:41.811 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:00:41.811 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:00:41.811 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:00:41.811 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:00:41.811 INFO:teuthology.orchestra.run.smithi046.stdout: "edc4b8c7-b702-489d-a925-ae7ad0ff0d9a": { 2024-09-21T04:00:41.811 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:00:40.181950+0000", 2024-09-21T04:00:41.811 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:00:41.811 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:00:41.811 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:00:41.811 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:00:41.811 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:00:41.812 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:00:41.812 INFO:teuthology.orchestra.run.smithi046.stdout: "a871f724-0198-493c-b03e-b2de78aba243": { 2024-09-21T04:00:41.812 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:56:30.082991+0000", 2024-09-21T04:00:41.812 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:00:41.812 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:00:41.812 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:00:41.812 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:00:41.812 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:00:41.812 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:00:41.812 INFO:teuthology.orchestra.run.smithi046.stdout: "d49f33a7-3d5a-421b-94ba-8b19a4120db1": { 2024-09-21T04:00:41.812 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:50.480786+0000", 2024-09-21T04:00:41.812 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:00:41.813 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:00:41.813 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:00:41.813 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:00:41.813 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:00:41.813 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:00:41.813 INFO:teuthology.orchestra.run.smithi046.stdout: "3bbf7097-70d7-4743-bbce-41465502b35b": { 2024-09-21T04:00:41.813 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:10.661441+0000", 2024-09-21T04:00:41.813 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:00:41.813 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:00:41.813 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:00:41.813 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:00:41.813 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:00:41.813 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:00:41.814 INFO:teuthology.orchestra.run.smithi046.stdout: "08f0c962-df1a-4129-a1a2-b916240d9803": { 2024-09-21T04:00:41.814 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:02.937596+0000", 2024-09-21T04:00:41.814 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:00:41.814 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:00:41.814 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:00:41.814 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:00:41.814 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:00:41.814 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:00:41.814 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:00:41.814 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T04:00:41.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.800+0000 7fc435a09640 1 -- 172.21.15.46:0/2166903410 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc41c0b6680 msgr2=0x7fc41c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:41.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.800+0000 7fc435a09640 1 --2- 172.21.15.46:0/2166903410 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc41c0b6680 0x7fc41c0b8b90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x563d630d5ef0 tx=0x7fc420005f90 comp rx=0 tx=0).stop 2024-09-21T04:00:41.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.800+0000 7fc435a09640 1 -- 172.21.15.46:0/2166903410 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc430109e10 msgr2=0x7fc43019fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:41.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.800+0000 7fc435a09640 1 --2- 172.21.15.46:0/2166903410 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc430109e10 0x7fc43019fc30 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fc428005cc0 tx=0x7fc428031700 comp rx=0 tx=0).stop 2024-09-21T04:00:41.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.800+0000 7fc435a09640 1 -- 172.21.15.46:0/2166903410 shutdown_connections 2024-09-21T04:00:41.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.800+0000 7fc435a09640 1 --2- 172.21.15.46:0/2166903410 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc430109e10 0x7fc43019fc30 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.800+0000 7fc435a09640 1 --2- 172.21.15.46:0/2166903410 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc41c0b6680 0x7fc41c0b8b90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.800+0000 7fc435a09640 1 --2- 172.21.15.46:0/2166903410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4301094c0 0x7fc43019a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.800+0000 7fc435a09640 1 --2- 172.21.15.46:0/2166903410 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc430101fe0 0x7fc43019a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.800+0000 7fc435a09640 1 -- 172.21.15.46:0/2166903410 >> 172.21.15.46:0/2166903410 conn(0x7fc430077bc0 msgr2=0x7fc4301053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:41.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.803+0000 7fc435a09640 1 -- 172.21.15.46:0/2166903410 shutdown_connections 2024-09-21T04:00:41.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:00:41.803+0000 7fc435a09640 1 -- 172.21.15.46:0/2166903410 wait complete. 2024-09-21T04:00:42.067 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:41 smithi105 ceph-mon[34773]: pgmap v489: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T04:00:42.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:41 smithi162 ceph-mon[35071]: pgmap v489: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T04:00:42.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:41 smithi046 ceph-mon[30954]: pgmap v489: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T04:00:42.590 INFO:tasks.cephfs.filesystem:scrub status for tag:edc4b8c7-b702-489d-a925-ae7ad0ff0d9a - {'path': '/', 'tag': 'edc4b8c7-b702-489d-a925-ae7ad0ff0d9a', 'options': 'recursive,force'} 2024-09-21T04:00:44.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:43 smithi105 ceph-mon[34773]: pgmap v490: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-21T04:00:44.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:43 smithi105 ceph-mon[34773]: scrub summary: idle 2024-09-21T04:00:44.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:43 smithi162 ceph-mon[35071]: pgmap v490: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-21T04:00:44.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:43 smithi162 ceph-mon[35071]: scrub summary: idle 2024-09-21T04:00:44.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:43 smithi046 ceph-mon[30954]: pgmap v490: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-21T04:00:44.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:43 smithi046 ceph-mon[30954]: scrub summary: idle 2024-09-21T04:00:46.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:45 smithi105 ceph-mon[34773]: pgmap v491: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 4 op/s 2024-09-21T04:00:46.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:45 smithi162 ceph-mon[35071]: pgmap v491: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 4 op/s 2024-09-21T04:00:46.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:45 smithi046 ceph-mon[30954]: pgmap v491: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 4 op/s 2024-09-21T04:00:48.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:47 smithi105 ceph-mon[34773]: pgmap v492: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 3 op/s 2024-09-21T04:00:48.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:47 smithi162 ceph-mon[35071]: pgmap v492: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 3 op/s 2024-09-21T04:00:48.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:47 smithi046 ceph-mon[30954]: pgmap v492: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 3 op/s 2024-09-21T04:00:50.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:49 smithi105 ceph-mon[34773]: pgmap v493: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 4 op/s 2024-09-21T04:00:50.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:49 smithi162 ceph-mon[35071]: pgmap v493: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 4 op/s 2024-09-21T04:00:50.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:49 smithi046 ceph-mon[30954]: pgmap v493: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 4 op/s 2024-09-21T04:00:52.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:51 smithi105 ceph-mon[34773]: pgmap v494: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T04:00:52.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:51 smithi162 ceph-mon[35071]: pgmap v494: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T04:00:52.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:51 smithi046 ceph-mon[30954]: pgmap v494: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T04:00:54.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:53 smithi162 ceph-mon[35071]: pgmap v495: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-21T04:00:54.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:53 smithi046 ceph-mon[30954]: pgmap v495: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-21T04:00:54.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:53 smithi105 ceph-mon[34773]: pgmap v495: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-21T04:00:56.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:55 smithi162 ceph-mon[35071]: pgmap v496: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2 op/s 2024-09-21T04:00:56.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:55 smithi046 ceph-mon[30954]: pgmap v496: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2 op/s 2024-09-21T04:00:56.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:55 smithi105 ceph-mon[34773]: pgmap v496: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2 op/s 2024-09-21T04:00:58.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:57 smithi162 ceph-mon[35071]: pgmap v497: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:00:58.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:57 smithi046 ceph-mon[30954]: pgmap v497: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:00:58.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:57 smithi105 ceph-mon[34773]: pgmap v497: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:01:00.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:00:59 smithi162 ceph-mon[35071]: pgmap v498: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:01:00.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:00:59 smithi046 ceph-mon[30954]: pgmap v498: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:01:00.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:00:59 smithi105 ceph-mon[34773]: pgmap v498: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:01:02.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:01 smithi162 ceph-mon[35071]: pgmap v499: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:01:02.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:01 smithi046 ceph-mon[30954]: pgmap v499: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:01:02.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:01 smithi105 ceph-mon[34773]: pgmap v499: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:01:04.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:03 smithi162 ceph-mon[35071]: pgmap v500: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-21T04:01:04.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:03 smithi046 ceph-mon[30954]: pgmap v500: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-21T04:01:04.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:03 smithi105 ceph-mon[34773]: pgmap v500: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-21T04:01:06.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:05 smithi162 ceph-mon[35071]: pgmap v501: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T04:01:06.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:05 smithi046 ceph-mon[30954]: pgmap v501: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T04:01:06.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:05 smithi105 ceph-mon[34773]: pgmap v501: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T04:01:08.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:07 smithi162 ceph-mon[35071]: pgmap v502: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T04:01:08.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:07 smithi046 ceph-mon[30954]: pgmap v502: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T04:01:08.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:07 smithi105 ceph-mon[34773]: pgmap v502: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T04:01:10.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:09 smithi162 ceph-mon[35071]: pgmap v503: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T04:01:10.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:09 smithi046 ceph-mon[30954]: pgmap v503: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T04:01:10.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:09 smithi105 ceph-mon[34773]: pgmap v503: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T04:01:12.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:11 smithi162 ceph-mon[35071]: pgmap v504: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T04:01:12.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:11 smithi046 ceph-mon[30954]: pgmap v504: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T04:01:12.317 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:11 smithi105 ceph-mon[34773]: pgmap v504: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T04:01:12.591 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T04:01:12.871 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:13.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.408+0000 7f90f359e640 1 -- 172.21.15.46:0/2685294573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90f41092d0 msgr2=0x7f90f41096e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:13.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.408+0000 7f90f359e640 1 --2- 172.21.15.46:0/2685294573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90f41092d0 0x7f90f41096e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f90dc009900 tx=0x7f90dc02a3f0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.408+0000 7f90f359e640 1 -- 172.21.15.46:0/2685294573 shutdown_connections 2024-09-21T04:01:13.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.408+0000 7f90f359e640 1 --2- 172.21.15.46:0/2685294573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90f4109c20 0x7f90f4110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.408+0000 7f90f359e640 1 --2- 172.21.15.46:0/2685294573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90f41092d0 0x7f90f41096e0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.408+0000 7f90f359e640 1 --2- 172.21.15.46:0/2685294573 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90f4103990 0x7f90f4103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.408+0000 7f90f359e640 1 -- 172.21.15.46:0/2685294573 >> 172.21.15.46:0/2685294573 conn(0x7f90f40ff3e0 msgr2=0x7f90f4101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:13.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.408+0000 7f90f359e640 1 -- 172.21.15.46:0/2685294573 shutdown_connections 2024-09-21T04:01:13.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.408+0000 7f90f359e640 1 -- 172.21.15.46:0/2685294573 wait complete. 2024-09-21T04:01:13.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.409+0000 7f90f359e640 1 Processor -- start 2024-09-21T04:01:13.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.409+0000 7f90f359e640 1 -- start start 2024-09-21T04:01:13.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.409+0000 7f90f359e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90f4103990 0x7f90f419a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:13.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.409+0000 7f90f359e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90f41092d0 0x7f90f419a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:13.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.409+0000 7f90f359e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90f4109c20 0x7f90f419fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:13.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.409+0000 7f90f359e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f90f41138e0 con 0x7f90f4109c20 2024-09-21T04:01:13.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.409+0000 7f90f359e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f90f4113760 con 0x7f90f41092d0 2024-09-21T04:01:13.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.409+0000 7f90f359e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f90f4113a60 con 0x7f90f4103990 2024-09-21T04:01:13.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.410+0000 7f90f2d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90f4109c20 0x7f90f419fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:13.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.410+0000 7f90f2d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90f4109c20 0x7f90f419fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42480/0 (socket says 172.21.15.46:42480) 2024-09-21T04:01:13.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.410+0000 7f90f2d9d640 1 -- 172.21.15.46:0/4193982541 learned_addr learned my addr 172.21.15.46:0/4193982541 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:13.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.410+0000 7f90f259c640 1 --2- 172.21.15.46:0/4193982541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90f4103990 0x7f90f419a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:13.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.410+0000 7f90f1d9b640 1 --2- 172.21.15.46:0/4193982541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90f41092d0 0x7f90f419a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:13.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.410+0000 7f90f2d9d640 1 -- 172.21.15.46:0/4193982541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90f4103990 msgr2=0x7f90f419a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:13.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.410+0000 7f90f2d9d640 1 --2- 172.21.15.46:0/4193982541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90f4103990 0x7f90f419a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.410+0000 7f90f2d9d640 1 -- 172.21.15.46:0/4193982541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90f41092d0 msgr2=0x7f90f419a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:13.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.410+0000 7f90f2d9d640 1 --2- 172.21.15.46:0/4193982541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90f41092d0 0x7f90f419a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.410+0000 7f90f2d9d640 1 -- 172.21.15.46:0/4193982541 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90f41a01c0 con 0x7f90f4109c20 2024-09-21T04:01:13.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.410+0000 7f90f2d9d640 1 --2- 172.21.15.46:0/4193982541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90f4109c20 0x7f90f419fb50 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f90ec00d750 tx=0x7f90ec00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:13.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.410+0000 7f90eb7fe640 1 -- 172.21.15.46:0/4193982541 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ec017070 con 0x7f90f4109c20 2024-09-21T04:01:13.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.410+0000 7f90f359e640 1 -- 172.21.15.46:0/4193982541 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90f41a04b0 con 0x7f90f4109c20 2024-09-21T04:01:13.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.410+0000 7f90eb7fe640 1 -- 172.21.15.46:0/4193982541 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90ec0054d0 con 0x7f90f4109c20 2024-09-21T04:01:13.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.411+0000 7f90eb7fe640 1 -- 172.21.15.46:0/4193982541 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ec004c60 con 0x7f90f4109c20 2024-09-21T04:01:13.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.411+0000 7f90f359e640 1 -- 172.21.15.46:0/4193982541 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90f41a0970 con 0x7f90f4109c20 2024-09-21T04:01:13.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.413+0000 7f90ff173740 1 Processor -- start 2024-09-21T04:01:13.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.414+0000 7f90eb7fe640 1 -- 172.21.15.46:0/4193982541 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f90ec004e00 con 0x7f90f4109c20 2024-09-21T04:01:13.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.414+0000 7f90ff173740 1 -- start start 2024-09-21T04:01:13.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.415+0000 7f90ff173740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fabcf23070 0x55fabd2ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:13.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.415+0000 7f90ff173740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fabcefa1b0 0x55fabd2ca950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:13.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.415+0000 7f90ff173740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fabcf02390 0x55fabd2cae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:13.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.415+0000 7f90ff173740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55fabd240e50 con 0x55fabcf02390 2024-09-21T04:01:13.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.415+0000 7f90ff173740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55fabd230280 con 0x55fabcf23070 2024-09-21T04:01:13.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.415+0000 7f90ff173740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fabd234090 con 0x55fabcefa1b0 2024-09-21T04:01:13.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.415+0000 7f90f1d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fabcf02390 0x55fabd2cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:13.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.415+0000 7f90f1d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fabcf02390 0x55fabd2cae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42490/0 (socket says 172.21.15.46:42490) 2024-09-21T04:01:13.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.415+0000 7f90f1d9b640 1 -- 172.21.15.46:0/4151937698 learned_addr learned my addr 172.21.15.46:0/4151937698 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:13.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.415+0000 7f90f259c640 1 --2- 172.21.15.46:0/4151937698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fabcefa1b0 0x55fabd2ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:13.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.415+0000 7f90f1d9b640 1 --2- 172.21.15.46:0/4151937698 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fabcf23070 0x55fabd2ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:13.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.415+0000 7f90f259c640 1 -- 172.21.15.46:0/4151937698 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fabcf23070 msgr2=0x55fabd2ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:13.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.415+0000 7f90f259c640 1 --2- 172.21.15.46:0/4151937698 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fabcf23070 0x55fabd2ca410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.415+0000 7f90f259c640 1 -- 172.21.15.46:0/4151937698 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fabcf02390 msgr2=0x55fabd2cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:13.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.415+0000 7f90f259c640 1 --2- 172.21.15.46:0/4151937698 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fabcf02390 0x55fabd2cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.415+0000 7f90f259c640 1 -- 172.21.15.46:0/4151937698 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fabcf8e650 con 0x55fabcefa1b0 2024-09-21T04:01:13.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.415+0000 7f90f1d9b640 1 --2- 172.21.15.46:0/4151937698 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fabcf02390 0x55fabd2cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:01:13.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.415+0000 7f90eb7fe640 1 --2- 172.21.15.46:0/4193982541 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f90e00b66b0 0x7f90e00b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:13.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.415+0000 7f90f1d9b640 1 --2- 172.21.15.46:0/4193982541 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f90e00b66b0 0x7f90e00b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:13.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.416+0000 7f90f259c640 1 --2- 172.21.15.46:0/4151937698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fabcefa1b0 0x55fabd2ca950 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f90e4007ed0 tx=0x7f90e400f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99f3b3f0b588c020 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:13.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.416+0000 7f90eb7fe640 1 -- 172.21.15.46:0/4193982541 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f90ec0e6fd0 con 0x7f90f4109c20 2024-09-21T04:01:13.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.416+0000 7f90e8ff9640 1 -- 172.21.15.46:0/4151937698 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e4004d20 con 0x55fabcefa1b0 2024-09-21T04:01:13.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.416+0000 7f90e8ff9640 1 -- 172.21.15.46:0/4151937698 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90e4010af0 con 0x55fabcefa1b0 2024-09-21T04:01:13.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.416+0000 7f90e8ff9640 1 -- 172.21.15.46:0/4151937698 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e4005650 con 0x55fabcefa1b0 2024-09-21T04:01:13.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.417+0000 7f90ff173740 1 -- 172.21.15.46:0/4151937698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fabcefa1b0 msgr2=0x55fabd2ca950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:13.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.417+0000 7f90f1d9b640 1 --2- 172.21.15.46:0/4193982541 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f90e00b66b0 0x7f90e00b8bc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f90dc032fd0 tx=0x7f90dc000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:13.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.417+0000 7f90ff173740 1 --2- 172.21.15.46:0/4151937698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fabcefa1b0 0x55fabd2ca950 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f90e4007ed0 tx=0x7f90e400f790 comp rx=0 tx=0).stop 2024-09-21T04:01:13.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.417+0000 7f90ff173740 1 -- 172.21.15.46:0/4151937698 shutdown_connections 2024-09-21T04:01:13.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.417+0000 7f90ff173740 1 --2- 172.21.15.46:0/4151937698 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fabcf02390 0x55fabd2cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.417+0000 7f90ff173740 1 --2- 172.21.15.46:0/4151937698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fabcefa1b0 0x55fabd2ca950 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.417+0000 7f90ff173740 1 --2- 172.21.15.46:0/4151937698 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fabcf23070 0x55fabd2ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.417+0000 7f90ff173740 1 -- 172.21.15.46:0/4151937698 >> 172.21.15.46:0/4151937698 conn(0x55fabcf17460 msgr2=0x55fabd2c8300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:13.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.417+0000 7f90ff173740 1 -- 172.21.15.46:0/4151937698 shutdown_connections 2024-09-21T04:01:13.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.417+0000 7f90ff173740 1 -- 172.21.15.46:0/4151937698 wait complete. 2024-09-21T04:01:13.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.417+0000 7f90ff173740 1 -- start start 2024-09-21T04:01:13.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.417+0000 7f90ff173740 1 Processor -- start 2024-09-21T04:01:13.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.418+0000 7f90ff173740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fabcefa1b0 0x55fabd2d5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:13.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.418+0000 7f90ff173740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fabcf02390 0x55fabd2d5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:13.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.418+0000 7f90ff173740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fabcf23070 0x55fabd2e1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:13.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.418+0000 7f90ff173740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55fabd091700 con 0x55fabcf02390 2024-09-21T04:01:13.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.418+0000 7f90ff173740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55fabd1cb110 con 0x55fabcf23070 2024-09-21T04:01:13.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.418+0000 7f90ff173740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fabd2d8bf0 con 0x55fabcefa1b0 2024-09-21T04:01:13.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.418+0000 7f90ff173740 10 client.0 _ll_register_callbacks cb 0x55fabd1e4990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:01:13.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.418+0000 7f90f1d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fabcf02390 0x55fabd2d5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:13.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.418+0000 7f90f1d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fabcf02390 0x55fabd2d5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42502/0 (socket says 172.21.15.46:42502) 2024-09-21T04:01:13.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.418+0000 7f90f1d9b640 1 -- 172.21.15.46:0/4168930213 learned_addr learned my addr 172.21.15.46:0/4168930213 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:13.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.418+0000 7f90f259c640 1 --2- 172.21.15.46:0/4168930213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fabcefa1b0 0x55fabd2d5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:13.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.418+0000 7f90f2d9d640 1 --2- 172.21.15.46:0/4168930213 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fabcf23070 0x55fabd2e1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:13.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.418+0000 7f90f1d9b640 1 -- 172.21.15.46:0/4168930213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fabcefa1b0 msgr2=0x55fabd2d5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:13.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.418+0000 7f90f1d9b640 1 --2- 172.21.15.46:0/4168930213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fabcefa1b0 0x55fabd2d5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.418+0000 7f90f1d9b640 1 -- 172.21.15.46:0/4168930213 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fabcf23070 msgr2=0x55fabd2e1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:13.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.418+0000 7f90f1d9b640 1 --2- 172.21.15.46:0/4168930213 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fabcf23070 0x55fabd2e1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.418+0000 7f90f1d9b640 1 -- 172.21.15.46:0/4168930213 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fabd1f8c40 con 0x55fabcf02390 2024-09-21T04:01:13.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.419+0000 7f90f1d9b640 1 --2- 172.21.15.46:0/4168930213 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fabcf02390 0x55fabd2d5fc0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f90dc031a70 tx=0x7f90dc031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a43e8bc77bb713c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:13.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.419+0000 7f90d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:01:13.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.419+0000 7f90d9ffb640 1 -- 172.21.15.46:0/4168930213 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90dc050070 con 0x55fabcf02390 2024-09-21T04:01:13.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.419+0000 7f90d9ffb640 1 -- 172.21.15.46:0/4168930213 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f90dc003ac0 con 0x55fabcf02390 2024-09-21T04:01:13.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.419+0000 7f90ff173740 1 -- 172.21.15.46:0/4168930213 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90e4010af0 con 0x55fabcf02390 2024-09-21T04:01:13.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.419+0000 7f90d9ffb640 1 -- 172.21.15.46:0/4168930213 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f90dc059030 con 0x55fabcf02390 2024-09-21T04:01:13.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.419+0000 7f90ff173740 10 client.16329 fetch_fsmap learned FSMap version 20 2024-09-21T04:01:13.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.419+0000 7f90ff173740 1 -- 172.21.15.46:0/4168930213 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55fabd2e48c0 con 0x55fabcf02390 2024-09-21T04:01:13.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.419+0000 7f90d9ffb640 1 -- 172.21.15.46:0/4168930213 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90e4010af0 con 0x55fabcf02390 2024-09-21T04:01:13.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.419+0000 7f90d9ffb640 1 -- 172.21.15.46:0/4168930213 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f90dc004980 con 0x55fabcf02390 2024-09-21T04:01:13.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.419+0000 7f90ff173740 10 client.16329 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:01:13.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.419+0000 7f90ff173740 10 client.16329 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:01:13.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.419+0000 7f90ff173740 20 client.16329 populate_metadata read hostname 'smithi046' 2024-09-21T04:01:13.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.419+0000 7f90ff173740 1 --2- 172.21.15.46:0/4168930213 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55fabcee19f0 0x55fabd2e7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:13.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.420+0000 7f90ff173740 4 client.16329 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:01:13.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.420+0000 7f90ff173740 1 -- 172.21.15.46:0/4168930213 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fabd242da0 con 0x55fabcee19f0 2024-09-21T04:01:13.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.420+0000 7f90f259c640 1 --2- 172.21.15.46:0/4168930213 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55fabcee19f0 0x55fabd2e7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:13.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.420+0000 7f90d9ffb640 10 client.16329 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:01:13.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.420+0000 7f90f259c640 1 --2- 172.21.15.46:0/4168930213 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55fabcee19f0 0x55fabd2e7dc0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=651359ee9e9eba5d server_cookie=73e24c584c7d1a32 in_seq=0 out_seq=0 2024-09-21T04:01:13.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.421+0000 7f90d9ffb640 1 -- 172.21.15.46:0/4168930213 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fabd242da0 con 0x55fabcee19f0 2024-09-21T04:01:13.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.421+0000 7f90d9ffb640 10 client.16329 handle_command_reply: tid=0 2024-09-21T04:01:13.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.421+0000 7f90ff173740 1 client.16329 shutdown 2024-09-21T04:01:13.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.421+0000 7f90ff173740 1 -- 172.21.15.46:0/4168930213 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fabcf02390 msgr2=0x55fabd2d5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:13.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.421+0000 7f90ff173740 1 --2- 172.21.15.46:0/4168930213 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fabcf02390 0x55fabd2d5fc0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f90dc031a70 tx=0x7f90dc031400 comp rx=0 tx=0).stop 2024-09-21T04:01:13.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.421+0000 7f90ff173740 1 -- 172.21.15.46:0/4168930213 shutdown_connections 2024-09-21T04:01:13.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.421+0000 7f90ff173740 1 --2- 172.21.15.46:0/4168930213 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55fabcee19f0 0x55fabd2e7dc0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.421+0000 7f90ff173740 1 --2- 172.21.15.46:0/4168930213 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fabcf23070 0x55fabd2e1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.421+0000 7f90ff173740 1 --2- 172.21.15.46:0/4168930213 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fabcf02390 0x55fabd2d5fc0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.421+0000 7f90ff173740 1 --2- 172.21.15.46:0/4168930213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fabcefa1b0 0x55fabd2d5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.421+0000 7f90ff173740 1 -- 172.21.15.46:0/4168930213 >> 172.21.15.46:0/4168930213 conn(0x55fabcf17460 msgr2=0x55fabd2cd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:13.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.421+0000 7f90d9ffb640 0 client.16329 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:01:13.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.422+0000 7f90ff173740 1 -- 172.21.15.46:0/4168930213 shutdown_connections 2024-09-21T04:01:13.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.422+0000 7f90ff173740 1 -- 172.21.15.46:0/4168930213 wait complete. 2024-09-21T04:01:13.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.422+0000 7f90ff173740 20 client.16329 trim_cache size 0 max 16384 2024-09-21T04:01:13.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.439+0000 7f90ff173740 1 Processor -- start 2024-09-21T04:01:13.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.439+0000 7f90ff173740 1 -- start start 2024-09-21T04:01:13.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.439+0000 7f90ff173740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fabcefa1b0 0x55fabd2cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:13.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.439+0000 7f90ff173740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fabcf02390 0x55fabd2d76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:13.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.439+0000 7f90ff173740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fabcf23070 0x55fabd2c7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:13.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.439+0000 7f90ff173740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f90f41ad2d0 con 0x55fabcf02390 2024-09-21T04:01:13.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.439+0000 7f90ff173740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f90f41afb70 con 0x55fabcefa1b0 2024-09-21T04:01:13.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.439+0000 7f90ff173740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f90f41ad960 con 0x55fabcf23070 2024-09-21T04:01:13.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.439+0000 7f90f1d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fabcf02390 0x55fabd2d76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:13.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.440+0000 7f90f1d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fabcf02390 0x55fabd2d76b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42516/0 (socket says 172.21.15.46:42516) 2024-09-21T04:01:13.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.440+0000 7f90f1d9b640 1 -- 172.21.15.46:0/2031164104 learned_addr learned my addr 172.21.15.46:0/2031164104 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:13.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.440+0000 7f90f259c640 1 --2- 172.21.15.46:0/2031164104 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fabcefa1b0 0x55fabd2cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:13.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.440+0000 7f90f2d9d640 1 --2- 172.21.15.46:0/2031164104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fabcf23070 0x55fabd2c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:13.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.440+0000 7f90f1d9b640 1 -- 172.21.15.46:0/2031164104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fabcf23070 msgr2=0x55fabd2c7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:13.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.440+0000 7f90f1d9b640 1 --2- 172.21.15.46:0/2031164104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fabcf23070 0x55fabd2c7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.440+0000 7f90f1d9b640 1 -- 172.21.15.46:0/2031164104 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fabcefa1b0 msgr2=0x55fabd2cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:13.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.440+0000 7f90f1d9b640 1 --2- 172.21.15.46:0/2031164104 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fabcefa1b0 0x55fabd2cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.440+0000 7f90f1d9b640 1 -- 172.21.15.46:0/2031164104 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fabd2d6d40 con 0x55fabcf02390 2024-09-21T04:01:13.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.440+0000 7f90f1d9b640 1 --2- 172.21.15.46:0/2031164104 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fabcf02390 0x55fabd2d76b0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f90dc031a40 tx=0x7f90dc032cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b78e6aa76fc15464 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:13.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.440+0000 7f90dbfff640 1 -- 172.21.15.46:0/2031164104 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90dc062030 con 0x55fabcf02390 2024-09-21T04:01:13.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.440+0000 7f90dbfff640 1 -- 172.21.15.46:0/2031164104 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90dc0038c0 con 0x55fabcf02390 2024-09-21T04:01:13.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.440+0000 7f90dbfff640 1 -- 172.21.15.46:0/2031164104 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90dc050070 con 0x55fabcf02390 2024-09-21T04:01:13.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.441+0000 7f90ff173740 1 -- 172.21.15.46:0/2031164104 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fabcf02390 msgr2=0x55fabd2d76b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:13.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.441+0000 7f90ff173740 1 --2- 172.21.15.46:0/2031164104 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fabcf02390 0x55fabd2d76b0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f90dc031a40 tx=0x7f90dc032cf0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.441+0000 7f90ff173740 1 -- 172.21.15.46:0/2031164104 shutdown_connections 2024-09-21T04:01:13.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.441+0000 7f90ff173740 1 --2- 172.21.15.46:0/2031164104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fabcf23070 0x55fabd2c7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.441+0000 7f90ff173740 1 --2- 172.21.15.46:0/2031164104 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fabcf02390 0x55fabd2d76b0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.441+0000 7f90ff173740 1 --2- 172.21.15.46:0/2031164104 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fabcefa1b0 0x55fabd2cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.441+0000 7f90ff173740 1 -- 172.21.15.46:0/2031164104 >> 172.21.15.46:0/2031164104 conn(0x55fabcf17460 msgr2=0x55fabd2d6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:13.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.441+0000 7f90ff173740 1 -- 172.21.15.46:0/2031164104 shutdown_connections 2024-09-21T04:01:13.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.441+0000 7f90ff173740 1 -- 172.21.15.46:0/2031164104 wait complete. 2024-09-21T04:01:13.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.442+0000 7f90ff173740 1 -- start start 2024-09-21T04:01:13.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.442+0000 7f90ff173740 1 Processor -- start 2024-09-21T04:01:13.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.442+0000 7f90ff173740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fabcefa1b0 0x55fabd2de450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:13.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.442+0000 7f90ff173740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fabcf02390 0x55fabd2d9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:13.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.442+0000 7f90ff173740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fabcf23070 0x55fabd2d9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:13.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.442+0000 7f90ff173740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f90f41ae030 con 0x55fabcefa1b0 2024-09-21T04:01:13.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.442+0000 7f90ff173740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f90f41af4a0 con 0x55fabcf23070 2024-09-21T04:01:13.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.442+0000 7f90ff173740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f90f41ae700 con 0x55fabcf02390 2024-09-21T04:01:13.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.442+0000 7f90ff173740 10 client.0 _ll_register_callbacks cb 0x7f90dc032c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:01:13.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.442+0000 7f90f259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fabcefa1b0 0x55fabd2de450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:13.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.442+0000 7f90f259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fabcefa1b0 0x55fabd2de450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42520/0 (socket says 172.21.15.46:42520) 2024-09-21T04:01:13.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.442+0000 7f90f259c640 1 -- 172.21.15.46:0/3555012007 learned_addr learned my addr 172.21.15.46:0/3555012007 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:13.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.442+0000 7f90f1d9b640 1 --2- 172.21.15.46:0/3555012007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fabcf02390 0x55fabd2d9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:13.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.443+0000 7f90f259c640 1 -- 172.21.15.46:0/3555012007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fabcf02390 msgr2=0x55fabd2d9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:13.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.443+0000 7f90f259c640 1 --2- 172.21.15.46:0/3555012007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fabcf02390 0x55fabd2d9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.443+0000 7f90f259c640 1 -- 172.21.15.46:0/3555012007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fabcf23070 msgr2=0x55fabd2d9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:13.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.443+0000 7f90f2d9d640 1 --2- 172.21.15.46:0/3555012007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fabcf23070 0x55fabd2d9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:13.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.443+0000 7f90f259c640 1 --2- 172.21.15.46:0/3555012007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fabcf23070 0x55fabd2d9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.443+0000 7f90f259c640 1 -- 172.21.15.46:0/3555012007 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fabd2da400 con 0x55fabcefa1b0 2024-09-21T04:01:13.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.443+0000 7f90f1d9b640 1 --2- 172.21.15.46:0/3555012007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fabcf02390 0x55fabd2d9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:01:13.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.443+0000 7f90f2d9d640 1 --2- 172.21.15.46:0/3555012007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fabcf23070 0x55fabd2d9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:01:13.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.443+0000 7f90f259c640 1 --2- 172.21.15.46:0/3555012007 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fabcefa1b0 0x55fabd2de450 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f90e4018000 tx=0x7f90e40052d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbffd189802f6066 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:13.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.443+0000 7f90d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:01:13.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.443+0000 7f90d9ffb640 1 -- 172.21.15.46:0/3555012007 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e401d040 con 0x55fabcefa1b0 2024-09-21T04:01:13.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.443+0000 7f90d9ffb640 1 -- 172.21.15.46:0/3555012007 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f90e4010740 con 0x55fabcefa1b0 2024-09-21T04:01:13.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.443+0000 7f90ff173740 1 -- 172.21.15.46:0/3555012007 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90dc0038c0 con 0x55fabcefa1b0 2024-09-21T04:01:13.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.443+0000 7f90d9ffb640 1 -- 172.21.15.46:0/3555012007 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f90e403a050 con 0x55fabcefa1b0 2024-09-21T04:01:13.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.443+0000 7f90ff173740 10 client.16335 fetch_fsmap learned FSMap version 20 2024-09-21T04:01:13.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.443+0000 7f90ff173740 1 -- 172.21.15.46:0/3555012007 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55fabd356910 con 0x55fabcefa1b0 2024-09-21T04:01:13.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.443+0000 7f90d9ffb640 1 -- 172.21.15.46:0/3555012007 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90dc0038c0 con 0x55fabcefa1b0 2024-09-21T04:01:13.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.444+0000 7f90d9ffb640 1 -- 172.21.15.46:0/3555012007 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f90e4004a70 con 0x55fabcefa1b0 2024-09-21T04:01:13.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.444+0000 7f90ff173740 10 client.16335 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:01:13.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.444+0000 7f90ff173740 10 client.16335 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:01:13.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.444+0000 7f90ff173740 20 client.16335 populate_metadata read hostname 'smithi046' 2024-09-21T04:01:13.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.444+0000 7f90ff173740 1 --2- 172.21.15.46:0/3555012007 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55fabceb6da0 0x55fabd358e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:13.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.444+0000 7f90ff173740 4 client.16335 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T04:01:13.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.444+0000 7f90ff173740 1 -- 172.21.15.46:0/3555012007 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fabd23e850 con 0x55fabceb6da0 2024-09-21T04:01:13.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.444+0000 7f90f1d9b640 1 --2- 172.21.15.46:0/3555012007 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55fabceb6da0 0x55fabd358e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:13.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.444+0000 7f90d9ffb640 10 client.16335 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:01:13.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.444+0000 7f90f1d9b640 1 --2- 172.21.15.46:0/3555012007 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55fabceb6da0 0x55fabd358e20 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22ae5adb3ee4fb2d server_cookie=d2bce0671170fb6d in_seq=0 out_seq=0 2024-09-21T04:01:13.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.445+0000 7f90d9ffb640 1 -- 172.21.15.46:0/3555012007 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3498 (crc 0 0 0) 0x55fabd23e850 con 0x55fabceb6da0 2024-09-21T04:01:13.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.445+0000 7f90d9ffb640 10 client.16335 handle_command_reply: tid=0 2024-09-21T04:01:13.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.445+0000 7f90ff173740 1 client.16335 shutdown 2024-09-21T04:01:13.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.445+0000 7f90ff173740 1 -- 172.21.15.46:0/3555012007 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fabcefa1b0 msgr2=0x55fabd2de450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:13.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.445+0000 7f90ff173740 1 --2- 172.21.15.46:0/3555012007 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fabcefa1b0 0x55fabd2de450 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f90e4018000 tx=0x7f90e40052d0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.445+0000 7f90ff173740 1 -- 172.21.15.46:0/3555012007 shutdown_connections 2024-09-21T04:01:13.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.445+0000 7f90ff173740 1 --2- 172.21.15.46:0/3555012007 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55fabceb6da0 0x55fabd358e20 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.445+0000 7f90ff173740 1 --2- 172.21.15.46:0/3555012007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fabcf23070 0x55fabd2d9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.445+0000 7f90ff173740 1 --2- 172.21.15.46:0/3555012007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fabcf02390 0x55fabd2d9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.445+0000 7f90ff173740 1 --2- 172.21.15.46:0/3555012007 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fabcefa1b0 0x55fabd2de450 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.445+0000 7f90ff173740 1 -- 172.21.15.46:0/3555012007 >> 172.21.15.46:0/3555012007 conn(0x55fabcf17460 msgr2=0x55fabd2d78d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:13.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.445+0000 7f90d9ffb640 0 client.16335 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:01:13.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.445+0000 7f90ff173740 1 -- 172.21.15.46:0/3555012007 shutdown_connections 2024-09-21T04:01:13.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.445+0000 7f90ff173740 1 -- 172.21.15.46:0/3555012007 wait complete. 2024-09-21T04:01:13.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.445+0000 7f90ff173740 20 client.16335 trim_cache size 0 max 16384 2024-09-21T04:01:13.453 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T04:01:13.453 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "no active scrubs running", 2024-09-21T04:01:13.453 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": {}, 2024-09-21T04:01:13.453 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_stats": { 2024-09-21T04:01:13.453 INFO:teuthology.orchestra.run.smithi046.stdout: "0d781b95-cf5e-46f2-9875-2923181385e2": { 2024-09-21T04:01:13.453 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:00:33.099094+0000", 2024-09-21T04:01:13.453 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:13.453 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:13.453 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:13.453 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:13.453 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:13.453 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:13.453 INFO:teuthology.orchestra.run.smithi046.stdout: "326aaecf-f38a-4946-988a-d83f25556995": { 2024-09-21T04:01:13.454 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:54.189884+0000", 2024-09-21T04:01:13.454 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:13.454 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:13.454 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:13.454 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:13.454 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:13.454 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:13.454 INFO:teuthology.orchestra.run.smithi046.stdout: "46bb5415-6e16-47c6-a1e4-55f9c623ce90": { 2024-09-21T04:01:13.454 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:14.950674+0000", 2024-09-21T04:01:13.454 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:13.454 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:13.454 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:13.454 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:13.454 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:13.455 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:13.455 INFO:teuthology.orchestra.run.smithi046.stdout: "6103c660-8e77-4b06-ad6c-bb322c26035a": { 2024-09-21T04:01:13.455 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:35.594467+0000", 2024-09-21T04:01:13.455 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:13.455 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:13.455 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:13.455 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:13.455 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:13.455 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:13.455 INFO:teuthology.orchestra.run.smithi046.stdout: "dab67652-8894-4711-be64-cbdfea27a9ba": { 2024-09-21T04:01:13.455 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:28.161616+0000", 2024-09-21T04:01:13.455 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:13.455 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:13.456 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:13.456 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:13.456 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:13.456 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:13.456 INFO:teuthology.orchestra.run.smithi046.stdout: "c47f458a-de5e-4952-a575-a81261953667": { 2024-09-21T04:01:13.456 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:48.699411+0000", 2024-09-21T04:01:13.456 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:13.456 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:13.456 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:13.456 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:13.456 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:13.456 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:13.456 INFO:teuthology.orchestra.run.smithi046.stdout: "e24ec8f1-0d13-478f-9c2c-b51798868ffc": { 2024-09-21T04:01:13.456 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:09.736194+0000", 2024-09-21T04:01:13.457 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:13.457 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:13.457 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:13.457 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:13.457 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:13.457 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:13.457 INFO:teuthology.orchestra.run.smithi046.stdout: "edc4b8c7-b702-489d-a925-ae7ad0ff0d9a": { 2024-09-21T04:01:13.457 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:00:40.181950+0000", 2024-09-21T04:01:13.457 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:13.457 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:13.457 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:13.457 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:13.457 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:13.457 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:13.457 INFO:teuthology.orchestra.run.smithi046.stdout: "a871f724-0198-493c-b03e-b2de78aba243": { 2024-09-21T04:01:13.458 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:56:30.082991+0000", 2024-09-21T04:01:13.458 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:13.458 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:13.458 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:13.458 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:13.458 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:13.458 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:13.458 INFO:teuthology.orchestra.run.smithi046.stdout: "d49f33a7-3d5a-421b-94ba-8b19a4120db1": { 2024-09-21T04:01:13.458 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:50.480786+0000", 2024-09-21T04:01:13.458 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:13.458 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:13.458 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:13.458 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:13.459 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:13.459 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:13.459 INFO:teuthology.orchestra.run.smithi046.stdout: "3bbf7097-70d7-4743-bbce-41465502b35b": { 2024-09-21T04:01:13.459 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:10.661441+0000", 2024-09-21T04:01:13.459 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:13.459 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:13.459 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:13.459 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:13.459 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:13.459 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:13.459 INFO:teuthology.orchestra.run.smithi046.stdout: "08f0c962-df1a-4129-a1a2-b916240d9803": { 2024-09-21T04:01:13.459 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:02.937596+0000", 2024-09-21T04:01:13.459 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:13.460 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:13.460 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:13.460 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:13.460 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:13.460 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:01:13.460 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:01:13.460 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T04:01:13.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.446+0000 7f90f359e640 1 -- 172.21.15.46:0/4193982541 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f90e00b66b0 msgr2=0x7f90e00b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:13.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.446+0000 7f90f359e640 1 --2- 172.21.15.46:0/4193982541 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f90e00b66b0 0x7f90e00b8bc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f90dc032fd0 tx=0x7f90dc000bc0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.446+0000 7f90f359e640 1 -- 172.21.15.46:0/4193982541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90f4109c20 msgr2=0x7f90f419fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:13.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.446+0000 7f90f359e640 1 --2- 172.21.15.46:0/4193982541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90f4109c20 0x7f90f419fb50 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f90ec00d750 tx=0x7f90ec00dc10 comp rx=0 tx=0).stop 2024-09-21T04:01:13.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.446+0000 7f90f359e640 1 -- 172.21.15.46:0/4193982541 shutdown_connections 2024-09-21T04:01:13.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.446+0000 7f90f359e640 1 --2- 172.21.15.46:0/4193982541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90f4109c20 0x7f90f419fb50 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.446+0000 7f90f359e640 1 --2- 172.21.15.46:0/4193982541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90f41092d0 0x7f90f419a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.446+0000 7f90f359e640 1 --2- 172.21.15.46:0/4193982541 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f90e00b66b0 0x7f90e00b8bc0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.446+0000 7f90f359e640 1 --2- 172.21.15.46:0/4193982541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90f4103990 0x7f90f419a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.446+0000 7f90f359e640 1 -- 172.21.15.46:0/4193982541 >> 172.21.15.46:0/4193982541 conn(0x7f90f40ff3e0 msgr2=0x7f90f4101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:13.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.446+0000 7f90f359e640 1 -- 172.21.15.46:0/4193982541 shutdown_connections 2024-09-21T04:01:13.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:13.446+0000 7f90f359e640 1 -- 172.21.15.46:0/4193982541 wait complete. 2024-09-21T04:01:14.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:13 smithi162 ceph-mon[35071]: pgmap v505: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T04:01:14.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:13 smithi046 ceph-mon[30954]: pgmap v505: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T04:01:14.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:13 smithi105 ceph-mon[34773]: pgmap v505: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T04:01:14.351 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T04:01:14.352 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:01:14.610 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:15.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.092+0000 7f993e0d2640 1 -- 172.21.15.46:0/3085445560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9938103b60 msgr2=0x7f9938103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:15.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.092+0000 7f993e0d2640 1 --2- 172.21.15.46:0/3085445560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9938103b60 0x7f9938103f70 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f9928009900 tx=0x7f992802a410 comp rx=0 tx=0).stop 2024-09-21T04:01:15.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.092+0000 7f993e0d2640 1 -- 172.21.15.46:0/3085445560 shutdown_connections 2024-09-21T04:01:15.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.092+0000 7f993e0d2640 1 --2- 172.21.15.46:0/3085445560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9938109df0 0x7f9938110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:15.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.092+0000 7f993e0d2640 1 --2- 172.21.15.46:0/3085445560 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99381094a0 0x7f99381098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:15.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.092+0000 7f993e0d2640 1 --2- 172.21.15.46:0/3085445560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9938103b60 0x7f9938103f70 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:15.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.092+0000 7f993e0d2640 1 -- 172.21.15.46:0/3085445560 >> 172.21.15.46:0/3085445560 conn(0x7f993807b850 msgr2=0x7f993807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:15.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.092+0000 7f993e0d2640 1 -- 172.21.15.46:0/3085445560 shutdown_connections 2024-09-21T04:01:15.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.092+0000 7f993e0d2640 1 -- 172.21.15.46:0/3085445560 wait complete. 2024-09-21T04:01:15.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.093+0000 7f993e0d2640 1 Processor -- start 2024-09-21T04:01:15.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.093+0000 7f993e0d2640 1 -- start start 2024-09-21T04:01:15.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.093+0000 7f993e0d2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9938103b60 0x7f9938075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:15.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.093+0000 7f993e0d2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99381094a0 0x7f9938075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:15.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.093+0000 7f993e0d2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9938109df0 0x7f9938076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:15.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.093+0000 7f993e0d2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9938113ab0 con 0x7f9938109df0 2024-09-21T04:01:15.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.093+0000 7f993e0d2640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9938113930 con 0x7f9938103b60 2024-09-21T04:01:15.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.093+0000 7f993e0d2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9938113c30 con 0x7f99381094a0 2024-09-21T04:01:15.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.093+0000 7f9937fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9938109df0 0x7f9938076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:15.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.093+0000 7f9937fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9938109df0 0x7f9938076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42544/0 (socket says 172.21.15.46:42544) 2024-09-21T04:01:15.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.093+0000 7f9937fff640 1 -- 172.21.15.46:0/932420546 learned_addr learned my addr 172.21.15.46:0/932420546 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:15.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.093+0000 7f9936ffd640 1 --2- 172.21.15.46:0/932420546 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99381094a0 0x7f9938075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:15.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.094+0000 7f99377fe640 1 --2- 172.21.15.46:0/932420546 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9938103b60 0x7f9938075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:15.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.094+0000 7f9937fff640 1 -- 172.21.15.46:0/932420546 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99381094a0 msgr2=0x7f9938075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:15.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.094+0000 7f9937fff640 1 --2- 172.21.15.46:0/932420546 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99381094a0 0x7f9938075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:15.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.094+0000 7f9937fff640 1 -- 172.21.15.46:0/932420546 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9938103b60 msgr2=0x7f9938075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:15.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.094+0000 7f9937fff640 1 --2- 172.21.15.46:0/932420546 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9938103b60 0x7f9938075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:15.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.094+0000 7f9937fff640 1 -- 172.21.15.46:0/932420546 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99381a8740 con 0x7f9938109df0 2024-09-21T04:01:15.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.094+0000 7f9937fff640 1 --2- 172.21.15.46:0/932420546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9938109df0 0x7f9938076190 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f993000eaa0 tx=0x7f993000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:15.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.094+0000 7f9934ff9640 1 -- 172.21.15.46:0/932420546 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993000cdb0 con 0x7f9938109df0 2024-09-21T04:01:15.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.094+0000 7f9934ff9640 1 -- 172.21.15.46:0/932420546 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9930005020 con 0x7f9938109df0 2024-09-21T04:01:15.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.094+0000 7f993e0d2640 1 -- 172.21.15.46:0/932420546 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99381a8a30 con 0x7f9938109df0 2024-09-21T04:01:15.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.094+0000 7f9934ff9640 1 -- 172.21.15.46:0/932420546 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99300116d0 con 0x7f9938109df0 2024-09-21T04:01:15.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.094+0000 7f993e0d2640 1 -- 172.21.15.46:0/932420546 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99381a8f70 con 0x7f9938109df0 2024-09-21T04:01:15.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.096+0000 7f993e0d2640 1 -- 172.21.15.46:0/932420546 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9938103f70 con 0x7f9938109df0 2024-09-21T04:01:15.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.097+0000 7f9934ff9640 1 -- 172.21.15.46:0/932420546 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f99300051d0 con 0x7f9938109df0 2024-09-21T04:01:15.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.098+0000 7f9934ff9640 1 --2- 172.21.15.46:0/932420546 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f99200b6680 0x7f99200b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:15.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.098+0000 7f99377fe640 1 --2- 172.21.15.46:0/932420546 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f99200b6680 0x7f99200b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:15.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.098+0000 7f9934ff9640 1 -- 172.21.15.46:0/932420546 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f99300e7810 con 0x7f9938109df0 2024-09-21T04:01:15.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.099+0000 7f99377fe640 1 --2- 172.21.15.46:0/932420546 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f99200b6680 0x7f99200b8b90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9928000c00 tx=0x7f9928031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:15.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.103+0000 7f9934ff9640 1 -- 172.21.15.46:0/932420546 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9930016030 con 0x7f9938109df0 2024-09-21T04:01:15.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.332+0000 7f993e0d2640 1 -- 172.21.15.46:0/932420546 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f993802e640 con 0x7f9938109df0 2024-09-21T04:01:15.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.333+0000 7f9934ff9640 1 -- 172.21.15.46:0/932420546 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f99300ade00 con 0x7f9938109df0 2024-09-21T04:01:15.335 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T04:01:15.336 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"btime":"2024-09-21T03:53:23:865820+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1766354184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1766354184},{"type":"v1","addr":"172.21.15.46:6839","nonce":1766354184}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/1901774207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":1901774207},{"type":"v1","addr":"172.21.15.46:6841","nonce":1901774207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3548633196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":3548633196},{"type":"v1","addr":"172.21.15.105:6837","nonce":3548633196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24652,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3551934241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3551934241},{"type":"v1","addr":"172.21.15.162:6835","nonce":3551934241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/48949822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":48949822},{"type":"v1","addr":"172.21.15.162:6837","nonce":48949822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:53:14.452819+0000","modified":"2024-09-21T03:53:23.593278+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24680},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/2196053213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2196053213},{"type":"v1","addr":"172.21.15.162:6839","nonce":2196053213}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.105:6839/3911438406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":3911438406},{"type":"v1","addr":"172.21.15.105:6839","nonce":3911438406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24680,"qdb_cluster":[24680]},"id":1}]} 2024-09-21T04:01:15.336 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T04:01:15.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.335+0000 7f993e0d2640 1 -- 172.21.15.46:0/932420546 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f99200b6680 msgr2=0x7f99200b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:15.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.335+0000 7f993e0d2640 1 --2- 172.21.15.46:0/932420546 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f99200b6680 0x7f99200b8b90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9928000c00 tx=0x7f9928031400 comp rx=0 tx=0).stop 2024-09-21T04:01:15.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.335+0000 7f993e0d2640 1 -- 172.21.15.46:0/932420546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9938109df0 msgr2=0x7f9938076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:15.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.335+0000 7f993e0d2640 1 --2- 172.21.15.46:0/932420546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9938109df0 0x7f9938076190 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f993000eaa0 tx=0x7f993000ef60 comp rx=0 tx=0).stop 2024-09-21T04:01:15.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.335+0000 7f993e0d2640 1 -- 172.21.15.46:0/932420546 shutdown_connections 2024-09-21T04:01:15.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.335+0000 7f993e0d2640 1 --2- 172.21.15.46:0/932420546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9938109df0 0x7f9938076190 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:15.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.335+0000 7f993e0d2640 1 --2- 172.21.15.46:0/932420546 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f99200b6680 0x7f99200b8b90 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:15.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.335+0000 7f993e0d2640 1 --2- 172.21.15.46:0/932420546 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99381094a0 0x7f9938075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:15.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.335+0000 7f993e0d2640 1 --2- 172.21.15.46:0/932420546 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9938103b60 0x7f9938075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:15.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.335+0000 7f993e0d2640 1 -- 172.21.15.46:0/932420546 >> 172.21.15.46:0/932420546 conn(0x7f993807b850 msgr2=0x7f9938107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:15.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.335+0000 7f993e0d2640 1 -- 172.21.15.46:0/932420546 shutdown_connections 2024-09-21T04:01:15.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:15.335+0000 7f993e0d2640 1 -- 172.21.15.46:0/932420546 wait complete. 2024-09-21T04:01:15.974 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:15 smithi046 ceph-mon[30954]: pgmap v506: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 11 KiB/s wr, 4 op/s 2024-09-21T04:01:15.975 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:15 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/932420546' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:01:16.009 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T04:01:16.120 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:15 smithi105 ceph-mon[34773]: pgmap v506: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 11 KiB/s wr, 4 op/s 2024-09-21T04:01:16.120 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:15 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/932420546' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:01:16.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:15 smithi162 ceph-mon[35071]: pgmap v506: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 11 KiB/s wr, 4 op/s 2024-09-21T04:01:16.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:15 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/932420546' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:01:16.279 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:16.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.820+0000 7f0ed7161640 1 -- 172.21.15.46:0/370696009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ed0109df0 msgr2=0x7f0ed0110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:16.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.820+0000 7f0ed7161640 1 --2- 172.21.15.46:0/370696009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ed0109df0 0x7f0ed0110620 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8009900 tx=0x7f0eb802a410 comp rx=0 tx=0).stop 2024-09-21T04:01:16.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.820+0000 7f0ed7161640 1 -- 172.21.15.46:0/370696009 shutdown_connections 2024-09-21T04:01:16.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.820+0000 7f0ed7161640 1 --2- 172.21.15.46:0/370696009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ed0109df0 0x7f0ed0110620 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.820+0000 7f0ed7161640 1 --2- 172.21.15.46:0/370696009 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ed01094a0 0x7f0ed01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.820+0000 7f0ed7161640 1 --2- 172.21.15.46:0/370696009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ed0103b60 0x7f0ed0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.820+0000 7f0ed7161640 1 -- 172.21.15.46:0/370696009 >> 172.21.15.46:0/370696009 conn(0x7f0ed007b850 msgr2=0x7f0ed007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:16.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.820+0000 7f0ed7161640 1 -- 172.21.15.46:0/370696009 shutdown_connections 2024-09-21T04:01:16.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.820+0000 7f0ed7161640 1 -- 172.21.15.46:0/370696009 wait complete. 2024-09-21T04:01:16.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.820+0000 7f0ed7161640 1 Processor -- start 2024-09-21T04:01:16.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.820+0000 7f0ed7161640 1 -- start start 2024-09-21T04:01:16.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.821+0000 7f0ed7161640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ed0103b60 0x7f0ed019a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:16.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.821+0000 7f0ed7161640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ed01094a0 0x7f0ed019aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:16.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.821+0000 7f0ed7161640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ed0109df0 0x7f0ed019fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:16.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.821+0000 7f0ed7161640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed0113ab0 con 0x7f0ed0103b60 2024-09-21T04:01:16.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.821+0000 7f0ed7161640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed0113930 con 0x7f0ed01094a0 2024-09-21T04:01:16.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.821+0000 7f0ed7161640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed0113c30 con 0x7f0ed0109df0 2024-09-21T04:01:16.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.821+0000 7f0ed4efd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ed0103b60 0x7f0ed019a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:16.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.821+0000 7f0ed4efd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ed0103b60 0x7f0ed019a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42560/0 (socket says 172.21.15.46:42560) 2024-09-21T04:01:16.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.821+0000 7f0ed4efd640 1 -- 172.21.15.46:0/1730114392 learned_addr learned my addr 172.21.15.46:0/1730114392 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:16.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.821+0000 7f0ecffff640 1 --2- 172.21.15.46:0/1730114392 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ed01094a0 0x7f0ed019aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:16.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.821+0000 7f0ed56fe640 1 --2- 172.21.15.46:0/1730114392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ed0109df0 0x7f0ed019fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:16.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.821+0000 7f0ed4efd640 1 -- 172.21.15.46:0/1730114392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ed0109df0 msgr2=0x7f0ed019fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:16.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.821+0000 7f0ed4efd640 1 --2- 172.21.15.46:0/1730114392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ed0109df0 0x7f0ed019fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.821+0000 7f0ed4efd640 1 -- 172.21.15.46:0/1730114392 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ed01094a0 msgr2=0x7f0ed019aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:16.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.821+0000 7f0ed4efd640 1 --2- 172.21.15.46:0/1730114392 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ed01094a0 0x7f0ed019aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.821+0000 7f0ed4efd640 1 -- 172.21.15.46:0/1730114392 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed01a03f0 con 0x7f0ed0103b60 2024-09-21T04:01:16.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.821+0000 7f0ed4efd640 1 --2- 172.21.15.46:0/1730114392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ed0103b60 0x7f0ed019a480 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f0ec800d770 tx=0x7f0ec800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:16.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.821+0000 7f0ecdffb640 1 -- 172.21.15.46:0/1730114392 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8017070 con 0x7f0ed0103b60 2024-09-21T04:01:16.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.822+0000 7f0ed7161640 1 -- 172.21.15.46:0/1730114392 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ed01a06e0 con 0x7f0ed0103b60 2024-09-21T04:01:16.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.822+0000 7f0ecdffb640 1 -- 172.21.15.46:0/1730114392 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ec80054d0 con 0x7f0ed0103b60 2024-09-21T04:01:16.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.822+0000 7f0ecdffb640 1 -- 172.21.15.46:0/1730114392 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8004c30 con 0x7f0ed0103b60 2024-09-21T04:01:16.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.822+0000 7f0ed7161640 1 -- 172.21.15.46:0/1730114392 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ed01a6e40 con 0x7f0ed0103b60 2024-09-21T04:01:16.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.824+0000 7f0edd6d5740 1 Processor -- start 2024-09-21T04:01:16.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.824+0000 7f0edd6d5740 1 -- start start 2024-09-21T04:01:16.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.824+0000 7f0ecdffb640 1 -- 172.21.15.46:0/1730114392 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f0ec8004e10 con 0x7f0ed0103b60 2024-09-21T04:01:16.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.825+0000 7f0edd6d5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd3a614070 0x55cd3a9bb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:16.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.825+0000 7f0edd6d5740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd3a5eb1b0 0x55cd3a9bbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:16.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.825+0000 7f0edd6d5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd3a5f3390 0x55cd3a9bc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:16.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.825+0000 7f0edd6d5740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55cd3a931ea0 con 0x55cd3a5eb1b0 2024-09-21T04:01:16.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.825+0000 7f0edd6d5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55cd3a9212d0 con 0x55cd3a614070 2024-09-21T04:01:16.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.825+0000 7f0edd6d5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cd3a9250e0 con 0x55cd3a5f3390 2024-09-21T04:01:16.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.825+0000 7f0ed4efd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd3a5eb1b0 0x55cd3a9bbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:16.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.825+0000 7f0ed4efd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd3a5eb1b0 0x55cd3a9bbbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42570/0 (socket says 172.21.15.46:42570) 2024-09-21T04:01:16.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.825+0000 7f0ed4efd640 1 -- 172.21.15.46:0/2804752620 learned_addr learned my addr 172.21.15.46:0/2804752620 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:16.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.825+0000 7f0ecffff640 1 --2- 172.21.15.46:0/2804752620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd3a5f3390 0x55cd3a9bc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:16.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.825+0000 7f0ed56fe640 1 --2- 172.21.15.46:0/2804752620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd3a614070 0x55cd3a9bb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:16.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.825+0000 7f0ed4efd640 1 -- 172.21.15.46:0/2804752620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd3a5f3390 msgr2=0x55cd3a9bc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:16.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.825+0000 7f0ed4efd640 1 --2- 172.21.15.46:0/2804752620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd3a5f3390 0x55cd3a9bc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.825+0000 7f0ed4efd640 1 -- 172.21.15.46:0/2804752620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd3a614070 msgr2=0x55cd3a9bb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:16.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.825+0000 7f0ed4efd640 1 --2- 172.21.15.46:0/2804752620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd3a614070 0x55cd3a9bb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.825+0000 7f0ed4efd640 1 -- 172.21.15.46:0/2804752620 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd3a67f650 con 0x55cd3a5eb1b0 2024-09-21T04:01:16.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.825+0000 7f0ed56fe640 1 --2- 172.21.15.46:0/2804752620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd3a614070 0x55cd3a9bb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:01:16.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.825+0000 7f0ecdffb640 1 --2- 172.21.15.46:0/1730114392 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f0ebc0b6680 0x7f0ebc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:16.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.826+0000 7f0ed56fe640 1 --2- 172.21.15.46:0/1730114392 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f0ebc0b6680 0x7f0ebc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:16.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.826+0000 7f0ed4efd640 1 --2- 172.21.15.46:0/2804752620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd3a5eb1b0 0x55cd3a9bbbe0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0ec80e4970 tx=0x7f0ec80ef910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749fe58808aeb12f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:16.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.826+0000 7f0ecdffb640 1 -- 172.21.15.46:0/1730114392 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f0ec80e7240 con 0x7f0ed0103b60 2024-09-21T04:01:16.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.826+0000 7f0ec6ffd640 1 -- 172.21.15.46:0/2804752620 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8020020 con 0x55cd3a5eb1b0 2024-09-21T04:01:16.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.826+0000 7f0ec6ffd640 1 -- 172.21.15.46:0/2804752620 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ec80acc40 con 0x55cd3a5eb1b0 2024-09-21T04:01:16.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.826+0000 7f0ec6ffd640 1 -- 172.21.15.46:0/2804752620 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec80a8fd0 con 0x55cd3a5eb1b0 2024-09-21T04:01:16.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.827+0000 7f0edd6d5740 1 -- 172.21.15.46:0/2804752620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd3a5eb1b0 msgr2=0x55cd3a9bbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:16.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.827+0000 7f0ed56fe640 1 --2- 172.21.15.46:0/1730114392 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f0ebc0b6680 0x7f0ebc0b8b90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8005ab0 tx=0x7f0eb8005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:16.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.827+0000 7f0edd6d5740 1 --2- 172.21.15.46:0/2804752620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd3a5eb1b0 0x55cd3a9bbbe0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0ec80e4970 tx=0x7f0ec80ef910 comp rx=0 tx=0).stop 2024-09-21T04:01:16.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.827+0000 7f0edd6d5740 1 -- 172.21.15.46:0/2804752620 shutdown_connections 2024-09-21T04:01:16.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.827+0000 7f0edd6d5740 1 --2- 172.21.15.46:0/2804752620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd3a5f3390 0x55cd3a9bc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.827+0000 7f0edd6d5740 1 --2- 172.21.15.46:0/2804752620 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd3a5eb1b0 0x55cd3a9bbbe0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.827+0000 7f0edd6d5740 1 --2- 172.21.15.46:0/2804752620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd3a614070 0x55cd3a9bb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.827+0000 7f0edd6d5740 1 -- 172.21.15.46:0/2804752620 >> 172.21.15.46:0/2804752620 conn(0x55cd3a608460 msgr2=0x55cd3a9b9590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:16.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.827+0000 7f0edd6d5740 1 -- 172.21.15.46:0/2804752620 shutdown_connections 2024-09-21T04:01:16.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.827+0000 7f0edd6d5740 1 -- 172.21.15.46:0/2804752620 wait complete. 2024-09-21T04:01:16.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.827+0000 7f0edd6d5740 1 -- start start 2024-09-21T04:01:16.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.828+0000 7f0edd6d5740 1 Processor -- start 2024-09-21T04:01:16.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.828+0000 7f0edd6d5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd3a5eb1b0 0x55cd3a9c6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:16.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.828+0000 7f0edd6d5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd3a5f3390 0x55cd3a9c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:16.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.828+0000 7f0edd6d5740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd3a614070 0x55cd3a9d31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:16.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.828+0000 7f0edd6d5740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55cd3a782700 con 0x55cd3a614070 2024-09-21T04:01:16.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.828+0000 7f0edd6d5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55cd3a8bc160 con 0x55cd3a5eb1b0 2024-09-21T04:01:16.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.828+0000 7f0edd6d5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cd3a9c9e80 con 0x55cd3a5f3390 2024-09-21T04:01:16.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.828+0000 7f0edd6d5740 10 client.0 _ll_register_callbacks cb 0x55cd3a8d59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:01:16.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.828+0000 7f0ed56fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd3a614070 0x55cd3a9d31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:16.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.828+0000 7f0ed56fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd3a614070 0x55cd3a9d31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42572/0 (socket says 172.21.15.46:42572) 2024-09-21T04:01:16.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.828+0000 7f0ed56fe640 1 -- 172.21.15.46:0/1291180892 learned_addr learned my addr 172.21.15.46:0/1291180892 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:16.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.828+0000 7f0ecffff640 1 --2- 172.21.15.46:0/1291180892 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd3a5f3390 0x55cd3a9c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:16.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.829+0000 7f0ed4efd640 1 --2- 172.21.15.46:0/1291180892 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd3a5eb1b0 0x55cd3a9c6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:16.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.829+0000 7f0ed56fe640 1 -- 172.21.15.46:0/1291180892 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd3a5f3390 msgr2=0x55cd3a9c72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:16.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.829+0000 7f0ed56fe640 1 --2- 172.21.15.46:0/1291180892 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd3a5f3390 0x55cd3a9c72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.829+0000 7f0ed56fe640 1 -- 172.21.15.46:0/1291180892 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd3a5eb1b0 msgr2=0x55cd3a9c6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:16.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.829+0000 7f0ed56fe640 1 --2- 172.21.15.46:0/1291180892 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd3a5eb1b0 0x55cd3a9c6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.829+0000 7f0ed56fe640 1 -- 172.21.15.46:0/1291180892 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd3a8e9c90 con 0x55cd3a614070 2024-09-21T04:01:16.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.829+0000 7f0ed56fe640 1 --2- 172.21.15.46:0/1291180892 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd3a614070 0x55cd3a9d31d0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8033000 tx=0x7f0eb802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde1e01db8fd96c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:16.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.829+0000 7f0eaffff640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:01:16.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.829+0000 7f0eaffff640 1 -- 172.21.15.46:0/1291180892 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb804b070 con 0x55cd3a614070 2024-09-21T04:01:16.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.829+0000 7f0eaffff640 1 -- 172.21.15.46:0/1291180892 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f0eb8003800 con 0x55cd3a614070 2024-09-21T04:01:16.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.829+0000 7f0edd6d5740 1 -- 172.21.15.46:0/1291180892 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ec80acc40 con 0x55cd3a614070 2024-09-21T04:01:16.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.829+0000 7f0eaffff640 1 -- 172.21.15.46:0/1291180892 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0eb8057050 con 0x55cd3a614070 2024-09-21T04:01:16.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.829+0000 7f0edd6d5740 10 client.16353 fetch_fsmap learned FSMap version 20 2024-09-21T04:01:16.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.829+0000 7f0edd6d5740 1 -- 172.21.15.46:0/1291180892 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55cd3a9d5bb0 con 0x55cd3a614070 2024-09-21T04:01:16.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.830+0000 7f0eaffff640 1 -- 172.21.15.46:0/1291180892 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ec80acc40 con 0x55cd3a614070 2024-09-21T04:01:16.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.830+0000 7f0eaffff640 1 -- 172.21.15.46:0/1291180892 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f0eb8047730 con 0x55cd3a614070 2024-09-21T04:01:16.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.830+0000 7f0edd6d5740 10 client.16353 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:01:16.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.830+0000 7f0edd6d5740 10 client.16353 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:01:16.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.830+0000 7f0edd6d5740 20 client.16353 populate_metadata read hostname 'smithi046' 2024-09-21T04:01:16.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.830+0000 7f0edd6d5740 1 --2- 172.21.15.46:0/1291180892 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55cd3a5d29f0 0x55cd3a9d9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:16.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.830+0000 7f0edd6d5740 4 client.16353 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:01:16.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.830+0000 7f0edd6d5740 1 -- 172.21.15.46:0/1291180892 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd3a933df0 con 0x55cd3a5d29f0 2024-09-21T04:01:16.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.830+0000 7f0ed4efd640 1 --2- 172.21.15.46:0/1291180892 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55cd3a5d29f0 0x55cd3a9d9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:16.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.831+0000 7f0ed4efd640 1 --2- 172.21.15.46:0/1291180892 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55cd3a5d29f0 0x55cd3a9d9040 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40c83b4db03b15f3 server_cookie=9552da758fbfab2d in_seq=0 out_seq=0 2024-09-21T04:01:16.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.831+0000 7f0eaffff640 10 client.16353 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:01:16.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.832+0000 7f0eaffff640 1 -- 172.21.15.46:0/1291180892 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cd3a933df0 con 0x55cd3a5d29f0 2024-09-21T04:01:16.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.832+0000 7f0eaffff640 10 client.16353 handle_command_reply: tid=0 2024-09-21T04:01:16.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.832+0000 7f0edd6d5740 1 client.16353 shutdown 2024-09-21T04:01:16.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.832+0000 7f0edd6d5740 1 -- 172.21.15.46:0/1291180892 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd3a614070 msgr2=0x55cd3a9d31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:16.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.832+0000 7f0edd6d5740 1 --2- 172.21.15.46:0/1291180892 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd3a614070 0x55cd3a9d31d0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8033000 tx=0x7f0eb802a410 comp rx=0 tx=0).stop 2024-09-21T04:01:16.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.832+0000 7f0edd6d5740 1 -- 172.21.15.46:0/1291180892 shutdown_connections 2024-09-21T04:01:16.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.832+0000 7f0edd6d5740 1 --2- 172.21.15.46:0/1291180892 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55cd3a5d29f0 0x55cd3a9d9040 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.832+0000 7f0edd6d5740 1 --2- 172.21.15.46:0/1291180892 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd3a614070 0x55cd3a9d31d0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.832+0000 7f0edd6d5740 1 --2- 172.21.15.46:0/1291180892 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd3a5f3390 0x55cd3a9c72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.832+0000 7f0edd6d5740 1 --2- 172.21.15.46:0/1291180892 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd3a5eb1b0 0x55cd3a9c6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.832+0000 7f0edd6d5740 1 -- 172.21.15.46:0/1291180892 >> 172.21.15.46:0/1291180892 conn(0x55cd3a608460 msgr2=0x55cd3a9be830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:16.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.832+0000 7f0eaffff640 0 client.16353 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:01:16.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.832+0000 7f0edd6d5740 1 -- 172.21.15.46:0/1291180892 shutdown_connections 2024-09-21T04:01:16.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.832+0000 7f0edd6d5740 1 -- 172.21.15.46:0/1291180892 wait complete. 2024-09-21T04:01:16.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.832+0000 7f0edd6d5740 20 client.16353 trim_cache size 0 max 16384 2024-09-21T04:01:16.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.845+0000 7f0edd6d5740 1 Processor -- start 2024-09-21T04:01:16.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.845+0000 7f0edd6d5740 1 -- start start 2024-09-21T04:01:16.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.845+0000 7f0edd6d5740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd3a5eb1b0 0x55cd3a9bd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:16.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.845+0000 7f0edd6d5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd3a5f3390 0x55cd3a9c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:16.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.846+0000 7f0edd6d5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd3a614070 0x55cd3a9d30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:16.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.846+0000 7f0edd6d5740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed01ad550 con 0x55cd3a5eb1b0 2024-09-21T04:01:16.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.846+0000 7f0edd6d5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed01afdb0 con 0x55cd3a5f3390 2024-09-21T04:01:16.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.846+0000 7f0edd6d5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed01adba0 con 0x55cd3a614070 2024-09-21T04:01:16.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.846+0000 7f0ed4efd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd3a5eb1b0 0x55cd3a9bd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:16.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.846+0000 7f0ed4efd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd3a5eb1b0 0x55cd3a9bd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42576/0 (socket says 172.21.15.46:42576) 2024-09-21T04:01:16.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.846+0000 7f0ed4efd640 1 -- 172.21.15.46:0/190828012 learned_addr learned my addr 172.21.15.46:0/190828012 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:16.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.846+0000 7f0ed4efd640 1 -- 172.21.15.46:0/190828012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd3a614070 msgr2=0x55cd3a9d30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:16.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.846+0000 7f0ed56fe640 1 --2- 172.21.15.46:0/190828012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd3a614070 0x55cd3a9d30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:16.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.846+0000 7f0ecffff640 1 --2- 172.21.15.46:0/190828012 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd3a5f3390 0x55cd3a9c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:16.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.846+0000 7f0ed4efd640 1 --2- 172.21.15.46:0/190828012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd3a614070 0x55cd3a9d30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.846+0000 7f0ed4efd640 1 -- 172.21.15.46:0/190828012 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd3a5f3390 msgr2=0x55cd3a9c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:16.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.846+0000 7f0ed4efd640 1 --2- 172.21.15.46:0/190828012 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd3a5f3390 0x55cd3a9c8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.846+0000 7f0ed4efd640 1 -- 172.21.15.46:0/190828012 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd3a9c8040 con 0x55cd3a5eb1b0 2024-09-21T04:01:16.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.846+0000 7f0ed4efd640 1 --2- 172.21.15.46:0/190828012 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd3a5eb1b0 0x55cd3a9bd1a0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8009610 tx=0x7f0ec80b4f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82fc4e2df8f27533 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:16.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.846+0000 7f0ec67fc640 1 -- 172.21.15.46:0/190828012 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8020040 con 0x55cd3a5eb1b0 2024-09-21T04:01:16.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.846+0000 7f0ec67fc640 1 -- 172.21.15.46:0/190828012 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ec80e6040 con 0x55cd3a5eb1b0 2024-09-21T04:01:16.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.846+0000 7f0ec67fc640 1 -- 172.21.15.46:0/190828012 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec80ac8a0 con 0x55cd3a5eb1b0 2024-09-21T04:01:16.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.847+0000 7f0edd6d5740 1 -- 172.21.15.46:0/190828012 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd3a5eb1b0 msgr2=0x55cd3a9bd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:16.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.847+0000 7f0edd6d5740 1 --2- 172.21.15.46:0/190828012 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd3a5eb1b0 0x55cd3a9bd1a0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8009610 tx=0x7f0ec80b4f90 comp rx=0 tx=0).stop 2024-09-21T04:01:16.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.847+0000 7f0edd6d5740 1 -- 172.21.15.46:0/190828012 shutdown_connections 2024-09-21T04:01:16.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.847+0000 7f0edd6d5740 1 --2- 172.21.15.46:0/190828012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd3a614070 0x55cd3a9d30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.847+0000 7f0edd6d5740 1 --2- 172.21.15.46:0/190828012 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd3a5f3390 0x55cd3a9c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.847+0000 7f0edd6d5740 1 --2- 172.21.15.46:0/190828012 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd3a5eb1b0 0x55cd3a9bd1a0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.847+0000 7f0edd6d5740 1 -- 172.21.15.46:0/190828012 >> 172.21.15.46:0/190828012 conn(0x55cd3a608460 msgr2=0x55cd3a9c07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:16.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.847+0000 7f0edd6d5740 1 -- 172.21.15.46:0/190828012 shutdown_connections 2024-09-21T04:01:16.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.847+0000 7f0edd6d5740 1 -- 172.21.15.46:0/190828012 wait complete. 2024-09-21T04:01:16.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.847+0000 7f0edd6d5740 1 -- start start 2024-09-21T04:01:16.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.848+0000 7f0edd6d5740 1 Processor -- start 2024-09-21T04:01:16.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.848+0000 7f0edd6d5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd3a5eb1b0 0x55cd3a9cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:16.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.848+0000 7f0edd6d5740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd3a5f3390 0x55cd3a9cb720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:16.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.848+0000 7f0edd6d5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd3a614070 0x55cd3a9cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:16.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.848+0000 7f0edd6d5740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed01ae270 con 0x55cd3a5f3390 2024-09-21T04:01:16.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.848+0000 7f0edd6d5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed01af6e0 con 0x55cd3a5eb1b0 2024-09-21T04:01:16.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.848+0000 7f0edd6d5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed01ae940 con 0x55cd3a614070 2024-09-21T04:01:16.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.848+0000 7f0edd6d5740 10 client.0 _ll_register_callbacks cb 0x7f0eb803f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:01:16.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.848+0000 7f0ecffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd3a5f3390 0x55cd3a9cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:16.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.848+0000 7f0ecffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd3a5f3390 0x55cd3a9cb720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42580/0 (socket says 172.21.15.46:42580) 2024-09-21T04:01:16.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.848+0000 7f0ecffff640 1 -- 172.21.15.46:0/1435009736 learned_addr learned my addr 172.21.15.46:0/1435009736 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:16.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.848+0000 7f0ed4efd640 1 --2- 172.21.15.46:0/1435009736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd3a5eb1b0 0x55cd3a9cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:16.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.849+0000 7f0ed56fe640 1 --2- 172.21.15.46:0/1435009736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd3a614070 0x55cd3a9cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:16.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.849+0000 7f0ecffff640 1 -- 172.21.15.46:0/1435009736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd3a614070 msgr2=0x55cd3a9cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:16.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.849+0000 7f0ecffff640 1 --2- 172.21.15.46:0/1435009736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd3a614070 0x55cd3a9cbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.849+0000 7f0ecffff640 1 -- 172.21.15.46:0/1435009736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd3a5eb1b0 msgr2=0x55cd3a9cb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:16.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.849+0000 7f0ecffff640 1 --2- 172.21.15.46:0/1435009736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd3a5eb1b0 0x55cd3a9cb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.849+0000 7f0ecffff640 1 -- 172.21.15.46:0/1435009736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd3aa42ad0 con 0x55cd3a5f3390 2024-09-21T04:01:16.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.849+0000 7f0ed56fe640 1 --2- 172.21.15.46:0/1435009736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd3a614070 0x55cd3a9cbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:01:16.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.849+0000 7f0ecffff640 1 --2- 172.21.15.46:0/1435009736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd3a5f3390 0x55cd3a9cb720 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0013a50 tx=0x7f0ec0013f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25ef820306c3c814 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:16.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.849+0000 7f0eaffff640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:01:16.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.849+0000 7f0eaffff640 1 -- 172.21.15.46:0/1435009736 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec0011c30 con 0x55cd3a5f3390 2024-09-21T04:01:16.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.849+0000 7f0edd6d5740 1 -- 172.21.15.46:0/1435009736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ec80e6040 con 0x55cd3a5f3390 2024-09-21T04:01:16.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.849+0000 7f0eaffff640 1 -- 172.21.15.46:0/1435009736 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f0ec0011dd0 con 0x55cd3a5f3390 2024-09-21T04:01:16.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.849+0000 7f0eaffff640 1 -- 172.21.15.46:0/1435009736 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0ec0004b20 con 0x55cd3a5f3390 2024-09-21T04:01:16.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.849+0000 7f0edd6d5740 10 client.16359 fetch_fsmap learned FSMap version 20 2024-09-21T04:01:16.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.849+0000 7f0edd6d5740 1 -- 172.21.15.46:0/1435009736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55cd3aa43da0 con 0x55cd3a5f3390 2024-09-21T04:01:16.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.849+0000 7f0eaffff640 1 -- 172.21.15.46:0/1435009736 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ec80e6040 con 0x55cd3a5f3390 2024-09-21T04:01:16.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.850+0000 7f0eaffff640 1 -- 172.21.15.46:0/1435009736 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f0ec0004400 con 0x55cd3a5f3390 2024-09-21T04:01:16.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.850+0000 7f0edd6d5740 10 client.16359 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:01:16.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.850+0000 7f0edd6d5740 10 client.16359 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:01:16.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.850+0000 7f0edd6d5740 20 client.16359 populate_metadata read hostname 'smithi046' 2024-09-21T04:01:16.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.850+0000 7f0edd6d5740 1 --2- 172.21.15.46:0/1435009736 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55cd3a5a7da0 0x55cd3aa465c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:16.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.850+0000 7f0edd6d5740 4 client.16359 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T04:01:16.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.850+0000 7f0edd6d5740 1 -- 172.21.15.46:0/1435009736 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cd3a92f8a0 con 0x55cd3a5a7da0 2024-09-21T04:01:16.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.850+0000 7f0ed4efd640 1 --2- 172.21.15.46:0/1435009736 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55cd3a5a7da0 0x55cd3aa465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:16.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.851+0000 7f0ed4efd640 1 --2- 172.21.15.46:0/1435009736 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55cd3a5a7da0 0x55cd3aa465c0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c148b8be1591f7ac server_cookie=bb57e67fa25eee5c in_seq=0 out_seq=0 2024-09-21T04:01:16.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.851+0000 7f0eaffff640 10 client.16359 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:01:16.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.851+0000 7f0eaffff640 1 -- 172.21.15.46:0/1435009736 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cd3a92f8a0 con 0x55cd3a5a7da0 2024-09-21T04:01:16.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.851+0000 7f0eaffff640 10 client.16359 handle_command_reply: tid=0 2024-09-21T04:01:16.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.851+0000 7f0edd6d5740 1 client.16359 shutdown 2024-09-21T04:01:16.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.851+0000 7f0edd6d5740 1 -- 172.21.15.46:0/1435009736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd3a5f3390 msgr2=0x55cd3a9cb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:16.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.851+0000 7f0edd6d5740 1 --2- 172.21.15.46:0/1435009736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd3a5f3390 0x55cd3a9cb720 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0013a50 tx=0x7f0ec0013f10 comp rx=0 tx=0).stop 2024-09-21T04:01:16.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.851+0000 7f0edd6d5740 1 -- 172.21.15.46:0/1435009736 shutdown_connections 2024-09-21T04:01:16.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.851+0000 7f0edd6d5740 1 --2- 172.21.15.46:0/1435009736 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55cd3a5a7da0 0x55cd3aa465c0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.851+0000 7f0edd6d5740 1 --2- 172.21.15.46:0/1435009736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd3a614070 0x55cd3a9cbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.851+0000 7f0edd6d5740 1 --2- 172.21.15.46:0/1435009736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd3a5f3390 0x55cd3a9cb720 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.851+0000 7f0eaffff640 0 client.16359 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:01:16.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.851+0000 7f0edd6d5740 1 --2- 172.21.15.46:0/1435009736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd3a5eb1b0 0x55cd3a9cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.851+0000 7f0edd6d5740 1 -- 172.21.15.46:0/1435009736 >> 172.21.15.46:0/1435009736 conn(0x55cd3a608460 msgr2=0x55cd3a9c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:16.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.851+0000 7f0edd6d5740 1 -- 172.21.15.46:0/1435009736 shutdown_connections 2024-09-21T04:01:16.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.851+0000 7f0edd6d5740 1 -- 172.21.15.46:0/1435009736 wait complete. 2024-09-21T04:01:16.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.851+0000 7f0edd6d5740 20 client.16359 trim_cache size 0 max 16384 2024-09-21T04:01:16.860 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-21T04:01:16.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.852+0000 7f0ed7161640 1 -- 172.21.15.46:0/1730114392 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f0ebc0b6680 msgr2=0x7f0ebc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:16.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.852+0000 7f0ed7161640 1 --2- 172.21.15.46:0/1730114392 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f0ebc0b6680 0x7f0ebc0b8b90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8005ab0 tx=0x7f0eb8005a20 comp rx=0 tx=0).stop 2024-09-21T04:01:16.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.852+0000 7f0ed7161640 1 -- 172.21.15.46:0/1730114392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ed0103b60 msgr2=0x7f0ed019a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:16.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.852+0000 7f0ed7161640 1 --2- 172.21.15.46:0/1730114392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ed0103b60 0x7f0ed019a480 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f0ec800d770 tx=0x7f0ec800dc30 comp rx=0 tx=0).stop 2024-09-21T04:01:16.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.852+0000 7f0ed7161640 1 -- 172.21.15.46:0/1730114392 shutdown_connections 2024-09-21T04:01:16.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.852+0000 7f0ed7161640 1 --2- 172.21.15.46:0/1730114392 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f0ebc0b6680 0x7f0ebc0b8b90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.852+0000 7f0ed7161640 1 --2- 172.21.15.46:0/1730114392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ed0109df0 0x7f0ed019fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.852+0000 7f0ed7161640 1 --2- 172.21.15.46:0/1730114392 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ed01094a0 0x7f0ed019aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.852+0000 7f0ed7161640 1 --2- 172.21.15.46:0/1730114392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ed0103b60 0x7f0ed019a480 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.852+0000 7f0ed7161640 1 -- 172.21.15.46:0/1730114392 >> 172.21.15.46:0/1730114392 conn(0x7f0ed007b850 msgr2=0x7f0ed0105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:16.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.852+0000 7f0ed7161640 1 -- 172.21.15.46:0/1730114392 shutdown_connections 2024-09-21T04:01:16.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:16.852+0000 7f0ed7161640 1 -- 172.21.15.46:0/1730114392 wait complete. 2024-09-21T04:01:18.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:17 smithi046 ceph-mon[30954]: pgmap v507: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T04:01:18.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:17 smithi162 ceph-mon[35071]: pgmap v507: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T04:01:18.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:17 smithi105 ceph-mon[34773]: pgmap v507: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T04:01:18.660 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T04:01:18.660 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T04:01:18.931 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:19.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.423+0000 7fc9f3a6e640 1 -- 172.21.15.46:0/2312443502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9ec102ae0 msgr2=0x7fc9ec102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:19.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.423+0000 7fc9f3a6e640 1 --2- 172.21.15.46:0/2312443502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9ec102ae0 0x7fc9ec102ef0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8009900 tx=0x7fc9e802a410 comp rx=0 tx=0).stop 2024-09-21T04:01:19.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.423+0000 7fc9f3a6e640 1 -- 172.21.15.46:0/2312443502 shutdown_connections 2024-09-21T04:01:19.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.423+0000 7fc9f3a6e640 1 --2- 172.21.15.46:0/2312443502 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9ec108d20 0x7fc9ec10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:19.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.423+0000 7fc9f3a6e640 1 --2- 172.21.15.46:0/2312443502 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9ec1083d0 0x7fc9ec1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:19.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.424+0000 7fc9f3a6e640 1 --2- 172.21.15.46:0/2312443502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9ec102ae0 0x7fc9ec102ef0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:19.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.424+0000 7fc9f3a6e640 1 -- 172.21.15.46:0/2312443502 >> 172.21.15.46:0/2312443502 conn(0x7fc9ec079760 msgr2=0x7fc9ec079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:19.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.424+0000 7fc9f3a6e640 1 -- 172.21.15.46:0/2312443502 shutdown_connections 2024-09-21T04:01:19.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.424+0000 7fc9f3a6e640 1 -- 172.21.15.46:0/2312443502 wait complete. 2024-09-21T04:01:19.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.424+0000 7fc9f3a6e640 1 Processor -- start 2024-09-21T04:01:19.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.424+0000 7fc9f3a6e640 1 -- start start 2024-09-21T04:01:19.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.425+0000 7fc9f3a6e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9ec102ae0 0x7fc9ec104280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:19.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.425+0000 7fc9f3a6e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9ec1083d0 0x7fc9ec1047c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:19.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.425+0000 7fc9f3a6e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9ec108d20 0x7fc9ec104d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:19.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.425+0000 7fc9f3a6e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec112990 con 0x7fc9ec1083d0 2024-09-21T04:01:19.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.425+0000 7fc9f3a6e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec112810 con 0x7fc9ec102ae0 2024-09-21T04:01:19.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.425+0000 7fc9f3a6e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec112b10 con 0x7fc9ec108d20 2024-09-21T04:01:19.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.425+0000 7fc9f1009640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9ec1083d0 0x7fc9ec1047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:19.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.425+0000 7fc9f1009640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9ec1083d0 0x7fc9ec1047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42596/0 (socket says 172.21.15.46:42596) 2024-09-21T04:01:19.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.425+0000 7fc9f1009640 1 -- 172.21.15.46:0/1735266548 learned_addr learned my addr 172.21.15.46:0/1735266548 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:19.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.425+0000 7fc9f180a640 1 --2- 172.21.15.46:0/1735266548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9ec102ae0 0x7fc9ec104280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:19.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.425+0000 7fc9f200b640 1 --2- 172.21.15.46:0/1735266548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9ec108d20 0x7fc9ec104d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:19.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.425+0000 7fc9f1009640 1 -- 172.21.15.46:0/1735266548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9ec108d20 msgr2=0x7fc9ec104d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:19.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.425+0000 7fc9f1009640 1 --2- 172.21.15.46:0/1735266548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9ec108d20 0x7fc9ec104d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:19.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.425+0000 7fc9f1009640 1 -- 172.21.15.46:0/1735266548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9ec102ae0 msgr2=0x7fc9ec104280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:19.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.425+0000 7fc9f1009640 1 --2- 172.21.15.46:0/1735266548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9ec102ae0 0x7fc9ec104280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:19.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.425+0000 7fc9f1009640 1 -- 172.21.15.46:0/1735266548 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9ec1a8730 con 0x7fc9ec1083d0 2024-09-21T04:01:19.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.425+0000 7fc9f1009640 1 --2- 172.21.15.46:0/1735266548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9ec1083d0 0x7fc9ec1047c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc00d770 tx=0x7fc9dc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:19.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.426+0000 7fc9e2ffd640 1 -- 172.21.15.46:0/1735266548 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc017070 con 0x7fc9ec1083d0 2024-09-21T04:01:19.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.426+0000 7fc9e2ffd640 1 -- 172.21.15.46:0/1735266548 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9dc009c30 con 0x7fc9ec1083d0 2024-09-21T04:01:19.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.426+0000 7fc9e2ffd640 1 -- 172.21.15.46:0/1735266548 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc00f620 con 0x7fc9ec1083d0 2024-09-21T04:01:19.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.426+0000 7fc9f3a6e640 1 -- 172.21.15.46:0/1735266548 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9ec1a8a20 con 0x7fc9ec1083d0 2024-09-21T04:01:19.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.426+0000 7fc9f3a6e640 1 -- 172.21.15.46:0/1735266548 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9ec1a8f60 con 0x7fc9ec1083d0 2024-09-21T04:01:19.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.428+0000 7fc9f9fe2740 1 Processor -- start 2024-09-21T04:01:19.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.429+0000 7fc9f9fe2740 1 -- start start 2024-09-21T04:01:19.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.429+0000 7fc9e2ffd640 1 -- 172.21.15.46:0/1735266548 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7fc9dc01a070 con 0x7fc9ec1083d0 2024-09-21T04:01:19.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.429+0000 7fc9f9fe2740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55798950b350 0x5579898b2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:19.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.429+0000 7fc9f9fe2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5579894e2490 0x5579898b2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:19.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.429+0000 7fc9f9fe2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579894ea670 0x5579898b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:19.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.429+0000 7fc9f9fe2740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x557989828e60 con 0x55798950b350 2024-09-21T04:01:19.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.429+0000 7fc9f9fe2740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x557989818290 con 0x5579894e2490 2024-09-21T04:01:19.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.429+0000 7fc9f9fe2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55798981c0a0 con 0x5579894ea670 2024-09-21T04:01:19.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.429+0000 7fc9f200b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55798950b350 0x5579898b2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:19.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.429+0000 7fc9f200b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55798950b350 0x5579898b2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42600/0 (socket says 172.21.15.46:42600) 2024-09-21T04:01:19.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.429+0000 7fc9f200b640 1 -- 172.21.15.46:0/940003742 learned_addr learned my addr 172.21.15.46:0/940003742 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:19.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.429+0000 7fc9f180a640 1 --2- 172.21.15.46:0/940003742 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5579894e2490 0x5579898b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:19.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.430+0000 7fc9f1009640 1 --2- 172.21.15.46:0/940003742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579894ea670 0x5579898b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:19.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.430+0000 7fc9f200b640 1 -- 172.21.15.46:0/940003742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579894ea670 msgr2=0x5579898b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:19.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.430+0000 7fc9f200b640 1 --2- 172.21.15.46:0/940003742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579894ea670 0x5579898b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:19.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.430+0000 7fc9f200b640 1 -- 172.21.15.46:0/940003742 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5579894e2490 msgr2=0x5579898b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:19.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.430+0000 7fc9f200b640 1 --2- 172.21.15.46:0/940003742 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5579894e2490 0x5579898b2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:19.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.430+0000 7fc9f200b640 1 -- 172.21.15.46:0/940003742 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557989576930 con 0x55798950b350 2024-09-21T04:01:19.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.430+0000 7fc9f180a640 1 --2- 172.21.15.46:0/940003742 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5579894e2490 0x5579898b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:01:19.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.430+0000 7fc9f200b640 1 --2- 172.21.15.46:0/940003742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55798950b350 0x5579898b2430 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4008dc0 tx=0x7fc9e400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3860a529c074f945 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:19.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.430+0000 7fc9d7fff640 1 -- 172.21.15.46:0/940003742 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4014070 con 0x55798950b350 2024-09-21T04:01:19.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.430+0000 7fc9e2ffd640 1 --2- 172.21.15.46:0/1735266548 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc9d80b6680 0x7fc9d80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:19.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.430+0000 7fc9d7fff640 1 -- 172.21.15.46:0/940003742 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9e4003b70 con 0x55798950b350 2024-09-21T04:01:19.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.430+0000 7fc9f180a640 1 --2- 172.21.15.46:0/1735266548 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc9d80b6680 0x7fc9d80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:19.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.430+0000 7fc9e2ffd640 1 -- 172.21.15.46:0/1735266548 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fc9dc0e71a0 con 0x7fc9ec1083d0 2024-09-21T04:01:19.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.431+0000 7fc9d7fff640 1 -- 172.21.15.46:0/940003742 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4010730 con 0x55798950b350 2024-09-21T04:01:19.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.431+0000 7fc9f9fe2740 1 -- 172.21.15.46:0/940003742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55798950b350 msgr2=0x5579898b2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:19.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.431+0000 7fc9f180a640 1 --2- 172.21.15.46:0/1735266548 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc9d80b6680 0x7fc9d80b8b90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8000c00 tx=0x7fc9e8031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:19.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.431+0000 7fc9f9fe2740 1 --2- 172.21.15.46:0/940003742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55798950b350 0x5579898b2430 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4008dc0 tx=0x7fc9e400e720 comp rx=0 tx=0).stop 2024-09-21T04:01:19.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.431+0000 7fc9f9fe2740 1 -- 172.21.15.46:0/940003742 shutdown_connections 2024-09-21T04:01:19.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.431+0000 7fc9f9fe2740 1 --2- 172.21.15.46:0/940003742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579894ea670 0x5579898b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:19.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.431+0000 7fc9f9fe2740 1 --2- 172.21.15.46:0/940003742 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5579894e2490 0x5579898b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:19.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.431+0000 7fc9f9fe2740 1 --2- 172.21.15.46:0/940003742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55798950b350 0x5579898b2430 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:19.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.431+0000 7fc9f9fe2740 1 -- 172.21.15.46:0/940003742 >> 172.21.15.46:0/940003742 conn(0x5579894ff740 msgr2=0x5579898b0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:19.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.431+0000 7fc9f9fe2740 1 -- 172.21.15.46:0/940003742 shutdown_connections 2024-09-21T04:01:19.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.431+0000 7fc9f9fe2740 1 -- 172.21.15.46:0/940003742 wait complete. 2024-09-21T04:01:19.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.432+0000 7fc9f9fe2740 1 -- start start 2024-09-21T04:01:19.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.432+0000 7fc9f9fe2740 1 Processor -- start 2024-09-21T04:01:19.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.432+0000 7fc9f9fe2740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5579894e2490 0x5579898be050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:19.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.432+0000 7fc9f9fe2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579894ea670 0x5579898be590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:19.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.432+0000 7fc9f9fe2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55798950b350 0x5579898c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:19.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.432+0000 7fc9f9fe2740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x557989679890 con 0x5579894e2490 2024-09-21T04:01:19.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.432+0000 7fc9f9fe2740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5579897b2d40 con 0x55798950b350 2024-09-21T04:01:19.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.432+0000 7fc9f9fe2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5579898c0c60 con 0x5579894ea670 2024-09-21T04:01:19.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.432+0000 7fc9f9fe2740 10 client.0 _ll_register_callbacks cb 0x557989816c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:01:19.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.432+0000 7fc9f180a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5579894e2490 0x5579898be050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:19.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.433+0000 7fc9f180a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5579894e2490 0x5579898be050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42606/0 (socket says 172.21.15.46:42606) 2024-09-21T04:01:19.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.433+0000 7fc9f180a640 1 -- 172.21.15.46:0/57527531 learned_addr learned my addr 172.21.15.46:0/57527531 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:19.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.433+0000 7fc9f1009640 1 --2- 172.21.15.46:0/57527531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579894ea670 0x5579898be590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:19.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.433+0000 7fc9f200b640 1 --2- 172.21.15.46:0/57527531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55798950b350 0x5579898c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:19.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.433+0000 7fc9f180a640 1 -- 172.21.15.46:0/57527531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579894ea670 msgr2=0x5579898be590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:19.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.433+0000 7fc9f180a640 1 --2- 172.21.15.46:0/57527531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579894ea670 0x5579898be590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:19.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.433+0000 7fc9f180a640 1 -- 172.21.15.46:0/57527531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55798950b350 msgr2=0x5579898c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:19.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.433+0000 7fc9f180a640 1 --2- 172.21.15.46:0/57527531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55798950b350 0x5579898c9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:19.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.433+0000 7fc9f180a640 1 -- 172.21.15.46:0/57527531 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579898ca570 con 0x5579894e2490 2024-09-21T04:01:19.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.433+0000 7fc9f180a640 1 --2- 172.21.15.46:0/57527531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5579894e2490 0x5579898be050 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8009900 tx=0x7fc9e8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f3224200cff7e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:19.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.433+0000 7fc9d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:01:19.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.433+0000 7fc9d57fa640 1 -- 172.21.15.46:0/57527531 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e804c070 con 0x5579894e2490 2024-09-21T04:01:19.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.433+0000 7fc9f9fe2740 1 -- 172.21.15.46:0/57527531 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9e4003b70 con 0x5579894e2490 2024-09-21T04:01:19.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.433+0000 7fc9d57fa640 1 -- 172.21.15.46:0/57527531 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fc9e8005030 con 0x5579894e2490 2024-09-21T04:01:19.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.433+0000 7fc9d57fa640 1 -- 172.21.15.46:0/57527531 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc9e8058050 con 0x5579894e2490 2024-09-21T04:01:19.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.433+0000 7fc9f9fe2740 10 client.16371 fetch_fsmap learned FSMap version 20 2024-09-21T04:01:19.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.434+0000 7fc9f9fe2740 1 -- 172.21.15.46:0/57527531 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5579898cce80 con 0x5579894e2490 2024-09-21T04:01:19.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.434+0000 7fc9d57fa640 1 -- 172.21.15.46:0/57527531 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9e4003b70 con 0x5579894e2490 2024-09-21T04:01:19.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.434+0000 7fc9d57fa640 1 -- 172.21.15.46:0/57527531 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc9e80035f0 con 0x5579894e2490 2024-09-21T04:01:19.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.434+0000 7fc9f9fe2740 10 client.16371 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:01:19.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.434+0000 7fc9f9fe2740 10 client.16371 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:01:19.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.434+0000 7fc9f9fe2740 20 client.16371 populate_metadata read hostname 'smithi046' 2024-09-21T04:01:19.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.434+0000 7fc9f9fe2740 1 --2- 172.21.15.46:0/57527531 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5579894c9cd0 0x5579898d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:19.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.434+0000 7fc9f9fe2740 4 client.16371 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:01:19.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.434+0000 7fc9f9fe2740 1 -- 172.21.15.46:0/57527531 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55798982adb0 con 0x5579894c9cd0 2024-09-21T04:01:19.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.434+0000 7fc9f1009640 1 --2- 172.21.15.46:0/57527531 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5579894c9cd0 0x5579898d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:19.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.435+0000 7fc9f1009640 1 --2- 172.21.15.46:0/57527531 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5579894c9cd0 0x5579898d03c0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58386524dc108cc9 server_cookie=724dd76bdfbe46b6 in_seq=0 out_seq=0 2024-09-21T04:01:19.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.435+0000 7fc9d57fa640 10 client.16371 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:01:19.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.436+0000 7fc9d57fa640 1 -- 172.21.15.46:0/57527531 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55798982adb0 con 0x5579894c9cd0 2024-09-21T04:01:19.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.436+0000 7fc9d57fa640 10 client.16371 handle_command_reply: tid=0 2024-09-21T04:01:19.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.436+0000 7fc9f9fe2740 1 client.16371 shutdown 2024-09-21T04:01:19.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.436+0000 7fc9f9fe2740 1 -- 172.21.15.46:0/57527531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5579894e2490 msgr2=0x5579898be050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:19.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.436+0000 7fc9f9fe2740 1 --2- 172.21.15.46:0/57527531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5579894e2490 0x5579898be050 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8009900 tx=0x7fc9e8009260 comp rx=0 tx=0).stop 2024-09-21T04:01:19.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.436+0000 7fc9f9fe2740 1 -- 172.21.15.46:0/57527531 shutdown_connections 2024-09-21T04:01:19.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.436+0000 7fc9f9fe2740 1 --2- 172.21.15.46:0/57527531 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5579894c9cd0 0x5579898d03c0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:19.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.436+0000 7fc9f9fe2740 1 --2- 172.21.15.46:0/57527531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55798950b350 0x5579898c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:19.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.436+0000 7fc9f9fe2740 1 --2- 172.21.15.46:0/57527531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579894ea670 0x5579898be590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:19.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.436+0000 7fc9d57fa640 0 client.16371 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:01:19.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.436+0000 7fc9f9fe2740 1 --2- 172.21.15.46:0/57527531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5579894e2490 0x5579898be050 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:19.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.436+0000 7fc9f9fe2740 1 -- 172.21.15.46:0/57527531 >> 172.21.15.46:0/57527531 conn(0x5579894ff740 msgr2=0x5579898b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:19.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.436+0000 7fc9f9fe2740 1 -- 172.21.15.46:0/57527531 shutdown_connections 2024-09-21T04:01:19.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.436+0000 7fc9f9fe2740 1 -- 172.21.15.46:0/57527531 wait complete. 2024-09-21T04:01:19.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.436+0000 7fc9f9fe2740 20 client.16371 trim_cache size 0 max 16384 2024-09-21T04:01:19.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.454+0000 7fc9f9fe2740 1 Processor -- start 2024-09-21T04:01:19.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.454+0000 7fc9f9fe2740 1 -- start start 2024-09-21T04:01:19.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.454+0000 7fc9f9fe2740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5579894c9cd0 0x5579898b7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:19.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.454+0000 7fc9f9fe2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5579894e2490 0x5579898bd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:19.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.454+0000 7fc9f9fe2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579894ea670 0x5579898c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:19.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.454+0000 7fc9f9fe2740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec1af720 con 0x5579894c9cd0 2024-09-21T04:01:19.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.454+0000 7fc9f9fe2740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec1b1fc0 con 0x5579894e2490 2024-09-21T04:01:19.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.454+0000 7fc9f9fe2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec1afdb0 con 0x5579894ea670 2024-09-21T04:01:19.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.454+0000 7fc9f180a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5579894c9cd0 0x5579898b7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:19.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.454+0000 7fc9f180a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5579894c9cd0 0x5579898b7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42614/0 (socket says 172.21.15.46:42614) 2024-09-21T04:01:19.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.454+0000 7fc9f180a640 1 -- 172.21.15.46:0/182813389 learned_addr learned my addr 172.21.15.46:0/182813389 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:19.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.454+0000 7fc9f200b640 1 --2- 172.21.15.46:0/182813389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579894ea670 0x5579898c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:19.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.454+0000 7fc9f1009640 1 --2- 172.21.15.46:0/182813389 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5579894e2490 0x5579898bd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:19.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.454+0000 7fc9f180a640 1 -- 172.21.15.46:0/182813389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579894ea670 msgr2=0x5579898c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:19.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.454+0000 7fc9f180a640 1 --2- 172.21.15.46:0/182813389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579894ea670 0x5579898c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:19.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.454+0000 7fc9f180a640 1 -- 172.21.15.46:0/182813389 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5579894e2490 msgr2=0x5579898bd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:19.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.454+0000 7fc9f180a640 1 --2- 172.21.15.46:0/182813389 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5579894e2490 0x5579898bd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:19.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.454+0000 7fc9f180a640 1 -- 172.21.15.46:0/182813389 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579898b49f0 con 0x5579894c9cd0 2024-09-21T04:01:19.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.454+0000 7fc9f200b640 1 --2- 172.21.15.46:0/182813389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579894ea670 0x5579898c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:01:19.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.454+0000 7fc9f1009640 1 --2- 172.21.15.46:0/182813389 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5579894e2490 0x5579898bd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:01:19.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.455+0000 7fc9f180a640 1 --2- 172.21.15.46:0/182813389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5579894c9cd0 0x5579898b7c50 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8032ec0 tx=0x7fc9e802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ea40f214f2bebdc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:19.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.455+0000 7fc9d77fe640 1 -- 172.21.15.46:0/182813389 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e804c070 con 0x5579894c9cd0 2024-09-21T04:01:19.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.455+0000 7fc9d77fe640 1 -- 172.21.15.46:0/182813389 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9e8004490 con 0x5579894c9cd0 2024-09-21T04:01:19.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.455+0000 7fc9d77fe640 1 -- 172.21.15.46:0/182813389 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8035040 con 0x5579894c9cd0 2024-09-21T04:01:19.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.455+0000 7fc9f9fe2740 1 -- 172.21.15.46:0/182813389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5579894c9cd0 msgr2=0x5579898b7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:19.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.455+0000 7fc9f9fe2740 1 --2- 172.21.15.46:0/182813389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5579894c9cd0 0x5579898b7c50 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8032ec0 tx=0x7fc9e802a410 comp rx=0 tx=0).stop 2024-09-21T04:01:19.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.456+0000 7fc9f9fe2740 1 -- 172.21.15.46:0/182813389 shutdown_connections 2024-09-21T04:01:19.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.456+0000 7fc9f9fe2740 1 --2- 172.21.15.46:0/182813389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579894ea670 0x5579898c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:19.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.456+0000 7fc9f9fe2740 1 --2- 172.21.15.46:0/182813389 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5579894e2490 0x5579898bd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:19.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.456+0000 7fc9f9fe2740 1 --2- 172.21.15.46:0/182813389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5579894c9cd0 0x5579898b7c50 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:19.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.456+0000 7fc9f9fe2740 1 -- 172.21.15.46:0/182813389 >> 172.21.15.46:0/182813389 conn(0x5579894ff740 msgr2=0x5579898b7540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:19.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.456+0000 7fc9f9fe2740 1 -- 172.21.15.46:0/182813389 shutdown_connections 2024-09-21T04:01:19.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.456+0000 7fc9f9fe2740 1 -- 172.21.15.46:0/182813389 wait complete. 2024-09-21T04:01:19.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.456+0000 7fc9f9fe2740 1 -- start start 2024-09-21T04:01:19.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.456+0000 7fc9f9fe2740 1 Processor -- start 2024-09-21T04:01:19.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.457+0000 7fc9f9fe2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5579894c9cd0 0x5579898c2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:19.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.457+0000 7fc9f9fe2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579894e2490 0x5579898c2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:19.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.457+0000 7fc9f9fe2740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5579894ea670 0x557989939dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:19.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.457+0000 7fc9f9fe2740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec1b0480 con 0x5579894ea670 2024-09-21T04:01:19.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.457+0000 7fc9f9fe2740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec1b18f0 con 0x5579894c9cd0 2024-09-21T04:01:19.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.457+0000 7fc9f9fe2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec1b0b50 con 0x5579894e2490 2024-09-21T04:01:19.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.457+0000 7fc9f9fe2740 10 client.0 _ll_register_callbacks cb 0x7fc9e8031520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:01:19.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.457+0000 7fc9f200b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5579894ea670 0x557989939dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:19.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.457+0000 7fc9f200b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5579894ea670 0x557989939dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42626/0 (socket says 172.21.15.46:42626) 2024-09-21T04:01:19.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.457+0000 7fc9f200b640 1 -- 172.21.15.46:0/2021438443 learned_addr learned my addr 172.21.15.46:0/2021438443 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:19.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.457+0000 7fc9f1009640 1 --2- 172.21.15.46:0/2021438443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579894e2490 0x5579898c2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:19.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.457+0000 7fc9f180a640 1 --2- 172.21.15.46:0/2021438443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5579894c9cd0 0x5579898c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:19.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.457+0000 7fc9f200b640 1 -- 172.21.15.46:0/2021438443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579894e2490 msgr2=0x5579898c2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:19.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.457+0000 7fc9f200b640 1 --2- 172.21.15.46:0/2021438443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579894e2490 0x5579898c2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:19.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.457+0000 7fc9f200b640 1 -- 172.21.15.46:0/2021438443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5579894c9cd0 msgr2=0x5579898c2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:19.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.457+0000 7fc9f200b640 1 --2- 172.21.15.46:0/2021438443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5579894c9cd0 0x5579898c2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:19.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.457+0000 7fc9f200b640 1 -- 172.21.15.46:0/2021438443 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55798993a310 con 0x5579894ea670 2024-09-21T04:01:19.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.457+0000 7fc9f200b640 1 --2- 172.21.15.46:0/2021438443 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5579894ea670 0x557989939dd0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4004990 tx=0x7fc9e4010c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfbb2a7df2dc3867 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:19.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.457+0000 7fc9d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:01:19.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.457+0000 7fc9d57fa640 1 -- 172.21.15.46:0/2021438443 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e402a060 con 0x5579894ea670 2024-09-21T04:01:19.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.458+0000 7fc9d57fa640 1 -- 172.21.15.46:0/2021438443 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fc9e4004a00 con 0x5579894ea670 2024-09-21T04:01:19.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.458+0000 7fc9f9fe2740 1 -- 172.21.15.46:0/2021438443 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9e8004490 con 0x5579894ea670 2024-09-21T04:01:19.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.458+0000 7fc9d57fa640 1 -- 172.21.15.46:0/2021438443 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc9e4014040 con 0x5579894ea670 2024-09-21T04:01:19.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.458+0000 7fc9f9fe2740 10 client.16377 fetch_fsmap learned FSMap version 20 2024-09-21T04:01:19.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.458+0000 7fc9f9fe2740 1 -- 172.21.15.46:0/2021438443 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55798993b440 con 0x5579894ea670 2024-09-21T04:01:19.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.458+0000 7fc9d57fa640 1 -- 172.21.15.46:0/2021438443 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9e8004490 con 0x5579894ea670 2024-09-21T04:01:19.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.458+0000 7fc9d57fa640 1 -- 172.21.15.46:0/2021438443 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc9e40057d0 con 0x5579894ea670 2024-09-21T04:01:19.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.458+0000 7fc9f9fe2740 10 client.16377 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:01:19.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.458+0000 7fc9f9fe2740 10 client.16377 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:01:19.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.458+0000 7fc9f9fe2740 20 client.16377 populate_metadata read hostname 'smithi046' 2024-09-21T04:01:19.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.458+0000 7fc9f9fe2740 1 --2- 172.21.15.46:0/2021438443 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55798950b350 0x55798993daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:19.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.458+0000 7fc9f9fe2740 4 client.16377 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T04:01:19.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.458+0000 7fc9f9fe2740 1 -- 172.21.15.46:0/2021438443 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557989826860 con 0x55798950b350 2024-09-21T04:01:19.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.458+0000 7fc9f180a640 1 --2- 172.21.15.46:0/2021438443 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55798950b350 0x55798993daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:19.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.459+0000 7fc9f180a640 1 --2- 172.21.15.46:0/2021438443 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55798950b350 0x55798993daa0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b69e037aa577796b server_cookie=3715c1e10e80e9d7 in_seq=0 out_seq=0 2024-09-21T04:01:19.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.459+0000 7fc9d57fa640 10 client.16377 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:01:19.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.461+0000 7fc9d57fa640 1 -- 172.21.15.46:0/2021438443 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557989826860 con 0x55798950b350 2024-09-21T04:01:19.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.461+0000 7fc9d57fa640 10 client.16377 handle_command_reply: tid=0 2024-09-21T04:01:19.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.461+0000 7fc9f9fe2740 1 client.16377 shutdown 2024-09-21T04:01:19.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.461+0000 7fc9f9fe2740 1 -- 172.21.15.46:0/2021438443 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5579894ea670 msgr2=0x557989939dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:19.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.461+0000 7fc9f9fe2740 1 --2- 172.21.15.46:0/2021438443 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5579894ea670 0x557989939dd0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4004990 tx=0x7fc9e4010c10 comp rx=0 tx=0).stop 2024-09-21T04:01:19.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.461+0000 7fc9f9fe2740 1 -- 172.21.15.46:0/2021438443 shutdown_connections 2024-09-21T04:01:19.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.461+0000 7fc9f9fe2740 1 --2- 172.21.15.46:0/2021438443 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55798950b350 0x55798993daa0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:19.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.461+0000 7fc9f9fe2740 1 --2- 172.21.15.46:0/2021438443 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5579894ea670 0x557989939dd0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:19.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.461+0000 7fc9f9fe2740 1 --2- 172.21.15.46:0/2021438443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579894e2490 0x5579898c2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:19.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.461+0000 7fc9f9fe2740 1 --2- 172.21.15.46:0/2021438443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5579894c9cd0 0x5579898c2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:19.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.461+0000 7fc9d57fa640 0 client.16377 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:01:19.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.461+0000 7fc9f9fe2740 1 -- 172.21.15.46:0/2021438443 >> 172.21.15.46:0/2021438443 conn(0x5579894ff740 msgr2=0x5579898b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:19.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.461+0000 7fc9f9fe2740 1 -- 172.21.15.46:0/2021438443 shutdown_connections 2024-09-21T04:01:19.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.461+0000 7fc9f9fe2740 1 -- 172.21.15.46:0/2021438443 wait complete. 2024-09-21T04:01:19.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.461+0000 7fc9f9fe2740 20 client.16377 trim_cache size 0 max 16384 2024-09-21T04:01:19.468 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T04:01:19.468 INFO:teuthology.orchestra.run.smithi046.stdout: "return_code": 0, 2024-09-21T04:01:19.468 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_tag": "d7634007-e881-46f7-9833-ac9bd0a3100e", 2024-09-21T04:01:19.468 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": "asynchronous" 2024-09-21T04:01:19.468 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T04:01:19.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.462+0000 7fc9f3a6e640 1 -- 172.21.15.46:0/1735266548 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc9d80b6680 msgr2=0x7fc9d80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:19.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.462+0000 7fc9f3a6e640 1 --2- 172.21.15.46:0/1735266548 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc9d80b6680 0x7fc9d80b8b90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8000c00 tx=0x7fc9e8031400 comp rx=0 tx=0).stop 2024-09-21T04:01:19.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.462+0000 7fc9f3a6e640 1 -- 172.21.15.46:0/1735266548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9ec1083d0 msgr2=0x7fc9ec1047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:19.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.462+0000 7fc9f3a6e640 1 --2- 172.21.15.46:0/1735266548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9ec1083d0 0x7fc9ec1047c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc00d770 tx=0x7fc9dc00dc30 comp rx=0 tx=0).stop 2024-09-21T04:01:19.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.462+0000 7fc9f3a6e640 1 -- 172.21.15.46:0/1735266548 shutdown_connections 2024-09-21T04:01:19.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.462+0000 7fc9f3a6e640 1 --2- 172.21.15.46:0/1735266548 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fc9d80b6680 0x7fc9d80b8b90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:19.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.462+0000 7fc9f3a6e640 1 --2- 172.21.15.46:0/1735266548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9ec108d20 0x7fc9ec104d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:19.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.462+0000 7fc9f3a6e640 1 --2- 172.21.15.46:0/1735266548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9ec1083d0 0x7fc9ec1047c0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:19.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.462+0000 7fc9f3a6e640 1 --2- 172.21.15.46:0/1735266548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9ec102ae0 0x7fc9ec104280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:19.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.462+0000 7fc9f3a6e640 1 -- 172.21.15.46:0/1735266548 >> 172.21.15.46:0/1735266548 conn(0x7fc9ec079760 msgr2=0x7fc9ec101a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:19.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.462+0000 7fc9f3a6e640 1 -- 172.21.15.46:0/1735266548 shutdown_connections 2024-09-21T04:01:19.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:19.462+0000 7fc9f3a6e640 1 -- 172.21.15.46:0/1735266548 wait complete. 2024-09-21T04:01:20.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:19 smithi162 ceph-mon[35071]: pgmap v508: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T04:01:20.126 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:19 smithi046 ceph-mon[30954]: pgmap v508: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T04:01:20.156 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T04:01:20.317 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:19 smithi105 ceph-mon[34773]: pgmap v508: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T04:01:20.415 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:20.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.907+0000 7f2c57e26640 1 -- 172.21.15.46:0/3464341683 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c501062e0 msgr2=0x7f2c501066f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:20.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.907+0000 7f2c57e26640 1 --2- 172.21.15.46:0/3464341683 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c501062e0 0x7f2c501066f0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f2c40009900 tx=0x7f2c4002a410 comp rx=0 tx=0).stop 2024-09-21T04:01:20.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.907+0000 7f2c57e26640 1 -- 172.21.15.46:0/3464341683 shutdown_connections 2024-09-21T04:01:20.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.907+0000 7f2c57e26640 1 --2- 172.21.15.46:0/3464341683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c50106c30 0x7f2c50110680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.907+0000 7f2c57e26640 1 --2- 172.21.15.46:0/3464341683 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c501062e0 0x7f2c501066f0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.907+0000 7f2c57e26640 1 --2- 172.21.15.46:0/3464341683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c50102000 0x7f2c50102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.907+0000 7f2c57e26640 1 -- 172.21.15.46:0/3464341683 >> 172.21.15.46:0/3464341683 conn(0x7f2c50079e40 msgr2=0x7f2c5007a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:20.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.908+0000 7f2c57e26640 1 -- 172.21.15.46:0/3464341683 shutdown_connections 2024-09-21T04:01:20.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.908+0000 7f2c57e26640 1 -- 172.21.15.46:0/3464341683 wait complete. 2024-09-21T04:01:20.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.908+0000 7f2c57e26640 1 Processor -- start 2024-09-21T04:01:20.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.908+0000 7f2c57e26640 1 -- start start 2024-09-21T04:01:20.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.909+0000 7f2c57e26640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c50102000 0x7f2c5019c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:20.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.909+0000 7f2c57e26640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c501062e0 0x7f2c5019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:20.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.909+0000 7f2c57e26640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c50106c30 0x7f2c501a1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:20.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.909+0000 7f2c57e26640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2c50113ad0 con 0x7f2c50102000 2024-09-21T04:01:20.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.909+0000 7f2c57e26640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2c50113950 con 0x7f2c50106c30 2024-09-21T04:01:20.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.909+0000 7f2c57e26640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2c50113c50 con 0x7f2c501062e0 2024-09-21T04:01:20.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.909+0000 7f2c55bc2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c50102000 0x7f2c5019c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:20.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.909+0000 7f2c55bc2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c50102000 0x7f2c5019c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42642/0 (socket says 172.21.15.46:42642) 2024-09-21T04:01:20.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.909+0000 7f2c55bc2640 1 -- 172.21.15.46:0/2668933132 learned_addr learned my addr 172.21.15.46:0/2668933132 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:20.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.909+0000 7f2c553c1640 1 --2- 172.21.15.46:0/2668933132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c501062e0 0x7f2c5019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:20.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.909+0000 7f2c563c3640 1 --2- 172.21.15.46:0/2668933132 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c50106c30 0x7f2c501a1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:20.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.909+0000 7f2c55bc2640 1 -- 172.21.15.46:0/2668933132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c501062e0 msgr2=0x7f2c5019cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:20.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.909+0000 7f2c55bc2640 1 --2- 172.21.15.46:0/2668933132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c501062e0 0x7f2c5019cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.909+0000 7f2c55bc2640 1 -- 172.21.15.46:0/2668933132 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c50106c30 msgr2=0x7f2c501a1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:20.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.909+0000 7f2c55bc2640 1 --2- 172.21.15.46:0/2668933132 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c50106c30 0x7f2c501a1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.909+0000 7f2c55bc2640 1 -- 172.21.15.46:0/2668933132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c501a2610 con 0x7f2c50102000 2024-09-21T04:01:20.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.909+0000 7f2c563c3640 1 --2- 172.21.15.46:0/2668933132 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c50106c30 0x7f2c501a1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:01:20.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.909+0000 7f2c55bc2640 1 --2- 172.21.15.46:0/2668933132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c50102000 0x7f2c5019c6a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00d950 tx=0x7f2c4c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:20.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.910+0000 7f2c46ffd640 1 -- 172.21.15.46:0/2668933132 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c017030 con 0x7f2c50102000 2024-09-21T04:01:20.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.910+0000 7f2c46ffd640 1 -- 172.21.15.46:0/2668933132 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c4c004020 con 0x7f2c50102000 2024-09-21T04:01:20.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.910+0000 7f2c57e26640 1 -- 172.21.15.46:0/2668933132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c501a2900 con 0x7f2c50102000 2024-09-21T04:01:20.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.910+0000 7f2c46ffd640 1 -- 172.21.15.46:0/2668933132 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c0047a0 con 0x7f2c50102000 2024-09-21T04:01:20.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.910+0000 7f2c57e26640 1 -- 172.21.15.46:0/2668933132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c501a9060 con 0x7f2c50102000 2024-09-21T04:01:20.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.912+0000 7f2c5e39a740 1 Processor -- start 2024-09-21T04:01:20.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.912+0000 7f2c5e39a740 1 -- start start 2024-09-21T04:01:20.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.913+0000 7f2c46ffd640 1 -- 172.21.15.46:0/2668933132 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f2c4c009a30 con 0x7f2c50102000 2024-09-21T04:01:20.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.913+0000 7f2c5e39a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56233450e070 0x5623348b5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:20.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.913+0000 7f2c5e39a740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623344e51b0 0x5623348b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:20.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.913+0000 7f2c5e39a740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623344ed390 0x5623348b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:20.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.913+0000 7f2c5e39a740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x56233482be50 con 0x5623344ed390 2024-09-21T04:01:20.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.913+0000 7f2c5e39a740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56233481b280 con 0x5623344e51b0 2024-09-21T04:01:20.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.913+0000 7f2c5e39a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56233481f090 con 0x56233450e070 2024-09-21T04:01:20.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.913+0000 7f2c553c1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623344ed390 0x5623348b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:20.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.913+0000 7f2c553c1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623344ed390 0x5623348b60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42654/0 (socket says 172.21.15.46:42654) 2024-09-21T04:01:20.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.913+0000 7f2c553c1640 1 -- 172.21.15.46:0/3638917300 learned_addr learned my addr 172.21.15.46:0/3638917300 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:20.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.913+0000 7f2c563c3640 1 --2- 172.21.15.46:0/3638917300 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56233450e070 0x5623348b5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:20.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.913+0000 7f2c55bc2640 1 --2- 172.21.15.46:0/3638917300 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623344e51b0 0x5623348b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:20.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.913+0000 7f2c553c1640 1 -- 172.21.15.46:0/3638917300 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56233450e070 msgr2=0x5623348b5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:20.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.913+0000 7f2c553c1640 1 --2- 172.21.15.46:0/3638917300 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56233450e070 0x5623348b5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.913+0000 7f2c553c1640 1 -- 172.21.15.46:0/3638917300 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623344e51b0 msgr2=0x5623348b5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:20.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.913+0000 7f2c553c1640 1 --2- 172.21.15.46:0/3638917300 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623344e51b0 0x5623348b5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.913+0000 7f2c553c1640 1 -- 172.21.15.46:0/3638917300 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562334579650 con 0x5623344ed390 2024-09-21T04:01:20.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.914+0000 7f2c553c1640 1 --2- 172.21.15.46:0/3638917300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623344ed390 0x5623348b60d0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f2c40009900 tx=0x7f2c40032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc5a482225065676 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:20.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.914+0000 7f2c46ffd640 1 --2- 172.21.15.46:0/2668933132 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f2c3c0b6700 0x7f2c3c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:20.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.914+0000 7f2c563c3640 1 --2- 172.21.15.46:0/2668933132 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f2c3c0b6700 0x7f2c3c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:20.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.914+0000 7f2c3bfff640 1 -- 172.21.15.46:0/3638917300 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4003f070 con 0x5623344ed390 2024-09-21T04:01:20.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.914+0000 7f2c46ffd640 1 -- 172.21.15.46:0/2668933132 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f2c4c0e71d0 con 0x7f2c50102000 2024-09-21T04:01:20.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.914+0000 7f2c3bfff640 1 -- 172.21.15.46:0/3638917300 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c40032e40 con 0x5623344ed390 2024-09-21T04:01:20.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.914+0000 7f2c3bfff640 1 -- 172.21.15.46:0/3638917300 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c40035070 con 0x5623344ed390 2024-09-21T04:01:20.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.915+0000 7f2c5e39a740 1 -- 172.21.15.46:0/3638917300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623344ed390 msgr2=0x5623348b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:20.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.915+0000 7f2c563c3640 1 --2- 172.21.15.46:0/2668933132 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f2c3c0b6700 0x7f2c3c0b8c10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2c48009370 tx=0x7f2c48009720 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:20.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.915+0000 7f2c5e39a740 1 --2- 172.21.15.46:0/3638917300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623344ed390 0x5623348b60d0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f2c40009900 tx=0x7f2c40032c50 comp rx=0 tx=0).stop 2024-09-21T04:01:20.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.915+0000 7f2c5e39a740 1 -- 172.21.15.46:0/3638917300 shutdown_connections 2024-09-21T04:01:20.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.915+0000 7f2c5e39a740 1 --2- 172.21.15.46:0/3638917300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623344ed390 0x5623348b60d0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.915+0000 7f2c5e39a740 1 --2- 172.21.15.46:0/3638917300 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623344e51b0 0x5623348b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.915+0000 7f2c5e39a740 1 --2- 172.21.15.46:0/3638917300 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56233450e070 0x5623348b5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.915+0000 7f2c5e39a740 1 -- 172.21.15.46:0/3638917300 >> 172.21.15.46:0/3638917300 conn(0x562334502460 msgr2=0x5623348b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:20.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.915+0000 7f2c5e39a740 1 -- 172.21.15.46:0/3638917300 shutdown_connections 2024-09-21T04:01:20.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.915+0000 7f2c5e39a740 1 -- 172.21.15.46:0/3638917300 wait complete. 2024-09-21T04:01:20.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.915+0000 7f2c5e39a740 1 -- start start 2024-09-21T04:01:20.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.916+0000 7f2c5e39a740 1 Processor -- start 2024-09-21T04:01:20.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.916+0000 7f2c5e39a740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623344e51b0 0x5623348c0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:20.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.916+0000 7f2c5e39a740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623344ed390 0x5623348c1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:20.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.916+0000 7f2c5e39a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56233450e070 0x5623348cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:20.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.916+0000 7f2c5e39a740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x56233467c700 con 0x5623344e51b0 2024-09-21T04:01:20.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.916+0000 7f2c5e39a740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5623347b6110 con 0x5623344ed390 2024-09-21T04:01:20.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.916+0000 7f2c5e39a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5623348c3dd0 con 0x56233450e070 2024-09-21T04:01:20.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.916+0000 7f2c5e39a740 10 client.0 _ll_register_callbacks cb 0x5623347cf990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:01:20.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.916+0000 7f2c55bc2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623344e51b0 0x5623348c0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:20.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.916+0000 7f2c55bc2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623344e51b0 0x5623348c0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42658/0 (socket says 172.21.15.46:42658) 2024-09-21T04:01:20.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.916+0000 7f2c55bc2640 1 -- 172.21.15.46:0/1231583059 learned_addr learned my addr 172.21.15.46:0/1231583059 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:20.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.916+0000 7f2c553c1640 1 --2- 172.21.15.46:0/1231583059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623344ed390 0x5623348c1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:20.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.916+0000 7f2c563c3640 1 --2- 172.21.15.46:0/1231583059 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56233450e070 0x5623348cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:20.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.917+0000 7f2c55bc2640 1 -- 172.21.15.46:0/1231583059 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56233450e070 msgr2=0x5623348cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:20.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.917+0000 7f2c55bc2640 1 --2- 172.21.15.46:0/1231583059 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56233450e070 0x5623348cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.917+0000 7f2c55bc2640 1 -- 172.21.15.46:0/1231583059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623344ed390 msgr2=0x5623348c1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:20.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.917+0000 7f2c55bc2640 1 --2- 172.21.15.46:0/1231583059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623344ed390 0x5623348c1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.917+0000 7f2c55bc2640 1 -- 172.21.15.46:0/1231583059 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623347e3c40 con 0x5623344e51b0 2024-09-21T04:01:20.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.917+0000 7f2c553c1640 1 --2- 172.21.15.46:0/1231583059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623344ed390 0x5623348c1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:01:20.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.917+0000 7f2c55bc2640 1 --2- 172.21.15.46:0/1231583059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623344e51b0 0x5623348c0d30 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c0acdc0 tx=0x7f2c4c0a9020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9cc7156531ad247 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:20.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.917+0000 7f2c397fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:01:20.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.917+0000 7f2c397fa640 1 -- 172.21.15.46:0/1231583059 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c0ac830 con 0x5623344e51b0 2024-09-21T04:01:20.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.917+0000 7f2c397fa640 1 -- 172.21.15.46:0/1231583059 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f2c4c0e9110 con 0x5623344e51b0 2024-09-21T04:01:20.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.917+0000 7f2c5e39a740 1 -- 172.21.15.46:0/1231583059 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56233482dda0 con 0x5623344e51b0 2024-09-21T04:01:20.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.917+0000 7f2c397fa640 1 -- 172.21.15.46:0/1231583059 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2c4c0e4e40 con 0x5623344e51b0 2024-09-21T04:01:20.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.917+0000 7f2c5e39a740 10 client.16389 fetch_fsmap learned FSMap version 20 2024-09-21T04:01:20.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.917+0000 7f2c5e39a740 1 -- 172.21.15.46:0/1231583059 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5623348cfb10 con 0x5623344e51b0 2024-09-21T04:01:20.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.917+0000 7f2c397fa640 1 -- 172.21.15.46:0/1231583059 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56233482dda0 con 0x5623344e51b0 2024-09-21T04:01:20.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.918+0000 7f2c397fa640 1 -- 172.21.15.46:0/1231583059 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f2c4c0a8a10 con 0x5623344e51b0 2024-09-21T04:01:20.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.918+0000 7f2c5e39a740 10 client.16389 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:01:20.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.918+0000 7f2c5e39a740 10 client.16389 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:01:20.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.918+0000 7f2c5e39a740 20 client.16389 populate_metadata read hostname 'smithi046' 2024-09-21T04:01:20.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.918+0000 7f2c5e39a740 1 --2- 172.21.15.46:0/1231583059 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5623344cc9f0 0x5623348d3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:20.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.918+0000 7f2c5e39a740 4 client.16389 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:01:20.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.918+0000 7f2c5e39a740 1 -- 172.21.15.46:0/1231583059 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562334829850 con 0x5623344cc9f0 2024-09-21T04:01:20.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.918+0000 7f2c553c1640 1 --2- 172.21.15.46:0/1231583059 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5623344cc9f0 0x5623348d3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:20.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.919+0000 7f2c397fa640 10 client.16389 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:01:20.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.919+0000 7f2c553c1640 1 --2- 172.21.15.46:0/1231583059 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5623344cc9f0 0x5623348d3070 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e58736f80a3a8943 server_cookie=11e28d7919e223f9 in_seq=0 out_seq=0 2024-09-21T04:01:20.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.919+0000 7f2c397fa640 1 -- 172.21.15.46:0/1231583059 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562334829850 con 0x5623344cc9f0 2024-09-21T04:01:20.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.919+0000 7f2c397fa640 10 client.16389 handle_command_reply: tid=0 2024-09-21T04:01:20.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.919+0000 7f2c5e39a740 1 client.16389 shutdown 2024-09-21T04:01:20.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.920+0000 7f2c5e39a740 1 -- 172.21.15.46:0/1231583059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623344e51b0 msgr2=0x5623348c0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:20.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.920+0000 7f2c5e39a740 1 --2- 172.21.15.46:0/1231583059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623344e51b0 0x5623348c0d30 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c0acdc0 tx=0x7f2c4c0a9020 comp rx=0 tx=0).stop 2024-09-21T04:01:20.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.920+0000 7f2c5e39a740 1 -- 172.21.15.46:0/1231583059 shutdown_connections 2024-09-21T04:01:20.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.920+0000 7f2c5e39a740 1 --2- 172.21.15.46:0/1231583059 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5623344cc9f0 0x5623348d3070 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.920+0000 7f2c5e39a740 1 --2- 172.21.15.46:0/1231583059 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56233450e070 0x5623348cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.920+0000 7f2c5e39a740 1 --2- 172.21.15.46:0/1231583059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623344ed390 0x5623348c1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.920+0000 7f2c397fa640 0 client.16389 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:01:20.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.920+0000 7f2c5e39a740 1 --2- 172.21.15.46:0/1231583059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5623344e51b0 0x5623348c0d30 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.920+0000 7f2c5e39a740 1 -- 172.21.15.46:0/1231583059 >> 172.21.15.46:0/1231583059 conn(0x562334502460 msgr2=0x5623348b87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:20.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.920+0000 7f2c5e39a740 1 -- 172.21.15.46:0/1231583059 shutdown_connections 2024-09-21T04:01:20.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.920+0000 7f2c5e39a740 1 -- 172.21.15.46:0/1231583059 wait complete. 2024-09-21T04:01:20.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.920+0000 7f2c5e39a740 20 client.16389 trim_cache size 0 max 16384 2024-09-21T04:01:20.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.937+0000 7f2c5e39a740 1 Processor -- start 2024-09-21T04:01:20.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.937+0000 7f2c5e39a740 1 -- start start 2024-09-21T04:01:20.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.938+0000 7f2c5e39a740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623344e51b0 0x5623348c11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:20.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.938+0000 7f2c5e39a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5623344ed390 0x5623348ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:20.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.938+0000 7f2c5e39a740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56233450e070 0x5623348cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:20.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.938+0000 7f2c5e39a740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2c501af640 con 0x56233450e070 2024-09-21T04:01:20.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.938+0000 7f2c5e39a740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2c501b1ee0 con 0x5623344e51b0 2024-09-21T04:01:20.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.938+0000 7f2c5e39a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2c501afcd0 con 0x5623344ed390 2024-09-21T04:01:20.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.938+0000 7f2c563c3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56233450e070 0x5623348cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:20.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.938+0000 7f2c563c3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56233450e070 0x5623348cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42662/0 (socket says 172.21.15.46:42662) 2024-09-21T04:01:20.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.938+0000 7f2c563c3640 1 -- 172.21.15.46:0/2982332740 learned_addr learned my addr 172.21.15.46:0/2982332740 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:20.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.938+0000 7f2c553c1640 1 --2- 172.21.15.46:0/2982332740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5623344ed390 0x5623348ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:20.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.938+0000 7f2c55bc2640 1 --2- 172.21.15.46:0/2982332740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623344e51b0 0x5623348c11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:20.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.938+0000 7f2c563c3640 1 -- 172.21.15.46:0/2982332740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5623344ed390 msgr2=0x5623348ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:20.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.938+0000 7f2c563c3640 1 --2- 172.21.15.46:0/2982332740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5623344ed390 0x5623348ccfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.938+0000 7f2c563c3640 1 -- 172.21.15.46:0/2982332740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623344e51b0 msgr2=0x5623348c11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:20.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.938+0000 7f2c563c3640 1 --2- 172.21.15.46:0/2982332740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623344e51b0 0x5623348c11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.938+0000 7f2c563c3640 1 -- 172.21.15.46:0/2982332740 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623348b84b0 con 0x56233450e070 2024-09-21T04:01:20.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.939+0000 7f2c563c3640 1 --2- 172.21.15.46:0/2982332740 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56233450e070 0x5623348cd500 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f2c48012870 tx=0x7f2c48014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3666d6125beb56 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:20.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.939+0000 7f2c3b7fe640 1 -- 172.21.15.46:0/2982332740 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c48004d20 con 0x56233450e070 2024-09-21T04:01:20.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.939+0000 7f2c3b7fe640 1 -- 172.21.15.46:0/2982332740 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c4801fdf0 con 0x56233450e070 2024-09-21T04:01:20.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.939+0000 7f2c3b7fe640 1 -- 172.21.15.46:0/2982332740 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c48005910 con 0x56233450e070 2024-09-21T04:01:20.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.939+0000 7f2c5e39a740 1 -- 172.21.15.46:0/2982332740 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56233450e070 msgr2=0x5623348cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:20.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.939+0000 7f2c5e39a740 1 --2- 172.21.15.46:0/2982332740 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56233450e070 0x5623348cd500 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f2c48012870 tx=0x7f2c48014000 comp rx=0 tx=0).stop 2024-09-21T04:01:20.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.939+0000 7f2c5e39a740 1 -- 172.21.15.46:0/2982332740 shutdown_connections 2024-09-21T04:01:20.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.939+0000 7f2c5e39a740 1 --2- 172.21.15.46:0/2982332740 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56233450e070 0x5623348cd500 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.939+0000 7f2c5e39a740 1 --2- 172.21.15.46:0/2982332740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5623344ed390 0x5623348ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.939+0000 7f2c5e39a740 1 --2- 172.21.15.46:0/2982332740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623344e51b0 0x5623348c11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.939+0000 7f2c5e39a740 1 -- 172.21.15.46:0/2982332740 >> 172.21.15.46:0/2982332740 conn(0x562334502460 msgr2=0x5623348c0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:20.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.940+0000 7f2c5e39a740 1 -- 172.21.15.46:0/2982332740 shutdown_connections 2024-09-21T04:01:20.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.940+0000 7f2c5e39a740 1 -- 172.21.15.46:0/2982332740 wait complete. 2024-09-21T04:01:20.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.940+0000 7f2c5e39a740 1 -- start start 2024-09-21T04:01:20.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.940+0000 7f2c5e39a740 1 Processor -- start 2024-09-21T04:01:20.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.940+0000 7f2c5e39a740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623344e51b0 0x5623348c5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:20.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.941+0000 7f2c5e39a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5623344ed390 0x5623348c59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:20.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.941+0000 7f2c5e39a740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56233450e070 0x56233493ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:20.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.941+0000 7f2c5e39a740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2c501b03a0 con 0x56233450e070 2024-09-21T04:01:20.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.941+0000 7f2c5e39a740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2c501b1810 con 0x5623344e51b0 2024-09-21T04:01:20.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.941+0000 7f2c5e39a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2c501b0a70 con 0x5623344ed390 2024-09-21T04:01:20.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.941+0000 7f2c5e39a740 10 client.0 _ll_register_callbacks cb 0x7f2c4c0a9710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:01:20.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.941+0000 7f2c563c3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56233450e070 0x56233493ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:20.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.941+0000 7f2c563c3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56233450e070 0x56233493ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42670/0 (socket says 172.21.15.46:42670) 2024-09-21T04:01:20.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.941+0000 7f2c563c3640 1 -- 172.21.15.46:0/3460152369 learned_addr learned my addr 172.21.15.46:0/3460152369 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:20.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.941+0000 7f2c55bc2640 1 --2- 172.21.15.46:0/3460152369 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623344e51b0 0x5623348c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:20.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.941+0000 7f2c553c1640 1 --2- 172.21.15.46:0/3460152369 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5623344ed390 0x5623348c59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:20.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.941+0000 7f2c563c3640 1 -- 172.21.15.46:0/3460152369 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5623344ed390 msgr2=0x5623348c59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:20.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.941+0000 7f2c563c3640 1 --2- 172.21.15.46:0/3460152369 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5623344ed390 0x5623348c59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.941+0000 7f2c563c3640 1 -- 172.21.15.46:0/3460152369 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623344e51b0 msgr2=0x5623348c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:20.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.941+0000 7f2c563c3640 1 --2- 172.21.15.46:0/3460152369 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623344e51b0 0x5623348c5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.941+0000 7f2c563c3640 1 -- 172.21.15.46:0/3460152369 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56233493cf70 con 0x56233450e070 2024-09-21T04:01:20.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.941+0000 7f2c563c3640 1 --2- 172.21.15.46:0/3460152369 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56233450e070 0x56233493ca30 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f2c480052e0 tx=0x7f2c48005310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c015d12ab06b368 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:20.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.941+0000 7f2c397fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:01:20.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.941+0000 7f2c397fa640 1 -- 172.21.15.46:0/3460152369 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c48038060 con 0x56233450e070 2024-09-21T04:01:20.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.942+0000 7f2c397fa640 1 -- 172.21.15.46:0/3460152369 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f2c4801fbd0 con 0x56233450e070 2024-09-21T04:01:20.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.942+0000 7f2c5e39a740 1 -- 172.21.15.46:0/3460152369 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c4801fdf0 con 0x56233450e070 2024-09-21T04:01:20.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.942+0000 7f2c397fa640 1 -- 172.21.15.46:0/3460152369 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2c48005510 con 0x56233450e070 2024-09-21T04:01:20.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.942+0000 7f2c5e39a740 10 client.16395 fetch_fsmap learned FSMap version 20 2024-09-21T04:01:20.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.942+0000 7f2c5e39a740 1 -- 172.21.15.46:0/3460152369 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56233493e100 con 0x56233450e070 2024-09-21T04:01:20.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.942+0000 7f2c397fa640 1 -- 172.21.15.46:0/3460152369 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c4801fdf0 con 0x56233450e070 2024-09-21T04:01:20.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.942+0000 7f2c397fa640 1 -- 172.21.15.46:0/3460152369 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f2c4800f040 con 0x56233450e070 2024-09-21T04:01:20.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.942+0000 7f2c5e39a740 10 client.16395 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:01:20.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.942+0000 7f2c5e39a740 10 client.16395 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:01:20.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.942+0000 7f2c5e39a740 20 client.16395 populate_metadata read hostname 'smithi046' 2024-09-21T04:01:20.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.942+0000 7f2c5e39a740 1 --2- 172.21.15.46:0/3460152369 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5623344a1da0 0x5623349407b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:20.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.942+0000 7f2c5e39a740 4 client.16395 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T04:01:20.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.942+0000 7f2c5e39a740 1 -- 172.21.15.46:0/3460152369 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562334826c80 con 0x5623344a1da0 2024-09-21T04:01:20.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.943+0000 7f2c55bc2640 1 --2- 172.21.15.46:0/3460152369 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5623344a1da0 0x5623349407b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:20.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.943+0000 7f2c55bc2640 1 --2- 172.21.15.46:0/3460152369 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5623344a1da0 0x5623349407b0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13eaf8b7ff326345 server_cookie=1f75a224c9fa2f9e in_seq=0 out_seq=0 2024-09-21T04:01:20.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.943+0000 7f2c397fa640 10 client.16395 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:01:20.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.943+0000 7f2c397fa640 1 -- 172.21.15.46:0/3460152369 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3978 (crc 0 0 0) 0x562334826c80 con 0x5623344a1da0 2024-09-21T04:01:20.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.943+0000 7f2c397fa640 10 client.16395 handle_command_reply: tid=0 2024-09-21T04:01:20.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.943+0000 7f2c5e39a740 1 client.16395 shutdown 2024-09-21T04:01:20.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.944+0000 7f2c5e39a740 1 -- 172.21.15.46:0/3460152369 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56233450e070 msgr2=0x56233493ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:20.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.944+0000 7f2c5e39a740 1 --2- 172.21.15.46:0/3460152369 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56233450e070 0x56233493ca30 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f2c480052e0 tx=0x7f2c48005310 comp rx=0 tx=0).stop 2024-09-21T04:01:20.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.944+0000 7f2c5e39a740 1 -- 172.21.15.46:0/3460152369 shutdown_connections 2024-09-21T04:01:20.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.944+0000 7f2c5e39a740 1 --2- 172.21.15.46:0/3460152369 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5623344a1da0 0x5623349407b0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.944+0000 7f2c5e39a740 1 --2- 172.21.15.46:0/3460152369 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56233450e070 0x56233493ca30 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.944+0000 7f2c5e39a740 1 --2- 172.21.15.46:0/3460152369 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5623344ed390 0x5623348c59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.944+0000 7f2c5e39a740 1 --2- 172.21.15.46:0/3460152369 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623344e51b0 0x5623348c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.944+0000 7f2c397fa640 0 client.16395 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:01:20.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.944+0000 7f2c5e39a740 1 -- 172.21.15.46:0/3460152369 >> 172.21.15.46:0/3460152369 conn(0x562334502460 msgr2=0x5623348b8750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:20.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.944+0000 7f2c5e39a740 1 -- 172.21.15.46:0/3460152369 shutdown_connections 2024-09-21T04:01:20.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.944+0000 7f2c5e39a740 1 -- 172.21.15.46:0/3460152369 wait complete. 2024-09-21T04:01:20.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.944+0000 7f2c5e39a740 20 client.16395 trim_cache size 0 max 16384 2024-09-21T04:01:20.951 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T04:01:20.951 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T04:01:20.951 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2024-09-21T04:01:20.951 INFO:teuthology.orchestra.run.smithi046.stdout: "d7634007-e881-46f7-9833-ac9bd0a3100e": { 2024-09-21T04:01:20.951 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:20.952 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "d7634007-e881-46f7-9833-ac9bd0a3100e", 2024-09-21T04:01:20.952 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2024-09-21T04:01:20.952 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:01:20.952 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:20.952 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_stats": { 2024-09-21T04:01:20.952 INFO:teuthology.orchestra.run.smithi046.stdout: "d7634007-e881-46f7-9833-ac9bd0a3100e": { 2024-09-21T04:01:20.952 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:01:19.459151+0000", 2024-09-21T04:01:20.952 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:20.952 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:20.952 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:20.952 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:20.953 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:20.953 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:20.953 INFO:teuthology.orchestra.run.smithi046.stdout: "0d781b95-cf5e-46f2-9875-2923181385e2": { 2024-09-21T04:01:20.953 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:00:33.099094+0000", 2024-09-21T04:01:20.953 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:20.953 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:20.953 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:20.953 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:20.953 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:20.953 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:20.953 INFO:teuthology.orchestra.run.smithi046.stdout: "326aaecf-f38a-4946-988a-d83f25556995": { 2024-09-21T04:01:20.953 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:54.189884+0000", 2024-09-21T04:01:20.953 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:20.954 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:20.954 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:20.954 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:20.954 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:20.954 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:20.954 INFO:teuthology.orchestra.run.smithi046.stdout: "46bb5415-6e16-47c6-a1e4-55f9c623ce90": { 2024-09-21T04:01:20.954 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:14.950674+0000", 2024-09-21T04:01:20.954 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:20.954 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:20.954 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:20.954 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:20.954 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:20.954 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:20.955 INFO:teuthology.orchestra.run.smithi046.stdout: "6103c660-8e77-4b06-ad6c-bb322c26035a": { 2024-09-21T04:01:20.955 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:35.594467+0000", 2024-09-21T04:01:20.955 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:20.955 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:20.955 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:20.955 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:20.955 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:20.955 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:20.955 INFO:teuthology.orchestra.run.smithi046.stdout: "dab67652-8894-4711-be64-cbdfea27a9ba": { 2024-09-21T04:01:20.955 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:28.161616+0000", 2024-09-21T04:01:20.955 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:20.955 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:20.955 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:20.956 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:20.956 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:20.956 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:20.956 INFO:teuthology.orchestra.run.smithi046.stdout: "c47f458a-de5e-4952-a575-a81261953667": { 2024-09-21T04:01:20.956 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:48.699411+0000", 2024-09-21T04:01:20.956 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:20.956 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:20.956 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:20.956 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:20.956 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:20.956 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:20.956 INFO:teuthology.orchestra.run.smithi046.stdout: "e24ec8f1-0d13-478f-9c2c-b51798868ffc": { 2024-09-21T04:01:20.957 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:09.736194+0000", 2024-09-21T04:01:20.957 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:20.957 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:20.957 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:20.957 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:20.957 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:20.957 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:20.957 INFO:teuthology.orchestra.run.smithi046.stdout: "edc4b8c7-b702-489d-a925-ae7ad0ff0d9a": { 2024-09-21T04:01:20.957 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:00:40.181950+0000", 2024-09-21T04:01:20.958 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:20.958 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:20.958 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:20.958 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:20.958 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:20.958 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:20.958 INFO:teuthology.orchestra.run.smithi046.stdout: "a871f724-0198-493c-b03e-b2de78aba243": { 2024-09-21T04:01:20.958 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:56:30.082991+0000", 2024-09-21T04:01:20.958 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:20.958 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:20.959 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:20.959 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:20.959 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:20.959 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:20.959 INFO:teuthology.orchestra.run.smithi046.stdout: "d49f33a7-3d5a-421b-94ba-8b19a4120db1": { 2024-09-21T04:01:20.959 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:50.480786+0000", 2024-09-21T04:01:20.959 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:20.959 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:20.959 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:20.959 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:20.959 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:20.959 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:20.960 INFO:teuthology.orchestra.run.smithi046.stdout: "3bbf7097-70d7-4743-bbce-41465502b35b": { 2024-09-21T04:01:20.960 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:10.661441+0000", 2024-09-21T04:01:20.960 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:20.960 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:20.960 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:20.960 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:20.960 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:20.960 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:20.960 INFO:teuthology.orchestra.run.smithi046.stdout: "08f0c962-df1a-4129-a1a2-b916240d9803": { 2024-09-21T04:01:20.961 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:02.937596+0000", 2024-09-21T04:01:20.961 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:20.961 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:20.961 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:20.961 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:20.961 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:20.961 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:01:20.961 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:01:20.961 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T04:01:20.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.945+0000 7f2c57e26640 1 -- 172.21.15.46:0/2668933132 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f2c3c0b6700 msgr2=0x7f2c3c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:20.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.945+0000 7f2c57e26640 1 --2- 172.21.15.46:0/2668933132 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f2c3c0b6700 0x7f2c3c0b8c10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2c48009370 tx=0x7f2c48009720 comp rx=0 tx=0).stop 2024-09-21T04:01:20.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.945+0000 7f2c57e26640 1 -- 172.21.15.46:0/2668933132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c50102000 msgr2=0x7f2c5019c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:20.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.945+0000 7f2c57e26640 1 --2- 172.21.15.46:0/2668933132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c50102000 0x7f2c5019c6a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00d950 tx=0x7f2c4c00de10 comp rx=0 tx=0).stop 2024-09-21T04:01:20.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.945+0000 7f2c57e26640 1 -- 172.21.15.46:0/2668933132 shutdown_connections 2024-09-21T04:01:20.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.945+0000 7f2c57e26640 1 --2- 172.21.15.46:0/2668933132 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c50106c30 0x7f2c501a1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.945+0000 7f2c57e26640 1 --2- 172.21.15.46:0/2668933132 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f2c3c0b6700 0x7f2c3c0b8c10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.945+0000 7f2c57e26640 1 --2- 172.21.15.46:0/2668933132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c501062e0 0x7f2c5019cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.945+0000 7f2c57e26640 1 --2- 172.21.15.46:0/2668933132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c50102000 0x7f2c5019c6a0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.945+0000 7f2c57e26640 1 -- 172.21.15.46:0/2668933132 >> 172.21.15.46:0/2668933132 conn(0x7f2c50079e40 msgr2=0x7f2c50107370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:20.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.945+0000 7f2c57e26640 1 -- 172.21.15.46:0/2668933132 shutdown_connections 2024-09-21T04:01:20.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:20.945+0000 7f2c57e26640 1 -- 172.21.15.46:0/2668933132 wait complete. 2024-09-21T04:01:21.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:20 smithi162 ceph-mon[35071]: scrub queued for path: / 2024-09-21T04:01:21.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:20 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T04:01:21.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:20 smithi162 ceph-mon[35071]: scrub summary: active paths [/] 2024-09-21T04:01:21.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:20 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T04:01:21.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:20 smithi046 ceph-mon[30954]: scrub queued for path: / 2024-09-21T04:01:21.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:20 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T04:01:21.253 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:20 smithi046 ceph-mon[30954]: scrub summary: active paths [/] 2024-09-21T04:01:21.253 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:20 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T04:01:21.321 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:20 smithi105 ceph-mon[34773]: scrub queued for path: / 2024-09-21T04:01:21.321 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:20 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T04:01:21.322 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:20 smithi105 ceph-mon[34773]: scrub summary: active paths [/] 2024-09-21T04:01:21.322 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:20 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T04:01:21.718 INFO:tasks.cephfs.filesystem:scrub status for tag:d7634007-e881-46f7-9833-ac9bd0a3100e - {'path': '/', 'tag': 'd7634007-e881-46f7-9833-ac9bd0a3100e', 'options': 'recursive,force'} 2024-09-21T04:01:22.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:21 smithi046 ceph-mon[30954]: pgmap v509: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T04:01:22.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:21 smithi162 ceph-mon[35071]: pgmap v509: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T04:01:22.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:21 smithi105 ceph-mon[34773]: pgmap v509: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T04:01:24.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:23 smithi162 ceph-mon[35071]: pgmap v510: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-21T04:01:24.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:23 smithi162 ceph-mon[35071]: scrub summary: idle 2024-09-21T04:01:24.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:23 smithi046 ceph-mon[30954]: pgmap v510: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-21T04:01:24.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:23 smithi046 ceph-mon[30954]: scrub summary: idle 2024-09-21T04:01:24.317 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:23 smithi105 ceph-mon[34773]: pgmap v510: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-21T04:01:24.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:23 smithi105 ceph-mon[34773]: scrub summary: idle 2024-09-21T04:01:26.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:25 smithi162 ceph-mon[35071]: pgmap v511: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T04:01:26.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:25 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:01:26.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:25 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:01:26.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:25 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:01:26.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:25 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:01:26.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:25 smithi046 ceph-mon[30954]: pgmap v511: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T04:01:26.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:25 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:01:26.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:25 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:01:26.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:25 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:01:26.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:25 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:01:26.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:25 smithi105 ceph-mon[34773]: pgmap v511: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T04:01:26.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:25 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:01:26.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:25 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:01:26.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:25 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:01:26.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:25 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:01:28.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:27 smithi046 ceph-mon[30954]: pgmap v512: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T04:01:28.317 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:27 smithi105 ceph-mon[34773]: pgmap v512: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T04:01:28.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:27 smithi162 ceph-mon[35071]: pgmap v512: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T04:01:30.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:29 smithi046 ceph-mon[30954]: pgmap v513: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T04:01:30.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:29 smithi105 ceph-mon[34773]: pgmap v513: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T04:01:30.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:29 smithi162 ceph-mon[35071]: pgmap v513: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T04:01:32.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:31 smithi046 ceph-mon[30954]: pgmap v514: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T04:01:32.317 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:31 smithi105 ceph-mon[34773]: pgmap v514: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T04:01:32.377 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:31 smithi162 ceph-mon[35071]: pgmap v514: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T04:01:34.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:33 smithi046 ceph-mon[30954]: pgmap v515: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-21T04:01:34.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:33 smithi105 ceph-mon[34773]: pgmap v515: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-21T04:01:34.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:33 smithi162 ceph-mon[35071]: pgmap v515: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-21T04:01:36.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:35 smithi046 ceph-mon[30954]: pgmap v516: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2 op/s 2024-09-21T04:01:36.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:35 smithi105 ceph-mon[34773]: pgmap v516: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2 op/s 2024-09-21T04:01:36.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:35 smithi162 ceph-mon[35071]: pgmap v516: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2 op/s 2024-09-21T04:01:38.255 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:37 smithi046 ceph-mon[30954]: pgmap v517: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:01:38.322 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:37 smithi105 ceph-mon[34773]: pgmap v517: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:01:38.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:37 smithi162 ceph-mon[35071]: pgmap v517: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:01:40.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:39 smithi046 ceph-mon[30954]: pgmap v518: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:01:40.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:39 smithi105 ceph-mon[34773]: pgmap v518: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:01:40.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:39 smithi162 ceph-mon[35071]: pgmap v518: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:01:42.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:41 smithi046 ceph-mon[30954]: pgmap v519: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:01:42.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:41 smithi105 ceph-mon[34773]: pgmap v519: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:01:42.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:41 smithi162 ceph-mon[35071]: pgmap v519: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:01:44.177 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:43 smithi162 ceph-mon[35071]: pgmap v520: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T04:01:44.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:43 smithi046 ceph-mon[30954]: pgmap v520: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T04:01:44.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:43 smithi105 ceph-mon[34773]: pgmap v520: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T04:01:46.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:45 smithi046 ceph-mon[30954]: pgmap v521: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:01:46.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:45 smithi105 ceph-mon[34773]: pgmap v521: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:01:46.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:45 smithi162 ceph-mon[35071]: pgmap v521: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:01:48.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:47 smithi046 ceph-mon[30954]: pgmap v522: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:01:48.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:47 smithi105 ceph-mon[34773]: pgmap v522: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:01:48.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:47 smithi162 ceph-mon[35071]: pgmap v522: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:01:50.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:49 smithi046 ceph-mon[30954]: pgmap v523: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:01:50.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:49 smithi105 ceph-mon[34773]: pgmap v523: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:01:50.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:49 smithi162 ceph-mon[35071]: pgmap v523: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:01:51.719 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T04:01:51.995 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:52.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:51 smithi046 ceph-mon[30954]: pgmap v524: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:01:52.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:51 smithi105 ceph-mon[34773]: pgmap v524: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:01:52.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:51 smithi162 ceph-mon[35071]: pgmap v524: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:01:52.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.485+0000 7fae9c433640 1 -- 172.21.15.46:0/2563244025 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae94108cf0 msgr2=0x7fae9410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:52.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.485+0000 7fae9c433640 1 --2- 172.21.15.46:0/2563244025 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae94108cf0 0x7fae9410f520 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fae8c009ca0 tx=0x7fae8c02a8c0 comp rx=0 tx=0).stop 2024-09-21T04:01:52.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.485+0000 7fae9c433640 1 -- 172.21.15.46:0/2563244025 shutdown_connections 2024-09-21T04:01:52.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.485+0000 7fae9c433640 1 --2- 172.21.15.46:0/2563244025 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae94108cf0 0x7fae9410f520 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:52.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.485+0000 7fae9c433640 1 --2- 172.21.15.46:0/2563244025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae941083a0 0x7fae941087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:52.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.485+0000 7fae9c433640 1 --2- 172.21.15.46:0/2563244025 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae94102a60 0x7fae94102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:52.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.485+0000 7fae9c433640 1 -- 172.21.15.46:0/2563244025 >> 172.21.15.46:0/2563244025 conn(0x7fae94079730 msgr2=0x7fae94079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:52.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.485+0000 7fae9c433640 1 -- 172.21.15.46:0/2563244025 shutdown_connections 2024-09-21T04:01:52.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.485+0000 7fae9c433640 1 -- 172.21.15.46:0/2563244025 wait complete. 2024-09-21T04:01:52.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.486+0000 7fae9c433640 1 Processor -- start 2024-09-21T04:01:52.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.486+0000 7fae9c433640 1 -- start start 2024-09-21T04:01:52.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.486+0000 7fae9c433640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae94102a60 0x7fae9419a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:52.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.486+0000 7fae9c433640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae941083a0 0x7fae9419a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:52.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.486+0000 7fae9c433640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae94108cf0 0x7fae9419fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:52.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.486+0000 7fae9c433640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fae94112960 con 0x7fae94108cf0 2024-09-21T04:01:52.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.486+0000 7fae9c433640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fae941127e0 con 0x7fae941083a0 2024-09-21T04:01:52.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.486+0000 7fae9c433640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fae94112ae0 con 0x7fae94102a60 2024-09-21T04:01:52.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.486+0000 7fae9a9d0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae94108cf0 0x7fae9419fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:52.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.486+0000 7fae9a9d0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae94108cf0 0x7fae9419fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34192/0 (socket says 172.21.15.46:34192) 2024-09-21T04:01:52.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.486+0000 7fae9a9d0640 1 -- 172.21.15.46:0/2234540431 learned_addr learned my addr 172.21.15.46:0/2234540431 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:52.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.487+0000 7fae9a1cf640 1 --2- 172.21.15.46:0/2234540431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae94102a60 0x7fae9419a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:52.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.487+0000 7fae999ce640 1 --2- 172.21.15.46:0/2234540431 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae941083a0 0x7fae9419a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:52.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.487+0000 7fae9a9d0640 1 -- 172.21.15.46:0/2234540431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae94102a60 msgr2=0x7fae9419a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:52.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.487+0000 7fae9a9d0640 1 --2- 172.21.15.46:0/2234540431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae94102a60 0x7fae9419a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:52.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.487+0000 7fae9a9d0640 1 -- 172.21.15.46:0/2234540431 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae941083a0 msgr2=0x7fae9419a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:52.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.487+0000 7fae9a9d0640 1 --2- 172.21.15.46:0/2234540431 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae941083a0 0x7fae9419a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:52.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.487+0000 7fae9a9d0640 1 -- 172.21.15.46:0/2234540431 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae941a0370 con 0x7fae94108cf0 2024-09-21T04:01:52.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.487+0000 7fae9a9d0640 1 --2- 172.21.15.46:0/2234540431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae94108cf0 0x7fae9419fc40 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fae8c005cc0 tx=0x7fae8c02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:52.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.487+0000 7fae937fe640 1 -- 172.21.15.46:0/2234540431 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae8c003bf0 con 0x7fae94108cf0 2024-09-21T04:01:52.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.487+0000 7fae937fe640 1 -- 172.21.15.46:0/2234540431 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae8c003d90 con 0x7fae94108cf0 2024-09-21T04:01:52.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.487+0000 7fae937fe640 1 -- 172.21.15.46:0/2234540431 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae8c02fbc0 con 0x7fae94108cf0 2024-09-21T04:01:52.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.487+0000 7fae9c433640 1 -- 172.21.15.46:0/2234540431 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae941a0600 con 0x7fae94108cf0 2024-09-21T04:01:52.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.487+0000 7fae9c433640 1 -- 172.21.15.46:0/2234540431 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae941a6dc0 con 0x7fae94108cf0 2024-09-21T04:01:52.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.490+0000 7faea29a7740 1 Processor -- start 2024-09-21T04:01:52.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.490+0000 7fae937fe640 1 -- 172.21.15.46:0/2234540431 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7fae8c02fd60 con 0x7fae94108cf0 2024-09-21T04:01:52.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.491+0000 7faea29a7740 1 -- start start 2024-09-21T04:01:52.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.491+0000 7faea29a7740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5598e719d070 0x5598e7544650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:52.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.491+0000 7faea29a7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5598e71741b0 0x5598e7544b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:52.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.491+0000 7faea29a7740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598e717c390 0x5598e75450d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:52.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.491+0000 7faea29a7740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5598e74bae50 con 0x5598e719d070 2024-09-21T04:01:52.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.491+0000 7faea29a7740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5598e74aa280 con 0x5598e717c390 2024-09-21T04:01:52.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.491+0000 7faea29a7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5598e74ae090 con 0x5598e71741b0 2024-09-21T04:01:52.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.491+0000 7fae999ce640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5598e719d070 0x5598e7544650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:52.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.491+0000 7fae999ce640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5598e719d070 0x5598e7544650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34206/0 (socket says 172.21.15.46:34206) 2024-09-21T04:01:52.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.491+0000 7fae999ce640 1 -- 172.21.15.46:0/3264868411 learned_addr learned my addr 172.21.15.46:0/3264868411 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:52.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.491+0000 7fae9a1cf640 1 --2- 172.21.15.46:0/3264868411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5598e71741b0 0x5598e7544b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:52.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.491+0000 7fae999ce640 1 --2- 172.21.15.46:0/3264868411 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598e717c390 0x5598e75450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:52.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.491+0000 7fae999ce640 1 -- 172.21.15.46:0/3264868411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5598e71741b0 msgr2=0x5598e7544b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:52.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.491+0000 7fae999ce640 1 --2- 172.21.15.46:0/3264868411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5598e71741b0 0x5598e7544b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:52.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.492+0000 7fae999ce640 1 -- 172.21.15.46:0/3264868411 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598e717c390 msgr2=0x5598e75450d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:52.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.492+0000 7fae999ce640 1 --2- 172.21.15.46:0/3264868411 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598e717c390 0x5598e75450d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:52.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.492+0000 7fae999ce640 1 -- 172.21.15.46:0/3264868411 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598e7208650 con 0x5598e719d070 2024-09-21T04:01:52.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.492+0000 7fae937fe640 1 --2- 172.21.15.46:0/2234540431 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fae7c0b6700 0x7fae7c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:52.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.492+0000 7fae9a1cf640 1 --2- 172.21.15.46:0/2234540431 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fae7c0b6700 0x7fae7c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:52.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.492+0000 7fae999ce640 1 --2- 172.21.15.46:0/3264868411 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5598e719d070 0x5598e7544650 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fae88012570 tx=0x7fae8800b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d04efbfea1df383 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:52.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.492+0000 7fae937fe640 1 -- 172.21.15.46:0/2234540431 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fae8c108a40 con 0x7fae94108cf0 2024-09-21T04:01:52.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.492+0000 7fae90d9a640 1 -- 172.21.15.46:0/3264868411 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae88004020 con 0x5598e719d070 2024-09-21T04:01:52.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.492+0000 7fae90d9a640 1 -- 172.21.15.46:0/3264868411 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae88004c50 con 0x5598e719d070 2024-09-21T04:01:52.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.492+0000 7fae90d9a640 1 -- 172.21.15.46:0/3264868411 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae88005280 con 0x5598e719d070 2024-09-21T04:01:52.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.493+0000 7faea29a7740 1 -- 172.21.15.46:0/3264868411 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5598e719d070 msgr2=0x5598e7544650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:52.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.493+0000 7fae9a1cf640 1 --2- 172.21.15.46:0/2234540431 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fae7c0b6700 0x7fae7c0b8c10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x5598e75432d0 tx=0x7fae8400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:52.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.493+0000 7faea29a7740 1 --2- 172.21.15.46:0/3264868411 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5598e719d070 0x5598e7544650 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fae88012570 tx=0x7fae8800b650 comp rx=0 tx=0).stop 2024-09-21T04:01:52.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.493+0000 7faea29a7740 1 -- 172.21.15.46:0/3264868411 shutdown_connections 2024-09-21T04:01:52.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.493+0000 7faea29a7740 1 --2- 172.21.15.46:0/3264868411 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598e717c390 0x5598e75450d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:52.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.493+0000 7faea29a7740 1 --2- 172.21.15.46:0/3264868411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5598e71741b0 0x5598e7544b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:52.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.493+0000 7faea29a7740 1 --2- 172.21.15.46:0/3264868411 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5598e719d070 0x5598e7544650 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:52.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.493+0000 7faea29a7740 1 -- 172.21.15.46:0/3264868411 >> 172.21.15.46:0/3264868411 conn(0x5598e7191460 msgr2=0x5598e7542540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:52.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.493+0000 7faea29a7740 1 -- 172.21.15.46:0/3264868411 shutdown_connections 2024-09-21T04:01:52.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.493+0000 7faea29a7740 1 -- 172.21.15.46:0/3264868411 wait complete. 2024-09-21T04:01:52.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.494+0000 7faea29a7740 1 -- start start 2024-09-21T04:01:52.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.494+0000 7faea29a7740 1 Processor -- start 2024-09-21T04:01:52.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.494+0000 7faea29a7740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5598e71741b0 0x5598e754fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:52.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.494+0000 7faea29a7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5598e717c390 0x5598e75501f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:52.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.494+0000 7faea29a7740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598e719d070 0x5598e7550730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:52.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.494+0000 7faea29a7740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5598e730b700 con 0x5598e71741b0 2024-09-21T04:01:52.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.494+0000 7faea29a7740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5598e7445110 con 0x5598e719d070 2024-09-21T04:01:52.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.494+0000 7faea29a7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5598e7552e30 con 0x5598e717c390 2024-09-21T04:01:52.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.494+0000 7faea29a7740 10 client.0 _ll_register_callbacks cb 0x5598e745e990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:01:52.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.494+0000 7fae9a1cf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5598e71741b0 0x5598e754fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:52.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.494+0000 7fae9a1cf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5598e71741b0 0x5598e754fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34218/0 (socket says 172.21.15.46:34218) 2024-09-21T04:01:52.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.494+0000 7fae9a1cf640 1 -- 172.21.15.46:0/2328751097 learned_addr learned my addr 172.21.15.46:0/2328751097 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:52.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.494+0000 7fae9a9d0640 1 --2- 172.21.15.46:0/2328751097 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598e719d070 0x5598e7550730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:52.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.494+0000 7fae9a1cf640 1 -- 172.21.15.46:0/2328751097 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5598e717c390 msgr2=0x5598e75501f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:52.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.494+0000 7fae999ce640 1 --2- 172.21.15.46:0/2328751097 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5598e717c390 0x5598e75501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:52.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.494+0000 7fae9a1cf640 1 --2- 172.21.15.46:0/2328751097 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5598e717c390 0x5598e75501f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:52.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.494+0000 7fae9a1cf640 1 -- 172.21.15.46:0/2328751097 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598e719d070 msgr2=0x5598e7550730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:52.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.494+0000 7fae9a1cf640 1 --2- 172.21.15.46:0/2328751097 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598e719d070 0x5598e7550730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:52.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.495+0000 7fae9a1cf640 1 -- 172.21.15.46:0/2328751097 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598e7472c40 con 0x5598e71741b0 2024-09-21T04:01:52.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.495+0000 7fae9a9d0640 1 --2- 172.21.15.46:0/2328751097 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598e719d070 0x5598e7550730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:01:52.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.495+0000 7fae999ce640 1 --2- 172.21.15.46:0/2328751097 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5598e717c390 0x5598e75501f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:01:52.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.495+0000 7fae9a1cf640 1 --2- 172.21.15.46:0/2328751097 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5598e71741b0 0x5598e754fcb0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fae84003e90 tx=0x7fae840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e04be317ab3a56f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:52.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.495+0000 7fae79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:01:52.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.495+0000 7fae79ffb640 1 -- 172.21.15.46:0/2328751097 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae8401b660 con 0x5598e71741b0 2024-09-21T04:01:52.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.495+0000 7faea29a7740 1 -- 172.21.15.46:0/2328751097 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae88004c50 con 0x5598e71741b0 2024-09-21T04:01:52.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.495+0000 7fae79ffb640 1 -- 172.21.15.46:0/2328751097 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fae8401b800 con 0x5598e71741b0 2024-09-21T04:01:52.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.495+0000 7fae79ffb640 1 -- 172.21.15.46:0/2328751097 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fae8401ba00 con 0x5598e71741b0 2024-09-21T04:01:52.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.495+0000 7faea29a7740 10 client.16407 fetch_fsmap learned FSMap version 20 2024-09-21T04:01:52.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.495+0000 7faea29a7740 1 -- 172.21.15.46:0/2328751097 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5598e755eb10 con 0x5598e71741b0 2024-09-21T04:01:52.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.495+0000 7fae79ffb640 1 -- 172.21.15.46:0/2328751097 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae88004c50 con 0x5598e71741b0 2024-09-21T04:01:52.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.496+0000 7fae79ffb640 1 -- 172.21.15.46:0/2328751097 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fae84024070 con 0x5598e71741b0 2024-09-21T04:01:52.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.496+0000 7faea29a7740 10 client.16407 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:01:52.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.496+0000 7faea29a7740 10 client.16407 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:01:52.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.496+0000 7faea29a7740 20 client.16407 populate_metadata read hostname 'smithi046' 2024-09-21T04:01:52.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.496+0000 7faea29a7740 1 --2- 172.21.15.46:0/2328751097 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5598e715b9f0 0x5598e7561fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:52.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.496+0000 7faea29a7740 4 client.16407 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:01:52.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.496+0000 7faea29a7740 1 -- 172.21.15.46:0/2328751097 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5598e74bcda0 con 0x5598e715b9f0 2024-09-21T04:01:52.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.496+0000 7fae999ce640 1 --2- 172.21.15.46:0/2328751097 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5598e715b9f0 0x5598e7561fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:52.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.497+0000 7fae999ce640 1 --2- 172.21.15.46:0/2328751097 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5598e715b9f0 0x5598e7561fe0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=143cc1ee70cd70da server_cookie=c43b8208acc149bb in_seq=0 out_seq=0 2024-09-21T04:01:52.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.497+0000 7fae79ffb640 10 client.16407 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:01:52.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.497+0000 7fae79ffb640 1 -- 172.21.15.46:0/2328751097 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5598e74bcda0 con 0x5598e715b9f0 2024-09-21T04:01:52.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.498+0000 7fae79ffb640 10 client.16407 handle_command_reply: tid=0 2024-09-21T04:01:52.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.498+0000 7faea29a7740 1 client.16407 shutdown 2024-09-21T04:01:52.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.498+0000 7faea29a7740 1 -- 172.21.15.46:0/2328751097 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5598e71741b0 msgr2=0x5598e754fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:52.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.498+0000 7faea29a7740 1 --2- 172.21.15.46:0/2328751097 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5598e71741b0 0x5598e754fcb0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fae84003e90 tx=0x7fae840046c0 comp rx=0 tx=0).stop 2024-09-21T04:01:52.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.498+0000 7faea29a7740 1 -- 172.21.15.46:0/2328751097 shutdown_connections 2024-09-21T04:01:52.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.498+0000 7faea29a7740 1 --2- 172.21.15.46:0/2328751097 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5598e715b9f0 0x5598e7561fe0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:52.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.498+0000 7faea29a7740 1 --2- 172.21.15.46:0/2328751097 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598e719d070 0x5598e7550730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:52.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.498+0000 7faea29a7740 1 --2- 172.21.15.46:0/2328751097 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5598e717c390 0x5598e75501f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:52.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.498+0000 7faea29a7740 1 --2- 172.21.15.46:0/2328751097 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5598e71741b0 0x5598e754fcb0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:52.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.498+0000 7fae79ffb640 0 client.16407 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:01:52.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.498+0000 7faea29a7740 1 -- 172.21.15.46:0/2328751097 >> 172.21.15.46:0/2328751097 conn(0x5598e7191460 msgr2=0x5598e7547830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:52.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.498+0000 7faea29a7740 1 -- 172.21.15.46:0/2328751097 shutdown_connections 2024-09-21T04:01:52.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.498+0000 7faea29a7740 1 -- 172.21.15.46:0/2328751097 wait complete. 2024-09-21T04:01:52.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.498+0000 7faea29a7740 20 client.16407 trim_cache size 0 max 16384 2024-09-21T04:01:52.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.516+0000 7faea29a7740 1 Processor -- start 2024-09-21T04:01:52.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.516+0000 7faea29a7740 1 -- start start 2024-09-21T04:01:52.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.516+0000 7faea29a7740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5598e71741b0 0x5598e7546040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:52.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.516+0000 7faea29a7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5598e717c390 0x5598e75518e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:52.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.516+0000 7faea29a7740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598e719d070 0x5598e7541b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:52.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.516+0000 7faea29a7740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fae941ad460 con 0x5598e71741b0 2024-09-21T04:01:52.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.516+0000 7faea29a7740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fae941afd00 con 0x5598e719d070 2024-09-21T04:01:52.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.516+0000 7faea29a7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fae941adaf0 con 0x5598e717c390 2024-09-21T04:01:52.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.516+0000 7fae9a1cf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5598e71741b0 0x5598e7546040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:52.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.516+0000 7fae9a1cf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5598e71741b0 0x5598e7546040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34226/0 (socket says 172.21.15.46:34226) 2024-09-21T04:01:52.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.516+0000 7fae9a1cf640 1 -- 172.21.15.46:0/3064652758 learned_addr learned my addr 172.21.15.46:0/3064652758 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:52.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.516+0000 7fae9a9d0640 1 --2- 172.21.15.46:0/3064652758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598e719d070 0x5598e7541b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:52.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.516+0000 7fae999ce640 1 --2- 172.21.15.46:0/3064652758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5598e717c390 0x5598e75518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:52.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.516+0000 7fae9a1cf640 1 -- 172.21.15.46:0/3064652758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5598e717c390 msgr2=0x5598e75518e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:52.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.516+0000 7fae9a1cf640 1 --2- 172.21.15.46:0/3064652758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5598e717c390 0x5598e75518e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:52.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.516+0000 7fae9a1cf640 1 -- 172.21.15.46:0/3064652758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598e719d070 msgr2=0x5598e7541b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:52.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.516+0000 7fae9a1cf640 1 --2- 172.21.15.46:0/3064652758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598e719d070 0x5598e7541b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:52.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.516+0000 7fae9a1cf640 1 -- 172.21.15.46:0/3064652758 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598e754e1b0 con 0x5598e71741b0 2024-09-21T04:01:52.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.516+0000 7fae9a9d0640 1 --2- 172.21.15.46:0/3064652758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598e719d070 0x5598e7541b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:01:52.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.517+0000 7fae9a1cf640 1 --2- 172.21.15.46:0/3064652758 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5598e71741b0 0x5598e7546040 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fae84026680 tx=0x7fae8401bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f6aa693281a797 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:52.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.517+0000 7fae7bfff640 1 -- 172.21.15.46:0/3064652758 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae8401b460 con 0x5598e71741b0 2024-09-21T04:01:52.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.517+0000 7fae7bfff640 1 -- 172.21.15.46:0/3064652758 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae84035020 con 0x5598e71741b0 2024-09-21T04:01:52.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.517+0000 7fae7bfff640 1 -- 172.21.15.46:0/3064652758 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae84004c60 con 0x5598e71741b0 2024-09-21T04:01:52.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.517+0000 7faea29a7740 1 -- 172.21.15.46:0/3064652758 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5598e71741b0 msgr2=0x5598e7546040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:52.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.517+0000 7faea29a7740 1 --2- 172.21.15.46:0/3064652758 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5598e71741b0 0x5598e7546040 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fae84026680 tx=0x7fae8401bdf0 comp rx=0 tx=0).stop 2024-09-21T04:01:52.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.517+0000 7faea29a7740 1 -- 172.21.15.46:0/3064652758 shutdown_connections 2024-09-21T04:01:52.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.517+0000 7faea29a7740 1 --2- 172.21.15.46:0/3064652758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598e719d070 0x5598e7541b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:52.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.517+0000 7faea29a7740 1 --2- 172.21.15.46:0/3064652758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5598e717c390 0x5598e75518e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:52.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.517+0000 7faea29a7740 1 --2- 172.21.15.46:0/3064652758 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5598e71741b0 0x5598e7546040 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:52.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.517+0000 7faea29a7740 1 -- 172.21.15.46:0/3064652758 >> 172.21.15.46:0/3064652758 conn(0x5598e7191460 msgr2=0x5598e75511d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:52.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.518+0000 7faea29a7740 1 -- 172.21.15.46:0/3064652758 shutdown_connections 2024-09-21T04:01:52.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.518+0000 7faea29a7740 1 -- 172.21.15.46:0/3064652758 wait complete. 2024-09-21T04:01:52.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.518+0000 7faea29a7740 1 -- start start 2024-09-21T04:01:52.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.518+0000 7faea29a7740 1 Processor -- start 2024-09-21T04:01:52.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.518+0000 7faea29a7740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598e71741b0 0x5598e75c8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:52.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.518+0000 7faea29a7740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5598e717c390 0x5598e75580b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:52.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.518+0000 7faea29a7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5598e719d070 0x5598e7558610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:52.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.518+0000 7faea29a7740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fae941ae1c0 con 0x5598e717c390 2024-09-21T04:01:52.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.518+0000 7faea29a7740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fae941af630 con 0x5598e71741b0 2024-09-21T04:01:52.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.518+0000 7faea29a7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fae941ae890 con 0x5598e719d070 2024-09-21T04:01:52.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.518+0000 7fae999ce640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5598e717c390 0x5598e75580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:52.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.518+0000 7fae999ce640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5598e717c390 0x5598e75580b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34232/0 (socket says 172.21.15.46:34232) 2024-09-21T04:01:52.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.519+0000 7fae999ce640 1 -- 172.21.15.46:0/2251644905 learned_addr learned my addr 172.21.15.46:0/2251644905 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:52.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.519+0000 7faea29a7740 10 client.0 _ll_register_callbacks cb 0x7fae84004300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:01:52.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.519+0000 7fae9a9d0640 1 --2- 172.21.15.46:0/2251644905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5598e719d070 0x5598e7558610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:52.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.519+0000 7fae9a1cf640 1 --2- 172.21.15.46:0/2251644905 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598e71741b0 0x5598e75c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:52.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.519+0000 7fae999ce640 1 -- 172.21.15.46:0/2251644905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5598e719d070 msgr2=0x5598e7558610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:52.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.519+0000 7fae999ce640 1 --2- 172.21.15.46:0/2251644905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5598e719d070 0x5598e7558610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:52.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.519+0000 7fae999ce640 1 -- 172.21.15.46:0/2251644905 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598e71741b0 msgr2=0x5598e75c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:52.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.519+0000 7fae999ce640 1 --2- 172.21.15.46:0/2251644905 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598e71741b0 0x5598e75c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:52.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.519+0000 7fae999ce640 1 -- 172.21.15.46:0/2251644905 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598e7558da0 con 0x5598e717c390 2024-09-21T04:01:52.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.519+0000 7fae9a1cf640 1 --2- 172.21.15.46:0/2251644905 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598e71741b0 0x5598e75c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:01:52.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.519+0000 7fae999ce640 1 --2- 172.21.15.46:0/2251644905 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5598e717c390 0x5598e75580b0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fae88005d00 tx=0x7fae880045b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80a5689054543920 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:52.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.519+0000 7fae79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:01:52.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.519+0000 7fae79ffb640 1 -- 172.21.15.46:0/2251644905 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae88036060 con 0x5598e717c390 2024-09-21T04:01:52.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.519+0000 7fae79ffb640 1 -- 172.21.15.46:0/2251644905 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fae88004860 con 0x5598e717c390 2024-09-21T04:01:52.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.519+0000 7faea29a7740 1 -- 172.21.15.46:0/2251644905 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae84035020 con 0x5598e717c390 2024-09-21T04:01:52.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.520+0000 7fae79ffb640 1 -- 172.21.15.46:0/2251644905 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fae88004a60 con 0x5598e717c390 2024-09-21T04:01:52.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.520+0000 7faea29a7740 10 client.16413 fetch_fsmap learned FSMap version 20 2024-09-21T04:01:52.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.520+0000 7faea29a7740 1 -- 172.21.15.46:0/2251644905 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5598e75d0df0 con 0x5598e717c390 2024-09-21T04:01:52.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.520+0000 7fae79ffb640 1 -- 172.21.15.46:0/2251644905 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae84035020 con 0x5598e717c390 2024-09-21T04:01:52.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.520+0000 7fae79ffb640 1 -- 172.21.15.46:0/2251644905 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fae88010460 con 0x5598e717c390 2024-09-21T04:01:52.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.520+0000 7faea29a7740 10 client.16413 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:01:52.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.520+0000 7faea29a7740 10 client.16413 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:01:52.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.520+0000 7faea29a7740 20 client.16413 populate_metadata read hostname 'smithi046' 2024-09-21T04:01:52.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.520+0000 7faea29a7740 1 --2- 172.21.15.46:0/2251644905 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5598e7130da0 0x5598e75d3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:52.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.520+0000 7faea29a7740 4 client.16413 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T04:01:52.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.520+0000 7faea29a7740 1 -- 172.21.15.46:0/2251644905 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5598e74b8850 con 0x5598e7130da0 2024-09-21T04:01:52.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.520+0000 7fae9a1cf640 1 --2- 172.21.15.46:0/2251644905 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5598e7130da0 0x5598e75d3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:52.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.521+0000 7fae79ffb640 10 client.16413 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:01:52.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.521+0000 7fae9a1cf640 1 --2- 172.21.15.46:0/2251644905 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5598e7130da0 0x5598e75d3390 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b598193152de6445 server_cookie=adbf0707f9d3dfb9 in_seq=0 out_seq=0 2024-09-21T04:01:52.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.521+0000 7fae79ffb640 1 -- 172.21.15.46:0/2251644905 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3782 (crc 0 0 0) 0x5598e74b8850 con 0x5598e7130da0 2024-09-21T04:01:52.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.521+0000 7fae79ffb640 10 client.16413 handle_command_reply: tid=0 2024-09-21T04:01:52.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.521+0000 7faea29a7740 1 client.16413 shutdown 2024-09-21T04:01:52.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.521+0000 7faea29a7740 1 -- 172.21.15.46:0/2251644905 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5598e717c390 msgr2=0x5598e75580b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:52.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.521+0000 7faea29a7740 1 --2- 172.21.15.46:0/2251644905 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5598e717c390 0x5598e75580b0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fae88005d00 tx=0x7fae880045b0 comp rx=0 tx=0).stop 2024-09-21T04:01:52.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.521+0000 7faea29a7740 1 -- 172.21.15.46:0/2251644905 shutdown_connections 2024-09-21T04:01:52.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.521+0000 7faea29a7740 1 --2- 172.21.15.46:0/2251644905 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5598e7130da0 0x5598e75d3390 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:52.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.521+0000 7faea29a7740 1 --2- 172.21.15.46:0/2251644905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5598e719d070 0x5598e7558610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:52.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.521+0000 7faea29a7740 1 --2- 172.21.15.46:0/2251644905 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5598e717c390 0x5598e75580b0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:52.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.521+0000 7fae79ffb640 0 client.16413 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:01:52.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.521+0000 7faea29a7740 1 --2- 172.21.15.46:0/2251644905 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598e71741b0 0x5598e75c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:52.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.521+0000 7faea29a7740 1 -- 172.21.15.46:0/2251644905 >> 172.21.15.46:0/2251644905 conn(0x5598e7191460 msgr2=0x5598e7545e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:52.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.522+0000 7faea29a7740 1 -- 172.21.15.46:0/2251644905 shutdown_connections 2024-09-21T04:01:52.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.522+0000 7faea29a7740 1 -- 172.21.15.46:0/2251644905 wait complete. 2024-09-21T04:01:52.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.522+0000 7faea29a7740 20 client.16413 trim_cache size 0 max 16384 2024-09-21T04:01:52.529 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T04:01:52.529 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "no active scrubs running", 2024-09-21T04:01:52.529 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": {}, 2024-09-21T04:01:52.529 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_stats": { 2024-09-21T04:01:52.529 INFO:teuthology.orchestra.run.smithi046.stdout: "d7634007-e881-46f7-9833-ac9bd0a3100e": { 2024-09-21T04:01:52.529 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:01:19.459151+0000", 2024-09-21T04:01:52.530 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:52.530 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:52.530 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:52.530 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:52.530 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:52.530 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:52.530 INFO:teuthology.orchestra.run.smithi046.stdout: "0d781b95-cf5e-46f2-9875-2923181385e2": { 2024-09-21T04:01:52.530 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:00:33.099094+0000", 2024-09-21T04:01:52.530 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:52.530 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:52.530 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:52.530 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:52.530 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:52.531 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:52.531 INFO:teuthology.orchestra.run.smithi046.stdout: "326aaecf-f38a-4946-988a-d83f25556995": { 2024-09-21T04:01:52.531 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:54.189884+0000", 2024-09-21T04:01:52.531 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:52.531 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:52.531 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:52.531 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:52.531 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:52.531 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:52.531 INFO:teuthology.orchestra.run.smithi046.stdout: "46bb5415-6e16-47c6-a1e4-55f9c623ce90": { 2024-09-21T04:01:52.531 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:14.950674+0000", 2024-09-21T04:01:52.531 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:52.531 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:52.531 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:52.532 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:52.532 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:52.532 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:52.532 INFO:teuthology.orchestra.run.smithi046.stdout: "6103c660-8e77-4b06-ad6c-bb322c26035a": { 2024-09-21T04:01:52.532 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:35.594467+0000", 2024-09-21T04:01:52.532 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:52.532 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:52.532 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:52.532 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:52.532 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:52.532 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:52.532 INFO:teuthology.orchestra.run.smithi046.stdout: "dab67652-8894-4711-be64-cbdfea27a9ba": { 2024-09-21T04:01:52.532 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:28.161616+0000", 2024-09-21T04:01:52.532 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:52.532 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:52.533 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:52.533 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:52.533 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:52.533 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:52.533 INFO:teuthology.orchestra.run.smithi046.stdout: "c47f458a-de5e-4952-a575-a81261953667": { 2024-09-21T04:01:52.533 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:48.699411+0000", 2024-09-21T04:01:52.533 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:52.533 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:52.533 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:52.533 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:52.533 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:52.533 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:52.533 INFO:teuthology.orchestra.run.smithi046.stdout: "e24ec8f1-0d13-478f-9c2c-b51798868ffc": { 2024-09-21T04:01:52.533 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:09.736194+0000", 2024-09-21T04:01:52.534 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:52.534 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:52.534 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:52.534 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:52.534 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:52.534 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:52.534 INFO:teuthology.orchestra.run.smithi046.stdout: "edc4b8c7-b702-489d-a925-ae7ad0ff0d9a": { 2024-09-21T04:01:52.534 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:00:40.181950+0000", 2024-09-21T04:01:52.534 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:52.534 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:52.534 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:52.534 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:52.534 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:52.534 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:52.535 INFO:teuthology.orchestra.run.smithi046.stdout: "a871f724-0198-493c-b03e-b2de78aba243": { 2024-09-21T04:01:52.535 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:56:30.082991+0000", 2024-09-21T04:01:52.535 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:52.535 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:52.535 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:52.535 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:52.535 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:52.535 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:52.535 INFO:teuthology.orchestra.run.smithi046.stdout: "d49f33a7-3d5a-421b-94ba-8b19a4120db1": { 2024-09-21T04:01:52.535 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:50.480786+0000", 2024-09-21T04:01:52.535 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:52.535 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:52.535 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:52.535 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:52.535 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:52.536 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:52.536 INFO:teuthology.orchestra.run.smithi046.stdout: "3bbf7097-70d7-4743-bbce-41465502b35b": { 2024-09-21T04:01:52.536 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:10.661441+0000", 2024-09-21T04:01:52.536 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:52.536 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:52.536 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:52.536 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:52.536 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:52.536 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:52.536 INFO:teuthology.orchestra.run.smithi046.stdout: "08f0c962-df1a-4129-a1a2-b916240d9803": { 2024-09-21T04:01:52.536 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:02.937596+0000", 2024-09-21T04:01:52.536 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:52.536 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:52.536 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:52.536 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:52.537 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:52.537 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:01:52.537 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:01:52.537 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T04:01:52.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.522+0000 7fae9c433640 1 -- 172.21.15.46:0/2234540431 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fae7c0b6700 msgr2=0x7fae7c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:52.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.522+0000 7fae9c433640 1 --2- 172.21.15.46:0/2234540431 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fae7c0b6700 0x7fae7c0b8c10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x5598e75432d0 tx=0x7fae8400b390 comp rx=0 tx=0).stop 2024-09-21T04:01:52.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.522+0000 7fae9c433640 1 -- 172.21.15.46:0/2234540431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae94108cf0 msgr2=0x7fae9419fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:52.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.522+0000 7fae9c433640 1 --2- 172.21.15.46:0/2234540431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae94108cf0 0x7fae9419fc40 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fae8c005cc0 tx=0x7fae8c02f380 comp rx=0 tx=0).stop 2024-09-21T04:01:52.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.522+0000 7fae9c433640 1 -- 172.21.15.46:0/2234540431 shutdown_connections 2024-09-21T04:01:52.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.522+0000 7fae9c433640 1 --2- 172.21.15.46:0/2234540431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae94108cf0 0x7fae9419fc40 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:52.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.522+0000 7fae9c433640 1 --2- 172.21.15.46:0/2234540431 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae941083a0 0x7fae9419a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:52.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.522+0000 7fae9c433640 1 --2- 172.21.15.46:0/2234540431 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fae7c0b6700 0x7fae7c0b8c10 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:52.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.522+0000 7fae9c433640 1 --2- 172.21.15.46:0/2234540431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae94102a60 0x7fae9419a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:52.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.522+0000 7fae9c433640 1 -- 172.21.15.46:0/2234540431 >> 172.21.15.46:0/2234540431 conn(0x7fae94079730 msgr2=0x7fae94101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:52.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.522+0000 7fae9c433640 1 -- 172.21.15.46:0/2234540431 shutdown_connections 2024-09-21T04:01:52.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:52.522+0000 7fae9c433640 1 -- 172.21.15.46:0/2234540431 wait complete. 2024-09-21T04:01:53.390 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T04:01:53.393 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:01:53.655 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:54.071 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:53 smithi046 ceph-mon[30954]: pgmap v525: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T04:01:54.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.162+0000 7fd9a6325640 1 -- 172.21.15.46:0/733466352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9a01094c0 msgr2=0x7fd9a01098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:54.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.162+0000 7fd9a6325640 1 --2- 172.21.15.46:0/733466352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9a01094c0 0x7fd9a01098d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fd988009900 tx=0x7fd98802a410 comp rx=0 tx=0).stop 2024-09-21T04:01:54.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.162+0000 7fd9a6325640 1 -- 172.21.15.46:0/733466352 shutdown_connections 2024-09-21T04:01:54.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.162+0000 7fd9a6325640 1 --2- 172.21.15.46:0/733466352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9a0109e10 0x7fd9a0110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.162+0000 7fd9a6325640 1 --2- 172.21.15.46:0/733466352 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9a01094c0 0x7fd9a01098d0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.162+0000 7fd9a6325640 1 --2- 172.21.15.46:0/733466352 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9a0103b80 0x7fd9a0103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.162+0000 7fd9a6325640 1 -- 172.21.15.46:0/733466352 >> 172.21.15.46:0/733466352 conn(0x7fd9a00ff5d0 msgr2=0x7fd9a0101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:54.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.162+0000 7fd9a6325640 1 -- 172.21.15.46:0/733466352 shutdown_connections 2024-09-21T04:01:54.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.162+0000 7fd9a6325640 1 -- 172.21.15.46:0/733466352 wait complete. 2024-09-21T04:01:54.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.163+0000 7fd9a6325640 1 Processor -- start 2024-09-21T04:01:54.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.163+0000 7fd9a6325640 1 -- start start 2024-09-21T04:01:54.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.163+0000 7fd9a6325640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9a0103b80 0x7fd9a019a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:54.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.163+0000 7fd9a6325640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9a01094c0 0x7fd9a019aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:54.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.163+0000 7fd9a6325640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9a0109e10 0x7fd9a019fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:54.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.163+0000 7fd9a6325640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a0113af0 con 0x7fd9a0103b80 2024-09-21T04:01:54.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.163+0000 7fd9a6325640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a0113970 con 0x7fd9a01094c0 2024-09-21T04:01:54.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.163+0000 7fd9a6325640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a0113c70 con 0x7fd9a0109e10 2024-09-21T04:01:54.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.163+0000 7fd99ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9a0103b80 0x7fd9a019a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:54.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.163+0000 7fd99ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9a0103b80 0x7fd9a019a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34250/0 (socket says 172.21.15.46:34250) 2024-09-21T04:01:54.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.163+0000 7fd99ffff640 1 -- 172.21.15.46:0/3101286455 learned_addr learned my addr 172.21.15.46:0/3101286455 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:54.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.163+0000 7fd99ffff640 1 -- 172.21.15.46:0/3101286455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9a0109e10 msgr2=0x7fd9a019fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:54.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.163+0000 7fd997fff640 1 --2- 172.21.15.46:0/3101286455 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9a01094c0 0x7fd9a019aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:54.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.164+0000 7fd9a48c2640 1 --2- 172.21.15.46:0/3101286455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9a0109e10 0x7fd9a019fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:54.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.164+0000 7fd99ffff640 1 --2- 172.21.15.46:0/3101286455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9a0109e10 0x7fd9a019fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.164+0000 7fd99ffff640 1 -- 172.21.15.46:0/3101286455 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9a01094c0 msgr2=0x7fd9a019aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:54.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.164+0000 7fd99ffff640 1 --2- 172.21.15.46:0/3101286455 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9a01094c0 0x7fd9a019aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.164+0000 7fd99ffff640 1 -- 172.21.15.46:0/3101286455 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9a01a0470 con 0x7fd9a0103b80 2024-09-21T04:01:54.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.164+0000 7fd9a48c2640 1 --2- 172.21.15.46:0/3101286455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9a0109e10 0x7fd9a019fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:01:54.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.164+0000 7fd997fff640 1 --2- 172.21.15.46:0/3101286455 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9a01094c0 0x7fd9a019aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:01:54.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.164+0000 7fd99ffff640 1 --2- 172.21.15.46:0/3101286455 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9a0103b80 0x7fd9a019a500 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd99000d950 tx=0x7fd99000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:54.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.164+0000 7fd99dffb640 1 -- 172.21.15.46:0/3101286455 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd990017070 con 0x7fd9a0103b80 2024-09-21T04:01:54.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.164+0000 7fd9a6325640 1 -- 172.21.15.46:0/3101286455 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9a01a0760 con 0x7fd9a0103b80 2024-09-21T04:01:54.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.164+0000 7fd99dffb640 1 -- 172.21.15.46:0/3101286455 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd990009c30 con 0x7fd9a0103b80 2024-09-21T04:01:54.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.164+0000 7fd99dffb640 1 -- 172.21.15.46:0/3101286455 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd99000f620 con 0x7fd9a0103b80 2024-09-21T04:01:54.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.164+0000 7fd9a6325640 1 -- 172.21.15.46:0/3101286455 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9a01a6f40 con 0x7fd9a0103b80 2024-09-21T04:01:54.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.165+0000 7fd9a6325640 1 -- 172.21.15.46:0/3101286455 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9a0103f90 con 0x7fd9a0103b80 2024-09-21T04:01:54.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.167+0000 7fd99dffb640 1 -- 172.21.15.46:0/3101286455 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7fd990005030 con 0x7fd9a0103b80 2024-09-21T04:01:54.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.167+0000 7fd99dffb640 1 --2- 172.21.15.46:0/3101286455 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fd98c0b6680 0x7fd98c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:54.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.168+0000 7fd997fff640 1 --2- 172.21.15.46:0/3101286455 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fd98c0b6680 0x7fd98c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:54.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.168+0000 7fd99dffb640 1 -- 172.21.15.46:0/3101286455 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fd9900e7320 con 0x7fd9a0103b80 2024-09-21T04:01:54.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.168+0000 7fd997fff640 1 --2- 172.21.15.46:0/3101286455 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fd98c0b6680 0x7fd98c0b8b90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd988000c00 tx=0x7fd988031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:54.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.171+0000 7fd99dffb640 1 -- 172.21.15.46:0/3101286455 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd9900ad910 con 0x7fd9a0103b80 2024-09-21T04:01:54.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:53 smithi105 ceph-mon[34773]: pgmap v525: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T04:01:54.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:53 smithi162 ceph-mon[35071]: pgmap v525: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T04:01:54.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.398+0000 7fd9a6325640 1 -- 172.21.15.46:0/3101286455 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9a002e640 con 0x7fd9a0103b80 2024-09-21T04:01:54.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.399+0000 7fd99dffb640 1 -- 172.21.15.46:0/3101286455 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7fd990009de0 con 0x7fd9a0103b80 2024-09-21T04:01:54.401 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T04:01:54.401 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"btime":"2024-09-21T03:53:23:865820+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1766354184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1766354184},{"type":"v1","addr":"172.21.15.46:6839","nonce":1766354184}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/1901774207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":1901774207},{"type":"v1","addr":"172.21.15.46:6841","nonce":1901774207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3548633196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":3548633196},{"type":"v1","addr":"172.21.15.105:6837","nonce":3548633196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24652,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3551934241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3551934241},{"type":"v1","addr":"172.21.15.162:6835","nonce":3551934241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/48949822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":48949822},{"type":"v1","addr":"172.21.15.162:6837","nonce":48949822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:53:14.452819+0000","modified":"2024-09-21T03:53:23.593278+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24680},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/2196053213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2196053213},{"type":"v1","addr":"172.21.15.162:6839","nonce":2196053213}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.105:6839/3911438406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":3911438406},{"type":"v1","addr":"172.21.15.105:6839","nonce":3911438406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24680,"qdb_cluster":[24680]},"id":1}]} 2024-09-21T04:01:54.402 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T04:01:54.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.401+0000 7fd9a6325640 1 -- 172.21.15.46:0/3101286455 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fd98c0b6680 msgr2=0x7fd98c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:54.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.401+0000 7fd9a6325640 1 --2- 172.21.15.46:0/3101286455 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fd98c0b6680 0x7fd98c0b8b90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd988000c00 tx=0x7fd988031400 comp rx=0 tx=0).stop 2024-09-21T04:01:54.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.401+0000 7fd9a6325640 1 -- 172.21.15.46:0/3101286455 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9a0103b80 msgr2=0x7fd9a019a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:54.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.401+0000 7fd9a6325640 1 --2- 172.21.15.46:0/3101286455 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9a0103b80 0x7fd9a019a500 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd99000d950 tx=0x7fd99000de10 comp rx=0 tx=0).stop 2024-09-21T04:01:54.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.401+0000 7fd9a6325640 1 -- 172.21.15.46:0/3101286455 shutdown_connections 2024-09-21T04:01:54.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.401+0000 7fd9a6325640 1 --2- 172.21.15.46:0/3101286455 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fd98c0b6680 0x7fd98c0b8b90 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.401+0000 7fd9a6325640 1 --2- 172.21.15.46:0/3101286455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9a0109e10 0x7fd9a019fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.401+0000 7fd9a6325640 1 --2- 172.21.15.46:0/3101286455 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9a01094c0 0x7fd9a019aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.401+0000 7fd9a6325640 1 --2- 172.21.15.46:0/3101286455 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9a0103b80 0x7fd9a019a500 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.401+0000 7fd9a6325640 1 -- 172.21.15.46:0/3101286455 >> 172.21.15.46:0/3101286455 conn(0x7fd9a00ff5d0 msgr2=0x7fd9a01019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:54.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.401+0000 7fd9a6325640 1 -- 172.21.15.46:0/3101286455 shutdown_connections 2024-09-21T04:01:54.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:54.401+0000 7fd9a6325640 1 -- 172.21.15.46:0/3101286455 wait complete. 2024-09-21T04:01:55.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:54 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3101286455' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:01:55.052 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T04:01:55.316 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:55.317 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:54 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3101286455' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:01:55.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:54 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3101286455' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:01:55.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.839+0000 7f7e1ce68640 1 -- 172.21.15.46:0/3391795519 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e18102a60 msgr2=0x7f7e18102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:55.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.839+0000 7f7e1ce68640 1 --2- 172.21.15.46:0/3391795519 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e18102a60 0x7f7e18102e70 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f7e08009900 tx=0x7f7e0802a410 comp rx=0 tx=0).stop 2024-09-21T04:01:55.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.840+0000 7f7e1ce68640 1 -- 172.21.15.46:0/3391795519 shutdown_connections 2024-09-21T04:01:55.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.840+0000 7f7e1ce68640 1 --2- 172.21.15.46:0/3391795519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e18108cf0 0x7f7e1810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:55.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.840+0000 7f7e1ce68640 1 --2- 172.21.15.46:0/3391795519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e181083a0 0x7f7e181087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:55.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.840+0000 7f7e1ce68640 1 --2- 172.21.15.46:0/3391795519 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e18102a60 0x7f7e18102e70 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:55.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.840+0000 7f7e1ce68640 1 -- 172.21.15.46:0/3391795519 >> 172.21.15.46:0/3391795519 conn(0x7f7e18079730 msgr2=0x7f7e18079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:55.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.840+0000 7f7e1ce68640 1 -- 172.21.15.46:0/3391795519 shutdown_connections 2024-09-21T04:01:55.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.840+0000 7f7e1ce68640 1 -- 172.21.15.46:0/3391795519 wait complete. 2024-09-21T04:01:55.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.841+0000 7f7e1ce68640 1 Processor -- start 2024-09-21T04:01:55.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.841+0000 7f7e1ce68640 1 -- start start 2024-09-21T04:01:55.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.841+0000 7f7e1ce68640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e18102a60 0x7f7e18199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:55.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.841+0000 7f7e1ce68640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e181083a0 0x7f7e181998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:55.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.841+0000 7f7e1ce68640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e18108cf0 0x7f7e1819eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:55.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.841+0000 7f7e1ce68640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7e18112960 con 0x7f7e181083a0 2024-09-21T04:01:55.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.841+0000 7f7e1ce68640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7e181127e0 con 0x7f7e18108cf0 2024-09-21T04:01:55.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.841+0000 7f7e1ce68640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7e18112ae0 con 0x7f7e18102a60 2024-09-21T04:01:55.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.841+0000 7f7e15d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e181083a0 0x7f7e181998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:55.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.841+0000 7f7e15d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e181083a0 0x7f7e181998f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34264/0 (socket says 172.21.15.46:34264) 2024-09-21T04:01:55.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.841+0000 7f7e15d9b640 1 -- 172.21.15.46:0/902014024 learned_addr learned my addr 172.21.15.46:0/902014024 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:55.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.841+0000 7f7e1659c640 1 --2- 172.21.15.46:0/902014024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e18102a60 0x7f7e18199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:55.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.842+0000 7f7e16d9d640 1 --2- 172.21.15.46:0/902014024 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e18108cf0 0x7f7e1819eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:55.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.842+0000 7f7e15d9b640 1 -- 172.21.15.46:0/902014024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e18102a60 msgr2=0x7f7e18199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:55.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.842+0000 7f7e15d9b640 1 --2- 172.21.15.46:0/902014024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e18102a60 0x7f7e18199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:55.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.842+0000 7f7e15d9b640 1 -- 172.21.15.46:0/902014024 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e18108cf0 msgr2=0x7f7e1819eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:55.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.842+0000 7f7e15d9b640 1 --2- 172.21.15.46:0/902014024 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e18108cf0 0x7f7e1819eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:55.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.842+0000 7f7e15d9b640 1 -- 172.21.15.46:0/902014024 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e1819f2c0 con 0x7f7e181083a0 2024-09-21T04:01:55.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.842+0000 7f7e15d9b640 1 --2- 172.21.15.46:0/902014024 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e181083a0 0x7f7e181998f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c00eb90 tx=0x7f7e0c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:55.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.843+0000 7f7e077fe640 1 -- 172.21.15.46:0/902014024 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c010630 con 0x7f7e181083a0 2024-09-21T04:01:55.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.843+0000 7f7e077fe640 1 -- 172.21.15.46:0/902014024 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e0c00ee90 con 0x7f7e181083a0 2024-09-21T04:01:55.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.843+0000 7f7e1ce68640 1 -- 172.21.15.46:0/902014024 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e1819f5b0 con 0x7f7e181083a0 2024-09-21T04:01:55.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.843+0000 7f7e077fe640 1 -- 172.21.15.46:0/902014024 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c018ac0 con 0x7f7e181083a0 2024-09-21T04:01:55.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.843+0000 7f7e1ce68640 1 -- 172.21.15.46:0/902014024 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e1806ae60 con 0x7f7e181083a0 2024-09-21T04:01:55.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.845+0000 7f7e233dc740 1 Processor -- start 2024-09-21T04:01:55.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.846+0000 7f7e233dc740 1 -- start start 2024-09-21T04:01:55.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.846+0000 7f7e077fe640 1 -- 172.21.15.46:0/902014024 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f7e0c018c60 con 0x7f7e181083a0 2024-09-21T04:01:55.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.846+0000 7f7e233dc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a28a625070 0x55a28a9cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:55.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.846+0000 7f7e233dc740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a28a5fc1b0 0x55a28a9ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:55.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.846+0000 7f7e233dc740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a28a604390 0x55a28a9cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:55.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.846+0000 7f7e233dc740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55a28a942ea0 con 0x55a28a5fc1b0 2024-09-21T04:01:55.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.846+0000 7f7e233dc740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55a28a9322d0 con 0x55a28a604390 2024-09-21T04:01:55.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.846+0000 7f7e233dc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a28a9360e0 con 0x55a28a625070 2024-09-21T04:01:55.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.846+0000 7f7e1659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a28a5fc1b0 0x55a28a9ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:55.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.846+0000 7f7e15d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a28a604390 0x55a28a9cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:55.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.846+0000 7f7e1659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a28a5fc1b0 0x55a28a9ccbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34272/0 (socket says 172.21.15.46:34272) 2024-09-21T04:01:55.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.846+0000 7f7e1659c640 1 -- 172.21.15.46:0/3839299742 learned_addr learned my addr 172.21.15.46:0/3839299742 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:55.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.846+0000 7f7e16d9d640 1 --2- 172.21.15.46:0/3839299742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a28a625070 0x55a28a9cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:55.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.847+0000 7f7e1659c640 1 -- 172.21.15.46:0/3839299742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a28a625070 msgr2=0x55a28a9cc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:55.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.847+0000 7f7e1659c640 1 --2- 172.21.15.46:0/3839299742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a28a625070 0x55a28a9cc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:55.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.847+0000 7f7e1659c640 1 -- 172.21.15.46:0/3839299742 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a28a604390 msgr2=0x55a28a9cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:55.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.847+0000 7f7e1659c640 1 --2- 172.21.15.46:0/3839299742 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a28a604390 0x55a28a9cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:55.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.847+0000 7f7e1659c640 1 -- 172.21.15.46:0/3839299742 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a28a690650 con 0x55a28a5fc1b0 2024-09-21T04:01:55.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.847+0000 7f7e15d9b640 1 --2- 172.21.15.46:0/3839299742 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a28a604390 0x55a28a9cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:01:55.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.847+0000 7f7e1659c640 1 --2- 172.21.15.46:0/3839299742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a28a5fc1b0 0x55a28a9ccbe0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f7e08009900 tx=0x7f7e08032cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=965324357f923db4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:55.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.847+0000 7f7e04ff9640 1 -- 172.21.15.46:0/3839299742 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e08040070 con 0x55a28a5fc1b0 2024-09-21T04:01:55.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.847+0000 7f7e04ff9640 1 -- 172.21.15.46:0/3839299742 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e080316a0 con 0x55a28a5fc1b0 2024-09-21T04:01:55.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.847+0000 7f7e04ff9640 1 -- 172.21.15.46:0/3839299742 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e08035040 con 0x55a28a5fc1b0 2024-09-21T04:01:55.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.847+0000 7f7e077fe640 1 --2- 172.21.15.46:0/902014024 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7e000b6680 0x7f7e000b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:55.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.848+0000 7f7e16d9d640 1 --2- 172.21.15.46:0/902014024 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7e000b6680 0x7f7e000b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:55.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.848+0000 7f7e077fe640 1 -- 172.21.15.46:0/902014024 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f7e0c0e7c30 con 0x7f7e181083a0 2024-09-21T04:01:55.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.848+0000 7f7e233dc740 1 -- 172.21.15.46:0/3839299742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a28a5fc1b0 msgr2=0x55a28a9ccbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:55.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.848+0000 7f7e16d9d640 1 --2- 172.21.15.46:0/902014024 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7e000b6680 0x7f7e000b8b90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7e10005fd0 tx=0x7f7e10005f60 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:55.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.848+0000 7f7e233dc740 1 --2- 172.21.15.46:0/3839299742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a28a5fc1b0 0x55a28a9ccbe0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f7e08009900 tx=0x7f7e08032cd0 comp rx=0 tx=0).stop 2024-09-21T04:01:55.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.848+0000 7f7e233dc740 1 -- 172.21.15.46:0/3839299742 shutdown_connections 2024-09-21T04:01:55.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.848+0000 7f7e233dc740 1 --2- 172.21.15.46:0/3839299742 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a28a604390 0x55a28a9cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:55.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.848+0000 7f7e233dc740 1 --2- 172.21.15.46:0/3839299742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a28a5fc1b0 0x55a28a9ccbe0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:55.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.848+0000 7f7e233dc740 1 --2- 172.21.15.46:0/3839299742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a28a625070 0x55a28a9cc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:55.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.848+0000 7f7e233dc740 1 -- 172.21.15.46:0/3839299742 >> 172.21.15.46:0/3839299742 conn(0x55a28a619460 msgr2=0x55a28a9ca590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:55.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.848+0000 7f7e233dc740 1 -- 172.21.15.46:0/3839299742 shutdown_connections 2024-09-21T04:01:55.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.849+0000 7f7e233dc740 1 -- 172.21.15.46:0/3839299742 wait complete. 2024-09-21T04:01:55.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.849+0000 7f7e233dc740 1 -- start start 2024-09-21T04:01:55.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.849+0000 7f7e233dc740 1 Processor -- start 2024-09-21T04:01:55.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.849+0000 7f7e233dc740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a28a5fc1b0 0x55a28a9dc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:55.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.849+0000 7f7e233dc740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a28a604390 0x55a28a9dc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:55.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.849+0000 7f7e233dc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a28a625070 0x55a28a9e8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:55.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.849+0000 7f7e233dc740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55a28a793700 con 0x55a28a5fc1b0 2024-09-21T04:01:55.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.849+0000 7f7e233dc740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55a28a8cd160 con 0x55a28a604390 2024-09-21T04:01:55.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.849+0000 7f7e233dc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a28a9df180 con 0x55a28a625070 2024-09-21T04:01:55.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.849+0000 7f7e233dc740 10 client.0 _ll_register_callbacks cb 0x55a28a8e69e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:01:55.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.849+0000 7f7e1659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a28a5fc1b0 0x55a28a9dc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:55.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.850+0000 7f7e1659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a28a5fc1b0 0x55a28a9dc180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34288/0 (socket says 172.21.15.46:34288) 2024-09-21T04:01:55.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.850+0000 7f7e1659c640 1 -- 172.21.15.46:0/3151502665 learned_addr learned my addr 172.21.15.46:0/3151502665 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:55.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.850+0000 7f7e15d9b640 1 --2- 172.21.15.46:0/3151502665 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a28a604390 0x55a28a9dc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:55.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.850+0000 7f7e16d9d640 1 --2- 172.21.15.46:0/3151502665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a28a625070 0x55a28a9e8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:55.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.850+0000 7f7e1659c640 1 -- 172.21.15.46:0/3151502665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a28a625070 msgr2=0x55a28a9e8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:55.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.850+0000 7f7e1659c640 1 --2- 172.21.15.46:0/3151502665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a28a625070 0x55a28a9e8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:55.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.850+0000 7f7e1659c640 1 -- 172.21.15.46:0/3151502665 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a28a604390 msgr2=0x55a28a9dc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:55.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.850+0000 7f7e1659c640 1 --2- 172.21.15.46:0/3151502665 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a28a604390 0x55a28a9dc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:55.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.850+0000 7f7e1659c640 1 -- 172.21.15.46:0/3151502665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a28a8fac90 con 0x55a28a5fc1b0 2024-09-21T04:01:55.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.850+0000 7f7e1659c640 1 --2- 172.21.15.46:0/3151502665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a28a5fc1b0 0x55a28a9dc180 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f7e0802a930 tx=0x7f7e08005230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40d13433ca6e87c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:55.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.850+0000 7f7dfdffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:01:55.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.850+0000 7f7dfdffb640 1 -- 172.21.15.46:0/3151502665 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e08035070 con 0x55a28a5fc1b0 2024-09-21T04:01:55.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.850+0000 7f7dfdffb640 1 -- 172.21.15.46:0/3151502665 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f7e08004050 con 0x55a28a5fc1b0 2024-09-21T04:01:55.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.850+0000 7f7e233dc740 1 -- 172.21.15.46:0/3151502665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e080316a0 con 0x55a28a5fc1b0 2024-09-21T04:01:55.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.851+0000 7f7dfdffb640 1 -- 172.21.15.46:0/3151502665 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7e08040040 con 0x55a28a5fc1b0 2024-09-21T04:01:55.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.851+0000 7f7e233dc740 10 client.16431 fetch_fsmap learned FSMap version 20 2024-09-21T04:01:55.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.851+0000 7f7e233dc740 1 -- 172.21.15.46:0/3151502665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a28a9eaf10 con 0x55a28a5fc1b0 2024-09-21T04:01:55.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.851+0000 7f7dfdffb640 1 -- 172.21.15.46:0/3151502665 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e080316a0 con 0x55a28a5fc1b0 2024-09-21T04:01:55.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.851+0000 7f7dfdffb640 1 -- 172.21.15.46:0/3151502665 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f7e08004750 con 0x55a28a5fc1b0 2024-09-21T04:01:55.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.851+0000 7f7e233dc740 10 client.16431 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:01:55.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.851+0000 7f7e233dc740 10 client.16431 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:01:55.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.851+0000 7f7e233dc740 20 client.16431 populate_metadata read hostname 'smithi046' 2024-09-21T04:01:55.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.851+0000 7f7e233dc740 1 --2- 172.21.15.46:0/3151502665 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55a28a5e39f0 0x55a28a9ee270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:55.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.851+0000 7f7e233dc740 4 client.16431 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:01:55.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.851+0000 7f7e233dc740 1 -- 172.21.15.46:0/3151502665 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a28a944df0 con 0x55a28a5e39f0 2024-09-21T04:01:55.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.851+0000 7f7e15d9b640 1 --2- 172.21.15.46:0/3151502665 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55a28a5e39f0 0x55a28a9ee270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:55.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.852+0000 7f7e15d9b640 1 --2- 172.21.15.46:0/3151502665 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55a28a5e39f0 0x55a28a9ee270 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8a5abfc86e9ad43 server_cookie=6c85a02e3f998edb in_seq=0 out_seq=0 2024-09-21T04:01:55.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.852+0000 7f7dfdffb640 10 client.16431 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:01:55.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.852+0000 7f7dfdffb640 1 -- 172.21.15.46:0/3151502665 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a28a944df0 con 0x55a28a5e39f0 2024-09-21T04:01:55.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.853+0000 7f7dfdffb640 10 client.16431 handle_command_reply: tid=0 2024-09-21T04:01:55.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.853+0000 7f7e233dc740 1 client.16431 shutdown 2024-09-21T04:01:55.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.853+0000 7f7e233dc740 1 -- 172.21.15.46:0/3151502665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a28a5fc1b0 msgr2=0x55a28a9dc180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:55.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.853+0000 7f7e233dc740 1 --2- 172.21.15.46:0/3151502665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a28a5fc1b0 0x55a28a9dc180 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f7e0802a930 tx=0x7f7e08005230 comp rx=0 tx=0).stop 2024-09-21T04:01:55.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.853+0000 7f7e233dc740 1 -- 172.21.15.46:0/3151502665 shutdown_connections 2024-09-21T04:01:55.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.853+0000 7f7e233dc740 1 --2- 172.21.15.46:0/3151502665 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55a28a5e39f0 0x55a28a9ee270 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:55.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.853+0000 7f7e233dc740 1 --2- 172.21.15.46:0/3151502665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a28a625070 0x55a28a9e8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:55.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.853+0000 7f7e233dc740 1 --2- 172.21.15.46:0/3151502665 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a28a604390 0x55a28a9dc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:55.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.853+0000 7f7e233dc740 1 --2- 172.21.15.46:0/3151502665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a28a5fc1b0 0x55a28a9dc180 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:55.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.853+0000 7f7dfdffb640 0 client.16431 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:01:55.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.853+0000 7f7e233dc740 1 -- 172.21.15.46:0/3151502665 >> 172.21.15.46:0/3151502665 conn(0x55a28a619460 msgr2=0x55a28a9c8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:55.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.853+0000 7f7e233dc740 1 -- 172.21.15.46:0/3151502665 shutdown_connections 2024-09-21T04:01:55.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.853+0000 7f7e233dc740 1 -- 172.21.15.46:0/3151502665 wait complete. 2024-09-21T04:01:55.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.853+0000 7f7e233dc740 20 client.16431 trim_cache size 0 max 16384 2024-09-21T04:01:55.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.866+0000 7f7e233dc740 1 Processor -- start 2024-09-21T04:01:55.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.866+0000 7f7e233dc740 1 -- start start 2024-09-21T04:01:55.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.866+0000 7f7e233dc740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a28a5fc1b0 0x55a28a9db070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:55.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.866+0000 7f7e233dc740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a28a604390 0x55a28a9d1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:55.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.866+0000 7f7e233dc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a28a625070 0x55a28a9d9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:55.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.866+0000 7f7e233dc740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7e181ab210 con 0x55a28a604390 2024-09-21T04:01:55.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.866+0000 7f7e233dc740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7e181ada90 con 0x55a28a5fc1b0 2024-09-21T04:01:55.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.866+0000 7f7e233dc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7e181ab880 con 0x55a28a625070 2024-09-21T04:01:55.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.866+0000 7f7e15d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a28a604390 0x55a28a9d1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:55.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.866+0000 7f7e15d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a28a604390 0x55a28a9d1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34290/0 (socket says 172.21.15.46:34290) 2024-09-21T04:01:55.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.867+0000 7f7e15d9b640 1 -- 172.21.15.46:0/160245706 learned_addr learned my addr 172.21.15.46:0/160245706 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:55.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.867+0000 7f7e1659c640 1 --2- 172.21.15.46:0/160245706 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a28a5fc1b0 0x55a28a9db070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:55.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.867+0000 7f7e16d9d640 1 --2- 172.21.15.46:0/160245706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a28a625070 0x55a28a9d9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:55.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.867+0000 7f7e15d9b640 1 -- 172.21.15.46:0/160245706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a28a625070 msgr2=0x55a28a9d9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:55.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.867+0000 7f7e15d9b640 1 --2- 172.21.15.46:0/160245706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a28a625070 0x55a28a9d9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:55.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.867+0000 7f7e15d9b640 1 -- 172.21.15.46:0/160245706 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a28a5fc1b0 msgr2=0x55a28a9db070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:55.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.867+0000 7f7e15d9b640 1 --2- 172.21.15.46:0/160245706 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a28a5fc1b0 0x55a28a9db070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:55.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.867+0000 7f7e15d9b640 1 -- 172.21.15.46:0/160245706 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a28a9d2730 con 0x55a28a604390 2024-09-21T04:01:55.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.867+0000 7f7e15d9b640 1 --2- 172.21.15.46:0/160245706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a28a604390 0x55a28a9d1f50 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c00cba0 tx=0x7f7e0c0ea0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e4c89a24c9154a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:55.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.867+0000 7f7dfffff640 1 -- 172.21.15.46:0/160245706 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c0ad520 con 0x55a28a604390 2024-09-21T04:01:55.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.867+0000 7f7dfffff640 1 -- 172.21.15.46:0/160245706 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e0c0aee50 con 0x55a28a604390 2024-09-21T04:01:55.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.867+0000 7f7dfffff640 1 -- 172.21.15.46:0/160245706 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c0a9340 con 0x55a28a604390 2024-09-21T04:01:55.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.868+0000 7f7e233dc740 1 -- 172.21.15.46:0/160245706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a28a604390 msgr2=0x55a28a9d1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:55.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.868+0000 7f7e233dc740 1 --2- 172.21.15.46:0/160245706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a28a604390 0x55a28a9d1f50 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c00cba0 tx=0x7f7e0c0ea0c0 comp rx=0 tx=0).stop 2024-09-21T04:01:55.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.868+0000 7f7e233dc740 1 -- 172.21.15.46:0/160245706 shutdown_connections 2024-09-21T04:01:55.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.868+0000 7f7e233dc740 1 --2- 172.21.15.46:0/160245706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a28a625070 0x55a28a9d9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:55.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.868+0000 7f7e233dc740 1 --2- 172.21.15.46:0/160245706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a28a604390 0x55a28a9d1f50 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:55.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.868+0000 7f7e233dc740 1 --2- 172.21.15.46:0/160245706 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a28a5fc1b0 0x55a28a9db070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:55.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.868+0000 7f7e233dc740 1 -- 172.21.15.46:0/160245706 >> 172.21.15.46:0/160245706 conn(0x55a28a619460 msgr2=0x55a28a9d1840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:55.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.868+0000 7f7e233dc740 1 -- 172.21.15.46:0/160245706 shutdown_connections 2024-09-21T04:01:55.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.868+0000 7f7e233dc740 1 -- 172.21.15.46:0/160245706 wait complete. 2024-09-21T04:01:55.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.868+0000 7f7e233dc740 1 -- start start 2024-09-21T04:01:55.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.869+0000 7f7e233dc740 1 Processor -- start 2024-09-21T04:01:55.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.869+0000 7f7e233dc740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a28a5fc1b0 0x55a28a9f1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:55.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.869+0000 7f7e233dc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a28a604390 0x55a28a9ef090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:55.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.869+0000 7f7e233dc740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a28a625070 0x55a28a9ef730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:55.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.869+0000 7f7e233dc740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7e181abf50 con 0x55a28a625070 2024-09-21T04:01:55.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.869+0000 7f7e233dc740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7e181ad3c0 con 0x55a28a5fc1b0 2024-09-21T04:01:55.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.869+0000 7f7e233dc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7e181ac620 con 0x55a28a604390 2024-09-21T04:01:55.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.869+0000 7f7e233dc740 10 client.0 _ll_register_callbacks cb 0x7f7e0c0eb5f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:01:55.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.869+0000 7f7e16d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a28a625070 0x55a28a9ef730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:55.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.869+0000 7f7e1659c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a28a5fc1b0 0x55a28a9f1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:55.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.869+0000 7f7e16d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a28a625070 0x55a28a9ef730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34298/0 (socket says 172.21.15.46:34298) 2024-09-21T04:01:55.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.869+0000 7f7e1659c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a28a5fc1b0 0x55a28a9f1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.46:55024/0 (socket says 172.21.15.46:55024) 2024-09-21T04:01:55.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.869+0000 7f7e16d9d640 1 -- 172.21.15.46:0/2205998710 learned_addr learned my addr 172.21.15.46:0/2205998710 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:55.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.869+0000 7f7e15d9b640 1 --2- 172.21.15.46:0/2205998710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a28a604390 0x55a28a9ef090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:55.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.869+0000 7f7e16d9d640 1 -- 172.21.15.46:0/2205998710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a28a604390 msgr2=0x55a28a9ef090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:55.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.869+0000 7f7e16d9d640 1 --2- 172.21.15.46:0/2205998710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a28a604390 0x55a28a9ef090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:55.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.869+0000 7f7e16d9d640 1 -- 172.21.15.46:0/2205998710 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a28a5fc1b0 msgr2=0x55a28a9f1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:55.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.869+0000 7f7e16d9d640 1 --2- 172.21.15.46:0/2205998710 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a28a5fc1b0 0x55a28a9f1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:55.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.869+0000 7f7e16d9d640 1 -- 172.21.15.46:0/2205998710 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a28a9efea0 con 0x55a28a625070 2024-09-21T04:01:55.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.869+0000 7f7e1659c640 1 --2- 172.21.15.46:0/2205998710 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a28a5fc1b0 0x55a28a9f1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:01:55.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.870+0000 7f7e16d9d640 1 --2- 172.21.15.46:0/2205998710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a28a625070 0x55a28a9ef730 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f7e1001bc00 tx=0x7f7e100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c043f978dc521c09 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:55.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.870+0000 7f7dfdffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:01:55.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.870+0000 7f7dfdffb640 1 -- 172.21.15.46:0/2205998710 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e1002d060 con 0x55a28a625070 2024-09-21T04:01:55.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.870+0000 7f7dfdffb640 1 -- 172.21.15.46:0/2205998710 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f7e1000f8a0 con 0x55a28a625070 2024-09-21T04:01:55.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.870+0000 7f7e233dc740 1 -- 172.21.15.46:0/2205998710 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e0c0aee50 con 0x55a28a625070 2024-09-21T04:01:55.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.870+0000 7f7dfdffb640 1 -- 172.21.15.46:0/2205998710 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7e10010ea0 con 0x55a28a625070 2024-09-21T04:01:55.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.870+0000 7f7e233dc740 10 client.16437 fetch_fsmap learned FSMap version 20 2024-09-21T04:01:55.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.870+0000 7f7e233dc740 1 -- 172.21.15.46:0/2205998710 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a28aa58ad0 con 0x55a28a625070 2024-09-21T04:01:55.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.870+0000 7f7dfdffb640 1 -- 172.21.15.46:0/2205998710 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e0c0aee50 con 0x55a28a625070 2024-09-21T04:01:55.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.870+0000 7f7dfdffb640 1 -- 172.21.15.46:0/2205998710 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f7e1001ac30 con 0x55a28a625070 2024-09-21T04:01:55.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.871+0000 7f7e233dc740 10 client.16437 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:01:55.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.871+0000 7f7e233dc740 10 client.16437 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:01:55.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.871+0000 7f7e233dc740 20 client.16437 populate_metadata read hostname 'smithi046' 2024-09-21T04:01:55.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.871+0000 7f7e233dc740 1 --2- 172.21.15.46:0/2205998710 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55a28a5b8da0 0x55a28aa5b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:55.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.871+0000 7f7e233dc740 4 client.16437 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T04:01:55.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.871+0000 7f7e233dc740 1 -- 172.21.15.46:0/2205998710 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a28a9408a0 con 0x55a28a5b8da0 2024-09-21T04:01:55.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.871+0000 7f7e1659c640 1 --2- 172.21.15.46:0/2205998710 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55a28a5b8da0 0x55a28aa5b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:55.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.871+0000 7f7e1659c640 1 --2- 172.21.15.46:0/2205998710 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55a28a5b8da0 0x55a28aa5b2f0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e700141207b1 server_cookie=c990d0d15ebaf04e in_seq=0 out_seq=0 2024-09-21T04:01:55.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.871+0000 7f7dfdffb640 10 client.16437 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:01:55.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.871+0000 7f7dfdffb640 1 -- 172.21.15.46:0/2205998710 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a28a9408a0 con 0x55a28a5b8da0 2024-09-21T04:01:55.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.871+0000 7f7dfdffb640 10 client.16437 handle_command_reply: tid=0 2024-09-21T04:01:55.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.871+0000 7f7e233dc740 1 client.16437 shutdown 2024-09-21T04:01:55.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.872+0000 7f7e233dc740 1 -- 172.21.15.46:0/2205998710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a28a625070 msgr2=0x55a28a9ef730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:55.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.872+0000 7f7e233dc740 1 --2- 172.21.15.46:0/2205998710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a28a625070 0x55a28a9ef730 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f7e1001bc00 tx=0x7f7e100046c0 comp rx=0 tx=0).stop 2024-09-21T04:01:55.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.872+0000 7f7e233dc740 1 -- 172.21.15.46:0/2205998710 shutdown_connections 2024-09-21T04:01:55.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.872+0000 7f7e233dc740 1 --2- 172.21.15.46:0/2205998710 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55a28a5b8da0 0x55a28aa5b2f0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:55.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.872+0000 7f7e233dc740 1 --2- 172.21.15.46:0/2205998710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a28a625070 0x55a28a9ef730 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:55.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.872+0000 7f7e233dc740 1 --2- 172.21.15.46:0/2205998710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a28a604390 0x55a28a9ef090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:55.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.872+0000 7f7dfdffb640 0 client.16437 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:01:55.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.872+0000 7f7e233dc740 1 --2- 172.21.15.46:0/2205998710 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a28a5fc1b0 0x55a28a9f1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:55.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.872+0000 7f7e233dc740 1 -- 172.21.15.46:0/2205998710 >> 172.21.15.46:0/2205998710 conn(0x55a28a619460 msgr2=0x55a28a9cd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:55.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.872+0000 7f7e233dc740 1 -- 172.21.15.46:0/2205998710 shutdown_connections 2024-09-21T04:01:55.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.872+0000 7f7e233dc740 1 -- 172.21.15.46:0/2205998710 wait complete. 2024-09-21T04:01:55.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.872+0000 7f7e233dc740 20 client.16437 trim_cache size 0 max 16384 2024-09-21T04:01:55.879 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-21T04:01:55.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.872+0000 7f7e1ce68640 1 -- 172.21.15.46:0/902014024 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7e000b6680 msgr2=0x7f7e000b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:55.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.872+0000 7f7e1ce68640 1 --2- 172.21.15.46:0/902014024 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7e000b6680 0x7f7e000b8b90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7e10005fd0 tx=0x7f7e10005f60 comp rx=0 tx=0).stop 2024-09-21T04:01:55.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.872+0000 7f7e1ce68640 1 -- 172.21.15.46:0/902014024 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e181083a0 msgr2=0x7f7e181998f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:55.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.872+0000 7f7e1ce68640 1 --2- 172.21.15.46:0/902014024 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e181083a0 0x7f7e181998f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c00eb90 tx=0x7f7e0c00c6a0 comp rx=0 tx=0).stop 2024-09-21T04:01:55.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.873+0000 7f7e1ce68640 1 -- 172.21.15.46:0/902014024 shutdown_connections 2024-09-21T04:01:55.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.873+0000 7f7e1ce68640 1 --2- 172.21.15.46:0/902014024 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e18108cf0 0x7f7e1819eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:55.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.873+0000 7f7e1ce68640 1 --2- 172.21.15.46:0/902014024 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e181083a0 0x7f7e181998f0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:55.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.873+0000 7f7e1ce68640 1 --2- 172.21.15.46:0/902014024 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f7e000b6680 0x7f7e000b8b90 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:55.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.873+0000 7f7e1ce68640 1 --2- 172.21.15.46:0/902014024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e18102a60 0x7f7e18199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:55.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.873+0000 7f7e1ce68640 1 -- 172.21.15.46:0/902014024 >> 172.21.15.46:0/902014024 conn(0x7f7e18079730 msgr2=0x7f7e181013d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:55.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.873+0000 7f7e1ce68640 1 -- 172.21.15.46:0/902014024 shutdown_connections 2024-09-21T04:01:55.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:55.873+0000 7f7e1ce68640 1 -- 172.21.15.46:0/902014024 wait complete. 2024-09-21T04:01:56.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:55 smithi046 ceph-mon[30954]: pgmap v526: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:01:56.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:55 smithi105 ceph-mon[34773]: pgmap v526: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:01:56.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:55 smithi162 ceph-mon[35071]: pgmap v526: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:01:57.585 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T04:01:57.585 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T04:01:57.858 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:58.182 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:57 smithi046 ceph-mon[30954]: pgmap v527: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:01:58.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:57 smithi105 ceph-mon[34773]: pgmap v527: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:01:58.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:57 smithi162 ceph-mon[35071]: pgmap v527: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:01:58.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.376+0000 7f21af826640 1 -- 172.21.15.46:0/2738606465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21a81083a0 msgr2=0x7f21a81087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:58.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.376+0000 7f21af826640 1 --2- 172.21.15.46:0/2738606465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21a81083a0 0x7f21a81087b0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f2198009900 tx=0x7f219802a410 comp rx=0 tx=0).stop 2024-09-21T04:01:58.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.376+0000 7f21af826640 1 -- 172.21.15.46:0/2738606465 shutdown_connections 2024-09-21T04:01:58.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.376+0000 7f21af826640 1 --2- 172.21.15.46:0/2738606465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21a8108cf0 0x7f21a810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:58.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.376+0000 7f21af826640 1 --2- 172.21.15.46:0/2738606465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21a81083a0 0x7f21a81087b0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:58.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.376+0000 7f21af826640 1 --2- 172.21.15.46:0/2738606465 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21a8102a60 0x7f21a8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:58.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.376+0000 7f21af826640 1 -- 172.21.15.46:0/2738606465 >> 172.21.15.46:0/2738606465 conn(0x7f21a8079730 msgr2=0x7f21a8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:58.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.376+0000 7f21af826640 1 -- 172.21.15.46:0/2738606465 shutdown_connections 2024-09-21T04:01:58.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.376+0000 7f21af826640 1 -- 172.21.15.46:0/2738606465 wait complete. 2024-09-21T04:01:58.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.377+0000 7f21af826640 1 Processor -- start 2024-09-21T04:01:58.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.377+0000 7f21af826640 1 -- start start 2024-09-21T04:01:58.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.377+0000 7f21af826640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21a8102a60 0x7f21a819a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:58.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.377+0000 7f21af826640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21a81083a0 0x7f21a819aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:58.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.377+0000 7f21af826640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21a8108cf0 0x7f21a819fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:58.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.377+0000 7f21af826640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f21a8113ab0 con 0x7f21a81083a0 2024-09-21T04:01:58.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.377+0000 7f21af826640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f21a8113930 con 0x7f21a8102a60 2024-09-21T04:01:58.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.377+0000 7f21af826640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f21a8113c30 con 0x7f21a8108cf0 2024-09-21T04:01:58.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.377+0000 7f21acdc1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21a81083a0 0x7f21a819aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:58.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.377+0000 7f21acdc1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21a81083a0 0x7f21a819aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34314/0 (socket says 172.21.15.46:34314) 2024-09-21T04:01:58.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.377+0000 7f21acdc1640 1 -- 172.21.15.46:0/1708694262 learned_addr learned my addr 172.21.15.46:0/1708694262 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:58.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.378+0000 7f21addc3640 1 --2- 172.21.15.46:0/1708694262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21a8108cf0 0x7f21a819fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:58.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.378+0000 7f21ad5c2640 1 --2- 172.21.15.46:0/1708694262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21a8102a60 0x7f21a819a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:58.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.378+0000 7f21acdc1640 1 -- 172.21.15.46:0/1708694262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21a8108cf0 msgr2=0x7f21a819fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:58.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.378+0000 7f21acdc1640 1 --2- 172.21.15.46:0/1708694262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21a8108cf0 0x7f21a819fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:58.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.378+0000 7f21acdc1640 1 -- 172.21.15.46:0/1708694262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21a8102a60 msgr2=0x7f21a819a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:58.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.378+0000 7f21acdc1640 1 --2- 172.21.15.46:0/1708694262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21a8102a60 0x7f21a819a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:58.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.378+0000 7f21acdc1640 1 -- 172.21.15.46:0/1708694262 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21a81a03b0 con 0x7f21a81083a0 2024-09-21T04:01:58.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.378+0000 7f21acdc1640 1 --2- 172.21.15.46:0/1708694262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21a81083a0 0x7f21a819aaa0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f2198031440 tx=0x7f2198003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:58.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.378+0000 7f219e7fc640 1 -- 172.21.15.46:0/1708694262 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219803f070 con 0x7f21a81083a0 2024-09-21T04:01:58.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.378+0000 7f21af826640 1 -- 172.21.15.46:0/1708694262 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21a81a0640 con 0x7f21a81083a0 2024-09-21T04:01:58.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.378+0000 7f219e7fc640 1 -- 172.21.15.46:0/1708694262 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2198031d60 con 0x7f21a81083a0 2024-09-21T04:01:58.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.378+0000 7f219e7fc640 1 -- 172.21.15.46:0/1708694262 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2198035030 con 0x7f21a81083a0 2024-09-21T04:01:58.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.378+0000 7f21af826640 1 -- 172.21.15.46:0/1708694262 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21a81a0b70 con 0x7f21a81083a0 2024-09-21T04:01:58.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.382+0000 7f21b5d9a740 1 Processor -- start 2024-09-21T04:01:58.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.382+0000 7f21b5d9a740 1 -- start start 2024-09-21T04:01:58.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.382+0000 7f219e7fc640 1 -- 172.21.15.46:0/1708694262 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f2198042070 con 0x7f21a81083a0 2024-09-21T04:01:58.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.382+0000 7f21b5d9a740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bfec2350 0x55a0c0269430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:58.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.382+0000 7f21b5d9a740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0bfe99490 0x55a0c0269970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:58.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.382+0000 7f21b5d9a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0bfea1670 0x55a0c0269eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:58.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.382+0000 7f21b5d9a740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55a0c01dfe60 con 0x55a0bfe99490 2024-09-21T04:01:58.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.382+0000 7f21b5d9a740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55a0c01cf290 con 0x55a0bfec2350 2024-09-21T04:01:58.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.382+0000 7f21b5d9a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a0c01d30a0 con 0x55a0bfea1670 2024-09-21T04:01:58.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.382+0000 7f21ad5c2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0bfe99490 0x55a0c0269970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:58.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.383+0000 7f21ad5c2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0bfe99490 0x55a0c0269970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34318/0 (socket says 172.21.15.46:34318) 2024-09-21T04:01:58.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.383+0000 7f21ad5c2640 1 -- 172.21.15.46:0/2006757408 learned_addr learned my addr 172.21.15.46:0/2006757408 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:58.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.383+0000 7f21addc3640 1 --2- 172.21.15.46:0/2006757408 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bfec2350 0x55a0c0269430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:58.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.383+0000 7f21acdc1640 1 --2- 172.21.15.46:0/2006757408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0bfea1670 0x55a0c0269eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:58.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.383+0000 7f21ad5c2640 1 -- 172.21.15.46:0/2006757408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0bfea1670 msgr2=0x55a0c0269eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:58.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.383+0000 7f21ad5c2640 1 --2- 172.21.15.46:0/2006757408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0bfea1670 0x55a0c0269eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:58.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.383+0000 7f21ad5c2640 1 -- 172.21.15.46:0/2006757408 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bfec2350 msgr2=0x55a0c0269430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:58.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.383+0000 7f21ad5c2640 1 --2- 172.21.15.46:0/2006757408 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bfec2350 0x55a0c0269430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:58.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.383+0000 7f21ad5c2640 1 -- 172.21.15.46:0/2006757408 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0bff2d930 con 0x55a0bfe99490 2024-09-21T04:01:58.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.383+0000 7f21ad5c2640 1 --2- 172.21.15.46:0/2006757408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0bfe99490 0x55a0c0269970 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f21a400af40 tx=0x7f21a400f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e54633293293d83 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:58.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.383+0000 7f219e7fc640 1 --2- 172.21.15.46:0/1708694262 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f21940b66b0 0x7f21940b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:58.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.383+0000 7f21937fe640 1 -- 172.21.15.46:0/2006757408 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a401d070 con 0x55a0bfe99490 2024-09-21T04:01:58.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.383+0000 7f21addc3640 1 --2- 172.21.15.46:0/1708694262 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f21940b66b0 0x7f21940b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:58.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.383+0000 7f21937fe640 1 -- 172.21.15.46:0/2006757408 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21a4010db0 con 0x55a0bfe99490 2024-09-21T04:01:58.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.383+0000 7f21937fe640 1 -- 172.21.15.46:0/2006757408 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a4018da0 con 0x55a0bfe99490 2024-09-21T04:01:58.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.383+0000 7f219e7fc640 1 -- 172.21.15.46:0/1708694262 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f2198107ed0 con 0x7f21a81083a0 2024-09-21T04:01:58.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.384+0000 7f21addc3640 1 --2- 172.21.15.46:0/1708694262 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f21940b66b0 0x7f21940b8bc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f21a000ab60 tx=0x7f21a000a250 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:58.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.384+0000 7f21b5d9a740 1 -- 172.21.15.46:0/2006757408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0bfe99490 msgr2=0x55a0c0269970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:58.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.384+0000 7f21b5d9a740 1 --2- 172.21.15.46:0/2006757408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0bfe99490 0x55a0c0269970 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f21a400af40 tx=0x7f21a400f850 comp rx=0 tx=0).stop 2024-09-21T04:01:58.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.384+0000 7f21b5d9a740 1 -- 172.21.15.46:0/2006757408 shutdown_connections 2024-09-21T04:01:58.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.384+0000 7f21b5d9a740 1 --2- 172.21.15.46:0/2006757408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0bfea1670 0x55a0c0269eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:58.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.384+0000 7f21b5d9a740 1 --2- 172.21.15.46:0/2006757408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0bfe99490 0x55a0c0269970 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:58.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.384+0000 7f21b5d9a740 1 --2- 172.21.15.46:0/2006757408 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bfec2350 0x55a0c0269430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:58.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.384+0000 7f21b5d9a740 1 -- 172.21.15.46:0/2006757408 >> 172.21.15.46:0/2006757408 conn(0x55a0bfeb6740 msgr2=0x55a0c0267320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:58.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.384+0000 7f21b5d9a740 1 -- 172.21.15.46:0/2006757408 shutdown_connections 2024-09-21T04:01:58.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.384+0000 7f21b5d9a740 1 -- 172.21.15.46:0/2006757408 wait complete. 2024-09-21T04:01:58.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.385+0000 7f21b5d9a740 1 -- start start 2024-09-21T04:01:58.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.385+0000 7f21b5d9a740 1 Processor -- start 2024-09-21T04:01:58.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.385+0000 7f21b5d9a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0bfe99490 0x55a0c0275030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:58.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.385+0000 7f21b5d9a740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bfea1670 0x55a0c0275570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:58.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.385+0000 7f21b5d9a740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0bfec2350 0x55a0c0280f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:58.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.386+0000 7f21b5d9a740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55a0c0030890 con 0x55a0bfec2350 2024-09-21T04:01:58.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.386+0000 7f21b5d9a740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55a0c0169d40 con 0x55a0bfea1670 2024-09-21T04:01:58.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.386+0000 7f21b5d9a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a0c0277c10 con 0x55a0bfe99490 2024-09-21T04:01:58.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.386+0000 7f21b5d9a740 10 client.0 _ll_register_callbacks cb 0x55a0c01cdc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:01:58.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.386+0000 7f21addc3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0bfec2350 0x55a0c0280f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:58.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.386+0000 7f21addc3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0bfec2350 0x55a0c0280f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34324/0 (socket says 172.21.15.46:34324) 2024-09-21T04:01:58.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.386+0000 7f21addc3640 1 -- 172.21.15.46:0/2707193564 learned_addr learned my addr 172.21.15.46:0/2707193564 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:58.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.386+0000 7f21acdc1640 1 --2- 172.21.15.46:0/2707193564 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bfea1670 0x55a0c0275570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:58.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.386+0000 7f21ad5c2640 1 --2- 172.21.15.46:0/2707193564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0bfe99490 0x55a0c0275030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:58.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.386+0000 7f21addc3640 1 -- 172.21.15.46:0/2707193564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0bfe99490 msgr2=0x55a0c0275030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:58.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.386+0000 7f21addc3640 1 --2- 172.21.15.46:0/2707193564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0bfe99490 0x55a0c0275030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:58.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.386+0000 7f21addc3640 1 -- 172.21.15.46:0/2707193564 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bfea1670 msgr2=0x55a0c0275570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:58.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.386+0000 7f21addc3640 1 --2- 172.21.15.46:0/2707193564 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bfea1670 0x55a0c0275570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:58.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.386+0000 7f21addc3640 1 -- 172.21.15.46:0/2707193564 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0c02814c0 con 0x55a0bfec2350 2024-09-21T04:01:58.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.386+0000 7f21addc3640 1 --2- 172.21.15.46:0/2707193564 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0bfec2350 0x55a0c0280f00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f21a0010ec0 tx=0x7f21a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a53727f4fbc585 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:58.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.386+0000 7f2190ff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:01:58.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.386+0000 7f2190ff9640 1 -- 172.21.15.46:0/2707193564 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a001b870 con 0x55a0bfec2350 2024-09-21T04:01:58.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.387+0000 7f2190ff9640 1 -- 172.21.15.46:0/2707193564 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f21a001ba10 con 0x55a0bfec2350 2024-09-21T04:01:58.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.387+0000 7f21b5d9a740 1 -- 172.21.15.46:0/2707193564 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21a4010db0 con 0x55a0bfec2350 2024-09-21T04:01:58.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.387+0000 7f2190ff9640 1 -- 172.21.15.46:0/2707193564 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f21a001bc10 con 0x55a0bfec2350 2024-09-21T04:01:58.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.387+0000 7f21b5d9a740 10 client.16449 fetch_fsmap learned FSMap version 20 2024-09-21T04:01:58.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.387+0000 7f21b5d9a740 1 -- 172.21.15.46:0/2707193564 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a0c0283e50 con 0x55a0bfec2350 2024-09-21T04:01:58.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.387+0000 7f2190ff9640 1 -- 172.21.15.46:0/2707193564 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21a4010db0 con 0x55a0bfec2350 2024-09-21T04:01:58.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.387+0000 7f2190ff9640 1 -- 172.21.15.46:0/2707193564 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f21a0024070 con 0x55a0bfec2350 2024-09-21T04:01:58.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.387+0000 7f21b5d9a740 10 client.16449 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:01:58.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.387+0000 7f21b5d9a740 10 client.16449 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:01:58.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.387+0000 7f21b5d9a740 20 client.16449 populate_metadata read hostname 'smithi046' 2024-09-21T04:01:58.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.387+0000 7f21b5d9a740 1 --2- 172.21.15.46:0/2707193564 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55a0bfe80cd0 0x55a0c0287330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:58.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.387+0000 7f21b5d9a740 4 client.16449 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:01:58.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.387+0000 7f21b5d9a740 1 -- 172.21.15.46:0/2707193564 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0c01e1db0 con 0x55a0bfe80cd0 2024-09-21T04:01:58.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.388+0000 7f21ad5c2640 1 --2- 172.21.15.46:0/2707193564 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55a0bfe80cd0 0x55a0c0287330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:58.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.388+0000 7f21ad5c2640 1 --2- 172.21.15.46:0/2707193564 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55a0bfe80cd0 0x55a0c0287330 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85cf01a01badad0c server_cookie=f9b47da80a7d1cd5 in_seq=0 out_seq=0 2024-09-21T04:01:58.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.388+0000 7f2190ff9640 10 client.16449 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:01:58.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.389+0000 7f2190ff9640 1 -- 172.21.15.46:0/2707193564 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a0c01e1db0 con 0x55a0bfe80cd0 2024-09-21T04:01:58.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.389+0000 7f2190ff9640 10 client.16449 handle_command_reply: tid=0 2024-09-21T04:01:58.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.389+0000 7f21b5d9a740 1 client.16449 shutdown 2024-09-21T04:01:58.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.389+0000 7f21b5d9a740 1 -- 172.21.15.46:0/2707193564 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0bfec2350 msgr2=0x55a0c0280f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:58.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.389+0000 7f21b5d9a740 1 --2- 172.21.15.46:0/2707193564 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0bfec2350 0x55a0c0280f00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f21a0010ec0 tx=0x7f21a00046c0 comp rx=0 tx=0).stop 2024-09-21T04:01:58.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.389+0000 7f21b5d9a740 1 -- 172.21.15.46:0/2707193564 shutdown_connections 2024-09-21T04:01:58.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.389+0000 7f21b5d9a740 1 --2- 172.21.15.46:0/2707193564 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55a0bfe80cd0 0x55a0c0287330 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:58.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.389+0000 7f21b5d9a740 1 --2- 172.21.15.46:0/2707193564 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0bfec2350 0x55a0c0280f00 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:58.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.389+0000 7f21b5d9a740 1 --2- 172.21.15.46:0/2707193564 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bfea1670 0x55a0c0275570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:58.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.389+0000 7f2190ff9640 0 client.16449 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:01:58.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.389+0000 7f21b5d9a740 1 --2- 172.21.15.46:0/2707193564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0bfe99490 0x55a0c0275030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:58.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.389+0000 7f21b5d9a740 1 -- 172.21.15.46:0/2707193564 >> 172.21.15.46:0/2707193564 conn(0x55a0bfeb6740 msgr2=0x55a0c026c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:58.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.389+0000 7f21b5d9a740 1 -- 172.21.15.46:0/2707193564 shutdown_connections 2024-09-21T04:01:58.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.389+0000 7f21b5d9a740 1 -- 172.21.15.46:0/2707193564 wait complete. 2024-09-21T04:01:58.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.389+0000 7f21b5d9a740 20 client.16449 trim_cache size 0 max 16384 2024-09-21T04:01:58.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.407+0000 7f21b5d9a740 1 Processor -- start 2024-09-21T04:01:58.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.407+0000 7f21b5d9a740 1 -- start start 2024-09-21T04:01:58.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.408+0000 7f21b5d9a740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0bfe99490 0x55a0c02746c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:58.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.408+0000 7f21b5d9a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0bfea1670 0x55a0c0276a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:58.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.408+0000 7f21b5d9a740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bfec2350 0x55a0c026e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:58.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.408+0000 7f21b5d9a740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f21a81af730 con 0x55a0bfe99490 2024-09-21T04:01:58.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.408+0000 7f21b5d9a740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f21a81b1fd0 con 0x55a0bfec2350 2024-09-21T04:01:58.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.408+0000 7f21b5d9a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f21a81afdc0 con 0x55a0bfea1670 2024-09-21T04:01:58.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.408+0000 7f21ad5c2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0bfe99490 0x55a0c02746c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:58.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.408+0000 7f21ad5c2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0bfe99490 0x55a0c02746c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34338/0 (socket says 172.21.15.46:34338) 2024-09-21T04:01:58.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.408+0000 7f21ad5c2640 1 -- 172.21.15.46:0/217358816 learned_addr learned my addr 172.21.15.46:0/217358816 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:58.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.408+0000 7f21addc3640 1 --2- 172.21.15.46:0/217358816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bfec2350 0x55a0c026e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:58.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.408+0000 7f21acdc1640 1 --2- 172.21.15.46:0/217358816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0bfea1670 0x55a0c0276a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:58.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.408+0000 7f21ad5c2640 1 -- 172.21.15.46:0/217358816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0bfea1670 msgr2=0x55a0c0276a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:58.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.408+0000 7f21ad5c2640 1 --2- 172.21.15.46:0/217358816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0bfea1670 0x55a0c0276a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:58.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.408+0000 7f21ad5c2640 1 -- 172.21.15.46:0/217358816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bfec2350 msgr2=0x55a0c026e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:58.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.408+0000 7f21ad5c2640 1 --2- 172.21.15.46:0/217358816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bfec2350 0x55a0c026e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:58.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.408+0000 7f21ad5c2640 1 -- 172.21.15.46:0/217358816 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0c0267860 con 0x55a0bfe99490 2024-09-21T04:01:58.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.408+0000 7f21acdc1640 1 --2- 172.21.15.46:0/217358816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0bfea1670 0x55a0c0276a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:01:58.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.408+0000 7f21ad5c2640 1 --2- 172.21.15.46:0/217358816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0bfe99490 0x55a0c02746c0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f21a400ae90 tx=0x7f21a400a590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da3ff57ad11e56ea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:58.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.409+0000 7f2192ffd640 1 -- 172.21.15.46:0/217358816 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a401d040 con 0x55a0bfe99490 2024-09-21T04:01:58.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.409+0000 7f2192ffd640 1 -- 172.21.15.46:0/217358816 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21a4018640 con 0x55a0bfe99490 2024-09-21T04:01:58.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.409+0000 7f2192ffd640 1 -- 172.21.15.46:0/217358816 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a4010700 con 0x55a0bfe99490 2024-09-21T04:01:58.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.409+0000 7f21b5d9a740 1 -- 172.21.15.46:0/217358816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0bfe99490 msgr2=0x55a0c02746c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:58.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.409+0000 7f21b5d9a740 1 --2- 172.21.15.46:0/217358816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0bfe99490 0x55a0c02746c0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f21a400ae90 tx=0x7f21a400a590 comp rx=0 tx=0).stop 2024-09-21T04:01:58.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.410+0000 7f21b5d9a740 1 -- 172.21.15.46:0/217358816 shutdown_connections 2024-09-21T04:01:58.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.410+0000 7f21b5d9a740 1 --2- 172.21.15.46:0/217358816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bfec2350 0x55a0c026e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:58.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.410+0000 7f21b5d9a740 1 --2- 172.21.15.46:0/217358816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0bfea1670 0x55a0c0276a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:58.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.410+0000 7f21b5d9a740 1 --2- 172.21.15.46:0/217358816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0bfe99490 0x55a0c02746c0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:58.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.410+0000 7f21b5d9a740 1 -- 172.21.15.46:0/217358816 >> 172.21.15.46:0/217358816 conn(0x55a0bfeb6740 msgr2=0x55a0c0276350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:58.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.410+0000 7f21b5d9a740 1 -- 172.21.15.46:0/217358816 shutdown_connections 2024-09-21T04:01:58.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.410+0000 7f21b5d9a740 1 -- 172.21.15.46:0/217358816 wait complete. 2024-09-21T04:01:58.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.410+0000 7f21b5d9a740 1 -- start start 2024-09-21T04:01:58.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.410+0000 7f21b5d9a740 1 Processor -- start 2024-09-21T04:01:58.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.411+0000 7f21b5d9a740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bfe99490 0x55a0c027d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:58.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.411+0000 7f21b5d9a740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0bfea1670 0x55a0c027b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:58.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.411+0000 7f21b5d9a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0bfec2350 0x55a0c027b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:58.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.411+0000 7f21b5d9a740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f21a81b0490 con 0x55a0bfea1670 2024-09-21T04:01:58.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.411+0000 7f21b5d9a740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f21a81b1900 con 0x55a0bfe99490 2024-09-21T04:01:58.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.411+0000 7f21b5d9a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f21a81b0b60 con 0x55a0bfec2350 2024-09-21T04:01:58.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.411+0000 7f21b5d9a740 10 client.0 _ll_register_callbacks cb 0x7f21a000a7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:01:58.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.411+0000 7f21acdc1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0bfea1670 0x55a0c027b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:58.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.411+0000 7f21acdc1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0bfea1670 0x55a0c027b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34342/0 (socket says 172.21.15.46:34342) 2024-09-21T04:01:58.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.411+0000 7f21acdc1640 1 -- 172.21.15.46:0/1325290403 learned_addr learned my addr 172.21.15.46:0/1325290403 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:58.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.411+0000 7f21addc3640 1 --2- 172.21.15.46:0/1325290403 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0bfec2350 0x55a0c027b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:58.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.411+0000 7f21ad5c2640 1 --2- 172.21.15.46:0/1325290403 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bfe99490 0x55a0c027d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:58.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.411+0000 7f21acdc1640 1 -- 172.21.15.46:0/1325290403 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0bfec2350 msgr2=0x55a0c027b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:58.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.411+0000 7f21acdc1640 1 --2- 172.21.15.46:0/1325290403 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0bfec2350 0x55a0c027b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:58.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.411+0000 7f21acdc1640 1 -- 172.21.15.46:0/1325290403 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bfe99490 msgr2=0x55a0c027d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:58.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.411+0000 7f21acdc1640 1 --2- 172.21.15.46:0/1325290403 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bfe99490 0x55a0c027d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:58.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.411+0000 7f21acdc1640 1 -- 172.21.15.46:0/1325290403 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0c027bd20 con 0x55a0bfea1670 2024-09-21T04:01:58.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.411+0000 7f21acdc1640 1 --2- 172.21.15.46:0/1325290403 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0bfea1670 0x55a0c027b0a0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f2198005ab0 tx=0x7f219802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b87feea0cc2d220 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:58.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.411+0000 7f2190ff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:01:58.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.411+0000 7f2190ff9640 1 -- 172.21.15.46:0/1325290403 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2198049070 con 0x55a0bfea1670 2024-09-21T04:01:58.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.412+0000 7f2190ff9640 1 -- 172.21.15.46:0/1325290403 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f21980d7350 con 0x55a0bfea1670 2024-09-21T04:01:58.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.412+0000 7f21b5d9a740 1 -- 172.21.15.46:0/1325290403 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21a4018640 con 0x55a0bfea1670 2024-09-21T04:01:58.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.412+0000 7f2190ff9640 1 -- 172.21.15.46:0/1325290403 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f21980cdc40 con 0x55a0bfea1670 2024-09-21T04:01:58.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.412+0000 7f21b5d9a740 10 client.16455 fetch_fsmap learned FSMap version 20 2024-09-21T04:01:58.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.412+0000 7f21b5d9a740 1 -- 172.21.15.46:0/1325290403 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a0c02f2b90 con 0x55a0bfea1670 2024-09-21T04:01:58.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.412+0000 7f2190ff9640 1 -- 172.21.15.46:0/1325290403 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21a4018640 con 0x55a0bfea1670 2024-09-21T04:01:58.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.412+0000 7f2190ff9640 1 -- 172.21.15.46:0/1325290403 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f219810b020 con 0x55a0bfea1670 2024-09-21T04:01:58.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.412+0000 7f21b5d9a740 10 client.16455 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:01:58.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.412+0000 7f21b5d9a740 10 client.16455 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:01:58.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.412+0000 7f21b5d9a740 20 client.16455 populate_metadata read hostname 'smithi046' 2024-09-21T04:01:58.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.412+0000 7f21b5d9a740 1 --2- 172.21.15.46:0/1325290403 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55a0bfe56080 0x55a0c02f5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:58.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.412+0000 7f21b5d9a740 4 client.16455 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T04:01:58.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.412+0000 7f21b5d9a740 1 -- 172.21.15.46:0/1325290403 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a0c01dd860 con 0x55a0bfe56080 2024-09-21T04:01:58.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.412+0000 7f21ad5c2640 1 --2- 172.21.15.46:0/1325290403 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55a0bfe56080 0x55a0c02f5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:58.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.413+0000 7f2190ff9640 10 client.16455 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:01:58.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.413+0000 7f21ad5c2640 1 --2- 172.21.15.46:0/1325290403 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55a0bfe56080 0x55a0c02f5380 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1096f9b10d6a12d5 server_cookie=3cbd38746296b0c7 in_seq=0 out_seq=0 2024-09-21T04:01:58.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.415+0000 7f2190ff9640 1 -- 172.21.15.46:0/1325290403 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a0c01dd860 con 0x55a0bfe56080 2024-09-21T04:01:58.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.415+0000 7f2190ff9640 10 client.16455 handle_command_reply: tid=0 2024-09-21T04:01:58.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.415+0000 7f21b5d9a740 1 client.16455 shutdown 2024-09-21T04:01:58.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.415+0000 7f21b5d9a740 1 -- 172.21.15.46:0/1325290403 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0bfea1670 msgr2=0x55a0c027b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:58.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.415+0000 7f21b5d9a740 1 --2- 172.21.15.46:0/1325290403 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0bfea1670 0x55a0c027b0a0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f2198005ab0 tx=0x7f219802a410 comp rx=0 tx=0).stop 2024-09-21T04:01:58.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.415+0000 7f21b5d9a740 1 -- 172.21.15.46:0/1325290403 shutdown_connections 2024-09-21T04:01:58.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.415+0000 7f21b5d9a740 1 --2- 172.21.15.46:0/1325290403 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55a0bfe56080 0x55a0c02f5380 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:58.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.415+0000 7f21b5d9a740 1 --2- 172.21.15.46:0/1325290403 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a0bfec2350 0x55a0c027b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:58.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.415+0000 7f21b5d9a740 1 --2- 172.21.15.46:0/1325290403 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0bfea1670 0x55a0c027b0a0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:58.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.415+0000 7f21b5d9a740 1 --2- 172.21.15.46:0/1325290403 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bfe99490 0x55a0c027d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:58.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.415+0000 7f21b5d9a740 1 -- 172.21.15.46:0/1325290403 >> 172.21.15.46:0/1325290403 conn(0x55a0bfeb6740 msgr2=0x55a0c026ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:58.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.415+0000 7f2190ff9640 0 client.16455 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:01:58.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.415+0000 7f21b5d9a740 1 -- 172.21.15.46:0/1325290403 shutdown_connections 2024-09-21T04:01:58.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.415+0000 7f21b5d9a740 1 -- 172.21.15.46:0/1325290403 wait complete. 2024-09-21T04:01:58.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.415+0000 7f21b5d9a740 20 client.16455 trim_cache size 0 max 16384 2024-09-21T04:01:58.422 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T04:01:58.422 INFO:teuthology.orchestra.run.smithi046.stdout: "return_code": 0, 2024-09-21T04:01:58.422 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_tag": "7a3afabe-6b27-4bce-928a-8c6773a85803", 2024-09-21T04:01:58.422 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": "asynchronous" 2024-09-21T04:01:58.422 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T04:01:58.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.416+0000 7f21af826640 1 -- 172.21.15.46:0/1708694262 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f21940b66b0 msgr2=0x7f21940b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:58.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.416+0000 7f21af826640 1 --2- 172.21.15.46:0/1708694262 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f21940b66b0 0x7f21940b8bc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f21a000ab60 tx=0x7f21a000a250 comp rx=0 tx=0).stop 2024-09-21T04:01:58.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.416+0000 7f21af826640 1 -- 172.21.15.46:0/1708694262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21a81083a0 msgr2=0x7f21a819aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:58.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.416+0000 7f21af826640 1 --2- 172.21.15.46:0/1708694262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21a81083a0 0x7f21a819aaa0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f2198031440 tx=0x7f2198003d50 comp rx=0 tx=0).stop 2024-09-21T04:01:58.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.416+0000 7f21af826640 1 -- 172.21.15.46:0/1708694262 shutdown_connections 2024-09-21T04:01:58.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.416+0000 7f21af826640 1 --2- 172.21.15.46:0/1708694262 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f21940b66b0 0x7f21940b8bc0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:58.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.416+0000 7f21af826640 1 --2- 172.21.15.46:0/1708694262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21a8108cf0 0x7f21a819fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:58.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.416+0000 7f21af826640 1 --2- 172.21.15.46:0/1708694262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21a81083a0 0x7f21a819aaa0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:58.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.416+0000 7f21af826640 1 --2- 172.21.15.46:0/1708694262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21a8102a60 0x7f21a819a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:58.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.416+0000 7f21af826640 1 -- 172.21.15.46:0/1708694262 >> 172.21.15.46:0/1708694262 conn(0x7f21a8079730 msgr2=0x7f21a8104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:58.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.416+0000 7f21af826640 1 -- 172.21.15.46:0/1708694262 shutdown_connections 2024-09-21T04:01:58.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:58.416+0000 7f21af826640 1 -- 172.21.15.46:0/1708694262 wait complete. 2024-09-21T04:01:59.110 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T04:01:59.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:58 smithi046 ceph-mon[30954]: scrub queued for path: / 2024-09-21T04:01:59.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:58 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T04:01:59.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:58 smithi046 ceph-mon[30954]: scrub summary: active paths [/] 2024-09-21T04:01:59.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:58 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T04:01:59.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:58 smithi105 ceph-mon[34773]: scrub queued for path: / 2024-09-21T04:01:59.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:58 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T04:01:59.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:58 smithi105 ceph-mon[34773]: scrub summary: active paths [/] 2024-09-21T04:01:59.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:58 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T04:01:59.369 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:59.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:58 smithi162 ceph-mon[35071]: scrub queued for path: / 2024-09-21T04:01:59.378 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:58 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T04:01:59.378 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:58 smithi162 ceph-mon[35071]: scrub summary: active paths [/] 2024-09-21T04:01:59.378 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:58 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T04:01:59.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.886+0000 7f99121bd640 1 -- 172.21.15.46:0/3352566877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f990c103b60 msgr2=0x7f990c103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:59.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.886+0000 7f99121bd640 1 --2- 172.21.15.46:0/3352566877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f990c103b60 0x7f990c103f70 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f98fc009900 tx=0x7f98fc02a410 comp rx=0 tx=0).stop 2024-09-21T04:01:59.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.886+0000 7f99121bd640 1 -- 172.21.15.46:0/3352566877 shutdown_connections 2024-09-21T04:01:59.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.886+0000 7f99121bd640 1 --2- 172.21.15.46:0/3352566877 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f990c109df0 0x7f990c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.886+0000 7f99121bd640 1 --2- 172.21.15.46:0/3352566877 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f990c1094a0 0x7f990c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.886+0000 7f99121bd640 1 --2- 172.21.15.46:0/3352566877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f990c103b60 0x7f990c103f70 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.886+0000 7f99121bd640 1 -- 172.21.15.46:0/3352566877 >> 172.21.15.46:0/3352566877 conn(0x7f990c07b850 msgr2=0x7f990c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:59.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.886+0000 7f99121bd640 1 -- 172.21.15.46:0/3352566877 shutdown_connections 2024-09-21T04:01:59.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.886+0000 7f99121bd640 1 -- 172.21.15.46:0/3352566877 wait complete. 2024-09-21T04:01:59.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.887+0000 7f99121bd640 1 Processor -- start 2024-09-21T04:01:59.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.887+0000 7f99121bd640 1 -- start start 2024-09-21T04:01:59.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.887+0000 7f99121bd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f990c103b60 0x7f990c19a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:59.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.887+0000 7f99121bd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f990c1094a0 0x7f990c19aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:59.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.887+0000 7f99121bd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f990c109df0 0x7f990c19fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:59.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.887+0000 7f99121bd640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f990c113ab0 con 0x7f990c1094a0 2024-09-21T04:01:59.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.887+0000 7f99121bd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f990c113930 con 0x7f990c103b60 2024-09-21T04:01:59.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.887+0000 7f99121bd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f990c113c30 con 0x7f990c109df0 2024-09-21T04:01:59.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.887+0000 7f990affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f990c1094a0 0x7f990c19aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:59.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.887+0000 7f990affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f990c1094a0 0x7f990c19aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34370/0 (socket says 172.21.15.46:34370) 2024-09-21T04:01:59.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.887+0000 7f990affd640 1 -- 172.21.15.46:0/448217344 learned_addr learned my addr 172.21.15.46:0/448217344 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:59.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.887+0000 7f990bfff640 1 --2- 172.21.15.46:0/448217344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f990c109df0 0x7f990c19fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:59.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.888+0000 7f990b7fe640 1 --2- 172.21.15.46:0/448217344 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f990c103b60 0x7f990c19a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:59.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.888+0000 7f990affd640 1 -- 172.21.15.46:0/448217344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f990c109df0 msgr2=0x7f990c19fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:59.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.888+0000 7f990affd640 1 --2- 172.21.15.46:0/448217344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f990c109df0 0x7f990c19fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.888+0000 7f990affd640 1 -- 172.21.15.46:0/448217344 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f990c103b60 msgr2=0x7f990c19a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:59.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.888+0000 7f990affd640 1 --2- 172.21.15.46:0/448217344 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f990c103b60 0x7f990c19a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.888+0000 7f990affd640 1 -- 172.21.15.46:0/448217344 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f990c1a03d0 con 0x7f990c1094a0 2024-09-21T04:01:59.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.888+0000 7f990b7fe640 1 --2- 172.21.15.46:0/448217344 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f990c103b60 0x7f990c19a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:01:59.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.888+0000 7f990affd640 1 --2- 172.21.15.46:0/448217344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f990c1094a0 0x7f990c19aac0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f990000c970 tx=0x7f990000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:59.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.888+0000 7f9908ff9640 1 -- 172.21.15.46:0/448217344 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9900004220 con 0x7f990c1094a0 2024-09-21T04:01:59.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.888+0000 7f9908ff9640 1 -- 172.21.15.46:0/448217344 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99000043c0 con 0x7f990c1094a0 2024-09-21T04:01:59.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.888+0000 7f99121bd640 1 -- 172.21.15.46:0/448217344 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f990c1a06c0 con 0x7f990c1094a0 2024-09-21T04:01:59.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.888+0000 7f9908ff9640 1 -- 172.21.15.46:0/448217344 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9900004a00 con 0x7f990c1094a0 2024-09-21T04:01:59.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.888+0000 7f99121bd640 1 -- 172.21.15.46:0/448217344 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f990c0755f0 con 0x7f990c1094a0 2024-09-21T04:01:59.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.891+0000 7f9918731740 1 Processor -- start 2024-09-21T04:01:59.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.891+0000 7f9908ff9640 1 -- 172.21.15.46:0/448217344 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f99000079b0 con 0x7f990c1094a0 2024-09-21T04:01:59.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.891+0000 7f9918731740 1 -- start start 2024-09-21T04:01:59.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.891+0000 7f9918731740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561b21b9f070 0x561b21f46650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:59.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.891+0000 7f9918731740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561b21b761b0 0x561b21f46b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:59.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.891+0000 7f9918731740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b21b7e390 0x561b21f470d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:59.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.891+0000 7f9918731740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x561b21ebce50 con 0x561b21b761b0 2024-09-21T04:01:59.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.891+0000 7f9918731740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x561b21eac280 con 0x561b21b9f070 2024-09-21T04:01:59.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.891+0000 7f9918731740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561b21eb0090 con 0x561b21b7e390 2024-09-21T04:01:59.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.892+0000 7f990b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561b21b761b0 0x561b21f46b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:59.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.892+0000 7f990bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561b21b9f070 0x561b21f46650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:59.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.892+0000 7f990b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561b21b761b0 0x561b21f46b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34374/0 (socket says 172.21.15.46:34374) 2024-09-21T04:01:59.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.892+0000 7f990affd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b21b7e390 0x561b21f470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:59.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.892+0000 7f990b7fe640 1 -- 172.21.15.46:0/1603230588 learned_addr learned my addr 172.21.15.46:0/1603230588 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:59.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.892+0000 7f990b7fe640 1 -- 172.21.15.46:0/1603230588 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b21b7e390 msgr2=0x561b21f470d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:59.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.892+0000 7f990b7fe640 1 --2- 172.21.15.46:0/1603230588 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b21b7e390 0x561b21f470d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.892+0000 7f990b7fe640 1 -- 172.21.15.46:0/1603230588 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561b21b9f070 msgr2=0x561b21f46650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:59.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.892+0000 7f990b7fe640 1 --2- 172.21.15.46:0/1603230588 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561b21b9f070 0x561b21f46650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.892+0000 7f990b7fe640 1 -- 172.21.15.46:0/1603230588 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b21c0a650 con 0x561b21b761b0 2024-09-21T04:01:59.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.892+0000 7f9908ff9640 1 --2- 172.21.15.46:0/448217344 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f98f40bab40 0x7f98f40bd050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:59.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.892+0000 7f990b7fe640 1 --2- 172.21.15.46:0/1603230588 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561b21b761b0 0x561b21f46b90 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f98fc0096c0 tx=0x7f98fc031e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4d74d9232f1cea9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:59.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.892+0000 7f990bfff640 1 --2- 172.21.15.46:0/448217344 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f98f40bab40 0x7f98f40bd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:59.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.892+0000 7f9908ff9640 1 -- 172.21.15.46:0/448217344 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f99000e73e0 con 0x7f990c1094a0 2024-09-21T04:01:59.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.893+0000 7f98f1ffb640 1 -- 172.21.15.46:0/1603230588 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc03f070 con 0x561b21b761b0 2024-09-21T04:01:59.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.893+0000 7f98f1ffb640 1 -- 172.21.15.46:0/1603230588 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98fc0316a0 con 0x561b21b761b0 2024-09-21T04:01:59.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.893+0000 7f98f1ffb640 1 -- 172.21.15.46:0/1603230588 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc035070 con 0x561b21b761b0 2024-09-21T04:01:59.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.893+0000 7f9918731740 1 -- 172.21.15.46:0/1603230588 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561b21b761b0 msgr2=0x561b21f46b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:59.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.893+0000 7f990bfff640 1 --2- 172.21.15.46:0/448217344 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f98f40bab40 0x7f98f40bd050 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9904007e50 tx=0x7f9904007600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:59.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.893+0000 7f9918731740 1 --2- 172.21.15.46:0/1603230588 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561b21b761b0 0x561b21f46b90 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f98fc0096c0 tx=0x7f98fc031e60 comp rx=0 tx=0).stop 2024-09-21T04:01:59.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.894+0000 7f9918731740 1 -- 172.21.15.46:0/1603230588 shutdown_connections 2024-09-21T04:01:59.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.894+0000 7f9918731740 1 --2- 172.21.15.46:0/1603230588 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b21b7e390 0x561b21f470d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.894+0000 7f9918731740 1 --2- 172.21.15.46:0/1603230588 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561b21b761b0 0x561b21f46b90 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.894+0000 7f9918731740 1 --2- 172.21.15.46:0/1603230588 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561b21b9f070 0x561b21f46650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.894+0000 7f9918731740 1 -- 172.21.15.46:0/1603230588 >> 172.21.15.46:0/1603230588 conn(0x561b21b93460 msgr2=0x561b21f44540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:59.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.894+0000 7f9918731740 1 -- 172.21.15.46:0/1603230588 shutdown_connections 2024-09-21T04:01:59.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.894+0000 7f9918731740 1 -- 172.21.15.46:0/1603230588 wait complete. 2024-09-21T04:01:59.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.894+0000 7f9918731740 1 -- start start 2024-09-21T04:01:59.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.894+0000 7f9918731740 1 Processor -- start 2024-09-21T04:01:59.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.895+0000 7f9918731740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b21b761b0 0x561b21f51cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:59.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.895+0000 7f9918731740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561b21b7e390 0x561b21f521f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:59.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.895+0000 7f9918731740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561b21b9f070 0x561b21f52730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:59.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.895+0000 7f9918731740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x561b21d0d700 con 0x561b21b9f070 2024-09-21T04:01:59.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.895+0000 7f9918731740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x561b21e47110 con 0x561b21b7e390 2024-09-21T04:01:59.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.895+0000 7f9918731740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561b21f54dd0 con 0x561b21b761b0 2024-09-21T04:01:59.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.895+0000 7f9918731740 10 client.0 _ll_register_callbacks cb 0x561b21e60990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:01:59.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.895+0000 7f990bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561b21b9f070 0x561b21f52730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:59.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.895+0000 7f990bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561b21b9f070 0x561b21f52730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34388/0 (socket says 172.21.15.46:34388) 2024-09-21T04:01:59.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.895+0000 7f990bfff640 1 -- 172.21.15.46:0/3146150817 learned_addr learned my addr 172.21.15.46:0/3146150817 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:59.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.895+0000 7f990affd640 1 --2- 172.21.15.46:0/3146150817 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561b21b7e390 0x561b21f521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:59.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.895+0000 7f990b7fe640 1 --2- 172.21.15.46:0/3146150817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b21b761b0 0x561b21f51cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:59.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.895+0000 7f990bfff640 1 -- 172.21.15.46:0/3146150817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b21b761b0 msgr2=0x561b21f51cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:59.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.895+0000 7f990bfff640 1 --2- 172.21.15.46:0/3146150817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b21b761b0 0x561b21f51cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.895+0000 7f990bfff640 1 -- 172.21.15.46:0/3146150817 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561b21b7e390 msgr2=0x561b21f521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:59.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.895+0000 7f990bfff640 1 --2- 172.21.15.46:0/3146150817 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561b21b7e390 0x561b21f521f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.895+0000 7f990bfff640 1 -- 172.21.15.46:0/3146150817 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b21e74c40 con 0x561b21b9f070 2024-09-21T04:01:59.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.895+0000 7f990affd640 1 --2- 172.21.15.46:0/3146150817 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561b21b7e390 0x561b21f521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:01:59.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.896+0000 7f990bfff640 1 --2- 172.21.15.46:0/3146150817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561b21b9f070 0x561b21f52730 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f99040075d0 tx=0x7f9904004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad43af49b86300f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:59.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.896+0000 7f98eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:01:59.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.896+0000 7f98eaffd640 1 -- 172.21.15.46:0/3146150817 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f990400ee60 con 0x561b21b9f070 2024-09-21T04:01:59.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.896+0000 7f9918731740 1 -- 172.21.15.46:0/3146150817 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98fc0316a0 con 0x561b21b9f070 2024-09-21T04:01:59.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.896+0000 7f98eaffd640 1 -- 172.21.15.46:0/3146150817 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f990401cd30 con 0x561b21b9f070 2024-09-21T04:01:59.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.896+0000 7f98eaffd640 1 -- 172.21.15.46:0/3146150817 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f990402d020 con 0x561b21b9f070 2024-09-21T04:01:59.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.896+0000 7f9918731740 10 client.16467 fetch_fsmap learned FSMap version 20 2024-09-21T04:01:59.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.896+0000 7f9918731740 1 -- 172.21.15.46:0/3146150817 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x561b21f60a80 con 0x561b21b9f070 2024-09-21T04:01:59.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.896+0000 7f98eaffd640 1 -- 172.21.15.46:0/3146150817 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98fc0316a0 con 0x561b21b9f070 2024-09-21T04:01:59.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.896+0000 7f98eaffd640 1 -- 172.21.15.46:0/3146150817 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f9904032660 con 0x561b21b9f070 2024-09-21T04:01:59.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.897+0000 7f9918731740 10 client.16467 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:01:59.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.897+0000 7f9918731740 10 client.16467 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:01:59.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.897+0000 7f9918731740 20 client.16467 populate_metadata read hostname 'smithi046' 2024-09-21T04:01:59.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.897+0000 7f9918731740 1 --2- 172.21.15.46:0/3146150817 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x561b21b5d9f0 0x561b21f63f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:59.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.897+0000 7f9918731740 4 client.16467 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:01:59.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.897+0000 7f9918731740 1 -- 172.21.15.46:0/3146150817 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b21ebeda0 con 0x561b21b5d9f0 2024-09-21T04:01:59.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.897+0000 7f990b7fe640 1 --2- 172.21.15.46:0/3146150817 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x561b21b5d9f0 0x561b21f63f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:59.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.897+0000 7f98eaffd640 10 client.16467 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:01:59.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.897+0000 7f990b7fe640 1 --2- 172.21.15.46:0/3146150817 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x561b21b5d9f0 0x561b21f63f80 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ac1f4d5bc5c0e06 server_cookie=b83760789662567b in_seq=0 out_seq=0 2024-09-21T04:01:59.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.898+0000 7f98eaffd640 1 -- 172.21.15.46:0/3146150817 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561b21ebeda0 con 0x561b21b5d9f0 2024-09-21T04:01:59.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.898+0000 7f98eaffd640 10 client.16467 handle_command_reply: tid=0 2024-09-21T04:01:59.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.898+0000 7f9918731740 1 client.16467 shutdown 2024-09-21T04:01:59.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.898+0000 7f9918731740 1 -- 172.21.15.46:0/3146150817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561b21b9f070 msgr2=0x561b21f52730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:59.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.898+0000 7f9918731740 1 --2- 172.21.15.46:0/3146150817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561b21b9f070 0x561b21f52730 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f99040075d0 tx=0x7f9904004a40 comp rx=0 tx=0).stop 2024-09-21T04:01:59.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.898+0000 7f9918731740 1 -- 172.21.15.46:0/3146150817 shutdown_connections 2024-09-21T04:01:59.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.898+0000 7f9918731740 1 --2- 172.21.15.46:0/3146150817 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x561b21b5d9f0 0x561b21f63f80 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.898+0000 7f9918731740 1 --2- 172.21.15.46:0/3146150817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561b21b9f070 0x561b21f52730 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.898+0000 7f9918731740 1 --2- 172.21.15.46:0/3146150817 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561b21b7e390 0x561b21f521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.898+0000 7f9918731740 1 --2- 172.21.15.46:0/3146150817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b21b761b0 0x561b21f51cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.898+0000 7f9918731740 1 -- 172.21.15.46:0/3146150817 >> 172.21.15.46:0/3146150817 conn(0x561b21b93460 msgr2=0x561b21f49830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:59.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.898+0000 7f98eaffd640 0 client.16467 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:01:59.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.899+0000 7f9918731740 1 -- 172.21.15.46:0/3146150817 shutdown_connections 2024-09-21T04:01:59.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.899+0000 7f9918731740 1 -- 172.21.15.46:0/3146150817 wait complete. 2024-09-21T04:01:59.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.899+0000 7f9918731740 20 client.16467 trim_cache size 0 max 16384 2024-09-21T04:01:59.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.916+0000 7f9918731740 1 Processor -- start 2024-09-21T04:01:59.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.916+0000 7f9918731740 1 -- start start 2024-09-21T04:01:59.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.916+0000 7f9918731740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561b21b761b0 0x561b21f48150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:59.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.916+0000 7f9918731740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561b21b7e390 0x561b21f53b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:59.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.916+0000 7f9918731740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b21b9f070 0x561b21f5dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:59.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.916+0000 7f9918731740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f990c1ab290 con 0x561b21b7e390 2024-09-21T04:01:59.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.916+0000 7f9918731740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f990c1adb10 con 0x561b21b761b0 2024-09-21T04:01:59.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.916+0000 7f9918731740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f990c1ab900 con 0x561b21b9f070 2024-09-21T04:01:59.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.917+0000 7f990affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561b21b7e390 0x561b21f53b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:59.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.917+0000 7f990affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561b21b7e390 0x561b21f53b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34396/0 (socket says 172.21.15.46:34396) 2024-09-21T04:01:59.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.917+0000 7f990affd640 1 -- 172.21.15.46:0/3717360201 learned_addr learned my addr 172.21.15.46:0/3717360201 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:59.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.917+0000 7f990bfff640 1 --2- 172.21.15.46:0/3717360201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b21b9f070 0x561b21f5dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:59.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.917+0000 7f990b7fe640 1 --2- 172.21.15.46:0/3717360201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561b21b761b0 0x561b21f48150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:59.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.917+0000 7f990affd640 1 -- 172.21.15.46:0/3717360201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b21b9f070 msgr2=0x561b21f5dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:59.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.917+0000 7f990affd640 1 --2- 172.21.15.46:0/3717360201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b21b9f070 0x561b21f5dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.917+0000 7f990affd640 1 -- 172.21.15.46:0/3717360201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561b21b761b0 msgr2=0x561b21f48150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:59.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.917+0000 7f990affd640 1 --2- 172.21.15.46:0/3717360201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561b21b761b0 0x561b21f48150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.917+0000 7f990affd640 1 -- 172.21.15.46:0/3717360201 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b21b5dc20 con 0x561b21b7e390 2024-09-21T04:01:59.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.917+0000 7f990b7fe640 1 --2- 172.21.15.46:0/3717360201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561b21b761b0 0x561b21f48150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:01:59.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.917+0000 7f990affd640 1 --2- 172.21.15.46:0/3717360201 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561b21b7e390 0x561b21f53b90 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f99000aa540 tx=0x7f99000eaed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d74a4fd1c256f607 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:59.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.917+0000 7f98f17fa640 1 -- 172.21.15.46:0/3717360201 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f990001d040 con 0x561b21b7e390 2024-09-21T04:01:59.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.917+0000 7f98f17fa640 1 -- 172.21.15.46:0/3717360201 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99000056a0 con 0x561b21b7e390 2024-09-21T04:01:59.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.917+0000 7f98f17fa640 1 -- 172.21.15.46:0/3717360201 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99000b1db0 con 0x561b21b7e390 2024-09-21T04:01:59.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.918+0000 7f9918731740 1 -- 172.21.15.46:0/3717360201 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561b21b7e390 msgr2=0x561b21f53b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:59.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.918+0000 7f9918731740 1 --2- 172.21.15.46:0/3717360201 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561b21b7e390 0x561b21f53b90 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f99000aa540 tx=0x7f99000eaed0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.918+0000 7f9918731740 1 -- 172.21.15.46:0/3717360201 shutdown_connections 2024-09-21T04:01:59.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.918+0000 7f9918731740 1 --2- 172.21.15.46:0/3717360201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b21b9f070 0x561b21f5dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.918+0000 7f9918731740 1 --2- 172.21.15.46:0/3717360201 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561b21b7e390 0x561b21f53b90 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.918+0000 7f9918731740 1 --2- 172.21.15.46:0/3717360201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561b21b761b0 0x561b21f48150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.918+0000 7f9918731740 1 -- 172.21.15.46:0/3717360201 >> 172.21.15.46:0/3717360201 conn(0x561b21b93460 msgr2=0x561b21f49750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:59.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.918+0000 7f9918731740 1 -- 172.21.15.46:0/3717360201 shutdown_connections 2024-09-21T04:01:59.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.918+0000 7f9918731740 1 -- 172.21.15.46:0/3717360201 wait complete. 2024-09-21T04:01:59.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.918+0000 7f9918731740 1 -- start start 2024-09-21T04:01:59.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.919+0000 7f9918731740 1 Processor -- start 2024-09-21T04:01:59.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.919+0000 7f9918731740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561b21b761b0 0x561b21f5a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:59.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.919+0000 7f9918731740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b21b7e390 0x561b21f55be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:59.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.919+0000 7f9918731740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561b21b9f070 0x561b21f56120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:59.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.919+0000 7f9918731740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f990c1abfd0 con 0x561b21b9f070 2024-09-21T04:01:59.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.919+0000 7f9918731740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f990c1ad440 con 0x561b21b761b0 2024-09-21T04:01:59.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.919+0000 7f9918731740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f990c1ac6a0 con 0x561b21b7e390 2024-09-21T04:01:59.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.919+0000 7f9918731740 10 client.0 _ll_register_callbacks cb 0x7f9904007840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:01:59.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.919+0000 7f990bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561b21b9f070 0x561b21f56120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:59.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.919+0000 7f990bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561b21b9f070 0x561b21f56120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34398/0 (socket says 172.21.15.46:34398) 2024-09-21T04:01:59.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.919+0000 7f990bfff640 1 -- 172.21.15.46:0/171669716 learned_addr learned my addr 172.21.15.46:0/171669716 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:01:59.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.919+0000 7f990b7fe640 1 --2- 172.21.15.46:0/171669716 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561b21b761b0 0x561b21f5a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:59.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.919+0000 7f990affd640 1 --2- 172.21.15.46:0/171669716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b21b7e390 0x561b21f55be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:59.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.920+0000 7f990bfff640 1 -- 172.21.15.46:0/171669716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b21b7e390 msgr2=0x561b21f55be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:59.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.920+0000 7f990bfff640 1 --2- 172.21.15.46:0/171669716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b21b7e390 0x561b21f55be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.920+0000 7f990bfff640 1 -- 172.21.15.46:0/171669716 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561b21b761b0 msgr2=0x561b21f5a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:59.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.920+0000 7f990bfff640 1 --2- 172.21.15.46:0/171669716 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561b21b761b0 0x561b21f5a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.920+0000 7f990bfff640 1 -- 172.21.15.46:0/171669716 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b21f56810 con 0x561b21b9f070 2024-09-21T04:01:59.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.920+0000 7f990b7fe640 1 --2- 172.21.15.46:0/171669716 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561b21b761b0 0x561b21f5a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:01:59.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.920+0000 7f990bfff640 1 --2- 172.21.15.46:0/171669716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561b21b9f070 0x561b21f56120 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f9904016040 tx=0x7f9904004d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd5326da474e05 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:59.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.920+0000 7f98eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:01:59.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.920+0000 7f98eaffd640 1 -- 172.21.15.46:0/171669716 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9904038040 con 0x561b21b9f070 2024-09-21T04:01:59.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.920+0000 7f98eaffd640 1 -- 172.21.15.46:0/171669716 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f9904032630 con 0x561b21b9f070 2024-09-21T04:01:59.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.920+0000 7f9918731740 1 -- 172.21.15.46:0/171669716 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99000056a0 con 0x561b21b9f070 2024-09-21T04:01:59.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.920+0000 7f98eaffd640 1 -- 172.21.15.46:0/171669716 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f990400ee60 con 0x561b21b9f070 2024-09-21T04:01:59.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.920+0000 7f9918731740 10 client.16473 fetch_fsmap learned FSMap version 20 2024-09-21T04:01:59.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.920+0000 7f9918731740 1 -- 172.21.15.46:0/171669716 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x561b21fce7f0 con 0x561b21b9f070 2024-09-21T04:01:59.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.921+0000 7f98eaffd640 1 -- 172.21.15.46:0/171669716 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99000056a0 con 0x561b21b9f070 2024-09-21T04:01:59.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.921+0000 7f98eaffd640 1 -- 172.21.15.46:0/171669716 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f9904046030 con 0x561b21b9f070 2024-09-21T04:01:59.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.921+0000 7f9918731740 10 client.16473 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:01:59.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.921+0000 7f9918731740 10 client.16473 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:01:59.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.921+0000 7f9918731740 20 client.16473 populate_metadata read hostname 'smithi046' 2024-09-21T04:01:59.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.921+0000 7f9918731740 1 --2- 172.21.15.46:0/171669716 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x561b21b32da0 0x561b21fd1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:59.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.921+0000 7f9918731740 4 client.16473 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T04:01:59.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.921+0000 7f9918731740 1 -- 172.21.15.46:0/171669716 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561b21eba850 con 0x561b21b32da0 2024-09-21T04:01:59.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.921+0000 7f990b7fe640 1 --2- 172.21.15.46:0/171669716 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x561b21b32da0 0x561b21fd1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:59.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.921+0000 7f990b7fe640 1 --2- 172.21.15.46:0/171669716 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x561b21b32da0 0x561b21fd1030 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=326f2036f19c2bee server_cookie=ff5cfd4e6686498 in_seq=0 out_seq=0 2024-09-21T04:01:59.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.921+0000 7f98eaffd640 10 client.16473 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:01:59.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.922+0000 7f98eaffd640 1 -- 172.21.15.46:0/171669716 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4262 (crc 0 0 0) 0x561b21eba850 con 0x561b21b32da0 2024-09-21T04:01:59.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.922+0000 7f98eaffd640 10 client.16473 handle_command_reply: tid=0 2024-09-21T04:01:59.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.922+0000 7f9918731740 1 client.16473 shutdown 2024-09-21T04:01:59.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.922+0000 7f9918731740 1 -- 172.21.15.46:0/171669716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561b21b9f070 msgr2=0x561b21f56120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:59.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.922+0000 7f9918731740 1 --2- 172.21.15.46:0/171669716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561b21b9f070 0x561b21f56120 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f9904016040 tx=0x7f9904004d40 comp rx=0 tx=0).stop 2024-09-21T04:01:59.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.922+0000 7f9918731740 1 -- 172.21.15.46:0/171669716 shutdown_connections 2024-09-21T04:01:59.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.922+0000 7f9918731740 1 --2- 172.21.15.46:0/171669716 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x561b21b32da0 0x561b21fd1030 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.922+0000 7f9918731740 1 --2- 172.21.15.46:0/171669716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561b21b9f070 0x561b21f56120 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.922+0000 7f9918731740 1 --2- 172.21.15.46:0/171669716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561b21b7e390 0x561b21f55be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.922+0000 7f98eaffd640 0 client.16473 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:01:59.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.922+0000 7f9918731740 1 --2- 172.21.15.46:0/171669716 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561b21b761b0 0x561b21f5a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.922+0000 7f9918731740 1 -- 172.21.15.46:0/171669716 >> 172.21.15.46:0/171669716 conn(0x561b21b93460 msgr2=0x561b21f4a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:59.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.922+0000 7f9918731740 1 -- 172.21.15.46:0/171669716 shutdown_connections 2024-09-21T04:01:59.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.922+0000 7f9918731740 1 -- 172.21.15.46:0/171669716 wait complete. 2024-09-21T04:01:59.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.922+0000 7f9918731740 20 client.16473 trim_cache size 0 max 16384 2024-09-21T04:01:59.930 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T04:01:59.930 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T04:01:59.930 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2024-09-21T04:01:59.930 INFO:teuthology.orchestra.run.smithi046.stdout: "7a3afabe-6b27-4bce-928a-8c6773a85803": { 2024-09-21T04:01:59.930 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:59.930 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "7a3afabe-6b27-4bce-928a-8c6773a85803", 2024-09-21T04:01:59.930 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2024-09-21T04:01:59.930 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:01:59.930 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:59.930 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_stats": { 2024-09-21T04:01:59.930 INFO:teuthology.orchestra.run.smithi046.stdout: "7a3afabe-6b27-4bce-928a-8c6773a85803": { 2024-09-21T04:01:59.930 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:01:58.413358+0000", 2024-09-21T04:01:59.931 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:59.931 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:59.931 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:59.931 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:59.931 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:59.931 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:59.931 INFO:teuthology.orchestra.run.smithi046.stdout: "08f0c962-df1a-4129-a1a2-b916240d9803": { 2024-09-21T04:01:59.931 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:02.937596+0000", 2024-09-21T04:01:59.931 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:59.931 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:59.931 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:59.931 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:59.931 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:59.932 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:59.932 INFO:teuthology.orchestra.run.smithi046.stdout: "d49f33a7-3d5a-421b-94ba-8b19a4120db1": { 2024-09-21T04:01:59.932 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:50.480786+0000", 2024-09-21T04:01:59.932 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:59.932 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:59.932 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:59.932 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:59.932 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:59.932 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:59.932 INFO:teuthology.orchestra.run.smithi046.stdout: "a871f724-0198-493c-b03e-b2de78aba243": { 2024-09-21T04:01:59.932 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:56:30.082991+0000", 2024-09-21T04:01:59.932 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:59.932 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:59.932 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:59.933 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:59.933 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:59.933 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:59.933 INFO:teuthology.orchestra.run.smithi046.stdout: "edc4b8c7-b702-489d-a925-ae7ad0ff0d9a": { 2024-09-21T04:01:59.933 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:00:40.181950+0000", 2024-09-21T04:01:59.933 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:59.933 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:59.933 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:59.933 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:59.933 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:59.933 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:59.933 INFO:teuthology.orchestra.run.smithi046.stdout: "3bbf7097-70d7-4743-bbce-41465502b35b": { 2024-09-21T04:01:59.933 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:10.661441+0000", 2024-09-21T04:01:59.934 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:59.934 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:59.934 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:59.934 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:59.934 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:59.934 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:59.934 INFO:teuthology.orchestra.run.smithi046.stdout: "e24ec8f1-0d13-478f-9c2c-b51798868ffc": { 2024-09-21T04:01:59.934 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:09.736194+0000", 2024-09-21T04:01:59.934 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:59.934 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:59.934 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:59.934 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:59.934 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:59.935 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:59.935 INFO:teuthology.orchestra.run.smithi046.stdout: "c47f458a-de5e-4952-a575-a81261953667": { 2024-09-21T04:01:59.935 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:48.699411+0000", 2024-09-21T04:01:59.935 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:59.935 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:59.935 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:59.935 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:59.935 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:59.935 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:59.935 INFO:teuthology.orchestra.run.smithi046.stdout: "6103c660-8e77-4b06-ad6c-bb322c26035a": { 2024-09-21T04:01:59.935 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:35.594467+0000", 2024-09-21T04:01:59.935 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:59.935 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:59.935 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:59.936 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:59.936 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:59.936 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:59.936 INFO:teuthology.orchestra.run.smithi046.stdout: "46bb5415-6e16-47c6-a1e4-55f9c623ce90": { 2024-09-21T04:01:59.936 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:14.950674+0000", 2024-09-21T04:01:59.936 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:59.936 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:59.936 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:59.936 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:59.936 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:59.936 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:59.936 INFO:teuthology.orchestra.run.smithi046.stdout: "326aaecf-f38a-4946-988a-d83f25556995": { 2024-09-21T04:01:59.936 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:54.189884+0000", 2024-09-21T04:01:59.937 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:59.937 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:59.937 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:59.937 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:59.937 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:59.937 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:59.937 INFO:teuthology.orchestra.run.smithi046.stdout: "dab67652-8894-4711-be64-cbdfea27a9ba": { 2024-09-21T04:01:59.937 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:28.161616+0000", 2024-09-21T04:01:59.937 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:59.937 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:59.937 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:59.937 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:59.937 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:59.937 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:59.938 INFO:teuthology.orchestra.run.smithi046.stdout: "0d781b95-cf5e-46f2-9875-2923181385e2": { 2024-09-21T04:01:59.938 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:00:33.099094+0000", 2024-09-21T04:01:59.938 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:59.938 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:59.938 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:59.938 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:59.938 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:59.938 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:01:59.938 INFO:teuthology.orchestra.run.smithi046.stdout: "d7634007-e881-46f7-9833-ac9bd0a3100e": { 2024-09-21T04:01:59.938 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:01:19.459151+0000", 2024-09-21T04:01:59.938 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:01:59.938 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:01:59.938 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:01:59.939 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:01:59.939 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:01:59.939 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:01:59.939 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:01:59.939 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T04:01:59.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.923+0000 7f99121bd640 1 -- 172.21.15.46:0/448217344 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f98f40bab40 msgr2=0x7f98f40bd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:59.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.923+0000 7f99121bd640 1 --2- 172.21.15.46:0/448217344 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f98f40bab40 0x7f98f40bd050 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9904007e50 tx=0x7f9904007600 comp rx=0 tx=0).stop 2024-09-21T04:01:59.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.923+0000 7f99121bd640 1 -- 172.21.15.46:0/448217344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f990c1094a0 msgr2=0x7f990c19aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:59.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.923+0000 7f99121bd640 1 --2- 172.21.15.46:0/448217344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f990c1094a0 0x7f990c19aac0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f990000c970 tx=0x7f990000ce30 comp rx=0 tx=0).stop 2024-09-21T04:01:59.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.923+0000 7f99121bd640 1 -- 172.21.15.46:0/448217344 shutdown_connections 2024-09-21T04:01:59.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.923+0000 7f99121bd640 1 --2- 172.21.15.46:0/448217344 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f98f40bab40 0x7f98f40bd050 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.923+0000 7f99121bd640 1 --2- 172.21.15.46:0/448217344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f990c109df0 0x7f990c19fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.923+0000 7f99121bd640 1 --2- 172.21.15.46:0/448217344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f990c1094a0 0x7f990c19aac0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.923+0000 7f99121bd640 1 --2- 172.21.15.46:0/448217344 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f990c103b60 0x7f990c19a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.923+0000 7f99121bd640 1 -- 172.21.15.46:0/448217344 >> 172.21.15.46:0/448217344 conn(0x7f990c07b850 msgr2=0x7f990c1075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:59.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.923+0000 7f99121bd640 1 -- 172.21.15.46:0/448217344 shutdown_connections 2024-09-21T04:01:59.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:01:59.923+0000 7f99121bd640 1 -- 172.21.15.46:0/448217344 wait complete. 2024-09-21T04:02:00.247 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:01:59 smithi046 ceph-mon[30954]: pgmap v528: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:02:00.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:01:59 smithi105 ceph-mon[34773]: pgmap v528: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:02:00.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:01:59 smithi162 ceph-mon[35071]: pgmap v528: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:02:00.684 INFO:tasks.cephfs.filesystem:scrub status for tag:7a3afabe-6b27-4bce-928a-8c6773a85803 - {'path': '/', 'tag': '7a3afabe-6b27-4bce-928a-8c6773a85803', 'options': 'recursive,force'} 2024-09-21T04:02:02.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:01 smithi046 ceph-mon[30954]: pgmap v529: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:02:02.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:01 smithi105 ceph-mon[34773]: pgmap v529: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:02:02.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:01 smithi162 ceph-mon[35071]: pgmap v529: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:02:04.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:03 smithi046 ceph-mon[30954]: pgmap v530: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T04:02:04.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:03 smithi046 ceph-mon[30954]: scrub summary: idle 2024-09-21T04:02:04.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:03 smithi105 ceph-mon[34773]: pgmap v530: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T04:02:04.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:03 smithi105 ceph-mon[34773]: scrub summary: idle 2024-09-21T04:02:04.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:03 smithi162 ceph-mon[35071]: pgmap v530: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T04:02:04.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:03 smithi162 ceph-mon[35071]: scrub summary: idle 2024-09-21T04:02:06.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:05 smithi046 ceph-mon[30954]: pgmap v531: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 20 op/s 2024-09-21T04:02:06.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:05 smithi105 ceph-mon[34773]: pgmap v531: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 20 op/s 2024-09-21T04:02:06.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:05 smithi162 ceph-mon[35071]: pgmap v531: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 20 op/s 2024-09-21T04:02:08.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:07 smithi046 ceph-mon[30954]: pgmap v532: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-21T04:02:08.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:07 smithi105 ceph-mon[34773]: pgmap v532: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-21T04:02:08.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:07 smithi162 ceph-mon[35071]: pgmap v532: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-21T04:02:10.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:09 smithi046 ceph-mon[30954]: pgmap v533: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 20 op/s 2024-09-21T04:02:10.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:09 smithi046 ceph-mon[30954]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T04:02:10.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:09 smithi105 ceph-mon[34773]: pgmap v533: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 20 op/s 2024-09-21T04:02:10.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:09 smithi105 ceph-mon[34773]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T04:02:10.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:09 smithi162 ceph-mon[35071]: pgmap v533: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 20 op/s 2024-09-21T04:02:10.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:09 smithi162 ceph-mon[35071]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T04:02:11.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:11 smithi105 ceph-mon[34773]: pgmap v535: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-21T04:02:11.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:11 smithi162 ceph-mon[35071]: pgmap v535: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-21T04:02:11.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:11 smithi046 ceph-mon[30954]: pgmap v535: 97 pgs: 97 active+clean; 14 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-21T04:02:13.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:13 smithi105 ceph-mon[34773]: pgmap v536: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 27 KiB/s wr, 5 op/s 2024-09-21T04:02:13.598 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:13 smithi046 ceph-mon[30954]: pgmap v536: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 27 KiB/s wr, 5 op/s 2024-09-21T04:02:13.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:13 smithi162 ceph-mon[35071]: pgmap v536: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 27 KiB/s wr, 5 op/s 2024-09-21T04:02:15.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:15 smithi105 ceph-mon[34773]: pgmap v537: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T04:02:15.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:15 smithi162 ceph-mon[35071]: pgmap v537: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T04:02:15.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:15 smithi046 ceph-mon[30954]: pgmap v537: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T04:02:17.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:17 smithi105 ceph-mon[34773]: pgmap v538: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T04:02:17.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:17 smithi162 ceph-mon[35071]: pgmap v538: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T04:02:17.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:17 smithi046 ceph-mon[30954]: pgmap v538: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T04:02:19.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:18 smithi105 ceph-mon[34773]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T04:02:19.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:18 smithi162 ceph-mon[35071]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T04:02:19.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:18 smithi046 ceph-mon[30954]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T04:02:20.067 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:19 smithi105 ceph-mon[34773]: pgmap v540: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 221 B/s wr, 2 op/s 2024-09-21T04:02:20.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:19 smithi162 ceph-mon[35071]: pgmap v540: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 221 B/s wr, 2 op/s 2024-09-21T04:02:20.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:19 smithi046 ceph-mon[30954]: pgmap v540: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 221 B/s wr, 2 op/s 2024-09-21T04:02:22.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:21 smithi105 ceph-mon[34773]: pgmap v541: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T04:02:22.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:21 smithi162 ceph-mon[35071]: pgmap v541: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T04:02:22.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:21 smithi046 ceph-mon[30954]: pgmap v541: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T04:02:24.097 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:23 smithi046 ceph-mon[30954]: pgmap v542: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T04:02:24.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:23 smithi162 ceph-mon[35071]: pgmap v542: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T04:02:24.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:23 smithi105 ceph-mon[34773]: pgmap v542: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T04:02:26.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:25 smithi162 ceph-mon[35071]: pgmap v543: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T04:02:26.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:25 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:02:26.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:25 smithi046 ceph-mon[30954]: pgmap v543: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T04:02:26.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:25 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:02:26.317 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:25 smithi105 ceph-mon[34773]: pgmap v543: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T04:02:26.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:25 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:02:27.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:26 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:26 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:26 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:26 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:26 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:26 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:26 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:26 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:26 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:26 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:26 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:26 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:26 smithi162 ceph-mon[35071]: Adjusting osd_memory_target on smithi105 to 176.0M 2024-09-21T04:02:27.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:26 smithi162 ceph-mon[35071]: Adjusting osd_memory_target on smithi046 to 177.0M 2024-09-21T04:02:27.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:26 smithi162 ceph-mon[35071]: Adjusting osd_memory_target on smithi162 to 176.0M 2024-09-21T04:02:27.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:26 smithi162 ceph-mon[35071]: Unable to set osd_memory_target on smithi105 to 184588185: error parsing value: Value '184588185' is below minimum 939524096 2024-09-21T04:02:27.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:26 smithi162 ceph-mon[35071]: Unable to set osd_memory_target on smithi046 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-21T04:02:27.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:26 smithi162 ceph-mon[35071]: Unable to set osd_memory_target on smithi162 to 184593203: error parsing value: Value '184593203' is below minimum 939524096 2024-09-21T04:02:27.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:26 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:02:27.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:26 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:02:27.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:26 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:02:27.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:26 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:26 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:26 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:26 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:26 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:26 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:26 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:26 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:26 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.254 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:26 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.254 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:26 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.254 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:26 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.254 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:26 smithi046 ceph-mon[30954]: Adjusting osd_memory_target on smithi105 to 176.0M 2024-09-21T04:02:27.254 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:26 smithi046 ceph-mon[30954]: Adjusting osd_memory_target on smithi046 to 177.0M 2024-09-21T04:02:27.254 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:26 smithi046 ceph-mon[30954]: Adjusting osd_memory_target on smithi162 to 176.0M 2024-09-21T04:02:27.254 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:26 smithi046 ceph-mon[30954]: Unable to set osd_memory_target on smithi105 to 184588185: error parsing value: Value '184588185' is below minimum 939524096 2024-09-21T04:02:27.254 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:26 smithi046 ceph-mon[30954]: Unable to set osd_memory_target on smithi046 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-21T04:02:27.254 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:26 smithi046 ceph-mon[30954]: Unable to set osd_memory_target on smithi162 to 184593203: error parsing value: Value '184593203' is below minimum 939524096 2024-09-21T04:02:27.254 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:26 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:02:27.254 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:26 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:02:27.255 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:26 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:02:27.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:26 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:26 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:26 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:26 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:26 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:26 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:26 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:26 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:26 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:26 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:26 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:26 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T04:02:27.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:26 smithi105 ceph-mon[34773]: Adjusting osd_memory_target on smithi105 to 176.0M 2024-09-21T04:02:27.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:26 smithi105 ceph-mon[34773]: Adjusting osd_memory_target on smithi046 to 177.0M 2024-09-21T04:02:27.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:26 smithi105 ceph-mon[34773]: Adjusting osd_memory_target on smithi162 to 176.0M 2024-09-21T04:02:27.319 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:26 smithi105 ceph-mon[34773]: Unable to set osd_memory_target on smithi105 to 184588185: error parsing value: Value '184588185' is below minimum 939524096 2024-09-21T04:02:27.320 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:26 smithi105 ceph-mon[34773]: Unable to set osd_memory_target on smithi046 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-21T04:02:27.320 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:26 smithi105 ceph-mon[34773]: Unable to set osd_memory_target on smithi162 to 184593203: error parsing value: Value '184593203' is below minimum 939524096 2024-09-21T04:02:27.320 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:26 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:02:27.320 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:26 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:02:27.320 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:26 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:02:28.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:27 smithi046 ceph-mon[30954]: pgmap v544: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T04:02:28.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:27 smithi105 ceph-mon[34773]: pgmap v544: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T04:02:28.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:27 smithi162 ceph-mon[35071]: pgmap v544: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T04:02:30.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:29 smithi046 ceph-mon[30954]: pgmap v545: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-21T04:02:30.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:29 smithi105 ceph-mon[34773]: pgmap v545: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-21T04:02:30.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:29 smithi162 ceph-mon[35071]: pgmap v545: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-21T04:02:30.685 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T04:02:30.957 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:31.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.456+0000 7faf90cc5640 1 -- 172.21.15.46:0/2989519622 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf8c102ae0 msgr2=0x7faf8c102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:31.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.456+0000 7faf90cc5640 1 --2- 172.21.15.46:0/2989519622 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf8c102ae0 0x7faf8c102ef0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7faf7c009900 tx=0x7faf7c02a410 comp rx=0 tx=0).stop 2024-09-21T04:02:31.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.456+0000 7faf90cc5640 1 -- 172.21.15.46:0/2989519622 shutdown_connections 2024-09-21T04:02:31.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.456+0000 7faf90cc5640 1 --2- 172.21.15.46:0/2989519622 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf8c108d20 0x7faf8c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.456+0000 7faf90cc5640 1 --2- 172.21.15.46:0/2989519622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf8c1083d0 0x7faf8c1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.456+0000 7faf90cc5640 1 --2- 172.21.15.46:0/2989519622 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf8c102ae0 0x7faf8c102ef0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.456+0000 7faf90cc5640 1 -- 172.21.15.46:0/2989519622 >> 172.21.15.46:0/2989519622 conn(0x7faf8c079760 msgr2=0x7faf8c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:31.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.456+0000 7faf90cc5640 1 -- 172.21.15.46:0/2989519622 shutdown_connections 2024-09-21T04:02:31.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.456+0000 7faf90cc5640 1 -- 172.21.15.46:0/2989519622 wait complete. 2024-09-21T04:02:31.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.457+0000 7faf90cc5640 1 Processor -- start 2024-09-21T04:02:31.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.457+0000 7faf90cc5640 1 -- start start 2024-09-21T04:02:31.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.457+0000 7faf90cc5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf8c102ae0 0x7faf8c19a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:31.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.457+0000 7faf90cc5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf8c1083d0 0x7faf8c19aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:31.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.457+0000 7faf90cc5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf8c108d20 0x7faf8c19fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:31.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.457+0000 7faf90cc5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c112990 con 0x7faf8c108d20 2024-09-21T04:02:31.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.457+0000 7faf90cc5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c112810 con 0x7faf8c102ae0 2024-09-21T04:02:31.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.457+0000 7faf90cc5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c112b10 con 0x7faf8c1083d0 2024-09-21T04:02:31.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.458+0000 7faf8ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf8c108d20 0x7faf8c19fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:31.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.458+0000 7faf8ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf8c108d20 0x7faf8c19fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38394/0 (socket says 172.21.15.46:38394) 2024-09-21T04:02:31.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.458+0000 7faf8ad9d640 1 -- 172.21.15.46:0/4194794327 learned_addr learned my addr 172.21.15.46:0/4194794327 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:31.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.458+0000 7faf8a59c640 1 --2- 172.21.15.46:0/4194794327 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf8c102ae0 0x7faf8c19a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:31.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.458+0000 7faf89d9b640 1 --2- 172.21.15.46:0/4194794327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf8c1083d0 0x7faf8c19aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:31.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.458+0000 7faf8ad9d640 1 -- 172.21.15.46:0/4194794327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf8c1083d0 msgr2=0x7faf8c19aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:31.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.458+0000 7faf8ad9d640 1 --2- 172.21.15.46:0/4194794327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf8c1083d0 0x7faf8c19aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.458+0000 7faf8ad9d640 1 -- 172.21.15.46:0/4194794327 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf8c102ae0 msgr2=0x7faf8c19a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:31.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.458+0000 7faf8ad9d640 1 --2- 172.21.15.46:0/4194794327 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf8c102ae0 0x7faf8c19a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.458+0000 7faf8ad9d640 1 -- 172.21.15.46:0/4194794327 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf8c1a0320 con 0x7faf8c108d20 2024-09-21T04:02:31.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.458+0000 7faf89d9b640 1 --2- 172.21.15.46:0/4194794327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf8c1083d0 0x7faf8c19aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:02:31.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.458+0000 7faf8a59c640 1 --2- 172.21.15.46:0/4194794327 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf8c102ae0 0x7faf8c19a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:02:31.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.458+0000 7faf8ad9d640 1 --2- 172.21.15.46:0/4194794327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf8c108d20 0x7faf8c19fcb0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7faf8400cce0 tx=0x7faf8400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:31.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.458+0000 7faf7b7fe640 1 -- 172.21.15.46:0/4194794327 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf8400f450 con 0x7faf8c108d20 2024-09-21T04:02:31.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.458+0000 7faf7b7fe640 1 -- 172.21.15.46:0/4194794327 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf8400faa0 con 0x7faf8c108d20 2024-09-21T04:02:31.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.458+0000 7faf90cc5640 1 -- 172.21.15.46:0/4194794327 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf8c1a0610 con 0x7faf8c108d20 2024-09-21T04:02:31.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.458+0000 7faf7b7fe640 1 -- 172.21.15.46:0/4194794327 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf84018b70 con 0x7faf8c108d20 2024-09-21T04:02:31.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.458+0000 7faf90cc5640 1 -- 172.21.15.46:0/4194794327 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf8c1a0b00 con 0x7faf8c108d20 2024-09-21T04:02:31.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.461+0000 7faf97239740 1 Processor -- start 2024-09-21T04:02:31.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.461+0000 7faf7b7fe640 1 -- 172.21.15.46:0/4194794327 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7faf84018d10 con 0x7faf8c108d20 2024-09-21T04:02:31.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.461+0000 7faf97239740 1 -- start start 2024-09-21T04:02:31.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.462+0000 7faf97239740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557cb5e88070 0x557cb622f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:31.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.462+0000 7faf97239740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb5e5f1b0 0x557cb622f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:31.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.462+0000 7faf97239740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cb5e67390 0x557cb622fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:31.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.462+0000 7faf97239740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x557cb61a5e50 con 0x557cb5e88070 2024-09-21T04:02:31.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.462+0000 7faf97239740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x557cb6195280 con 0x557cb5e5f1b0 2024-09-21T04:02:31.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.462+0000 7faf97239740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557cb6199090 con 0x557cb5e67390 2024-09-21T04:02:31.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.462+0000 7faf89d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557cb5e88070 0x557cb622f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:31.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.462+0000 7faf89d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557cb5e88070 0x557cb622f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38398/0 (socket says 172.21.15.46:38398) 2024-09-21T04:02:31.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.462+0000 7faf89d9b640 1 -- 172.21.15.46:0/3045510434 learned_addr learned my addr 172.21.15.46:0/3045510434 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:31.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.462+0000 7faf8a59c640 1 --2- 172.21.15.46:0/3045510434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb5e5f1b0 0x557cb622f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:31.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.462+0000 7faf7b7fe640 1 --2- 172.21.15.46:0/4194794327 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7faf740b66b0 0x7faf740b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:31.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.462+0000 7faf89d9b640 1 -- 172.21.15.46:0/3045510434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cb5e67390 msgr2=0x557cb622fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:31.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.462+0000 7faf89d9b640 1 --2- 172.21.15.46:0/3045510434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cb5e67390 0x557cb622fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.462+0000 7faf89d9b640 1 -- 172.21.15.46:0/3045510434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb5e5f1b0 msgr2=0x557cb622f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:31.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.462+0000 7faf89d9b640 1 --2- 172.21.15.46:0/3045510434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb5e5f1b0 0x557cb622f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.462+0000 7faf89d9b640 1 -- 172.21.15.46:0/3045510434 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cb5ef3650 con 0x557cb5e88070 2024-09-21T04:02:31.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.462+0000 7faf8ad9d640 1 --2- 172.21.15.46:0/4194794327 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7faf740b66b0 0x7faf740b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:31.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.462+0000 7faf89d9b640 1 --2- 172.21.15.46:0/3045510434 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557cb5e88070 0x557cb622f270 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7faf80009c60 tx=0x7faf80012760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30a3dba4e8c3a1e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:31.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.462+0000 7faf7b7fe640 1 -- 172.21.15.46:0/4194794327 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7faf840e7bb0 con 0x7faf8c108d20 2024-09-21T04:02:31.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.463+0000 7faf78ff9640 1 -- 172.21.15.46:0/3045510434 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf8001b400 con 0x557cb5e88070 2024-09-21T04:02:31.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.463+0000 7faf78ff9640 1 -- 172.21.15.46:0/3045510434 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf8001ba50 con 0x557cb5e88070 2024-09-21T04:02:31.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.463+0000 7faf78ff9640 1 -- 172.21.15.46:0/3045510434 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf80013a30 con 0x557cb5e88070 2024-09-21T04:02:31.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.464+0000 7faf97239740 1 -- 172.21.15.46:0/3045510434 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557cb5e88070 msgr2=0x557cb622f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:31.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.464+0000 7faf8ad9d640 1 --2- 172.21.15.46:0/4194794327 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7faf740b66b0 0x7faf740b8bc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7faf840e5420 tx=0x7faf8407a720 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:31.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.464+0000 7faf97239740 1 --2- 172.21.15.46:0/3045510434 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557cb5e88070 0x557cb622f270 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7faf80009c60 tx=0x7faf80012760 comp rx=0 tx=0).stop 2024-09-21T04:02:31.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.464+0000 7faf97239740 1 -- 172.21.15.46:0/3045510434 shutdown_connections 2024-09-21T04:02:31.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.464+0000 7faf97239740 1 --2- 172.21.15.46:0/3045510434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cb5e67390 0x557cb622fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.464+0000 7faf97239740 1 --2- 172.21.15.46:0/3045510434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb5e5f1b0 0x557cb622f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.464+0000 7faf97239740 1 --2- 172.21.15.46:0/3045510434 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557cb5e88070 0x557cb622f270 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.464+0000 7faf97239740 1 -- 172.21.15.46:0/3045510434 >> 172.21.15.46:0/3045510434 conn(0x557cb5e7c460 msgr2=0x557cb622d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:31.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.464+0000 7faf97239740 1 -- 172.21.15.46:0/3045510434 shutdown_connections 2024-09-21T04:02:31.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.464+0000 7faf97239740 1 -- 172.21.15.46:0/3045510434 wait complete. 2024-09-21T04:02:31.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.464+0000 7faf97239740 1 -- start start 2024-09-21T04:02:31.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.464+0000 7faf97239740 1 Processor -- start 2024-09-21T04:02:31.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.465+0000 7faf97239740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb5e5f1b0 0x557cb623a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:31.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.465+0000 7faf97239740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557cb5e67390 0x557cb623aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:31.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.465+0000 7faf97239740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cb5e88070 0x557cb6246d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:31.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.465+0000 7faf97239740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x557cb5ff6700 con 0x557cb5e67390 2024-09-21T04:02:31.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.465+0000 7faf97239740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x557cb6130110 con 0x557cb5e5f1b0 2024-09-21T04:02:31.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.465+0000 7faf97239740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557cb623da50 con 0x557cb5e88070 2024-09-21T04:02:31.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.465+0000 7faf97239740 10 client.0 _ll_register_callbacks cb 0x557cb6149990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:02:31.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.465+0000 7faf8a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557cb5e67390 0x557cb623aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:31.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.465+0000 7faf8a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557cb5e67390 0x557cb623aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38402/0 (socket says 172.21.15.46:38402) 2024-09-21T04:02:31.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.465+0000 7faf8a59c640 1 -- 172.21.15.46:0/900325937 learned_addr learned my addr 172.21.15.46:0/900325937 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:31.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.465+0000 7faf89d9b640 1 --2- 172.21.15.46:0/900325937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb5e5f1b0 0x557cb623a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:31.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.465+0000 7faf89d9b640 1 --2- 172.21.15.46:0/900325937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cb5e88070 0x557cb6246d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:31.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.465+0000 7faf8a59c640 1 -- 172.21.15.46:0/900325937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cb5e88070 msgr2=0x557cb6246d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:31.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.465+0000 7faf8a59c640 1 --2- 172.21.15.46:0/900325937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cb5e88070 0x557cb6246d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.465+0000 7faf8a59c640 1 -- 172.21.15.46:0/900325937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb5e5f1b0 msgr2=0x557cb623a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:31.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.465+0000 7faf8a59c640 1 --2- 172.21.15.46:0/900325937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb5e5f1b0 0x557cb623a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.465+0000 7faf8a59c640 1 -- 172.21.15.46:0/900325937 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cb615dc40 con 0x557cb5e67390 2024-09-21T04:02:31.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.465+0000 7faf89d9b640 1 --2- 172.21.15.46:0/900325937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cb5e88070 0x557cb6246d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:02:31.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.465+0000 7faf8a59c640 1 --2- 172.21.15.46:0/900325937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557cb5e67390 0x557cb623aee0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7faf7c02a930 tx=0x7faf7c0317c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae7cd52e5164406 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:31.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.465+0000 7faf71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:02:31.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.465+0000 7faf71ffb640 1 -- 172.21.15.46:0/900325937 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c035070 con 0x557cb5e67390 2024-09-21T04:02:31.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.465+0000 7faf71ffb640 1 -- 172.21.15.46:0/900325937 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7faf7c004240 con 0x557cb5e67390 2024-09-21T04:02:31.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.465+0000 7faf97239740 1 -- 172.21.15.46:0/900325937 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf8001ba50 con 0x557cb5e67390 2024-09-21T04:02:31.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.466+0000 7faf71ffb640 1 -- 172.21.15.46:0/900325937 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7faf7c004440 con 0x557cb5e67390 2024-09-21T04:02:31.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.466+0000 7faf97239740 10 client.16485 fetch_fsmap learned FSMap version 20 2024-09-21T04:02:31.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.466+0000 7faf97239740 1 -- 172.21.15.46:0/900325937 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557cb62497e0 con 0x557cb5e67390 2024-09-21T04:02:31.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.466+0000 7faf71ffb640 1 -- 172.21.15.46:0/900325937 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf8001ba50 con 0x557cb5e67390 2024-09-21T04:02:31.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.466+0000 7faf71ffb640 1 -- 172.21.15.46:0/900325937 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7faf7c04c020 con 0x557cb5e67390 2024-09-21T04:02:31.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.466+0000 7faf97239740 10 client.16485 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:02:31.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.466+0000 7faf97239740 10 client.16485 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:02:31.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.466+0000 7faf97239740 20 client.16485 populate_metadata read hostname 'smithi046' 2024-09-21T04:02:31.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.466+0000 7faf97239740 1 --2- 172.21.15.46:0/900325937 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x557cb5e469f0 0x557cb624cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:31.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.466+0000 7faf97239740 4 client.16485 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:02:31.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.466+0000 7faf97239740 1 -- 172.21.15.46:0/900325937 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557cb61a7da0 con 0x557cb5e469f0 2024-09-21T04:02:31.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.467+0000 7faf89d9b640 1 --2- 172.21.15.46:0/900325937 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x557cb5e469f0 0x557cb624cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:31.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.467+0000 7faf71ffb640 10 client.16485 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:02:31.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.467+0000 7faf89d9b640 1 --2- 172.21.15.46:0/900325937 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x557cb5e469f0 0x557cb624cc80 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fae3685de42818a8 server_cookie=5cae60d385f59d4d in_seq=0 out_seq=0 2024-09-21T04:02:31.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.468+0000 7faf71ffb640 1 -- 172.21.15.46:0/900325937 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557cb61a7da0 con 0x557cb5e469f0 2024-09-21T04:02:31.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.468+0000 7faf71ffb640 10 client.16485 handle_command_reply: tid=0 2024-09-21T04:02:31.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.468+0000 7faf97239740 1 client.16485 shutdown 2024-09-21T04:02:31.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.468+0000 7faf97239740 1 -- 172.21.15.46:0/900325937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557cb5e67390 msgr2=0x557cb623aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:31.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.468+0000 7faf97239740 1 --2- 172.21.15.46:0/900325937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557cb5e67390 0x557cb623aee0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7faf7c02a930 tx=0x7faf7c0317c0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.468+0000 7faf97239740 1 -- 172.21.15.46:0/900325937 shutdown_connections 2024-09-21T04:02:31.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.468+0000 7faf97239740 1 --2- 172.21.15.46:0/900325937 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x557cb5e469f0 0x557cb624cc80 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.468+0000 7faf97239740 1 --2- 172.21.15.46:0/900325937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cb5e88070 0x557cb6246d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.468+0000 7faf71ffb640 0 client.16485 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:02:31.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.468+0000 7faf97239740 1 --2- 172.21.15.46:0/900325937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557cb5e67390 0x557cb623aee0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.468+0000 7faf97239740 1 --2- 172.21.15.46:0/900325937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb5e5f1b0 0x557cb623a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.468+0000 7faf97239740 1 -- 172.21.15.46:0/900325937 >> 172.21.15.46:0/900325937 conn(0x557cb5e7c460 msgr2=0x557cb6232450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:31.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.468+0000 7faf97239740 1 -- 172.21.15.46:0/900325937 shutdown_connections 2024-09-21T04:02:31.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.468+0000 7faf97239740 1 -- 172.21.15.46:0/900325937 wait complete. 2024-09-21T04:02:31.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.468+0000 7faf97239740 20 client.16485 trim_cache size 0 max 16384 2024-09-21T04:02:31.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.486+0000 7faf97239740 1 Processor -- start 2024-09-21T04:02:31.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.486+0000 7faf97239740 1 -- start start 2024-09-21T04:02:31.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.486+0000 7faf97239740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cb5e7c460 0x557cb623c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:31.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.486+0000 7faf97239740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557cb5e5f1b0 0x557cb6237b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:31.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.486+0000 7faf97239740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb5e67390 0x557cb62380d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:31.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.486+0000 7faf97239740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c1ad490 con 0x557cb5e5f1b0 2024-09-21T04:02:31.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.486+0000 7faf97239740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c1afcf0 con 0x557cb5e67390 2024-09-21T04:02:31.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.486+0000 7faf97239740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c1adae0 con 0x557cb5e7c460 2024-09-21T04:02:31.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.486+0000 7faf8a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557cb5e5f1b0 0x557cb6237b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:31.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.486+0000 7faf8a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557cb5e5f1b0 0x557cb6237b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38416/0 (socket says 172.21.15.46:38416) 2024-09-21T04:02:31.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.486+0000 7faf8a59c640 1 -- 172.21.15.46:0/373228910 learned_addr learned my addr 172.21.15.46:0/373228910 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:31.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.486+0000 7faf89d9b640 1 --2- 172.21.15.46:0/373228910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cb5e7c460 0x557cb623c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:31.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.486+0000 7faf8a59c640 1 -- 172.21.15.46:0/373228910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cb5e7c460 msgr2=0x557cb623c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:31.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.486+0000 7faf89d9b640 1 --2- 172.21.15.46:0/373228910 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb5e67390 0x557cb62380d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:31.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.486+0000 7faf8a59c640 1 --2- 172.21.15.46:0/373228910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cb5e7c460 0x557cb623c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.486+0000 7faf8a59c640 1 -- 172.21.15.46:0/373228910 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb5e67390 msgr2=0x557cb62380d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:31.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.486+0000 7faf8a59c640 1 --2- 172.21.15.46:0/373228910 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb5e67390 0x557cb62380d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.486+0000 7faf8a59c640 1 -- 172.21.15.46:0/373228910 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cb6231790 con 0x557cb5e5f1b0 2024-09-21T04:02:31.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.486+0000 7faf89d9b640 1 --2- 172.21.15.46:0/373228910 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb5e67390 0x557cb62380d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:02:31.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.487+0000 7faf8a59c640 1 --2- 172.21.15.46:0/373228910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557cb5e5f1b0 0x557cb6237b90 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7faf7c031a70 tx=0x7faf7c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac89470f1f0df581 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:31.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.487+0000 7faf73fff640 1 -- 172.21.15.46:0/373228910 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c000e60 con 0x557cb5e5f1b0 2024-09-21T04:02:31.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.487+0000 7faf73fff640 1 -- 172.21.15.46:0/373228910 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf7c053020 con 0x557cb5e5f1b0 2024-09-21T04:02:31.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.487+0000 7faf73fff640 1 -- 172.21.15.46:0/373228910 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c035070 con 0x557cb5e5f1b0 2024-09-21T04:02:31.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.488+0000 7faf97239740 1 -- 172.21.15.46:0/373228910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557cb5e5f1b0 msgr2=0x557cb6237b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:31.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.488+0000 7faf97239740 1 --2- 172.21.15.46:0/373228910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557cb5e5f1b0 0x557cb6237b90 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7faf7c031a70 tx=0x7faf7c000bc0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.488+0000 7faf97239740 1 -- 172.21.15.46:0/373228910 shutdown_connections 2024-09-21T04:02:31.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.488+0000 7faf97239740 1 --2- 172.21.15.46:0/373228910 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb5e67390 0x557cb62380d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.488+0000 7faf97239740 1 --2- 172.21.15.46:0/373228910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557cb5e5f1b0 0x557cb6237b90 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.488+0000 7faf97239740 1 --2- 172.21.15.46:0/373228910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cb5e7c460 0x557cb623c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.488+0000 7faf97239740 1 -- 172.21.15.46:0/373228910 >> 172.21.15.46:0/373228910 conn(0x557cb623b060 msgr2=0x557cb623bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:31.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.488+0000 7faf97239740 1 -- 172.21.15.46:0/373228910 shutdown_connections 2024-09-21T04:02:31.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.488+0000 7faf97239740 1 -- 172.21.15.46:0/373228910 wait complete. 2024-09-21T04:02:31.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.488+0000 7faf97239740 1 -- start start 2024-09-21T04:02:31.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.488+0000 7faf97239740 1 Processor -- start 2024-09-21T04:02:31.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.488+0000 7faf97239740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557cb5e5f1b0 0x557cb6240ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:31.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.488+0000 7faf97239740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cb5e67390 0x557cb62413e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:31.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.488+0000 7faf97239740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb5e7c460 0x557cb6241920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:31.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.488+0000 7faf97239740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c1ae1b0 con 0x557cb5e5f1b0 2024-09-21T04:02:31.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.488+0000 7faf97239740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c1af620 con 0x557cb5e7c460 2024-09-21T04:02:31.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.488+0000 7faf97239740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c1ae880 con 0x557cb5e67390 2024-09-21T04:02:31.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.489+0000 7faf97239740 10 client.0 _ll_register_callbacks cb 0x7faf80005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:02:31.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.489+0000 7faf89d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557cb5e5f1b0 0x557cb6240ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:31.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.489+0000 7faf89d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557cb5e5f1b0 0x557cb6240ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38432/0 (socket says 172.21.15.46:38432) 2024-09-21T04:02:31.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.489+0000 7faf89d9b640 1 -- 172.21.15.46:0/2752731331 learned_addr learned my addr 172.21.15.46:0/2752731331 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:31.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.489+0000 7faf8a59c640 1 --2- 172.21.15.46:0/2752731331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cb5e67390 0x557cb62413e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:31.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.489+0000 7faf89d9b640 1 --2- 172.21.15.46:0/2752731331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb5e7c460 0x557cb6241920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:31.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.489+0000 7faf89d9b640 1 -- 172.21.15.46:0/2752731331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cb5e67390 msgr2=0x557cb62413e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:31.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.489+0000 7faf89d9b640 1 --2- 172.21.15.46:0/2752731331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cb5e67390 0x557cb62413e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.489+0000 7faf89d9b640 1 -- 172.21.15.46:0/2752731331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb5e7c460 msgr2=0x557cb6241920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:31.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.489+0000 7faf89d9b640 1 --2- 172.21.15.46:0/2752731331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb5e7c460 0x557cb6241920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.489+0000 7faf89d9b640 1 -- 172.21.15.46:0/2752731331 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cb62b6850 con 0x557cb5e5f1b0 2024-09-21T04:02:31.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.489+0000 7faf89d9b640 1 --2- 172.21.15.46:0/2752731331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557cb5e5f1b0 0x557cb6240ea0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7faf8001d010 tx=0x7faf7c005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d277092dc2c93e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:31.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.489+0000 7faf71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:02:31.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.489+0000 7faf71ffb640 1 -- 172.21.15.46:0/2752731331 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf80005450 con 0x557cb5e5f1b0 2024-09-21T04:02:31.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.489+0000 7faf71ffb640 1 -- 172.21.15.46:0/2752731331 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7faf8001b400 con 0x557cb5e5f1b0 2024-09-21T04:02:31.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.489+0000 7faf97239740 1 -- 172.21.15.46:0/2752731331 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf7c053020 con 0x557cb5e5f1b0 2024-09-21T04:02:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.490+0000 7faf71ffb640 1 -- 172.21.15.46:0/2752731331 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7faf8001b600 con 0x557cb5e5f1b0 2024-09-21T04:02:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.490+0000 7faf97239740 10 client.16491 fetch_fsmap learned FSMap version 20 2024-09-21T04:02:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.490+0000 7faf97239740 1 -- 172.21.15.46:0/2752731331 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557cb62b7a80 con 0x557cb5e5f1b0 2024-09-21T04:02:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.490+0000 7faf71ffb640 1 -- 172.21.15.46:0/2752731331 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf7c053020 con 0x557cb5e5f1b0 2024-09-21T04:02:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.490+0000 7faf71ffb640 1 -- 172.21.15.46:0/2752731331 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7faf80031040 con 0x557cb5e5f1b0 2024-09-21T04:02:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.490+0000 7faf97239740 10 client.16491 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:02:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.490+0000 7faf97239740 10 client.16491 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:02:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.490+0000 7faf97239740 20 client.16491 populate_metadata read hostname 'smithi046' 2024-09-21T04:02:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.490+0000 7faf97239740 1 --2- 172.21.15.46:0/2752731331 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x557cb5e88070 0x557cb62b9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.490+0000 7faf97239740 4 client.16491 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T04:02:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.490+0000 7faf97239740 1 -- 172.21.15.46:0/2752731331 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557cb61a3850 con 0x557cb5e88070 2024-09-21T04:02:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.490+0000 7faf8a59c640 1 --2- 172.21.15.46:0/2752731331 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x557cb5e88070 0x557cb62b9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.491+0000 7faf8a59c640 1 --2- 172.21.15.46:0/2752731331 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x557cb5e88070 0x557cb62b9ee0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ed426a9991da36c server_cookie=4785ce0da51fc85d in_seq=0 out_seq=0 2024-09-21T04:02:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.491+0000 7faf71ffb640 10 client.16491 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:02:31.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.491+0000 7faf71ffb640 1 -- 172.21.15.46:0/2752731331 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4066 (crc 0 0 0) 0x557cb61a3850 con 0x557cb5e88070 2024-09-21T04:02:31.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.491+0000 7faf71ffb640 10 client.16491 handle_command_reply: tid=0 2024-09-21T04:02:31.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.491+0000 7faf97239740 1 client.16491 shutdown 2024-09-21T04:02:31.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.491+0000 7faf97239740 1 -- 172.21.15.46:0/2752731331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557cb5e5f1b0 msgr2=0x557cb6240ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:31.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.491+0000 7faf97239740 1 --2- 172.21.15.46:0/2752731331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557cb5e5f1b0 0x557cb6240ea0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7faf8001d010 tx=0x7faf7c005f30 comp rx=0 tx=0).stop 2024-09-21T04:02:31.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.491+0000 7faf97239740 1 -- 172.21.15.46:0/2752731331 shutdown_connections 2024-09-21T04:02:31.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.491+0000 7faf97239740 1 --2- 172.21.15.46:0/2752731331 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x557cb5e88070 0x557cb62b9ee0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.491+0000 7faf97239740 1 --2- 172.21.15.46:0/2752731331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cb5e7c460 0x557cb6241920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.491+0000 7faf97239740 1 --2- 172.21.15.46:0/2752731331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cb5e67390 0x557cb62413e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.491+0000 7faf71ffb640 0 client.16491 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:02:31.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.491+0000 7faf97239740 1 --2- 172.21.15.46:0/2752731331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557cb5e5f1b0 0x557cb6240ea0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.491+0000 7faf97239740 1 -- 172.21.15.46:0/2752731331 >> 172.21.15.46:0/2752731331 conn(0x557cb623b060 msgr2=0x557cb623bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:31.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.491+0000 7faf97239740 1 -- 172.21.15.46:0/2752731331 shutdown_connections 2024-09-21T04:02:31.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.491+0000 7faf97239740 1 -- 172.21.15.46:0/2752731331 wait complete. 2024-09-21T04:02:31.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.492+0000 7faf97239740 20 client.16491 trim_cache size 0 max 16384 2024-09-21T04:02:31.499 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T04:02:31.499 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "no active scrubs running", 2024-09-21T04:02:31.499 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": {}, 2024-09-21T04:02:31.499 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_stats": { 2024-09-21T04:02:31.499 INFO:teuthology.orchestra.run.smithi046.stdout: "7a3afabe-6b27-4bce-928a-8c6773a85803": { 2024-09-21T04:02:31.499 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:01:58.413358+0000", 2024-09-21T04:02:31.499 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:31.499 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:31.500 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:31.500 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:31.500 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:31.500 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:31.500 INFO:teuthology.orchestra.run.smithi046.stdout: "08f0c962-df1a-4129-a1a2-b916240d9803": { 2024-09-21T04:02:31.500 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:02.937596+0000", 2024-09-21T04:02:31.500 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:31.500 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:31.500 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:31.500 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:31.500 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:31.500 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:31.500 INFO:teuthology.orchestra.run.smithi046.stdout: "d49f33a7-3d5a-421b-94ba-8b19a4120db1": { 2024-09-21T04:02:31.501 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:50.480786+0000", 2024-09-21T04:02:31.501 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:31.501 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:31.501 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:31.501 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:31.501 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:31.501 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:31.501 INFO:teuthology.orchestra.run.smithi046.stdout: "a871f724-0198-493c-b03e-b2de78aba243": { 2024-09-21T04:02:31.501 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:56:30.082991+0000", 2024-09-21T04:02:31.501 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:31.501 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:31.501 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:31.501 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:31.501 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:31.502 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:31.502 INFO:teuthology.orchestra.run.smithi046.stdout: "edc4b8c7-b702-489d-a925-ae7ad0ff0d9a": { 2024-09-21T04:02:31.502 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:00:40.181950+0000", 2024-09-21T04:02:31.502 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:31.502 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:31.502 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:31.502 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:31.502 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:31.502 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:31.502 INFO:teuthology.orchestra.run.smithi046.stdout: "3bbf7097-70d7-4743-bbce-41465502b35b": { 2024-09-21T04:02:31.502 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:10.661441+0000", 2024-09-21T04:02:31.502 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:31.502 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:31.502 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:31.503 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:31.503 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:31.503 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:31.503 INFO:teuthology.orchestra.run.smithi046.stdout: "e24ec8f1-0d13-478f-9c2c-b51798868ffc": { 2024-09-21T04:02:31.503 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:09.736194+0000", 2024-09-21T04:02:31.503 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:31.503 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:31.503 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:31.503 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:31.503 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:31.503 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:31.503 INFO:teuthology.orchestra.run.smithi046.stdout: "c47f458a-de5e-4952-a575-a81261953667": { 2024-09-21T04:02:31.503 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:48.699411+0000", 2024-09-21T04:02:31.503 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:31.504 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:31.504 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:31.504 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:31.504 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:31.504 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:31.504 INFO:teuthology.orchestra.run.smithi046.stdout: "6103c660-8e77-4b06-ad6c-bb322c26035a": { 2024-09-21T04:02:31.504 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:35.594467+0000", 2024-09-21T04:02:31.504 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:31.504 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:31.504 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:31.504 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:31.504 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:31.504 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:31.504 INFO:teuthology.orchestra.run.smithi046.stdout: "46bb5415-6e16-47c6-a1e4-55f9c623ce90": { 2024-09-21T04:02:31.504 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:14.950674+0000", 2024-09-21T04:02:31.505 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:31.505 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:31.505 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:31.505 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:31.505 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:31.505 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:31.505 INFO:teuthology.orchestra.run.smithi046.stdout: "326aaecf-f38a-4946-988a-d83f25556995": { 2024-09-21T04:02:31.505 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:54.189884+0000", 2024-09-21T04:02:31.505 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:31.505 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:31.505 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:31.505 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:31.505 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:31.505 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:31.506 INFO:teuthology.orchestra.run.smithi046.stdout: "dab67652-8894-4711-be64-cbdfea27a9ba": { 2024-09-21T04:02:31.506 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:28.161616+0000", 2024-09-21T04:02:31.506 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:31.506 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:31.506 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:31.506 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:31.506 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:31.506 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:31.506 INFO:teuthology.orchestra.run.smithi046.stdout: "0d781b95-cf5e-46f2-9875-2923181385e2": { 2024-09-21T04:02:31.506 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:00:33.099094+0000", 2024-09-21T04:02:31.506 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:31.506 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:31.506 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:31.507 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:31.507 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:31.507 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:31.507 INFO:teuthology.orchestra.run.smithi046.stdout: "d7634007-e881-46f7-9833-ac9bd0a3100e": { 2024-09-21T04:02:31.507 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:01:19.459151+0000", 2024-09-21T04:02:31.507 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:31.507 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:31.507 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:31.507 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:31.507 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:31.507 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:02:31.507 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:02:31.507 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T04:02:31.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.492+0000 7faf90cc5640 1 -- 172.21.15.46:0/4194794327 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7faf740b66b0 msgr2=0x7faf740b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:31.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.492+0000 7faf90cc5640 1 --2- 172.21.15.46:0/4194794327 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7faf740b66b0 0x7faf740b8bc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7faf840e5420 tx=0x7faf8407a720 comp rx=0 tx=0).stop 2024-09-21T04:02:31.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.492+0000 7faf90cc5640 1 -- 172.21.15.46:0/4194794327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf8c108d20 msgr2=0x7faf8c19fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:31.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.492+0000 7faf90cc5640 1 --2- 172.21.15.46:0/4194794327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf8c108d20 0x7faf8c19fcb0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7faf8400cce0 tx=0x7faf8400a620 comp rx=0 tx=0).stop 2024-09-21T04:02:31.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.492+0000 7faf90cc5640 1 -- 172.21.15.46:0/4194794327 shutdown_connections 2024-09-21T04:02:31.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.492+0000 7faf90cc5640 1 --2- 172.21.15.46:0/4194794327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf8c108d20 0x7faf8c19fcb0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.492+0000 7faf90cc5640 1 --2- 172.21.15.46:0/4194794327 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7faf740b66b0 0x7faf740b8bc0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.492+0000 7faf90cc5640 1 --2- 172.21.15.46:0/4194794327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf8c1083d0 0x7faf8c19aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.492+0000 7faf90cc5640 1 --2- 172.21.15.46:0/4194794327 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf8c102ae0 0x7faf8c19a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.492+0000 7faf90cc5640 1 -- 172.21.15.46:0/4194794327 >> 172.21.15.46:0/4194794327 conn(0x7faf8c079760 msgr2=0x7faf8c101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:31.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.492+0000 7faf90cc5640 1 -- 172.21.15.46:0/4194794327 shutdown_connections 2024-09-21T04:02:31.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:31.492+0000 7faf90cc5640 1 -- 172.21.15.46:0/4194794327 wait complete. 2024-09-21T04:02:32.105 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:31 smithi046 ceph-mon[30954]: pgmap v546: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:02:32.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:31 smithi105 ceph-mon[34773]: pgmap v546: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:02:32.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:31 smithi162 ceph-mon[35071]: pgmap v546: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:02:32.382 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T04:02:32.383 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:02:32.651 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:33.084 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:33 smithi046 ceph-mon[30954]: pgmap v547: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T04:02:33.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.176+0000 7f927b396640 1 -- 172.21.15.46:0/229656728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92741101a0 msgr2=0x7f92741125c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:33.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.176+0000 7f927b396640 1 --2- 172.21.15.46:0/229656728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92741101a0 0x7f92741125c0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f926c009ca0 tx=0x7f926c02a950 comp rx=0 tx=0).stop 2024-09-21T04:02:33.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.176+0000 7f927b396640 1 -- 172.21.15.46:0/229656728 shutdown_connections 2024-09-21T04:02:33.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.176+0000 7f927b396640 1 --2- 172.21.15.46:0/229656728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92741101a0 0x7f92741125c0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:33.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.176+0000 7f927b396640 1 --2- 172.21.15.46:0/229656728 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9274102f40 0x7f927410fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:33.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.176+0000 7f927b396640 1 --2- 172.21.15.46:0/229656728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92741025f0 0x7f9274102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:33.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.176+0000 7f927b396640 1 -- 172.21.15.46:0/229656728 >> 172.21.15.46:0/229656728 conn(0x7f9274079740 msgr2=0x7f9274079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:33.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.176+0000 7f927b396640 1 -- 172.21.15.46:0/229656728 shutdown_connections 2024-09-21T04:02:33.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.176+0000 7f927b396640 1 -- 172.21.15.46:0/229656728 wait complete. 2024-09-21T04:02:33.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.177+0000 7f927b396640 1 Processor -- start 2024-09-21T04:02:33.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.177+0000 7f927b396640 1 -- start start 2024-09-21T04:02:33.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.177+0000 7f927b396640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92741025f0 0x7f927419c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:33.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.177+0000 7f927b396640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9274102f40 0x7f927419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:33.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.177+0000 7f927b396640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92741101a0 0x7f92741a1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:33.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.177+0000 7f927b396640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9274115cb0 con 0x7f9274102f40 2024-09-21T04:02:33.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.177+0000 7f927b396640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9274115b30 con 0x7f92741025f0 2024-09-21T04:02:33.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.177+0000 7f927b396640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9274115e30 con 0x7f92741101a0 2024-09-21T04:02:33.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.177+0000 7f9278931640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9274102f40 0x7f927419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:33.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.177+0000 7f9278931640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9274102f40 0x7f927419cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52292/0 (socket says 172.21.15.46:52292) 2024-09-21T04:02:33.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.177+0000 7f9278931640 1 -- 172.21.15.46:0/331247660 learned_addr learned my addr 172.21.15.46:0/331247660 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:33.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.177+0000 7f9279132640 1 --2- 172.21.15.46:0/331247660 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92741025f0 0x7f927419c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:33.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.177+0000 7f9279933640 1 --2- 172.21.15.46:0/331247660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92741101a0 0x7f92741a1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:33.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.178+0000 7f9278931640 1 -- 172.21.15.46:0/331247660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92741101a0 msgr2=0x7f92741a1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:33.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.178+0000 7f9278931640 1 --2- 172.21.15.46:0/331247660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92741101a0 0x7f92741a1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:33.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.178+0000 7f9278931640 1 -- 172.21.15.46:0/331247660 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92741025f0 msgr2=0x7f927419c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:33.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.178+0000 7f9278931640 1 --2- 172.21.15.46:0/331247660 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92741025f0 0x7f927419c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:33.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.178+0000 7f9278931640 1 -- 172.21.15.46:0/331247660 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92741a2650 con 0x7f9274102f40 2024-09-21T04:02:33.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.178+0000 7f9278931640 1 --2- 172.21.15.46:0/331247660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9274102f40 0x7f927419cc80 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f926400c890 tx=0x7f926400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:33.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.178+0000 7f926a7fc640 1 -- 172.21.15.46:0/331247660 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9264004220 con 0x7f9274102f40 2024-09-21T04:02:33.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.178+0000 7f927b396640 1 -- 172.21.15.46:0/331247660 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92741a2940 con 0x7f9274102f40 2024-09-21T04:02:33.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.178+0000 7f926a7fc640 1 -- 172.21.15.46:0/331247660 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92640043c0 con 0x7f9274102f40 2024-09-21T04:02:33.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.178+0000 7f926a7fc640 1 -- 172.21.15.46:0/331247660 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9264004a00 con 0x7f9274102f40 2024-09-21T04:02:33.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.178+0000 7f927b396640 1 -- 172.21.15.46:0/331247660 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92741a90a0 con 0x7f9274102f40 2024-09-21T04:02:33.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.179+0000 7f927b396640 1 -- 172.21.15.46:0/331247660 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f927406c240 con 0x7f9274102f40 2024-09-21T04:02:33.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.181+0000 7f926a7fc640 1 -- 172.21.15.46:0/331247660 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f92640079b0 con 0x7f9274102f40 2024-09-21T04:02:33.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.181+0000 7f926a7fc640 1 --2- 172.21.15.46:0/331247660 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f92600b6680 0x7f92600b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:33.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.182+0000 7f9279132640 1 --2- 172.21.15.46:0/331247660 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f92600b6680 0x7f92600b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:33.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.182+0000 7f926a7fc640 1 -- 172.21.15.46:0/331247660 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f92640e77e0 con 0x7f9274102f40 2024-09-21T04:02:33.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.182+0000 7f9279132640 1 --2- 172.21.15.46:0/331247660 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f92600b6680 0x7f92600b8b90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9270009990 tx=0x7f9270009110 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:33.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.185+0000 7f926a7fc640 1 -- 172.21.15.46:0/331247660 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9264014030 con 0x7f9274102f40 2024-09-21T04:02:33.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:33 smithi105 ceph-mon[34773]: pgmap v547: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T04:02:33.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:33 smithi162 ceph-mon[35071]: pgmap v547: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T04:02:33.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.413+0000 7f927b396640 1 -- 172.21.15.46:0/331247660 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9274102a00 con 0x7f9274102f40 2024-09-21T04:02:33.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.414+0000 7f926a7fc640 1 -- 172.21.15.46:0/331247660 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f92640adda0 con 0x7f9274102f40 2024-09-21T04:02:33.416 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T04:02:33.416 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"btime":"2024-09-21T03:53:23:865820+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1766354184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1766354184},{"type":"v1","addr":"172.21.15.46:6839","nonce":1766354184}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/1901774207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":1901774207},{"type":"v1","addr":"172.21.15.46:6841","nonce":1901774207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3548633196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":3548633196},{"type":"v1","addr":"172.21.15.105:6837","nonce":3548633196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24652,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3551934241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3551934241},{"type":"v1","addr":"172.21.15.162:6835","nonce":3551934241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/48949822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":48949822},{"type":"v1","addr":"172.21.15.162:6837","nonce":48949822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:53:14.452819+0000","modified":"2024-09-21T03:53:23.593278+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24680},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/2196053213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2196053213},{"type":"v1","addr":"172.21.15.162:6839","nonce":2196053213}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.105:6839/3911438406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":3911438406},{"type":"v1","addr":"172.21.15.105:6839","nonce":3911438406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24680,"qdb_cluster":[24680]},"id":1}]} 2024-09-21T04:02:33.417 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T04:02:33.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.417+0000 7f927b396640 1 -- 172.21.15.46:0/331247660 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f92600b6680 msgr2=0x7f92600b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:33.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.417+0000 7f927b396640 1 --2- 172.21.15.46:0/331247660 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f92600b6680 0x7f92600b8b90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9270009990 tx=0x7f9270009110 comp rx=0 tx=0).stop 2024-09-21T04:02:33.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.417+0000 7f927b396640 1 -- 172.21.15.46:0/331247660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9274102f40 msgr2=0x7f927419cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:33.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.417+0000 7f927b396640 1 --2- 172.21.15.46:0/331247660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9274102f40 0x7f927419cc80 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f926400c890 tx=0x7f926400cc90 comp rx=0 tx=0).stop 2024-09-21T04:02:33.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.417+0000 7f927b396640 1 -- 172.21.15.46:0/331247660 shutdown_connections 2024-09-21T04:02:33.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.417+0000 7f927b396640 1 --2- 172.21.15.46:0/331247660 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f92600b6680 0x7f92600b8b90 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:33.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.417+0000 7f927b396640 1 --2- 172.21.15.46:0/331247660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92741101a0 0x7f92741a1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:33.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.417+0000 7f927b396640 1 --2- 172.21.15.46:0/331247660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9274102f40 0x7f927419cc80 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:33.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.417+0000 7f927b396640 1 --2- 172.21.15.46:0/331247660 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92741025f0 0x7f927419c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:33.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.417+0000 7f927b396640 1 -- 172.21.15.46:0/331247660 >> 172.21.15.46:0/331247660 conn(0x7f9274079740 msgr2=0x7f9274109cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:33.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.417+0000 7f927b396640 1 -- 172.21.15.46:0/331247660 shutdown_connections 2024-09-21T04:02:33.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:33.417+0000 7f927b396640 1 -- 172.21.15.46:0/331247660 wait complete. 2024-09-21T04:02:34.051 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T04:02:34.310 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:34.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:34 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/331247660' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:02:34.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:34 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/331247660' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:02:34.432 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:34 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/331247660' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:02:34.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.803+0000 7f01e4e5f640 1 -- 172.21.15.46:0/2114827964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01e01051e0 msgr2=0x7f01e01055f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:34.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.803+0000 7f01e4e5f640 1 --2- 172.21.15.46:0/2114827964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01e01051e0 0x7f01e01055f0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f01c8009900 tx=0x7f01c802a410 comp rx=0 tx=0).stop 2024-09-21T04:02:34.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.803+0000 7f01e4e5f640 1 -- 172.21.15.46:0/2114827964 shutdown_connections 2024-09-21T04:02:34.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.803+0000 7f01e4e5f640 1 --2- 172.21.15.46:0/2114827964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01e0105b30 0x7f01e010f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:34.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.803+0000 7f01e4e5f640 1 --2- 172.21.15.46:0/2114827964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01e01051e0 0x7f01e01055f0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:34.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.803+0000 7f01e4e5f640 1 --2- 172.21.15.46:0/2114827964 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01e0103210 0x7f01e0103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:34.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.803+0000 7f01e4e5f640 1 -- 172.21.15.46:0/2114827964 >> 172.21.15.46:0/2114827964 conn(0x7f01e0079f90 msgr2=0x7f01e007a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:34.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.803+0000 7f01e4e5f640 1 -- 172.21.15.46:0/2114827964 shutdown_connections 2024-09-21T04:02:34.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.803+0000 7f01e4e5f640 1 -- 172.21.15.46:0/2114827964 wait complete. 2024-09-21T04:02:34.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.804+0000 7f01e4e5f640 1 Processor -- start 2024-09-21T04:02:34.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.804+0000 7f01e4e5f640 1 -- start start 2024-09-21T04:02:34.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.805+0000 7f01e4e5f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01e0103210 0x7f01e00fedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:34.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.805+0000 7f01e4e5f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01e01051e0 0x7f01e00ff330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:34.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.805+0000 7f01e4e5f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01e0105b30 0x7f01e00ff870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:34.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.805+0000 7f01e4e5f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f01e0112990 con 0x7f01e0105b30 2024-09-21T04:02:34.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.805+0000 7f01e4e5f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f01e0112810 con 0x7f01e01051e0 2024-09-21T04:02:34.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.805+0000 7f01e4e5f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f01e0112b10 con 0x7f01e0103210 2024-09-21T04:02:34.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.805+0000 7f01ded9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01e0105b30 0x7f01e00ff870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:34.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.805+0000 7f01ded9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01e0105b30 0x7f01e00ff870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52308/0 (socket says 172.21.15.46:52308) 2024-09-21T04:02:34.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.805+0000 7f01d7fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01e01051e0 0x7f01e00ff330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:34.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.805+0000 7f01ded9d640 1 -- 172.21.15.46:0/4116184972 learned_addr learned my addr 172.21.15.46:0/4116184972 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:34.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.805+0000 7f01de59c640 1 --2- 172.21.15.46:0/4116184972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01e0103210 0x7f01e00fedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:34.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.805+0000 7f01ded9d640 1 -- 172.21.15.46:0/4116184972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01e0103210 msgr2=0x7f01e00fedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:34.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.805+0000 7f01ded9d640 1 --2- 172.21.15.46:0/4116184972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01e0103210 0x7f01e00fedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:34.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.805+0000 7f01ded9d640 1 -- 172.21.15.46:0/4116184972 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01e01051e0 msgr2=0x7f01e00ff330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:34.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.805+0000 7f01ded9d640 1 --2- 172.21.15.46:0/4116184972 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01e01051e0 0x7f01e00ff330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:34.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.805+0000 7f01ded9d640 1 -- 172.21.15.46:0/4116184972 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e01a8740 con 0x7f01e0105b30 2024-09-21T04:02:34.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.806+0000 7f01ded9d640 1 --2- 172.21.15.46:0/4116184972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01e0105b30 0x7f01e00ff870 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f01d800cce0 tx=0x7f01d800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:34.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.806+0000 7f01d77fe640 1 -- 172.21.15.46:0/4116184972 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d800f450 con 0x7f01e0105b30 2024-09-21T04:02:34.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.806+0000 7f01d77fe640 1 -- 172.21.15.46:0/4116184972 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01d800faa0 con 0x7f01e0105b30 2024-09-21T04:02:34.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.806+0000 7f01e4e5f640 1 -- 172.21.15.46:0/4116184972 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01e01a8a30 con 0x7f01e0105b30 2024-09-21T04:02:34.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.806+0000 7f01d77fe640 1 -- 172.21.15.46:0/4116184972 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d8018b70 con 0x7f01e0105b30 2024-09-21T04:02:34.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.806+0000 7f01e4e5f640 1 -- 172.21.15.46:0/4116184972 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01e01a8ef0 con 0x7f01e0105b30 2024-09-21T04:02:34.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.809+0000 7f01eb3d3740 1 Processor -- start 2024-09-21T04:02:34.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.809+0000 7f01d77fe640 1 -- 172.21.15.46:0/4116184972 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f01d8018d10 con 0x7f01e0105b30 2024-09-21T04:02:34.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.809+0000 7f01eb3d3740 1 -- start start 2024-09-21T04:02:34.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.810+0000 7f01eb3d3740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ad6237070 0x556ad65de6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:34.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.810+0000 7f01eb3d3740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ad620e1b0 0x556ad65debe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:34.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.810+0000 7f01eb3d3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ad6216390 0x556ad65df120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:34.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.810+0000 7f01eb3d3740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x556ad6554ea0 con 0x556ad6237070 2024-09-21T04:02:34.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.810+0000 7f01eb3d3740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x556ad65442d0 con 0x556ad620e1b0 2024-09-21T04:02:34.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.810+0000 7f01eb3d3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556ad65480e0 con 0x556ad6216390 2024-09-21T04:02:34.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.810+0000 7f01d7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ad6237070 0x556ad65de6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:34.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.810+0000 7f01d7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ad6237070 0x556ad65de6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52322/0 (socket says 172.21.15.46:52322) 2024-09-21T04:02:34.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.810+0000 7f01d7fff640 1 -- 172.21.15.46:0/699829930 learned_addr learned my addr 172.21.15.46:0/699829930 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:34.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.810+0000 7f01de59c640 1 --2- 172.21.15.46:0/699829930 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ad620e1b0 0x556ad65debe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:34.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.810+0000 7f01d7fff640 1 --2- 172.21.15.46:0/699829930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ad6216390 0x556ad65df120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:34.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.810+0000 7f01d7fff640 1 -- 172.21.15.46:0/699829930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ad6216390 msgr2=0x556ad65df120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:34.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.810+0000 7f01d7fff640 1 --2- 172.21.15.46:0/699829930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ad6216390 0x556ad65df120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:34.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.810+0000 7f01d7fff640 1 -- 172.21.15.46:0/699829930 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ad620e1b0 msgr2=0x556ad65debe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:34.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.810+0000 7f01d7fff640 1 --2- 172.21.15.46:0/699829930 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ad620e1b0 0x556ad65debe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:34.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.810+0000 7f01d7fff640 1 -- 172.21.15.46:0/699829930 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ad62a2650 con 0x556ad6237070 2024-09-21T04:02:34.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.810+0000 7f01d77fe640 1 --2- 172.21.15.46:0/4116184972 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f01cc0b6680 0x7f01cc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:34.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.811+0000 7f01de59c640 1 --2- 172.21.15.46:0/4116184972 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f01cc0b6680 0x7f01cc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:34.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.811+0000 7f01d7fff640 1 --2- 172.21.15.46:0/699829930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ad6237070 0x556ad65de6a0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f01c8009900 tx=0x7f01c8005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2482109a1c184343 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:34.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.811+0000 7f01d77fe640 1 -- 172.21.15.46:0/4116184972 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f01d80e7a90 con 0x7f01e0105b30 2024-09-21T04:02:34.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.811+0000 7f01d4ff9640 1 -- 172.21.15.46:0/699829930 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c8035040 con 0x556ad6237070 2024-09-21T04:02:34.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.811+0000 7f01d4ff9640 1 -- 172.21.15.46:0/699829930 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01c8042070 con 0x556ad6237070 2024-09-21T04:02:34.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.811+0000 7f01d4ff9640 1 -- 172.21.15.46:0/699829930 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c8005600 con 0x556ad6237070 2024-09-21T04:02:34.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.812+0000 7f01eb3d3740 1 -- 172.21.15.46:0/699829930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ad6237070 msgr2=0x556ad65de6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:34.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.812+0000 7f01de59c640 1 --2- 172.21.15.46:0/4116184972 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f01cc0b6680 0x7f01cc0b8b90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x556ad65dd320 tx=0x7f01d000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:34.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.812+0000 7f01eb3d3740 1 --2- 172.21.15.46:0/699829930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ad6237070 0x556ad65de6a0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f01c8009900 tx=0x7f01c8005f30 comp rx=0 tx=0).stop 2024-09-21T04:02:34.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.812+0000 7f01eb3d3740 1 -- 172.21.15.46:0/699829930 shutdown_connections 2024-09-21T04:02:34.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.812+0000 7f01eb3d3740 1 --2- 172.21.15.46:0/699829930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ad6216390 0x556ad65df120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:34.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.812+0000 7f01eb3d3740 1 --2- 172.21.15.46:0/699829930 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ad620e1b0 0x556ad65debe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:34.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.812+0000 7f01eb3d3740 1 --2- 172.21.15.46:0/699829930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ad6237070 0x556ad65de6a0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:34.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.812+0000 7f01eb3d3740 1 -- 172.21.15.46:0/699829930 >> 172.21.15.46:0/699829930 conn(0x556ad622b460 msgr2=0x556ad65dc590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:34.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.812+0000 7f01eb3d3740 1 -- 172.21.15.46:0/699829930 shutdown_connections 2024-09-21T04:02:34.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.812+0000 7f01eb3d3740 1 -- 172.21.15.46:0/699829930 wait complete. 2024-09-21T04:02:34.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.812+0000 7f01eb3d3740 1 -- start start 2024-09-21T04:02:34.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.813+0000 7f01eb3d3740 1 Processor -- start 2024-09-21T04:02:34.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.813+0000 7f01eb3d3740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ad620e1b0 0x556ad65e9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:34.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.813+0000 7f01eb3d3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ad6216390 0x556ad65ea2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:34.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.813+0000 7f01eb3d3740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ad6237070 0x556ad65f6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:34.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.813+0000 7f01eb3d3740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x556ad63a5700 con 0x556ad620e1b0 2024-09-21T04:02:34.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.813+0000 7f01eb3d3740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x556ad64df160 con 0x556ad6237070 2024-09-21T04:02:34.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.813+0000 7f01eb3d3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556ad65ece20 con 0x556ad6216390 2024-09-21T04:02:34.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.813+0000 7f01eb3d3740 10 client.0 _ll_register_callbacks cb 0x556ad64f89e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:02:34.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.813+0000 7f01de59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ad620e1b0 0x556ad65e9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:34.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.813+0000 7f01de59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ad620e1b0 0x556ad65e9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52328/0 (socket says 172.21.15.46:52328) 2024-09-21T04:02:34.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.813+0000 7f01de59c640 1 -- 172.21.15.46:0/4211969083 learned_addr learned my addr 172.21.15.46:0/4211969083 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:34.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.813+0000 7f01d7fff640 1 --2- 172.21.15.46:0/4211969083 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ad6216390 0x556ad65ea2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:34.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.813+0000 7f01ded9d640 1 --2- 172.21.15.46:0/4211969083 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ad6237070 0x556ad65f6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:34.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.813+0000 7f01de59c640 1 -- 172.21.15.46:0/4211969083 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ad6216390 msgr2=0x556ad65ea2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:34.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.813+0000 7f01de59c640 1 --2- 172.21.15.46:0/4211969083 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ad6216390 0x556ad65ea2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:34.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.813+0000 7f01de59c640 1 -- 172.21.15.46:0/4211969083 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ad6237070 msgr2=0x556ad65f6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:34.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.813+0000 7f01de59c640 1 --2- 172.21.15.46:0/4211969083 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ad6237070 0x556ad65f6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:34.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.813+0000 7f01de59c640 1 -- 172.21.15.46:0/4211969083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ad650cc90 con 0x556ad620e1b0 2024-09-21T04:02:34.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.814+0000 7f01de59c640 1 --2- 172.21.15.46:0/4211969083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ad620e1b0 0x556ad65e9d70 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f01d0010790 tx=0x7f01d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=281460b7836287f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:34.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.814+0000 7f01c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:02:34.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.814+0000 7f01c5ffb640 1 -- 172.21.15.46:0/4211969083 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d000fa50 con 0x556ad620e1b0 2024-09-21T04:02:34.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.814+0000 7f01c5ffb640 1 -- 172.21.15.46:0/4211969083 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f01d000fbf0 con 0x556ad620e1b0 2024-09-21T04:02:34.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.814+0000 7f01eb3d3740 1 -- 172.21.15.46:0/4211969083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01c8042070 con 0x556ad620e1b0 2024-09-21T04:02:34.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.814+0000 7f01c5ffb640 1 -- 172.21.15.46:0/4211969083 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f01d000fdf0 con 0x556ad620e1b0 2024-09-21T04:02:34.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.814+0000 7f01eb3d3740 10 client.16509 fetch_fsmap learned FSMap version 20 2024-09-21T04:02:34.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.814+0000 7f01eb3d3740 1 -- 172.21.15.46:0/4211969083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x556ad65f8b80 con 0x556ad620e1b0 2024-09-21T04:02:34.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.814+0000 7f01c5ffb640 1 -- 172.21.15.46:0/4211969083 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01c8042070 con 0x556ad620e1b0 2024-09-21T04:02:34.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.814+0000 7f01c5ffb640 1 -- 172.21.15.46:0/4211969083 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f01d002f050 con 0x556ad620e1b0 2024-09-21T04:02:34.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.814+0000 7f01eb3d3740 10 client.16509 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:02:34.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.814+0000 7f01eb3d3740 10 client.16509 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:02:34.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.815+0000 7f01eb3d3740 20 client.16509 populate_metadata read hostname 'smithi046' 2024-09-21T04:02:34.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.815+0000 7f01eb3d3740 1 --2- 172.21.15.46:0/4211969083 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x556ad61f59f0 0x556ad65fc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:34.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.815+0000 7f01eb3d3740 4 client.16509 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:02:34.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.815+0000 7f01eb3d3740 1 -- 172.21.15.46:0/4211969083 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ad6556df0 con 0x556ad61f59f0 2024-09-21T04:02:34.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.815+0000 7f01d7fff640 1 --2- 172.21.15.46:0/4211969083 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x556ad61f59f0 0x556ad65fc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:34.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.815+0000 7f01d7fff640 1 --2- 172.21.15.46:0/4211969083 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x556ad61f59f0 0x556ad65fc050 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efcb271045ba8460 server_cookie=d9fd918a44c961a1 in_seq=0 out_seq=0 2024-09-21T04:02:34.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.815+0000 7f01c5ffb640 10 client.16509 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:02:34.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.816+0000 7f01c5ffb640 1 -- 172.21.15.46:0/4211969083 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556ad6556df0 con 0x556ad61f59f0 2024-09-21T04:02:34.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.816+0000 7f01c5ffb640 10 client.16509 handle_command_reply: tid=0 2024-09-21T04:02:34.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.816+0000 7f01eb3d3740 1 client.16509 shutdown 2024-09-21T04:02:34.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.816+0000 7f01eb3d3740 1 -- 172.21.15.46:0/4211969083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ad620e1b0 msgr2=0x556ad65e9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:34.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.816+0000 7f01eb3d3740 1 --2- 172.21.15.46:0/4211969083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ad620e1b0 0x556ad65e9d70 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f01d0010790 tx=0x7f01d00046c0 comp rx=0 tx=0).stop 2024-09-21T04:02:34.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.816+0000 7f01eb3d3740 1 -- 172.21.15.46:0/4211969083 shutdown_connections 2024-09-21T04:02:34.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.816+0000 7f01eb3d3740 1 --2- 172.21.15.46:0/4211969083 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x556ad61f59f0 0x556ad65fc050 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:34.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.816+0000 7f01eb3d3740 1 --2- 172.21.15.46:0/4211969083 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ad6237070 0x556ad65f6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:34.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.816+0000 7f01eb3d3740 1 --2- 172.21.15.46:0/4211969083 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ad6216390 0x556ad65ea2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:34.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.816+0000 7f01eb3d3740 1 --2- 172.21.15.46:0/4211969083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ad620e1b0 0x556ad65e9d70 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:34.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.816+0000 7f01eb3d3740 1 -- 172.21.15.46:0/4211969083 >> 172.21.15.46:0/4211969083 conn(0x556ad622b460 msgr2=0x556ad65e1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:34.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.816+0000 7f01c5ffb640 0 client.16509 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:02:34.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.816+0000 7f01eb3d3740 1 -- 172.21.15.46:0/4211969083 shutdown_connections 2024-09-21T04:02:34.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.816+0000 7f01eb3d3740 1 -- 172.21.15.46:0/4211969083 wait complete. 2024-09-21T04:02:34.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.817+0000 7f01eb3d3740 20 client.16509 trim_cache size 0 max 16384 2024-09-21T04:02:34.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.830+0000 7f01eb3d3740 1 Processor -- start 2024-09-21T04:02:34.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.830+0000 7f01eb3d3740 1 -- start start 2024-09-21T04:02:34.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.830+0000 7f01eb3d3740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ad620e1b0 0x556ad65eb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:34.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.830+0000 7f01eb3d3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ad6216390 0x556ad65dbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:34.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.830+0000 7f01eb3d3740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ad6237070 0x556ad65dc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:34.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.830+0000 7f01eb3d3740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f01e01af600 con 0x556ad620e1b0 2024-09-21T04:02:34.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.830+0000 7f01eb3d3740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f01e01b1e60 con 0x556ad6237070 2024-09-21T04:02:34.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.830+0000 7f01eb3d3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f01e01afc50 con 0x556ad6216390 2024-09-21T04:02:34.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.830+0000 7f01de59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ad620e1b0 0x556ad65eb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:34.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.830+0000 7f01de59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ad620e1b0 0x556ad65eb9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52344/0 (socket says 172.21.15.46:52344) 2024-09-21T04:02:34.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.830+0000 7f01de59c640 1 -- 172.21.15.46:0/4179107319 learned_addr learned my addr 172.21.15.46:0/4179107319 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:34.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.830+0000 7f01d7fff640 1 --2- 172.21.15.46:0/4179107319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ad6216390 0x556ad65dbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:34.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.830+0000 7f01de59c640 1 -- 172.21.15.46:0/4179107319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ad6216390 msgr2=0x556ad65dbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:34.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.830+0000 7f01de59c640 1 --2- 172.21.15.46:0/4179107319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ad6216390 0x556ad65dbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:34.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.830+0000 7f01de59c640 1 -- 172.21.15.46:0/4179107319 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ad6237070 msgr2=0x556ad65dc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:34.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.830+0000 7f01de59c640 1 --2- 172.21.15.46:0/4179107319 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ad6237070 0x556ad65dc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:34.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.830+0000 7f01de59c640 1 -- 172.21.15.46:0/4179107319 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ad65e0df0 con 0x556ad620e1b0 2024-09-21T04:02:34.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.831+0000 7f01de59c640 1 --2- 172.21.15.46:0/4179107319 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ad620e1b0 0x556ad65eb9a0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f01d0005850 tx=0x7f01d0012f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=256247c119212a6f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:34.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.831+0000 7f01c7fff640 1 -- 172.21.15.46:0/4179107319 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d000fa50 con 0x556ad620e1b0 2024-09-21T04:02:34.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.831+0000 7f01c7fff640 1 -- 172.21.15.46:0/4179107319 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01d000fbf0 con 0x556ad620e1b0 2024-09-21T04:02:34.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.831+0000 7f01c7fff640 1 -- 172.21.15.46:0/4179107319 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d00306c0 con 0x556ad620e1b0 2024-09-21T04:02:34.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.832+0000 7f01eb3d3740 1 -- 172.21.15.46:0/4179107319 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ad620e1b0 msgr2=0x556ad65eb9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:34.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.832+0000 7f01eb3d3740 1 --2- 172.21.15.46:0/4179107319 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ad620e1b0 0x556ad65eb9a0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f01d0005850 tx=0x7f01d0012f90 comp rx=0 tx=0).stop 2024-09-21T04:02:34.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.832+0000 7f01eb3d3740 1 -- 172.21.15.46:0/4179107319 shutdown_connections 2024-09-21T04:02:34.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.832+0000 7f01eb3d3740 1 --2- 172.21.15.46:0/4179107319 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ad6237070 0x556ad65dc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:34.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.832+0000 7f01eb3d3740 1 --2- 172.21.15.46:0/4179107319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ad6216390 0x556ad65dbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:34.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.832+0000 7f01eb3d3740 1 --2- 172.21.15.46:0/4179107319 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ad620e1b0 0x556ad65eb9a0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:34.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.832+0000 7f01eb3d3740 1 -- 172.21.15.46:0/4179107319 >> 172.21.15.46:0/4179107319 conn(0x556ad622b460 msgr2=0x556ad65eb290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:34.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.832+0000 7f01eb3d3740 1 -- 172.21.15.46:0/4179107319 shutdown_connections 2024-09-21T04:02:34.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.832+0000 7f01eb3d3740 1 -- 172.21.15.46:0/4179107319 wait complete. 2024-09-21T04:02:34.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.832+0000 7f01eb3d3740 1 -- start start 2024-09-21T04:02:34.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.832+0000 7f01eb3d3740 1 Processor -- start 2024-09-21T04:02:34.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.832+0000 7f01eb3d3740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ad620e1b0 0x556ad65f2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:34.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.832+0000 7f01eb3d3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ad6216390 0x556ad65edbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:34.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.832+0000 7f01eb3d3740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ad6237070 0x556ad65ee100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:34.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.832+0000 7f01eb3d3740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f01e01b0320 con 0x556ad6237070 2024-09-21T04:02:34.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.832+0000 7f01eb3d3740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f01e01b1790 con 0x556ad620e1b0 2024-09-21T04:02:34.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.832+0000 7f01eb3d3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f01e01b09f0 con 0x556ad6216390 2024-09-21T04:02:34.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.833+0000 7f01eb3d3740 10 client.0 _ll_register_callbacks cb 0x7f01d000b9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:02:34.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.833+0000 7f01ded9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ad6237070 0x556ad65ee100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:34.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.833+0000 7f01ded9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ad6237070 0x556ad65ee100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52346/0 (socket says 172.21.15.46:52346) 2024-09-21T04:02:34.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.833+0000 7f01ded9d640 1 -- 172.21.15.46:0/1609336833 learned_addr learned my addr 172.21.15.46:0/1609336833 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:34.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.833+0000 7f01de59c640 1 --2- 172.21.15.46:0/1609336833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ad620e1b0 0x556ad65f2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:34.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.833+0000 7f01d7fff640 1 --2- 172.21.15.46:0/1609336833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ad6216390 0x556ad65edbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:34.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.833+0000 7f01ded9d640 1 -- 172.21.15.46:0/1609336833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ad6216390 msgr2=0x556ad65edbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:34.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.833+0000 7f01ded9d640 1 --2- 172.21.15.46:0/1609336833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ad6216390 0x556ad65edbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:34.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.833+0000 7f01ded9d640 1 -- 172.21.15.46:0/1609336833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ad620e1b0 msgr2=0x556ad65f2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:34.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.833+0000 7f01ded9d640 1 --2- 172.21.15.46:0/1609336833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ad620e1b0 0x556ad65f2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:34.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.833+0000 7f01ded9d640 1 -- 172.21.15.46:0/1609336833 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ad65ee710 con 0x556ad6237070 2024-09-21T04:02:34.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.833+0000 7f01ded9d640 1 --2- 172.21.15.46:0/1609336833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ad6237070 0x556ad65ee100 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f01d800ab20 tx=0x7f01d80a9850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4503a8bad26782cc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:34.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.833+0000 7f01c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:02:34.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.833+0000 7f01c5ffb640 1 -- 172.21.15.46:0/1609336833 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d80a9060 con 0x556ad6237070 2024-09-21T04:02:34.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.833+0000 7f01c5ffb640 1 -- 172.21.15.46:0/1609336833 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f01d80acb50 con 0x556ad6237070 2024-09-21T04:02:34.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.833+0000 7f01eb3d3740 1 -- 172.21.15.46:0/1609336833 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01d000fbf0 con 0x556ad6237070 2024-09-21T04:02:34.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.833+0000 7f01c5ffb640 1 -- 172.21.15.46:0/1609336833 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f01d80b21b0 con 0x556ad6237070 2024-09-21T04:02:34.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.833+0000 7f01eb3d3740 10 client.16515 fetch_fsmap learned FSMap version 20 2024-09-21T04:02:34.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.833+0000 7f01eb3d3740 1 -- 172.21.15.46:0/1609336833 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x556ad6666820 con 0x556ad6237070 2024-09-21T04:02:34.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.834+0000 7f01c5ffb640 1 -- 172.21.15.46:0/1609336833 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01d805b080 con 0x556ad6237070 2024-09-21T04:02:34.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.834+0000 7f01c5ffb640 1 -- 172.21.15.46:0/1609336833 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f01d80ac5c0 con 0x556ad6237070 2024-09-21T04:02:34.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.834+0000 7f01eb3d3740 10 client.16515 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:02:34.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.834+0000 7f01eb3d3740 10 client.16515 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:02:34.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.834+0000 7f01eb3d3740 20 client.16515 populate_metadata read hostname 'smithi046' 2024-09-21T04:02:34.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.834+0000 7f01eb3d3740 1 --2- 172.21.15.46:0/1609336833 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x556ad61cada0 0x556ad6668fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:34.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.834+0000 7f01eb3d3740 4 client.16515 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T04:02:34.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.834+0000 7f01eb3d3740 1 -- 172.21.15.46:0/1609336833 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556ad65528a0 con 0x556ad61cada0 2024-09-21T04:02:34.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.834+0000 7f01de59c640 1 --2- 172.21.15.46:0/1609336833 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x556ad61cada0 0x556ad6668fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:34.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.835+0000 7f01c5ffb640 10 client.16515 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:02:34.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.835+0000 7f01de59c640 1 --2- 172.21.15.46:0/1609336833 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x556ad61cada0 0x556ad6668fe0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=549ec3c0b411b630 server_cookie=e80848adcf998acb in_seq=0 out_seq=0 2024-09-21T04:02:34.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.835+0000 7f01c5ffb640 1 -- 172.21.15.46:0/1609336833 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556ad65528a0 con 0x556ad61cada0 2024-09-21T04:02:34.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.835+0000 7f01c5ffb640 10 client.16515 handle_command_reply: tid=0 2024-09-21T04:02:34.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.835+0000 7f01eb3d3740 1 client.16515 shutdown 2024-09-21T04:02:34.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.835+0000 7f01eb3d3740 1 -- 172.21.15.46:0/1609336833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ad6237070 msgr2=0x556ad65ee100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:34.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.835+0000 7f01eb3d3740 1 --2- 172.21.15.46:0/1609336833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ad6237070 0x556ad65ee100 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f01d800ab20 tx=0x7f01d80a9850 comp rx=0 tx=0).stop 2024-09-21T04:02:34.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.835+0000 7f01eb3d3740 1 -- 172.21.15.46:0/1609336833 shutdown_connections 2024-09-21T04:02:34.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.835+0000 7f01eb3d3740 1 --2- 172.21.15.46:0/1609336833 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x556ad61cada0 0x556ad6668fe0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:34.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.835+0000 7f01eb3d3740 1 --2- 172.21.15.46:0/1609336833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ad6237070 0x556ad65ee100 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:34.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.835+0000 7f01eb3d3740 1 --2- 172.21.15.46:0/1609336833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ad6216390 0x556ad65edbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:34.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.835+0000 7f01eb3d3740 1 --2- 172.21.15.46:0/1609336833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ad620e1b0 0x556ad65f2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:34.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.835+0000 7f01eb3d3740 1 -- 172.21.15.46:0/1609336833 >> 172.21.15.46:0/1609336833 conn(0x556ad622b460 msgr2=0x556ad65eb140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:34.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.835+0000 7f01c5ffb640 0 client.16515 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:02:34.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.835+0000 7f01eb3d3740 1 -- 172.21.15.46:0/1609336833 shutdown_connections 2024-09-21T04:02:34.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.835+0000 7f01eb3d3740 1 -- 172.21.15.46:0/1609336833 wait complete. 2024-09-21T04:02:34.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.835+0000 7f01eb3d3740 20 client.16515 trim_cache size 0 max 16384 2024-09-21T04:02:34.848 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-21T04:02:34.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.836+0000 7f01e4e5f640 1 -- 172.21.15.46:0/4116184972 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f01cc0b6680 msgr2=0x7f01cc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:34.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.836+0000 7f01e4e5f640 1 --2- 172.21.15.46:0/4116184972 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f01cc0b6680 0x7f01cc0b8b90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x556ad65dd320 tx=0x7f01d000b390 comp rx=0 tx=0).stop 2024-09-21T04:02:34.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.836+0000 7f01e4e5f640 1 -- 172.21.15.46:0/4116184972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01e0105b30 msgr2=0x7f01e00ff870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:34.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.836+0000 7f01e4e5f640 1 --2- 172.21.15.46:0/4116184972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01e0105b30 0x7f01e00ff870 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f01d800cce0 tx=0x7f01d800a620 comp rx=0 tx=0).stop 2024-09-21T04:02:34.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.836+0000 7f01e4e5f640 1 -- 172.21.15.46:0/4116184972 shutdown_connections 2024-09-21T04:02:34.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.836+0000 7f01e4e5f640 1 --2- 172.21.15.46:0/4116184972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01e0105b30 0x7f01e00ff870 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:34.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.836+0000 7f01e4e5f640 1 --2- 172.21.15.46:0/4116184972 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01e01051e0 0x7f01e00ff330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:34.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.836+0000 7f01e4e5f640 1 --2- 172.21.15.46:0/4116184972 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f01cc0b6680 0x7f01cc0b8b90 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:34.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.836+0000 7f01e4e5f640 1 --2- 172.21.15.46:0/4116184972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01e0103210 0x7f01e00fedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:34.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.836+0000 7f01e4e5f640 1 -- 172.21.15.46:0/4116184972 >> 172.21.15.46:0/4116184972 conn(0x7f01e0079f90 msgr2=0x7f01e01015f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:34.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.836+0000 7f01e4e5f640 1 -- 172.21.15.46:0/4116184972 shutdown_connections 2024-09-21T04:02:34.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:34.836+0000 7f01e4e5f640 1 -- 172.21.15.46:0/4116184972 wait complete. 2024-09-21T04:02:35.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:35 smithi105 ceph-mon[34773]: pgmap v548: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:02:35.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:35 smithi162 ceph-mon[35071]: pgmap v548: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:02:35.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:35 smithi046 ceph-mon[30954]: pgmap v548: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:02:36.546 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T04:02:36.546 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T04:02:36.818 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:37.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.340+0000 7eff2839f640 1 -- 172.21.15.46:0/1696661597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff20102a90 msgr2=0x7eff20102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:37.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.340+0000 7eff2839f640 1 --2- 172.21.15.46:0/1696661597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff20102a90 0x7eff20102ea0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7eff1c009900 tx=0x7eff1c02a410 comp rx=0 tx=0).stop 2024-09-21T04:02:37.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.340+0000 7eff2839f640 1 -- 172.21.15.46:0/1696661597 shutdown_connections 2024-09-21T04:02:37.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.340+0000 7eff2839f640 1 --2- 172.21.15.46:0/1696661597 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff20108d20 0x7eff2010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.340+0000 7eff2839f640 1 --2- 172.21.15.46:0/1696661597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff201083d0 0x7eff201087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.340+0000 7eff2839f640 1 --2- 172.21.15.46:0/1696661597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff20102a90 0x7eff20102ea0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.340+0000 7eff2839f640 1 -- 172.21.15.46:0/1696661597 >> 172.21.15.46:0/1696661597 conn(0x7eff20079720 msgr2=0x7eff20079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:37.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.340+0000 7eff2839f640 1 -- 172.21.15.46:0/1696661597 shutdown_connections 2024-09-21T04:02:37.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.340+0000 7eff2839f640 1 -- 172.21.15.46:0/1696661597 wait complete. 2024-09-21T04:02:37.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.341+0000 7eff2839f640 1 Processor -- start 2024-09-21T04:02:37.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.341+0000 7eff2839f640 1 -- start start 2024-09-21T04:02:37.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.341+0000 7eff2839f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff20102a90 0x7eff20110030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:37.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.341+0000 7eff2839f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff201083d0 0x7eff20110570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:37.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.341+0000 7eff2839f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff20108d20 0x7eff20110ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:37.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.341+0000 7eff2839f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7eff20113b00 con 0x7eff20102a90 2024-09-21T04:02:37.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.341+0000 7eff2839f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7eff20113980 con 0x7eff20108d20 2024-09-21T04:02:37.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.341+0000 7eff2839f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7eff20113c80 con 0x7eff201083d0 2024-09-21T04:02:37.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.341+0000 7eff2613b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff20102a90 0x7eff20110030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:37.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.341+0000 7eff2613b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff20102a90 0x7eff20110030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52356/0 (socket says 172.21.15.46:52356) 2024-09-21T04:02:37.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.341+0000 7eff2613b640 1 -- 172.21.15.46:0/3987182907 learned_addr learned my addr 172.21.15.46:0/3987182907 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:37.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.341+0000 7eff2593a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff201083d0 0x7eff20110570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:37.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.342+0000 7eff2693c640 1 --2- 172.21.15.46:0/3987182907 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff20108d20 0x7eff20110ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:37.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.342+0000 7eff2613b640 1 -- 172.21.15.46:0/3987182907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff201083d0 msgr2=0x7eff20110570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:37.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.342+0000 7eff2613b640 1 --2- 172.21.15.46:0/3987182907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff201083d0 0x7eff20110570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.342+0000 7eff2613b640 1 -- 172.21.15.46:0/3987182907 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff20108d20 msgr2=0x7eff20110ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:37.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.342+0000 7eff2613b640 1 --2- 172.21.15.46:0/3987182907 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff20108d20 0x7eff20110ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.342+0000 7eff2613b640 1 -- 172.21.15.46:0/3987182907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff201a8770 con 0x7eff20102a90 2024-09-21T04:02:37.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.342+0000 7eff2593a640 1 --2- 172.21.15.46:0/3987182907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff201083d0 0x7eff20110570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:02:37.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.342+0000 7eff2613b640 1 --2- 172.21.15.46:0/3987182907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff20102a90 0x7eff20110030 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7eff1c005940 tx=0x7eff1c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:37.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.342+0000 7eff177fe640 1 -- 172.21.15.46:0/3987182907 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1c03f030 con 0x7eff20102a90 2024-09-21T04:02:37.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.342+0000 7eff177fe640 1 -- 172.21.15.46:0/3987182907 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff1c003aa0 con 0x7eff20102a90 2024-09-21T04:02:37.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.342+0000 7eff2839f640 1 -- 172.21.15.46:0/3987182907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff201a8a00 con 0x7eff20102a90 2024-09-21T04:02:37.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.342+0000 7eff177fe640 1 -- 172.21.15.46:0/3987182907 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1c035070 con 0x7eff20102a90 2024-09-21T04:02:37.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.342+0000 7eff2839f640 1 -- 172.21.15.46:0/3987182907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff201a8ee0 con 0x7eff20102a90 2024-09-21T04:02:37.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.345+0000 7eff2e913740 1 Processor -- start 2024-09-21T04:02:37.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.345+0000 7eff2e913740 1 -- start start 2024-09-21T04:02:37.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.345+0000 7eff177fe640 1 -- 172.21.15.46:0/3987182907 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7eff1c042030 con 0x7eff20102a90 2024-09-21T04:02:37.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.345+0000 7eff2e913740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c7c6041350 0x55c7c63e8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:37.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.345+0000 7eff2e913740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c7c6018490 0x55c7c63e8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:37.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.345+0000 7eff2e913740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c7c6020670 0x55c7c63e8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:37.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.345+0000 7eff2e913740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55c7c635ee60 con 0x55c7c6018490 2024-09-21T04:02:37.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.345+0000 7eff2e913740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55c7c634e290 con 0x55c7c6020670 2024-09-21T04:02:37.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.345+0000 7eff2e913740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c7c63520a0 con 0x55c7c6041350 2024-09-21T04:02:37.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.346+0000 7eff2613b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c7c6018490 0x55c7c63e8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:37.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.346+0000 7eff2613b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c7c6018490 0x55c7c63e8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52372/0 (socket says 172.21.15.46:52372) 2024-09-21T04:02:37.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.346+0000 7eff2613b640 1 -- 172.21.15.46:0/1649389814 learned_addr learned my addr 172.21.15.46:0/1649389814 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:37.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.346+0000 7eff2693c640 1 --2- 172.21.15.46:0/1649389814 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c7c6041350 0x55c7c63e8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:37.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.346+0000 7eff2593a640 1 --2- 172.21.15.46:0/1649389814 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c7c6020670 0x55c7c63e8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:37.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.346+0000 7eff2613b640 1 -- 172.21.15.46:0/1649389814 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c7c6041350 msgr2=0x55c7c63e8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:37.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.346+0000 7eff2613b640 1 --2- 172.21.15.46:0/1649389814 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c7c6041350 0x55c7c63e8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.346+0000 7eff2613b640 1 -- 172.21.15.46:0/1649389814 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c7c6020670 msgr2=0x55c7c63e8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:37.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.346+0000 7eff2613b640 1 --2- 172.21.15.46:0/1649389814 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c7c6020670 0x55c7c63e8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.346+0000 7eff2613b640 1 -- 172.21.15.46:0/1649389814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7c60ac930 con 0x55c7c6018490 2024-09-21T04:02:37.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.346+0000 7eff2593a640 1 --2- 172.21.15.46:0/1649389814 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c7c6020670 0x55c7c63e8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:02:37.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.346+0000 7eff2613b640 1 --2- 172.21.15.46:0/1649389814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c7c6018490 0x55c7c63e8970 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7eff1c1052b0 tx=0x7eff1c1100e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e260cb59780d4eb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:37.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.347+0000 7eff14d9a640 1 -- 172.21.15.46:0/1649389814 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1c110920 con 0x55c7c6018490 2024-09-21T04:02:37.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.347+0000 7eff14d9a640 1 -- 172.21.15.46:0/1649389814 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff1c115070 con 0x55c7c6018490 2024-09-21T04:02:37.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.347+0000 7eff14d9a640 1 -- 172.21.15.46:0/1649389814 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1c118370 con 0x55c7c6018490 2024-09-21T04:02:37.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.347+0000 7eff177fe640 1 --2- 172.21.15.46:0/3987182907 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7eff0c0b6680 0x7eff0c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:37.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.347+0000 7eff2693c640 1 --2- 172.21.15.46:0/3987182907 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7eff0c0b6680 0x7eff0c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:37.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.347+0000 7eff177fe640 1 -- 172.21.15.46:0/3987182907 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7eff1c107b80 con 0x7eff20102a90 2024-09-21T04:02:37.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.348+0000 7eff2e913740 1 -- 172.21.15.46:0/1649389814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c7c6018490 msgr2=0x55c7c63e8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:37.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.348+0000 7eff2693c640 1 --2- 172.21.15.46:0/3987182907 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7eff0c0b6680 0x7eff0c0b8b90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7eff18005fd0 tx=0x7eff18009740 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:37.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.348+0000 7eff2e913740 1 --2- 172.21.15.46:0/1649389814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c7c6018490 0x55c7c63e8970 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7eff1c1052b0 tx=0x7eff1c1100e0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.348+0000 7eff2e913740 1 -- 172.21.15.46:0/1649389814 shutdown_connections 2024-09-21T04:02:37.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.348+0000 7eff2e913740 1 --2- 172.21.15.46:0/1649389814 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c7c6020670 0x55c7c63e8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.348+0000 7eff2e913740 1 --2- 172.21.15.46:0/1649389814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c7c6018490 0x55c7c63e8970 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.348+0000 7eff2e913740 1 --2- 172.21.15.46:0/1649389814 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c7c6041350 0x55c7c63e8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.348+0000 7eff2e913740 1 -- 172.21.15.46:0/1649389814 >> 172.21.15.46:0/1649389814 conn(0x55c7c6035740 msgr2=0x55c7c63e6320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:37.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.348+0000 7eff2e913740 1 -- 172.21.15.46:0/1649389814 shutdown_connections 2024-09-21T04:02:37.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.348+0000 7eff2e913740 1 -- 172.21.15.46:0/1649389814 wait complete. 2024-09-21T04:02:37.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.348+0000 7eff2e913740 1 -- start start 2024-09-21T04:02:37.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.348+0000 7eff2e913740 1 Processor -- start 2024-09-21T04:02:37.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.349+0000 7eff2e913740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c7c6018490 0x55c7c63f4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:37.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.349+0000 7eff2e913740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c7c6020670 0x55c7c63f4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:37.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.349+0000 7eff2e913740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c7c6041350 0x55c7c63ffc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:37.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.349+0000 7eff2e913740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55c7c61af890 con 0x55c7c6020670 2024-09-21T04:02:37.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.349+0000 7eff2e913740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55c7c62e8d40 con 0x55c7c6018490 2024-09-21T04:02:37.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.349+0000 7eff2e913740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c7c63f69d0 con 0x55c7c6041350 2024-09-21T04:02:37.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.349+0000 7eff2e913740 10 client.0 _ll_register_callbacks cb 0x55c7c634cc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:02:37.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.349+0000 7eff2593a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c7c6020670 0x55c7c63f4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:37.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.349+0000 7eff2593a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c7c6020670 0x55c7c63f4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52388/0 (socket says 172.21.15.46:52388) 2024-09-21T04:02:37.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.349+0000 7eff2593a640 1 -- 172.21.15.46:0/2312991523 learned_addr learned my addr 172.21.15.46:0/2312991523 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:37.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.349+0000 7eff2693c640 1 --2- 172.21.15.46:0/2312991523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c7c6041350 0x55c7c63ffc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:37.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.349+0000 7eff2613b640 1 --2- 172.21.15.46:0/2312991523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c7c6018490 0x55c7c63f4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:37.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.349+0000 7eff2593a640 1 -- 172.21.15.46:0/2312991523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c7c6041350 msgr2=0x55c7c63ffc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:37.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.349+0000 7eff2593a640 1 --2- 172.21.15.46:0/2312991523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c7c6041350 0x55c7c63ffc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.349+0000 7eff2593a640 1 -- 172.21.15.46:0/2312991523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c7c6018490 msgr2=0x55c7c63f4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:37.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.349+0000 7eff2593a640 1 --2- 172.21.15.46:0/2312991523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c7c6018490 0x55c7c63f4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.349+0000 7eff2593a640 1 -- 172.21.15.46:0/2312991523 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7c64001f0 con 0x55c7c6020670 2024-09-21T04:02:37.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.349+0000 7eff2613b640 1 --2- 172.21.15.46:0/2312991523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c7c6018490 0x55c7c63f4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:02:37.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.349+0000 7eff2693c640 1 --2- 172.21.15.46:0/2312991523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c7c6041350 0x55c7c63ffc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:02:37.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.349+0000 7eff2593a640 1 --2- 172.21.15.46:0/2312991523 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c7c6020670 0x55c7c63f4570 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7eff100129b0 tx=0x7eff10012e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d31f0b7fea029f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:37.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.349+0000 7eff09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:02:37.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.349+0000 7eff09ffb640 1 -- 172.21.15.46:0/2312991523 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1000fa00 con 0x55c7c6020670 2024-09-21T04:02:37.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.349+0000 7eff09ffb640 1 -- 172.21.15.46:0/2312991523 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7eff1000fba0 con 0x55c7c6020670 2024-09-21T04:02:37.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.350+0000 7eff2e913740 1 -- 172.21.15.46:0/2312991523 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff1c115070 con 0x55c7c6020670 2024-09-21T04:02:37.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.350+0000 7eff09ffb640 1 -- 172.21.15.46:0/2312991523 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7eff1000fda0 con 0x55c7c6020670 2024-09-21T04:02:37.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.350+0000 7eff2e913740 10 client.16527 fetch_fsmap learned FSMap version 20 2024-09-21T04:02:37.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.350+0000 7eff2e913740 1 -- 172.21.15.46:0/2312991523 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55c7c6402b80 con 0x55c7c6020670 2024-09-21T04:02:37.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.350+0000 7eff09ffb640 1 -- 172.21.15.46:0/2312991523 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff1c115070 con 0x55c7c6020670 2024-09-21T04:02:37.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.350+0000 7eff09ffb640 1 -- 172.21.15.46:0/2312991523 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7eff10024020 con 0x55c7c6020670 2024-09-21T04:02:37.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.350+0000 7eff2e913740 10 client.16527 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:02:37.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.350+0000 7eff2e913740 10 client.16527 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:02:37.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.350+0000 7eff2e913740 20 client.16527 populate_metadata read hostname 'smithi046' 2024-09-21T04:02:37.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.350+0000 7eff2e913740 1 --2- 172.21.15.46:0/2312991523 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55c7c5fffcd0 0x55c7c64060b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:37.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.350+0000 7eff2e913740 4 client.16527 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:02:37.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.350+0000 7eff2e913740 1 -- 172.21.15.46:0/2312991523 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c7c6360db0 con 0x55c7c5fffcd0 2024-09-21T04:02:37.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.351+0000 7eff2613b640 1 --2- 172.21.15.46:0/2312991523 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55c7c5fffcd0 0x55c7c64060b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:37.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.351+0000 7eff2613b640 1 --2- 172.21.15.46:0/2312991523 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55c7c5fffcd0 0x55c7c64060b0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98a6a81f68371fbb server_cookie=87260f6a8ae64a75 in_seq=0 out_seq=0 2024-09-21T04:02:37.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.351+0000 7eff09ffb640 10 client.16527 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:02:37.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.352+0000 7eff09ffb640 1 -- 172.21.15.46:0/2312991523 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c7c6360db0 con 0x55c7c5fffcd0 2024-09-21T04:02:37.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.352+0000 7eff09ffb640 10 client.16527 handle_command_reply: tid=0 2024-09-21T04:02:37.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.352+0000 7eff2e913740 1 client.16527 shutdown 2024-09-21T04:02:37.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.352+0000 7eff2e913740 1 -- 172.21.15.46:0/2312991523 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c7c6020670 msgr2=0x55c7c63f4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:37.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.352+0000 7eff2e913740 1 --2- 172.21.15.46:0/2312991523 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c7c6020670 0x55c7c63f4570 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7eff100129b0 tx=0x7eff10012e70 comp rx=0 tx=0).stop 2024-09-21T04:02:37.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.352+0000 7eff2e913740 1 -- 172.21.15.46:0/2312991523 shutdown_connections 2024-09-21T04:02:37.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.352+0000 7eff2e913740 1 --2- 172.21.15.46:0/2312991523 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55c7c5fffcd0 0x55c7c64060b0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.352+0000 7eff2e913740 1 --2- 172.21.15.46:0/2312991523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c7c6041350 0x55c7c63ffc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.352+0000 7eff2e913740 1 --2- 172.21.15.46:0/2312991523 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c7c6020670 0x55c7c63f4570 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.352+0000 7eff2e913740 1 --2- 172.21.15.46:0/2312991523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c7c6018490 0x55c7c63f4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.352+0000 7eff09ffb640 0 client.16527 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:02:37.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.352+0000 7eff2e913740 1 -- 172.21.15.46:0/2312991523 >> 172.21.15.46:0/2312991523 conn(0x55c7c6035740 msgr2=0x55c7c63eb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:37.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.352+0000 7eff2e913740 1 -- 172.21.15.46:0/2312991523 shutdown_connections 2024-09-21T04:02:37.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.352+0000 7eff2e913740 1 -- 172.21.15.46:0/2312991523 wait complete. 2024-09-21T04:02:37.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.353+0000 7eff2e913740 20 client.16527 trim_cache size 0 max 16384 2024-09-21T04:02:37.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.370+0000 7eff2e913740 1 Processor -- start 2024-09-21T04:02:37.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.370+0000 7eff2e913740 1 -- start start 2024-09-21T04:02:37.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.370+0000 7eff2e913740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c7c6018490 0x55c7c63ef5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:37.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.370+0000 7eff2e913740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c7c6020670 0x55c7c63ffaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:37.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.370+0000 7eff2e913740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c7c6041350 0x55c7c63e9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:37.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.370+0000 7eff2e913740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7eff201af7b0 con 0x55c7c6041350 2024-09-21T04:02:37.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.370+0000 7eff2e913740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7eff201b2010 con 0x55c7c6018490 2024-09-21T04:02:37.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.370+0000 7eff2e913740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7eff201afe00 con 0x55c7c6020670 2024-09-21T04:02:37.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.371+0000 7eff2693c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c7c6041350 0x55c7c63e9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:37.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.371+0000 7eff2693c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c7c6041350 0x55c7c63e9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52402/0 (socket says 172.21.15.46:52402) 2024-09-21T04:02:37.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.371+0000 7eff2693c640 1 -- 172.21.15.46:0/3023086909 learned_addr learned my addr 172.21.15.46:0/3023086909 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:37.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.371+0000 7eff2613b640 1 --2- 172.21.15.46:0/3023086909 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c7c6018490 0x55c7c63ef5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:37.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.371+0000 7eff2593a640 1 --2- 172.21.15.46:0/3023086909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c7c6020670 0x55c7c63ffaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:37.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.371+0000 7eff2693c640 1 -- 172.21.15.46:0/3023086909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c7c6020670 msgr2=0x55c7c63ffaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:37.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.371+0000 7eff2693c640 1 --2- 172.21.15.46:0/3023086909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c7c6020670 0x55c7c63ffaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.371+0000 7eff2693c640 1 -- 172.21.15.46:0/3023086909 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c7c6018490 msgr2=0x55c7c63ef5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:37.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.371+0000 7eff2693c640 1 --2- 172.21.15.46:0/3023086909 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c7c6018490 0x55c7c63ef5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.371+0000 7eff2693c640 1 -- 172.21.15.46:0/3023086909 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7c63eb290 con 0x55c7c6041350 2024-09-21T04:02:37.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.371+0000 7eff2613b640 1 --2- 172.21.15.46:0/3023086909 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c7c6018490 0x55c7c63ef5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:02:37.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.371+0000 7eff2593a640 1 --2- 172.21.15.46:0/3023086909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c7c6020670 0x55c7c63ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:02:37.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.371+0000 7eff2693c640 1 --2- 172.21.15.46:0/3023086909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c7c6041350 0x55c7c63e9b70 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7eff1801e760 tx=0x7eff18015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87fcfa87c35618b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:37.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.371+0000 7eff0bfff640 1 -- 172.21.15.46:0/3023086909 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1802d070 con 0x55c7c6041350 2024-09-21T04:02:37.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.371+0000 7eff0bfff640 1 -- 172.21.15.46:0/3023086909 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff18020d50 con 0x55c7c6041350 2024-09-21T04:02:37.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.371+0000 7eff0bfff640 1 -- 172.21.15.46:0/3023086909 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff180283f0 con 0x55c7c6041350 2024-09-21T04:02:37.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.372+0000 7eff2e913740 1 -- 172.21.15.46:0/3023086909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c7c6041350 msgr2=0x55c7c63e9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:37.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.372+0000 7eff2e913740 1 --2- 172.21.15.46:0/3023086909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c7c6041350 0x55c7c63e9b70 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7eff1801e760 tx=0x7eff18015000 comp rx=0 tx=0).stop 2024-09-21T04:02:37.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.372+0000 7eff2e913740 1 -- 172.21.15.46:0/3023086909 shutdown_connections 2024-09-21T04:02:37.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.372+0000 7eff2e913740 1 --2- 172.21.15.46:0/3023086909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c7c6041350 0x55c7c63e9b70 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.372+0000 7eff2e913740 1 --2- 172.21.15.46:0/3023086909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c7c6020670 0x55c7c63ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.372+0000 7eff2e913740 1 --2- 172.21.15.46:0/3023086909 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c7c6018490 0x55c7c63ef5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.372+0000 7eff2e913740 1 -- 172.21.15.46:0/3023086909 >> 172.21.15.46:0/3023086909 conn(0x55c7c6035740 msgr2=0x55c7c63e9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:37.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.372+0000 7eff2e913740 1 -- 172.21.15.46:0/3023086909 shutdown_connections 2024-09-21T04:02:37.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.372+0000 7eff2e913740 1 -- 172.21.15.46:0/3023086909 wait complete. 2024-09-21T04:02:37.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.373+0000 7eff2e913740 1 -- start start 2024-09-21T04:02:37.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.373+0000 7eff2e913740 1 Processor -- start 2024-09-21T04:02:37.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.373+0000 7eff2e913740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c7c6018490 0x55c7c63fc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:37.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.373+0000 7eff2e913740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c7c6020670 0x55c7c63f8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:37.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.373+0000 7eff2e913740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c7c6041350 0x55c7c63f9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:37.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.373+0000 7eff2e913740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7eff201b04d0 con 0x55c7c6020670 2024-09-21T04:02:37.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.373+0000 7eff2e913740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7eff201b1940 con 0x55c7c6041350 2024-09-21T04:02:37.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.373+0000 7eff2e913740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7eff201b0ba0 con 0x55c7c6018490 2024-09-21T04:02:37.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.373+0000 7eff2e913740 10 client.0 _ll_register_callbacks cb 0x7eff10009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:02:37.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.373+0000 7eff2593a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c7c6020670 0x55c7c63f8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:37.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.373+0000 7eff2593a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c7c6020670 0x55c7c63f8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52408/0 (socket says 172.21.15.46:52408) 2024-09-21T04:02:37.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.373+0000 7eff2593a640 1 -- 172.21.15.46:0/4028917286 learned_addr learned my addr 172.21.15.46:0/4028917286 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:37.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.373+0000 7eff2613b640 1 --2- 172.21.15.46:0/4028917286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c7c6018490 0x55c7c63fc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:37.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.373+0000 7eff2593a640 1 -- 172.21.15.46:0/4028917286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c7c6018490 msgr2=0x55c7c63fc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:37.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.373+0000 7eff2593a640 1 --2- 172.21.15.46:0/4028917286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c7c6018490 0x55c7c63fc520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.373+0000 7eff2593a640 1 -- 172.21.15.46:0/4028917286 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c7c6041350 msgr2=0x55c7c63f9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:37.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.373+0000 7eff2593a640 1 --2- 172.21.15.46:0/4028917286 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c7c6041350 0x55c7c63f9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.373+0000 7eff2593a640 1 -- 172.21.15.46:0/4028917286 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7c6470a80 con 0x55c7c6020670 2024-09-21T04:02:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.374+0000 7eff2593a640 1 --2- 172.21.15.46:0/4028917286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c7c6020670 0x55c7c63f8a40 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7eff10003f30 tx=0x7eff1000fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=297932da820f3080 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.374+0000 7eff09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:02:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.374+0000 7eff09ffb640 1 -- 172.21.15.46:0/4028917286 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1000f790 con 0x55c7c6020670 2024-09-21T04:02:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.374+0000 7eff09ffb640 1 -- 172.21.15.46:0/4028917286 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7eff100041c0 con 0x55c7c6020670 2024-09-21T04:02:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.374+0000 7eff2e913740 1 -- 172.21.15.46:0/4028917286 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff18020d50 con 0x55c7c6020670 2024-09-21T04:02:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.374+0000 7eff09ffb640 1 -- 172.21.15.46:0/4028917286 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7eff100043c0 con 0x55c7c6020670 2024-09-21T04:02:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.374+0000 7eff2e913740 10 client.16533 fetch_fsmap learned FSMap version 20 2024-09-21T04:02:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.374+0000 7eff2e913740 1 -- 172.21.15.46:0/4028917286 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55c7c6471b20 con 0x55c7c6020670 2024-09-21T04:02:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.374+0000 7eff09ffb640 1 -- 172.21.15.46:0/4028917286 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff18020d50 con 0x55c7c6020670 2024-09-21T04:02:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.375+0000 7eff09ffb640 1 -- 172.21.15.46:0/4028917286 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7eff10036030 con 0x55c7c6020670 2024-09-21T04:02:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.375+0000 7eff2e913740 10 client.16533 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:02:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.375+0000 7eff2e913740 10 client.16533 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:02:37.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.375+0000 7eff2e913740 20 client.16533 populate_metadata read hostname 'smithi046' 2024-09-21T04:02:37.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.375+0000 7eff2e913740 1 --2- 172.21.15.46:0/4028917286 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55c7c5fd5080 0x55c7c6474320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:37.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.375+0000 7eff2e913740 4 client.16533 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T04:02:37.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.375+0000 7eff2e913740 1 -- 172.21.15.46:0/4028917286 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c7c635c860 con 0x55c7c5fd5080 2024-09-21T04:02:37.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.375+0000 7eff2613b640 1 --2- 172.21.15.46:0/4028917286 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55c7c5fd5080 0x55c7c6474320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:37.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.376+0000 7eff2613b640 1 --2- 172.21.15.46:0/4028917286 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55c7c5fd5080 0x55c7c6474320 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2299142c5592ff81 server_cookie=cf6176b4d1ee5488 in_seq=0 out_seq=0 2024-09-21T04:02:37.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.376+0000 7eff09ffb640 10 client.16533 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:02:37.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.378+0000 7eff09ffb640 1 -- 172.21.15.46:0/4028917286 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c7c635c860 con 0x55c7c5fd5080 2024-09-21T04:02:37.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.378+0000 7eff09ffb640 10 client.16533 handle_command_reply: tid=0 2024-09-21T04:02:37.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.378+0000 7eff2e913740 1 client.16533 shutdown 2024-09-21T04:02:37.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.378+0000 7eff2e913740 1 -- 172.21.15.46:0/4028917286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c7c6020670 msgr2=0x55c7c63f8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:37.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.378+0000 7eff2e913740 1 --2- 172.21.15.46:0/4028917286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c7c6020670 0x55c7c63f8a40 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7eff10003f30 tx=0x7eff1000fc90 comp rx=0 tx=0).stop 2024-09-21T04:02:37.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.378+0000 7eff2e913740 1 -- 172.21.15.46:0/4028917286 shutdown_connections 2024-09-21T04:02:37.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.378+0000 7eff2e913740 1 --2- 172.21.15.46:0/4028917286 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55c7c5fd5080 0x55c7c6474320 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.378+0000 7eff2e913740 1 --2- 172.21.15.46:0/4028917286 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c7c6041350 0x55c7c63f9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.378+0000 7eff2e913740 1 --2- 172.21.15.46:0/4028917286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c7c6020670 0x55c7c63f8a40 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.378+0000 7eff09ffb640 0 client.16533 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:02:37.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.378+0000 7eff2e913740 1 --2- 172.21.15.46:0/4028917286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c7c6018490 0x55c7c63fc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.378+0000 7eff2e913740 1 -- 172.21.15.46:0/4028917286 >> 172.21.15.46:0/4028917286 conn(0x55c7c6035740 msgr2=0x55c7c63e9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:37.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.378+0000 7eff2e913740 1 -- 172.21.15.46:0/4028917286 shutdown_connections 2024-09-21T04:02:37.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.378+0000 7eff2e913740 1 -- 172.21.15.46:0/4028917286 wait complete. 2024-09-21T04:02:37.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.378+0000 7eff2e913740 20 client.16533 trim_cache size 0 max 16384 2024-09-21T04:02:37.383 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T04:02:37.383 INFO:teuthology.orchestra.run.smithi046.stdout: "return_code": 0, 2024-09-21T04:02:37.384 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_tag": "64865e31-a445-43e8-9fa3-26fae089b973", 2024-09-21T04:02:37.384 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": "asynchronous" 2024-09-21T04:02:37.384 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T04:02:37.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.379+0000 7eff2839f640 1 -- 172.21.15.46:0/3987182907 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7eff0c0b6680 msgr2=0x7eff0c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:37.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.379+0000 7eff2839f640 1 --2- 172.21.15.46:0/3987182907 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7eff0c0b6680 0x7eff0c0b8b90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7eff18005fd0 tx=0x7eff18009740 comp rx=0 tx=0).stop 2024-09-21T04:02:37.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.379+0000 7eff2839f640 1 -- 172.21.15.46:0/3987182907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff20102a90 msgr2=0x7eff20110030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:37.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.379+0000 7eff2839f640 1 --2- 172.21.15.46:0/3987182907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff20102a90 0x7eff20110030 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7eff1c005940 tx=0x7eff1c004270 comp rx=0 tx=0).stop 2024-09-21T04:02:37.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.379+0000 7eff2839f640 1 -- 172.21.15.46:0/3987182907 shutdown_connections 2024-09-21T04:02:37.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.379+0000 7eff2839f640 1 --2- 172.21.15.46:0/3987182907 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff20108d20 0x7eff20110ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.379+0000 7eff2839f640 1 --2- 172.21.15.46:0/3987182907 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7eff0c0b6680 0x7eff0c0b8b90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.379+0000 7eff2839f640 1 --2- 172.21.15.46:0/3987182907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff201083d0 0x7eff20110570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.379+0000 7eff2839f640 1 --2- 172.21.15.46:0/3987182907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff20102a90 0x7eff20110030 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.379+0000 7eff2839f640 1 -- 172.21.15.46:0/3987182907 >> 172.21.15.46:0/3987182907 conn(0x7eff20079720 msgr2=0x7eff20106460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:37.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.379+0000 7eff2839f640 1 -- 172.21.15.46:0/3987182907 shutdown_connections 2024-09-21T04:02:37.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:37.379+0000 7eff2839f640 1 -- 172.21.15.46:0/3987182907 wait complete. 2024-09-21T04:02:37.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:37 smithi046 ceph-mon[30954]: pgmap v549: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:02:37.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:37 smithi105 ceph-mon[34773]: pgmap v549: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:02:37.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:37 smithi162 ceph-mon[35071]: pgmap v549: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:02:38.090 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T04:02:38.353 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:38.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:38 smithi105 ceph-mon[34773]: scrub queued for path: / 2024-09-21T04:02:38.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:38 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T04:02:38.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:38 smithi105 ceph-mon[34773]: scrub summary: active paths [/] 2024-09-21T04:02:38.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:38 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T04:02:38.604 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:38 smithi046 ceph-mon[30954]: scrub queued for path: / 2024-09-21T04:02:38.604 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:38 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T04:02:38.604 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:38 smithi046 ceph-mon[30954]: scrub summary: active paths [/] 2024-09-21T04:02:38.604 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:38 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T04:02:38.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:38 smithi162 ceph-mon[35071]: scrub queued for path: / 2024-09-21T04:02:38.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:38 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T04:02:38.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:38 smithi162 ceph-mon[35071]: scrub summary: active paths [/] 2024-09-21T04:02:38.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:38 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T04:02:38.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.830+0000 7f46173ae640 1 -- 172.21.15.46:0/681484140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46101049e0 msgr2=0x7f4610104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:38.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.830+0000 7f46173ae640 1 --2- 172.21.15.46:0/681484140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46101049e0 0x7f4610104df0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f460c009900 tx=0x7f460c02a410 comp rx=0 tx=0).stop 2024-09-21T04:02:38.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.830+0000 7f46173ae640 1 -- 172.21.15.46:0/681484140 shutdown_connections 2024-09-21T04:02:38.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.830+0000 7f46173ae640 1 --2- 172.21.15.46:0/681484140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f461010de40 0x7f4610110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.830+0000 7f46173ae640 1 --2- 172.21.15.46:0/681484140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4610105330 0x7f461010d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.830+0000 7f46173ae640 1 --2- 172.21.15.46:0/681484140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46101049e0 0x7f4610104df0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.830+0000 7f46173ae640 1 -- 172.21.15.46:0/681484140 >> 172.21.15.46:0/681484140 conn(0x7f4610079750 msgr2=0x7f4610079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:38.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.830+0000 7f46173ae640 1 -- 172.21.15.46:0/681484140 shutdown_connections 2024-09-21T04:02:38.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.830+0000 7f46173ae640 1 -- 172.21.15.46:0/681484140 wait complete. 2024-09-21T04:02:38.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.831+0000 7f46173ae640 1 Processor -- start 2024-09-21T04:02:38.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.831+0000 7f46173ae640 1 -- start start 2024-09-21T04:02:38.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.831+0000 7f46173ae640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46101049e0 0x7f4610102720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:38.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.831+0000 7f46173ae640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4610105330 0x7f4610102c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:38.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.831+0000 7f46173ae640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f461010de40 0x7f46101031a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:38.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.831+0000 7f46173ae640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4610113ac0 con 0x7f4610105330 2024-09-21T04:02:38.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.831+0000 7f46173ae640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4610113940 con 0x7f461010de40 2024-09-21T04:02:38.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.831+0000 7f46173ae640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4610113c40 con 0x7f46101049e0 2024-09-21T04:02:38.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.831+0000 7f4614949640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4610105330 0x7f4610102c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:38.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.831+0000 7f4614949640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4610105330 0x7f4610102c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52426/0 (socket says 172.21.15.46:52426) 2024-09-21T04:02:38.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.831+0000 7f4614949640 1 -- 172.21.15.46:0/805429273 learned_addr learned my addr 172.21.15.46:0/805429273 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:38.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.831+0000 7f461514a640 1 --2- 172.21.15.46:0/805429273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46101049e0 0x7f4610102720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:38.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.831+0000 7f461594b640 1 --2- 172.21.15.46:0/805429273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f461010de40 0x7f46101031a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:38.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.831+0000 7f4614949640 1 -- 172.21.15.46:0/805429273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46101049e0 msgr2=0x7f4610102720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:38.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.831+0000 7f4614949640 1 --2- 172.21.15.46:0/805429273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46101049e0 0x7f4610102720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.832+0000 7f4614949640 1 -- 172.21.15.46:0/805429273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f461010de40 msgr2=0x7f46101031a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:38.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.832+0000 7f4614949640 1 --2- 172.21.15.46:0/805429273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f461010de40 0x7f46101031a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.832+0000 7f4614949640 1 -- 172.21.15.46:0/805429273 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46101a87d0 con 0x7f4610105330 2024-09-21T04:02:38.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.832+0000 7f461594b640 1 --2- 172.21.15.46:0/805429273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f461010de40 0x7f46101031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:02:38.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.832+0000 7f4614949640 1 --2- 172.21.15.46:0/805429273 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4610105330 0x7f4610102c60 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f460400d750 tx=0x7f460400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:38.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.832+0000 7f46027fc640 1 -- 172.21.15.46:0/805429273 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4604017070 con 0x7f4610105330 2024-09-21T04:02:38.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.832+0000 7f46173ae640 1 -- 172.21.15.46:0/805429273 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46101a8ac0 con 0x7f4610105330 2024-09-21T04:02:38.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.832+0000 7f46027fc640 1 -- 172.21.15.46:0/805429273 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46040054d0 con 0x7f4610105330 2024-09-21T04:02:38.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.832+0000 7f46027fc640 1 -- 172.21.15.46:0/805429273 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4604004c30 con 0x7f4610105330 2024-09-21T04:02:38.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.832+0000 7f46173ae640 1 -- 172.21.15.46:0/805429273 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46101a8fb0 con 0x7f4610105330 2024-09-21T04:02:38.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.835+0000 7f461d922740 1 Processor -- start 2024-09-21T04:02:38.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.835+0000 7f461d922740 1 -- start start 2024-09-21T04:02:38.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.835+0000 7f46027fc640 1 -- 172.21.15.46:0/805429273 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f4604004dd0 con 0x7f4610105330 2024-09-21T04:02:38.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.835+0000 7f461d922740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec690f4070 0x55ec6949b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:38.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.835+0000 7f461d922740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ec690cb1b0 0x55ec6949bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:38.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.835+0000 7f461d922740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec690d3390 0x55ec6949c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:38.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.835+0000 7f461d922740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55ec69411e50 con 0x55ec690f4070 2024-09-21T04:02:38.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.835+0000 7f461d922740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55ec69401280 con 0x55ec690cb1b0 2024-09-21T04:02:38.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.835+0000 7f461d922740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ec69405090 con 0x55ec690d3390 2024-09-21T04:02:38.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.835+0000 7f461594b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec690f4070 0x55ec6949b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:38.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.835+0000 7f461594b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec690f4070 0x55ec6949b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52438/0 (socket says 172.21.15.46:52438) 2024-09-21T04:02:38.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.835+0000 7f461594b640 1 -- 172.21.15.46:0/2274751492 learned_addr learned my addr 172.21.15.46:0/2274751492 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:38.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.836+0000 7f461514a640 1 --2- 172.21.15.46:0/2274751492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ec690cb1b0 0x55ec6949bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:38.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.836+0000 7f4614949640 1 --2- 172.21.15.46:0/2274751492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec690d3390 0x55ec6949c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:38.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.836+0000 7f461594b640 1 -- 172.21.15.46:0/2274751492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec690d3390 msgr2=0x55ec6949c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:38.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.836+0000 7f461594b640 1 --2- 172.21.15.46:0/2274751492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec690d3390 0x55ec6949c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.836+0000 7f461594b640 1 -- 172.21.15.46:0/2274751492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ec690cb1b0 msgr2=0x55ec6949bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:38.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.836+0000 7f461594b640 1 --2- 172.21.15.46:0/2274751492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ec690cb1b0 0x55ec6949bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.836+0000 7f461594b640 1 -- 172.21.15.46:0/2274751492 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec6915f650 con 0x55ec690f4070 2024-09-21T04:02:38.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.836+0000 7f461514a640 1 --2- 172.21.15.46:0/2274751492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ec690cb1b0 0x55ec6949bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:02:38.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.836+0000 7f46027fc640 1 --2- 172.21.15.46:0/805429273 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f45fc0b6680 0x7f45fc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:38.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.836+0000 7f461594b640 1 --2- 172.21.15.46:0/2274751492 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec690f4070 0x55ec6949b650 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f4608008dd0 tx=0x7f460800d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a74020692921d219 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:38.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.836+0000 7f461514a640 1 --2- 172.21.15.46:0/805429273 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f45fc0b6680 0x7f45fc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:38.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.836+0000 7f46027fc640 1 -- 172.21.15.46:0/805429273 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f46040e7170 con 0x7f4610105330 2024-09-21T04:02:38.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.837+0000 7f45fb7fe640 1 -- 172.21.15.46:0/2274751492 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460800f830 con 0x55ec690f4070 2024-09-21T04:02:38.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.837+0000 7f45fb7fe640 1 -- 172.21.15.46:0/2274751492 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f460800de20 con 0x55ec690f4070 2024-09-21T04:02:38.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.837+0000 7f45fb7fe640 1 -- 172.21.15.46:0/2274751492 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4608018e40 con 0x55ec690f4070 2024-09-21T04:02:38.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.837+0000 7f461514a640 1 --2- 172.21.15.46:0/805429273 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f45fc0b6680 0x7f45fc0b8b90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f460c009230 tx=0x7f460c005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:38.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.837+0000 7f461d922740 1 -- 172.21.15.46:0/2274751492 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec690f4070 msgr2=0x55ec6949b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:38.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.837+0000 7f461d922740 1 --2- 172.21.15.46:0/2274751492 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec690f4070 0x55ec6949b650 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f4608008dd0 tx=0x7f460800d710 comp rx=0 tx=0).stop 2024-09-21T04:02:38.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.838+0000 7f461d922740 1 -- 172.21.15.46:0/2274751492 shutdown_connections 2024-09-21T04:02:38.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.838+0000 7f461d922740 1 --2- 172.21.15.46:0/2274751492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec690d3390 0x55ec6949c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.838+0000 7f461d922740 1 --2- 172.21.15.46:0/2274751492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ec690cb1b0 0x55ec6949bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.838+0000 7f461d922740 1 --2- 172.21.15.46:0/2274751492 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec690f4070 0x55ec6949b650 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.838+0000 7f461d922740 1 -- 172.21.15.46:0/2274751492 >> 172.21.15.46:0/2274751492 conn(0x55ec690e8460 msgr2=0x55ec69499540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:38.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.838+0000 7f461d922740 1 -- 172.21.15.46:0/2274751492 shutdown_connections 2024-09-21T04:02:38.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.838+0000 7f461d922740 1 -- 172.21.15.46:0/2274751492 wait complete. 2024-09-21T04:02:38.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.838+0000 7f461d922740 1 -- start start 2024-09-21T04:02:38.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.838+0000 7f461d922740 1 Processor -- start 2024-09-21T04:02:38.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.839+0000 7f461d922740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec690cb1b0 0x55ec694a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:38.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.839+0000 7f461d922740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec690d3390 0x55ec694a7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:38.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.839+0000 7f461d922740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ec690f4070 0x55ec694b3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:38.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.839+0000 7f461d922740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55ec69262700 con 0x55ec690d3390 2024-09-21T04:02:38.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.839+0000 7f461d922740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55ec6939c110 con 0x55ec690f4070 2024-09-21T04:02:38.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.839+0000 7f461d922740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ec694a9e30 con 0x55ec690cb1b0 2024-09-21T04:02:38.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.839+0000 7f461d922740 10 client.0 _ll_register_callbacks cb 0x55ec693b5990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:02:38.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.839+0000 7f4614949640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec690d3390 0x55ec694a7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:38.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.839+0000 7f4614949640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec690d3390 0x55ec694a7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52454/0 (socket says 172.21.15.46:52454) 2024-09-21T04:02:38.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.839+0000 7f4614949640 1 -- 172.21.15.46:0/3778447198 learned_addr learned my addr 172.21.15.46:0/3778447198 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:38.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.839+0000 7f461514a640 1 --2- 172.21.15.46:0/3778447198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec690cb1b0 0x55ec694a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:38.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.839+0000 7f461594b640 1 --2- 172.21.15.46:0/3778447198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ec690f4070 0x55ec694b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:38.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.839+0000 7f4614949640 1 -- 172.21.15.46:0/3778447198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec690cb1b0 msgr2=0x55ec694a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:38.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.839+0000 7f4614949640 1 --2- 172.21.15.46:0/3778447198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec690cb1b0 0x55ec694a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.839+0000 7f4614949640 1 -- 172.21.15.46:0/3778447198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ec690f4070 msgr2=0x55ec694b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:38.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.839+0000 7f4614949640 1 --2- 172.21.15.46:0/3778447198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ec690f4070 0x55ec694b3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.839+0000 7f4614949640 1 -- 172.21.15.46:0/3778447198 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec693c9c40 con 0x55ec690d3390 2024-09-21T04:02:38.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.839+0000 7f461594b640 1 --2- 172.21.15.46:0/3778447198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ec690f4070 0x55ec694b3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:02:38.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.839+0000 7f4614949640 1 --2- 172.21.15.46:0/3778447198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec690d3390 0x55ec694a7310 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f460400d720 tx=0x7f46040acec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c4b288383775bf6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:38.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.839+0000 7f45f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:02:38.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.839+0000 7f45f8ff9640 1 -- 172.21.15.46:0/3778447198 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4604020050 con 0x55ec690d3390 2024-09-21T04:02:38.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.839+0000 7f45f8ff9640 1 -- 172.21.15.46:0/3778447198 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f46040a92a0 con 0x55ec690d3390 2024-09-21T04:02:38.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.839+0000 7f461d922740 1 -- 172.21.15.46:0/3778447198 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f460800de20 con 0x55ec690d3390 2024-09-21T04:02:38.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.840+0000 7f45f8ff9640 1 -- 172.21.15.46:0/3778447198 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f46040ad730 con 0x55ec690d3390 2024-09-21T04:02:38.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.840+0000 7f461d922740 10 client.16545 fetch_fsmap learned FSMap version 20 2024-09-21T04:02:38.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.840+0000 7f461d922740 1 -- 172.21.15.46:0/3778447198 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55ec694b5ba0 con 0x55ec690d3390 2024-09-21T04:02:38.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.840+0000 7f45f8ff9640 1 -- 172.21.15.46:0/3778447198 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f460800de20 con 0x55ec690d3390 2024-09-21T04:02:38.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.840+0000 7f45f8ff9640 1 -- 172.21.15.46:0/3778447198 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f46040a8980 con 0x55ec690d3390 2024-09-21T04:02:38.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.840+0000 7f461d922740 10 client.16545 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:02:38.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.840+0000 7f461d922740 10 client.16545 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:02:38.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.840+0000 7f461d922740 20 client.16545 populate_metadata read hostname 'smithi046' 2024-09-21T04:02:38.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.840+0000 7f461d922740 1 --2- 172.21.15.46:0/3778447198 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55ec690b29f0 0x55ec694b9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:38.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.840+0000 7f461d922740 4 client.16545 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:02:38.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.840+0000 7f461d922740 1 -- 172.21.15.46:0/3778447198 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec69413da0 con 0x55ec690b29f0 2024-09-21T04:02:38.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.841+0000 7f461514a640 1 --2- 172.21.15.46:0/3778447198 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55ec690b29f0 0x55ec694b9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:38.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.841+0000 7f461514a640 1 --2- 172.21.15.46:0/3778447198 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55ec690b29f0 0x55ec694b9090 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e308da812889a04 server_cookie=10b4a18942e374e in_seq=0 out_seq=0 2024-09-21T04:02:38.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.841+0000 7f45f8ff9640 10 client.16545 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:02:38.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.842+0000 7f45f8ff9640 1 -- 172.21.15.46:0/3778447198 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ec69413da0 con 0x55ec690b29f0 2024-09-21T04:02:38.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.842+0000 7f45f8ff9640 10 client.16545 handle_command_reply: tid=0 2024-09-21T04:02:38.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.842+0000 7f461d922740 1 client.16545 shutdown 2024-09-21T04:02:38.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.842+0000 7f461d922740 1 -- 172.21.15.46:0/3778447198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec690d3390 msgr2=0x55ec694a7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:38.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.842+0000 7f461d922740 1 --2- 172.21.15.46:0/3778447198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec690d3390 0x55ec694a7310 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f460400d720 tx=0x7f46040acec0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.842+0000 7f461d922740 1 -- 172.21.15.46:0/3778447198 shutdown_connections 2024-09-21T04:02:38.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.842+0000 7f461d922740 1 --2- 172.21.15.46:0/3778447198 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55ec690b29f0 0x55ec694b9090 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.842+0000 7f461d922740 1 --2- 172.21.15.46:0/3778447198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ec690f4070 0x55ec694b3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.842+0000 7f461d922740 1 --2- 172.21.15.46:0/3778447198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec690d3390 0x55ec694a7310 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.842+0000 7f461d922740 1 --2- 172.21.15.46:0/3778447198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec690cb1b0 0x55ec694a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.842+0000 7f45f8ff9640 0 client.16545 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:02:38.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.842+0000 7f461d922740 1 -- 172.21.15.46:0/3778447198 >> 172.21.15.46:0/3778447198 conn(0x55ec690e8460 msgr2=0x55ec6949e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:38.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.842+0000 7f461d922740 1 -- 172.21.15.46:0/3778447198 shutdown_connections 2024-09-21T04:02:38.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.842+0000 7f461d922740 1 -- 172.21.15.46:0/3778447198 wait complete. 2024-09-21T04:02:38.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.842+0000 7f461d922740 20 client.16545 trim_cache size 0 max 16384 2024-09-21T04:02:38.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.860+0000 7f461d922740 1 Processor -- start 2024-09-21T04:02:38.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.860+0000 7f461d922740 1 -- start start 2024-09-21T04:02:38.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.860+0000 7f461d922740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec690cb1b0 0x55ec6949e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:38.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.860+0000 7f461d922740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec690d3390 0x55ec6949ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:38.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.860+0000 7f461d922740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ec690f4070 0x55ec694a3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:38.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.860+0000 7f461d922740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f46101af7c0 con 0x55ec690d3390 2024-09-21T04:02:38.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.860+0000 7f461d922740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f46101b2020 con 0x55ec690f4070 2024-09-21T04:02:38.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.860+0000 7f461d922740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f46101afe10 con 0x55ec690cb1b0 2024-09-21T04:02:38.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.860+0000 7f4614949640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec690d3390 0x55ec6949ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:38.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.861+0000 7f4614949640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec690d3390 0x55ec6949ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52458/0 (socket says 172.21.15.46:52458) 2024-09-21T04:02:38.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.861+0000 7f4614949640 1 -- 172.21.15.46:0/279284468 learned_addr learned my addr 172.21.15.46:0/279284468 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:38.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.861+0000 7f461514a640 1 --2- 172.21.15.46:0/279284468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec690cb1b0 0x55ec6949e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:38.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.861+0000 7f461594b640 1 --2- 172.21.15.46:0/279284468 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ec690f4070 0x55ec694a3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:38.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.861+0000 7f4614949640 1 -- 172.21.15.46:0/279284468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec690cb1b0 msgr2=0x55ec6949e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:38.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.861+0000 7f4614949640 1 --2- 172.21.15.46:0/279284468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec690cb1b0 0x55ec6949e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.861+0000 7f4614949640 1 -- 172.21.15.46:0/279284468 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ec690f4070 msgr2=0x55ec694a3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:38.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.861+0000 7f4614949640 1 --2- 172.21.15.46:0/279284468 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ec690f4070 0x55ec694a3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.861+0000 7f4614949640 1 -- 172.21.15.46:0/279284468 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec6949db70 con 0x55ec690d3390 2024-09-21T04:02:38.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.861+0000 7f4614949640 1 --2- 172.21.15.46:0/279284468 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec690d3390 0x55ec6949ec90 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f4604009610 tx=0x7f46040a8e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ff7d97271ee5bc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:38.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.861+0000 7f45faffd640 1 -- 172.21.15.46:0/279284468 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4604014030 con 0x55ec690d3390 2024-09-21T04:02:38.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.861+0000 7f45faffd640 1 -- 172.21.15.46:0/279284468 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46040b1b10 con 0x55ec690d3390 2024-09-21T04:02:38.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.861+0000 7f45faffd640 1 -- 172.21.15.46:0/279284468 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4604020050 con 0x55ec690d3390 2024-09-21T04:02:38.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.862+0000 7f461d922740 1 -- 172.21.15.46:0/279284468 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec690d3390 msgr2=0x55ec6949ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:38.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.862+0000 7f461d922740 1 --2- 172.21.15.46:0/279284468 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec690d3390 0x55ec6949ec90 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f4604009610 tx=0x7f46040a8e30 comp rx=0 tx=0).stop 2024-09-21T04:02:38.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.862+0000 7f461d922740 1 -- 172.21.15.46:0/279284468 shutdown_connections 2024-09-21T04:02:38.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.862+0000 7f461d922740 1 --2- 172.21.15.46:0/279284468 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ec690f4070 0x55ec694a3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.862+0000 7f461d922740 1 --2- 172.21.15.46:0/279284468 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec690d3390 0x55ec6949ec90 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.862+0000 7f461d922740 1 --2- 172.21.15.46:0/279284468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec690cb1b0 0x55ec6949e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.862+0000 7f461d922740 1 -- 172.21.15.46:0/279284468 >> 172.21.15.46:0/279284468 conn(0x55ec690e8460 msgr2=0x55ec694a5650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:38.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.862+0000 7f461d922740 1 -- 172.21.15.46:0/279284468 shutdown_connections 2024-09-21T04:02:38.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.862+0000 7f461d922740 1 -- 172.21.15.46:0/279284468 wait complete. 2024-09-21T04:02:38.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.863+0000 7f461d922740 1 -- start start 2024-09-21T04:02:38.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.863+0000 7f461d922740 1 Processor -- start 2024-09-21T04:02:38.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.863+0000 7f461d922740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ec690cb1b0 0x55ec694ab040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:38.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.863+0000 7f461d922740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec690d3390 0x55ec694ab580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:38.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.863+0000 7f461d922740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec690f4070 0x55ec694abac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:38.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.863+0000 7f461d922740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f46101b04e0 con 0x55ec690d3390 2024-09-21T04:02:38.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.863+0000 7f461d922740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f46101b1950 con 0x55ec690cb1b0 2024-09-21T04:02:38.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.863+0000 7f461d922740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f46101b0bb0 con 0x55ec690f4070 2024-09-21T04:02:38.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.863+0000 7f461d922740 10 client.0 _ll_register_callbacks cb 0x7f460400de60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:02:38.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.863+0000 7f4614949640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec690d3390 0x55ec694ab580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:38.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.863+0000 7f4614949640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec690d3390 0x55ec694ab580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52472/0 (socket says 172.21.15.46:52472) 2024-09-21T04:02:38.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.863+0000 7f4614949640 1 -- 172.21.15.46:0/3541591040 learned_addr learned my addr 172.21.15.46:0/3541591040 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:38.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.864+0000 7f461514a640 1 --2- 172.21.15.46:0/3541591040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ec690cb1b0 0x55ec694ab040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:38.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.864+0000 7f461594b640 1 --2- 172.21.15.46:0/3541591040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec690f4070 0x55ec694abac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:38.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.864+0000 7f4614949640 1 -- 172.21.15.46:0/3541591040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec690f4070 msgr2=0x55ec694abac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:38.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.864+0000 7f4614949640 1 --2- 172.21.15.46:0/3541591040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec690f4070 0x55ec694abac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.864+0000 7f4614949640 1 -- 172.21.15.46:0/3541591040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ec690cb1b0 msgr2=0x55ec694ab040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:38.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.864+0000 7f4614949640 1 --2- 172.21.15.46:0/3541591040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ec690cb1b0 0x55ec694ab040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.864+0000 7f4614949640 1 -- 172.21.15.46:0/3541591040 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec6952b200 con 0x55ec690d3390 2024-09-21T04:02:38.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.864+0000 7f461514a640 1 --2- 172.21.15.46:0/3541591040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ec690cb1b0 0x55ec694ab040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:02:38.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.864+0000 7f4614949640 1 --2- 172.21.15.46:0/3541591040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec690d3390 0x55ec694ab580 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f46040e49e0 tx=0x7f46040a9000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd2edd9a2b0b7e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:38.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.864+0000 7f45f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:02:38.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.864+0000 7f45f8ff9640 1 -- 172.21.15.46:0/3541591040 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4604014070 con 0x55ec690d3390 2024-09-21T04:02:38.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.864+0000 7f45f8ff9640 1 -- 172.21.15.46:0/3541591040 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f46040ac290 con 0x55ec690d3390 2024-09-21T04:02:38.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.864+0000 7f461d922740 1 -- 172.21.15.46:0/3541591040 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46040b1b10 con 0x55ec690d3390 2024-09-21T04:02:38.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.864+0000 7f45f8ff9640 1 -- 172.21.15.46:0/3541591040 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4604020070 con 0x55ec690d3390 2024-09-21T04:02:38.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.864+0000 7f461d922740 10 client.16551 fetch_fsmap learned FSMap version 20 2024-09-21T04:02:38.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.864+0000 7f461d922740 1 -- 172.21.15.46:0/3541591040 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55ec6952c420 con 0x55ec690d3390 2024-09-21T04:02:38.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.865+0000 7f45f8ff9640 1 -- 172.21.15.46:0/3541591040 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46040b1b10 con 0x55ec690d3390 2024-09-21T04:02:38.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.865+0000 7f45f8ff9640 1 -- 172.21.15.46:0/3541591040 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f46040abd00 con 0x55ec690d3390 2024-09-21T04:02:38.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.865+0000 7f461d922740 10 client.16551 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:02:38.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.865+0000 7f461d922740 10 client.16551 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:02:38.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.865+0000 7f461d922740 20 client.16551 populate_metadata read hostname 'smithi046' 2024-09-21T04:02:38.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.865+0000 7f461d922740 1 --2- 172.21.15.46:0/3541591040 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55ec69087da0 0x55ec6952e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:38.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.865+0000 7f461d922740 4 client.16551 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T04:02:38.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.865+0000 7f461d922740 1 -- 172.21.15.46:0/3541591040 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ec6940f850 con 0x55ec69087da0 2024-09-21T04:02:38.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.865+0000 7f461514a640 1 --2- 172.21.15.46:0/3541591040 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55ec69087da0 0x55ec6952e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:38.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.866+0000 7f461514a640 1 --2- 172.21.15.46:0/3541591040 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55ec69087da0 0x55ec6952e860 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f33e3dff29bb345a server_cookie=1103924fbee78e3b in_seq=0 out_seq=0 2024-09-21T04:02:38.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.866+0000 7f45f8ff9640 10 client.16551 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:02:38.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.866+0000 7f45f8ff9640 1 -- 172.21.15.46:0/3541591040 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4350 (crc 0 0 0) 0x55ec6940f850 con 0x55ec69087da0 2024-09-21T04:02:38.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.866+0000 7f45f8ff9640 10 client.16551 handle_command_reply: tid=0 2024-09-21T04:02:38.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.866+0000 7f461d922740 1 client.16551 shutdown 2024-09-21T04:02:38.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.866+0000 7f461d922740 1 -- 172.21.15.46:0/3541591040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec690d3390 msgr2=0x55ec694ab580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:38.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.866+0000 7f461d922740 1 --2- 172.21.15.46:0/3541591040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec690d3390 0x55ec694ab580 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f46040e49e0 tx=0x7f46040a9000 comp rx=0 tx=0).stop 2024-09-21T04:02:38.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.866+0000 7f461d922740 1 -- 172.21.15.46:0/3541591040 shutdown_connections 2024-09-21T04:02:38.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.866+0000 7f461d922740 1 --2- 172.21.15.46:0/3541591040 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55ec69087da0 0x55ec6952e860 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.866+0000 7f461d922740 1 --2- 172.21.15.46:0/3541591040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec690f4070 0x55ec694abac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.866+0000 7f461d922740 1 --2- 172.21.15.46:0/3541591040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ec690d3390 0x55ec694ab580 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.866+0000 7f461d922740 1 --2- 172.21.15.46:0/3541591040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ec690cb1b0 0x55ec694ab040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.866+0000 7f461d922740 1 -- 172.21.15.46:0/3541591040 >> 172.21.15.46:0/3541591040 conn(0x55ec690e8460 msgr2=0x55ec6949e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:38.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.866+0000 7f45f8ff9640 0 client.16551 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:02:38.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.866+0000 7f461d922740 1 -- 172.21.15.46:0/3541591040 shutdown_connections 2024-09-21T04:02:38.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.866+0000 7f461d922740 1 -- 172.21.15.46:0/3541591040 wait complete. 2024-09-21T04:02:38.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.866+0000 7f461d922740 20 client.16551 trim_cache size 0 max 16384 2024-09-21T04:02:38.875 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T04:02:38.875 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "no active scrubs running", 2024-09-21T04:02:38.875 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": {}, 2024-09-21T04:02:38.875 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_stats": { 2024-09-21T04:02:38.875 INFO:teuthology.orchestra.run.smithi046.stdout: "64865e31-a445-43e8-9fa3-26fae089b973": { 2024-09-21T04:02:38.875 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:02:37.376562+0000", 2024-09-21T04:02:38.875 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:38.875 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:38.875 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:38.875 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:38.875 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:38.876 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:38.876 INFO:teuthology.orchestra.run.smithi046.stdout: "7a3afabe-6b27-4bce-928a-8c6773a85803": { 2024-09-21T04:02:38.876 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:01:58.413358+0000", 2024-09-21T04:02:38.876 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:38.876 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:38.876 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:38.876 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:38.876 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:38.876 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:38.877 INFO:teuthology.orchestra.run.smithi046.stdout: "08f0c962-df1a-4129-a1a2-b916240d9803": { 2024-09-21T04:02:38.877 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:02.937596+0000", 2024-09-21T04:02:38.877 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:38.877 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:38.877 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:38.877 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:38.877 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:38.877 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:38.877 INFO:teuthology.orchestra.run.smithi046.stdout: "d49f33a7-3d5a-421b-94ba-8b19a4120db1": { 2024-09-21T04:02:38.878 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:50.480786+0000", 2024-09-21T04:02:38.878 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:38.878 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:38.878 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:38.878 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:38.878 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:38.878 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:38.878 INFO:teuthology.orchestra.run.smithi046.stdout: "a871f724-0198-493c-b03e-b2de78aba243": { 2024-09-21T04:02:38.878 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:56:30.082991+0000", 2024-09-21T04:02:38.878 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:38.878 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:38.878 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:38.879 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:38.879 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:38.879 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:38.879 INFO:teuthology.orchestra.run.smithi046.stdout: "edc4b8c7-b702-489d-a925-ae7ad0ff0d9a": { 2024-09-21T04:02:38.879 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:00:40.181950+0000", 2024-09-21T04:02:38.879 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:38.879 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:38.879 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:38.879 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:38.879 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:38.879 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:38.879 INFO:teuthology.orchestra.run.smithi046.stdout: "3bbf7097-70d7-4743-bbce-41465502b35b": { 2024-09-21T04:02:38.879 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:10.661441+0000", 2024-09-21T04:02:38.880 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:38.880 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:38.880 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:38.880 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:38.880 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:38.880 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:38.880 INFO:teuthology.orchestra.run.smithi046.stdout: "e24ec8f1-0d13-478f-9c2c-b51798868ffc": { 2024-09-21T04:02:38.880 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:09.736194+0000", 2024-09-21T04:02:38.880 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:38.880 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:38.880 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:38.880 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:38.880 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:38.881 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:38.881 INFO:teuthology.orchestra.run.smithi046.stdout: "c47f458a-de5e-4952-a575-a81261953667": { 2024-09-21T04:02:38.881 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:48.699411+0000", 2024-09-21T04:02:38.881 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:38.881 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:38.881 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:38.881 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:38.881 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:38.881 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:38.881 INFO:teuthology.orchestra.run.smithi046.stdout: "6103c660-8e77-4b06-ad6c-bb322c26035a": { 2024-09-21T04:02:38.881 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:35.594467+0000", 2024-09-21T04:02:38.881 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:38.881 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:38.881 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:38.882 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:38.882 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:38.882 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:38.882 INFO:teuthology.orchestra.run.smithi046.stdout: "46bb5415-6e16-47c6-a1e4-55f9c623ce90": { 2024-09-21T04:02:38.882 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:14.950674+0000", 2024-09-21T04:02:38.882 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:38.882 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:38.882 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:38.882 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:38.882 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:38.882 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:38.882 INFO:teuthology.orchestra.run.smithi046.stdout: "326aaecf-f38a-4946-988a-d83f25556995": { 2024-09-21T04:02:38.882 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:54.189884+0000", 2024-09-21T04:02:38.882 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:38.883 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:38.883 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:38.883 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:38.883 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:38.883 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:38.883 INFO:teuthology.orchestra.run.smithi046.stdout: "dab67652-8894-4711-be64-cbdfea27a9ba": { 2024-09-21T04:02:38.883 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:28.161616+0000", 2024-09-21T04:02:38.883 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:38.883 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:38.883 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:38.883 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:38.883 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:38.883 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:38.884 INFO:teuthology.orchestra.run.smithi046.stdout: "0d781b95-cf5e-46f2-9875-2923181385e2": { 2024-09-21T04:02:38.884 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:00:33.099094+0000", 2024-09-21T04:02:38.884 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:38.884 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:38.884 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:38.884 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:38.884 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:38.884 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:38.884 INFO:teuthology.orchestra.run.smithi046.stdout: "d7634007-e881-46f7-9833-ac9bd0a3100e": { 2024-09-21T04:02:38.884 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:01:19.459151+0000", 2024-09-21T04:02:38.884 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:38.884 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:38.884 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:38.884 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:38.884 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:38.885 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:02:38.885 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:02:38.885 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T04:02:38.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.867+0000 7f46173ae640 1 -- 172.21.15.46:0/805429273 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f45fc0b6680 msgr2=0x7f45fc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:38.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.867+0000 7f46173ae640 1 --2- 172.21.15.46:0/805429273 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f45fc0b6680 0x7f45fc0b8b90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f460c009230 tx=0x7f460c005e80 comp rx=0 tx=0).stop 2024-09-21T04:02:38.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.867+0000 7f46173ae640 1 -- 172.21.15.46:0/805429273 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4610105330 msgr2=0x7f4610102c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:38.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.867+0000 7f46173ae640 1 --2- 172.21.15.46:0/805429273 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4610105330 0x7f4610102c60 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f460400d750 tx=0x7f460400dc10 comp rx=0 tx=0).stop 2024-09-21T04:02:38.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.867+0000 7f46173ae640 1 -- 172.21.15.46:0/805429273 shutdown_connections 2024-09-21T04:02:38.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.867+0000 7f46173ae640 1 --2- 172.21.15.46:0/805429273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f461010de40 0x7f46101031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.867+0000 7f46173ae640 1 --2- 172.21.15.46:0/805429273 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4610105330 0x7f4610102c60 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.867+0000 7f46173ae640 1 --2- 172.21.15.46:0/805429273 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f45fc0b6680 0x7f45fc0b8b90 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.867+0000 7f46173ae640 1 --2- 172.21.15.46:0/805429273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46101049e0 0x7f4610102720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.867+0000 7f46173ae640 1 -- 172.21.15.46:0/805429273 >> 172.21.15.46:0/805429273 conn(0x7f4610079750 msgr2=0x7f4610100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:38.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.867+0000 7f46173ae640 1 -- 172.21.15.46:0/805429273 shutdown_connections 2024-09-21T04:02:38.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:38.867+0000 7f46173ae640 1 -- 172.21.15.46:0/805429273 wait complete. 2024-09-21T04:02:39.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:39 smithi046 ceph-mon[30954]: pgmap v550: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2 op/s 2024-09-21T04:02:39.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:39 smithi046 ceph-mon[30954]: scrub summary: idle 2024-09-21T04:02:39.558 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T04:02:39.558 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:02:39.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:39 smithi105 ceph-mon[34773]: pgmap v550: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2 op/s 2024-09-21T04:02:39.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:39 smithi105 ceph-mon[34773]: scrub summary: idle 2024-09-21T04:02:39.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:39 smithi162 ceph-mon[35071]: pgmap v550: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2 op/s 2024-09-21T04:02:39.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:39 smithi162 ceph-mon[35071]: scrub summary: idle 2024-09-21T04:02:39.818 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:40.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.381+0000 7f82ddd3c640 1 -- 172.21.15.46:0/1293561194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82d8103b90 msgr2=0x7f82d8103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:40.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.381+0000 7f82ddd3c640 1 --2- 172.21.15.46:0/1293561194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82d8103b90 0x7f82d8103fa0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f82c8009900 tx=0x7f82c802a410 comp rx=0 tx=0).stop 2024-09-21T04:02:40.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.381+0000 7f82ddd3c640 1 -- 172.21.15.46:0/1293561194 shutdown_connections 2024-09-21T04:02:40.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.381+0000 7f82ddd3c640 1 --2- 172.21.15.46:0/1293561194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82d8109e20 0x7f82d8110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:40.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.381+0000 7f82ddd3c640 1 --2- 172.21.15.46:0/1293561194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82d81094d0 0x7f82d81098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:40.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.381+0000 7f82ddd3c640 1 --2- 172.21.15.46:0/1293561194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82d8103b90 0x7f82d8103fa0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:40.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.381+0000 7f82ddd3c640 1 -- 172.21.15.46:0/1293561194 >> 172.21.15.46:0/1293561194 conn(0x7f82d80ff600 msgr2=0x7f82d8101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:40.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.381+0000 7f82ddd3c640 1 -- 172.21.15.46:0/1293561194 shutdown_connections 2024-09-21T04:02:40.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.381+0000 7f82ddd3c640 1 -- 172.21.15.46:0/1293561194 wait complete. 2024-09-21T04:02:40.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.382+0000 7f82ddd3c640 1 Processor -- start 2024-09-21T04:02:40.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.382+0000 7f82ddd3c640 1 -- start start 2024-09-21T04:02:40.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.382+0000 7f82ddd3c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82d8103b90 0x7f82d819a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:40.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.382+0000 7f82ddd3c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82d81094d0 0x7f82d819aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:40.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.382+0000 7f82ddd3c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82d8109e20 0x7f82d819fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:40.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.382+0000 7f82ddd3c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f82d8113ae0 con 0x7f82d8103b90 2024-09-21T04:02:40.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.382+0000 7f82ddd3c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f82d8113960 con 0x7f82d81094d0 2024-09-21T04:02:40.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.382+0000 7f82ddd3c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f82d8113c60 con 0x7f82d8109e20 2024-09-21T04:02:40.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.382+0000 7f82d77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82d8103b90 0x7f82d819a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:40.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.382+0000 7f82d77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82d8103b90 0x7f82d819a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52484/0 (socket says 172.21.15.46:52484) 2024-09-21T04:02:40.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.382+0000 7f82d77fe640 1 -- 172.21.15.46:0/4232505555 learned_addr learned my addr 172.21.15.46:0/4232505555 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:40.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.383+0000 7f82d6ffd640 1 --2- 172.21.15.46:0/4232505555 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82d81094d0 0x7f82d819aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:40.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.383+0000 7f82d7fff640 1 --2- 172.21.15.46:0/4232505555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82d8109e20 0x7f82d819fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:40.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.383+0000 7f82d77fe640 1 -- 172.21.15.46:0/4232505555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82d8109e20 msgr2=0x7f82d819fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:40.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.383+0000 7f82d77fe640 1 --2- 172.21.15.46:0/4232505555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82d8109e20 0x7f82d819fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:40.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.383+0000 7f82d77fe640 1 -- 172.21.15.46:0/4232505555 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82d81094d0 msgr2=0x7f82d819aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:40.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.383+0000 7f82d77fe640 1 --2- 172.21.15.46:0/4232505555 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82d81094d0 0x7f82d819aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:40.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.383+0000 7f82d77fe640 1 -- 172.21.15.46:0/4232505555 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d81a0360 con 0x7f82d8103b90 2024-09-21T04:02:40.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.383+0000 7f82d6ffd640 1 --2- 172.21.15.46:0/4232505555 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82d81094d0 0x7f82d819aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:02:40.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.383+0000 7f82d77fe640 1 --2- 172.21.15.46:0/4232505555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82d8103b90 0x7f82d819a4b0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f82c8006010 tx=0x7f82c80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:40.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.383+0000 7f82d4ff9640 1 -- 172.21.15.46:0/4232505555 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c803f030 con 0x7f82d8103b90 2024-09-21T04:02:40.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.383+0000 7f82ddd3c640 1 -- 172.21.15.46:0/4232505555 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82d81a05f0 con 0x7f82d8103b90 2024-09-21T04:02:40.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.383+0000 7f82d4ff9640 1 -- 172.21.15.46:0/4232505555 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82c8003800 con 0x7f82d8103b90 2024-09-21T04:02:40.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.383+0000 7f82d4ff9640 1 -- 172.21.15.46:0/4232505555 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c8035070 con 0x7f82d8103b90 2024-09-21T04:02:40.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.383+0000 7f82ddd3c640 1 -- 172.21.15.46:0/4232505555 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82d81a0ad0 con 0x7f82d8103b90 2024-09-21T04:02:40.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.385+0000 7f82ddd3c640 1 -- 172.21.15.46:0/4232505555 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82d8103fa0 con 0x7f82d8103b90 2024-09-21T04:02:40.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.386+0000 7f82d4ff9640 1 -- 172.21.15.46:0/4232505555 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f82c8003cb0 con 0x7f82d8103b90 2024-09-21T04:02:40.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.387+0000 7f82d4ff9640 1 --2- 172.21.15.46:0/4232505555 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f82c00b66b0 0x7f82c00b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:40.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.387+0000 7f82d6ffd640 1 --2- 172.21.15.46:0/4232505555 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f82c00b66b0 0x7f82c00b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:40.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.387+0000 7f82d4ff9640 1 -- 172.21.15.46:0/4232505555 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f82c8108180 con 0x7f82d8103b90 2024-09-21T04:02:40.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.387+0000 7f82d6ffd640 1 --2- 172.21.15.46:0/4232505555 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f82c00b66b0 0x7f82c00b8bc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f82d8108ea0 tx=0x7f82cc005d90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:40.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.391+0000 7f82d4ff9640 1 -- 172.21.15.46:0/4232505555 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f82c80ce6e0 con 0x7f82d8103b90 2024-09-21T04:02:40.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.620+0000 7f82ddd3c640 1 -- 172.21.15.46:0/4232505555 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f82d802e640 con 0x7f82d8103b90 2024-09-21T04:02:40.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.621+0000 7f82d4ff9640 1 -- 172.21.15.46:0/4232505555 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f82c80d2ac0 con 0x7f82d8103b90 2024-09-21T04:02:40.624 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T04:02:40.624 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"btime":"2024-09-21T03:53:23:865820+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1766354184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1766354184},{"type":"v1","addr":"172.21.15.46:6839","nonce":1766354184}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/1901774207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":1901774207},{"type":"v1","addr":"172.21.15.46:6841","nonce":1901774207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3548633196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":3548633196},{"type":"v1","addr":"172.21.15.105:6837","nonce":3548633196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24652,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3551934241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3551934241},{"type":"v1","addr":"172.21.15.162:6835","nonce":3551934241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/48949822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":48949822},{"type":"v1","addr":"172.21.15.162:6837","nonce":48949822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:53:14.452819+0000","modified":"2024-09-21T03:53:23.593278+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24680},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/2196053213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2196053213},{"type":"v1","addr":"172.21.15.162:6839","nonce":2196053213}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.105:6839/3911438406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":3911438406},{"type":"v1","addr":"172.21.15.105:6839","nonce":3911438406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24680,"qdb_cluster":[24680]},"id":1}]} 2024-09-21T04:02:40.624 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T04:02:40.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.624+0000 7f82ddd3c640 1 -- 172.21.15.46:0/4232505555 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f82c00b66b0 msgr2=0x7f82c00b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:40.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.624+0000 7f82ddd3c640 1 --2- 172.21.15.46:0/4232505555 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f82c00b66b0 0x7f82c00b8bc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f82d8108ea0 tx=0x7f82cc005d90 comp rx=0 tx=0).stop 2024-09-21T04:02:40.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.624+0000 7f82ddd3c640 1 -- 172.21.15.46:0/4232505555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82d8103b90 msgr2=0x7f82d819a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:40.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.624+0000 7f82ddd3c640 1 --2- 172.21.15.46:0/4232505555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82d8103b90 0x7f82d819a4b0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f82c8006010 tx=0x7f82c80042f0 comp rx=0 tx=0).stop 2024-09-21T04:02:40.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.624+0000 7f82ddd3c640 1 -- 172.21.15.46:0/4232505555 shutdown_connections 2024-09-21T04:02:40.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.624+0000 7f82ddd3c640 1 --2- 172.21.15.46:0/4232505555 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f82c00b66b0 0x7f82c00b8bc0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:40.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.624+0000 7f82ddd3c640 1 --2- 172.21.15.46:0/4232505555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82d8109e20 0x7f82d819fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:40.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.624+0000 7f82ddd3c640 1 --2- 172.21.15.46:0/4232505555 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82d81094d0 0x7f82d819aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:40.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.624+0000 7f82ddd3c640 1 --2- 172.21.15.46:0/4232505555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82d8103b90 0x7f82d819a4b0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:40.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.624+0000 7f82ddd3c640 1 -- 172.21.15.46:0/4232505555 >> 172.21.15.46:0/4232505555 conn(0x7f82d80ff600 msgr2=0x7f82d8101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:40.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.625+0000 7f82ddd3c640 1 -- 172.21.15.46:0/4232505555 shutdown_connections 2024-09-21T04:02:40.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:40.625+0000 7f82ddd3c640 1 -- 172.21.15.46:0/4232505555 wait complete. 2024-09-21T04:02:41.293 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T04:02:41.551 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:41.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:41 smithi105 ceph-mon[34773]: pgmap v551: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-21T04:02:41.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:41 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/4232505555' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:02:41.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:41 smithi162 ceph-mon[35071]: pgmap v551: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-21T04:02:41.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:41 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/4232505555' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:02:41.672 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:41 smithi046 ceph-mon[30954]: pgmap v551: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-21T04:02:41.672 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:41 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/4232505555' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:02:42.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.049+0000 7f768a75d640 1 -- 172.21.15.46:0/3852781580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7684102a80 msgr2=0x7f7684102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:42.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.049+0000 7f768a75d640 1 --2- 172.21.15.46:0/3852781580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7684102a80 0x7f7684102e90 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f7674009900 tx=0x7f767402a410 comp rx=0 tx=0).stop 2024-09-21T04:02:42.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.049+0000 7f768a75d640 1 -- 172.21.15.46:0/3852781580 shutdown_connections 2024-09-21T04:02:42.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.049+0000 7f768a75d640 1 --2- 172.21.15.46:0/3852781580 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7684108d10 0x7f768410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.049+0000 7f768a75d640 1 --2- 172.21.15.46:0/3852781580 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76841083c0 0x7f76841087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.049+0000 7f768a75d640 1 --2- 172.21.15.46:0/3852781580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7684102a80 0x7f7684102e90 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.049+0000 7f768a75d640 1 -- 172.21.15.46:0/3852781580 >> 172.21.15.46:0/3852781580 conn(0x7f7684079740 msgr2=0x7f7684079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:42.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.049+0000 7f768a75d640 1 -- 172.21.15.46:0/3852781580 shutdown_connections 2024-09-21T04:02:42.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.049+0000 7f768a75d640 1 -- 172.21.15.46:0/3852781580 wait complete. 2024-09-21T04:02:42.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.050+0000 7f768a75d640 1 Processor -- start 2024-09-21T04:02:42.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.050+0000 7f768a75d640 1 -- start start 2024-09-21T04:02:42.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.050+0000 7f768a75d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7684102a80 0x7f768419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:42.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.050+0000 7f768a75d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76841083c0 0x7f768419aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:42.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.050+0000 7f768a75d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7684108d10 0x7f768419fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:42.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.050+0000 7f768a75d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7684113b70 con 0x7f7684102a80 2024-09-21T04:02:42.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.050+0000 7f768a75d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f76841139f0 con 0x7f7684108d10 2024-09-21T04:02:42.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.050+0000 7f768a75d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7684113cf0 con 0x7f76841083c0 2024-09-21T04:02:42.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.051+0000 7f7683fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7684102a80 0x7f768419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:42.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.051+0000 7f7683fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7684102a80 0x7f768419a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39002/0 (socket says 172.21.15.46:39002) 2024-09-21T04:02:42.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.051+0000 7f7683fff640 1 -- 172.21.15.46:0/2176053848 learned_addr learned my addr 172.21.15.46:0/2176053848 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:42.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.051+0000 7f76837fe640 1 --2- 172.21.15.46:0/2176053848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76841083c0 0x7f768419aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:42.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.051+0000 7f7688cfa640 1 --2- 172.21.15.46:0/2176053848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7684108d10 0x7f768419fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:42.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.051+0000 7f7683fff640 1 -- 172.21.15.46:0/2176053848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76841083c0 msgr2=0x7f768419aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:42.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.051+0000 7f7683fff640 1 --2- 172.21.15.46:0/2176053848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76841083c0 0x7f768419aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.051+0000 7f7683fff640 1 -- 172.21.15.46:0/2176053848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7684108d10 msgr2=0x7f768419fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:42.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.051+0000 7f7683fff640 1 --2- 172.21.15.46:0/2176053848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7684108d10 0x7f768419fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.051+0000 7f7683fff640 1 -- 172.21.15.46:0/2176053848 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76841a0340 con 0x7f7684102a80 2024-09-21T04:02:42.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.051+0000 7f7688cfa640 1 --2- 172.21.15.46:0/2176053848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7684108d10 0x7f768419fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:02:42.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.051+0000 7f7683fff640 1 --2- 172.21.15.46:0/2176053848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7684102a80 0x7f768419a490 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f7674005940 tx=0x7f76740042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:42.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.051+0000 7f76817fa640 1 -- 172.21.15.46:0/2176053848 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767403f030 con 0x7f7684102a80 2024-09-21T04:02:42.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.051+0000 7f76817fa640 1 -- 172.21.15.46:0/2176053848 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7674003cb0 con 0x7f7684102a80 2024-09-21T04:02:42.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.051+0000 7f768a75d640 1 -- 172.21.15.46:0/2176053848 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76841a05d0 con 0x7f7684102a80 2024-09-21T04:02:42.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.051+0000 7f76817fa640 1 -- 172.21.15.46:0/2176053848 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7674035070 con 0x7f7684102a80 2024-09-21T04:02:42.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.051+0000 7f768a75d640 1 -- 172.21.15.46:0/2176053848 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76841a0ab0 con 0x7f7684102a80 2024-09-21T04:02:42.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.054+0000 7f7690cd1740 1 Processor -- start 2024-09-21T04:02:42.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.054+0000 7f7690cd1740 1 -- start start 2024-09-21T04:02:42.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.054+0000 7f7690cd1740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555627978070 0x555627d1f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:42.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.054+0000 7f7690cd1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55562794f1b0 0x555627d1fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:42.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.054+0000 7f7690cd1740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555627957390 0x555627d20120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:42.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.054+0000 7f76817fa640 1 -- 172.21.15.46:0/2176053848 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f7674042030 con 0x7f7684102a80 2024-09-21T04:02:42.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.054+0000 7f7690cd1740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x555627c95ea0 con 0x555627957390 2024-09-21T04:02:42.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.054+0000 7f7690cd1740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x555627c852d0 con 0x555627978070 2024-09-21T04:02:42.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.054+0000 7f7690cd1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555627c890e0 con 0x55562794f1b0 2024-09-21T04:02:42.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.054+0000 7f76837fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555627957390 0x555627d20120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:42.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.054+0000 7f76837fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555627957390 0x555627d20120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39014/0 (socket says 172.21.15.46:39014) 2024-09-21T04:02:42.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.054+0000 7f76837fe640 1 -- 172.21.15.46:0/3582731133 learned_addr learned my addr 172.21.15.46:0/3582731133 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:42.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.054+0000 7f7688cfa640 1 --2- 172.21.15.46:0/3582731133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555627978070 0x555627d1f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:42.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.055+0000 7f7683fff640 1 --2- 172.21.15.46:0/3582731133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55562794f1b0 0x555627d1fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:42.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.055+0000 7f76837fe640 1 -- 172.21.15.46:0/3582731133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55562794f1b0 msgr2=0x555627d1fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:42.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.055+0000 7f76837fe640 1 --2- 172.21.15.46:0/3582731133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55562794f1b0 0x555627d1fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.055+0000 7f76837fe640 1 -- 172.21.15.46:0/3582731133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555627978070 msgr2=0x555627d1f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:42.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.055+0000 7f76837fe640 1 --2- 172.21.15.46:0/3582731133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555627978070 0x555627d1f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.055+0000 7f76837fe640 1 -- 172.21.15.46:0/3582731133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556279e3650 con 0x555627957390 2024-09-21T04:02:42.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.055+0000 7f76837fe640 1 --2- 172.21.15.46:0/3582731133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555627957390 0x555627d20120 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f767800bcd0 tx=0x7f76780107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a1765d3e3f710a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:42.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.055+0000 7f766a7fc640 1 -- 172.21.15.46:0/3582731133 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767801c480 con 0x555627957390 2024-09-21T04:02:42.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.055+0000 7f766a7fc640 1 -- 172.21.15.46:0/3582731133 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f767801cad0 con 0x555627957390 2024-09-21T04:02:42.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.055+0000 7f766a7fc640 1 -- 172.21.15.46:0/3582731133 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7678011bb0 con 0x555627957390 2024-09-21T04:02:42.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.056+0000 7f76817fa640 1 --2- 172.21.15.46:0/2176053848 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f766c0b66b0 0x7f766c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:42.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.056+0000 7f7688cfa640 1 --2- 172.21.15.46:0/2176053848 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f766c0b66b0 0x7f766c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:42.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.056+0000 7f76817fa640 1 -- 172.21.15.46:0/2176053848 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f7674107c00 con 0x7f7684102a80 2024-09-21T04:02:42.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.056+0000 7f7690cd1740 1 -- 172.21.15.46:0/3582731133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555627957390 msgr2=0x555627d20120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:42.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.056+0000 7f7688cfa640 1 --2- 172.21.15.46:0/2176053848 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f766c0b66b0 0x7f766c0b8bc0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f767c007f10 tx=0x7f767c0076a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:42.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.056+0000 7f7690cd1740 1 --2- 172.21.15.46:0/3582731133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555627957390 0x555627d20120 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f767800bcd0 tx=0x7f76780107a0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.056+0000 7f7690cd1740 1 -- 172.21.15.46:0/3582731133 shutdown_connections 2024-09-21T04:02:42.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.056+0000 7f7690cd1740 1 --2- 172.21.15.46:0/3582731133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555627957390 0x555627d20120 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.056+0000 7f7690cd1740 1 --2- 172.21.15.46:0/3582731133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55562794f1b0 0x555627d1fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.056+0000 7f7690cd1740 1 --2- 172.21.15.46:0/3582731133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555627978070 0x555627d1f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.056+0000 7f7690cd1740 1 -- 172.21.15.46:0/3582731133 >> 172.21.15.46:0/3582731133 conn(0x55562796c460 msgr2=0x555627d1d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:42.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.056+0000 7f7690cd1740 1 -- 172.21.15.46:0/3582731133 shutdown_connections 2024-09-21T04:02:42.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.056+0000 7f7690cd1740 1 -- 172.21.15.46:0/3582731133 wait complete. 2024-09-21T04:02:42.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.057+0000 7f7690cd1740 1 -- start start 2024-09-21T04:02:42.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.057+0000 7f7690cd1740 1 Processor -- start 2024-09-21T04:02:42.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.057+0000 7f7690cd1740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55562794f1b0 0x555627d2f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:42.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.057+0000 7f7690cd1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555627957390 0x555627d2f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:42.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.057+0000 7f7690cd1740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555627978070 0x555627d3b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:42.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.057+0000 7f7690cd1740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x555627ae6700 con 0x555627978070 2024-09-21T04:02:42.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.057+0000 7f7690cd1740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x555627c20160 con 0x55562794f1b0 2024-09-21T04:02:42.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.057+0000 7f7690cd1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555627d321e0 con 0x555627957390 2024-09-21T04:02:42.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.057+0000 7f7690cd1740 10 client.0 _ll_register_callbacks cb 0x555627c399e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:02:42.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.057+0000 7f7688cfa640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555627978070 0x555627d3b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:42.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.058+0000 7f7688cfa640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555627978070 0x555627d3b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39020/0 (socket says 172.21.15.46:39020) 2024-09-21T04:02:42.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.058+0000 7f7688cfa640 1 -- 172.21.15.46:0/3912340425 learned_addr learned my addr 172.21.15.46:0/3912340425 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:42.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.058+0000 7f7683fff640 1 --2- 172.21.15.46:0/3912340425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55562794f1b0 0x555627d2f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:42.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.058+0000 7f76837fe640 1 --2- 172.21.15.46:0/3912340425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555627957390 0x555627d2f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:42.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.058+0000 7f7688cfa640 1 -- 172.21.15.46:0/3912340425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555627957390 msgr2=0x555627d2f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:42.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.058+0000 7f7688cfa640 1 --2- 172.21.15.46:0/3912340425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555627957390 0x555627d2f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.058+0000 7f7688cfa640 1 -- 172.21.15.46:0/3912340425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55562794f1b0 msgr2=0x555627d2f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:42.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.058+0000 7f7688cfa640 1 --2- 172.21.15.46:0/3912340425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55562794f1b0 0x555627d2f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.058+0000 7f7688cfa640 1 -- 172.21.15.46:0/3912340425 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555627c4dc90 con 0x555627978070 2024-09-21T04:02:42.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.058+0000 7f7688cfa640 1 --2- 172.21.15.46:0/3912340425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555627978070 0x555627d3b510 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f767c00edf0 tx=0x7f767c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8c3bef81350e666 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:42.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.058+0000 7f76637fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:02:42.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.058+0000 7f76637fe640 1 -- 172.21.15.46:0/3912340425 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c01cd30 con 0x555627978070 2024-09-21T04:02:42.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.058+0000 7f76637fe640 1 -- 172.21.15.46:0/3912340425 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f767c004b20 con 0x555627978070 2024-09-21T04:02:42.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.058+0000 7f7690cd1740 1 -- 172.21.15.46:0/3912340425 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f767801cad0 con 0x555627978070 2024-09-21T04:02:42.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.059+0000 7f76637fe640 1 -- 172.21.15.46:0/3912340425 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f767c004d20 con 0x555627978070 2024-09-21T04:02:42.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.059+0000 7f7690cd1740 10 client.16569 fetch_fsmap learned FSMap version 20 2024-09-21T04:02:42.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.059+0000 7f7690cd1740 1 -- 172.21.15.46:0/3912340425 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x555627d3df50 con 0x555627978070 2024-09-21T04:02:42.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.059+0000 7f76637fe640 1 -- 172.21.15.46:0/3912340425 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f767801cad0 con 0x555627978070 2024-09-21T04:02:42.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.059+0000 7f76637fe640 1 -- 172.21.15.46:0/3912340425 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f767c02f020 con 0x555627978070 2024-09-21T04:02:42.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.059+0000 7f7690cd1740 10 client.16569 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:02:42.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.059+0000 7f7690cd1740 10 client.16569 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:02:42.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.059+0000 7f7690cd1740 20 client.16569 populate_metadata read hostname 'smithi046' 2024-09-21T04:02:42.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.059+0000 7f7690cd1740 1 --2- 172.21.15.46:0/3912340425 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5556279369f0 0x555627d414f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:42.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.059+0000 7f7690cd1740 4 client.16569 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:02:42.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.059+0000 7f7690cd1740 1 -- 172.21.15.46:0/3912340425 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555627c97df0 con 0x5556279369f0 2024-09-21T04:02:42.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.060+0000 7f7683fff640 1 --2- 172.21.15.46:0/3912340425 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5556279369f0 0x555627d414f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:42.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.060+0000 7f76637fe640 10 client.16569 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:02:42.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.060+0000 7f7683fff640 1 --2- 172.21.15.46:0/3912340425 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5556279369f0 0x555627d414f0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=faa489a02600bd21 server_cookie=e6bbb406bf651c30 in_seq=0 out_seq=0 2024-09-21T04:02:42.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.061+0000 7f76637fe640 1 -- 172.21.15.46:0/3912340425 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555627c97df0 con 0x5556279369f0 2024-09-21T04:02:42.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.061+0000 7f76637fe640 10 client.16569 handle_command_reply: tid=0 2024-09-21T04:02:42.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.061+0000 7f7690cd1740 1 client.16569 shutdown 2024-09-21T04:02:42.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.061+0000 7f7690cd1740 1 -- 172.21.15.46:0/3912340425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555627978070 msgr2=0x555627d3b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:42.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.061+0000 7f7690cd1740 1 --2- 172.21.15.46:0/3912340425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555627978070 0x555627d3b510 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f767c00edf0 tx=0x7f767c004a40 comp rx=0 tx=0).stop 2024-09-21T04:02:42.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.061+0000 7f7690cd1740 1 -- 172.21.15.46:0/3912340425 shutdown_connections 2024-09-21T04:02:42.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.061+0000 7f7690cd1740 1 --2- 172.21.15.46:0/3912340425 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5556279369f0 0x555627d414f0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.061+0000 7f7690cd1740 1 --2- 172.21.15.46:0/3912340425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555627978070 0x555627d3b510 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.061+0000 7f7690cd1740 1 --2- 172.21.15.46:0/3912340425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555627957390 0x555627d2f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.061+0000 7f76637fe640 0 client.16569 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:02:42.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.061+0000 7f7690cd1740 1 --2- 172.21.15.46:0/3912340425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55562794f1b0 0x555627d2f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.061+0000 7f7690cd1740 1 -- 172.21.15.46:0/3912340425 >> 172.21.15.46:0/3912340425 conn(0x55562796c460 msgr2=0x555627d1bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:42.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.061+0000 7f7690cd1740 1 -- 172.21.15.46:0/3912340425 shutdown_connections 2024-09-21T04:02:42.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.061+0000 7f7690cd1740 1 -- 172.21.15.46:0/3912340425 wait complete. 2024-09-21T04:02:42.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.061+0000 7f7690cd1740 20 client.16569 trim_cache size 0 max 16384 2024-09-21T04:02:42.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.074+0000 7f7690cd1740 1 Processor -- start 2024-09-21T04:02:42.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.074+0000 7f7690cd1740 1 -- start start 2024-09-21T04:02:42.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.075+0000 7f7690cd1740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55562794f1b0 0x555627d2f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:42.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.075+0000 7f7690cd1740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555627957390 0x555627d24840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:42.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.075+0000 7f7690cd1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555627978070 0x555627d24d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:42.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.075+0000 7f7690cd1740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f76841ab2a0 con 0x555627957390 2024-09-21T04:02:42.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.075+0000 7f7690cd1740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f76841adb00 con 0x55562794f1b0 2024-09-21T04:02:42.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.075+0000 7f7690cd1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f76841ab8f0 con 0x555627978070 2024-09-21T04:02:42.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.075+0000 7f76837fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555627957390 0x555627d24840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:42.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.075+0000 7f76837fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555627957390 0x555627d24840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39026/0 (socket says 172.21.15.46:39026) 2024-09-21T04:02:42.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.075+0000 7f76837fe640 1 -- 172.21.15.46:0/122663598 learned_addr learned my addr 172.21.15.46:0/122663598 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:42.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.075+0000 7f7683fff640 1 --2- 172.21.15.46:0/122663598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55562794f1b0 0x555627d2f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:42.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.075+0000 7f7688cfa640 1 --2- 172.21.15.46:0/122663598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555627978070 0x555627d24d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:42.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.075+0000 7f76837fe640 1 -- 172.21.15.46:0/122663598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555627978070 msgr2=0x555627d24d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:42.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.075+0000 7f76837fe640 1 --2- 172.21.15.46:0/122663598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555627978070 0x555627d24d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.075+0000 7f76837fe640 1 -- 172.21.15.46:0/122663598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55562794f1b0 msgr2=0x555627d2f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:42.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.075+0000 7f76837fe640 1 --2- 172.21.15.46:0/122663598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55562794f1b0 0x555627d2f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.075+0000 7f76837fe640 1 -- 172.21.15.46:0/122663598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555627d21f20 con 0x555627957390 2024-09-21T04:02:42.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.075+0000 7f7688cfa640 1 --2- 172.21.15.46:0/122663598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555627978070 0x555627d24d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:02:42.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.075+0000 7f76837fe640 1 --2- 172.21.15.46:0/122663598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555627957390 0x555627d24840 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f7678011760 tx=0x7f7678011790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f71b620074d067 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:42.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.076+0000 7f7669ffb640 1 -- 172.21.15.46:0/122663598 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767802b070 con 0x555627957390 2024-09-21T04:02:42.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.076+0000 7f7669ffb640 1 -- 172.21.15.46:0/122663598 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7678011d70 con 0x555627957390 2024-09-21T04:02:42.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.076+0000 7f7669ffb640 1 -- 172.21.15.46:0/122663598 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767801c480 con 0x555627957390 2024-09-21T04:02:42.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.076+0000 7f7690cd1740 1 -- 172.21.15.46:0/122663598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555627957390 msgr2=0x555627d24840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:42.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.076+0000 7f7690cd1740 1 --2- 172.21.15.46:0/122663598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555627957390 0x555627d24840 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f7678011760 tx=0x7f7678011790 comp rx=0 tx=0).stop 2024-09-21T04:02:42.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.076+0000 7f7690cd1740 1 -- 172.21.15.46:0/122663598 shutdown_connections 2024-09-21T04:02:42.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.076+0000 7f7690cd1740 1 --2- 172.21.15.46:0/122663598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555627978070 0x555627d24d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.076+0000 7f7690cd1740 1 --2- 172.21.15.46:0/122663598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555627957390 0x555627d24840 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.076+0000 7f7690cd1740 1 --2- 172.21.15.46:0/122663598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55562794f1b0 0x555627d2f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.076+0000 7f7690cd1740 1 -- 172.21.15.46:0/122663598 >> 172.21.15.46:0/122663598 conn(0x55562796c460 msgr2=0x555627d2ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:42.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.077+0000 7f7690cd1740 1 -- 172.21.15.46:0/122663598 shutdown_connections 2024-09-21T04:02:42.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.077+0000 7f7690cd1740 1 -- 172.21.15.46:0/122663598 wait complete. 2024-09-21T04:02:42.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.077+0000 7f7690cd1740 1 -- start start 2024-09-21T04:02:42.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.077+0000 7f7690cd1740 1 Processor -- start 2024-09-21T04:02:42.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.077+0000 7f7690cd1740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55562794f1b0 0x555627d335d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:42.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.077+0000 7f7690cd1740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555627957390 0x555627d33b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:42.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.077+0000 7f7690cd1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555627978070 0x555627d34050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:42.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.078+0000 7f7690cd1740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f76841abfc0 con 0x55562794f1b0 2024-09-21T04:02:42.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.078+0000 7f7690cd1740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f76841ad430 con 0x555627957390 2024-09-21T04:02:42.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.078+0000 7f7690cd1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f76841ac690 con 0x555627978070 2024-09-21T04:02:42.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.078+0000 7f7683fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55562794f1b0 0x555627d335d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:42.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.078+0000 7f7690cd1740 10 client.0 _ll_register_callbacks cb 0x7f767c00ea70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:02:42.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.078+0000 7f7683fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55562794f1b0 0x555627d335d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39036/0 (socket says 172.21.15.46:39036) 2024-09-21T04:02:42.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.078+0000 7f7683fff640 1 -- 172.21.15.46:0/3624832439 learned_addr learned my addr 172.21.15.46:0/3624832439 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:42.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.078+0000 7f76837fe640 1 --2- 172.21.15.46:0/3624832439 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555627957390 0x555627d33b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:42.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.078+0000 7f7688cfa640 1 --2- 172.21.15.46:0/3624832439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555627978070 0x555627d34050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:42.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.078+0000 7f7683fff640 1 -- 172.21.15.46:0/3624832439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555627978070 msgr2=0x555627d34050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:42.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.078+0000 7f7683fff640 1 --2- 172.21.15.46:0/3624832439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555627978070 0x555627d34050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.078+0000 7f7683fff640 1 -- 172.21.15.46:0/3624832439 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555627957390 msgr2=0x555627d33b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:42.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.078+0000 7f7683fff640 1 --2- 172.21.15.46:0/3624832439 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555627957390 0x555627d33b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.078+0000 7f7683fff640 1 -- 172.21.15.46:0/3624832439 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555627dab030 con 0x55562794f1b0 2024-09-21T04:02:42.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.078+0000 7f7683fff640 1 --2- 172.21.15.46:0/3624832439 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55562794f1b0 0x555627d335d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f7674105420 tx=0x7f767403b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86884fe6a44c61ab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:42.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.078+0000 7f76637fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:02:42.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.078+0000 7f76637fe640 1 -- 172.21.15.46:0/3624832439 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7674049040 con 0x55562794f1b0 2024-09-21T04:02:42.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.078+0000 7f76637fe640 1 -- 172.21.15.46:0/3624832439 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f76740f10b0 con 0x55562794f1b0 2024-09-21T04:02:42.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.078+0000 7f7690cd1740 1 -- 172.21.15.46:0/3624832439 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7678011d70 con 0x55562794f1b0 2024-09-21T04:02:42.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.079+0000 7f76637fe640 1 -- 172.21.15.46:0/3624832439 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f76740c9230 con 0x55562794f1b0 2024-09-21T04:02:42.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.079+0000 7f7690cd1740 10 client.16575 fetch_fsmap learned FSMap version 20 2024-09-21T04:02:42.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.079+0000 7f7690cd1740 1 -- 172.21.15.46:0/3624832439 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x555627dac280 con 0x55562794f1b0 2024-09-21T04:02:42.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.079+0000 7f76637fe640 1 -- 172.21.15.46:0/3624832439 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7678011d70 con 0x55562794f1b0 2024-09-21T04:02:42.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.079+0000 7f76637fe640 1 -- 172.21.15.46:0/3624832439 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f76740b8030 con 0x55562794f1b0 2024-09-21T04:02:42.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.079+0000 7f7690cd1740 10 client.16575 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:02:42.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.079+0000 7f7690cd1740 10 client.16575 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:02:42.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.079+0000 7f7690cd1740 20 client.16575 populate_metadata read hostname 'smithi046' 2024-09-21T04:02:42.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.079+0000 7f7690cd1740 1 --2- 172.21.15.46:0/3624832439 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55562790bda0 0x555627daea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:42.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.079+0000 7f7690cd1740 4 client.16575 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T04:02:42.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.079+0000 7f7690cd1740 1 -- 172.21.15.46:0/3624832439 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555627d21d00 con 0x55562790bda0 2024-09-21T04:02:42.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.080+0000 7f76837fe640 1 --2- 172.21.15.46:0/3624832439 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55562790bda0 0x555627daea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:42.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.080+0000 7f76637fe640 10 client.16575 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:02:42.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.080+0000 7f76837fe640 1 --2- 172.21.15.46:0/3624832439 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55562790bda0 0x555627daea90 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd2275cb4e3ffe85 server_cookie=94ff8d205718d146 in_seq=0 out_seq=0 2024-09-21T04:02:42.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.080+0000 7f76637fe640 1 -- 172.21.15.46:0/3624832439 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555627d21d00 con 0x55562790bda0 2024-09-21T04:02:42.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.080+0000 7f76637fe640 10 client.16575 handle_command_reply: tid=0 2024-09-21T04:02:42.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.080+0000 7f7690cd1740 1 client.16575 shutdown 2024-09-21T04:02:42.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.080+0000 7f7690cd1740 1 -- 172.21.15.46:0/3624832439 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55562794f1b0 msgr2=0x555627d335d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:42.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.080+0000 7f7690cd1740 1 --2- 172.21.15.46:0/3624832439 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55562794f1b0 0x555627d335d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f7674105420 tx=0x7f767403b6b0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.080+0000 7f7690cd1740 1 -- 172.21.15.46:0/3624832439 shutdown_connections 2024-09-21T04:02:42.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.080+0000 7f7690cd1740 1 --2- 172.21.15.46:0/3624832439 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55562790bda0 0x555627daea90 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.081+0000 7f7690cd1740 1 --2- 172.21.15.46:0/3624832439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555627978070 0x555627d34050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.081+0000 7f7690cd1740 1 --2- 172.21.15.46:0/3624832439 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555627957390 0x555627d33b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.081+0000 7f7690cd1740 1 --2- 172.21.15.46:0/3624832439 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55562794f1b0 0x555627d335d0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.081+0000 7f76637fe640 0 client.16575 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:02:42.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.081+0000 7f7690cd1740 1 -- 172.21.15.46:0/3624832439 >> 172.21.15.46:0/3624832439 conn(0x55562796c460 msgr2=0x555627d24840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:42.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.081+0000 7f7690cd1740 1 -- 172.21.15.46:0/3624832439 shutdown_connections 2024-09-21T04:02:42.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.081+0000 7f7690cd1740 1 -- 172.21.15.46:0/3624832439 wait complete. 2024-09-21T04:02:42.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.081+0000 7f7690cd1740 20 client.16575 trim_cache size 0 max 16384 2024-09-21T04:02:42.096 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-21T04:02:42.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.081+0000 7f768a75d640 1 -- 172.21.15.46:0/2176053848 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f766c0b66b0 msgr2=0x7f766c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:42.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.081+0000 7f768a75d640 1 --2- 172.21.15.46:0/2176053848 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f766c0b66b0 0x7f766c0b8bc0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f767c007f10 tx=0x7f767c0076a0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.081+0000 7f768a75d640 1 -- 172.21.15.46:0/2176053848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7684102a80 msgr2=0x7f768419a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:42.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.081+0000 7f768a75d640 1 --2- 172.21.15.46:0/2176053848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7684102a80 0x7f768419a490 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f7674005940 tx=0x7f76740042f0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.081+0000 7f768a75d640 1 -- 172.21.15.46:0/2176053848 shutdown_connections 2024-09-21T04:02:42.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.081+0000 7f768a75d640 1 --2- 172.21.15.46:0/2176053848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7684108d10 0x7f768419fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.081+0000 7f768a75d640 1 --2- 172.21.15.46:0/2176053848 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f766c0b66b0 0x7f766c0b8bc0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.081+0000 7f768a75d640 1 --2- 172.21.15.46:0/2176053848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76841083c0 0x7f768419aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.081+0000 7f768a75d640 1 --2- 172.21.15.46:0/2176053848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7684102a80 0x7f768419a490 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.081+0000 7f768a75d640 1 -- 172.21.15.46:0/2176053848 >> 172.21.15.46:0/2176053848 conn(0x7f7684079740 msgr2=0x7f7684101450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:42.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.082+0000 7f768a75d640 1 -- 172.21.15.46:0/2176053848 shutdown_connections 2024-09-21T04:02:42.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:42.082+0000 7f768a75d640 1 -- 172.21.15.46:0/2176053848 wait complete. 2024-09-21T04:02:43.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:43 smithi105 ceph-mon[34773]: pgmap v552: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-21T04:02:43.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:43 smithi162 ceph-mon[35071]: pgmap v552: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-21T04:02:43.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:43 smithi046 ceph-mon[30954]: pgmap v552: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-21T04:02:43.861 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T04:02:43.861 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T04:02:44.132 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:44.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.688+0000 7f59d6197640 1 -- 172.21.15.46:0/4071559210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59d010de30 msgr2=0x7f59d0110310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:44.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.688+0000 7f59d6197640 1 --2- 172.21.15.46:0/4071559210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59d010de30 0x7f59d0110310 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f59c8009ca0 tx=0x7f59c802a8e0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.688+0000 7f59d6197640 1 -- 172.21.15.46:0/4071559210 shutdown_connections 2024-09-21T04:02:44.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.688+0000 7f59d6197640 1 --2- 172.21.15.46:0/4071559210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59d010de30 0x7f59d0110310 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.688+0000 7f59d6197640 1 --2- 172.21.15.46:0/4071559210 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59d01052b0 0x7f59d010d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.688+0000 7f59d6197640 1 --2- 172.21.15.46:0/4071559210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59d0104880 0x7f59d0104c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.688+0000 7f59d6197640 1 -- 172.21.15.46:0/4071559210 >> 172.21.15.46:0/4071559210 conn(0x7f59d0079740 msgr2=0x7f59d0079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:44.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.688+0000 7f59d6197640 1 -- 172.21.15.46:0/4071559210 shutdown_connections 2024-09-21T04:02:44.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.688+0000 7f59d6197640 1 -- 172.21.15.46:0/4071559210 wait complete. 2024-09-21T04:02:44.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.689+0000 7f59d6197640 1 Processor -- start 2024-09-21T04:02:44.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.689+0000 7f59d6197640 1 -- start start 2024-09-21T04:02:44.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.690+0000 7f59d6197640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59d0104880 0x7f59d019a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.690+0000 7f59d6197640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59d01052b0 0x7f59d019aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.690+0000 7f59d6197640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59d010de30 0x7f59d019fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.690+0000 7f59d6197640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f59d0113b60 con 0x7f59d01052b0 2024-09-21T04:02:44.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.690+0000 7f59d6197640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f59d01139e0 con 0x7f59d0104880 2024-09-21T04:02:44.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.690+0000 7f59d6197640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f59d0113ce0 con 0x7f59d010de30 2024-09-21T04:02:44.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.690+0000 7f59ceffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59d01052b0 0x7f59d019aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.690+0000 7f59ceffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59d01052b0 0x7f59d019aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39050/0 (socket says 172.21.15.46:39050) 2024-09-21T04:02:44.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.690+0000 7f59ceffd640 1 -- 172.21.15.46:0/3475744811 learned_addr learned my addr 172.21.15.46:0/3475744811 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:44.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.690+0000 7f59cffff640 1 --2- 172.21.15.46:0/3475744811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59d010de30 0x7f59d019fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.690+0000 7f59cf7fe640 1 --2- 172.21.15.46:0/3475744811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59d0104880 0x7f59d019a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.690+0000 7f59ceffd640 1 -- 172.21.15.46:0/3475744811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59d010de30 msgr2=0x7f59d019fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:44.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.690+0000 7f59ceffd640 1 --2- 172.21.15.46:0/3475744811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59d010de30 0x7f59d019fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.690+0000 7f59ceffd640 1 -- 172.21.15.46:0/3475744811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59d0104880 msgr2=0x7f59d019a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:44.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.690+0000 7f59ceffd640 1 --2- 172.21.15.46:0/3475744811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59d0104880 0x7f59d019a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.690+0000 7f59ceffd640 1 -- 172.21.15.46:0/3475744811 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d01a04c0 con 0x7f59d01052b0 2024-09-21T04:02:44.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.690+0000 7f59cffff640 1 --2- 172.21.15.46:0/3475744811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59d010de30 0x7f59d019fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:02:44.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.691+0000 7f59ceffd640 1 --2- 172.21.15.46:0/3475744811 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59d01052b0 0x7f59d019aaf0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f59b8006fd0 tx=0x7f59b800b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:44.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.691+0000 7f59ccff9640 1 -- 172.21.15.46:0/3475744811 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b8015020 con 0x7f59d01052b0 2024-09-21T04:02:44.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.691+0000 7f59d6197640 1 -- 172.21.15.46:0/3475744811 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59d01a07b0 con 0x7f59d01052b0 2024-09-21T04:02:44.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.691+0000 7f59ccff9640 1 -- 172.21.15.46:0/3475744811 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59b8011ce0 con 0x7f59d01052b0 2024-09-21T04:02:44.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.691+0000 7f59ccff9640 1 -- 172.21.15.46:0/3475744811 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b8010d90 con 0x7f59d01052b0 2024-09-21T04:02:44.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.691+0000 7f59d6197640 1 -- 172.21.15.46:0/3475744811 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59d01a6f10 con 0x7f59d01052b0 2024-09-21T04:02:44.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.694+0000 7f59ccff9640 1 -- 172.21.15.46:0/3475744811 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f59b8018020 con 0x7f59d01052b0 2024-09-21T04:02:44.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.694+0000 7f59dc70b740 1 Processor -- start 2024-09-21T04:02:44.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.694+0000 7f59dc70b740 1 -- start start 2024-09-21T04:02:44.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.695+0000 7f59dc70b740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5564dd6a1350 0x5564dda48430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.695+0000 7f59dc70b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5564dd678490 0x5564dda48970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.695+0000 7f59dc70b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564dd680670 0x5564dda48eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.695+0000 7f59dc70b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5564dd9bee60 con 0x5564dd678490 2024-09-21T04:02:44.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.695+0000 7f59dc70b740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5564dd9ae290 con 0x5564dd6a1350 2024-09-21T04:02:44.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.695+0000 7f59dc70b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5564dd9b20a0 con 0x5564dd680670 2024-09-21T04:02:44.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.695+0000 7f59cf7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5564dd678490 0x5564dda48970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.695+0000 7f59cf7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5564dd678490 0x5564dda48970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39064/0 (socket says 172.21.15.46:39064) 2024-09-21T04:02:44.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.695+0000 7f59cf7fe640 1 -- 172.21.15.46:0/3388016817 learned_addr learned my addr 172.21.15.46:0/3388016817 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:44.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.695+0000 7f59cffff640 1 --2- 172.21.15.46:0/3388016817 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5564dd6a1350 0x5564dda48430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.695+0000 7f59ceffd640 1 --2- 172.21.15.46:0/3388016817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564dd680670 0x5564dda48eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.695+0000 7f59ccff9640 1 --2- 172.21.15.46:0/3475744811 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f59bc0b6680 0x7f59bc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.695+0000 7f59cf7fe640 1 -- 172.21.15.46:0/3388016817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564dd680670 msgr2=0x5564dda48eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:44.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.695+0000 7f59cf7fe640 1 --2- 172.21.15.46:0/3388016817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564dd680670 0x5564dda48eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.695+0000 7f59cf7fe640 1 -- 172.21.15.46:0/3388016817 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5564dd6a1350 msgr2=0x5564dda48430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:44.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.695+0000 7f59cf7fe640 1 --2- 172.21.15.46:0/3388016817 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5564dd6a1350 0x5564dda48430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.695+0000 7f59cf7fe640 1 -- 172.21.15.46:0/3388016817 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564dd70c930 con 0x5564dd678490 2024-09-21T04:02:44.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.696+0000 7f59cffff640 1 --2- 172.21.15.46:0/3475744811 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f59bc0b6680 0x7f59bc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.696+0000 7f59ccff9640 1 -- 172.21.15.46:0/3475744811 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f59b80e6d80 con 0x7f59d01052b0 2024-09-21T04:02:44.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.696+0000 7f59cf7fe640 1 --2- 172.21.15.46:0/3388016817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5564dd678490 0x5564dda48970 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f59c0009a70 tx=0x7f59c0009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ecacf59ceceed0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:44.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.696+0000 7f59c5ffb640 1 -- 172.21.15.46:0/3388016817 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c0017070 con 0x5564dd678490 2024-09-21T04:02:44.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.696+0000 7f59c5ffb640 1 -- 172.21.15.46:0/3388016817 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59c0013470 con 0x5564dd678490 2024-09-21T04:02:44.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.696+0000 7f59c5ffb640 1 -- 172.21.15.46:0/3388016817 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c0012610 con 0x5564dd678490 2024-09-21T04:02:44.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.697+0000 7f59dc70b740 1 -- 172.21.15.46:0/3388016817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5564dd678490 msgr2=0x5564dda48970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:44.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.697+0000 7f59cffff640 1 --2- 172.21.15.46:0/3475744811 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f59bc0b6680 0x7f59bc0b8b90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f59c80094e0 tx=0x7f59c803e040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:44.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.697+0000 7f59dc70b740 1 --2- 172.21.15.46:0/3388016817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5564dd678490 0x5564dda48970 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f59c0009a70 tx=0x7f59c0009f30 comp rx=0 tx=0).stop 2024-09-21T04:02:44.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.697+0000 7f59dc70b740 1 -- 172.21.15.46:0/3388016817 shutdown_connections 2024-09-21T04:02:44.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.697+0000 7f59dc70b740 1 --2- 172.21.15.46:0/3388016817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564dd680670 0x5564dda48eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.697+0000 7f59dc70b740 1 --2- 172.21.15.46:0/3388016817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5564dd678490 0x5564dda48970 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.697+0000 7f59dc70b740 1 --2- 172.21.15.46:0/3388016817 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5564dd6a1350 0x5564dda48430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.697+0000 7f59dc70b740 1 -- 172.21.15.46:0/3388016817 >> 172.21.15.46:0/3388016817 conn(0x5564dd695740 msgr2=0x5564dda46320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:44.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.698+0000 7f59dc70b740 1 -- 172.21.15.46:0/3388016817 shutdown_connections 2024-09-21T04:02:44.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.698+0000 7f59dc70b740 1 -- 172.21.15.46:0/3388016817 wait complete. 2024-09-21T04:02:44.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.698+0000 7f59dc70b740 1 -- start start 2024-09-21T04:02:44.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.698+0000 7f59dc70b740 1 Processor -- start 2024-09-21T04:02:44.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.699+0000 7f59dc70b740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5564dd678490 0x5564dda53fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.699+0000 7f59dc70b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564dd680670 0x5564dda54510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.699+0000 7f59dc70b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5564dd6a1350 0x5564dda5ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.699+0000 7f59dc70b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5564dd80f890 con 0x5564dd6a1350 2024-09-21T04:02:44.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.699+0000 7f59dc70b740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5564dd948d40 con 0x5564dd678490 2024-09-21T04:02:44.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.699+0000 7f59dc70b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5564dda56c10 con 0x5564dd680670 2024-09-21T04:02:44.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.699+0000 7f59dc70b740 10 client.0 _ll_register_callbacks cb 0x5564dd9acc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:02:44.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.699+0000 7f59ceffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564dd680670 0x5564dda54510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.699+0000 7f59cf7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5564dd678490 0x5564dda53fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.699+0000 7f59cf7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5564dd678490 0x5564dda53fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.46:59402/0 (socket says 172.21.15.46:59402) 2024-09-21T04:02:44.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.699+0000 7f59cf7fe640 1 -- 172.21.15.46:0/3233796917 learned_addr learned my addr 172.21.15.46:0/3233796917 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:44.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.699+0000 7f59ceffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564dd680670 0x5564dda54510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:52752/0 (socket says 172.21.15.46:52752) 2024-09-21T04:02:44.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.699+0000 7f59cffff640 1 --2- 172.21.15.46:0/3233796917 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5564dd6a1350 0x5564dda5ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.699+0000 7f59cf7fe640 1 -- 172.21.15.46:0/3233796917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564dd680670 msgr2=0x5564dda54510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:44.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.699+0000 7f59cf7fe640 1 --2- 172.21.15.46:0/3233796917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564dd680670 0x5564dda54510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.699+0000 7f59cf7fe640 1 -- 172.21.15.46:0/3233796917 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5564dd6a1350 msgr2=0x5564dda5ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:44.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.699+0000 7f59cf7fe640 1 --2- 172.21.15.46:0/3233796917 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5564dd6a1350 0x5564dda5ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.699+0000 7f59cf7fe640 1 -- 172.21.15.46:0/3233796917 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564dda60470 con 0x5564dd678490 2024-09-21T04:02:44.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.699+0000 7f59cffff640 1 --2- 172.21.15.46:0/3233796917 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5564dd6a1350 0x5564dda5ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:02:44.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.699+0000 7f59cf7fe640 1 --2- 172.21.15.46:0/3233796917 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5564dd678490 0x5564dda53fd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f59c0004700 tx=0x7f59c000ef30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=253ccedee170514f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:44.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.699+0000 7f59aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-21T04:02:44.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.700+0000 7f59aeffd640 1 -- 172.21.15.46:0/3233796917 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c0017050 con 0x5564dd678490 2024-09-21T04:02:44.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.700+0000 7f59aeffd640 1 -- 172.21.15.46:0/3233796917 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f59c001c450 con 0x5564dd678490 2024-09-21T04:02:44.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.700+0000 7f59dc70b740 1 -- 172.21.15.46:0/3233796917 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59c0013470 con 0x5564dd678490 2024-09-21T04:02:44.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.700+0000 7f59aeffd640 1 -- 172.21.15.46:0/3233796917 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f59c001c650 con 0x5564dd678490 2024-09-21T04:02:44.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.700+0000 7f59dc70b740 10 client.26015 fetch_fsmap learned FSMap version 20 2024-09-21T04:02:44.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.700+0000 7f59dc70b740 1 -- 172.21.15.46:0/3233796917 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5564dda62da0 con 0x5564dd678490 2024-09-21T04:02:44.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.700+0000 7f59aeffd640 1 -- 172.21.15.46:0/3233796917 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59c0013470 con 0x5564dd678490 2024-09-21T04:02:44.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.700+0000 7f59aeffd640 1 -- 172.21.15.46:0/3233796917 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f59c002e020 con 0x5564dd678490 2024-09-21T04:02:44.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.700+0000 7f59dc70b740 10 client.26015 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:02:44.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.700+0000 7f59dc70b740 10 client.26015 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:02:44.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.701+0000 7f59dc70b740 20 client.26015 populate_metadata read hostname 'smithi046' 2024-09-21T04:02:44.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.701+0000 7f59dc70b740 1 --2- 172.21.15.46:0/3233796917 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5564dd65fcd0 0x5564dda66100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.701+0000 7f59dc70b740 4 client.26015 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:02:44.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.701+0000 7f59dc70b740 1 -- 172.21.15.46:0/3233796917 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564dd9c0db0 con 0x5564dd65fcd0 2024-09-21T04:02:44.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.701+0000 7f59ceffd640 1 --2- 172.21.15.46:0/3233796917 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5564dd65fcd0 0x5564dda66100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.701+0000 7f59aeffd640 10 client.26015 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:02:44.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.701+0000 7f59ceffd640 1 --2- 172.21.15.46:0/3233796917 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5564dd65fcd0 0x5564dda66100 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1381092eaaffc899 server_cookie=baf00aaededd7087 in_seq=0 out_seq=0 2024-09-21T04:02:44.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.702+0000 7f59aeffd640 1 -- 172.21.15.46:0/3233796917 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5564dd9c0db0 con 0x5564dd65fcd0 2024-09-21T04:02:44.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.702+0000 7f59aeffd640 10 client.26015 handle_command_reply: tid=0 2024-09-21T04:02:44.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.702+0000 7f59dc70b740 1 client.26015 shutdown 2024-09-21T04:02:44.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.702+0000 7f59dc70b740 1 -- 172.21.15.46:0/3233796917 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5564dd678490 msgr2=0x5564dda53fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:44.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.702+0000 7f59dc70b740 1 --2- 172.21.15.46:0/3233796917 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5564dd678490 0x5564dda53fd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f59c0004700 tx=0x7f59c000ef30 comp rx=0 tx=0).stop 2024-09-21T04:02:44.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.702+0000 7f59dc70b740 1 -- 172.21.15.46:0/3233796917 shutdown_connections 2024-09-21T04:02:44.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.702+0000 7f59dc70b740 1 --2- 172.21.15.46:0/3233796917 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5564dd65fcd0 0x5564dda66100 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.702+0000 7f59dc70b740 1 --2- 172.21.15.46:0/3233796917 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5564dd6a1350 0x5564dda5ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.702+0000 7f59dc70b740 1 --2- 172.21.15.46:0/3233796917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564dd680670 0x5564dda54510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.702+0000 7f59aeffd640 0 client.26015 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:02:44.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.702+0000 7f59dc70b740 1 --2- 172.21.15.46:0/3233796917 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5564dd678490 0x5564dda53fd0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.702+0000 7f59dc70b740 1 -- 172.21.15.46:0/3233796917 >> 172.21.15.46:0/3233796917 conn(0x5564dd695740 msgr2=0x5564dda4b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:44.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.703+0000 7f59dc70b740 1 -- 172.21.15.46:0/3233796917 shutdown_connections 2024-09-21T04:02:44.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.703+0000 7f59dc70b740 1 -- 172.21.15.46:0/3233796917 wait complete. 2024-09-21T04:02:44.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.703+0000 7f59dc70b740 20 client.26015 trim_cache size 0 max 16384 2024-09-21T04:02:44.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.720+0000 7f59dc70b740 1 Processor -- start 2024-09-21T04:02:44.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.721+0000 7f59dc70b740 1 -- start start 2024-09-21T04:02:44.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.721+0000 7f59dc70b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564dd65fcd0 0x5564dda5fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.721+0000 7f59dc70b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5564dd678490 0x5564dda4dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.721+0000 7f59dc70b740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5564dd680670 0x5564dda49e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.721+0000 7f59dc70b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f59d01ad690 con 0x5564dd678490 2024-09-21T04:02:44.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.721+0000 7f59dc70b740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f59d01afef0 con 0x5564dd680670 2024-09-21T04:02:44.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.721+0000 7f59dc70b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f59d01adce0 con 0x5564dd65fcd0 2024-09-21T04:02:44.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.721+0000 7f59ceffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5564dd678490 0x5564dda4dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.721+0000 7f59ceffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5564dd678490 0x5564dda4dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39072/0 (socket says 172.21.15.46:39072) 2024-09-21T04:02:44.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.721+0000 7f59ceffd640 1 -- 172.21.15.46:0/969281347 learned_addr learned my addr 172.21.15.46:0/969281347 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:44.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.721+0000 7f59cffff640 1 --2- 172.21.15.46:0/969281347 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5564dd680670 0x5564dda49e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.721+0000 7f59cf7fe640 1 --2- 172.21.15.46:0/969281347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564dd65fcd0 0x5564dda5fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.721+0000 7f59ceffd640 1 -- 172.21.15.46:0/969281347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564dd65fcd0 msgr2=0x5564dda5fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:44.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.721+0000 7f59ceffd640 1 --2- 172.21.15.46:0/969281347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564dd65fcd0 0x5564dda5fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.722+0000 7f59ceffd640 1 -- 172.21.15.46:0/969281347 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5564dd680670 msgr2=0x5564dda49e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:44.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.722+0000 7f59ceffd640 1 --2- 172.21.15.46:0/969281347 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5564dd680670 0x5564dda49e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.722+0000 7f59ceffd640 1 -- 172.21.15.46:0/969281347 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564dda55090 con 0x5564dd678490 2024-09-21T04:02:44.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.722+0000 7f59ceffd640 1 --2- 172.21.15.46:0/969281347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5564dd678490 0x5564dda4dbb0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f59b80a9210 tx=0x7f59b80e9300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a25c2a6e1a2097 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:44.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.722+0000 7f59c57fa640 1 -- 172.21.15.46:0/969281347 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b80940b0 con 0x5564dd678490 2024-09-21T04:02:44.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.722+0000 7f59c57fa640 1 -- 172.21.15.46:0/969281347 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59b80ac750 con 0x5564dd678490 2024-09-21T04:02:44.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.722+0000 7f59c57fa640 1 -- 172.21.15.46:0/969281347 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b80e4950 con 0x5564dd678490 2024-09-21T04:02:44.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.723+0000 7f59dc70b740 1 -- 172.21.15.46:0/969281347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5564dd678490 msgr2=0x5564dda4dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:44.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.723+0000 7f59dc70b740 1 --2- 172.21.15.46:0/969281347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5564dd678490 0x5564dda4dbb0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f59b80a9210 tx=0x7f59b80e9300 comp rx=0 tx=0).stop 2024-09-21T04:02:44.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.723+0000 7f59dc70b740 1 -- 172.21.15.46:0/969281347 shutdown_connections 2024-09-21T04:02:44.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.723+0000 7f59dc70b740 1 --2- 172.21.15.46:0/969281347 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5564dd680670 0x5564dda49e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.723+0000 7f59dc70b740 1 --2- 172.21.15.46:0/969281347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5564dd678490 0x5564dda4dbb0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.723+0000 7f59dc70b740 1 --2- 172.21.15.46:0/969281347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564dd65fcd0 0x5564dda5fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.723+0000 7f59dc70b740 1 -- 172.21.15.46:0/969281347 >> 172.21.15.46:0/969281347 conn(0x5564dd695740 msgr2=0x5564dda52650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:44.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.723+0000 7f59dc70b740 1 -- 172.21.15.46:0/969281347 shutdown_connections 2024-09-21T04:02:44.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.723+0000 7f59dc70b740 1 -- 172.21.15.46:0/969281347 wait complete. 2024-09-21T04:02:44.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.723+0000 7f59dc70b740 1 -- start start 2024-09-21T04:02:44.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.724+0000 7f59dc70b740 1 Processor -- start 2024-09-21T04:02:44.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.724+0000 7f59dc70b740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5564dd65fcd0 0x5564dda67c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.724+0000 7f59dc70b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5564dd678490 0x5564dda68270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.724+0000 7f59dc70b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564dd680670 0x5564ddac7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.724+0000 7f59dc70b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f59d01ae3b0 con 0x5564dd678490 2024-09-21T04:02:44.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.724+0000 7f59dc70b740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f59d01af820 con 0x5564dd65fcd0 2024-09-21T04:02:44.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.724+0000 7f59dc70b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f59d01aea80 con 0x5564dd680670 2024-09-21T04:02:44.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.724+0000 7f59dc70b740 10 client.0 _ll_register_callbacks cb 0x7f59c00098f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:02:44.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.724+0000 7f59cf7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5564dd65fcd0 0x5564dda67c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.724+0000 7f59cf7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5564dd65fcd0 0x5564dda67c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.46:59418/0 (socket says 172.21.15.46:59418) 2024-09-21T04:02:44.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.724+0000 7f59cf7fe640 1 -- 172.21.15.46:0/2271167654 learned_addr learned my addr 172.21.15.46:0/2271167654 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:44.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.724+0000 7f59cffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564dd680670 0x5564ddac7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.725+0000 7f59ceffd640 1 --2- 172.21.15.46:0/2271167654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5564dd678490 0x5564dda68270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.725+0000 7f59cf7fe640 1 -- 172.21.15.46:0/2271167654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564dd680670 msgr2=0x5564ddac7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:44.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.725+0000 7f59cf7fe640 1 --2- 172.21.15.46:0/2271167654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564dd680670 0x5564ddac7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.725+0000 7f59cf7fe640 1 -- 172.21.15.46:0/2271167654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5564dd678490 msgr2=0x5564dda68270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:44.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.725+0000 7f59cf7fe640 1 --2- 172.21.15.46:0/2271167654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5564dd678490 0x5564dda68270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.725+0000 7f59cf7fe640 1 -- 172.21.15.46:0/2271167654 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564ddac7ea0 con 0x5564dd65fcd0 2024-09-21T04:02:44.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.725+0000 7f59cf7fe640 1 --2- 172.21.15.46:0/2271167654 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5564dd65fcd0 0x5564dda67c90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f59c0009520 tx=0x7f59c0013c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3103d5512180507 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:44.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.725+0000 7f59aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-21T04:02:44.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.725+0000 7f59aeffd640 1 -- 172.21.15.46:0/2271167654 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c0035030 con 0x5564dd65fcd0 2024-09-21T04:02:44.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.725+0000 7f59aeffd640 1 -- 172.21.15.46:0/2271167654 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f59c001c450 con 0x5564dd65fcd0 2024-09-21T04:02:44.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.725+0000 7f59dc70b740 1 -- 172.21.15.46:0/2271167654 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59b80ac750 con 0x5564dd65fcd0 2024-09-21T04:02:44.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.726+0000 7f59aeffd640 1 -- 172.21.15.46:0/2271167654 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f59c003f050 con 0x5564dd65fcd0 2024-09-21T04:02:44.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.726+0000 7f59dc70b740 10 client.26021 fetch_fsmap learned FSMap version 20 2024-09-21T04:02:44.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.726+0000 7f59dc70b740 1 -- 172.21.15.46:0/2271167654 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5564ddad14a0 con 0x5564dd65fcd0 2024-09-21T04:02:44.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.726+0000 7f59aeffd640 1 -- 172.21.15.46:0/2271167654 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59b80ac750 con 0x5564dd65fcd0 2024-09-21T04:02:44.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.726+0000 7f59aeffd640 1 -- 172.21.15.46:0/2271167654 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f59c002e070 con 0x5564dd65fcd0 2024-09-21T04:02:44.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.726+0000 7f59dc70b740 10 client.26021 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:02:44.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.726+0000 7f59dc70b740 10 client.26021 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:02:44.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.726+0000 7f59dc70b740 20 client.26021 populate_metadata read hostname 'smithi046' 2024-09-21T04:02:44.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.726+0000 7f59dc70b740 1 --2- 172.21.15.46:0/2271167654 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5564dd6a1350 0x5564ddad3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.726+0000 7f59dc70b740 4 client.26021 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T04:02:44.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.726+0000 7f59dc70b740 1 -- 172.21.15.46:0/2271167654 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5564dd9bc860 con 0x5564dd6a1350 2024-09-21T04:02:44.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.726+0000 7f59ceffd640 1 --2- 172.21.15.46:0/2271167654 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5564dd6a1350 0x5564ddad3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.727+0000 7f59aeffd640 10 client.26021 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:02:44.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.727+0000 7f59ceffd640 1 --2- 172.21.15.46:0/2271167654 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5564dd6a1350 0x5564ddad3c80 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7745ef24c398d249 server_cookie=4fde9d5e80e23157 in_seq=0 out_seq=0 2024-09-21T04:02:44.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.729+0000 7f59aeffd640 1 -- 172.21.15.46:0/2271167654 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5564dd9bc860 con 0x5564dd6a1350 2024-09-21T04:02:44.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.729+0000 7f59aeffd640 10 client.26021 handle_command_reply: tid=0 2024-09-21T04:02:44.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.729+0000 7f59dc70b740 1 client.26021 shutdown 2024-09-21T04:02:44.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.729+0000 7f59dc70b740 1 -- 172.21.15.46:0/2271167654 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5564dd65fcd0 msgr2=0x5564dda67c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:44.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.729+0000 7f59dc70b740 1 --2- 172.21.15.46:0/2271167654 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5564dd65fcd0 0x5564dda67c90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f59c0009520 tx=0x7f59c0013c40 comp rx=0 tx=0).stop 2024-09-21T04:02:44.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.729+0000 7f59dc70b740 1 -- 172.21.15.46:0/2271167654 shutdown_connections 2024-09-21T04:02:44.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.729+0000 7f59dc70b740 1 --2- 172.21.15.46:0/2271167654 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5564dd6a1350 0x5564ddad3c80 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.729+0000 7f59dc70b740 1 --2- 172.21.15.46:0/2271167654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564dd680670 0x5564ddac7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.729+0000 7f59aeffd640 0 client.26021 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:02:44.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.729+0000 7f59dc70b740 1 --2- 172.21.15.46:0/2271167654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5564dd678490 0x5564dda68270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.729+0000 7f59dc70b740 1 --2- 172.21.15.46:0/2271167654 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5564dd65fcd0 0x5564dda67c90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.729+0000 7f59dc70b740 1 -- 172.21.15.46:0/2271167654 >> 172.21.15.46:0/2271167654 conn(0x5564dd695740 msgr2=0x5564dda49bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:44.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.729+0000 7f59dc70b740 1 -- 172.21.15.46:0/2271167654 shutdown_connections 2024-09-21T04:02:44.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.729+0000 7f59dc70b740 1 -- 172.21.15.46:0/2271167654 wait complete. 2024-09-21T04:02:44.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.730+0000 7f59dc70b740 20 client.26021 trim_cache size 0 max 16384 2024-09-21T04:02:44.828 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T04:02:44.828 INFO:teuthology.orchestra.run.smithi046.stdout: "return_code": 0, 2024-09-21T04:02:44.828 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_tag": "96aa13fd-aa77-46b5-b20e-a9b203dc7a94", 2024-09-21T04:02:44.829 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": "asynchronous" 2024-09-21T04:02:44.829 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T04:02:44.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.730+0000 7f59d6197640 1 -- 172.21.15.46:0/3475744811 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f59bc0b6680 msgr2=0x7f59bc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:44.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.730+0000 7f59d6197640 1 --2- 172.21.15.46:0/3475744811 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f59bc0b6680 0x7f59bc0b8b90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f59c80094e0 tx=0x7f59c803e040 comp rx=0 tx=0).stop 2024-09-21T04:02:44.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.730+0000 7f59d6197640 1 -- 172.21.15.46:0/3475744811 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59d01052b0 msgr2=0x7f59d019aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:44.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.730+0000 7f59d6197640 1 --2- 172.21.15.46:0/3475744811 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59d01052b0 0x7f59d019aaf0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f59b8006fd0 tx=0x7f59b800b820 comp rx=0 tx=0).stop 2024-09-21T04:02:44.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.730+0000 7f59d6197640 1 -- 172.21.15.46:0/3475744811 shutdown_connections 2024-09-21T04:02:44.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.730+0000 7f59d6197640 1 --2- 172.21.15.46:0/3475744811 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f59bc0b6680 0x7f59bc0b8b90 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.730+0000 7f59d6197640 1 --2- 172.21.15.46:0/3475744811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59d010de30 0x7f59d019fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.730+0000 7f59d6197640 1 --2- 172.21.15.46:0/3475744811 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59d01052b0 0x7f59d019aaf0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.730+0000 7f59d6197640 1 --2- 172.21.15.46:0/3475744811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59d0104880 0x7f59d019a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.730+0000 7f59d6197640 1 -- 172.21.15.46:0/3475744811 >> 172.21.15.46:0/3475744811 conn(0x7f59d0079740 msgr2=0x7f59d0100870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:44.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.730+0000 7f59d6197640 1 -- 172.21.15.46:0/3475744811 shutdown_connections 2024-09-21T04:02:44.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:44.731+0000 7f59d6197640 1 -- 172.21.15.46:0/3475744811 wait complete. 2024-09-21T04:02:45.529 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T04:02:45.552 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:45 smithi046 ceph-mon[30954]: pgmap v553: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T04:02:45.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:45 smithi105 ceph-mon[34773]: pgmap v553: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T04:02:45.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:45 smithi162 ceph-mon[35071]: pgmap v553: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T04:02:45.797 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:46.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.314+0000 7f9d31591640 1 -- 172.21.15.46:0/1297124321 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d2c1083d0 msgr2=0x7f9d2c1087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:46.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.314+0000 7f9d31591640 1 --2- 172.21.15.46:0/1297124321 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d2c1083d0 0x7f9d2c1087e0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f9d14009900 tx=0x7f9d1402a410 comp rx=0 tx=0).stop 2024-09-21T04:02:46.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.314+0000 7f9d31591640 1 -- 172.21.15.46:0/1297124321 shutdown_connections 2024-09-21T04:02:46.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.314+0000 7f9d31591640 1 --2- 172.21.15.46:0/1297124321 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d2c108d20 0x7f9d2c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.314+0000 7f9d31591640 1 --2- 172.21.15.46:0/1297124321 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d2c1083d0 0x7f9d2c1087e0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.314+0000 7f9d31591640 1 --2- 172.21.15.46:0/1297124321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d2c102ae0 0x7f9d2c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.314+0000 7f9d31591640 1 -- 172.21.15.46:0/1297124321 >> 172.21.15.46:0/1297124321 conn(0x7f9d2c079760 msgr2=0x7f9d2c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:46.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.314+0000 7f9d31591640 1 -- 172.21.15.46:0/1297124321 shutdown_connections 2024-09-21T04:02:46.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.314+0000 7f9d31591640 1 -- 172.21.15.46:0/1297124321 wait complete. 2024-09-21T04:02:46.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.315+0000 7f9d31591640 1 Processor -- start 2024-09-21T04:02:46.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.315+0000 7f9d31591640 1 -- start start 2024-09-21T04:02:46.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.315+0000 7f9d31591640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d2c102ae0 0x7f9d2c19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.315+0000 7f9d31591640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d2c1083d0 0x7f9d2c19aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.315+0000 7f9d31591640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d2c108d20 0x7f9d2c19fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.315+0000 7f9d31591640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c112990 con 0x7f9d2c1083d0 2024-09-21T04:02:46.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.315+0000 7f9d31591640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c112810 con 0x7f9d2c108d20 2024-09-21T04:02:46.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.315+0000 7f9d31591640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c112b10 con 0x7f9d2c102ae0 2024-09-21T04:02:46.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.316+0000 7f9d2a7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d2c1083d0 0x7f9d2c19aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:46.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.316+0000 7f9d2a7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d2c1083d0 0x7f9d2c19aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39106/0 (socket says 172.21.15.46:39106) 2024-09-21T04:02:46.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.316+0000 7f9d2a7fc640 1 -- 172.21.15.46:0/3480135720 learned_addr learned my addr 172.21.15.46:0/3480135720 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:46.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.316+0000 7f9d2b7fe640 1 --2- 172.21.15.46:0/3480135720 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d2c108d20 0x7f9d2c19fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:46.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.316+0000 7f9d2affd640 1 --2- 172.21.15.46:0/3480135720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d2c102ae0 0x7f9d2c19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:46.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.316+0000 7f9d2a7fc640 1 -- 172.21.15.46:0/3480135720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d2c102ae0 msgr2=0x7f9d2c19a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:46.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.316+0000 7f9d2a7fc640 1 --2- 172.21.15.46:0/3480135720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d2c102ae0 0x7f9d2c19a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.316+0000 7f9d2a7fc640 1 -- 172.21.15.46:0/3480135720 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d2c108d20 msgr2=0x7f9d2c19fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:46.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.316+0000 7f9d2a7fc640 1 --2- 172.21.15.46:0/3480135720 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d2c108d20 0x7f9d2c19fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.316+0000 7f9d2a7fc640 1 -- 172.21.15.46:0/3480135720 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d2c1a0420 con 0x7f9d2c1083d0 2024-09-21T04:02:46.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.316+0000 7f9d2affd640 1 --2- 172.21.15.46:0/3480135720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d2c102ae0 0x7f9d2c19a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:02:46.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.316+0000 7f9d2a7fc640 1 --2- 172.21.15.46:0/3480135720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d2c1083d0 0x7f9d2c19aa50 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f9d14031a90 tx=0x7f9d14004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:46.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.316+0000 7f9d23fff640 1 -- 172.21.15.46:0/3480135720 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1403f030 con 0x7f9d2c1083d0 2024-09-21T04:02:46.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.316+0000 7f9d31591640 1 -- 172.21.15.46:0/3480135720 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d2c1a06b0 con 0x7f9d2c1083d0 2024-09-21T04:02:46.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.316+0000 7f9d23fff640 1 -- 172.21.15.46:0/3480135720 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d14003cb0 con 0x7f9d2c1083d0 2024-09-21T04:02:46.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.316+0000 7f9d23fff640 1 -- 172.21.15.46:0/3480135720 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d14035070 con 0x7f9d2c1083d0 2024-09-21T04:02:46.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.317+0000 7f9d31591640 1 -- 172.21.15.46:0/3480135720 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d2c1a6e70 con 0x7f9d2c1083d0 2024-09-21T04:02:46.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.319+0000 7f9d37b05740 1 Processor -- start 2024-09-21T04:02:46.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.319+0000 7f9d37b05740 1 -- start start 2024-09-21T04:02:46.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.319+0000 7f9d23fff640 1 -- 172.21.15.46:0/3480135720 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f9d14042030 con 0x7f9d2c1083d0 2024-09-21T04:02:46.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.320+0000 7f9d37b05740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5578f9050070 0x5578f93f7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.320+0000 7f9d37b05740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578f90271b0 0x5578f93f7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.320+0000 7f9d37b05740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5578f902f390 0x5578f93f80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.320+0000 7f9d37b05740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5578f936de50 con 0x5578f9050070 2024-09-21T04:02:46.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.320+0000 7f9d37b05740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5578f935d280 con 0x5578f902f390 2024-09-21T04:02:46.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.320+0000 7f9d37b05740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5578f9361090 con 0x5578f90271b0 2024-09-21T04:02:46.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.320+0000 7f9d2b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5578f9050070 0x5578f93f7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:46.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.320+0000 7f9d2b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5578f9050070 0x5578f93f7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39112/0 (socket says 172.21.15.46:39112) 2024-09-21T04:02:46.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.320+0000 7f9d2b7fe640 1 -- 172.21.15.46:0/3113255648 learned_addr learned my addr 172.21.15.46:0/3113255648 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:46.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.320+0000 7f9d2affd640 1 --2- 172.21.15.46:0/3113255648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578f90271b0 0x5578f93f7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:46.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.320+0000 7f9d2a7fc640 1 --2- 172.21.15.46:0/3113255648 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5578f902f390 0x5578f93f80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:46.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.320+0000 7f9d2b7fe640 1 -- 172.21.15.46:0/3113255648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578f90271b0 msgr2=0x5578f93f7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:46.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.320+0000 7f9d2b7fe640 1 --2- 172.21.15.46:0/3113255648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578f90271b0 0x5578f93f7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.320+0000 7f9d2b7fe640 1 -- 172.21.15.46:0/3113255648 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5578f902f390 msgr2=0x5578f93f80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:46.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.320+0000 7f9d2b7fe640 1 --2- 172.21.15.46:0/3113255648 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5578f902f390 0x5578f93f80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.320+0000 7f9d2b7fe640 1 -- 172.21.15.46:0/3113255648 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578f90bb650 con 0x5578f9050070 2024-09-21T04:02:46.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.320+0000 7f9d2a7fc640 1 --2- 172.21.15.46:0/3113255648 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5578f902f390 0x5578f93f80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:02:46.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.320+0000 7f9d2affd640 1 --2- 172.21.15.46:0/3113255648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578f90271b0 0x5578f93f7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:02:46.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.321+0000 7f9d23fff640 1 --2- 172.21.15.46:0/3480135720 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f9d180b6680 0x7f9d180b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.321+0000 7f9d2b7fe640 1 --2- 172.21.15.46:0/3113255648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5578f9050070 0x5578f93f7650 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f9d2400ae90 tx=0x7f9d2400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd822ff2e62e04d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:46.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.321+0000 7f9d2affd640 1 --2- 172.21.15.46:0/3480135720 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f9d180b6680 0x7f9d180b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:46.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.321+0000 7f9d23fff640 1 -- 172.21.15.46:0/3480135720 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f9d14107cd0 con 0x7f9d2c1083d0 2024-09-21T04:02:46.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.321+0000 7f9d217fa640 1 -- 172.21.15.46:0/3113255648 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d24003b70 con 0x5578f9050070 2024-09-21T04:02:46.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.321+0000 7f9d217fa640 1 -- 172.21.15.46:0/3113255648 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d24003d10 con 0x5578f9050070 2024-09-21T04:02:46.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.321+0000 7f9d217fa640 1 -- 172.21.15.46:0/3113255648 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d24010ba0 con 0x5578f9050070 2024-09-21T04:02:46.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.322+0000 7f9d37b05740 1 -- 172.21.15.46:0/3113255648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5578f9050070 msgr2=0x5578f93f7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:46.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.322+0000 7f9d37b05740 1 --2- 172.21.15.46:0/3113255648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5578f9050070 0x5578f93f7650 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f9d2400ae90 tx=0x7f9d2400f790 comp rx=0 tx=0).stop 2024-09-21T04:02:46.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.322+0000 7f9d2affd640 1 --2- 172.21.15.46:0/3480135720 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f9d180b6680 0x7f9d180b8b90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x5578f93f62d0 tx=0x7f9d1c00c390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:46.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.322+0000 7f9d37b05740 1 -- 172.21.15.46:0/3113255648 shutdown_connections 2024-09-21T04:02:46.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.322+0000 7f9d37b05740 1 --2- 172.21.15.46:0/3113255648 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5578f902f390 0x5578f93f80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.322+0000 7f9d37b05740 1 --2- 172.21.15.46:0/3113255648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578f90271b0 0x5578f93f7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.322+0000 7f9d37b05740 1 --2- 172.21.15.46:0/3113255648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5578f9050070 0x5578f93f7650 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.322+0000 7f9d37b05740 1 -- 172.21.15.46:0/3113255648 >> 172.21.15.46:0/3113255648 conn(0x5578f9044460 msgr2=0x5578f93f5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:46.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.322+0000 7f9d37b05740 1 -- 172.21.15.46:0/3113255648 shutdown_connections 2024-09-21T04:02:46.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.322+0000 7f9d37b05740 1 -- 172.21.15.46:0/3113255648 wait complete. 2024-09-21T04:02:46.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.323+0000 7f9d37b05740 1 -- start start 2024-09-21T04:02:46.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.323+0000 7f9d37b05740 1 Processor -- start 2024-09-21T04:02:46.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.323+0000 7f9d37b05740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578f90271b0 0x5578f9402d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.323+0000 7f9d37b05740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5578f902f390 0x5578f94032d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.323+0000 7f9d37b05740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5578f9050070 0x5578f940f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.323+0000 7f9d37b05740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5578f91be700 con 0x5578f902f390 2024-09-21T04:02:46.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.323+0000 7f9d37b05740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5578f92f8110 con 0x5578f9050070 2024-09-21T04:02:46.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.323+0000 7f9d37b05740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5578f9405e30 con 0x5578f90271b0 2024-09-21T04:02:46.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.323+0000 7f9d37b05740 10 client.0 _ll_register_callbacks cb 0x5578f9311990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:02:46.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.323+0000 7f9d2a7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5578f902f390 0x5578f94032d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:46.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.323+0000 7f9d2a7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5578f902f390 0x5578f94032d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39126/0 (socket says 172.21.15.46:39126) 2024-09-21T04:02:46.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.323+0000 7f9d2a7fc640 1 -- 172.21.15.46:0/964037673 learned_addr learned my addr 172.21.15.46:0/964037673 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:46.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.323+0000 7f9d2affd640 1 --2- 172.21.15.46:0/964037673 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578f90271b0 0x5578f9402d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:46.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.323+0000 7f9d2b7fe640 1 --2- 172.21.15.46:0/964037673 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5578f9050070 0x5578f940f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:46.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.324+0000 7f9d2a7fc640 1 -- 172.21.15.46:0/964037673 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578f90271b0 msgr2=0x5578f9402d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:46.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.324+0000 7f9d2a7fc640 1 --2- 172.21.15.46:0/964037673 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578f90271b0 0x5578f9402d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.324+0000 7f9d2a7fc640 1 -- 172.21.15.46:0/964037673 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5578f9050070 msgr2=0x5578f940f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:46.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.324+0000 7f9d2a7fc640 1 --2- 172.21.15.46:0/964037673 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5578f9050070 0x5578f940f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.324+0000 7f9d2a7fc640 1 -- 172.21.15.46:0/964037673 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578f9325c40 con 0x5578f902f390 2024-09-21T04:02:46.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.324+0000 7f9d2b7fe640 1 --2- 172.21.15.46:0/964037673 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5578f9050070 0x5578f940f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:02:46.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.324+0000 7f9d2a7fc640 1 --2- 172.21.15.46:0/964037673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5578f902f390 0x5578f94032d0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f9d14006010 tx=0x7f9d140ca2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e6b8b7ed39e62f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:46.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.324+0000 7f9d127fc640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:02:46.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.324+0000 7f9d127fc640 1 -- 172.21.15.46:0/964037673 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d14049070 con 0x5578f902f390 2024-09-21T04:02:46.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.324+0000 7f9d127fc640 1 -- 172.21.15.46:0/964037673 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f9d1403bc50 con 0x5578f902f390 2024-09-21T04:02:46.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.324+0000 7f9d37b05740 1 -- 172.21.15.46:0/964037673 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d24003d10 con 0x5578f902f390 2024-09-21T04:02:46.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.324+0000 7f9d127fc640 1 -- 172.21.15.46:0/964037673 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9d140cd4e0 con 0x5578f902f390 2024-09-21T04:02:46.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.324+0000 7f9d37b05740 10 client.16605 fetch_fsmap learned FSMap version 20 2024-09-21T04:02:46.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.324+0000 7f9d37b05740 1 -- 172.21.15.46:0/964037673 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5578f9411b10 con 0x5578f902f390 2024-09-21T04:02:46.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.324+0000 7f9d127fc640 1 -- 172.21.15.46:0/964037673 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d24003d10 con 0x5578f902f390 2024-09-21T04:02:46.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.325+0000 7f9d127fc640 1 -- 172.21.15.46:0/964037673 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f9d14105be0 con 0x5578f902f390 2024-09-21T04:02:46.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.325+0000 7f9d37b05740 10 client.16605 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:02:46.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.325+0000 7f9d37b05740 10 client.16605 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:02:46.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.325+0000 7f9d37b05740 20 client.16605 populate_metadata read hostname 'smithi046' 2024-09-21T04:02:46.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.325+0000 7f9d37b05740 1 --2- 172.21.15.46:0/964037673 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5578f900e9f0 0x5578f9415000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.325+0000 7f9d37b05740 4 client.16605 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:02:46.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.325+0000 7f9d37b05740 1 -- 172.21.15.46:0/964037673 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5578f936fda0 con 0x5578f900e9f0 2024-09-21T04:02:46.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.325+0000 7f9d2affd640 1 --2- 172.21.15.46:0/964037673 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5578f900e9f0 0x5578f9415000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:46.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.325+0000 7f9d127fc640 10 client.16605 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:02:46.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.325+0000 7f9d2affd640 1 --2- 172.21.15.46:0/964037673 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5578f900e9f0 0x5578f9415000 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a333a5cc1ac80590 server_cookie=31c54ef35a70233d in_seq=0 out_seq=0 2024-09-21T04:02:46.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.326+0000 7f9d127fc640 1 -- 172.21.15.46:0/964037673 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5578f936fda0 con 0x5578f900e9f0 2024-09-21T04:02:46.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.326+0000 7f9d127fc640 10 client.16605 handle_command_reply: tid=0 2024-09-21T04:02:46.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.326+0000 7f9d37b05740 1 client.16605 shutdown 2024-09-21T04:02:46.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.327+0000 7f9d37b05740 1 -- 172.21.15.46:0/964037673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5578f902f390 msgr2=0x5578f94032d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:46.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.327+0000 7f9d37b05740 1 --2- 172.21.15.46:0/964037673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5578f902f390 0x5578f94032d0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f9d14006010 tx=0x7f9d140ca2a0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.327+0000 7f9d37b05740 1 -- 172.21.15.46:0/964037673 shutdown_connections 2024-09-21T04:02:46.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.327+0000 7f9d37b05740 1 --2- 172.21.15.46:0/964037673 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5578f900e9f0 0x5578f9415000 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.327+0000 7f9d37b05740 1 --2- 172.21.15.46:0/964037673 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5578f9050070 0x5578f940f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.327+0000 7f9d37b05740 1 --2- 172.21.15.46:0/964037673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5578f902f390 0x5578f94032d0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.327+0000 7f9d37b05740 1 --2- 172.21.15.46:0/964037673 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578f90271b0 0x5578f9402d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.327+0000 7f9d37b05740 1 -- 172.21.15.46:0/964037673 >> 172.21.15.46:0/964037673 conn(0x5578f9044460 msgr2=0x5578f93fa830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:46.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.327+0000 7f9d127fc640 0 client.16605 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:02:46.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.327+0000 7f9d37b05740 1 -- 172.21.15.46:0/964037673 shutdown_connections 2024-09-21T04:02:46.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.327+0000 7f9d37b05740 1 -- 172.21.15.46:0/964037673 wait complete. 2024-09-21T04:02:46.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.327+0000 7f9d37b05740 20 client.16605 trim_cache size 0 max 16384 2024-09-21T04:02:46.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.344+0000 7f9d37b05740 1 Processor -- start 2024-09-21T04:02:46.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.345+0000 7f9d37b05740 1 -- start start 2024-09-21T04:02:46.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.345+0000 7f9d37b05740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578f90271b0 0x5578f94049c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.345+0000 7f9d37b05740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5578f902f390 0x5578f940f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.345+0000 7f9d37b05740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5578f9050070 0x5578f93fff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.345+0000 7f9d37b05740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c1ad570 con 0x5578f902f390 2024-09-21T04:02:46.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.345+0000 7f9d37b05740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c1afdd0 con 0x5578f9050070 2024-09-21T04:02:46.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.345+0000 7f9d37b05740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c1adbc0 con 0x5578f90271b0 2024-09-21T04:02:46.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.345+0000 7f9d2a7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5578f902f390 0x5578f940f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:46.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.345+0000 7f9d2a7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5578f902f390 0x5578f940f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39130/0 (socket says 172.21.15.46:39130) 2024-09-21T04:02:46.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.345+0000 7f9d2a7fc640 1 -- 172.21.15.46:0/437349096 learned_addr learned my addr 172.21.15.46:0/437349096 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:46.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.345+0000 7f9d2affd640 1 --2- 172.21.15.46:0/437349096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578f90271b0 0x5578f94049c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:46.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.345+0000 7f9d2b7fe640 1 --2- 172.21.15.46:0/437349096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5578f9050070 0x5578f93fff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:46.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.345+0000 7f9d2a7fc640 1 -- 172.21.15.46:0/437349096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578f90271b0 msgr2=0x5578f94049c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:46.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.345+0000 7f9d2a7fc640 1 --2- 172.21.15.46:0/437349096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578f90271b0 0x5578f94049c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.345+0000 7f9d2a7fc640 1 -- 172.21.15.46:0/437349096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5578f9050070 msgr2=0x5578f93fff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:46.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.345+0000 7f9d2a7fc640 1 --2- 172.21.15.46:0/437349096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5578f9050070 0x5578f93fff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.345+0000 7f9d2a7fc640 1 -- 172.21.15.46:0/437349096 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578f93f9940 con 0x5578f902f390 2024-09-21T04:02:46.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.345+0000 7f9d2b7fe640 1 --2- 172.21.15.46:0/437349096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5578f9050070 0x5578f93fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:02:46.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.346+0000 7f9d2a7fc640 1 --2- 172.21.15.46:0/437349096 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5578f902f390 0x5578f940f050 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f9d14004650 tx=0x7f9d1402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea26d8630ff8f7ef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:46.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.346+0000 7f9d20ff9640 1 -- 172.21.15.46:0/437349096 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d14049030 con 0x5578f902f390 2024-09-21T04:02:46.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.346+0000 7f9d20ff9640 1 -- 172.21.15.46:0/437349096 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d14109070 con 0x5578f902f390 2024-09-21T04:02:46.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.346+0000 7f9d20ff9640 1 -- 172.21.15.46:0/437349096 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d140cd300 con 0x5578f902f390 2024-09-21T04:02:46.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.347+0000 7f9d37b05740 1 -- 172.21.15.46:0/437349096 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5578f902f390 msgr2=0x5578f940f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:46.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.347+0000 7f9d37b05740 1 --2- 172.21.15.46:0/437349096 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5578f902f390 0x5578f940f050 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f9d14004650 tx=0x7f9d1402a410 comp rx=0 tx=0).stop 2024-09-21T04:02:46.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.347+0000 7f9d37b05740 1 -- 172.21.15.46:0/437349096 shutdown_connections 2024-09-21T04:02:46.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.347+0000 7f9d37b05740 1 --2- 172.21.15.46:0/437349096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5578f9050070 0x5578f93fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.347+0000 7f9d37b05740 1 --2- 172.21.15.46:0/437349096 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5578f902f390 0x5578f940f050 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.347+0000 7f9d37b05740 1 --2- 172.21.15.46:0/437349096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578f90271b0 0x5578f94049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.347+0000 7f9d37b05740 1 -- 172.21.15.46:0/437349096 >> 172.21.15.46:0/437349096 conn(0x5578f9044460 msgr2=0x5578f94042b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:46.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.347+0000 7f9d37b05740 1 -- 172.21.15.46:0/437349096 shutdown_connections 2024-09-21T04:02:46.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.347+0000 7f9d37b05740 1 -- 172.21.15.46:0/437349096 wait complete. 2024-09-21T04:02:46.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.347+0000 7f9d37b05740 1 -- start start 2024-09-21T04:02:46.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.347+0000 7f9d37b05740 1 Processor -- start 2024-09-21T04:02:46.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.348+0000 7f9d37b05740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5578f90271b0 0x5578f940b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.348+0000 7f9d37b05740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5578f902f390 0x5578f940bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.348+0000 7f9d37b05740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578f9050070 0x5578f9406ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.348+0000 7f9d37b05740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c1ae290 con 0x5578f90271b0 2024-09-21T04:02:46.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.348+0000 7f9d37b05740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c1af700 con 0x5578f902f390 2024-09-21T04:02:46.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.348+0000 7f9d37b05740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c1ae960 con 0x5578f9050070 2024-09-21T04:02:46.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.348+0000 7f9d37b05740 10 client.0 _ll_register_callbacks cb 0x7f9d14005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:02:46.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.348+0000 7f9d2affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5578f90271b0 0x5578f940b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:46.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.348+0000 7f9d2affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5578f90271b0 0x5578f940b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39142/0 (socket says 172.21.15.46:39142) 2024-09-21T04:02:46.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.348+0000 7f9d2affd640 1 -- 172.21.15.46:0/996488608 learned_addr learned my addr 172.21.15.46:0/996488608 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:02:46.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.348+0000 7f9d2b7fe640 1 --2- 172.21.15.46:0/996488608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578f9050070 0x5578f9406ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:46.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.348+0000 7f9d2a7fc640 1 --2- 172.21.15.46:0/996488608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5578f902f390 0x5578f940bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:46.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.348+0000 7f9d2affd640 1 -- 172.21.15.46:0/996488608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578f9050070 msgr2=0x5578f9406ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:46.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.348+0000 7f9d2affd640 1 --2- 172.21.15.46:0/996488608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578f9050070 0x5578f9406ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.348+0000 7f9d2affd640 1 -- 172.21.15.46:0/996488608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5578f902f390 msgr2=0x5578f940bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:46.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.348+0000 7f9d2affd640 1 --2- 172.21.15.46:0/996488608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5578f902f390 0x5578f940bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.348+0000 7f9d2affd640 1 -- 172.21.15.46:0/996488608 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578f9407330 con 0x5578f90271b0 2024-09-21T04:02:46.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.348+0000 7f9d2affd640 1 --2- 172.21.15.46:0/996488608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5578f90271b0 0x5578f940b520 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c011790 tx=0x7f9d1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8228b42073f2c24d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:46.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.348+0000 7f9d127fc640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:02:46.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.349+0000 7f9d127fc640 1 -- 172.21.15.46:0/996488608 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c004220 con 0x5578f90271b0 2024-09-21T04:02:46.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.349+0000 7f9d127fc640 1 -- 172.21.15.46:0/996488608 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f9d1c0043c0 con 0x5578f90271b0 2024-09-21T04:02:46.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.349+0000 7f9d37b05740 1 -- 172.21.15.46:0/996488608 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d14109070 con 0x5578f90271b0 2024-09-21T04:02:46.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.349+0000 7f9d127fc640 1 -- 172.21.15.46:0/996488608 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9d1c01f930 con 0x5578f90271b0 2024-09-21T04:02:46.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.349+0000 7f9d37b05740 10 client.16611 fetch_fsmap learned FSMap version 20 2024-09-21T04:02:46.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.349+0000 7f9d37b05740 1 -- 172.21.15.46:0/996488608 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5578f947f5f0 con 0x5578f90271b0 2024-09-21T04:02:46.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.349+0000 7f9d127fc640 1 -- 172.21.15.46:0/996488608 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d14109070 con 0x5578f90271b0 2024-09-21T04:02:46.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.349+0000 7f9d127fc640 1 -- 172.21.15.46:0/996488608 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f9d1c037030 con 0x5578f90271b0 2024-09-21T04:02:46.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.349+0000 7f9d37b05740 10 client.16611 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:02:46.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.349+0000 7f9d37b05740 10 client.16611 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:02:46.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.349+0000 7f9d37b05740 20 client.16611 populate_metadata read hostname 'smithi046' 2024-09-21T04:02:46.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.349+0000 7f9d37b05740 1 --2- 172.21.15.46:0/996488608 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5578f8fe3da0 0x5578f9481e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.349+0000 7f9d37b05740 4 client.16611 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T04:02:46.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.349+0000 7f9d37b05740 1 -- 172.21.15.46:0/996488608 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5578f936b850 con 0x5578f8fe3da0 2024-09-21T04:02:46.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.350+0000 7f9d2a7fc640 1 --2- 172.21.15.46:0/996488608 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5578f8fe3da0 0x5578f9481e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:46.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.350+0000 7f9d2a7fc640 1 --2- 172.21.15.46:0/996488608 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5578f8fe3da0 0x5578f9481e10 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=765a1801d055b839 server_cookie=87af19c052cd0838 in_seq=0 out_seq=0 2024-09-21T04:02:46.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.350+0000 7f9d127fc640 10 client.16611 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:02:46.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.350+0000 7f9d127fc640 1 -- 172.21.15.46:0/996488608 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4830 (crc 0 0 0) 0x5578f936b850 con 0x5578f8fe3da0 2024-09-21T04:02:46.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.350+0000 7f9d127fc640 10 client.16611 handle_command_reply: tid=0 2024-09-21T04:02:46.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.351+0000 7f9d37b05740 1 client.16611 shutdown 2024-09-21T04:02:46.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.351+0000 7f9d37b05740 1 -- 172.21.15.46:0/996488608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5578f90271b0 msgr2=0x5578f940b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:46.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.351+0000 7f9d37b05740 1 --2- 172.21.15.46:0/996488608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5578f90271b0 0x5578f940b520 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c011790 tx=0x7f9d1c0046c0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.351+0000 7f9d37b05740 1 -- 172.21.15.46:0/996488608 shutdown_connections 2024-09-21T04:02:46.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.351+0000 7f9d37b05740 1 --2- 172.21.15.46:0/996488608 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5578f8fe3da0 0x5578f9481e10 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.351+0000 7f9d127fc640 0 client.16611 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:02:46.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.351+0000 7f9d37b05740 1 --2- 172.21.15.46:0/996488608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578f9050070 0x5578f9406ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.351+0000 7f9d37b05740 1 --2- 172.21.15.46:0/996488608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5578f902f390 0x5578f940bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.351+0000 7f9d37b05740 1 --2- 172.21.15.46:0/996488608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5578f90271b0 0x5578f940b520 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.351+0000 7f9d37b05740 1 -- 172.21.15.46:0/996488608 >> 172.21.15.46:0/996488608 conn(0x5578f9044460 msgr2=0x5578f93f8630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:46.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.351+0000 7f9d37b05740 1 -- 172.21.15.46:0/996488608 shutdown_connections 2024-09-21T04:02:46.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.351+0000 7f9d37b05740 1 -- 172.21.15.46:0/996488608 wait complete. 2024-09-21T04:02:46.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.351+0000 7f9d37b05740 20 client.16611 trim_cache size 0 max 16384 2024-09-21T04:02:46.358 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T04:02:46.358 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T04:02:46.358 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2024-09-21T04:02:46.358 INFO:teuthology.orchestra.run.smithi046.stdout: "96aa13fd-aa77-46b5-b20e-a9b203dc7a94": { 2024-09-21T04:02:46.359 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:46.359 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "96aa13fd-aa77-46b5-b20e-a9b203dc7a94", 2024-09-21T04:02:46.359 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2024-09-21T04:02:46.359 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:02:46.359 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:46.359 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_stats": { 2024-09-21T04:02:46.359 INFO:teuthology.orchestra.run.smithi046.stdout: "96aa13fd-aa77-46b5-b20e-a9b203dc7a94": { 2024-09-21T04:02:46.359 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:02:44.727411+0000", 2024-09-21T04:02:46.359 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:46.359 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:46.359 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:46.359 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:46.359 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:46.360 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:46.360 INFO:teuthology.orchestra.run.smithi046.stdout: "64865e31-a445-43e8-9fa3-26fae089b973": { 2024-09-21T04:02:46.360 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:02:37.376562+0000", 2024-09-21T04:02:46.360 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:46.360 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:46.360 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:46.360 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:46.360 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:46.360 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:46.360 INFO:teuthology.orchestra.run.smithi046.stdout: "7a3afabe-6b27-4bce-928a-8c6773a85803": { 2024-09-21T04:02:46.360 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:01:58.413358+0000", 2024-09-21T04:02:46.360 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:46.360 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:46.361 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:46.361 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:46.361 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:46.361 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:46.361 INFO:teuthology.orchestra.run.smithi046.stdout: "08f0c962-df1a-4129-a1a2-b916240d9803": { 2024-09-21T04:02:46.361 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:02.937596+0000", 2024-09-21T04:02:46.361 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:46.361 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:46.361 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:46.361 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:46.361 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:46.361 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:46.361 INFO:teuthology.orchestra.run.smithi046.stdout: "d49f33a7-3d5a-421b-94ba-8b19a4120db1": { 2024-09-21T04:02:46.361 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:50.480786+0000", 2024-09-21T04:02:46.362 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:46.362 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:46.362 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:46.362 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:46.362 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:46.362 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:46.362 INFO:teuthology.orchestra.run.smithi046.stdout: "a871f724-0198-493c-b03e-b2de78aba243": { 2024-09-21T04:02:46.362 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:56:30.082991+0000", 2024-09-21T04:02:46.362 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:46.362 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:46.362 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:46.362 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:46.362 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:46.363 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:46.363 INFO:teuthology.orchestra.run.smithi046.stdout: "edc4b8c7-b702-489d-a925-ae7ad0ff0d9a": { 2024-09-21T04:02:46.363 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:00:40.181950+0000", 2024-09-21T04:02:46.363 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:46.363 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:46.363 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:46.363 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:46.363 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:46.363 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:46.363 INFO:teuthology.orchestra.run.smithi046.stdout: "3bbf7097-70d7-4743-bbce-41465502b35b": { 2024-09-21T04:02:46.363 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:10.661441+0000", 2024-09-21T04:02:46.363 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:46.364 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:46.364 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:46.364 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:46.364 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:46.364 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:46.364 INFO:teuthology.orchestra.run.smithi046.stdout: "e24ec8f1-0d13-478f-9c2c-b51798868ffc": { 2024-09-21T04:02:46.364 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:09.736194+0000", 2024-09-21T04:02:46.364 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:46.364 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:46.364 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:46.364 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:46.364 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:46.364 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:46.365 INFO:teuthology.orchestra.run.smithi046.stdout: "c47f458a-de5e-4952-a575-a81261953667": { 2024-09-21T04:02:46.365 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:48.699411+0000", 2024-09-21T04:02:46.365 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:46.365 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:46.365 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:46.365 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:46.365 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:46.365 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:46.365 INFO:teuthology.orchestra.run.smithi046.stdout: "6103c660-8e77-4b06-ad6c-bb322c26035a": { 2024-09-21T04:02:46.365 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:35.594467+0000", 2024-09-21T04:02:46.365 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:46.365 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:46.365 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:46.365 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:46.366 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:46.366 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:46.366 INFO:teuthology.orchestra.run.smithi046.stdout: "46bb5415-6e16-47c6-a1e4-55f9c623ce90": { 2024-09-21T04:02:46.366 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:14.950674+0000", 2024-09-21T04:02:46.366 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:46.366 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:46.366 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:46.366 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:46.366 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:46.366 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:46.366 INFO:teuthology.orchestra.run.smithi046.stdout: "326aaecf-f38a-4946-988a-d83f25556995": { 2024-09-21T04:02:46.366 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:54.189884+0000", 2024-09-21T04:02:46.366 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:46.367 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:46.367 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:46.367 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:46.367 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:46.367 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:46.367 INFO:teuthology.orchestra.run.smithi046.stdout: "dab67652-8894-4711-be64-cbdfea27a9ba": { 2024-09-21T04:02:46.367 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:28.161616+0000", 2024-09-21T04:02:46.367 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:46.367 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:46.367 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:46.367 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:46.367 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:46.367 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:46.367 INFO:teuthology.orchestra.run.smithi046.stdout: "0d781b95-cf5e-46f2-9875-2923181385e2": { 2024-09-21T04:02:46.368 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:00:33.099094+0000", 2024-09-21T04:02:46.368 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:46.368 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:46.368 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:46.368 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:46.368 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:46.368 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:02:46.368 INFO:teuthology.orchestra.run.smithi046.stdout: "d7634007-e881-46f7-9833-ac9bd0a3100e": { 2024-09-21T04:02:46.368 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:01:19.459151+0000", 2024-09-21T04:02:46.368 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:02:46.368 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:02:46.368 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:02:46.368 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:02:46.368 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:02:46.369 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:02:46.369 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:02:46.369 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T04:02:46.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.351+0000 7f9d31591640 1 -- 172.21.15.46:0/3480135720 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f9d180b6680 msgr2=0x7f9d180b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:46.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.351+0000 7f9d31591640 1 --2- 172.21.15.46:0/3480135720 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f9d180b6680 0x7f9d180b8b90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x5578f93f62d0 tx=0x7f9d1c00c390 comp rx=0 tx=0).stop 2024-09-21T04:02:46.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.351+0000 7f9d31591640 1 -- 172.21.15.46:0/3480135720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d2c1083d0 msgr2=0x7f9d2c19aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:46.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.351+0000 7f9d31591640 1 --2- 172.21.15.46:0/3480135720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d2c1083d0 0x7f9d2c19aa50 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f9d14031a90 tx=0x7f9d14004270 comp rx=0 tx=0).stop 2024-09-21T04:02:46.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.352+0000 7f9d31591640 1 -- 172.21.15.46:0/3480135720 shutdown_connections 2024-09-21T04:02:46.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.352+0000 7f9d31591640 1 --2- 172.21.15.46:0/3480135720 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d2c108d20 0x7f9d2c19fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.352+0000 7f9d31591640 1 --2- 172.21.15.46:0/3480135720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d2c1083d0 0x7f9d2c19aa50 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.352+0000 7f9d31591640 1 --2- 172.21.15.46:0/3480135720 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f9d180b6680 0x7f9d180b8b90 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.352+0000 7f9d31591640 1 --2- 172.21.15.46:0/3480135720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d2c102ae0 0x7f9d2c19a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.352+0000 7f9d31591640 1 -- 172.21.15.46:0/3480135720 >> 172.21.15.46:0/3480135720 conn(0x7f9d2c079760 msgr2=0x7f9d2c101b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:46.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.352+0000 7f9d31591640 1 -- 172.21.15.46:0/3480135720 shutdown_connections 2024-09-21T04:02:46.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:02:46.352+0000 7f9d31591640 1 -- 172.21.15.46:0/3480135720 wait complete. 2024-09-21T04:02:46.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:46 smithi046 ceph-mon[30954]: scrub queued for path: / 2024-09-21T04:02:46.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:46 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T04:02:46.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:46 smithi046 ceph-mon[30954]: scrub summary: active paths [/] 2024-09-21T04:02:46.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:46 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T04:02:46.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:46 smithi105 ceph-mon[34773]: scrub queued for path: / 2024-09-21T04:02:46.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:46 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T04:02:46.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:46 smithi105 ceph-mon[34773]: scrub summary: active paths [/] 2024-09-21T04:02:46.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:46 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T04:02:46.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:46 smithi162 ceph-mon[35071]: scrub queued for path: / 2024-09-21T04:02:46.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:46 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T04:02:46.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:46 smithi162 ceph-mon[35071]: scrub summary: active paths [/] 2024-09-21T04:02:46.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:46 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T04:02:47.158 INFO:tasks.cephfs.filesystem:scrub status for tag:96aa13fd-aa77-46b5-b20e-a9b203dc7a94 - {'path': '/', 'tag': '96aa13fd-aa77-46b5-b20e-a9b203dc7a94', 'options': 'recursive,force'} 2024-09-21T04:02:47.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:47 smithi046 ceph-mon[30954]: pgmap v554: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2 op/s 2024-09-21T04:02:47.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:47 smithi105 ceph-mon[34773]: pgmap v554: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2 op/s 2024-09-21T04:02:47.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:47 smithi162 ceph-mon[35071]: pgmap v554: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2 op/s 2024-09-21T04:02:49.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:49 smithi105 ceph-mon[34773]: pgmap v555: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 4 op/s 2024-09-21T04:02:49.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:49 smithi105 ceph-mon[34773]: scrub summary: idle 2024-09-21T04:02:49.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:49 smithi162 ceph-mon[35071]: pgmap v555: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 4 op/s 2024-09-21T04:02:49.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:49 smithi162 ceph-mon[35071]: scrub summary: idle 2024-09-21T04:02:49.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:49 smithi046 ceph-mon[30954]: pgmap v555: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 4 op/s 2024-09-21T04:02:49.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:49 smithi046 ceph-mon[30954]: scrub summary: idle 2024-09-21T04:02:51.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:51 smithi105 ceph-mon[34773]: pgmap v556: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-21T04:02:51.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:51 smithi162 ceph-mon[35071]: pgmap v556: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-21T04:02:51.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:51 smithi046 ceph-mon[30954]: pgmap v556: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-21T04:02:53.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:53 smithi105 ceph-mon[34773]: pgmap v557: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-21T04:02:53.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:53 smithi162 ceph-mon[35071]: pgmap v557: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-21T04:02:53.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:53 smithi046 ceph-mon[30954]: pgmap v557: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-21T04:02:55.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:55 smithi046 ceph-mon[30954]: pgmap v558: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T04:02:55.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:55 smithi105 ceph-mon[34773]: pgmap v558: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T04:02:55.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:55 smithi162 ceph-mon[35071]: pgmap v558: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T04:02:57.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:57 smithi105 ceph-mon[34773]: pgmap v559: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T04:02:57.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:57 smithi162 ceph-mon[35071]: pgmap v559: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T04:02:57.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:57 smithi046 ceph-mon[30954]: pgmap v559: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T04:02:59.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:02:59 smithi105 ceph-mon[34773]: pgmap v560: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-09-21T04:02:59.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:02:59 smithi162 ceph-mon[35071]: pgmap v560: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-09-21T04:02:59.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:02:59 smithi046 ceph-mon[30954]: pgmap v560: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-09-21T04:03:01.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:01 smithi105 ceph-mon[34773]: pgmap v561: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:03:01.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:01 smithi162 ceph-mon[35071]: pgmap v561: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:03:01.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:01 smithi046 ceph-mon[30954]: pgmap v561: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:03:03.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:03 smithi162 ceph-mon[35071]: pgmap v562: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T04:03:03.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:03 smithi046 ceph-mon[30954]: pgmap v562: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T04:03:03.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:03 smithi105 ceph-mon[34773]: pgmap v562: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T04:03:05.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:05 smithi162 ceph-mon[35071]: pgmap v563: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-21T04:03:05.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:05 smithi046 ceph-mon[30954]: pgmap v563: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-21T04:03:05.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:05 smithi105 ceph-mon[34773]: pgmap v563: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-21T04:03:07.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:07 smithi162 ceph-mon[35071]: pgmap v564: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-21T04:03:07.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:07 smithi046 ceph-mon[30954]: pgmap v564: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-21T04:03:07.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:07 smithi105 ceph-mon[34773]: pgmap v564: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-21T04:03:09.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:09 smithi162 ceph-mon[35071]: pgmap v565: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-21T04:03:09.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:09 smithi046 ceph-mon[30954]: pgmap v565: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-21T04:03:09.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:09 smithi105 ceph-mon[34773]: pgmap v565: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-21T04:03:10.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:10 smithi162 ceph-mon[35071]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T04:03:10.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:10 smithi046 ceph-mon[30954]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T04:03:10.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:10 smithi105 ceph-mon[34773]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T04:03:11.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:11 smithi162 ceph-mon[35071]: pgmap v567: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-21T04:03:11.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:11 smithi046 ceph-mon[30954]: pgmap v567: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-21T04:03:11.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:11 smithi105 ceph-mon[34773]: pgmap v567: 97 pgs: 97 active+clean; 14 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-21T04:03:14.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:13 smithi162 ceph-mon[35071]: pgmap v568: 97 pgs: 97 active+clean; 14 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 27 KiB/s wr, 5 op/s 2024-09-21T04:03:14.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:13 smithi046 ceph-mon[30954]: pgmap v568: 97 pgs: 97 active+clean; 14 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 27 KiB/s wr, 5 op/s 2024-09-21T04:03:14.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:13 smithi105 ceph-mon[34773]: pgmap v568: 97 pgs: 97 active+clean; 14 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 27 KiB/s wr, 5 op/s 2024-09-21T04:03:16.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:15 smithi162 ceph-mon[35071]: pgmap v569: 97 pgs: 97 active+clean; 14 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T04:03:16.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:15 smithi046 ceph-mon[30954]: pgmap v569: 97 pgs: 97 active+clean; 14 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T04:03:16.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:15 smithi105 ceph-mon[34773]: pgmap v569: 97 pgs: 97 active+clean; 14 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T04:03:17.159 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T04:03:17.435 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:03:17.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.959+0000 7f42b39ce640 1 -- 172.21.15.46:0/3532862468 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ac101fe0 msgr2=0x7f42ac1023f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:17.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.959+0000 7f42b39ce640 1 --2- 172.21.15.46:0/3532862468 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ac101fe0 0x7f42ac1023f0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f42a8009900 tx=0x7f42a802a410 comp rx=0 tx=0).stop 2024-09-21T04:03:17.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.959+0000 7f42b39ce640 1 -- 172.21.15.46:0/3532862468 shutdown_connections 2024-09-21T04:03:17.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.959+0000 7f42b39ce640 1 --2- 172.21.15.46:0/3532862468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42ac109e10 0x7f42ac110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:17.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.959+0000 7f42b39ce640 1 --2- 172.21.15.46:0/3532862468 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42ac1094c0 0x7f42ac1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:17.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.959+0000 7f42b39ce640 1 --2- 172.21.15.46:0/3532862468 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ac101fe0 0x7f42ac1023f0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:17.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.959+0000 7f42b39ce640 1 -- 172.21.15.46:0/3532862468 >> 172.21.15.46:0/3532862468 conn(0x7f42ac077bc0 msgr2=0x7f42ac078000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:17.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.960+0000 7f42b39ce640 1 -- 172.21.15.46:0/3532862468 shutdown_connections 2024-09-21T04:03:17.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.960+0000 7f42b39ce640 1 -- 172.21.15.46:0/3532862468 wait complete. 2024-09-21T04:03:17.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.960+0000 7f42b39ce640 1 Processor -- start 2024-09-21T04:03:17.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.960+0000 7f42b39ce640 1 -- start start 2024-09-21T04:03:17.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.961+0000 7f42b39ce640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42ac101fe0 0x7f42ac19a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:17.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.961+0000 7f42b39ce640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ac1094c0 0x7f42ac19a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:17.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.961+0000 7f42b39ce640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42ac109e10 0x7f42ac19fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:17.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.961+0000 7f42b39ce640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac113a80 con 0x7f42ac1094c0 2024-09-21T04:03:17.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.961+0000 7f42b39ce640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac113900 con 0x7f42ac109e10 2024-09-21T04:03:17.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.961+0000 7f42b39ce640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac113c00 con 0x7f42ac101fe0 2024-09-21T04:03:17.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.961+0000 7f42b0f69640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ac1094c0 0x7f42ac19a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:17.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.961+0000 7f42b0f69640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ac1094c0 0x7f42ac19a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60314/0 (socket says 172.21.15.46:60314) 2024-09-21T04:03:17.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.961+0000 7f42b0f69640 1 -- 172.21.15.46:0/4064477069 learned_addr learned my addr 172.21.15.46:0/4064477069 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:03:17.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.961+0000 7f42b176a640 1 --2- 172.21.15.46:0/4064477069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42ac101fe0 0x7f42ac19a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:17.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.961+0000 7f42b1f6b640 1 --2- 172.21.15.46:0/4064477069 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42ac109e10 0x7f42ac19fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:17.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.961+0000 7f42b0f69640 1 -- 172.21.15.46:0/4064477069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42ac101fe0 msgr2=0x7f42ac19a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:17.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.961+0000 7f42b0f69640 1 --2- 172.21.15.46:0/4064477069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42ac101fe0 0x7f42ac19a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:17.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.961+0000 7f42b0f69640 1 -- 172.21.15.46:0/4064477069 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42ac109e10 msgr2=0x7f42ac19fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:17.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.961+0000 7f42b0f69640 1 --2- 172.21.15.46:0/4064477069 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42ac109e10 0x7f42ac19fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:17.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.961+0000 7f42b0f69640 1 -- 172.21.15.46:0/4064477069 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42ac1a0380 con 0x7f42ac1094c0 2024-09-21T04:03:17.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.961+0000 7f42b1f6b640 1 --2- 172.21.15.46:0/4064477069 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42ac109e10 0x7f42ac19fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:03:17.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.961+0000 7f42b0f69640 1 --2- 172.21.15.46:0/4064477069 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ac1094c0 0x7f42ac19a9b0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f429c00d740 tx=0x7f429c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:17.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.962+0000 7f42a27fc640 1 -- 172.21.15.46:0/4064477069 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c017070 con 0x7f42ac1094c0 2024-09-21T04:03:17.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.962+0000 7f42a27fc640 1 -- 172.21.15.46:0/4064477069 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f429c00de50 con 0x7f42ac1094c0 2024-09-21T04:03:17.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.962+0000 7f42a27fc640 1 -- 172.21.15.46:0/4064477069 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c003c20 con 0x7f42ac1094c0 2024-09-21T04:03:17.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.962+0000 7f42b39ce640 1 -- 172.21.15.46:0/4064477069 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42ac1a0670 con 0x7f42ac1094c0 2024-09-21T04:03:17.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.962+0000 7f42b39ce640 1 -- 172.21.15.46:0/4064477069 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42ac1a6dd0 con 0x7f42ac1094c0 2024-09-21T04:03:17.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.964+0000 7f42b9f42740 1 Processor -- start 2024-09-21T04:03:17.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.965+0000 7f42b9f42740 1 -- start start 2024-09-21T04:03:17.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.965+0000 7f42a27fc640 1 -- 172.21.15.46:0/4064477069 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f429c003dc0 con 0x7f42ac1094c0 2024-09-21T04:03:17.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.965+0000 7f42b9f42740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e8ac2b070 0x558e8afd2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:17.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.965+0000 7f42b9f42740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558e8ac021b0 0x558e8afd27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:17.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.965+0000 7f42b9f42740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558e8ac0a390 0x558e8afd2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:17.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.965+0000 7f42b9f42740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x558e8af48e50 con 0x558e8ac0a390 2024-09-21T04:03:17.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.965+0000 7f42b9f42740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x558e8af38280 con 0x558e8ac021b0 2024-09-21T04:03:17.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.965+0000 7f42b9f42740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558e8af3c090 con 0x558e8ac2b070 2024-09-21T04:03:17.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.965+0000 7f42b0f69640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558e8ac0a390 0x558e8afd2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:17.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.965+0000 7f42b0f69640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558e8ac0a390 0x558e8afd2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60328/0 (socket says 172.21.15.46:60328) 2024-09-21T04:03:17.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.965+0000 7f42b0f69640 1 -- 172.21.15.46:0/328126333 learned_addr learned my addr 172.21.15.46:0/328126333 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:03:17.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.965+0000 7f42b1f6b640 1 --2- 172.21.15.46:0/328126333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e8ac2b070 0x558e8afd2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:17.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.965+0000 7f42b176a640 1 --2- 172.21.15.46:0/328126333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558e8ac021b0 0x558e8afd27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:17.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.966+0000 7f42b0f69640 1 -- 172.21.15.46:0/328126333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e8ac2b070 msgr2=0x558e8afd2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:17.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.966+0000 7f42b0f69640 1 --2- 172.21.15.46:0/328126333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e8ac2b070 0x558e8afd2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:17.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.966+0000 7f42b0f69640 1 -- 172.21.15.46:0/328126333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558e8ac021b0 msgr2=0x558e8afd27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:17.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.966+0000 7f42b0f69640 1 --2- 172.21.15.46:0/328126333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558e8ac021b0 0x558e8afd27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:17.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.966+0000 7f42b0f69640 1 -- 172.21.15.46:0/328126333 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e8ac96650 con 0x558e8ac0a390 2024-09-21T04:03:17.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.966+0000 7f42a27fc640 1 --2- 172.21.15.46:0/4064477069 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f42980b6700 0x7f42980b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:17.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.966+0000 7f42b0f69640 1 --2- 172.21.15.46:0/328126333 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558e8ac0a390 0x558e8afd2cf0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f429c0e47b0 tx=0x7f429c0ef780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efafcb4dbddd34e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:17.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.966+0000 7f42b1f6b640 1 --2- 172.21.15.46:0/4064477069 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f42980b6700 0x7f42980b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:17.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.966+0000 7f42a27fc640 1 -- 172.21.15.46:0/4064477069 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f429c0e7080 con 0x7f42ac1094c0 2024-09-21T04:03:17.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.966+0000 7f42977fe640 1 -- 172.21.15.46:0/328126333 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c020070 con 0x558e8ac0a390 2024-09-21T04:03:17.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.966+0000 7f42977fe640 1 -- 172.21.15.46:0/328126333 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f429c0aca50 con 0x558e8ac0a390 2024-09-21T04:03:17.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.966+0000 7f42977fe640 1 -- 172.21.15.46:0/328126333 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c0a8de0 con 0x558e8ac0a390 2024-09-21T04:03:17.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.967+0000 7f42b9f42740 1 -- 172.21.15.46:0/328126333 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558e8ac0a390 msgr2=0x558e8afd2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:17.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.967+0000 7f42b1f6b640 1 --2- 172.21.15.46:0/4064477069 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f42980b6700 0x7f42980b8c10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f42a4005fd0 tx=0x7f42a4009800 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:17.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.967+0000 7f42b9f42740 1 --2- 172.21.15.46:0/328126333 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558e8ac0a390 0x558e8afd2cf0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f429c0e47b0 tx=0x7f429c0ef780 comp rx=0 tx=0).stop 2024-09-21T04:03:17.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.967+0000 7f42b9f42740 1 -- 172.21.15.46:0/328126333 shutdown_connections 2024-09-21T04:03:17.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.967+0000 7f42b9f42740 1 --2- 172.21.15.46:0/328126333 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558e8ac0a390 0x558e8afd2cf0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:17.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.967+0000 7f42b9f42740 1 --2- 172.21.15.46:0/328126333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558e8ac021b0 0x558e8afd27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:17.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.967+0000 7f42b9f42740 1 --2- 172.21.15.46:0/328126333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e8ac2b070 0x558e8afd2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:17.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.967+0000 7f42b9f42740 1 -- 172.21.15.46:0/328126333 >> 172.21.15.46:0/328126333 conn(0x558e8ac1f460 msgr2=0x558e8afd0160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:17.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.967+0000 7f42b9f42740 1 -- 172.21.15.46:0/328126333 shutdown_connections 2024-09-21T04:03:17.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.967+0000 7f42b9f42740 1 -- 172.21.15.46:0/328126333 wait complete. 2024-09-21T04:03:17.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.968+0000 7f42b9f42740 1 -- start start 2024-09-21T04:03:17.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.968+0000 7f42b9f42740 1 Processor -- start 2024-09-21T04:03:17.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.968+0000 7f42b9f42740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558e8ac021b0 0x558e8afdd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:17.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.968+0000 7f42b9f42740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e8ac0a390 0x558e8afdde40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:17.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.968+0000 7f42b9f42740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558e8ac2b070 0x558e8afe9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:17.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.968+0000 7f42b9f42740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x558e8ad99700 con 0x558e8ac021b0 2024-09-21T04:03:17.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.968+0000 7f42b9f42740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x558e8aed3110 con 0x558e8ac2b070 2024-09-21T04:03:17.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.968+0000 7f42b9f42740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558e8afe0a50 con 0x558e8ac0a390 2024-09-21T04:03:17.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.968+0000 7f42b9f42740 10 client.0 _ll_register_callbacks cb 0x558e8aeec990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:03:17.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.968+0000 7f42b176a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558e8ac021b0 0x558e8afdd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:17.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.969+0000 7f42b176a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558e8ac021b0 0x558e8afdd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60340/0 (socket says 172.21.15.46:60340) 2024-09-21T04:03:17.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.969+0000 7f42b176a640 1 -- 172.21.15.46:0/2744274742 learned_addr learned my addr 172.21.15.46:0/2744274742 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:03:17.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.969+0000 7f42b1f6b640 1 --2- 172.21.15.46:0/2744274742 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558e8ac2b070 0x558e8afe9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:17.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.969+0000 7f42b0f69640 1 --2- 172.21.15.46:0/2744274742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e8ac0a390 0x558e8afdde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:17.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.969+0000 7f42b176a640 1 -- 172.21.15.46:0/2744274742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e8ac0a390 msgr2=0x558e8afdde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:17.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.969+0000 7f42b176a640 1 --2- 172.21.15.46:0/2744274742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e8ac0a390 0x558e8afdde40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:17.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.969+0000 7f42b176a640 1 -- 172.21.15.46:0/2744274742 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558e8ac2b070 msgr2=0x558e8afe9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:17.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.969+0000 7f42b176a640 1 --2- 172.21.15.46:0/2744274742 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558e8ac2b070 0x558e8afe9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:17.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.969+0000 7f42b176a640 1 -- 172.21.15.46:0/2744274742 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e8af00c40 con 0x558e8ac021b0 2024-09-21T04:03:17.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.969+0000 7f42b176a640 1 --2- 172.21.15.46:0/2744274742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558e8ac021b0 0x558e8afdd900 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f42a8009900 tx=0x7f42a80316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=678c5952c048bbce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:17.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.969+0000 7f4294ff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:03:17.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.969+0000 7f4294ff9640 1 -- 172.21.15.46:0/2744274742 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a8035040 con 0x558e8ac021b0 2024-09-21T04:03:17.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.969+0000 7f4294ff9640 1 -- 172.21.15.46:0/2744274742 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f42a8031b10 con 0x558e8ac021b0 2024-09-21T04:03:17.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.969+0000 7f42b9f42740 1 -- 172.21.15.46:0/2744274742 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f429c0aca50 con 0x558e8ac021b0 2024-09-21T04:03:17.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.970+0000 7f4294ff9640 1 -- 172.21.15.46:0/2744274742 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f42a8031d10 con 0x558e8ac021b0 2024-09-21T04:03:17.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.970+0000 7f42b9f42740 10 client.16623 fetch_fsmap learned FSMap version 20 2024-09-21T04:03:17.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.970+0000 7f42b9f42740 1 -- 172.21.15.46:0/2744274742 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x558e8afec730 con 0x558e8ac021b0 2024-09-21T04:03:17.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.970+0000 7f4294ff9640 1 -- 172.21.15.46:0/2744274742 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f429c0aca50 con 0x558e8ac021b0 2024-09-21T04:03:17.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.970+0000 7f4294ff9640 1 -- 172.21.15.46:0/2744274742 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f42a804d020 con 0x558e8ac021b0 2024-09-21T04:03:17.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.970+0000 7f42b9f42740 10 client.16623 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:03:17.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.970+0000 7f42b9f42740 10 client.16623 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:03:17.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.970+0000 7f42b9f42740 20 client.16623 populate_metadata read hostname 'smithi046' 2024-09-21T04:03:17.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.970+0000 7f42b9f42740 1 --2- 172.21.15.46:0/2744274742 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558e8abe99f0 0x558e8afefb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:17.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.970+0000 7f42b9f42740 4 client.16623 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:03:17.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.970+0000 7f42b9f42740 1 -- 172.21.15.46:0/2744274742 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e8af4ada0 con 0x558e8abe99f0 2024-09-21T04:03:17.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.970+0000 7f42b0f69640 1 --2- 172.21.15.46:0/2744274742 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558e8abe99f0 0x558e8afefb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:17.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.971+0000 7f42b0f69640 1 --2- 172.21.15.46:0/2744274742 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558e8abe99f0 0x558e8afefb90 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58331214a1055a24 server_cookie=a64c9079c012a764 in_seq=0 out_seq=0 2024-09-21T04:03:17.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.971+0000 7f4294ff9640 10 client.16623 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:03:17.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.972+0000 7f4294ff9640 1 -- 172.21.15.46:0/2744274742 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558e8af4ada0 con 0x558e8abe99f0 2024-09-21T04:03:17.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.972+0000 7f4294ff9640 10 client.16623 handle_command_reply: tid=0 2024-09-21T04:03:17.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.972+0000 7f42b9f42740 1 client.16623 shutdown 2024-09-21T04:03:17.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.972+0000 7f42b9f42740 1 -- 172.21.15.46:0/2744274742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558e8ac021b0 msgr2=0x558e8afdd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:17.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.972+0000 7f42b9f42740 1 --2- 172.21.15.46:0/2744274742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558e8ac021b0 0x558e8afdd900 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f42a8009900 tx=0x7f42a80316d0 comp rx=0 tx=0).stop 2024-09-21T04:03:17.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.972+0000 7f42b9f42740 1 -- 172.21.15.46:0/2744274742 shutdown_connections 2024-09-21T04:03:17.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.972+0000 7f42b9f42740 1 --2- 172.21.15.46:0/2744274742 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558e8abe99f0 0x558e8afefb90 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:17.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.972+0000 7f42b9f42740 1 --2- 172.21.15.46:0/2744274742 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558e8ac2b070 0x558e8afe9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:17.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.972+0000 7f42b9f42740 1 --2- 172.21.15.46:0/2744274742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e8ac0a390 0x558e8afdde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:17.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.972+0000 7f4294ff9640 0 client.16623 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:03:17.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.972+0000 7f42b9f42740 1 --2- 172.21.15.46:0/2744274742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558e8ac021b0 0x558e8afdd900 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:17.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.972+0000 7f42b9f42740 1 -- 172.21.15.46:0/2744274742 >> 172.21.15.46:0/2744274742 conn(0x558e8ac1f460 msgr2=0x558e8afd5400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:17.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.972+0000 7f42b9f42740 1 -- 172.21.15.46:0/2744274742 shutdown_connections 2024-09-21T04:03:17.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.972+0000 7f42b9f42740 1 -- 172.21.15.46:0/2744274742 wait complete. 2024-09-21T04:03:17.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.972+0000 7f42b9f42740 20 client.16623 trim_cache size 0 max 16384 2024-09-21T04:03:17.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.990+0000 7f42b9f42740 1 Processor -- start 2024-09-21T04:03:17.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.990+0000 7f42b9f42740 1 -- start start 2024-09-21T04:03:17.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.990+0000 7f42b9f42740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558e8ac021b0 0x558e8afd39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:17.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.990+0000 7f42b9f42740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558e8ac0a390 0x558e8afcf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:17.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.990+0000 7f42b9f42740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e8ac2b070 0x558e8afcfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:17.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.990+0000 7f42b9f42740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac1ad520 con 0x558e8ac021b0 2024-09-21T04:03:17.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.990+0000 7f42b9f42740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac1afd80 con 0x558e8ac0a390 2024-09-21T04:03:17.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.990+0000 7f42b9f42740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac1adb70 con 0x558e8ac2b070 2024-09-21T04:03:17.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.990+0000 7f42b176a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558e8ac021b0 0x558e8afd39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:17.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.990+0000 7f42b176a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558e8ac021b0 0x558e8afd39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60350/0 (socket says 172.21.15.46:60350) 2024-09-21T04:03:17.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.990+0000 7f42b176a640 1 -- 172.21.15.46:0/852619147 learned_addr learned my addr 172.21.15.46:0/852619147 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:03:17.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.990+0000 7f42b0f69640 1 --2- 172.21.15.46:0/852619147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558e8ac0a390 0x558e8afcf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:17.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.990+0000 7f42b1f6b640 1 --2- 172.21.15.46:0/852619147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e8ac2b070 0x558e8afcfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:17.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.990+0000 7f42b176a640 1 -- 172.21.15.46:0/852619147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e8ac2b070 msgr2=0x558e8afcfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:17.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.990+0000 7f42b176a640 1 --2- 172.21.15.46:0/852619147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e8ac2b070 0x558e8afcfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:17.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.990+0000 7f42b176a640 1 -- 172.21.15.46:0/852619147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558e8ac0a390 msgr2=0x558e8afcf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:17.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.990+0000 7f42b176a640 1 --2- 172.21.15.46:0/852619147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558e8ac0a390 0x558e8afcf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:17.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.990+0000 7f42b176a640 1 -- 172.21.15.46:0/852619147 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e8afca410 con 0x558e8ac021b0 2024-09-21T04:03:17.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.990+0000 7f42b0f69640 1 --2- 172.21.15.46:0/852619147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558e8ac0a390 0x558e8afcf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:03:17.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.990+0000 7f42b1f6b640 1 --2- 172.21.15.46:0/852619147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e8ac2b070 0x558e8afcfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:03:17.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.991+0000 7f42b176a640 1 --2- 172.21.15.46:0/852619147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558e8ac021b0 0x558e8afd39b0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f42a802a450 tx=0x7f42a8031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64626b80e17783db server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:17.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.991+0000 7f4296ffd640 1 -- 172.21.15.46:0/852619147 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a8035070 con 0x558e8ac021b0 2024-09-21T04:03:17.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.991+0000 7f4296ffd640 1 -- 172.21.15.46:0/852619147 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42a8004870 con 0x558e8ac021b0 2024-09-21T04:03:17.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.991+0000 7f4296ffd640 1 -- 172.21.15.46:0/852619147 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a804f6c0 con 0x558e8ac021b0 2024-09-21T04:03:17.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.992+0000 7f42b9f42740 1 -- 172.21.15.46:0/852619147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558e8ac021b0 msgr2=0x558e8afd39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:17.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.992+0000 7f42b9f42740 1 --2- 172.21.15.46:0/852619147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558e8ac021b0 0x558e8afd39b0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f42a802a450 tx=0x7f42a8031ca0 comp rx=0 tx=0).stop 2024-09-21T04:03:17.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.992+0000 7f42b9f42740 1 -- 172.21.15.46:0/852619147 shutdown_connections 2024-09-21T04:03:17.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.992+0000 7f42b9f42740 1 --2- 172.21.15.46:0/852619147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e8ac2b070 0x558e8afcfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:17.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.992+0000 7f42b9f42740 1 --2- 172.21.15.46:0/852619147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558e8ac0a390 0x558e8afcf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:17.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.992+0000 7f42b9f42740 1 --2- 172.21.15.46:0/852619147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558e8ac021b0 0x558e8afd39b0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:17.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.992+0000 7f42b9f42740 1 -- 172.21.15.46:0/852619147 >> 172.21.15.46:0/852619147 conn(0x558e8ac1f460 msgr2=0x558e8afd32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:17.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.992+0000 7f42b9f42740 1 -- 172.21.15.46:0/852619147 shutdown_connections 2024-09-21T04:03:17.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.992+0000 7f42b9f42740 1 -- 172.21.15.46:0/852619147 wait complete. 2024-09-21T04:03:17.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.992+0000 7f42b9f42740 1 -- start start 2024-09-21T04:03:17.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.992+0000 7f42b9f42740 1 Processor -- start 2024-09-21T04:03:17.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.993+0000 7f42b9f42740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e8ac021b0 0x558e8afe1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:17.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.993+0000 7f42b9f42740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558e8ac0a390 0x558e8afe2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:17.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.993+0000 7f42b9f42740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558e8ac2b070 0x558e8afe26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:17.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.993+0000 7f42b9f42740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac1ae240 con 0x558e8ac2b070 2024-09-21T04:03:17.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.993+0000 7f42b9f42740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac1af6b0 con 0x558e8ac0a390 2024-09-21T04:03:17.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.993+0000 7f42b9f42740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac1ae910 con 0x558e8ac021b0 2024-09-21T04:03:17.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.993+0000 7f42b9f42740 10 client.0 _ll_register_callbacks cb 0x7f42a8005db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:03:17.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.993+0000 7f42b1f6b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558e8ac2b070 0x558e8afe26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:17.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.993+0000 7f42b1f6b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558e8ac2b070 0x558e8afe26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60360/0 (socket says 172.21.15.46:60360) 2024-09-21T04:03:17.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.993+0000 7f42b1f6b640 1 -- 172.21.15.46:0/2261662963 learned_addr learned my addr 172.21.15.46:0/2261662963 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:03:17.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.993+0000 7f42b0f69640 1 --2- 172.21.15.46:0/2261662963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558e8ac0a390 0x558e8afe2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:17.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.993+0000 7f42b176a640 1 --2- 172.21.15.46:0/2261662963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e8ac021b0 0x558e8afe1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:17.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.993+0000 7f42b1f6b640 1 -- 172.21.15.46:0/2261662963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e8ac021b0 msgr2=0x558e8afe1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:17.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.993+0000 7f42b1f6b640 1 --2- 172.21.15.46:0/2261662963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e8ac021b0 0x558e8afe1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:17.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.993+0000 7f42b1f6b640 1 -- 172.21.15.46:0/2261662963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558e8ac0a390 msgr2=0x558e8afe2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:17.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.993+0000 7f42b1f6b640 1 --2- 172.21.15.46:0/2261662963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558e8ac0a390 0x558e8afe2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:17.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.993+0000 7f42b1f6b640 1 -- 172.21.15.46:0/2261662963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e8b0595e0 con 0x558e8ac2b070 2024-09-21T04:03:17.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.993+0000 7f42b0f69640 1 --2- 172.21.15.46:0/2261662963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558e8ac0a390 0x558e8afe2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:03:18.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.994+0000 7f42b1f6b640 1 --2- 172.21.15.46:0/2261662963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558e8ac2b070 0x558e8afe26b0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f42a4011ed0 tx=0x7f42a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc70e1bcfc286a3d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:18.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.994+0000 7f4294ff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:03:18.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.994+0000 7f4294ff9640 1 -- 172.21.15.46:0/2261662963 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a4020c30 con 0x558e8ac2b070 2024-09-21T04:03:18.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.994+0000 7f4294ff9640 1 -- 172.21.15.46:0/2261662963 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f42a4020dd0 con 0x558e8ac2b070 2024-09-21T04:03:18.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.994+0000 7f42b9f42740 1 -- 172.21.15.46:0/2261662963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42a8004870 con 0x558e8ac2b070 2024-09-21T04:03:18.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.994+0000 7f4294ff9640 1 -- 172.21.15.46:0/2261662963 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f42a4004b20 con 0x558e8ac2b070 2024-09-21T04:03:18.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.994+0000 7f42b9f42740 10 client.16629 fetch_fsmap learned FSMap version 20 2024-09-21T04:03:18.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.994+0000 7f42b9f42740 1 -- 172.21.15.46:0/2261662963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x558e8b05a7c0 con 0x558e8ac2b070 2024-09-21T04:03:18.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.994+0000 7f4294ff9640 1 -- 172.21.15.46:0/2261662963 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42a8004870 con 0x558e8ac2b070 2024-09-21T04:03:18.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.994+0000 7f4294ff9640 1 -- 172.21.15.46:0/2261662963 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f42a4031030 con 0x558e8ac2b070 2024-09-21T04:03:18.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.994+0000 7f42b9f42740 10 client.16629 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:03:18.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.994+0000 7f42b9f42740 10 client.16629 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:03:18.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.994+0000 7f42b9f42740 20 client.16629 populate_metadata read hostname 'smithi046' 2024-09-21T04:03:18.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.995+0000 7f42b9f42740 1 --2- 172.21.15.46:0/2261662963 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558e8abbeda0 0x558e8b05d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:18.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.995+0000 7f42b9f42740 4 client.16629 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T04:03:18.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.995+0000 7f42b9f42740 1 -- 172.21.15.46:0/2261662963 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558e8af46850 con 0x558e8abbeda0 2024-09-21T04:03:18.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.995+0000 7f42b176a640 1 --2- 172.21.15.46:0/2261662963 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558e8abbeda0 0x558e8b05d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:18.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.995+0000 7f42b176a640 1 --2- 172.21.15.46:0/2261662963 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558e8abbeda0 0x558e8b05d030 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe2802ea7112ae1f server_cookie=bf595ac209489531 in_seq=0 out_seq=0 2024-09-21T04:03:18.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.995+0000 7f4294ff9640 10 client.16629 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:03:18.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.996+0000 7f4294ff9640 1 -- 172.21.15.46:0/2261662963 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4634 (crc 0 0 0) 0x558e8af46850 con 0x558e8abbeda0 2024-09-21T04:03:18.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.996+0000 7f4294ff9640 10 client.16629 handle_command_reply: tid=0 2024-09-21T04:03:18.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.996+0000 7f42b9f42740 1 client.16629 shutdown 2024-09-21T04:03:18.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.996+0000 7f42b9f42740 1 -- 172.21.15.46:0/2261662963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558e8ac2b070 msgr2=0x558e8afe26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:18.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.996+0000 7f42b9f42740 1 --2- 172.21.15.46:0/2261662963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558e8ac2b070 0x558e8afe26b0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f42a4011ed0 tx=0x7f42a4004a40 comp rx=0 tx=0).stop 2024-09-21T04:03:18.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.996+0000 7f42b9f42740 1 -- 172.21.15.46:0/2261662963 shutdown_connections 2024-09-21T04:03:18.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.996+0000 7f42b9f42740 1 --2- 172.21.15.46:0/2261662963 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558e8abbeda0 0x558e8b05d030 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:18.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.996+0000 7f42b9f42740 1 --2- 172.21.15.46:0/2261662963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558e8ac2b070 0x558e8afe26b0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:18.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.996+0000 7f42b9f42740 1 --2- 172.21.15.46:0/2261662963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558e8ac0a390 0x558e8afe2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:18.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.996+0000 7f42b9f42740 1 --2- 172.21.15.46:0/2261662963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e8ac021b0 0x558e8afe1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:18.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.996+0000 7f42b9f42740 1 -- 172.21.15.46:0/2261662963 >> 172.21.15.46:0/2261662963 conn(0x558e8ac1f460 msgr2=0x558e8afd3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:18.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.996+0000 7f4294ff9640 0 client.16629 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:03:18.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.996+0000 7f42b9f42740 1 -- 172.21.15.46:0/2261662963 shutdown_connections 2024-09-21T04:03:18.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.996+0000 7f42b9f42740 1 -- 172.21.15.46:0/2261662963 wait complete. 2024-09-21T04:03:18.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.996+0000 7f42b9f42740 20 client.16629 trim_cache size 0 max 16384 2024-09-21T04:03:18.003 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T04:03:18.003 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "no active scrubs running", 2024-09-21T04:03:18.003 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": {}, 2024-09-21T04:03:18.004 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_stats": { 2024-09-21T04:03:18.004 INFO:teuthology.orchestra.run.smithi046.stdout: "96aa13fd-aa77-46b5-b20e-a9b203dc7a94": { 2024-09-21T04:03:18.004 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:02:44.727411+0000", 2024-09-21T04:03:18.004 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:18.004 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:18.004 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:18.004 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:18.004 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:18.004 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:18.004 INFO:teuthology.orchestra.run.smithi046.stdout: "64865e31-a445-43e8-9fa3-26fae089b973": { 2024-09-21T04:03:18.004 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:02:37.376562+0000", 2024-09-21T04:03:18.004 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:18.004 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:18.004 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:18.004 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:18.005 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:18.005 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:18.005 INFO:teuthology.orchestra.run.smithi046.stdout: "7a3afabe-6b27-4bce-928a-8c6773a85803": { 2024-09-21T04:03:18.005 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:01:58.413358+0000", 2024-09-21T04:03:18.005 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:18.005 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:18.005 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:18.005 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:18.005 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:18.005 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:18.005 INFO:teuthology.orchestra.run.smithi046.stdout: "08f0c962-df1a-4129-a1a2-b916240d9803": { 2024-09-21T04:03:18.005 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:02.937596+0000", 2024-09-21T04:03:18.005 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:18.005 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:18.006 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:18.006 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:18.006 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:18.006 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:18.006 INFO:teuthology.orchestra.run.smithi046.stdout: "d49f33a7-3d5a-421b-94ba-8b19a4120db1": { 2024-09-21T04:03:18.006 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:50.480786+0000", 2024-09-21T04:03:18.006 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:18.006 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:18.006 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:18.006 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:18.006 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:18.006 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:18.006 INFO:teuthology.orchestra.run.smithi046.stdout: "a871f724-0198-493c-b03e-b2de78aba243": { 2024-09-21T04:03:18.007 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:56:30.082991+0000", 2024-09-21T04:03:18.007 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:18.007 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:18.007 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:18.007 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:18.007 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:18.007 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:18.007 INFO:teuthology.orchestra.run.smithi046.stdout: "edc4b8c7-b702-489d-a925-ae7ad0ff0d9a": { 2024-09-21T04:03:18.007 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:00:40.181950+0000", 2024-09-21T04:03:18.007 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:18.007 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:18.007 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:18.007 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:18.008 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:18.008 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:18.008 INFO:teuthology.orchestra.run.smithi046.stdout: "3bbf7097-70d7-4743-bbce-41465502b35b": { 2024-09-21T04:03:18.008 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:10.661441+0000", 2024-09-21T04:03:18.008 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:18.008 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:18.008 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:18.008 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:18.008 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:18.008 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:18.008 INFO:teuthology.orchestra.run.smithi046.stdout: "e24ec8f1-0d13-478f-9c2c-b51798868ffc": { 2024-09-21T04:03:18.008 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:09.736194+0000", 2024-09-21T04:03:18.008 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:18.008 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:18.008 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:18.009 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:18.009 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:18.009 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:18.009 INFO:teuthology.orchestra.run.smithi046.stdout: "c47f458a-de5e-4952-a575-a81261953667": { 2024-09-21T04:03:18.009 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:48.699411+0000", 2024-09-21T04:03:18.009 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:18.009 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:18.009 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:18.009 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:18.009 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:18.009 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:18.009 INFO:teuthology.orchestra.run.smithi046.stdout: "6103c660-8e77-4b06-ad6c-bb322c26035a": { 2024-09-21T04:03:18.009 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:35.594467+0000", 2024-09-21T04:03:18.009 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:18.010 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:18.010 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:18.010 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:18.010 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:18.010 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:18.010 INFO:teuthology.orchestra.run.smithi046.stdout: "46bb5415-6e16-47c6-a1e4-55f9c623ce90": { 2024-09-21T04:03:18.010 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:14.950674+0000", 2024-09-21T04:03:18.010 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:18.010 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:18.010 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:18.010 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:18.010 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:18.010 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:18.010 INFO:teuthology.orchestra.run.smithi046.stdout: "326aaecf-f38a-4946-988a-d83f25556995": { 2024-09-21T04:03:18.011 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:54.189884+0000", 2024-09-21T04:03:18.011 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:18.011 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:18.011 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:18.011 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:18.011 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:18.011 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:18.011 INFO:teuthology.orchestra.run.smithi046.stdout: "dab67652-8894-4711-be64-cbdfea27a9ba": { 2024-09-21T04:03:18.011 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:28.161616+0000", 2024-09-21T04:03:18.011 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:18.011 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:18.011 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:18.012 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:18.012 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:18.012 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:18.012 INFO:teuthology.orchestra.run.smithi046.stdout: "0d781b95-cf5e-46f2-9875-2923181385e2": { 2024-09-21T04:03:18.012 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:00:33.099094+0000", 2024-09-21T04:03:18.012 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:18.012 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:18.012 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:18.012 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:18.012 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:18.012 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:18.012 INFO:teuthology.orchestra.run.smithi046.stdout: "d7634007-e881-46f7-9833-ac9bd0a3100e": { 2024-09-21T04:03:18.012 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:01:19.459151+0000", 2024-09-21T04:03:18.013 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:18.013 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:18.013 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:18.013 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:18.013 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:18.013 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:03:18.013 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:03:18.013 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T04:03:18.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.997+0000 7f42b39ce640 1 -- 172.21.15.46:0/4064477069 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f42980b6700 msgr2=0x7f42980b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:18.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.997+0000 7f42b39ce640 1 --2- 172.21.15.46:0/4064477069 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f42980b6700 0x7f42980b8c10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f42a4005fd0 tx=0x7f42a4009800 comp rx=0 tx=0).stop 2024-09-21T04:03:18.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.997+0000 7f42b39ce640 1 -- 172.21.15.46:0/4064477069 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ac1094c0 msgr2=0x7f42ac19a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:18.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.997+0000 7f42b39ce640 1 --2- 172.21.15.46:0/4064477069 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ac1094c0 0x7f42ac19a9b0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f429c00d740 tx=0x7f429c00dc00 comp rx=0 tx=0).stop 2024-09-21T04:03:18.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.997+0000 7f42b39ce640 1 -- 172.21.15.46:0/4064477069 shutdown_connections 2024-09-21T04:03:18.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.997+0000 7f42b39ce640 1 --2- 172.21.15.46:0/4064477069 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42ac109e10 0x7f42ac19fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:18.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.997+0000 7f42b39ce640 1 --2- 172.21.15.46:0/4064477069 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ac1094c0 0x7f42ac19a9b0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:18.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.997+0000 7f42b39ce640 1 --2- 172.21.15.46:0/4064477069 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f42980b6700 0x7f42980b8c10 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:18.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.997+0000 7f42b39ce640 1 --2- 172.21.15.46:0/4064477069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42ac101fe0 0x7f42ac19a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:18.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.997+0000 7f42b39ce640 1 -- 172.21.15.46:0/4064477069 >> 172.21.15.46:0/4064477069 conn(0x7f42ac077bc0 msgr2=0x7f42ac107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:18.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.997+0000 7f42b39ce640 1 -- 172.21.15.46:0/4064477069 shutdown_connections 2024-09-21T04:03:18.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:17.997+0000 7f42b39ce640 1 -- 172.21.15.46:0/4064477069 wait complete. 2024-09-21T04:03:18.120 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:17 smithi105 ceph-mon[34773]: pgmap v570: 97 pgs: 97 active+clean; 14 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T04:03:18.120 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:17 smithi105 ceph-mon[34773]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T04:03:18.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:17 smithi162 ceph-mon[35071]: pgmap v570: 97 pgs: 97 active+clean; 14 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T04:03:18.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:17 smithi162 ceph-mon[35071]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T04:03:18.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:17 smithi046 ceph-mon[30954]: pgmap v570: 97 pgs: 97 active+clean; 14 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T04:03:18.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:17 smithi046 ceph-mon[30954]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T04:03:18.864 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T04:03:18.865 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:03:19.123 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:03:19.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.638+0000 7f620a306640 1 -- 172.21.15.46:0/1975950303 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6204109e00 msgr2=0x7f6204110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:19.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.638+0000 7f620a306640 1 --2- 172.21.15.46:0/1975950303 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6204109e00 0x7f6204110630 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f61fc009ca0 tx=0x7f61fc02a8c0 comp rx=0 tx=0).stop 2024-09-21T04:03:19.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.638+0000 7f620a306640 1 -- 172.21.15.46:0/1975950303 shutdown_connections 2024-09-21T04:03:19.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.638+0000 7f620a306640 1 --2- 172.21.15.46:0/1975950303 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6204109e00 0x7f6204110630 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:19.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.638+0000 7f620a306640 1 --2- 172.21.15.46:0/1975950303 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62041094b0 0x7f62041098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:19.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.638+0000 7f620a306640 1 --2- 172.21.15.46:0/1975950303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6204101f70 0x7f6204102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:19.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.638+0000 7f620a306640 1 -- 172.21.15.46:0/1975950303 >> 172.21.15.46:0/1975950303 conn(0x7f6204077c60 msgr2=0x7f62040780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:19.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.639+0000 7f620a306640 1 -- 172.21.15.46:0/1975950303 shutdown_connections 2024-09-21T04:03:19.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.639+0000 7f620a306640 1 -- 172.21.15.46:0/1975950303 wait complete. 2024-09-21T04:03:19.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.639+0000 7f620a306640 1 Processor -- start 2024-09-21T04:03:19.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.639+0000 7f620a306640 1 -- start start 2024-09-21T04:03:19.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.640+0000 7f620a306640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6204101f70 0x7f6204102f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:19.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.640+0000 7f620a306640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62041094b0 0x7f6204103450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:19.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.640+0000 7f620a306640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6204109e00 0x7f6204103990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:19.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.640+0000 7f620a306640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6204113ac0 con 0x7f6204101f70 2024-09-21T04:03:19.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.640+0000 7f620a306640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6204113940 con 0x7f62041094b0 2024-09-21T04:03:19.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.640+0000 7f620a306640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6204113c40 con 0x7f6204109e00 2024-09-21T04:03:19.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.640+0000 7f6203fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6204101f70 0x7f6204102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:19.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.640+0000 7f6203fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6204101f70 0x7f6204102f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60382/0 (socket says 172.21.15.46:60382) 2024-09-21T04:03:19.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.640+0000 7f6203fff640 1 -- 172.21.15.46:0/156492645 learned_addr learned my addr 172.21.15.46:0/156492645 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:03:19.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.640+0000 7f62037fe640 1 --2- 172.21.15.46:0/156492645 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62041094b0 0x7f6204103450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:19.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.640+0000 7f62088a3640 1 --2- 172.21.15.46:0/156492645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6204109e00 0x7f6204103990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:19.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.640+0000 7f6203fff640 1 -- 172.21.15.46:0/156492645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6204109e00 msgr2=0x7f6204103990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:19.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.640+0000 7f6203fff640 1 --2- 172.21.15.46:0/156492645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6204109e00 0x7f6204103990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:19.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.640+0000 7f6203fff640 1 -- 172.21.15.46:0/156492645 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62041094b0 msgr2=0x7f6204103450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:19.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.640+0000 7f6203fff640 1 --2- 172.21.15.46:0/156492645 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62041094b0 0x7f6204103450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:19.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.640+0000 7f6203fff640 1 -- 172.21.15.46:0/156492645 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62041a87b0 con 0x7f6204101f70 2024-09-21T04:03:19.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.640+0000 7f62088a3640 1 --2- 172.21.15.46:0/156492645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6204109e00 0x7f6204103990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:03:19.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.640+0000 7f62037fe640 1 --2- 172.21.15.46:0/156492645 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62041094b0 0x7f6204103450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:03:19.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.640+0000 7f6203fff640 1 --2- 172.21.15.46:0/156492645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6204101f70 0x7f6204102f10 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f61f400d950 tx=0x7f61f400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:19.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.641+0000 7f62017fa640 1 -- 172.21.15.46:0/156492645 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f4017070 con 0x7f6204101f70 2024-09-21T04:03:19.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.641+0000 7f620a306640 1 -- 172.21.15.46:0/156492645 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62041a8aa0 con 0x7f6204101f70 2024-09-21T04:03:19.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.641+0000 7f62017fa640 1 -- 172.21.15.46:0/156492645 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61f4009c30 con 0x7f6204101f70 2024-09-21T04:03:19.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.641+0000 7f62017fa640 1 -- 172.21.15.46:0/156492645 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f400f620 con 0x7f6204101f70 2024-09-21T04:03:19.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.641+0000 7f620a306640 1 -- 172.21.15.46:0/156492645 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62041a9030 con 0x7f6204101f70 2024-09-21T04:03:19.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.642+0000 7f620a306640 1 -- 172.21.15.46:0/156492645 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6204102380 con 0x7f6204101f70 2024-09-21T04:03:19.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.643+0000 7f62017fa640 1 -- 172.21.15.46:0/156492645 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f61f4005030 con 0x7f6204101f70 2024-09-21T04:03:19.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.644+0000 7f62017fa640 1 --2- 172.21.15.46:0/156492645 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f61ec0b6680 0x7f61ec0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:19.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.644+0000 7f62037fe640 1 --2- 172.21.15.46:0/156492645 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f61ec0b6680 0x7f61ec0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:19.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.644+0000 7f62017fa640 1 -- 172.21.15.46:0/156492645 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f61f40e7360 con 0x7f6204101f70 2024-09-21T04:03:19.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.645+0000 7f62037fe640 1 --2- 172.21.15.46:0/156492645 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f61ec0b6680 0x7f61ec0b8b90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f61f8005fd0 tx=0x7f61f80094d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:19.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.647+0000 7f62017fa640 1 -- 172.21.15.46:0/156492645 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f61f40ad920 con 0x7f6204101f70 2024-09-21T04:03:19.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.873+0000 7f620a306640 1 -- 172.21.15.46:0/156492645 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f620402e640 con 0x7f6204101f70 2024-09-21T04:03:19.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.874+0000 7f62017fa640 1 -- 172.21.15.46:0/156492645 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f61f4009de0 con 0x7f6204101f70 2024-09-21T04:03:19.877 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T04:03:19.877 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"btime":"2024-09-21T03:53:23:865820+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1766354184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1766354184},{"type":"v1","addr":"172.21.15.46:6839","nonce":1766354184}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/1901774207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":1901774207},{"type":"v1","addr":"172.21.15.46:6841","nonce":1901774207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3548633196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":3548633196},{"type":"v1","addr":"172.21.15.105:6837","nonce":3548633196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24652,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3551934241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3551934241},{"type":"v1","addr":"172.21.15.162:6835","nonce":3551934241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/48949822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":48949822},{"type":"v1","addr":"172.21.15.162:6837","nonce":48949822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:53:14.452819+0000","modified":"2024-09-21T03:53:23.593278+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24680},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/2196053213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2196053213},{"type":"v1","addr":"172.21.15.162:6839","nonce":2196053213}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.105:6839/3911438406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":3911438406},{"type":"v1","addr":"172.21.15.105:6839","nonce":3911438406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24680,"qdb_cluster":[24680]},"id":1}]} 2024-09-21T04:03:19.877 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T04:03:19.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.876+0000 7f620a306640 1 -- 172.21.15.46:0/156492645 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f61ec0b6680 msgr2=0x7f61ec0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:19.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.876+0000 7f620a306640 1 --2- 172.21.15.46:0/156492645 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f61ec0b6680 0x7f61ec0b8b90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f61f8005fd0 tx=0x7f61f80094d0 comp rx=0 tx=0).stop 2024-09-21T04:03:19.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.876+0000 7f620a306640 1 -- 172.21.15.46:0/156492645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6204101f70 msgr2=0x7f6204102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:19.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.876+0000 7f620a306640 1 --2- 172.21.15.46:0/156492645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6204101f70 0x7f6204102f10 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f61f400d950 tx=0x7f61f400de10 comp rx=0 tx=0).stop 2024-09-21T04:03:19.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.876+0000 7f620a306640 1 -- 172.21.15.46:0/156492645 shutdown_connections 2024-09-21T04:03:19.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.876+0000 7f620a306640 1 --2- 172.21.15.46:0/156492645 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f61ec0b6680 0x7f61ec0b8b90 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:19.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.876+0000 7f620a306640 1 --2- 172.21.15.46:0/156492645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6204109e00 0x7f6204103990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:19.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.876+0000 7f620a306640 1 --2- 172.21.15.46:0/156492645 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62041094b0 0x7f6204103450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:19.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.876+0000 7f620a306640 1 --2- 172.21.15.46:0/156492645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6204101f70 0x7f6204102f10 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:19.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.876+0000 7f620a306640 1 -- 172.21.15.46:0/156492645 >> 172.21.15.46:0/156492645 conn(0x7f6204077c60 msgr2=0x7f6204107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:19.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.876+0000 7f620a306640 1 -- 172.21.15.46:0/156492645 shutdown_connections 2024-09-21T04:03:19.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:19.876+0000 7f620a306640 1 -- 172.21.15.46:0/156492645 wait complete. 2024-09-21T04:03:20.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:19 smithi162 ceph-mon[35071]: pgmap v572: 97 pgs: 97 active+clean; 14 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 230 B/s wr, 2 op/s 2024-09-21T04:03:20.185 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:19 smithi046 ceph-mon[30954]: pgmap v572: 97 pgs: 97 active+clean; 14 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 230 B/s wr, 2 op/s 2024-09-21T04:03:20.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:19 smithi105 ceph-mon[34773]: pgmap v572: 97 pgs: 97 active+clean; 14 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 230 B/s wr, 2 op/s 2024-09-21T04:03:20.533 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T04:03:20.794 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:03:21.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:20 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/156492645' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:03:21.173 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:20 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/156492645' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:03:21.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.265+0000 7f9b0868b640 1 -- 172.21.15.46:0/2628953014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b00109e40 msgr2=0x7f9b00110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:21.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.265+0000 7f9b0868b640 1 --2- 172.21.15.46:0/2628953014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b00109e40 0x7f9b00110670 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f9af0009ca0 tx=0x7f9af002a8c0 comp rx=0 tx=0).stop 2024-09-21T04:03:21.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.265+0000 7f9b0868b640 1 -- 172.21.15.46:0/2628953014 shutdown_connections 2024-09-21T04:03:21.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.265+0000 7f9b0868b640 1 --2- 172.21.15.46:0/2628953014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b00109e40 0x7f9b00110670 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:21.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.265+0000 7f9b0868b640 1 --2- 172.21.15.46:0/2628953014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9b001094f0 0x7f9b00109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:21.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.265+0000 7f9b0868b640 1 --2- 172.21.15.46:0/2628953014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b00103bb0 0x7f9b00103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:21.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.265+0000 7f9b0868b640 1 -- 172.21.15.46:0/2628953014 >> 172.21.15.46:0/2628953014 conn(0x7f9b000ff600 msgr2=0x7f9b00101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:21.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.265+0000 7f9b0868b640 1 -- 172.21.15.46:0/2628953014 shutdown_connections 2024-09-21T04:03:21.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.265+0000 7f9b0868b640 1 -- 172.21.15.46:0/2628953014 wait complete. 2024-09-21T04:03:21.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.266+0000 7f9b0868b640 1 Processor -- start 2024-09-21T04:03:21.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.266+0000 7f9b0868b640 1 -- start start 2024-09-21T04:03:21.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.266+0000 7f9b0868b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9b00103bb0 0x7f9b00075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:21.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.266+0000 7f9b0868b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b001094f0 0x7f9b00075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:21.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.266+0000 7f9b0868b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b00109e40 0x7f9b00076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:21.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.266+0000 7f9b0868b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9b00113b00 con 0x7f9b00109e40 2024-09-21T04:03:21.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.266+0000 7f9b0868b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9b00113980 con 0x7f9b00103bb0 2024-09-21T04:03:21.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.266+0000 7f9b0868b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9b00113c80 con 0x7f9b001094f0 2024-09-21T04:03:21.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.266+0000 7f9b06c28640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b00109e40 0x7f9b00076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:21.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.266+0000 7f9b06c28640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b00109e40 0x7f9b00076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60398/0 (socket says 172.21.15.46:60398) 2024-09-21T04:03:21.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.266+0000 7f9b06c28640 1 -- 172.21.15.46:0/1910909221 learned_addr learned my addr 172.21.15.46:0/1910909221 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:03:21.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.266+0000 7f9b06427640 1 --2- 172.21.15.46:0/1910909221 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9b00103bb0 0x7f9b00075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:21.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.266+0000 7f9b05c26640 1 --2- 172.21.15.46:0/1910909221 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b001094f0 0x7f9b00075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:21.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.266+0000 7f9b06c28640 1 -- 172.21.15.46:0/1910909221 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b001094f0 msgr2=0x7f9b00075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:21.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.267+0000 7f9b06c28640 1 --2- 172.21.15.46:0/1910909221 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b001094f0 0x7f9b00075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:21.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.267+0000 7f9b06c28640 1 -- 172.21.15.46:0/1910909221 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9b00103bb0 msgr2=0x7f9b00075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:21.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.267+0000 7f9b06c28640 1 --2- 172.21.15.46:0/1910909221 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9b00103bb0 0x7f9b00075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:21.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.267+0000 7f9b06c28640 1 -- 172.21.15.46:0/1910909221 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b001a8730 con 0x7f9b00109e40 2024-09-21T04:03:21.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.267+0000 7f9b06c28640 1 --2- 172.21.15.46:0/1910909221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b00109e40 0x7f9b00076190 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f9af0005cc0 tx=0x7f9af002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:21.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.267+0000 7f9aff7fe640 1 -- 172.21.15.46:0/1910909221 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af0003bf0 con 0x7f9b00109e40 2024-09-21T04:03:21.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.267+0000 7f9aff7fe640 1 -- 172.21.15.46:0/1910909221 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9af0003d90 con 0x7f9b00109e40 2024-09-21T04:03:21.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.267+0000 7f9aff7fe640 1 -- 172.21.15.46:0/1910909221 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af002fbc0 con 0x7f9b00109e40 2024-09-21T04:03:21.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.267+0000 7f9b0868b640 1 -- 172.21.15.46:0/1910909221 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b001a89c0 con 0x7f9b00109e40 2024-09-21T04:03:21.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.267+0000 7f9b0868b640 1 -- 172.21.15.46:0/1910909221 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b001a8f50 con 0x7f9b00109e40 2024-09-21T04:03:21.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.269+0000 7f9b0ebff740 1 Processor -- start 2024-09-21T04:03:21.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.270+0000 7f9aff7fe640 1 -- 172.21.15.46:0/1910909221 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f9af002fd60 con 0x7f9b00109e40 2024-09-21T04:03:21.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.270+0000 7f9b0ebff740 1 -- start start 2024-09-21T04:03:21.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.270+0000 7f9b0ebff740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5619cefbe070 0x5619cf3652c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:21.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.270+0000 7f9b0ebff740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5619cef951b0 0x5619cf365800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:21.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.270+0000 7f9b0ebff740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619cef9d390 0x5619cf365d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:21.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.270+0000 7f9b0ebff740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5619cf2dbea0 con 0x5619cefbe070 2024-09-21T04:03:21.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.270+0000 7f9b0ebff740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5619cf2cb2d0 con 0x5619cef951b0 2024-09-21T04:03:21.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.270+0000 7f9b0ebff740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5619cf2cf0e0 con 0x5619cef9d390 2024-09-21T04:03:21.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.271+0000 7f9b05c26640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5619cefbe070 0x5619cf3652c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:21.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.271+0000 7f9b05c26640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5619cefbe070 0x5619cf3652c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60408/0 (socket says 172.21.15.46:60408) 2024-09-21T04:03:21.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.271+0000 7f9b05c26640 1 -- 172.21.15.46:0/2239083285 learned_addr learned my addr 172.21.15.46:0/2239083285 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:03:21.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.271+0000 7f9b06427640 1 --2- 172.21.15.46:0/2239083285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5619cef951b0 0x5619cf365800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:21.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.271+0000 7f9b05c26640 1 --2- 172.21.15.46:0/2239083285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619cef9d390 0x5619cf365d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:21.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.271+0000 7f9aff7fe640 1 --2- 172.21.15.46:0/1910909221 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f9ae80b6700 0x7f9ae80b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:21.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.271+0000 7f9b05c26640 1 -- 172.21.15.46:0/2239083285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619cef9d390 msgr2=0x5619cf365d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:21.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.271+0000 7f9b05c26640 1 --2- 172.21.15.46:0/2239083285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619cef9d390 0x5619cf365d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:21.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.271+0000 7f9b05c26640 1 -- 172.21.15.46:0/2239083285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5619cef951b0 msgr2=0x5619cf365800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:21.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.271+0000 7f9b05c26640 1 --2- 172.21.15.46:0/2239083285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5619cef951b0 0x5619cf365800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:21.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.271+0000 7f9b05c26640 1 -- 172.21.15.46:0/2239083285 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619cf029650 con 0x5619cefbe070 2024-09-21T04:03:21.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.271+0000 7f9b06c28640 1 --2- 172.21.15.46:0/1910909221 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f9ae80b6700 0x7f9ae80b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:21.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.271+0000 7f9aff7fe640 1 -- 172.21.15.46:0/1910909221 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f9af0108bc0 con 0x7f9b00109e40 2024-09-21T04:03:21.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.271+0000 7f9b05c26640 1 --2- 172.21.15.46:0/2239083285 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5619cefbe070 0x5619cf3652c0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f9af400df90 tx=0x7f9af400d610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a14ffa738e4a328b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:21.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.272+0000 7f9afcff9640 1 -- 172.21.15.46:0/2239083285 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af4004030 con 0x5619cefbe070 2024-09-21T04:03:21.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.272+0000 7f9afcff9640 1 -- 172.21.15.46:0/2239083285 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9af40054d0 con 0x5619cefbe070 2024-09-21T04:03:21.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.272+0000 7f9afcff9640 1 -- 172.21.15.46:0/2239083285 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af4004b20 con 0x5619cefbe070 2024-09-21T04:03:21.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.272+0000 7f9b0ebff740 1 -- 172.21.15.46:0/2239083285 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5619cefbe070 msgr2=0x5619cf3652c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:21.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.272+0000 7f9b06c28640 1 --2- 172.21.15.46:0/1910909221 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f9ae80b6700 0x7f9ae80b8c10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9af00cbc90 tx=0x7f9af00c3280 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:21.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.272+0000 7f9b0ebff740 1 --2- 172.21.15.46:0/2239083285 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5619cefbe070 0x5619cf3652c0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f9af400df90 tx=0x7f9af400d610 comp rx=0 tx=0).stop 2024-09-21T04:03:21.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.273+0000 7f9b0ebff740 1 -- 172.21.15.46:0/2239083285 shutdown_connections 2024-09-21T04:03:21.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.273+0000 7f9b0ebff740 1 --2- 172.21.15.46:0/2239083285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619cef9d390 0x5619cf365d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:21.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.273+0000 7f9b0ebff740 1 --2- 172.21.15.46:0/2239083285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5619cef951b0 0x5619cf365800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:21.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.273+0000 7f9b0ebff740 1 --2- 172.21.15.46:0/2239083285 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5619cefbe070 0x5619cf3652c0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:21.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.273+0000 7f9b0ebff740 1 -- 172.21.15.46:0/2239083285 >> 172.21.15.46:0/2239083285 conn(0x5619cefb2460 msgr2=0x5619cf3631b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:21.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.273+0000 7f9b0ebff740 1 -- 172.21.15.46:0/2239083285 shutdown_connections 2024-09-21T04:03:21.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.273+0000 7f9b0ebff740 1 -- 172.21.15.46:0/2239083285 wait complete. 2024-09-21T04:03:21.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.273+0000 7f9b0ebff740 1 -- start start 2024-09-21T04:03:21.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.273+0000 7f9b0ebff740 1 Processor -- start 2024-09-21T04:03:21.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.274+0000 7f9b0ebff740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619cef951b0 0x5619cf3708e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:21.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.274+0000 7f9b0ebff740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5619cef9d390 0x5619cf370e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:21.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.274+0000 7f9b0ebff740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5619cefbe070 0x5619cf371360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:21.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.274+0000 7f9b0ebff740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5619cf12c700 con 0x5619cefbe070 2024-09-21T04:03:21.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.274+0000 7f9b0ebff740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5619cf266160 con 0x5619cef9d390 2024-09-21T04:03:21.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.274+0000 7f9b0ebff740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5619cf373aa0 con 0x5619cef951b0 2024-09-21T04:03:21.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.274+0000 7f9b0ebff740 10 client.0 _ll_register_callbacks cb 0x5619cf27f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:03:21.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.274+0000 7f9b05c26640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5619cefbe070 0x5619cf371360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:21.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.274+0000 7f9b05c26640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5619cefbe070 0x5619cf371360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60424/0 (socket says 172.21.15.46:60424) 2024-09-21T04:03:21.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.274+0000 7f9b05c26640 1 -- 172.21.15.46:0/1015175150 learned_addr learned my addr 172.21.15.46:0/1015175150 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:03:21.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.274+0000 7f9b05c26640 1 --2- 172.21.15.46:0/1015175150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619cef951b0 0x5619cf3708e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:21.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.274+0000 7f9b06427640 1 --2- 172.21.15.46:0/1015175150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5619cef9d390 0x5619cf370e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:21.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.274+0000 7f9b05c26640 1 -- 172.21.15.46:0/1015175150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619cef951b0 msgr2=0x5619cf3708e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:21.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.274+0000 7f9b05c26640 1 --2- 172.21.15.46:0/1015175150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619cef951b0 0x5619cf3708e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:21.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.274+0000 7f9b05c26640 1 -- 172.21.15.46:0/1015175150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5619cef9d390 msgr2=0x5619cf370e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:21.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.274+0000 7f9b05c26640 1 --2- 172.21.15.46:0/1015175150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5619cef9d390 0x5619cf370e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:21.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.274+0000 7f9b05c26640 1 -- 172.21.15.46:0/1015175150 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619cf293c90 con 0x5619cefbe070 2024-09-21T04:03:21.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.274+0000 7f9b05c26640 1 --2- 172.21.15.46:0/1015175150 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5619cefbe070 0x5619cf371360 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f9af4004800 tx=0x7f9af40045b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d5c2de6684e92a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:21.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.274+0000 7f9ae5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:03:21.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.274+0000 7f9ae5ffb640 1 -- 172.21.15.46:0/1015175150 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af40048a0 con 0x5619cefbe070 2024-09-21T04:03:21.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.274+0000 7f9b0ebff740 1 -- 172.21.15.46:0/1015175150 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9af40054d0 con 0x5619cefbe070 2024-09-21T04:03:21.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.274+0000 7f9ae5ffb640 1 -- 172.21.15.46:0/1015175150 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f9af4004a40 con 0x5619cefbe070 2024-09-21T04:03:21.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.275+0000 7f9ae5ffb640 1 -- 172.21.15.46:0/1015175150 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9af4035050 con 0x5619cefbe070 2024-09-21T04:03:21.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.275+0000 7f9b0ebff740 10 client.16647 fetch_fsmap learned FSMap version 20 2024-09-21T04:03:21.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.275+0000 7f9b0ebff740 1 -- 172.21.15.46:0/1015175150 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5619cf37f750 con 0x5619cefbe070 2024-09-21T04:03:21.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.275+0000 7f9ae5ffb640 1 -- 172.21.15.46:0/1015175150 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9af40054d0 con 0x5619cefbe070 2024-09-21T04:03:21.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.275+0000 7f9ae5ffb640 1 -- 172.21.15.46:0/1015175150 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f9af4011a90 con 0x5619cefbe070 2024-09-21T04:03:21.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.275+0000 7f9b0ebff740 10 client.16647 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:03:21.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.275+0000 7f9b0ebff740 10 client.16647 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:03:21.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.275+0000 7f9b0ebff740 20 client.16647 populate_metadata read hostname 'smithi046' 2024-09-21T04:03:21.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.275+0000 7f9b0ebff740 1 --2- 172.21.15.46:0/1015175150 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5619cef7c9f0 0x5619cf382b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:21.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.275+0000 7f9b0ebff740 4 client.16647 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:03:21.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.275+0000 7f9b0ebff740 1 -- 172.21.15.46:0/1015175150 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5619cf2dddf0 con 0x5619cef7c9f0 2024-09-21T04:03:21.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.275+0000 7f9b06427640 1 --2- 172.21.15.46:0/1015175150 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5619cef7c9f0 0x5619cf382b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:21.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.276+0000 7f9ae5ffb640 10 client.16647 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:03:21.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.276+0000 7f9b06427640 1 --2- 172.21.15.46:0/1015175150 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5619cef7c9f0 0x5619cf382b10 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf4e0b893c7983ab server_cookie=2036687ba7320a8a in_seq=0 out_seq=0 2024-09-21T04:03:21.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.277+0000 7f9ae5ffb640 1 -- 172.21.15.46:0/1015175150 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5619cf2dddf0 con 0x5619cef7c9f0 2024-09-21T04:03:21.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.277+0000 7f9ae5ffb640 10 client.16647 handle_command_reply: tid=0 2024-09-21T04:03:21.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.277+0000 7f9b0ebff740 1 client.16647 shutdown 2024-09-21T04:03:21.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.277+0000 7f9b0ebff740 1 -- 172.21.15.46:0/1015175150 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5619cefbe070 msgr2=0x5619cf371360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:21.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.277+0000 7f9b0ebff740 1 --2- 172.21.15.46:0/1015175150 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5619cefbe070 0x5619cf371360 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f9af4004800 tx=0x7f9af40045b0 comp rx=0 tx=0).stop 2024-09-21T04:03:21.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.277+0000 7f9b0ebff740 1 -- 172.21.15.46:0/1015175150 shutdown_connections 2024-09-21T04:03:21.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.277+0000 7f9b0ebff740 1 --2- 172.21.15.46:0/1015175150 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5619cef7c9f0 0x5619cf382b10 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:21.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.277+0000 7f9b0ebff740 1 --2- 172.21.15.46:0/1015175150 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5619cefbe070 0x5619cf371360 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:21.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.277+0000 7f9b0ebff740 1 --2- 172.21.15.46:0/1015175150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5619cef9d390 0x5619cf370e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:21.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.277+0000 7f9b0ebff740 1 --2- 172.21.15.46:0/1015175150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619cef951b0 0x5619cf3708e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:21.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.277+0000 7f9b0ebff740 1 -- 172.21.15.46:0/1015175150 >> 172.21.15.46:0/1015175150 conn(0x5619cefb2460 msgr2=0x5619cf3684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:21.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.277+0000 7f9ae5ffb640 0 client.16647 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:03:21.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.277+0000 7f9b0ebff740 1 -- 172.21.15.46:0/1015175150 shutdown_connections 2024-09-21T04:03:21.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.277+0000 7f9b0ebff740 1 -- 172.21.15.46:0/1015175150 wait complete. 2024-09-21T04:03:21.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.277+0000 7f9b0ebff740 20 client.16647 trim_cache size 0 max 16384 2024-09-21T04:03:21.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.290+0000 7f9b0ebff740 1 Processor -- start 2024-09-21T04:03:21.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.290+0000 7f9b0ebff740 1 -- start start 2024-09-21T04:03:21.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.291+0000 7f9b0ebff740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5619cef951b0 0x5619cf3727c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:21.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.291+0000 7f9b0ebff740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5619cef9d390 0x5619cf3662f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:21.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.291+0000 7f9b0ebff740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619cefbe070 0x5619cf368ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:21.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.291+0000 7f9b0ebff740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9b001af7c0 con 0x5619cef951b0 2024-09-21T04:03:21.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.291+0000 7f9b0ebff740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9b001b2020 con 0x5619cef9d390 2024-09-21T04:03:21.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.291+0000 7f9b0ebff740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9b001afe10 con 0x5619cefbe070 2024-09-21T04:03:21.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.291+0000 7f9b05c26640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5619cef951b0 0x5619cf3727c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:21.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.291+0000 7f9b05c26640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5619cef951b0 0x5619cf3727c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60434/0 (socket says 172.21.15.46:60434) 2024-09-21T04:03:21.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.291+0000 7f9b05c26640 1 -- 172.21.15.46:0/3793549735 learned_addr learned my addr 172.21.15.46:0/3793549735 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:03:21.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.291+0000 7f9b06427640 1 --2- 172.21.15.46:0/3793549735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5619cef9d390 0x5619cf3662f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:21.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.291+0000 7f9b05c26640 1 -- 172.21.15.46:0/3793549735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619cefbe070 msgr2=0x5619cf368ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:21.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.291+0000 7f9b05c26640 1 --2- 172.21.15.46:0/3793549735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619cefbe070 0x5619cf368ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:21.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.291+0000 7f9b05c26640 1 -- 172.21.15.46:0/3793549735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5619cef9d390 msgr2=0x5619cf3662f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:21.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.291+0000 7f9b05c26640 1 --2- 172.21.15.46:0/3793549735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5619cef9d390 0x5619cf3662f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:21.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.291+0000 7f9b05c26640 1 -- 172.21.15.46:0/3793549735 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619cf35d440 con 0x5619cef951b0 2024-09-21T04:03:21.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.291+0000 7f9b05c26640 1 --2- 172.21.15.46:0/3793549735 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5619cef951b0 0x5619cf3727c0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f9af401e5c0 tx=0x7f9af400d4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a303e1741b803bef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:21.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.291+0000 7f9ae7fff640 1 -- 172.21.15.46:0/3793549735 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af4032030 con 0x5619cef951b0 2024-09-21T04:03:21.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.291+0000 7f9ae7fff640 1 -- 172.21.15.46:0/3793549735 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9af400d740 con 0x5619cef951b0 2024-09-21T04:03:21.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.291+0000 7f9ae7fff640 1 -- 172.21.15.46:0/3793549735 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af4005510 con 0x5619cef951b0 2024-09-21T04:03:21.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.292+0000 7f9b0ebff740 1 -- 172.21.15.46:0/3793549735 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5619cef951b0 msgr2=0x5619cf3727c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:21.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.292+0000 7f9b0ebff740 1 --2- 172.21.15.46:0/3793549735 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5619cef951b0 0x5619cf3727c0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f9af401e5c0 tx=0x7f9af400d4b0 comp rx=0 tx=0).stop 2024-09-21T04:03:21.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.292+0000 7f9b0ebff740 1 -- 172.21.15.46:0/3793549735 shutdown_connections 2024-09-21T04:03:21.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.292+0000 7f9b0ebff740 1 --2- 172.21.15.46:0/3793549735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619cefbe070 0x5619cf368ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:21.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.292+0000 7f9b0ebff740 1 --2- 172.21.15.46:0/3793549735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5619cef9d390 0x5619cf3662f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:21.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.292+0000 7f9b0ebff740 1 --2- 172.21.15.46:0/3793549735 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5619cef951b0 0x5619cf3727c0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:21.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.292+0000 7f9b0ebff740 1 -- 172.21.15.46:0/3793549735 >> 172.21.15.46:0/3793549735 conn(0x5619cefb2460 msgr2=0x5619cf3683c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:21.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.292+0000 7f9b0ebff740 1 -- 172.21.15.46:0/3793549735 shutdown_connections 2024-09-21T04:03:21.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.292+0000 7f9b0ebff740 1 -- 172.21.15.46:0/3793549735 wait complete. 2024-09-21T04:03:21.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.293+0000 7f9b0ebff740 1 -- start start 2024-09-21T04:03:21.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.293+0000 7f9b0ebff740 1 Processor -- start 2024-09-21T04:03:21.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.293+0000 7f9b0ebff740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619cef951b0 0x5619cf379160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:21.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.293+0000 7f9b0ebff740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5619cef9d390 0x5619cf379720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:21.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.293+0000 7f9b0ebff740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5619cefbe070 0x5619cf374810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:21.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.293+0000 7f9b0ebff740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9b001b04e0 con 0x5619cef9d390 2024-09-21T04:03:21.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.293+0000 7f9b0ebff740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9b001b1950 con 0x5619cefbe070 2024-09-21T04:03:21.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.293+0000 7f9b0ebff740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9b001b0bb0 con 0x5619cef951b0 2024-09-21T04:03:21.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.293+0000 7f9b0ebff740 10 client.0 _ll_register_callbacks cb 0x7f9af800b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:03:21.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.293+0000 7f9b06427640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5619cef9d390 0x5619cf379720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:21.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.293+0000 7f9b06427640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5619cef9d390 0x5619cf379720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60448/0 (socket says 172.21.15.46:60448) 2024-09-21T04:03:21.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.293+0000 7f9b06427640 1 -- 172.21.15.46:0/3244293648 learned_addr learned my addr 172.21.15.46:0/3244293648 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:03:21.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.293+0000 7f9b05c26640 1 --2- 172.21.15.46:0/3244293648 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5619cefbe070 0x5619cf374810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:21.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.293+0000 7f9b05c26640 1 --2- 172.21.15.46:0/3244293648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619cef951b0 0x5619cf379160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:21.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.293+0000 7f9b06427640 1 -- 172.21.15.46:0/3244293648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619cef951b0 msgr2=0x5619cf379160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:21.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.293+0000 7f9b06427640 1 --2- 172.21.15.46:0/3244293648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619cef951b0 0x5619cf379160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:21.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.293+0000 7f9b06427640 1 -- 172.21.15.46:0/3244293648 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5619cefbe070 msgr2=0x5619cf374810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:21.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.293+0000 7f9b06427640 1 --2- 172.21.15.46:0/3244293648 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5619cefbe070 0x5619cf374810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:21.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.293+0000 7f9b06427640 1 -- 172.21.15.46:0/3244293648 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619cf374fa0 con 0x5619cef9d390 2024-09-21T04:03:21.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.294+0000 7f9b05c26640 1 --2- 172.21.15.46:0/3244293648 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5619cefbe070 0x5619cf374810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:03:21.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.294+0000 7f9b06427640 1 --2- 172.21.15.46:0/3244293648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5619cef9d390 0x5619cf379720 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f9b00077160 tx=0x7f9af80035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d0651225f92d1f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:21.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.294+0000 7f9ae5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:03:21.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.294+0000 7f9ae5ffb640 1 -- 172.21.15.46:0/3244293648 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af8005220 con 0x5619cef9d390 2024-09-21T04:03:21.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.294+0000 7f9ae5ffb640 1 -- 172.21.15.46:0/3244293648 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f9af80053c0 con 0x5619cef9d390 2024-09-21T04:03:21.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.294+0000 7f9b0ebff740 1 -- 172.21.15.46:0/3244293648 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9af400d740 con 0x5619cef9d390 2024-09-21T04:03:21.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.294+0000 7f9ae5ffb640 1 -- 172.21.15.46:0/3244293648 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9af80055c0 con 0x5619cef9d390 2024-09-21T04:03:21.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.294+0000 7f9b0ebff740 10 client.16653 fetch_fsmap learned FSMap version 20 2024-09-21T04:03:21.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.294+0000 7f9b0ebff740 1 -- 172.21.15.46:0/3244293648 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5619cf3ecfa0 con 0x5619cef9d390 2024-09-21T04:03:21.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.294+0000 7f9ae5ffb640 1 -- 172.21.15.46:0/3244293648 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9af400d740 con 0x5619cef9d390 2024-09-21T04:03:21.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.294+0000 7f9ae5ffb640 1 -- 172.21.15.46:0/3244293648 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f9af802c030 con 0x5619cef9d390 2024-09-21T04:03:21.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.295+0000 7f9b0ebff740 10 client.16653 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:03:21.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.295+0000 7f9b0ebff740 10 client.16653 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:03:21.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.295+0000 7f9b0ebff740 20 client.16653 populate_metadata read hostname 'smithi046' 2024-09-21T04:03:21.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.295+0000 7f9b0ebff740 1 --2- 172.21.15.46:0/3244293648 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5619cef51da0 0x5619cf3ef810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:21.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.295+0000 7f9b0ebff740 4 client.16653 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T04:03:21.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.295+0000 7f9b0ebff740 1 -- 172.21.15.46:0/3244293648 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5619cf2d98a0 con 0x5619cef51da0 2024-09-21T04:03:21.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.295+0000 7f9b05c26640 1 --2- 172.21.15.46:0/3244293648 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5619cef51da0 0x5619cf3ef810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:21.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.295+0000 7f9b05c26640 1 --2- 172.21.15.46:0/3244293648 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5619cef51da0 0x5619cf3ef810 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1bb93795cb397b7 server_cookie=15a8bf2e9c9c66cf in_seq=0 out_seq=0 2024-09-21T04:03:21.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.295+0000 7f9ae5ffb640 10 client.16653 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:03:21.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.295+0000 7f9ae5ffb640 1 -- 172.21.15.46:0/3244293648 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5619cf2d98a0 con 0x5619cef51da0 2024-09-21T04:03:21.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.295+0000 7f9ae5ffb640 10 client.16653 handle_command_reply: tid=0 2024-09-21T04:03:21.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.296+0000 7f9b0ebff740 1 client.16653 shutdown 2024-09-21T04:03:21.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.296+0000 7f9b0ebff740 1 -- 172.21.15.46:0/3244293648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5619cef9d390 msgr2=0x5619cf379720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:21.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.296+0000 7f9b0ebff740 1 --2- 172.21.15.46:0/3244293648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5619cef9d390 0x5619cf379720 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f9b00077160 tx=0x7f9af80035f0 comp rx=0 tx=0).stop 2024-09-21T04:03:21.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.296+0000 7f9b0ebff740 1 -- 172.21.15.46:0/3244293648 shutdown_connections 2024-09-21T04:03:21.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.296+0000 7f9b0ebff740 1 --2- 172.21.15.46:0/3244293648 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5619cef51da0 0x5619cf3ef810 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:21.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.296+0000 7f9ae5ffb640 0 client.16653 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:03:21.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.296+0000 7f9b0ebff740 1 --2- 172.21.15.46:0/3244293648 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5619cefbe070 0x5619cf374810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:21.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.296+0000 7f9b0ebff740 1 --2- 172.21.15.46:0/3244293648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5619cef9d390 0x5619cf379720 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:21.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.296+0000 7f9b0ebff740 1 --2- 172.21.15.46:0/3244293648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619cef951b0 0x5619cf379160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:21.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.296+0000 7f9b0ebff740 1 -- 172.21.15.46:0/3244293648 >> 172.21.15.46:0/3244293648 conn(0x5619cefb2460 msgr2=0x5619cf3683c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:21.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.296+0000 7f9b0ebff740 1 -- 172.21.15.46:0/3244293648 shutdown_connections 2024-09-21T04:03:21.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.296+0000 7f9b0ebff740 1 -- 172.21.15.46:0/3244293648 wait complete. 2024-09-21T04:03:21.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.296+0000 7f9b0ebff740 20 client.16653 trim_cache size 0 max 16384 2024-09-21T04:03:21.308 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-21T04:03:21.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.296+0000 7f9b0868b640 1 -- 172.21.15.46:0/1910909221 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f9ae80b6700 msgr2=0x7f9ae80b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:21.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.296+0000 7f9b0868b640 1 --2- 172.21.15.46:0/1910909221 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f9ae80b6700 0x7f9ae80b8c10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9af00cbc90 tx=0x7f9af00c3280 comp rx=0 tx=0).stop 2024-09-21T04:03:21.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.296+0000 7f9b0868b640 1 -- 172.21.15.46:0/1910909221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b00109e40 msgr2=0x7f9b00076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:21.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.296+0000 7f9b0868b640 1 --2- 172.21.15.46:0/1910909221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b00109e40 0x7f9b00076190 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f9af0005cc0 tx=0x7f9af002f380 comp rx=0 tx=0).stop 2024-09-21T04:03:21.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.296+0000 7f9b0868b640 1 -- 172.21.15.46:0/1910909221 shutdown_connections 2024-09-21T04:03:21.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.297+0000 7f9b0868b640 1 --2- 172.21.15.46:0/1910909221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b00109e40 0x7f9b00076190 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:21.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.297+0000 7f9b0868b640 1 --2- 172.21.15.46:0/1910909221 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f9ae80b6700 0x7f9ae80b8c10 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:21.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.297+0000 7f9b0868b640 1 --2- 172.21.15.46:0/1910909221 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b001094f0 0x7f9b00075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:21.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.297+0000 7f9b0868b640 1 --2- 172.21.15.46:0/1910909221 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9b00103bb0 0x7f9b00075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:21.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.297+0000 7f9b0868b640 1 -- 172.21.15.46:0/1910909221 >> 172.21.15.46:0/1910909221 conn(0x7f9b000ff600 msgr2=0x7f9b00101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:21.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.297+0000 7f9b0868b640 1 -- 172.21.15.46:0/1910909221 shutdown_connections 2024-09-21T04:03:21.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:21.297+0000 7f9b0868b640 1 -- 172.21.15.46:0/1910909221 wait complete. 2024-09-21T04:03:21.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:20 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/156492645' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:03:21.962 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:21 smithi046 ceph-mon[30954]: pgmap v573: 97 pgs: 97 active+clean; 14 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T04:03:22.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:21 smithi162 ceph-mon[35071]: pgmap v573: 97 pgs: 97 active+clean; 14 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T04:03:22.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:21 smithi105 ceph-mon[34773]: pgmap v573: 97 pgs: 97 active+clean; 14 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T04:03:22.992 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T04:03:22.993 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T04:03:23.267 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:03:23.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.752+0000 7f260d751640 1 -- 172.21.15.46:0/848457628 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26081049d0 msgr2=0x7f2608104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:23.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.752+0000 7f260d751640 1 --2- 172.21.15.46:0/848457628 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26081049d0 0x7f2608104de0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f25f8009ca0 tx=0x7f25f802a8c0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.752+0000 7f260d751640 1 -- 172.21.15.46:0/848457628 shutdown_connections 2024-09-21T04:03:23.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.752+0000 7f260d751640 1 --2- 172.21.15.46:0/848457628 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f260810de30 0x7f2608110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.752+0000 7f260d751640 1 --2- 172.21.15.46:0/848457628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2608105320 0x7f260810d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.752+0000 7f260d751640 1 --2- 172.21.15.46:0/848457628 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26081049d0 0x7f2608104de0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.752+0000 7f260d751640 1 -- 172.21.15.46:0/848457628 >> 172.21.15.46:0/848457628 conn(0x7f2608079740 msgr2=0x7f2608079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:23.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.752+0000 7f260d751640 1 -- 172.21.15.46:0/848457628 shutdown_connections 2024-09-21T04:03:23.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.752+0000 7f260d751640 1 -- 172.21.15.46:0/848457628 wait complete. 2024-09-21T04:03:23.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.753+0000 7f260d751640 1 Processor -- start 2024-09-21T04:03:23.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.753+0000 7f260d751640 1 -- start start 2024-09-21T04:03:23.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.753+0000 7f260d751640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26081049d0 0x7f260819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.753+0000 7f260d751640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2608105320 0x7f260819aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.753+0000 7f260d751640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f260810de30 0x7f260819fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.753+0000 7f260d751640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2608113a90 con 0x7f2608105320 2024-09-21T04:03:23.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.753+0000 7f260d751640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2608113910 con 0x7f26081049d0 2024-09-21T04:03:23.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.753+0000 7f260d751640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2608113c10 con 0x7f260810de30 2024-09-21T04:03:23.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.753+0000 7f26067fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2608105320 0x7f260819aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.753+0000 7f26067fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2608105320 0x7f260819aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40460/0 (socket says 172.21.15.46:40460) 2024-09-21T04:03:23.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.753+0000 7f26067fc640 1 -- 172.21.15.46:0/1279357020 learned_addr learned my addr 172.21.15.46:0/1279357020 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:03:23.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.753+0000 7f2606ffd640 1 --2- 172.21.15.46:0/1279357020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26081049d0 0x7f260819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.754+0000 7f26077fe640 1 --2- 172.21.15.46:0/1279357020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f260810de30 0x7f260819fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.754+0000 7f26067fc640 1 -- 172.21.15.46:0/1279357020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f260810de30 msgr2=0x7f260819fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:23.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.754+0000 7f26067fc640 1 --2- 172.21.15.46:0/1279357020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f260810de30 0x7f260819fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.754+0000 7f26067fc640 1 -- 172.21.15.46:0/1279357020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26081049d0 msgr2=0x7f260819a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:23.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.754+0000 7f26067fc640 1 --2- 172.21.15.46:0/1279357020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26081049d0 0x7f260819a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.754+0000 7f26067fc640 1 -- 172.21.15.46:0/1279357020 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26081a04b0 con 0x7f2608105320 2024-09-21T04:03:23.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.754+0000 7f26077fe640 1 --2- 172.21.15.46:0/1279357020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f260810de30 0x7f260819fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:03:23.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.754+0000 7f26067fc640 1 --2- 172.21.15.46:0/1279357020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2608105320 0x7f260819aba0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f25fc00c8c0 tx=0x7f25fc00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:23.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.754+0000 7f25effff640 1 -- 172.21.15.46:0/1279357020 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25fc007bb0 con 0x7f2608105320 2024-09-21T04:03:23.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.754+0000 7f260d751640 1 -- 172.21.15.46:0/1279357020 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26081a07a0 con 0x7f2608105320 2024-09-21T04:03:23.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.754+0000 7f25effff640 1 -- 172.21.15.46:0/1279357020 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25fc007d50 con 0x7f2608105320 2024-09-21T04:03:23.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.754+0000 7f25effff640 1 -- 172.21.15.46:0/1279357020 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25fc0187c0 con 0x7f2608105320 2024-09-21T04:03:23.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.754+0000 7f260d751640 1 -- 172.21.15.46:0/1279357020 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26081a6fc0 con 0x7f2608105320 2024-09-21T04:03:23.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.757+0000 7f2613cc5740 1 Processor -- start 2024-09-21T04:03:23.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.757+0000 7f25effff640 1 -- 172.21.15.46:0/1279357020 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f25fc00fa20 con 0x7f2608105320 2024-09-21T04:03:23.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.757+0000 7f2613cc5740 1 -- start start 2024-09-21T04:03:23.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.757+0000 7f2613cc5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564fe7fd4350 0x564fe837b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.757+0000 7f2613cc5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564fe7fab490 0x564fe837b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.757+0000 7f2613cc5740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fe7fb3670 0x564fe837beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.757+0000 7f2613cc5740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x564fe82f1e60 con 0x564fe7fb3670 2024-09-21T04:03:23.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.757+0000 7f2613cc5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x564fe82e1290 con 0x564fe7fd4350 2024-09-21T04:03:23.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.757+0000 7f2613cc5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564fe82e50a0 con 0x564fe7fab490 2024-09-21T04:03:23.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.757+0000 7f26067fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fe7fb3670 0x564fe837beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.758+0000 7f26067fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fe7fb3670 0x564fe837beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40464/0 (socket says 172.21.15.46:40464) 2024-09-21T04:03:23.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.758+0000 7f26067fc640 1 -- 172.21.15.46:0/1911994218 learned_addr learned my addr 172.21.15.46:0/1911994218 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:03:23.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.758+0000 7f2606ffd640 1 --2- 172.21.15.46:0/1911994218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564fe7fab490 0x564fe837b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.758+0000 7f26077fe640 1 --2- 172.21.15.46:0/1911994218 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564fe7fd4350 0x564fe837b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.758+0000 7f26067fc640 1 -- 172.21.15.46:0/1911994218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564fe7fab490 msgr2=0x564fe837b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:23.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.758+0000 7f26067fc640 1 --2- 172.21.15.46:0/1911994218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564fe7fab490 0x564fe837b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.758+0000 7f26067fc640 1 -- 172.21.15.46:0/1911994218 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564fe7fd4350 msgr2=0x564fe837b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:23.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.758+0000 7f26067fc640 1 --2- 172.21.15.46:0/1911994218 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564fe7fd4350 0x564fe837b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.758+0000 7f26067fc640 1 -- 172.21.15.46:0/1911994218 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fe803f930 con 0x564fe7fb3670 2024-09-21T04:03:23.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.758+0000 7f26077fe640 1 --2- 172.21.15.46:0/1911994218 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564fe7fd4350 0x564fe837b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:03:23.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.758+0000 7f25effff640 1 --2- 172.21.15.46:0/1279357020 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f25f00b66b0 0x7f25f00b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.758+0000 7f26067fc640 1 --2- 172.21.15.46:0/1911994218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fe7fb3670 0x564fe837beb0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f25fc0e4e90 tx=0x7f25fc0edcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5807671a3be7be0e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:23.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.758+0000 7f26077fe640 1 --2- 172.21.15.46:0/1279357020 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f25f00b66b0 0x7f25f00b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.758+0000 7f25effff640 1 -- 172.21.15.46:0/1279357020 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f25fc0e7760 con 0x7f2608105320 2024-09-21T04:03:23.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.758+0000 7f25ed7fa640 1 -- 172.21.15.46:0/1911994218 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25fc0a9c70 con 0x564fe7fb3670 2024-09-21T04:03:23.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.759+0000 7f25ed7fa640 1 -- 172.21.15.46:0/1911994218 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25fc0ad130 con 0x564fe7fb3670 2024-09-21T04:03:23.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.759+0000 7f25ed7fa640 1 -- 172.21.15.46:0/1911994218 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25fc0acd90 con 0x564fe7fb3670 2024-09-21T04:03:23.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.759+0000 7f2613cc5740 1 -- 172.21.15.46:0/1911994218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fe7fb3670 msgr2=0x564fe837beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:23.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.759+0000 7f2613cc5740 1 --2- 172.21.15.46:0/1911994218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fe7fb3670 0x564fe837beb0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f25fc0e4e90 tx=0x7f25fc0edcd0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.759+0000 7f26077fe640 1 --2- 172.21.15.46:0/1279357020 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f25f00b66b0 0x7f25f00b8bc0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f260000cbe0 tx=0x7f260000c5c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:23.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.759+0000 7f2613cc5740 1 -- 172.21.15.46:0/1911994218 shutdown_connections 2024-09-21T04:03:23.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.759+0000 7f2613cc5740 1 --2- 172.21.15.46:0/1911994218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fe7fb3670 0x564fe837beb0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.759+0000 7f2613cc5740 1 --2- 172.21.15.46:0/1911994218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564fe7fab490 0x564fe837b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.759+0000 7f2613cc5740 1 --2- 172.21.15.46:0/1911994218 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564fe7fd4350 0x564fe837b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.759+0000 7f2613cc5740 1 -- 172.21.15.46:0/1911994218 >> 172.21.15.46:0/1911994218 conn(0x564fe7fc8740 msgr2=0x564fe8379320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:23.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.760+0000 7f2613cc5740 1 -- 172.21.15.46:0/1911994218 shutdown_connections 2024-09-21T04:03:23.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.760+0000 7f2613cc5740 1 -- 172.21.15.46:0/1911994218 wait complete. 2024-09-21T04:03:23.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.760+0000 7f2613cc5740 1 -- start start 2024-09-21T04:03:23.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.760+0000 7f2613cc5740 1 Processor -- start 2024-09-21T04:03:23.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.760+0000 7f2613cc5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564fe7fab490 0x564fe8387020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.760+0000 7f2613cc5740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fe7fb3670 0x564fe83875a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.760+0000 7f2613cc5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564fe7fd4350 0x564fe8392f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.760+0000 7f2613cc5740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x564fe8142890 con 0x564fe7fb3670 2024-09-21T04:03:23.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.760+0000 7f2613cc5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x564fe827bd40 con 0x564fe7fab490 2024-09-21T04:03:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.760+0000 7f2613cc5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564fe8389c10 con 0x564fe7fd4350 2024-09-21T04:03:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.760+0000 7f2613cc5740 10 client.0 _ll_register_callbacks cb 0x564fe82dfc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:03:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.761+0000 7f26067fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fe7fb3670 0x564fe83875a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.761+0000 7f26067fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fe7fb3670 0x564fe83875a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40478/0 (socket says 172.21.15.46:40478) 2024-09-21T04:03:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.761+0000 7f26067fc640 1 -- 172.21.15.46:0/3850117704 learned_addr learned my addr 172.21.15.46:0/3850117704 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:03:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.761+0000 7f2606ffd640 1 --2- 172.21.15.46:0/3850117704 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564fe7fab490 0x564fe8387020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.761+0000 7f26077fe640 1 --2- 172.21.15.46:0/3850117704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564fe7fd4350 0x564fe8392f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.761+0000 7f26067fc640 1 -- 172.21.15.46:0/3850117704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564fe7fd4350 msgr2=0x564fe8392f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.761+0000 7f26067fc640 1 --2- 172.21.15.46:0/3850117704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564fe7fd4350 0x564fe8392f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.761+0000 7f26067fc640 1 -- 172.21.15.46:0/3850117704 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564fe7fab490 msgr2=0x564fe8387020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.761+0000 7f26067fc640 1 --2- 172.21.15.46:0/3850117704 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564fe7fab490 0x564fe8387020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.761+0000 7f26067fc640 1 -- 172.21.15.46:0/3850117704 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fe8393510 con 0x564fe7fb3670 2024-09-21T04:03:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.761+0000 7f26077fe640 1 --2- 172.21.15.46:0/3850117704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564fe7fd4350 0x564fe8392f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:03:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.761+0000 7f26067fc640 1 --2- 172.21.15.46:0/3850117704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fe7fb3670 0x564fe83875a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f25fc00fd70 tx=0x7f25fc0e7a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65394c29148aaeed server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.761+0000 7f25eaff5640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:03:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.761+0000 7f25eaff5640 1 -- 172.21.15.46:0/3850117704 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25fc0acf70 con 0x564fe7fb3670 2024-09-21T04:03:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.761+0000 7f25eaff5640 1 -- 172.21.15.46:0/3850117704 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f25fc0b6040 con 0x564fe7fb3670 2024-09-21T04:03:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.761+0000 7f2613cc5740 1 -- 172.21.15.46:0/3850117704 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25fc0ad130 con 0x564fe7fb3670 2024-09-21T04:03:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.761+0000 7f25eaff5640 1 -- 172.21.15.46:0/3850117704 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f25fc0ad3f0 con 0x564fe7fb3670 2024-09-21T04:03:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.761+0000 7f2613cc5740 10 client.16665 fetch_fsmap learned FSMap version 20 2024-09-21T04:03:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.761+0000 7f2613cc5740 1 -- 172.21.15.46:0/3850117704 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564fe8395e40 con 0x564fe7fb3670 2024-09-21T04:03:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.762+0000 7f25eaff5640 1 -- 172.21.15.46:0/3850117704 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25fc0ad130 con 0x564fe7fb3670 2024-09-21T04:03:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.762+0000 7f25eaff5640 1 -- 172.21.15.46:0/3850117704 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f25fc0a8f70 con 0x564fe7fb3670 2024-09-21T04:03:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.762+0000 7f2613cc5740 10 client.16665 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:03:23.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.762+0000 7f2613cc5740 10 client.16665 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:03:23.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.762+0000 7f2613cc5740 20 client.16665 populate_metadata read hostname 'smithi046' 2024-09-21T04:03:23.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.762+0000 7f2613cc5740 1 --2- 172.21.15.46:0/3850117704 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x564fe7f92cd0 0x564fe83991a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.762+0000 7f2613cc5740 4 client.16665 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:03:23.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.762+0000 7f2613cc5740 1 -- 172.21.15.46:0/3850117704 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564fe82f3db0 con 0x564fe7f92cd0 2024-09-21T04:03:23.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.762+0000 7f2606ffd640 1 --2- 172.21.15.46:0/3850117704 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x564fe7f92cd0 0x564fe83991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.763+0000 7f25eaff5640 10 client.16665 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:03:23.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.763+0000 7f2606ffd640 1 --2- 172.21.15.46:0/3850117704 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x564fe7f92cd0 0x564fe83991a0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f44925010b180200 server_cookie=977446b647ce3b27 in_seq=0 out_seq=0 2024-09-21T04:03:23.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.763+0000 7f25eaff5640 1 -- 172.21.15.46:0/3850117704 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564fe82f3db0 con 0x564fe7f92cd0 2024-09-21T04:03:23.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.763+0000 7f25eaff5640 10 client.16665 handle_command_reply: tid=0 2024-09-21T04:03:23.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.764+0000 7f2613cc5740 1 client.16665 shutdown 2024-09-21T04:03:23.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.764+0000 7f2613cc5740 1 -- 172.21.15.46:0/3850117704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fe7fb3670 msgr2=0x564fe83875a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:23.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.764+0000 7f2613cc5740 1 --2- 172.21.15.46:0/3850117704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fe7fb3670 0x564fe83875a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f25fc00fd70 tx=0x7f25fc0e7a60 comp rx=0 tx=0).stop 2024-09-21T04:03:23.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.764+0000 7f2613cc5740 1 -- 172.21.15.46:0/3850117704 shutdown_connections 2024-09-21T04:03:23.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.764+0000 7f2613cc5740 1 --2- 172.21.15.46:0/3850117704 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x564fe7f92cd0 0x564fe83991a0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.764+0000 7f2613cc5740 1 --2- 172.21.15.46:0/3850117704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564fe7fd4350 0x564fe8392f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.764+0000 7f2613cc5740 1 --2- 172.21.15.46:0/3850117704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fe7fb3670 0x564fe83875a0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.764+0000 7f2613cc5740 1 --2- 172.21.15.46:0/3850117704 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564fe7fab490 0x564fe8387020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.764+0000 7f2613cc5740 1 -- 172.21.15.46:0/3850117704 >> 172.21.15.46:0/3850117704 conn(0x564fe7fc8740 msgr2=0x564fe837e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:23.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.764+0000 7f25eaff5640 0 client.16665 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:03:23.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.765+0000 7f2613cc5740 1 -- 172.21.15.46:0/3850117704 shutdown_connections 2024-09-21T04:03:23.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.765+0000 7f2613cc5740 1 -- 172.21.15.46:0/3850117704 wait complete. 2024-09-21T04:03:23.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.765+0000 7f2613cc5740 20 client.16665 trim_cache size 0 max 16384 2024-09-21T04:03:23.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.782+0000 7f2613cc5740 1 Processor -- start 2024-09-21T04:03:23.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.782+0000 7f2613cc5740 1 -- start start 2024-09-21T04:03:23.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.783+0000 7f2613cc5740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fe7fab490 0x564fe8392e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.783+0000 7f2613cc5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564fe7fb3670 0x564fe8387480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.783+0000 7f2613cc5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564fe7fd4350 0x564fe8381510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.783+0000 7f2613cc5740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f26081ad620 con 0x564fe7fab490 2024-09-21T04:03:23.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.783+0000 7f2613cc5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f26081afe80 con 0x564fe7fb3670 2024-09-21T04:03:23.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.783+0000 7f2613cc5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f26081adc70 con 0x564fe7fd4350 2024-09-21T04:03:23.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.783+0000 7f2606ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fe7fab490 0x564fe8392e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.783+0000 7f2606ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fe7fab490 0x564fe8392e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40492/0 (socket says 172.21.15.46:40492) 2024-09-21T04:03:23.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.783+0000 7f2606ffd640 1 -- 172.21.15.46:0/4193832860 learned_addr learned my addr 172.21.15.46:0/4193832860 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:03:23.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.783+0000 7f26077fe640 1 --2- 172.21.15.46:0/4193832860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564fe7fd4350 0x564fe8381510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.783+0000 7f26067fc640 1 --2- 172.21.15.46:0/4193832860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564fe7fb3670 0x564fe8387480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.783+0000 7f2606ffd640 1 -- 172.21.15.46:0/4193832860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564fe7fd4350 msgr2=0x564fe8381510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:23.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.783+0000 7f2606ffd640 1 --2- 172.21.15.46:0/4193832860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564fe7fd4350 0x564fe8381510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.783+0000 7f2606ffd640 1 -- 172.21.15.46:0/4193832860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564fe7fb3670 msgr2=0x564fe8387480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:23.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.783+0000 7f2606ffd640 1 --2- 172.21.15.46:0/4193832860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564fe7fb3670 0x564fe8387480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.783+0000 7f2606ffd640 1 -- 172.21.15.46:0/4193832860 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fe8381a50 con 0x564fe7fab490 2024-09-21T04:03:23.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.783+0000 7f26077fe640 1 --2- 172.21.15.46:0/4193832860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564fe7fd4350 0x564fe8381510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:03:23.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.783+0000 7f26067fc640 1 --2- 172.21.15.46:0/4193832860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564fe7fb3670 0x564fe8387480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:03:23.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.783+0000 7f2606ffd640 1 --2- 172.21.15.46:0/4193832860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fe7fab490 0x564fe8392e70 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f260806c940 tx=0x7f25f802f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec508b1e867c96da server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:23.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.784+0000 7f25ecff9640 1 -- 172.21.15.46:0/4193832860 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f8031910 con 0x564fe7fab490 2024-09-21T04:03:23.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.784+0000 7f25ecff9640 1 -- 172.21.15.46:0/4193832860 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25f8036040 con 0x564fe7fab490 2024-09-21T04:03:23.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.784+0000 7f25ecff9640 1 -- 172.21.15.46:0/4193832860 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f802f8c0 con 0x564fe7fab490 2024-09-21T04:03:23.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.784+0000 7f2613cc5740 1 -- 172.21.15.46:0/4193832860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fe7fab490 msgr2=0x564fe8392e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:23.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.784+0000 7f2613cc5740 1 --2- 172.21.15.46:0/4193832860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fe7fab490 0x564fe8392e70 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f260806c940 tx=0x7f25f802f310 comp rx=0 tx=0).stop 2024-09-21T04:03:23.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.784+0000 7f2613cc5740 1 -- 172.21.15.46:0/4193832860 shutdown_connections 2024-09-21T04:03:23.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.784+0000 7f2613cc5740 1 --2- 172.21.15.46:0/4193832860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564fe7fd4350 0x564fe8381510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.784+0000 7f2613cc5740 1 --2- 172.21.15.46:0/4193832860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564fe7fb3670 0x564fe8387480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.784+0000 7f2613cc5740 1 --2- 172.21.15.46:0/4193832860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fe7fab490 0x564fe8392e70 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.785+0000 7f2613cc5740 1 -- 172.21.15.46:0/4193832860 >> 172.21.15.46:0/4193832860 conn(0x564fe7fc8740 msgr2=0x564fe83856a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:23.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.785+0000 7f2613cc5740 1 -- 172.21.15.46:0/4193832860 shutdown_connections 2024-09-21T04:03:23.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.785+0000 7f2613cc5740 1 -- 172.21.15.46:0/4193832860 wait complete. 2024-09-21T04:03:23.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.785+0000 7f2613cc5740 1 -- start start 2024-09-21T04:03:23.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.785+0000 7f2613cc5740 1 Processor -- start 2024-09-21T04:03:23.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.785+0000 7f2613cc5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564fe7fab490 0x564fe839cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.785+0000 7f2613cc5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564fe7fb3670 0x564fe839a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.785+0000 7f2613cc5740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fe7fd4350 0x564fe839a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.785+0000 7f2613cc5740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f26081ae340 con 0x564fe7fd4350 2024-09-21T04:03:23.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.785+0000 7f2613cc5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f26081af7b0 con 0x564fe7fb3670 2024-09-21T04:03:23.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.785+0000 7f2613cc5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f26081aea10 con 0x564fe7fab490 2024-09-21T04:03:23.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.785+0000 7f2613cc5740 10 client.0 _ll_register_callbacks cb 0x7f25f8009440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:03:23.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.786+0000 7f26077fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fe7fd4350 0x564fe839a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.786+0000 7f26077fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fe7fd4350 0x564fe839a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40508/0 (socket says 172.21.15.46:40508) 2024-09-21T04:03:23.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.786+0000 7f26077fe640 1 -- 172.21.15.46:0/168229253 learned_addr learned my addr 172.21.15.46:0/168229253 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:03:23.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.786+0000 7f2606ffd640 1 --2- 172.21.15.46:0/168229253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564fe7fab490 0x564fe839cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.786+0000 7f26067fc640 1 --2- 172.21.15.46:0/168229253 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564fe7fb3670 0x564fe839a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.786+0000 7f26077fe640 1 -- 172.21.15.46:0/168229253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564fe7fab490 msgr2=0x564fe839cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:23.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.786+0000 7f26077fe640 1 --2- 172.21.15.46:0/168229253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564fe7fab490 0x564fe839cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.786+0000 7f26077fe640 1 -- 172.21.15.46:0/168229253 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564fe7fb3670 msgr2=0x564fe839a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:23.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.786+0000 7f26077fe640 1 --2- 172.21.15.46:0/168229253 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564fe7fb3670 0x564fe839a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.786+0000 7f26077fe640 1 -- 172.21.15.46:0/168229253 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fe8402920 con 0x564fe7fd4350 2024-09-21T04:03:23.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.786+0000 7f26077fe640 1 --2- 172.21.15.46:0/168229253 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fe7fd4350 0x564fe839a6f0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f2600010f50 tx=0x7f2600004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=274eec9ebfe62cef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:23.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.786+0000 7f25eaff5640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:03:23.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.786+0000 7f25eaff5640 1 -- 172.21.15.46:0/168229253 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2600020840 con 0x564fe7fd4350 2024-09-21T04:03:23.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.786+0000 7f25eaff5640 1 -- 172.21.15.46:0/168229253 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f26000209e0 con 0x564fe7fd4350 2024-09-21T04:03:23.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.786+0000 7f2613cc5740 1 -- 172.21.15.46:0/168229253 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25f8036040 con 0x564fe7fd4350 2024-09-21T04:03:23.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.787+0000 7f25eaff5640 1 -- 172.21.15.46:0/168229253 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2600020be0 con 0x564fe7fd4350 2024-09-21T04:03:23.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.787+0000 7f2613cc5740 10 client.16671 fetch_fsmap learned FSMap version 20 2024-09-21T04:03:23.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.787+0000 7f2613cc5740 1 -- 172.21.15.46:0/168229253 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564fe8403a90 con 0x564fe7fd4350 2024-09-21T04:03:23.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.787+0000 7f25eaff5640 1 -- 172.21.15.46:0/168229253 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25f8036040 con 0x564fe7fd4350 2024-09-21T04:03:23.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.787+0000 7f25eaff5640 1 -- 172.21.15.46:0/168229253 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f2600031020 con 0x564fe7fd4350 2024-09-21T04:03:23.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.787+0000 7f2613cc5740 10 client.16671 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:03:23.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.787+0000 7f2613cc5740 10 client.16671 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:03:23.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.787+0000 7f2613cc5740 20 client.16671 populate_metadata read hostname 'smithi046' 2024-09-21T04:03:23.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.787+0000 7f2613cc5740 1 --2- 172.21.15.46:0/168229253 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x564fe7f68080 0x564fe8406280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.787+0000 7f2613cc5740 4 client.16671 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T04:03:23.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.787+0000 7f2613cc5740 1 -- 172.21.15.46:0/168229253 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564fe82ef860 con 0x564fe7f68080 2024-09-21T04:03:23.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.787+0000 7f2606ffd640 1 --2- 172.21.15.46:0/168229253 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x564fe7f68080 0x564fe8406280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.788+0000 7f2606ffd640 1 --2- 172.21.15.46:0/168229253 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x564fe7f68080 0x564fe8406280 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bffa24067ec4684 server_cookie=1da86dddc2e9814 in_seq=0 out_seq=0 2024-09-21T04:03:23.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.788+0000 7f25eaff5640 10 client.16671 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:03:23.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.789+0000 7f25eaff5640 1 -- 172.21.15.46:0/168229253 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564fe82ef860 con 0x564fe7f68080 2024-09-21T04:03:23.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.789+0000 7f25eaff5640 10 client.16671 handle_command_reply: tid=0 2024-09-21T04:03:23.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.789+0000 7f2613cc5740 1 client.16671 shutdown 2024-09-21T04:03:23.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.790+0000 7f2613cc5740 1 -- 172.21.15.46:0/168229253 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fe7fd4350 msgr2=0x564fe839a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:23.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.790+0000 7f2613cc5740 1 --2- 172.21.15.46:0/168229253 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fe7fd4350 0x564fe839a6f0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f2600010f50 tx=0x7f2600004730 comp rx=0 tx=0).stop 2024-09-21T04:03:23.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.790+0000 7f2613cc5740 1 -- 172.21.15.46:0/168229253 shutdown_connections 2024-09-21T04:03:23.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.790+0000 7f2613cc5740 1 --2- 172.21.15.46:0/168229253 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x564fe7f68080 0x564fe8406280 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.790+0000 7f2613cc5740 1 --2- 172.21.15.46:0/168229253 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564fe7fd4350 0x564fe839a6f0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.790+0000 7f2613cc5740 1 --2- 172.21.15.46:0/168229253 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564fe7fb3670 0x564fe839a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.790+0000 7f25eaff5640 0 client.16671 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:03:23.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.790+0000 7f2613cc5740 1 --2- 172.21.15.46:0/168229253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564fe7fab490 0x564fe839cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.790+0000 7f2613cc5740 1 -- 172.21.15.46:0/168229253 >> 172.21.15.46:0/168229253 conn(0x564fe7fc8740 msgr2=0x564fe8388200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:23.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.790+0000 7f2613cc5740 1 -- 172.21.15.46:0/168229253 shutdown_connections 2024-09-21T04:03:23.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.790+0000 7f2613cc5740 1 -- 172.21.15.46:0/168229253 wait complete. 2024-09-21T04:03:23.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.790+0000 7f2613cc5740 20 client.16671 trim_cache size 0 max 16384 2024-09-21T04:03:23.797 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T04:03:23.797 INFO:teuthology.orchestra.run.smithi046.stdout: "return_code": 0, 2024-09-21T04:03:23.797 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_tag": "cfba6404-dc3f-4ad2-b873-926d5f9007de", 2024-09-21T04:03:23.797 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": "asynchronous" 2024-09-21T04:03:23.797 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T04:03:23.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.791+0000 7f260d751640 1 -- 172.21.15.46:0/1279357020 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f25f00b66b0 msgr2=0x7f25f00b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:23.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.791+0000 7f260d751640 1 --2- 172.21.15.46:0/1279357020 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f25f00b66b0 0x7f25f00b8bc0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f260000cbe0 tx=0x7f260000c5c0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.791+0000 7f260d751640 1 -- 172.21.15.46:0/1279357020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2608105320 msgr2=0x7f260819aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:23.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.791+0000 7f260d751640 1 --2- 172.21.15.46:0/1279357020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2608105320 0x7f260819aba0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f25fc00c8c0 tx=0x7f25fc00cd80 comp rx=0 tx=0).stop 2024-09-21T04:03:23.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.791+0000 7f260d751640 1 -- 172.21.15.46:0/1279357020 shutdown_connections 2024-09-21T04:03:23.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.791+0000 7f260d751640 1 --2- 172.21.15.46:0/1279357020 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f25f00b66b0 0x7f25f00b8bc0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.791+0000 7f260d751640 1 --2- 172.21.15.46:0/1279357020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f260810de30 0x7f260819fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.791+0000 7f260d751640 1 --2- 172.21.15.46:0/1279357020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2608105320 0x7f260819aba0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.791+0000 7f260d751640 1 --2- 172.21.15.46:0/1279357020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26081049d0 0x7f260819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.791+0000 7f260d751640 1 -- 172.21.15.46:0/1279357020 >> 172.21.15.46:0/1279357020 conn(0x7f2608079740 msgr2=0x7f26080ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:23.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.791+0000 7f260d751640 1 -- 172.21.15.46:0/1279357020 shutdown_connections 2024-09-21T04:03:23.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:23.791+0000 7f260d751640 1 -- 172.21.15.46:0/1279357020 wait complete. 2024-09-21T04:03:24.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:23 smithi046 ceph-mon[30954]: pgmap v574: 97 pgs: 97 active+clean; 14 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T04:03:24.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:23 smithi162 ceph-mon[35071]: pgmap v574: 97 pgs: 97 active+clean; 14 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T04:03:24.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:23 smithi105 ceph-mon[34773]: pgmap v574: 97 pgs: 97 active+clean; 14 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T04:03:24.584 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T04:03:24.841 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:03:25.102 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:24 smithi046 ceph-mon[30954]: scrub queued for path: / 2024-09-21T04:03:25.102 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:24 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T04:03:25.103 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:24 smithi046 ceph-mon[30954]: scrub summary: active paths [/] 2024-09-21T04:03:25.103 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:24 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T04:03:25.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:24 smithi162 ceph-mon[35071]: scrub queued for path: / 2024-09-21T04:03:25.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:24 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T04:03:25.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:24 smithi162 ceph-mon[35071]: scrub summary: active paths [/] 2024-09-21T04:03:25.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:24 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T04:03:25.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:24 smithi105 ceph-mon[34773]: scrub queued for path: / 2024-09-21T04:03:25.348 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:24 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T04:03:25.348 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:24 smithi105 ceph-mon[34773]: scrub summary: active paths [/] 2024-09-21T04:03:25.348 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:24 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T04:03:25.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.319+0000 7f1ec4ab0640 1 -- 172.21.15.46:0/2497973047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ec010de30 msgr2=0x7f1ec0110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:25.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.319+0000 7f1ec4ab0640 1 --2- 172.21.15.46:0/2497973047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ec010de30 0x7f1ec0110320 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8009ca0 tx=0x7f1eb802a8c0 comp rx=0 tx=0).stop 2024-09-21T04:03:25.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.319+0000 7f1ec4ab0640 1 -- 172.21.15.46:0/2497973047 shutdown_connections 2024-09-21T04:03:25.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.319+0000 7f1ec4ab0640 1 --2- 172.21.15.46:0/2497973047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ec010de30 0x7f1ec0110320 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:25.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.319+0000 7f1ec4ab0640 1 --2- 172.21.15.46:0/2497973047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ec0105320 0x7f1ec010d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:25.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.319+0000 7f1ec4ab0640 1 --2- 172.21.15.46:0/2497973047 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ec01049d0 0x7f1ec0104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:25.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.319+0000 7f1ec4ab0640 1 -- 172.21.15.46:0/2497973047 >> 172.21.15.46:0/2497973047 conn(0x7f1ec0079740 msgr2=0x7f1ec0079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:25.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.319+0000 7f1ec4ab0640 1 -- 172.21.15.46:0/2497973047 shutdown_connections 2024-09-21T04:03:25.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.319+0000 7f1ec4ab0640 1 -- 172.21.15.46:0/2497973047 wait complete. 2024-09-21T04:03:25.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.320+0000 7f1ec4ab0640 1 Processor -- start 2024-09-21T04:03:25.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.320+0000 7f1ec4ab0640 1 -- start start 2024-09-21T04:03:25.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.320+0000 7f1ec4ab0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ec01049d0 0x7f1ec019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:25.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.320+0000 7f1ec4ab0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ec0105320 0x7f1ec019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:25.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.320+0000 7f1ec4ab0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ec010de30 0x7f1ec019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:25.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.320+0000 7f1ec4ab0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec0113ab0 con 0x7f1ec01049d0 2024-09-21T04:03:25.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.320+0000 7f1ec4ab0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec0113930 con 0x7f1ec0105320 2024-09-21T04:03:25.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.320+0000 7f1ec4ab0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec0113c30 con 0x7f1ec010de30 2024-09-21T04:03:25.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.321+0000 7f1ebe59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ec01049d0 0x7f1ec019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:25.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.321+0000 7f1ebe59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ec01049d0 0x7f1ec019a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40530/0 (socket says 172.21.15.46:40530) 2024-09-21T04:03:25.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.321+0000 7f1ebe59c640 1 -- 172.21.15.46:0/3224947571 learned_addr learned my addr 172.21.15.46:0/3224947571 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:03:25.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.321+0000 7f1ebed9d640 1 --2- 172.21.15.46:0/3224947571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ec010de30 0x7f1ec019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:25.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.321+0000 7f1ebdd9b640 1 --2- 172.21.15.46:0/3224947571 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ec0105320 0x7f1ec019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:25.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.321+0000 7f1ebe59c640 1 -- 172.21.15.46:0/3224947571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ec010de30 msgr2=0x7f1ec019fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:25.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.321+0000 7f1ebe59c640 1 --2- 172.21.15.46:0/3224947571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ec010de30 0x7f1ec019fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:25.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.321+0000 7f1ebe59c640 1 -- 172.21.15.46:0/3224947571 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ec0105320 msgr2=0x7f1ec019aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:25.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.321+0000 7f1ebe59c640 1 --2- 172.21.15.46:0/3224947571 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ec0105320 0x7f1ec019aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:25.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.321+0000 7f1ebe59c640 1 -- 172.21.15.46:0/3224947571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec01a0430 con 0x7f1ec01049d0 2024-09-21T04:03:25.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.321+0000 7f1ebdd9b640 1 --2- 172.21.15.46:0/3224947571 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ec0105320 0x7f1ec019aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:03:25.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.321+0000 7f1ebe59c640 1 --2- 172.21.15.46:0/3224947571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ec01049d0 0x7f1ec019a4c0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f1eb000d770 tx=0x7f1eb000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:25.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.321+0000 7f1eb77fe640 1 -- 172.21.15.46:0/3224947571 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb0017070 con 0x7f1ec01049d0 2024-09-21T04:03:25.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.321+0000 7f1eb77fe640 1 -- 172.21.15.46:0/3224947571 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1eb0009c30 con 0x7f1ec01049d0 2024-09-21T04:03:25.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.321+0000 7f1ec4ab0640 1 -- 172.21.15.46:0/3224947571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ec01a0720 con 0x7f1ec01049d0 2024-09-21T04:03:25.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.321+0000 7f1eb77fe640 1 -- 172.21.15.46:0/3224947571 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb0003cc0 con 0x7f1ec01049d0 2024-09-21T04:03:25.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.321+0000 7f1ec4ab0640 1 -- 172.21.15.46:0/3224947571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ec01a6e80 con 0x7f1ec01049d0 2024-09-21T04:03:25.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.325+0000 7f1ecb024740 1 Processor -- start 2024-09-21T04:03:25.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.325+0000 7f1ecb024740 1 -- start start 2024-09-21T04:03:25.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.325+0000 7f1ecb024740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55aa0e745070 0x55aa0eaec650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:25.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.325+0000 7f1eb77fe640 1 -- 172.21.15.46:0/3224947571 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f1eb0003e60 con 0x7f1ec01049d0 2024-09-21T04:03:25.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.325+0000 7f1ecb024740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55aa0e71c1b0 0x55aa0eaecb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:25.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.325+0000 7f1ecb024740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa0e724390 0x55aa0eaed0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:25.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.325+0000 7f1ecb024740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55aa0ea62e50 con 0x55aa0e745070 2024-09-21T04:03:25.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.325+0000 7f1ecb024740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55aa0ea52280 con 0x55aa0e71c1b0 2024-09-21T04:03:25.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.325+0000 7f1ecb024740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55aa0ea56090 con 0x55aa0e724390 2024-09-21T04:03:25.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.325+0000 7f1ebed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55aa0e745070 0x55aa0eaec650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:25.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.325+0000 7f1ebed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55aa0e745070 0x55aa0eaec650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40540/0 (socket says 172.21.15.46:40540) 2024-09-21T04:03:25.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.325+0000 7f1ebed9d640 1 -- 172.21.15.46:0/2014905124 learned_addr learned my addr 172.21.15.46:0/2014905124 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:03:25.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.326+0000 7f1ebe59c640 1 --2- 172.21.15.46:0/2014905124 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55aa0e71c1b0 0x55aa0eaecb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:25.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.326+0000 7f1ebdd9b640 1 --2- 172.21.15.46:0/2014905124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa0e724390 0x55aa0eaed0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:25.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.326+0000 7f1ebed9d640 1 -- 172.21.15.46:0/2014905124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa0e724390 msgr2=0x55aa0eaed0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:25.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.326+0000 7f1ebed9d640 1 --2- 172.21.15.46:0/2014905124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa0e724390 0x55aa0eaed0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:25.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.326+0000 7f1ebed9d640 1 -- 172.21.15.46:0/2014905124 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55aa0e71c1b0 msgr2=0x55aa0eaecb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:25.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.326+0000 7f1ebed9d640 1 --2- 172.21.15.46:0/2014905124 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55aa0e71c1b0 0x55aa0eaecb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:25.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.326+0000 7f1ebed9d640 1 -- 172.21.15.46:0/2014905124 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa0e7b0650 con 0x55aa0e745070 2024-09-21T04:03:25.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.326+0000 7f1ebe59c640 1 --2- 172.21.15.46:0/2014905124 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55aa0e71c1b0 0x55aa0eaecb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:03:25.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.326+0000 7f1ebed9d640 1 --2- 172.21.15.46:0/2014905124 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55aa0e745070 0x55aa0eaec650 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8009920 tx=0x7f1eb8009950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2b05e2e6732dd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:25.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.326+0000 7f1eb77fe640 1 --2- 172.21.15.46:0/3224947571 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f1eac0b6680 0x7f1eac0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:25.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.326+0000 7f1eb4ff9640 1 -- 172.21.15.46:0/2014905124 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8031e30 con 0x55aa0e745070 2024-09-21T04:03:25.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.326+0000 7f1eb4ff9640 1 -- 172.21.15.46:0/2014905124 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1eb8036030 con 0x55aa0e745070 2024-09-21T04:03:25.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.326+0000 7f1eb4ff9640 1 -- 172.21.15.46:0/2014905124 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8004260 con 0x55aa0e745070 2024-09-21T04:03:25.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.326+0000 7f1ebe59c640 1 --2- 172.21.15.46:0/3224947571 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f1eac0b6680 0x7f1eac0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:25.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.326+0000 7f1eb77fe640 1 -- 172.21.15.46:0/3224947571 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f1eb00e7080 con 0x7f1ec01049d0 2024-09-21T04:03:25.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.327+0000 7f1ecb024740 1 -- 172.21.15.46:0/2014905124 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55aa0e745070 msgr2=0x55aa0eaec650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:25.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.327+0000 7f1ebe59c640 1 --2- 172.21.15.46:0/3224947571 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f1eac0b6680 0x7f1eac0b8b90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x55aa0eaeb2d0 tx=0x7f1eb0060040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:25.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.327+0000 7f1ecb024740 1 --2- 172.21.15.46:0/2014905124 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55aa0e745070 0x55aa0eaec650 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8009920 tx=0x7f1eb8009950 comp rx=0 tx=0).stop 2024-09-21T04:03:25.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.327+0000 7f1ecb024740 1 -- 172.21.15.46:0/2014905124 shutdown_connections 2024-09-21T04:03:25.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.327+0000 7f1ecb024740 1 --2- 172.21.15.46:0/2014905124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa0e724390 0x55aa0eaed0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:25.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.327+0000 7f1ecb024740 1 --2- 172.21.15.46:0/2014905124 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55aa0e71c1b0 0x55aa0eaecb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:25.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.327+0000 7f1ecb024740 1 --2- 172.21.15.46:0/2014905124 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55aa0e745070 0x55aa0eaec650 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:25.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.327+0000 7f1ecb024740 1 -- 172.21.15.46:0/2014905124 >> 172.21.15.46:0/2014905124 conn(0x55aa0e739460 msgr2=0x55aa0eaea540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:25.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.327+0000 7f1ecb024740 1 -- 172.21.15.46:0/2014905124 shutdown_connections 2024-09-21T04:03:25.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.327+0000 7f1ecb024740 1 -- 172.21.15.46:0/2014905124 wait complete. 2024-09-21T04:03:25.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.328+0000 7f1ecb024740 1 -- start start 2024-09-21T04:03:25.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.328+0000 7f1ecb024740 1 Processor -- start 2024-09-21T04:03:25.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.328+0000 7f1ecb024740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55aa0e71c1b0 0x55aa0eaf7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:25.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.328+0000 7f1ecb024740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55aa0e724390 0x55aa0eaf8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:25.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.328+0000 7f1ecb024740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa0e745070 0x55aa0eb03f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:25.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.328+0000 7f1ecb024740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55aa0e8b3700 con 0x55aa0e724390 2024-09-21T04:03:25.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.328+0000 7f1ecb024740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55aa0e9ed110 con 0x55aa0e71c1b0 2024-09-21T04:03:25.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.328+0000 7f1ecb024740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55aa0eafac50 con 0x55aa0e745070 2024-09-21T04:03:25.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.328+0000 7f1ecb024740 10 client.0 _ll_register_callbacks cb 0x55aa0ea06990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:03:25.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.328+0000 7f1ebdd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55aa0e724390 0x55aa0eaf8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:25.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.329+0000 7f1ebdd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55aa0e724390 0x55aa0eaf8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40554/0 (socket says 172.21.15.46:40554) 2024-09-21T04:03:25.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.329+0000 7f1ebdd9b640 1 -- 172.21.15.46:0/4082866205 learned_addr learned my addr 172.21.15.46:0/4082866205 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:03:25.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.329+0000 7f1ebed9d640 1 --2- 172.21.15.46:0/4082866205 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55aa0e71c1b0 0x55aa0eaf7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:25.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.329+0000 7f1ebed9d640 1 --2- 172.21.15.46:0/4082866205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa0e745070 0x55aa0eb03f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:25.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.329+0000 7f1ebdd9b640 1 -- 172.21.15.46:0/4082866205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa0e745070 msgr2=0x55aa0eb03f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:25.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.329+0000 7f1ebdd9b640 1 --2- 172.21.15.46:0/4082866205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa0e745070 0x55aa0eb03f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:25.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.329+0000 7f1ebdd9b640 1 -- 172.21.15.46:0/4082866205 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55aa0e71c1b0 msgr2=0x55aa0eaf7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:25.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.329+0000 7f1ebdd9b640 1 --2- 172.21.15.46:0/4082866205 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55aa0e71c1b0 0x55aa0eaf7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:25.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.329+0000 7f1ebdd9b640 1 -- 172.21.15.46:0/4082866205 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa0ea1ac40 con 0x55aa0e724390 2024-09-21T04:03:25.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.329+0000 7f1ebed9d640 1 --2- 172.21.15.46:0/4082866205 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55aa0e71c1b0 0x55aa0eaf7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:03:25.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.329+0000 7f1ebdd9b640 1 --2- 172.21.15.46:0/4082866205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55aa0e724390 0x55aa0eaf8260 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8011800 tx=0x7f1ea8011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a713da29748a415 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:25.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.329+0000 7f1ea5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:03:25.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.329+0000 7f1ea5ffb640 1 -- 172.21.15.46:0/4082866205 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea800fe70 con 0x55aa0e724390 2024-09-21T04:03:25.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.329+0000 7f1ea5ffb640 1 -- 172.21.15.46:0/4082866205 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f1ea8004020 con 0x55aa0e724390 2024-09-21T04:03:25.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.329+0000 7f1ecb024740 1 -- 172.21.15.46:0/4082866205 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1eb8036030 con 0x55aa0e724390 2024-09-21T04:03:25.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.329+0000 7f1ea5ffb640 1 -- 172.21.15.46:0/4082866205 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1ea8004240 con 0x55aa0e724390 2024-09-21T04:03:25.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.329+0000 7f1ecb024740 10 client.16683 fetch_fsmap learned FSMap version 20 2024-09-21T04:03:25.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.329+0000 7f1ecb024740 1 -- 172.21.15.46:0/4082866205 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55aa0eb069b0 con 0x55aa0e724390 2024-09-21T04:03:25.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.330+0000 7f1ea5ffb640 1 -- 172.21.15.46:0/4082866205 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1eb8036030 con 0x55aa0e724390 2024-09-21T04:03:25.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.330+0000 7f1ea5ffb640 1 -- 172.21.15.46:0/4082866205 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f1ea8018030 con 0x55aa0e724390 2024-09-21T04:03:25.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.330+0000 7f1ecb024740 10 client.16683 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:03:25.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.330+0000 7f1ecb024740 10 client.16683 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:03:25.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.330+0000 7f1ecb024740 20 client.16683 populate_metadata read hostname 'smithi046' 2024-09-21T04:03:25.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.330+0000 7f1ecb024740 1 --2- 172.21.15.46:0/4082866205 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55aa0e7039f0 0x55aa0eb09f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:25.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.330+0000 7f1ecb024740 4 client.16683 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:03:25.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.330+0000 7f1ecb024740 1 -- 172.21.15.46:0/4082866205 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa0ea64da0 con 0x55aa0e7039f0 2024-09-21T04:03:25.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.330+0000 7f1ebed9d640 1 --2- 172.21.15.46:0/4082866205 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55aa0e7039f0 0x55aa0eb09f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:25.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.331+0000 7f1ebed9d640 1 --2- 172.21.15.46:0/4082866205 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55aa0e7039f0 0x55aa0eb09f10 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4836039a83aa798 server_cookie=8ef2083dac303872 in_seq=0 out_seq=0 2024-09-21T04:03:25.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.331+0000 7f1ea5ffb640 10 client.16683 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:03:25.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.331+0000 7f1ea5ffb640 1 -- 172.21.15.46:0/4082866205 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55aa0ea64da0 con 0x55aa0e7039f0 2024-09-21T04:03:25.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.332+0000 7f1ea5ffb640 10 client.16683 handle_command_reply: tid=0 2024-09-21T04:03:25.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.332+0000 7f1ecb024740 1 client.16683 shutdown 2024-09-21T04:03:25.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.332+0000 7f1ecb024740 1 -- 172.21.15.46:0/4082866205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55aa0e724390 msgr2=0x55aa0eaf8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:25.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.332+0000 7f1ecb024740 1 --2- 172.21.15.46:0/4082866205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55aa0e724390 0x55aa0eaf8260 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8011800 tx=0x7f1ea8011cc0 comp rx=0 tx=0).stop 2024-09-21T04:03:25.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.332+0000 7f1ecb024740 1 -- 172.21.15.46:0/4082866205 shutdown_connections 2024-09-21T04:03:25.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.332+0000 7f1ecb024740 1 --2- 172.21.15.46:0/4082866205 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55aa0e7039f0 0x55aa0eb09f10 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:25.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.332+0000 7f1ea5ffb640 0 client.16683 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:03:25.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.332+0000 7f1ecb024740 1 --2- 172.21.15.46:0/4082866205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa0e745070 0x55aa0eb03f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:25.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.332+0000 7f1ecb024740 1 --2- 172.21.15.46:0/4082866205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55aa0e724390 0x55aa0eaf8260 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:25.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.332+0000 7f1ecb024740 1 --2- 172.21.15.46:0/4082866205 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55aa0e71c1b0 0x55aa0eaf7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:25.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.332+0000 7f1ecb024740 1 -- 172.21.15.46:0/4082866205 >> 172.21.15.46:0/4082866205 conn(0x55aa0e739460 msgr2=0x55aa0eaef830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:25.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.332+0000 7f1ecb024740 1 -- 172.21.15.46:0/4082866205 shutdown_connections 2024-09-21T04:03:25.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.332+0000 7f1ecb024740 1 -- 172.21.15.46:0/4082866205 wait complete. 2024-09-21T04:03:25.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.332+0000 7f1ecb024740 20 client.16683 trim_cache size 0 max 16384 2024-09-21T04:03:25.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.349+0000 7f1ecb024740 1 Processor -- start 2024-09-21T04:03:25.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.350+0000 7f1ecb024740 1 -- start start 2024-09-21T04:03:25.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.350+0000 7f1ecb024740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55aa0e7039f0 0x55aa0eaee040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:25.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.350+0000 7f1ecb024740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa0e71c1b0 0x55aa0eaf9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:25.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.350+0000 7f1ecb024740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55aa0e724390 0x55aa0eae9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:25.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.350+0000 7f1ecb024740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec01ad5e0 con 0x55aa0e7039f0 2024-09-21T04:03:25.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.350+0000 7f1ecb024740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec01afe40 con 0x55aa0e724390 2024-09-21T04:03:25.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.350+0000 7f1ecb024740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec01adc30 con 0x55aa0e71c1b0 2024-09-21T04:03:25.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.350+0000 7f1ebed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55aa0e7039f0 0x55aa0eaee040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:25.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.350+0000 7f1ebed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55aa0e7039f0 0x55aa0eaee040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40568/0 (socket says 172.21.15.46:40568) 2024-09-21T04:03:25.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.350+0000 7f1ebed9d640 1 -- 172.21.15.46:0/2497643013 learned_addr learned my addr 172.21.15.46:0/2497643013 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:03:25.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.350+0000 7f1ebed9d640 1 -- 172.21.15.46:0/2497643013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa0e71c1b0 msgr2=0x55aa0eaf9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:25.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.350+0000 7f1ebed9d640 1 --2- 172.21.15.46:0/2497643013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa0e71c1b0 0x55aa0eaf9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:25.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.350+0000 7f1ebed9d640 1 -- 172.21.15.46:0/2497643013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55aa0e724390 msgr2=0x55aa0eae9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:25.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.350+0000 7f1ebed9d640 1 --2- 172.21.15.46:0/2497643013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55aa0e724390 0x55aa0eae9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:25.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.350+0000 7f1ebed9d640 1 -- 172.21.15.46:0/2497643013 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa0eaf85d0 con 0x55aa0e7039f0 2024-09-21T04:03:25.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.351+0000 7f1ebed9d640 1 --2- 172.21.15.46:0/2497643013 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55aa0e7039f0 0x55aa0eaee040 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f1eb80099c0 tx=0x7f1eb8003db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c978844ee8963fc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:25.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.351+0000 7f1ea7fff640 1 -- 172.21.15.46:0/2497643013 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb80314d0 con 0x55aa0e7039f0 2024-09-21T04:03:25.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.351+0000 7f1ea7fff640 1 -- 172.21.15.46:0/2497643013 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1eb8036040 con 0x55aa0e7039f0 2024-09-21T04:03:25.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.351+0000 7f1ea7fff640 1 -- 172.21.15.46:0/2497643013 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8031920 con 0x55aa0e7039f0 2024-09-21T04:03:25.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.352+0000 7f1ecb024740 1 -- 172.21.15.46:0/2497643013 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55aa0e7039f0 msgr2=0x55aa0eaee040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:25.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.352+0000 7f1ecb024740 1 --2- 172.21.15.46:0/2497643013 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55aa0e7039f0 0x55aa0eaee040 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f1eb80099c0 tx=0x7f1eb8003db0 comp rx=0 tx=0).stop 2024-09-21T04:03:25.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.352+0000 7f1ecb024740 1 -- 172.21.15.46:0/2497643013 shutdown_connections 2024-09-21T04:03:25.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.352+0000 7f1ecb024740 1 --2- 172.21.15.46:0/2497643013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55aa0e724390 0x55aa0eae9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:25.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.352+0000 7f1ecb024740 1 --2- 172.21.15.46:0/2497643013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa0e71c1b0 0x55aa0eaf9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:25.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.352+0000 7f1ecb024740 1 --2- 172.21.15.46:0/2497643013 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55aa0e7039f0 0x55aa0eaee040 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:25.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.352+0000 7f1ecb024740 1 -- 172.21.15.46:0/2497643013 >> 172.21.15.46:0/2497643013 conn(0x55aa0e739460 msgr2=0x55aa0eaf9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:25.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.352+0000 7f1ecb024740 1 -- 172.21.15.46:0/2497643013 shutdown_connections 2024-09-21T04:03:25.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.352+0000 7f1ecb024740 1 -- 172.21.15.46:0/2497643013 wait complete. 2024-09-21T04:03:25.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.352+0000 7f1ecb024740 1 -- start start 2024-09-21T04:03:25.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.352+0000 7f1ecb024740 1 Processor -- start 2024-09-21T04:03:25.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.353+0000 7f1ecb024740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa0e7039f0 0x55aa0eafbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:25.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.353+0000 7f1ecb024740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55aa0e71c1b0 0x55aa0eafc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:25.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.353+0000 7f1ecb024740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55aa0e724390 0x55aa0eafc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:25.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.353+0000 7f1ecb024740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec01ae300 con 0x55aa0e724390 2024-09-21T04:03:25.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.353+0000 7f1ecb024740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec01af770 con 0x55aa0e71c1b0 2024-09-21T04:03:25.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.353+0000 7f1ecb024740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec01ae9d0 con 0x55aa0e7039f0 2024-09-21T04:03:25.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.353+0000 7f1ecb024740 10 client.0 _ll_register_callbacks cb 0x7f1ea800c830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:03:25.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.353+0000 7f1ebed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55aa0e724390 0x55aa0eafc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:25.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.353+0000 7f1ebed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55aa0e724390 0x55aa0eafc940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40574/0 (socket says 172.21.15.46:40574) 2024-09-21T04:03:25.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.353+0000 7f1ebed9d640 1 -- 172.21.15.46:0/2332828882 learned_addr learned my addr 172.21.15.46:0/2332828882 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:03:25.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.353+0000 7f1ebed9d640 1 --2- 172.21.15.46:0/2332828882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa0e7039f0 0x55aa0eafbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:25.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.353+0000 7f1ebdd9b640 1 --2- 172.21.15.46:0/2332828882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55aa0e71c1b0 0x55aa0eafc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:25.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.353+0000 7f1ebed9d640 1 -- 172.21.15.46:0/2332828882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa0e7039f0 msgr2=0x55aa0eafbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:25.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.353+0000 7f1ebed9d640 1 --2- 172.21.15.46:0/2332828882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa0e7039f0 0x55aa0eafbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:25.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.353+0000 7f1ebed9d640 1 -- 172.21.15.46:0/2332828882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55aa0e71c1b0 msgr2=0x55aa0eafc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:25.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.353+0000 7f1ebed9d640 1 --2- 172.21.15.46:0/2332828882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55aa0e71c1b0 0x55aa0eafc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:25.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.353+0000 7f1ebed9d640 1 -- 172.21.15.46:0/2332828882 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa0eb73900 con 0x55aa0e724390 2024-09-21T04:03:25.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.354+0000 7f1ebed9d640 1 --2- 172.21.15.46:0/2332828882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55aa0e724390 0x55aa0eafc940 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8005e00 tx=0x7f1eb802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b752114d7c967222 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:25.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.354+0000 7f1ea5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:03:25.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.354+0000 7f1ea5ffb640 1 -- 172.21.15.46:0/2332828882 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb80314d0 con 0x55aa0e724390 2024-09-21T04:03:25.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.354+0000 7f1ea5ffb640 1 -- 172.21.15.46:0/2332828882 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f1eb8004040 con 0x55aa0e724390 2024-09-21T04:03:25.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.354+0000 7f1ecb024740 1 -- 172.21.15.46:0/2332828882 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1eb8036040 con 0x55aa0e724390 2024-09-21T04:03:25.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.354+0000 7f1ea5ffb640 1 -- 172.21.15.46:0/2332828882 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1eb8031670 con 0x55aa0e724390 2024-09-21T04:03:25.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.354+0000 7f1ecb024740 10 client.16689 fetch_fsmap learned FSMap version 20 2024-09-21T04:03:25.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.354+0000 7f1ecb024740 1 -- 172.21.15.46:0/2332828882 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55aa0eb74b70 con 0x55aa0e724390 2024-09-21T04:03:25.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.354+0000 7f1ea5ffb640 1 -- 172.21.15.46:0/2332828882 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1eb8036040 con 0x55aa0e724390 2024-09-21T04:03:25.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.354+0000 7f1ea5ffb640 1 -- 172.21.15.46:0/2332828882 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f1eb8062070 con 0x55aa0e724390 2024-09-21T04:03:25.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.354+0000 7f1ecb024740 10 client.16689 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:03:25.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.354+0000 7f1ecb024740 10 client.16689 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:03:25.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.355+0000 7f1ecb024740 20 client.16689 populate_metadata read hostname 'smithi046' 2024-09-21T04:03:25.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.355+0000 7f1ecb024740 1 --2- 172.21.15.46:0/2332828882 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55aa0e745070 0x55aa0eb76ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:25.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.355+0000 7f1ecb024740 4 client.16689 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T04:03:25.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.355+0000 7f1ecb024740 1 -- 172.21.15.46:0/2332828882 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55aa0ea60850 con 0x55aa0e745070 2024-09-21T04:03:25.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.355+0000 7f1ebdd9b640 1 --2- 172.21.15.46:0/2332828882 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55aa0e745070 0x55aa0eb76ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:25.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.355+0000 7f1ebdd9b640 1 --2- 172.21.15.46:0/2332828882 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55aa0e745070 0x55aa0eb76ff0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76212cd11f87a8d4 server_cookie=fb2e50524e814322 in_seq=0 out_seq=0 2024-09-21T04:03:25.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.355+0000 7f1ea5ffb640 10 client.16689 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:03:25.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.356+0000 7f1ea5ffb640 1 -- 172.21.15.46:0/2332828882 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5114 (crc 0 0 0) 0x55aa0ea60850 con 0x55aa0e745070 2024-09-21T04:03:25.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.356+0000 7f1ea5ffb640 10 client.16689 handle_command_reply: tid=0 2024-09-21T04:03:25.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.356+0000 7f1ecb024740 1 client.16689 shutdown 2024-09-21T04:03:25.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.356+0000 7f1ecb024740 1 -- 172.21.15.46:0/2332828882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55aa0e724390 msgr2=0x55aa0eafc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:25.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.356+0000 7f1ecb024740 1 --2- 172.21.15.46:0/2332828882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55aa0e724390 0x55aa0eafc940 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8005e00 tx=0x7f1eb802a8c0 comp rx=0 tx=0).stop 2024-09-21T04:03:25.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.356+0000 7f1ecb024740 1 -- 172.21.15.46:0/2332828882 shutdown_connections 2024-09-21T04:03:25.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.356+0000 7f1ecb024740 1 --2- 172.21.15.46:0/2332828882 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55aa0e745070 0x55aa0eb76ff0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:25.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.356+0000 7f1ea5ffb640 0 client.16689 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:03:25.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.356+0000 7f1ecb024740 1 --2- 172.21.15.46:0/2332828882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55aa0e724390 0x55aa0eafc940 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:25.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.356+0000 7f1ecb024740 1 --2- 172.21.15.46:0/2332828882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55aa0e71c1b0 0x55aa0eafc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:25.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.356+0000 7f1ecb024740 1 --2- 172.21.15.46:0/2332828882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa0e7039f0 0x55aa0eafbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:25.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.356+0000 7f1ecb024740 1 -- 172.21.15.46:0/2332828882 >> 172.21.15.46:0/2332828882 conn(0x55aa0e739460 msgr2=0x55aa0eaede10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:25.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.356+0000 7f1ecb024740 1 -- 172.21.15.46:0/2332828882 shutdown_connections 2024-09-21T04:03:25.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.356+0000 7f1ecb024740 1 -- 172.21.15.46:0/2332828882 wait complete. 2024-09-21T04:03:25.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.356+0000 7f1ecb024740 20 client.16689 trim_cache size 0 max 16384 2024-09-21T04:03:25.370 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T04:03:25.370 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T04:03:25.370 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2024-09-21T04:03:25.370 INFO:teuthology.orchestra.run.smithi046.stdout: "cfba6404-dc3f-4ad2-b873-926d5f9007de": { 2024-09-21T04:03:25.371 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:25.371 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "cfba6404-dc3f-4ad2-b873-926d5f9007de", 2024-09-21T04:03:25.371 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2024-09-21T04:03:25.371 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:03:25.371 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:25.371 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_stats": { 2024-09-21T04:03:25.371 INFO:teuthology.orchestra.run.smithi046.stdout: "cfba6404-dc3f-4ad2-b873-926d5f9007de": { 2024-09-21T04:03:25.371 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:03:23.788611+0000", 2024-09-21T04:03:25.371 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:25.371 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:25.371 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:25.371 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:25.371 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:25.372 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:25.372 INFO:teuthology.orchestra.run.smithi046.stdout: "96aa13fd-aa77-46b5-b20e-a9b203dc7a94": { 2024-09-21T04:03:25.372 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:02:44.727411+0000", 2024-09-21T04:03:25.372 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:25.372 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:25.372 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:25.372 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:25.372 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:25.372 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:25.372 INFO:teuthology.orchestra.run.smithi046.stdout: "64865e31-a445-43e8-9fa3-26fae089b973": { 2024-09-21T04:03:25.372 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:02:37.376562+0000", 2024-09-21T04:03:25.372 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:25.373 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:25.373 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:25.373 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:25.373 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:25.373 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:25.373 INFO:teuthology.orchestra.run.smithi046.stdout: "7a3afabe-6b27-4bce-928a-8c6773a85803": { 2024-09-21T04:03:25.373 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:01:58.413358+0000", 2024-09-21T04:03:25.373 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:25.373 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:25.373 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:25.373 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:25.373 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:25.373 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:25.374 INFO:teuthology.orchestra.run.smithi046.stdout: "08f0c962-df1a-4129-a1a2-b916240d9803": { 2024-09-21T04:03:25.374 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:02.937596+0000", 2024-09-21T04:03:25.374 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:25.374 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:25.374 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:25.374 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:25.374 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:25.374 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:25.374 INFO:teuthology.orchestra.run.smithi046.stdout: "d49f33a7-3d5a-421b-94ba-8b19a4120db1": { 2024-09-21T04:03:25.374 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:50.480786+0000", 2024-09-21T04:03:25.374 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:25.374 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:25.374 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:25.374 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:25.375 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:25.375 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:25.375 INFO:teuthology.orchestra.run.smithi046.stdout: "a871f724-0198-493c-b03e-b2de78aba243": { 2024-09-21T04:03:25.375 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:56:30.082991+0000", 2024-09-21T04:03:25.375 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:25.375 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:25.375 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:25.375 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:25.375 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:25.375 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:25.375 INFO:teuthology.orchestra.run.smithi046.stdout: "edc4b8c7-b702-489d-a925-ae7ad0ff0d9a": { 2024-09-21T04:03:25.375 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:00:40.181950+0000", 2024-09-21T04:03:25.375 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:25.376 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:25.376 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:25.376 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:25.376 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:25.376 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:25.376 INFO:teuthology.orchestra.run.smithi046.stdout: "3bbf7097-70d7-4743-bbce-41465502b35b": { 2024-09-21T04:03:25.376 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:10.661441+0000", 2024-09-21T04:03:25.376 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:25.376 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:25.376 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:25.376 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:25.376 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:25.376 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:25.377 INFO:teuthology.orchestra.run.smithi046.stdout: "e24ec8f1-0d13-478f-9c2c-b51798868ffc": { 2024-09-21T04:03:25.377 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:09.736194+0000", 2024-09-21T04:03:25.377 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:25.377 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:25.377 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:25.377 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:25.377 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:25.377 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:25.377 INFO:teuthology.orchestra.run.smithi046.stdout: "c47f458a-de5e-4952-a575-a81261953667": { 2024-09-21T04:03:25.377 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:48.699411+0000", 2024-09-21T04:03:25.377 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:25.377 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:25.377 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:25.377 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:25.378 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:25.378 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:25.378 INFO:teuthology.orchestra.run.smithi046.stdout: "6103c660-8e77-4b06-ad6c-bb322c26035a": { 2024-09-21T04:03:25.378 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:35.594467+0000", 2024-09-21T04:03:25.378 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:25.378 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:25.378 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:25.378 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:25.378 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:25.378 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:25.378 INFO:teuthology.orchestra.run.smithi046.stdout: "46bb5415-6e16-47c6-a1e4-55f9c623ce90": { 2024-09-21T04:03:25.378 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:14.950674+0000", 2024-09-21T04:03:25.379 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:25.379 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:25.379 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:25.379 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:25.379 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:25.379 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:25.379 INFO:teuthology.orchestra.run.smithi046.stdout: "326aaecf-f38a-4946-988a-d83f25556995": { 2024-09-21T04:03:25.379 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:54.189884+0000", 2024-09-21T04:03:25.379 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:25.379 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:25.379 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:25.379 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:25.379 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:25.379 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:25.380 INFO:teuthology.orchestra.run.smithi046.stdout: "dab67652-8894-4711-be64-cbdfea27a9ba": { 2024-09-21T04:03:25.380 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:28.161616+0000", 2024-09-21T04:03:25.380 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:25.380 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:25.380 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:25.380 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:25.380 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:25.380 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:25.380 INFO:teuthology.orchestra.run.smithi046.stdout: "0d781b95-cf5e-46f2-9875-2923181385e2": { 2024-09-21T04:03:25.380 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:00:33.099094+0000", 2024-09-21T04:03:25.380 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:25.380 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:25.380 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:25.381 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:25.381 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:25.381 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:25.381 INFO:teuthology.orchestra.run.smithi046.stdout: "d7634007-e881-46f7-9833-ac9bd0a3100e": { 2024-09-21T04:03:25.381 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:01:19.459151+0000", 2024-09-21T04:03:25.381 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:25.381 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:25.381 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:25.381 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:25.381 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:25.381 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:03:25.381 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:03:25.381 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T04:03:25.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.357+0000 7f1ec4ab0640 1 -- 172.21.15.46:0/3224947571 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f1eac0b6680 msgr2=0x7f1eac0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:25.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.357+0000 7f1ec4ab0640 1 --2- 172.21.15.46:0/3224947571 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f1eac0b6680 0x7f1eac0b8b90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x55aa0eaeb2d0 tx=0x7f1eb0060040 comp rx=0 tx=0).stop 2024-09-21T04:03:25.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.357+0000 7f1ec4ab0640 1 -- 172.21.15.46:0/3224947571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ec01049d0 msgr2=0x7f1ec019a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:25.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.357+0000 7f1ec4ab0640 1 --2- 172.21.15.46:0/3224947571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ec01049d0 0x7f1ec019a4c0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f1eb000d770 tx=0x7f1eb000dc30 comp rx=0 tx=0).stop 2024-09-21T04:03:25.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.357+0000 7f1ec4ab0640 1 -- 172.21.15.46:0/3224947571 shutdown_connections 2024-09-21T04:03:25.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.357+0000 7f1ec4ab0640 1 --2- 172.21.15.46:0/3224947571 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f1eac0b6680 0x7f1eac0b8b90 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:25.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.357+0000 7f1ec4ab0640 1 --2- 172.21.15.46:0/3224947571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ec010de30 0x7f1ec019fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:25.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.357+0000 7f1ec4ab0640 1 --2- 172.21.15.46:0/3224947571 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ec0105320 0x7f1ec019aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:25.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.357+0000 7f1ec4ab0640 1 --2- 172.21.15.46:0/3224947571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ec01049d0 0x7f1ec019a4c0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:25.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.357+0000 7f1ec4ab0640 1 -- 172.21.15.46:0/3224947571 >> 172.21.15.46:0/3224947571 conn(0x7f1ec0079740 msgr2=0x7f1ec00ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:25.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.357+0000 7f1ec4ab0640 1 -- 172.21.15.46:0/3224947571 shutdown_connections 2024-09-21T04:03:25.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:25.357+0000 7f1ec4ab0640 1 -- 172.21.15.46:0/3224947571 wait complete. 2024-09-21T04:03:26.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:25 smithi162 ceph-mon[35071]: pgmap v575: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T04:03:26.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:25 smithi046 ceph-mon[30954]: pgmap v575: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T04:03:26.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:25 smithi105 ceph-mon[34773]: pgmap v575: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T04:03:26.393 INFO:tasks.cephfs.filesystem:scrub status for tag:cfba6404-dc3f-4ad2-b873-926d5f9007de - {'path': '/', 'tag': 'cfba6404-dc3f-4ad2-b873-926d5f9007de', 'options': 'recursive,force'} 2024-09-21T04:03:27.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:26 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:03:27.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:26 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:03:27.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:26 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:03:27.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:26 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:03:27.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:26 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:03:27.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:26 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:03:27.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:26 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:03:27.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:26 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:03:27.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:26 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:03:27.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:26 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:03:27.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:26 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:03:27.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:26 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:03:28.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:27 smithi162 ceph-mon[35071]: pgmap v576: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T04:03:28.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:27 smithi046 ceph-mon[30954]: pgmap v576: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T04:03:28.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:27 smithi105 ceph-mon[34773]: pgmap v576: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T04:03:29.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:28 smithi162 ceph-mon[35071]: scrub summary: idle 2024-09-21T04:03:29.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:28 smithi046 ceph-mon[30954]: scrub summary: idle 2024-09-21T04:03:29.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:28 smithi105 ceph-mon[34773]: scrub summary: idle 2024-09-21T04:03:30.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:29 smithi162 ceph-mon[35071]: pgmap v577: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 3 op/s 2024-09-21T04:03:30.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:29 smithi046 ceph-mon[30954]: pgmap v577: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 3 op/s 2024-09-21T04:03:30.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:29 smithi105 ceph-mon[34773]: pgmap v577: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 3 op/s 2024-09-21T04:03:32.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:31 smithi162 ceph-mon[35071]: pgmap v578: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T04:03:32.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:31 smithi046 ceph-mon[30954]: pgmap v578: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T04:03:32.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:31 smithi105 ceph-mon[34773]: pgmap v578: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T04:03:34.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:33 smithi162 ceph-mon[35071]: pgmap v579: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-21T04:03:34.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:33 smithi046 ceph-mon[30954]: pgmap v579: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-21T04:03:34.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:33 smithi105 ceph-mon[34773]: pgmap v579: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-21T04:03:36.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:35 smithi046 ceph-mon[30954]: pgmap v580: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T04:03:36.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:35 smithi105 ceph-mon[34773]: pgmap v580: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T04:03:36.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:35 smithi162 ceph-mon[35071]: pgmap v580: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T04:03:38.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:37 smithi046 ceph-mon[30954]: pgmap v581: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T04:03:38.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:37 smithi105 ceph-mon[34773]: pgmap v581: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T04:03:38.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:37 smithi162 ceph-mon[35071]: pgmap v581: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T04:03:40.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:39 smithi046 ceph-mon[30954]: pgmap v582: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-09-21T04:03:40.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:39 smithi105 ceph-mon[34773]: pgmap v582: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-09-21T04:03:40.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:39 smithi162 ceph-mon[35071]: pgmap v582: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-09-21T04:03:42.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:41 smithi046 ceph-mon[30954]: pgmap v583: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:03:42.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:41 smithi105 ceph-mon[34773]: pgmap v583: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:03:42.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:41 smithi162 ceph-mon[35071]: pgmap v583: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:03:44.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:43 smithi046 ceph-mon[30954]: pgmap v584: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T04:03:44.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:43 smithi105 ceph-mon[34773]: pgmap v584: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T04:03:44.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:43 smithi162 ceph-mon[35071]: pgmap v584: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T04:03:46.178 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:45 smithi162 ceph-mon[35071]: pgmap v585: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:03:46.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:45 smithi046 ceph-mon[30954]: pgmap v585: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:03:46.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:45 smithi105 ceph-mon[34773]: pgmap v585: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:03:48.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:47 smithi046 ceph-mon[30954]: pgmap v586: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:03:48.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:47 smithi105 ceph-mon[34773]: pgmap v586: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:03:48.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:47 smithi162 ceph-mon[35071]: pgmap v586: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:03:50.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:49 smithi046 ceph-mon[30954]: pgmap v587: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:03:50.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:49 smithi105 ceph-mon[34773]: pgmap v587: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:03:50.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:49 smithi162 ceph-mon[35071]: pgmap v587: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:03:52.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:51 smithi046 ceph-mon[30954]: pgmap v588: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:03:52.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:51 smithi105 ceph-mon[34773]: pgmap v588: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:03:52.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:51 smithi162 ceph-mon[35071]: pgmap v588: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:03:54.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:53 smithi046 ceph-mon[30954]: pgmap v589: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T04:03:54.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:53 smithi105 ceph-mon[34773]: pgmap v589: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T04:03:54.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:53 smithi162 ceph-mon[35071]: pgmap v589: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T04:03:56.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:55 smithi046 ceph-mon[30954]: pgmap v590: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:03:56.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:55 smithi105 ceph-mon[34773]: pgmap v590: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:03:56.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:55 smithi162 ceph-mon[35071]: pgmap v590: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:03:56.394 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T04:03:56.666 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:03:57.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.148+0000 7fe4c29a2640 1 -- 172.21.15.46:0/4236059880 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4bc108b10 msgr2=0x7fe4bc10f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:57.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.148+0000 7fe4c29a2640 1 --2- 172.21.15.46:0/4236059880 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4bc108b10 0x7fe4bc10f340 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4009ca0 tx=0x7fe4b402a8c0 comp rx=0 tx=0).stop 2024-09-21T04:03:57.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.148+0000 7fe4c29a2640 1 -- 172.21.15.46:0/4236059880 shutdown_connections 2024-09-21T04:03:57.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.148+0000 7fe4c29a2640 1 --2- 172.21.15.46:0/4236059880 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4bc108b10 0x7fe4bc10f340 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:57.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.148+0000 7fe4c29a2640 1 --2- 172.21.15.46:0/4236059880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4bc1081c0 0x7fe4bc1085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:57.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.148+0000 7fe4c29a2640 1 --2- 172.21.15.46:0/4236059880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4bc102880 0x7fe4bc102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:57.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.148+0000 7fe4c29a2640 1 -- 172.21.15.46:0/4236059880 >> 172.21.15.46:0/4236059880 conn(0x7fe4bc0fe2d0 msgr2=0x7fe4bc100720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:57.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.148+0000 7fe4c29a2640 1 -- 172.21.15.46:0/4236059880 shutdown_connections 2024-09-21T04:03:57.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.148+0000 7fe4c29a2640 1 -- 172.21.15.46:0/4236059880 wait complete. 2024-09-21T04:03:57.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.149+0000 7fe4c29a2640 1 Processor -- start 2024-09-21T04:03:57.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.149+0000 7fe4c29a2640 1 -- start start 2024-09-21T04:03:57.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.149+0000 7fe4c29a2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4bc102880 0x7fe4bc19b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:57.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.149+0000 7fe4c29a2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4bc1081c0 0x7fe4bc19b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:57.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.149+0000 7fe4c29a2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4bc108b10 0x7fe4bc19bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:57.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.149+0000 7fe4c29a2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe4bc1127c0 con 0x7fe4bc108b10 2024-09-21T04:03:57.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.149+0000 7fe4c29a2640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe4bc112640 con 0x7fe4bc1081c0 2024-09-21T04:03:57.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.149+0000 7fe4c29a2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe4bc112940 con 0x7fe4bc102880 2024-09-21T04:03:57.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.149+0000 7fe4c21a1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4bc108b10 0x7fe4bc19bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:57.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.149+0000 7fe4c19a0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4bc102880 0x7fe4bc19b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:57.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.149+0000 7fe4c21a1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4bc108b10 0x7fe4bc19bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52502/0 (socket says 172.21.15.46:52502) 2024-09-21T04:03:57.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.149+0000 7fe4c21a1640 1 -- 172.21.15.46:0/1112368956 learned_addr learned my addr 172.21.15.46:0/1112368956 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:03:57.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.149+0000 7fe4c119f640 1 --2- 172.21.15.46:0/1112368956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4bc1081c0 0x7fe4bc19b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:57.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.150+0000 7fe4c21a1640 1 -- 172.21.15.46:0/1112368956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4bc102880 msgr2=0x7fe4bc19b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:57.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.150+0000 7fe4c21a1640 1 --2- 172.21.15.46:0/1112368956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4bc102880 0x7fe4bc19b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:57.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.150+0000 7fe4c21a1640 1 -- 172.21.15.46:0/1112368956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4bc1081c0 msgr2=0x7fe4bc19b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:57.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.150+0000 7fe4c21a1640 1 --2- 172.21.15.46:0/1112368956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4bc1081c0 0x7fe4bc19b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:57.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.150+0000 7fe4c21a1640 1 -- 172.21.15.46:0/1112368956 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4bc1a6340 con 0x7fe4bc108b10 2024-09-21T04:03:57.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.150+0000 7fe4c19a0640 1 --2- 172.21.15.46:0/1112368956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4bc102880 0x7fe4bc19b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:03:57.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.150+0000 7fe4c21a1640 1 --2- 172.21.15.46:0/1112368956 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4bc108b10 0x7fe4bc19bab0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4005cc0 tx=0x7fe4b4031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:57.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.150+0000 7fe4b2ffd640 1 -- 172.21.15.46:0/1112368956 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4003b70 con 0x7fe4bc108b10 2024-09-21T04:03:57.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.150+0000 7fe4b2ffd640 1 -- 172.21.15.46:0/1112368956 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4b40318f0 con 0x7fe4bc108b10 2024-09-21T04:03:57.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.150+0000 7fe4c29a2640 1 -- 172.21.15.46:0/1112368956 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4bc1a65d0 con 0x7fe4bc108b10 2024-09-21T04:03:57.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.150+0000 7fe4b2ffd640 1 -- 172.21.15.46:0/1112368956 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b402f950 con 0x7fe4bc108b10 2024-09-21T04:03:57.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.150+0000 7fe4c29a2640 1 -- 172.21.15.46:0/1112368956 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4bc1a6b10 con 0x7fe4bc108b10 2024-09-21T04:03:57.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.153+0000 7fe4ca178740 1 Processor -- start 2024-09-21T04:03:57.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.153+0000 7fe4b2ffd640 1 -- 172.21.15.46:0/1112368956 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7fe4b402fb50 con 0x7fe4bc108b10 2024-09-21T04:03:57.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.153+0000 7fe4ca178740 1 -- start start 2024-09-21T04:03:57.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.154+0000 7fe4ca178740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557e5ee17070 0x557e5f1be810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:57.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.154+0000 7fe4ca178740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e5edee1b0 0x557e5f1bed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:57.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.154+0000 7fe4ca178740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e5edf6390 0x557e5f1bf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:57.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.154+0000 7fe4ca178740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x557e5f134e50 con 0x557e5ee17070 2024-09-21T04:03:57.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.154+0000 7fe4ca178740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x557e5f124280 con 0x557e5edee1b0 2024-09-21T04:03:57.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.154+0000 7fe4ca178740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557e5f128090 con 0x557e5edf6390 2024-09-21T04:03:57.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.154+0000 7fe4c119f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557e5ee17070 0x557e5f1be810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:57.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.154+0000 7fe4c119f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557e5ee17070 0x557e5f1be810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52510/0 (socket says 172.21.15.46:52510) 2024-09-21T04:03:57.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.154+0000 7fe4c119f640 1 -- 172.21.15.46:0/2546031700 learned_addr learned my addr 172.21.15.46:0/2546031700 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:03:57.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.154+0000 7fe4c119f640 1 -- 172.21.15.46:0/2546031700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e5edf6390 msgr2=0x557e5f1bf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:57.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.154+0000 7fe4c119f640 1 --2- 172.21.15.46:0/2546031700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e5edf6390 0x557e5f1bf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:57.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.154+0000 7fe4c119f640 1 -- 172.21.15.46:0/2546031700 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e5edee1b0 msgr2=0x557e5f1bed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:57.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.154+0000 7fe4c119f640 1 --2- 172.21.15.46:0/2546031700 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e5edee1b0 0x557e5f1bed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:57.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.154+0000 7fe4c119f640 1 -- 172.21.15.46:0/2546031700 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e5ee82650 con 0x557e5ee17070 2024-09-21T04:03:57.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.154+0000 7fe4b2ffd640 1 --2- 172.21.15.46:0/1112368956 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe4a80b6680 0x7fe4a80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:57.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.154+0000 7fe4c19a0640 1 --2- 172.21.15.46:0/1112368956 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe4a80b6680 0x7fe4a80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:57.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.154+0000 7fe4c119f640 1 --2- 172.21.15.46:0/2546031700 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557e5ee17070 0x557e5f1be810 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac009cd0 tx=0x7fe4ac013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7080bdf667302a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:57.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.154+0000 7fe4b2ffd640 1 -- 172.21.15.46:0/1112368956 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7fe4b4108800 con 0x7fe4bc108b10 2024-09-21T04:03:57.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.154+0000 7fe4a7fff640 1 -- 172.21.15.46:0/2546031700 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac004050 con 0x557e5ee17070 2024-09-21T04:03:57.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.155+0000 7fe4a7fff640 1 -- 172.21.15.46:0/2546031700 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4ac017030 con 0x557e5ee17070 2024-09-21T04:03:57.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.155+0000 7fe4a7fff640 1 -- 172.21.15.46:0/2546031700 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac010430 con 0x557e5ee17070 2024-09-21T04:03:57.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.155+0000 7fe4ca178740 1 -- 172.21.15.46:0/2546031700 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557e5ee17070 msgr2=0x557e5f1be810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:57.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.155+0000 7fe4c19a0640 1 --2- 172.21.15.46:0/1112368956 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe4a80b6680 0x7fe4a80b8b90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x557e5f1bd490 tx=0x7fe4b8009c50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:57.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.155+0000 7fe4ca178740 1 --2- 172.21.15.46:0/2546031700 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557e5ee17070 0x557e5f1be810 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac009cd0 tx=0x7fe4ac013830 comp rx=0 tx=0).stop 2024-09-21T04:03:57.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.155+0000 7fe4ca178740 1 -- 172.21.15.46:0/2546031700 shutdown_connections 2024-09-21T04:03:57.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.155+0000 7fe4ca178740 1 --2- 172.21.15.46:0/2546031700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e5edf6390 0x557e5f1bf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:57.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.155+0000 7fe4ca178740 1 --2- 172.21.15.46:0/2546031700 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e5edee1b0 0x557e5f1bed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:57.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.156+0000 7fe4ca178740 1 --2- 172.21.15.46:0/2546031700 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557e5ee17070 0x557e5f1be810 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:57.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.156+0000 7fe4ca178740 1 -- 172.21.15.46:0/2546031700 >> 172.21.15.46:0/2546031700 conn(0x557e5ee0b460 msgr2=0x557e5f1bc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:57.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.156+0000 7fe4ca178740 1 -- 172.21.15.46:0/2546031700 shutdown_connections 2024-09-21T04:03:57.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.156+0000 7fe4ca178740 1 -- 172.21.15.46:0/2546031700 wait complete. 2024-09-21T04:03:57.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.156+0000 7fe4ca178740 1 -- start start 2024-09-21T04:03:57.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.156+0000 7fe4ca178740 1 Processor -- start 2024-09-21T04:03:57.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.157+0000 7fe4ca178740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557e5edee1b0 0x557e5f1c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:57.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.157+0000 7fe4ca178740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e5edf6390 0x557e5f1ca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:57.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.157+0000 7fe4ca178740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e5ee17070 0x557e5f1d62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:57.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.157+0000 7fe4ca178740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x557e5ef85700 con 0x557e5edee1b0 2024-09-21T04:03:57.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.157+0000 7fe4ca178740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x557e5f0bf110 con 0x557e5ee17070 2024-09-21T04:03:57.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.157+0000 7fe4ca178740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557e5f1ccff0 con 0x557e5edf6390 2024-09-21T04:03:57.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.157+0000 7fe4ca178740 10 client.0 _ll_register_callbacks cb 0x557e5f0d8990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:03:57.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.157+0000 7fe4c19a0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557e5edee1b0 0x557e5f1c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:57.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.157+0000 7fe4c19a0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557e5edee1b0 0x557e5f1c9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52524/0 (socket says 172.21.15.46:52524) 2024-09-21T04:03:57.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.157+0000 7fe4c19a0640 1 -- 172.21.15.46:0/995651263 learned_addr learned my addr 172.21.15.46:0/995651263 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:03:57.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.157+0000 7fe4c119f640 1 --2- 172.21.15.46:0/995651263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e5edf6390 0x557e5f1ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:57.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.157+0000 7fe4c21a1640 1 --2- 172.21.15.46:0/995651263 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e5ee17070 0x557e5f1d62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:57.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.157+0000 7fe4c19a0640 1 -- 172.21.15.46:0/995651263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e5edf6390 msgr2=0x557e5f1ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:57.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.157+0000 7fe4c19a0640 1 --2- 172.21.15.46:0/995651263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e5edf6390 0x557e5f1ca440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:57.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.157+0000 7fe4c19a0640 1 -- 172.21.15.46:0/995651263 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e5ee17070 msgr2=0x557e5f1d62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:57.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.157+0000 7fe4c19a0640 1 --2- 172.21.15.46:0/995651263 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e5ee17070 0x557e5f1d62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:57.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.157+0000 7fe4c19a0640 1 -- 172.21.15.46:0/995651263 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e5f0ecc40 con 0x557e5edee1b0 2024-09-21T04:03:57.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.157+0000 7fe4c19a0640 1 --2- 172.21.15.46:0/995651263 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557e5edee1b0 0x557e5f1c9f00 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fe4b80037b0 tx=0x7fe4b8005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a2d5d5c27e569df server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:57.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.157+0000 7fe4a57fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:03:57.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.158+0000 7fe4a57fa640 1 -- 172.21.15.46:0/995651263 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b801dac0 con 0x557e5edee1b0 2024-09-21T04:03:57.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.158+0000 7fe4ca178740 1 -- 172.21.15.46:0/995651263 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4ac017030 con 0x557e5edee1b0 2024-09-21T04:03:57.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.158+0000 7fe4a57fa640 1 -- 172.21.15.46:0/995651263 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7fe4b801dc60 con 0x557e5edee1b0 2024-09-21T04:03:57.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.158+0000 7fe4a57fa640 1 -- 172.21.15.46:0/995651263 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe4b801e430 con 0x557e5edee1b0 2024-09-21T04:03:57.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.158+0000 7fe4ca178740 10 client.16701 fetch_fsmap learned FSMap version 20 2024-09-21T04:03:57.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.158+0000 7fe4ca178740 1 -- 172.21.15.46:0/995651263 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557e5f1dd140 con 0x557e5edee1b0 2024-09-21T04:03:57.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.158+0000 7fe4a57fa640 1 -- 172.21.15.46:0/995651263 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4ac017030 con 0x557e5edee1b0 2024-09-21T04:03:57.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.158+0000 7fe4a57fa640 1 -- 172.21.15.46:0/995651263 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fe4b802e030 con 0x557e5edee1b0 2024-09-21T04:03:57.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.158+0000 7fe4ca178740 10 client.16701 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:03:57.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.158+0000 7fe4ca178740 10 client.16701 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:03:57.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.158+0000 7fe4ca178740 20 client.16701 populate_metadata read hostname 'smithi046' 2024-09-21T04:03:57.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.159+0000 7fe4ca178740 1 --2- 172.21.15.46:0/995651263 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x557e5edd59f0 0x557e5f1e06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:57.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.159+0000 7fe4ca178740 4 client.16701 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:03:57.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.159+0000 7fe4ca178740 1 -- 172.21.15.46:0/995651263 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e5f136da0 con 0x557e5edd59f0 2024-09-21T04:03:57.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.159+0000 7fe4c119f640 1 --2- 172.21.15.46:0/995651263 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x557e5edd59f0 0x557e5f1e06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:57.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.159+0000 7fe4c119f640 1 --2- 172.21.15.46:0/995651263 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x557e5edd59f0 0x557e5f1e06a0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6accf887c26ee376 server_cookie=6f9ddf328cdb16d5 in_seq=0 out_seq=0 2024-09-21T04:03:57.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.159+0000 7fe4a57fa640 10 client.16701 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:03:57.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.160+0000 7fe4a57fa640 1 -- 172.21.15.46:0/995651263 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557e5f136da0 con 0x557e5edd59f0 2024-09-21T04:03:57.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.160+0000 7fe4a57fa640 10 client.16701 handle_command_reply: tid=0 2024-09-21T04:03:57.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.160+0000 7fe4ca178740 1 client.16701 shutdown 2024-09-21T04:03:57.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.160+0000 7fe4ca178740 1 -- 172.21.15.46:0/995651263 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557e5edee1b0 msgr2=0x557e5f1c9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:57.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.160+0000 7fe4ca178740 1 --2- 172.21.15.46:0/995651263 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557e5edee1b0 0x557e5f1c9f00 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fe4b80037b0 tx=0x7fe4b8005f90 comp rx=0 tx=0).stop 2024-09-21T04:03:57.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.160+0000 7fe4ca178740 1 -- 172.21.15.46:0/995651263 shutdown_connections 2024-09-21T04:03:57.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.160+0000 7fe4ca178740 1 --2- 172.21.15.46:0/995651263 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x557e5edd59f0 0x557e5f1e06a0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:57.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.160+0000 7fe4ca178740 1 --2- 172.21.15.46:0/995651263 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e5ee17070 0x557e5f1d62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:57.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.160+0000 7fe4ca178740 1 --2- 172.21.15.46:0/995651263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e5edf6390 0x557e5f1ca440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:57.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.160+0000 7fe4a57fa640 0 client.16701 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:03:57.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.160+0000 7fe4ca178740 1 --2- 172.21.15.46:0/995651263 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557e5edee1b0 0x557e5f1c9f00 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:57.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.160+0000 7fe4ca178740 1 -- 172.21.15.46:0/995651263 >> 172.21.15.46:0/995651263 conn(0x557e5ee0b460 msgr2=0x557e5f1c19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:57.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.161+0000 7fe4ca178740 1 -- 172.21.15.46:0/995651263 shutdown_connections 2024-09-21T04:03:57.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.161+0000 7fe4ca178740 1 -- 172.21.15.46:0/995651263 wait complete. 2024-09-21T04:03:57.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.161+0000 7fe4ca178740 20 client.16701 trim_cache size 0 max 16384 2024-09-21T04:03:57.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.178+0000 7fe4ca178740 1 Processor -- start 2024-09-21T04:03:57.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.178+0000 7fe4ca178740 1 -- start start 2024-09-21T04:03:57.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.178+0000 7fe4ca178740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e5edee1b0 0x557e5f1ca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:57.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.178+0000 7fe4ca178740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557e5edf6390 0x557e5f1c1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:57.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.178+0000 7fe4ca178740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e5ee17070 0x557e5f1c1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:57.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.178+0000 7fe4ca178740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe4bc1ab110 con 0x557e5edf6390 2024-09-21T04:03:57.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.178+0000 7fe4ca178740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe4bc1ad970 con 0x557e5ee17070 2024-09-21T04:03:57.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.178+0000 7fe4ca178740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe4bc1ab760 con 0x557e5edee1b0 2024-09-21T04:03:57.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.179+0000 7fe4c119f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557e5edf6390 0x557e5f1c1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:57.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.179+0000 7fe4c119f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557e5edf6390 0x557e5f1c1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52526/0 (socket says 172.21.15.46:52526) 2024-09-21T04:03:57.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.179+0000 7fe4c119f640 1 -- 172.21.15.46:0/2327377305 learned_addr learned my addr 172.21.15.46:0/2327377305 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:03:57.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.179+0000 7fe4c21a1640 1 --2- 172.21.15.46:0/2327377305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e5ee17070 0x557e5f1c1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:57.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.179+0000 7fe4c19a0640 1 --2- 172.21.15.46:0/2327377305 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e5edee1b0 0x557e5f1ca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:57.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.179+0000 7fe4c119f640 1 -- 172.21.15.46:0/2327377305 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e5edee1b0 msgr2=0x557e5f1ca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:57.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.179+0000 7fe4c119f640 1 --2- 172.21.15.46:0/2327377305 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e5edee1b0 0x557e5f1ca3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:57.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.179+0000 7fe4c119f640 1 -- 172.21.15.46:0/2327377305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e5ee17070 msgr2=0x557e5f1c1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:57.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.179+0000 7fe4c119f640 1 --2- 172.21.15.46:0/2327377305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e5ee17070 0x557e5f1c1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:57.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.179+0000 7fe4c119f640 1 -- 172.21.15.46:0/2327377305 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e5f1c0f60 con 0x557e5edf6390 2024-09-21T04:03:57.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.179+0000 7fe4c119f640 1 --2- 172.21.15.46:0/2327377305 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557e5edf6390 0x557e5f1c1910 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac009250 tx=0x7fe4ac003830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40e44ed3968ef92 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:57.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.179+0000 7fe4a77fe640 1 -- 172.21.15.46:0/2327377305 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac0038a0 con 0x557e5edf6390 2024-09-21T04:03:57.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.179+0000 7fe4a77fe640 1 -- 172.21.15.46:0/2327377305 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4ac017070 con 0x557e5edf6390 2024-09-21T04:03:57.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.179+0000 7fe4a77fe640 1 -- 172.21.15.46:0/2327377305 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac0040e0 con 0x557e5edf6390 2024-09-21T04:03:57.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.180+0000 7fe4ca178740 1 -- 172.21.15.46:0/2327377305 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557e5edf6390 msgr2=0x557e5f1c1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:57.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.180+0000 7fe4ca178740 1 --2- 172.21.15.46:0/2327377305 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557e5edf6390 0x557e5f1c1910 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac009250 tx=0x7fe4ac003830 comp rx=0 tx=0).stop 2024-09-21T04:03:57.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.180+0000 7fe4ca178740 1 -- 172.21.15.46:0/2327377305 shutdown_connections 2024-09-21T04:03:57.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.180+0000 7fe4ca178740 1 --2- 172.21.15.46:0/2327377305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e5ee17070 0x557e5f1c1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:57.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.180+0000 7fe4ca178740 1 --2- 172.21.15.46:0/2327377305 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557e5edf6390 0x557e5f1c1910 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:57.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.180+0000 7fe4ca178740 1 --2- 172.21.15.46:0/2327377305 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e5edee1b0 0x557e5f1ca3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:57.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.180+0000 7fe4ca178740 1 -- 172.21.15.46:0/2327377305 >> 172.21.15.46:0/2327377305 conn(0x557e5ee0b460 msgr2=0x557e5f1c9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:57.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.180+0000 7fe4ca178740 1 -- 172.21.15.46:0/2327377305 shutdown_connections 2024-09-21T04:03:57.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.180+0000 7fe4ca178740 1 -- 172.21.15.46:0/2327377305 wait complete. 2024-09-21T04:03:57.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.180+0000 7fe4ca178740 1 -- start start 2024-09-21T04:03:57.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.181+0000 7fe4ca178740 1 Processor -- start 2024-09-21T04:03:57.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.181+0000 7fe4ca178740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557e5edee1b0 0x557e5f1ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:57.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.181+0000 7fe4ca178740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e5edf6390 0x557e5f1ce6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:57.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.181+0000 7fe4ca178740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e5ee17070 0x557e5f1cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:57.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.181+0000 7fe4ca178740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe4bc1abe30 con 0x557e5edee1b0 2024-09-21T04:03:57.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.181+0000 7fe4ca178740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe4bc1ad2a0 con 0x557e5ee17070 2024-09-21T04:03:57.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.181+0000 7fe4ca178740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe4bc1ac500 con 0x557e5edf6390 2024-09-21T04:03:57.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.181+0000 7fe4ca178740 10 client.0 _ll_register_callbacks cb 0x7fe4b8004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:03:57.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.181+0000 7fe4c19a0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557e5edee1b0 0x557e5f1ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:57.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.181+0000 7fe4c19a0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557e5edee1b0 0x557e5f1ce1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52532/0 (socket says 172.21.15.46:52532) 2024-09-21T04:03:57.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.181+0000 7fe4c19a0640 1 -- 172.21.15.46:0/1890432410 learned_addr learned my addr 172.21.15.46:0/1890432410 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:03:57.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.181+0000 7fe4c119f640 1 --2- 172.21.15.46:0/1890432410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e5edf6390 0x557e5f1ce6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:57.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.181+0000 7fe4c21a1640 1 --2- 172.21.15.46:0/1890432410 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e5ee17070 0x557e5f1cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:57.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.182+0000 7fe4c19a0640 1 -- 172.21.15.46:0/1890432410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e5edf6390 msgr2=0x557e5f1ce6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:57.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.182+0000 7fe4c19a0640 1 --2- 172.21.15.46:0/1890432410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e5edf6390 0x557e5f1ce6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:57.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.182+0000 7fe4c19a0640 1 -- 172.21.15.46:0/1890432410 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e5ee17070 msgr2=0x557e5f1cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:57.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.182+0000 7fe4c19a0640 1 --2- 172.21.15.46:0/1890432410 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e5ee17070 0x557e5f1cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:57.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.182+0000 7fe4c19a0640 1 -- 172.21.15.46:0/1890432410 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e5f24a0a0 con 0x557e5edee1b0 2024-09-21T04:03:57.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.182+0000 7fe4c21a1640 1 --2- 172.21.15.46:0/1890432410 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e5ee17070 0x557e5f1cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:03:57.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.182+0000 7fe4c19a0640 1 --2- 172.21.15.46:0/1890432410 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557e5edee1b0 0x557e5f1ce1a0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8011e20 tx=0x7fe4b801bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aae35184386ed8a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:57.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.182+0000 7fe4a57fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:03:57.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.182+0000 7fe4a57fa640 1 -- 172.21.15.46:0/1890432410 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b8005450 con 0x557e5edee1b0 2024-09-21T04:03:57.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.182+0000 7fe4a57fa640 1 -- 172.21.15.46:0/1890432410 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7fe4b801d790 con 0x557e5edee1b0 2024-09-21T04:03:57.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.182+0000 7fe4ca178740 1 -- 172.21.15.46:0/1890432410 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4ac017070 con 0x557e5edee1b0 2024-09-21T04:03:57.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.182+0000 7fe4a57fa640 1 -- 172.21.15.46:0/1890432410 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe4b80055f0 con 0x557e5edee1b0 2024-09-21T04:03:57.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.182+0000 7fe4ca178740 10 client.16707 fetch_fsmap learned FSMap version 20 2024-09-21T04:03:57.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.182+0000 7fe4ca178740 1 -- 172.21.15.46:0/1890432410 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557e5f24b290 con 0x557e5edee1b0 2024-09-21T04:03:57.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.182+0000 7fe4a57fa640 1 -- 172.21.15.46:0/1890432410 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4ac017070 con 0x557e5edee1b0 2024-09-21T04:03:57.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.183+0000 7fe4a57fa640 1 -- 172.21.15.46:0/1890432410 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fe4b802e040 con 0x557e5edee1b0 2024-09-21T04:03:57.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.183+0000 7fe4ca178740 10 client.16707 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:03:57.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.183+0000 7fe4ca178740 10 client.16707 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:03:57.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.183+0000 7fe4ca178740 20 client.16707 populate_metadata read hostname 'smithi046' 2024-09-21T04:03:57.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.183+0000 7fe4ca178740 1 --2- 172.21.15.46:0/1890432410 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x557e5edaada0 0x557e5f24dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:57.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.183+0000 7fe4ca178740 4 client.16707 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T04:03:57.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.183+0000 7fe4ca178740 1 -- 172.21.15.46:0/1890432410 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557e5f132850 con 0x557e5edaada0 2024-09-21T04:03:57.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.183+0000 7fe4c119f640 1 --2- 172.21.15.46:0/1890432410 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x557e5edaada0 0x557e5f24dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:57.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.183+0000 7fe4a57fa640 10 client.16707 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:03:57.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.183+0000 7fe4c119f640 1 --2- 172.21.15.46:0/1890432410 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x557e5edaada0 0x557e5f24dad0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=677ab3fe3394b3cf server_cookie=720361c0b0018056 in_seq=0 out_seq=0 2024-09-21T04:03:57.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.184+0000 7fe4a57fa640 1 -- 172.21.15.46:0/1890432410 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4918 (crc 0 0 0) 0x557e5f132850 con 0x557e5edaada0 2024-09-21T04:03:57.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.184+0000 7fe4a57fa640 10 client.16707 handle_command_reply: tid=0 2024-09-21T04:03:57.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.184+0000 7fe4ca178740 1 client.16707 shutdown 2024-09-21T04:03:57.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.184+0000 7fe4ca178740 1 -- 172.21.15.46:0/1890432410 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557e5edee1b0 msgr2=0x557e5f1ce1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:57.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.184+0000 7fe4ca178740 1 --2- 172.21.15.46:0/1890432410 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557e5edee1b0 0x557e5f1ce1a0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8011e20 tx=0x7fe4b801bad0 comp rx=0 tx=0).stop 2024-09-21T04:03:57.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.184+0000 7fe4ca178740 1 -- 172.21.15.46:0/1890432410 shutdown_connections 2024-09-21T04:03:57.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.184+0000 7fe4ca178740 1 --2- 172.21.15.46:0/1890432410 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x557e5edaada0 0x557e5f24dad0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:57.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.184+0000 7fe4ca178740 1 --2- 172.21.15.46:0/1890432410 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557e5ee17070 0x557e5f1cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:57.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.184+0000 7fe4ca178740 1 --2- 172.21.15.46:0/1890432410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557e5edf6390 0x557e5f1ce6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:57.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.184+0000 7fe4ca178740 1 --2- 172.21.15.46:0/1890432410 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557e5edee1b0 0x557e5f1ce1a0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:57.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.184+0000 7fe4a57fa640 0 client.16707 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:03:57.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.184+0000 7fe4ca178740 1 -- 172.21.15.46:0/1890432410 >> 172.21.15.46:0/1890432410 conn(0x557e5ee0b460 msgr2=0x557e5f1c1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:57.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.184+0000 7fe4ca178740 1 -- 172.21.15.46:0/1890432410 shutdown_connections 2024-09-21T04:03:57.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.184+0000 7fe4ca178740 1 -- 172.21.15.46:0/1890432410 wait complete. 2024-09-21T04:03:57.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.184+0000 7fe4ca178740 20 client.16707 trim_cache size 0 max 16384 2024-09-21T04:03:57.191 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T04:03:57.192 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "no active scrubs running", 2024-09-21T04:03:57.192 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": {}, 2024-09-21T04:03:57.192 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_stats": { 2024-09-21T04:03:57.192 INFO:teuthology.orchestra.run.smithi046.stdout: "cfba6404-dc3f-4ad2-b873-926d5f9007de": { 2024-09-21T04:03:57.192 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:03:23.788611+0000", 2024-09-21T04:03:57.192 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:57.192 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:57.192 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:57.192 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:57.192 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:57.192 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:57.192 INFO:teuthology.orchestra.run.smithi046.stdout: "96aa13fd-aa77-46b5-b20e-a9b203dc7a94": { 2024-09-21T04:03:57.193 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:02:44.727411+0000", 2024-09-21T04:03:57.193 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:57.193 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:57.193 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:57.193 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:57.193 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:57.193 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:57.193 INFO:teuthology.orchestra.run.smithi046.stdout: "64865e31-a445-43e8-9fa3-26fae089b973": { 2024-09-21T04:03:57.193 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:02:37.376562+0000", 2024-09-21T04:03:57.193 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:57.193 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:57.193 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:57.193 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:57.193 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:57.194 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:57.194 INFO:teuthology.orchestra.run.smithi046.stdout: "7a3afabe-6b27-4bce-928a-8c6773a85803": { 2024-09-21T04:03:57.194 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:01:58.413358+0000", 2024-09-21T04:03:57.194 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:57.194 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:57.194 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:57.194 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:57.194 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:57.194 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:57.194 INFO:teuthology.orchestra.run.smithi046.stdout: "08f0c962-df1a-4129-a1a2-b916240d9803": { 2024-09-21T04:03:57.194 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:02.937596+0000", 2024-09-21T04:03:57.194 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:57.194 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:57.195 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:57.195 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:57.195 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:57.195 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:57.195 INFO:teuthology.orchestra.run.smithi046.stdout: "d49f33a7-3d5a-421b-94ba-8b19a4120db1": { 2024-09-21T04:03:57.195 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:50.480786+0000", 2024-09-21T04:03:57.195 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:57.195 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:57.195 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:57.195 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:57.195 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:57.195 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:57.195 INFO:teuthology.orchestra.run.smithi046.stdout: "a871f724-0198-493c-b03e-b2de78aba243": { 2024-09-21T04:03:57.196 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:56:30.082991+0000", 2024-09-21T04:03:57.196 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:57.196 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:57.196 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:57.196 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:57.196 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:57.196 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:57.196 INFO:teuthology.orchestra.run.smithi046.stdout: "edc4b8c7-b702-489d-a925-ae7ad0ff0d9a": { 2024-09-21T04:03:57.196 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:00:40.181950+0000", 2024-09-21T04:03:57.196 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:57.196 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:57.196 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:57.196 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:57.196 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:57.197 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:57.197 INFO:teuthology.orchestra.run.smithi046.stdout: "3bbf7097-70d7-4743-bbce-41465502b35b": { 2024-09-21T04:03:57.197 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:10.661441+0000", 2024-09-21T04:03:57.197 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:57.197 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:57.197 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:57.197 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:57.197 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:57.197 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:57.197 INFO:teuthology.orchestra.run.smithi046.stdout: "e24ec8f1-0d13-478f-9c2c-b51798868ffc": { 2024-09-21T04:03:57.197 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:09.736194+0000", 2024-09-21T04:03:57.197 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:57.197 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:57.197 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:57.198 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:57.198 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:57.198 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:57.198 INFO:teuthology.orchestra.run.smithi046.stdout: "c47f458a-de5e-4952-a575-a81261953667": { 2024-09-21T04:03:57.198 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:48.699411+0000", 2024-09-21T04:03:57.198 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:57.198 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:57.198 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:57.198 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:57.198 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:57.198 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:57.198 INFO:teuthology.orchestra.run.smithi046.stdout: "6103c660-8e77-4b06-ad6c-bb322c26035a": { 2024-09-21T04:03:57.198 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:35.594467+0000", 2024-09-21T04:03:57.199 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:57.199 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:57.199 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:57.199 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:57.199 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:57.199 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:57.199 INFO:teuthology.orchestra.run.smithi046.stdout: "46bb5415-6e16-47c6-a1e4-55f9c623ce90": { 2024-09-21T04:03:57.199 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:14.950674+0000", 2024-09-21T04:03:57.199 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:57.199 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:57.199 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:57.199 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:57.199 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:57.199 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:57.199 INFO:teuthology.orchestra.run.smithi046.stdout: "326aaecf-f38a-4946-988a-d83f25556995": { 2024-09-21T04:03:57.200 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:54.189884+0000", 2024-09-21T04:03:57.200 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:57.200 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:57.200 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:57.200 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:57.200 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:57.200 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:57.200 INFO:teuthology.orchestra.run.smithi046.stdout: "dab67652-8894-4711-be64-cbdfea27a9ba": { 2024-09-21T04:03:57.200 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:28.161616+0000", 2024-09-21T04:03:57.200 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:57.200 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:57.200 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:57.200 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:57.200 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:57.201 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:57.201 INFO:teuthology.orchestra.run.smithi046.stdout: "0d781b95-cf5e-46f2-9875-2923181385e2": { 2024-09-21T04:03:57.201 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:00:33.099094+0000", 2024-09-21T04:03:57.201 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:57.201 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:57.201 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:57.201 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:57.201 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:57.201 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:03:57.201 INFO:teuthology.orchestra.run.smithi046.stdout: "d7634007-e881-46f7-9833-ac9bd0a3100e": { 2024-09-21T04:03:57.201 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:01:19.459151+0000", 2024-09-21T04:03:57.201 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:03:57.201 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:03:57.202 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:03:57.202 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:03:57.202 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:03:57.202 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:03:57.202 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:03:57.202 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T04:03:57.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.185+0000 7fe4c29a2640 1 -- 172.21.15.46:0/1112368956 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe4a80b6680 msgr2=0x7fe4a80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:57.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.185+0000 7fe4c29a2640 1 --2- 172.21.15.46:0/1112368956 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe4a80b6680 0x7fe4a80b8b90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x557e5f1bd490 tx=0x7fe4b8009c50 comp rx=0 tx=0).stop 2024-09-21T04:03:57.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.185+0000 7fe4c29a2640 1 -- 172.21.15.46:0/1112368956 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4bc108b10 msgr2=0x7fe4bc19bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:57.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.185+0000 7fe4c29a2640 1 --2- 172.21.15.46:0/1112368956 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4bc108b10 0x7fe4bc19bab0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4005cc0 tx=0x7fe4b4031700 comp rx=0 tx=0).stop 2024-09-21T04:03:57.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.185+0000 7fe4c29a2640 1 -- 172.21.15.46:0/1112368956 shutdown_connections 2024-09-21T04:03:57.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.185+0000 7fe4c29a2640 1 --2- 172.21.15.46:0/1112368956 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe4bc108b10 0x7fe4bc19bab0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:57.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.185+0000 7fe4c29a2640 1 --2- 172.21.15.46:0/1112368956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4bc1081c0 0x7fe4bc19b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:57.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.185+0000 7fe4c29a2640 1 --2- 172.21.15.46:0/1112368956 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe4a80b6680 0x7fe4a80b8b90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:57.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.185+0000 7fe4c29a2640 1 --2- 172.21.15.46:0/1112368956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4bc102880 0x7fe4bc19b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:57.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.185+0000 7fe4c29a2640 1 -- 172.21.15.46:0/1112368956 >> 172.21.15.46:0/1112368956 conn(0x7fe4bc0fe2d0 msgr2=0x7fe4bc1006f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:57.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.185+0000 7fe4c29a2640 1 -- 172.21.15.46:0/1112368956 shutdown_connections 2024-09-21T04:03:57.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:57.185+0000 7fe4c29a2640 1 -- 172.21.15.46:0/1112368956 wait complete. 2024-09-21T04:03:58.094 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:57 smithi046 ceph-mon[30954]: pgmap v591: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:03:58.124 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T04:03:58.124 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:03:58.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:57 smithi105 ceph-mon[34773]: pgmap v591: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:03:58.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:57 smithi162 ceph-mon[35071]: pgmap v591: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:03:58.383 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:03:58.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.828+0000 7f5918fa0640 1 -- 172.21.15.46:0/999177529 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59141083a0 msgr2=0x7f59141087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:58.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.828+0000 7f5918fa0640 1 --2- 172.21.15.46:0/999177529 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59141083a0 0x7f59141087b0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f58fc009900 tx=0x7f58fc02a410 comp rx=0 tx=0).stop 2024-09-21T04:03:58.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.828+0000 7f5918fa0640 1 -- 172.21.15.46:0/999177529 shutdown_connections 2024-09-21T04:03:58.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.828+0000 7f5918fa0640 1 --2- 172.21.15.46:0/999177529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5914108cf0 0x7f591410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:58.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.828+0000 7f5918fa0640 1 --2- 172.21.15.46:0/999177529 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59141083a0 0x7f59141087b0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:58.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.828+0000 7f5918fa0640 1 --2- 172.21.15.46:0/999177529 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5914102a60 0x7f5914102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:58.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.828+0000 7f5918fa0640 1 -- 172.21.15.46:0/999177529 >> 172.21.15.46:0/999177529 conn(0x7f5914079730 msgr2=0x7f5914079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:58.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.829+0000 7f5918fa0640 1 -- 172.21.15.46:0/999177529 shutdown_connections 2024-09-21T04:03:58.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.829+0000 7f5918fa0640 1 -- 172.21.15.46:0/999177529 wait complete. 2024-09-21T04:03:58.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.830+0000 7f5918fa0640 1 Processor -- start 2024-09-21T04:03:58.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.830+0000 7f5918fa0640 1 -- start start 2024-09-21T04:03:58.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.830+0000 7f5918fa0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5914102a60 0x7f591419a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:58.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.830+0000 7f5918fa0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59141083a0 0x7f591419aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:58.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.830+0000 7f5918fa0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5914108cf0 0x7f591419fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:58.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.830+0000 7f5918fa0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f59141129a0 con 0x7f5914108cf0 2024-09-21T04:03:58.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.830+0000 7f5918fa0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5914112820 con 0x7f5914102a60 2024-09-21T04:03:58.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.830+0000 7f5918fa0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5914112b20 con 0x7f59141083a0 2024-09-21T04:03:58.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.830+0000 7f5912d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5914108cf0 0x7f591419fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:58.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.830+0000 7f5912d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5914108cf0 0x7f591419fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52538/0 (socket says 172.21.15.46:52538) 2024-09-21T04:03:58.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.830+0000 7f5912d9d640 1 -- 172.21.15.46:0/2473058593 learned_addr learned my addr 172.21.15.46:0/2473058593 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:03:58.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.830+0000 7f5911d9b640 1 --2- 172.21.15.46:0/2473058593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59141083a0 0x7f591419aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:58.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.830+0000 7f591259c640 1 --2- 172.21.15.46:0/2473058593 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5914102a60 0x7f591419a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:58.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.831+0000 7f5912d9d640 1 -- 172.21.15.46:0/2473058593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59141083a0 msgr2=0x7f591419aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:58.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.831+0000 7f5912d9d640 1 --2- 172.21.15.46:0/2473058593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59141083a0 0x7f591419aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:58.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.831+0000 7f5912d9d640 1 -- 172.21.15.46:0/2473058593 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5914102a60 msgr2=0x7f591419a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:58.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.831+0000 7f5912d9d640 1 --2- 172.21.15.46:0/2473058593 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5914102a60 0x7f591419a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:58.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.831+0000 7f5912d9d640 1 -- 172.21.15.46:0/2473058593 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59141a0450 con 0x7f5914108cf0 2024-09-21T04:03:58.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.831+0000 7f591259c640 1 --2- 172.21.15.46:0/2473058593 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5914102a60 0x7f591419a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:03:58.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.831+0000 7f5912d9d640 1 --2- 172.21.15.46:0/2473058593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5914108cf0 0x7f591419fd20 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f590c00b970 tx=0x7f590c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:58.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.831+0000 7f590b7fe640 1 -- 172.21.15.46:0/2473058593 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590c019070 con 0x7f5914108cf0 2024-09-21T04:03:58.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.831+0000 7f590b7fe640 1 -- 172.21.15.46:0/2473058593 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f590c014440 con 0x7f5914108cf0 2024-09-21T04:03:58.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.831+0000 7f5918fa0640 1 -- 172.21.15.46:0/2473058593 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59141a0740 con 0x7f5914108cf0 2024-09-21T04:03:58.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.831+0000 7f590b7fe640 1 -- 172.21.15.46:0/2473058593 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590c0075d0 con 0x7f5914108cf0 2024-09-21T04:03:58.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.831+0000 7f5918fa0640 1 -- 172.21.15.46:0/2473058593 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59141a6ea0 con 0x7f5914108cf0 2024-09-21T04:03:58.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.832+0000 7f5918fa0640 1 -- 172.21.15.46:0/2473058593 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5914102e70 con 0x7f5914108cf0 2024-09-21T04:03:58.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.834+0000 7f590b7fe640 1 -- 172.21.15.46:0/2473058593 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f590c01c070 con 0x7f5914108cf0 2024-09-21T04:03:58.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.835+0000 7f590b7fe640 1 --2- 172.21.15.46:0/2473058593 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f59000b6680 0x7f59000b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:58.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.835+0000 7f591259c640 1 --2- 172.21.15.46:0/2473058593 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f59000b6680 0x7f59000b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:58.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.835+0000 7f590b7fe640 1 -- 172.21.15.46:0/2473058593 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f590c0e7000 con 0x7f5914108cf0 2024-09-21T04:03:58.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.835+0000 7f591259c640 1 --2- 172.21.15.46:0/2473058593 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f59000b6680 0x7f59000b8b90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f59040058c0 tx=0x7f5904005ec0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:58.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:58.838+0000 7f590b7fe640 1 -- 172.21.15.46:0/2473058593 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f590c0b19a0 con 0x7f5914108cf0 2024-09-21T04:03:59.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:59.062+0000 7f5918fa0640 1 -- 172.21.15.46:0/2473058593 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f591419b610 con 0x7f5914108cf0 2024-09-21T04:03:59.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:59.063+0000 7f590b7fe640 1 -- 172.21.15.46:0/2473058593 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f591419b610 con 0x7f5914108cf0 2024-09-21T04:03:59.066 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T04:03:59.066 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"btime":"2024-09-21T03:53:23:865820+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1766354184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1766354184},{"type":"v1","addr":"172.21.15.46:6839","nonce":1766354184}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/1901774207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":1901774207},{"type":"v1","addr":"172.21.15.46:6841","nonce":1901774207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3548633196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":3548633196},{"type":"v1","addr":"172.21.15.105:6837","nonce":3548633196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24652,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3551934241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3551934241},{"type":"v1","addr":"172.21.15.162:6835","nonce":3551934241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/48949822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":48949822},{"type":"v1","addr":"172.21.15.162:6837","nonce":48949822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:53:14.452819+0000","modified":"2024-09-21T03:53:23.593278+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24680},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/2196053213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2196053213},{"type":"v1","addr":"172.21.15.162:6839","nonce":2196053213}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.105:6839/3911438406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":3911438406},{"type":"v1","addr":"172.21.15.105:6839","nonce":3911438406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24680,"qdb_cluster":[24680]},"id":1}]} 2024-09-21T04:03:59.066 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T04:03:59.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:59.065+0000 7f5918fa0640 1 -- 172.21.15.46:0/2473058593 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f59000b6680 msgr2=0x7f59000b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:59.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:59.065+0000 7f5918fa0640 1 --2- 172.21.15.46:0/2473058593 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f59000b6680 0x7f59000b8b90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f59040058c0 tx=0x7f5904005ec0 comp rx=0 tx=0).stop 2024-09-21T04:03:59.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:59.065+0000 7f5918fa0640 1 -- 172.21.15.46:0/2473058593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5914108cf0 msgr2=0x7f591419fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:59.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:59.065+0000 7f5918fa0640 1 --2- 172.21.15.46:0/2473058593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5914108cf0 0x7f591419fd20 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f590c00b970 tx=0x7f590c00be30 comp rx=0 tx=0).stop 2024-09-21T04:03:59.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:59.065+0000 7f5918fa0640 1 -- 172.21.15.46:0/2473058593 shutdown_connections 2024-09-21T04:03:59.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:59.065+0000 7f5918fa0640 1 --2- 172.21.15.46:0/2473058593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5914108cf0 0x7f591419fd20 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:59.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:59.065+0000 7f5918fa0640 1 --2- 172.21.15.46:0/2473058593 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f59000b6680 0x7f59000b8b90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:59.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:59.065+0000 7f5918fa0640 1 --2- 172.21.15.46:0/2473058593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59141083a0 0x7f591419aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:59.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:59.065+0000 7f5918fa0640 1 --2- 172.21.15.46:0/2473058593 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5914102a60 0x7f591419a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:59.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:59.065+0000 7f5918fa0640 1 -- 172.21.15.46:0/2473058593 >> 172.21.15.46:0/2473058593 conn(0x7f5914079730 msgr2=0x7f591406b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:59.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:59.065+0000 7f5918fa0640 1 -- 172.21.15.46:0/2473058593 shutdown_connections 2024-09-21T04:03:59.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:03:59.065+0000 7f5918fa0640 1 -- 172.21.15.46:0/2473058593 wait complete. 2024-09-21T04:03:59.741 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T04:03:59.998 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:04:00.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:59 smithi046 ceph-mon[30954]: pgmap v592: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:04:00.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:03:59 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/2473058593' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:04:00.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:59 smithi105 ceph-mon[34773]: pgmap v592: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:04:00.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:03:59 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/2473058593' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:04:00.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:59 smithi162 ceph-mon[35071]: pgmap v592: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:04:00.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:03:59 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/2473058593' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:04:00.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.506+0000 7f1de55c8640 1 -- 172.21.15.46:0/3169443299 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1de0102a70 msgr2=0x7f1de0102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:00.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.506+0000 7f1de55c8640 1 --2- 172.21.15.46:0/3169443299 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1de0102a70 0x7f1de0102e80 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0009ca0 tx=0x7f1dd002a8c0 comp rx=0 tx=0).stop 2024-09-21T04:04:00.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.506+0000 7f1de55c8640 1 -- 172.21.15.46:0/3169443299 shutdown_connections 2024-09-21T04:04:00.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.506+0000 7f1de55c8640 1 --2- 172.21.15.46:0/3169443299 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1de0108d00 0x7f1de010f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:00.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.506+0000 7f1de55c8640 1 --2- 172.21.15.46:0/3169443299 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1de01083b0 0x7f1de01087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:00.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.506+0000 7f1de55c8640 1 --2- 172.21.15.46:0/3169443299 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1de0102a70 0x7f1de0102e80 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:00.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.506+0000 7f1de55c8640 1 -- 172.21.15.46:0/3169443299 >> 172.21.15.46:0/3169443299 conn(0x7f1de0079730 msgr2=0x7f1de0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:00.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.506+0000 7f1de55c8640 1 -- 172.21.15.46:0/3169443299 shutdown_connections 2024-09-21T04:04:00.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.506+0000 7f1de55c8640 1 -- 172.21.15.46:0/3169443299 wait complete. 2024-09-21T04:04:00.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.507+0000 7f1de55c8640 1 Processor -- start 2024-09-21T04:04:00.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.507+0000 7f1de55c8640 1 -- start start 2024-09-21T04:04:00.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.507+0000 7f1de55c8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1de0102a70 0x7f1de019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:00.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.507+0000 7f1de55c8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1de01083b0 0x7f1de019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:00.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.508+0000 7f1de55c8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1de0108d00 0x7f1de019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:00.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.508+0000 7f1de55c8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1de01129c0 con 0x7f1de0108d00 2024-09-21T04:04:00.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.508+0000 7f1de55c8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1de0112840 con 0x7f1de01083b0 2024-09-21T04:04:00.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.508+0000 7f1de55c8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1de0112b40 con 0x7f1de0102a70 2024-09-21T04:04:00.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.508+0000 7f1ddf7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1de0108d00 0x7f1de019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:00.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.508+0000 7f1ddf7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1de0108d00 0x7f1de019fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52568/0 (socket says 172.21.15.46:52568) 2024-09-21T04:04:00.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.508+0000 7f1ddf7fe640 1 -- 172.21.15.46:0/1831734985 learned_addr learned my addr 172.21.15.46:0/1831734985 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:00.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.508+0000 7f1dde7fc640 1 --2- 172.21.15.46:0/1831734985 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1de01083b0 0x7f1de019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:00.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.508+0000 7f1ddeffd640 1 --2- 172.21.15.46:0/1831734985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1de0102a70 0x7f1de019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:00.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.508+0000 7f1ddf7fe640 1 -- 172.21.15.46:0/1831734985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1de0102a70 msgr2=0x7f1de019a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:00.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.508+0000 7f1ddf7fe640 1 --2- 172.21.15.46:0/1831734985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1de0102a70 0x7f1de019a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:00.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.508+0000 7f1ddf7fe640 1 -- 172.21.15.46:0/1831734985 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1de01083b0 msgr2=0x7f1de019aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:00.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.508+0000 7f1ddf7fe640 1 --2- 172.21.15.46:0/1831734985 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1de01083b0 0x7f1de019aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:00.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.508+0000 7f1ddf7fe640 1 -- 172.21.15.46:0/1831734985 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1de01a0450 con 0x7f1de0108d00 2024-09-21T04:04:00.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.508+0000 7f1ddf7fe640 1 --2- 172.21.15.46:0/1831734985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1de0108d00 0x7f1de019fd20 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f1dd800d750 tx=0x7f1dd800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:00.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.508+0000 7f1dc7fff640 1 -- 172.21.15.46:0/1831734985 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8017070 con 0x7f1de0108d00 2024-09-21T04:04:00.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.508+0000 7f1de55c8640 1 -- 172.21.15.46:0/1831734985 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1de01a0740 con 0x7f1de0108d00 2024-09-21T04:04:00.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.509+0000 7f1dc7fff640 1 -- 172.21.15.46:0/1831734985 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1dd80054d0 con 0x7f1de0108d00 2024-09-21T04:04:00.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.509+0000 7f1dc7fff640 1 -- 172.21.15.46:0/1831734985 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8004c60 con 0x7f1de0108d00 2024-09-21T04:04:00.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.509+0000 7f1de55c8640 1 -- 172.21.15.46:0/1831734985 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1de01a6ea0 con 0x7f1de0108d00 2024-09-21T04:04:00.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.511+0000 7f1dc7fff640 1 -- 172.21.15.46:0/1831734985 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f1dd8009bd0 con 0x7f1de0108d00 2024-09-21T04:04:00.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.511+0000 7f1debb3c740 1 Processor -- start 2024-09-21T04:04:00.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.512+0000 7f1debb3c740 1 -- start start 2024-09-21T04:04:00.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.512+0000 7f1debb3c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133ecfd070 0x56133f0a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:00.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.512+0000 7f1debb3c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133ecd41b0 0x56133f0a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:00.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.512+0000 7f1debb3c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56133ecdc390 0x56133f0a5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:00.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.512+0000 7f1debb3c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x56133f01aea0 con 0x56133ecdc390 2024-09-21T04:04:00.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.512+0000 7f1debb3c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56133f00a2d0 con 0x56133ecfd070 2024-09-21T04:04:00.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.512+0000 7f1debb3c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56133f00e0e0 con 0x56133ecd41b0 2024-09-21T04:04:00.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.512+0000 7f1dde7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56133ecdc390 0x56133f0a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:00.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.512+0000 7f1dde7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56133ecdc390 0x56133f0a5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52582/0 (socket says 172.21.15.46:52582) 2024-09-21T04:04:00.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.512+0000 7f1dde7fc640 1 -- 172.21.15.46:0/173355773 learned_addr learned my addr 172.21.15.46:0/173355773 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:00.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.512+0000 7f1dde7fc640 1 --2- 172.21.15.46:0/173355773 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133ecfd070 0x56133f0a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:00.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.512+0000 7f1dc7fff640 1 --2- 172.21.15.46:0/1831734985 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f1dc80b6680 0x7f1dc80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:00.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.512+0000 7f1ddeffd640 1 --2- 172.21.15.46:0/173355773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133ecd41b0 0x56133f0a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:00.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.512+0000 7f1dde7fc640 1 -- 172.21.15.46:0/173355773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133ecd41b0 msgr2=0x56133f0a4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:00.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.512+0000 7f1dde7fc640 1 --2- 172.21.15.46:0/173355773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133ecd41b0 0x56133f0a4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:00.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.512+0000 7f1dde7fc640 1 -- 172.21.15.46:0/173355773 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133ecfd070 msgr2=0x56133f0a46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:00.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.512+0000 7f1dde7fc640 1 --2- 172.21.15.46:0/173355773 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133ecfd070 0x56133f0a46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:00.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.512+0000 7f1dde7fc640 1 -- 172.21.15.46:0/173355773 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56133ed68650 con 0x56133ecdc390 2024-09-21T04:04:00.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.513+0000 7f1ddeffd640 1 --2- 172.21.15.46:0/173355773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133ecd41b0 0x56133f0a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:04:00.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.513+0000 7f1dc7fff640 1 -- 172.21.15.46:0/1831734985 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f1dd80e6fb0 con 0x7f1de0108d00 2024-09-21T04:04:00.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.513+0000 7f1ddf7fe640 1 --2- 172.21.15.46:0/1831734985 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f1dc80b6680 0x7f1dc80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:00.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.513+0000 7f1dde7fc640 1 --2- 172.21.15.46:0/173355773 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56133ecdc390 0x56133f0a5120 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4005880 tx=0x7f1dd4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=423bfe8d589b064b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:00.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.513+0000 7f1dc57fa640 1 -- 172.21.15.46:0/173355773 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4012ce0 con 0x56133ecdc390 2024-09-21T04:04:00.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.513+0000 7f1dc57fa640 1 -- 172.21.15.46:0/173355773 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1dd4005020 con 0x56133ecdc390 2024-09-21T04:04:00.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.513+0000 7f1dc57fa640 1 -- 172.21.15.46:0/173355773 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd40044e0 con 0x56133ecdc390 2024-09-21T04:04:00.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.514+0000 7f1debb3c740 1 -- 172.21.15.46:0/173355773 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56133ecdc390 msgr2=0x56133f0a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:00.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.514+0000 7f1debb3c740 1 --2- 172.21.15.46:0/173355773 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56133ecdc390 0x56133f0a5120 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4005880 tx=0x7f1dd4004730 comp rx=0 tx=0).stop 2024-09-21T04:04:00.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.514+0000 7f1ddf7fe640 1 --2- 172.21.15.46:0/1831734985 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f1dc80b6680 0x7f1dc80b8b90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1dd80acbc0 tx=0x7f1dd8005bb0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:00.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.514+0000 7f1debb3c740 1 -- 172.21.15.46:0/173355773 shutdown_connections 2024-09-21T04:04:00.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.514+0000 7f1debb3c740 1 --2- 172.21.15.46:0/173355773 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56133ecdc390 0x56133f0a5120 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:00.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.514+0000 7f1debb3c740 1 --2- 172.21.15.46:0/173355773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133ecd41b0 0x56133f0a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:00.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.514+0000 7f1debb3c740 1 --2- 172.21.15.46:0/173355773 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133ecfd070 0x56133f0a46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:00.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.514+0000 7f1debb3c740 1 -- 172.21.15.46:0/173355773 >> 172.21.15.46:0/173355773 conn(0x56133ecf1460 msgr2=0x56133f0a2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:00.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.514+0000 7f1debb3c740 1 -- 172.21.15.46:0/173355773 shutdown_connections 2024-09-21T04:04:00.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.514+0000 7f1debb3c740 1 -- 172.21.15.46:0/173355773 wait complete. 2024-09-21T04:04:00.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.514+0000 7f1debb3c740 1 -- start start 2024-09-21T04:04:00.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.515+0000 7f1debb3c740 1 Processor -- start 2024-09-21T04:04:00.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.515+0000 7f1debb3c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56133ecd41b0 0x56133f0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:00.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.515+0000 7f1debb3c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133ecdc390 0x56133f0b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:00.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.515+0000 7f1debb3c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133ecfd070 0x56133f0bc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:00.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.515+0000 7f1debb3c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x56133ee6b700 con 0x56133ecd41b0 2024-09-21T04:04:00.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.515+0000 7f1debb3c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56133efa5160 con 0x56133ecfd070 2024-09-21T04:04:00.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.515+0000 7f1debb3c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56133f0b2e80 con 0x56133ecdc390 2024-09-21T04:04:00.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.515+0000 7f1debb3c740 10 client.0 _ll_register_callbacks cb 0x56133efbe9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:04:00.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.515+0000 7f1dde7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56133ecd41b0 0x56133f0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:00.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.515+0000 7f1dde7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56133ecd41b0 0x56133f0afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52588/0 (socket says 172.21.15.46:52588) 2024-09-21T04:04:00.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.515+0000 7f1dde7fc640 1 -- 172.21.15.46:0/2587989762 learned_addr learned my addr 172.21.15.46:0/2587989762 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:00.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.515+0000 7f1ddeffd640 1 --2- 172.21.15.46:0/2587989762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133ecdc390 0x56133f0b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:00.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.515+0000 7f1dde7fc640 1 -- 172.21.15.46:0/2587989762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133ecdc390 msgr2=0x56133f0b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:00.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.515+0000 7f1dde7fc640 1 --2- 172.21.15.46:0/2587989762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133ecdc390 0x56133f0b02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:00.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.515+0000 7f1dde7fc640 1 -- 172.21.15.46:0/2587989762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133ecfd070 msgr2=0x56133f0bc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:00.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.515+0000 7f1dde7fc640 1 --2- 172.21.15.46:0/2587989762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133ecfd070 0x56133f0bc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:00.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.515+0000 7f1dde7fc640 1 -- 172.21.15.46:0/2587989762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56133efd2c90 con 0x56133ecd41b0 2024-09-21T04:04:00.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.516+0000 7f1dde7fc640 1 --2- 172.21.15.46:0/2587989762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56133ecd41b0 0x56133f0afd80 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400bd70 tx=0x7f1dd40051d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e68a72bcfcbfa03f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:00.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.516+0000 7f1dc2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:04:00.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.516+0000 7f1dc2ff5640 1 -- 172.21.15.46:0/2587989762 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4004240 con 0x56133ecd41b0 2024-09-21T04:04:00.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.516+0000 7f1dc2ff5640 1 -- 172.21.15.46:0/2587989762 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f1dd40043e0 con 0x56133ecd41b0 2024-09-21T04:04:00.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.516+0000 7f1debb3c740 1 -- 172.21.15.46:0/2587989762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1dd4005020 con 0x56133ecd41b0 2024-09-21T04:04:00.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.516+0000 7f1dc2ff5640 1 -- 172.21.15.46:0/2587989762 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1dd40047a0 con 0x56133ecd41b0 2024-09-21T04:04:00.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.516+0000 7f1debb3c740 10 client.16725 fetch_fsmap learned FSMap version 20 2024-09-21T04:04:00.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.516+0000 7f1debb3c740 1 -- 172.21.15.46:0/2587989762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56133f0bebc0 con 0x56133ecd41b0 2024-09-21T04:04:00.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.516+0000 7f1dc2ff5640 1 -- 172.21.15.46:0/2587989762 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1dd4005020 con 0x56133ecd41b0 2024-09-21T04:04:00.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.516+0000 7f1dc2ff5640 1 -- 172.21.15.46:0/2587989762 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f1dd402f020 con 0x56133ecd41b0 2024-09-21T04:04:00.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.517+0000 7f1debb3c740 10 client.16725 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:04:00.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.517+0000 7f1debb3c740 10 client.16725 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:04:00.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.517+0000 7f1debb3c740 20 client.16725 populate_metadata read hostname 'smithi046' 2024-09-21T04:04:00.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.517+0000 7f1debb3c740 1 --2- 172.21.15.46:0/2587989762 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56133ecbb9f0 0x56133f0c1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:00.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.517+0000 7f1debb3c740 4 client.16725 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:04:00.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.517+0000 7f1debb3c740 1 -- 172.21.15.46:0/2587989762 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56133f01cdf0 con 0x56133ecbb9f0 2024-09-21T04:04:00.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.517+0000 7f1ddeffd640 1 --2- 172.21.15.46:0/2587989762 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56133ecbb9f0 0x56133f0c1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:00.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.517+0000 7f1ddeffd640 1 --2- 172.21.15.46:0/2587989762 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56133ecbb9f0 0x56133f0c1f20 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=384a9e9474b89177 server_cookie=431806673039da31 in_seq=0 out_seq=0 2024-09-21T04:04:00.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.517+0000 7f1dc2ff5640 10 client.16725 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:00.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.518+0000 7f1dc2ff5640 1 -- 172.21.15.46:0/2587989762 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56133f01cdf0 con 0x56133ecbb9f0 2024-09-21T04:04:00.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.518+0000 7f1dc2ff5640 10 client.16725 handle_command_reply: tid=0 2024-09-21T04:04:00.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.518+0000 7f1debb3c740 1 client.16725 shutdown 2024-09-21T04:04:00.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.518+0000 7f1debb3c740 1 -- 172.21.15.46:0/2587989762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56133ecd41b0 msgr2=0x56133f0afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:00.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.518+0000 7f1debb3c740 1 --2- 172.21.15.46:0/2587989762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56133ecd41b0 0x56133f0afd80 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400bd70 tx=0x7f1dd40051d0 comp rx=0 tx=0).stop 2024-09-21T04:04:00.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.518+0000 7f1debb3c740 1 -- 172.21.15.46:0/2587989762 shutdown_connections 2024-09-21T04:04:00.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.518+0000 7f1debb3c740 1 --2- 172.21.15.46:0/2587989762 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56133ecbb9f0 0x56133f0c1f20 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:00.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.518+0000 7f1debb3c740 1 --2- 172.21.15.46:0/2587989762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133ecfd070 0x56133f0bc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:00.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.518+0000 7f1debb3c740 1 --2- 172.21.15.46:0/2587989762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133ecdc390 0x56133f0b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:00.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.518+0000 7f1debb3c740 1 --2- 172.21.15.46:0/2587989762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56133ecd41b0 0x56133f0afd80 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:00.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.518+0000 7f1debb3c740 1 -- 172.21.15.46:0/2587989762 >> 172.21.15.46:0/2587989762 conn(0x56133ecf1460 msgr2=0x56133f0a7880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:00.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.518+0000 7f1dc2ff5640 0 client.16725 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:00.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.518+0000 7f1debb3c740 1 -- 172.21.15.46:0/2587989762 shutdown_connections 2024-09-21T04:04:00.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.518+0000 7f1debb3c740 1 -- 172.21.15.46:0/2587989762 wait complete. 2024-09-21T04:04:00.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.519+0000 7f1debb3c740 20 client.16725 trim_cache size 0 max 16384 2024-09-21T04:04:00.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.532+0000 7f1debb3c740 1 Processor -- start 2024-09-21T04:04:00.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.532+0000 7f1debb3c740 1 -- start start 2024-09-21T04:04:00.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.532+0000 7f1debb3c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133ecd41b0 0x56133f0b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:00.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.532+0000 7f1debb3c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133ecdc390 0x56133f0a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:00.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.532+0000 7f1debb3c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56133ecfd070 0x56133f0a2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:00.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.532+0000 7f1debb3c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1de01ad580 con 0x56133ecfd070 2024-09-21T04:04:00.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.532+0000 7f1debb3c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1de01afde0 con 0x56133ecdc390 2024-09-21T04:04:00.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.532+0000 7f1debb3c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1de01adbd0 con 0x56133ecd41b0 2024-09-21T04:04:00.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.532+0000 7f1dde7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56133ecfd070 0x56133f0a2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:00.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.532+0000 7f1dde7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56133ecfd070 0x56133f0a2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52598/0 (socket says 172.21.15.46:52598) 2024-09-21T04:04:00.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.532+0000 7f1dde7fc640 1 -- 172.21.15.46:0/3000902549 learned_addr learned my addr 172.21.15.46:0/3000902549 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:00.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.532+0000 7f1ddeffd640 1 --2- 172.21.15.46:0/3000902549 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133ecdc390 0x56133f0a1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:00.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.532+0000 7f1dde7fc640 1 --2- 172.21.15.46:0/3000902549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133ecd41b0 0x56133f0b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:00.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.532+0000 7f1dde7fc640 1 -- 172.21.15.46:0/3000902549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133ecd41b0 msgr2=0x56133f0b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:00.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.532+0000 7f1dde7fc640 1 --2- 172.21.15.46:0/3000902549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133ecd41b0 0x56133f0b0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:00.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.532+0000 7f1dde7fc640 1 -- 172.21.15.46:0/3000902549 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133ecdc390 msgr2=0x56133f0a1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:00.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.532+0000 7f1dde7fc640 1 --2- 172.21.15.46:0/3000902549 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133ecdc390 0x56133f0a1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:00.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.532+0000 7f1dde7fc640 1 -- 172.21.15.46:0/3000902549 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56133f0b0e20 con 0x56133ecfd070 2024-09-21T04:04:00.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.533+0000 7f1dde7fc640 1 --2- 172.21.15.46:0/3000902549 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56133ecfd070 0x56133f0a2100 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4012d20 tx=0x7f1dd4012040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaecea932487c402 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:00.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.533+0000 7f1dc4ff9640 1 -- 172.21.15.46:0/3000902549 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4037030 con 0x56133ecfd070 2024-09-21T04:04:00.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.533+0000 7f1dc4ff9640 1 -- 172.21.15.46:0/3000902549 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1dd4016050 con 0x56133ecfd070 2024-09-21T04:04:00.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.533+0000 7f1dc4ff9640 1 -- 172.21.15.46:0/3000902549 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4004940 con 0x56133ecfd070 2024-09-21T04:04:00.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.534+0000 7f1debb3c740 1 -- 172.21.15.46:0/3000902549 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56133ecfd070 msgr2=0x56133f0a2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:00.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.534+0000 7f1debb3c740 1 --2- 172.21.15.46:0/3000902549 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56133ecfd070 0x56133f0a2100 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4012d20 tx=0x7f1dd4012040 comp rx=0 tx=0).stop 2024-09-21T04:04:00.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.534+0000 7f1debb3c740 1 -- 172.21.15.46:0/3000902549 shutdown_connections 2024-09-21T04:04:00.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.534+0000 7f1debb3c740 1 --2- 172.21.15.46:0/3000902549 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56133ecfd070 0x56133f0a2100 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:00.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.534+0000 7f1debb3c740 1 --2- 172.21.15.46:0/3000902549 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133ecdc390 0x56133f0a1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:00.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.534+0000 7f1debb3c740 1 --2- 172.21.15.46:0/3000902549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133ecd41b0 0x56133f0b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:00.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.534+0000 7f1debb3c740 1 -- 172.21.15.46:0/3000902549 >> 172.21.15.46:0/3000902549 conn(0x56133ecf1460 msgr2=0x56133f0afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:00.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.534+0000 7f1debb3c740 1 -- 172.21.15.46:0/3000902549 shutdown_connections 2024-09-21T04:04:00.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.534+0000 7f1debb3c740 1 -- 172.21.15.46:0/3000902549 wait complete. 2024-09-21T04:04:00.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.534+0000 7f1debb3c740 1 -- start start 2024-09-21T04:04:00.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.534+0000 7f1debb3c740 1 Processor -- start 2024-09-21T04:04:00.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.534+0000 7f1debb3c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56133ecd41b0 0x56133f0b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:00.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.534+0000 7f1debb3c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133ecdc390 0x56133f0b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:00.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.534+0000 7f1debb3c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133ecfd070 0x56133f124800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:00.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.534+0000 7f1debb3c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1de01ae2a0 con 0x56133ecd41b0 2024-09-21T04:04:00.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.534+0000 7f1debb3c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1de01af710 con 0x56133ecdc390 2024-09-21T04:04:00.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.534+0000 7f1debb3c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1de01ae970 con 0x56133ecfd070 2024-09-21T04:04:00.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.534+0000 7f1debb3c740 10 client.0 _ll_register_callbacks cb 0x7f1dd400be80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:04:00.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.535+0000 7f1dde7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56133ecd41b0 0x56133f0b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:00.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.535+0000 7f1dde7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56133ecd41b0 0x56133f0b3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52604/0 (socket says 172.21.15.46:52604) 2024-09-21T04:04:00.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.535+0000 7f1dde7fc640 1 -- 172.21.15.46:0/2841886095 learned_addr learned my addr 172.21.15.46:0/2841886095 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:00.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.535+0000 7f1ddeffd640 1 --2- 172.21.15.46:0/2841886095 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133ecdc390 0x56133f0b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:00.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.535+0000 7f1dde7fc640 1 --2- 172.21.15.46:0/2841886095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133ecfd070 0x56133f124800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:00.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.535+0000 7f1dde7fc640 1 -- 172.21.15.46:0/2841886095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133ecfd070 msgr2=0x56133f124800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:00.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.535+0000 7f1dde7fc640 1 --2- 172.21.15.46:0/2841886095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133ecfd070 0x56133f124800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:00.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.535+0000 7f1dde7fc640 1 -- 172.21.15.46:0/2841886095 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133ecdc390 msgr2=0x56133f0b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:00.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.535+0000 7f1dde7fc640 1 --2- 172.21.15.46:0/2841886095 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133ecdc390 0x56133f0b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:00.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.535+0000 7f1dde7fc640 1 -- 172.21.15.46:0/2841886095 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56133f124e70 con 0x56133ecd41b0 2024-09-21T04:04:00.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.535+0000 7f1ddeffd640 1 --2- 172.21.15.46:0/2841886095 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133ecdc390 0x56133f0b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:04:00.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.535+0000 7f1dde7fc640 1 --2- 172.21.15.46:0/2841886095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56133ecd41b0 0x56133f0b3af0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4010e40 tx=0x7f1dd4005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=326c17a26357b37e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:00.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.535+0000 7f1dc2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:04:00.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.535+0000 7f1dc2ff5640 1 -- 172.21.15.46:0/2841886095 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4037030 con 0x56133ecd41b0 2024-09-21T04:04:00.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.535+0000 7f1dc2ff5640 1 -- 172.21.15.46:0/2841886095 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f1dd40107b0 con 0x56133ecd41b0 2024-09-21T04:04:00.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.535+0000 7f1debb3c740 1 -- 172.21.15.46:0/2841886095 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1dd4016050 con 0x56133ecd41b0 2024-09-21T04:04:00.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.536+0000 7f1dc2ff5640 1 -- 172.21.15.46:0/2841886095 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1dd40109b0 con 0x56133ecd41b0 2024-09-21T04:04:00.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.536+0000 7f1debb3c740 10 client.16731 fetch_fsmap learned FSMap version 20 2024-09-21T04:04:00.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.536+0000 7f1debb3c740 1 -- 172.21.15.46:0/2841886095 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56133f12c1b0 con 0x56133ecd41b0 2024-09-21T04:04:00.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.536+0000 7f1dc2ff5640 1 -- 172.21.15.46:0/2841886095 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1dd4016050 con 0x56133ecd41b0 2024-09-21T04:04:00.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.536+0000 7f1dc2ff5640 1 -- 172.21.15.46:0/2841886095 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f1dd402f030 con 0x56133ecd41b0 2024-09-21T04:04:00.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.536+0000 7f1debb3c740 10 client.16731 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:04:00.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.536+0000 7f1debb3c740 10 client.16731 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:04:00.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.536+0000 7f1debb3c740 20 client.16731 populate_metadata read hostname 'smithi046' 2024-09-21T04:04:00.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.536+0000 7f1debb3c740 1 --2- 172.21.15.46:0/2841886095 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56133ec90da0 0x56133f12e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:00.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.536+0000 7f1debb3c740 4 client.16731 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T04:04:00.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.536+0000 7f1debb3c740 1 -- 172.21.15.46:0/2841886095 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56133f0188a0 con 0x56133ec90da0 2024-09-21T04:04:00.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.536+0000 7f1ddeffd640 1 --2- 172.21.15.46:0/2841886095 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56133ec90da0 0x56133f12e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:00.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.537+0000 7f1ddeffd640 1 --2- 172.21.15.46:0/2841886095 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56133ec90da0 0x56133f12e7d0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e666d639397e6df server_cookie=6b6d46bff8cc69f0 in_seq=0 out_seq=0 2024-09-21T04:04:00.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.537+0000 7f1dc2ff5640 10 client.16731 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:00.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.537+0000 7f1dc2ff5640 1 -- 172.21.15.46:0/2841886095 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56133f0188a0 con 0x56133ec90da0 2024-09-21T04:04:00.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.537+0000 7f1dc2ff5640 10 client.16731 handle_command_reply: tid=0 2024-09-21T04:04:00.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.537+0000 7f1debb3c740 1 client.16731 shutdown 2024-09-21T04:04:00.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.537+0000 7f1debb3c740 1 -- 172.21.15.46:0/2841886095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56133ecd41b0 msgr2=0x56133f0b3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:00.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.537+0000 7f1debb3c740 1 --2- 172.21.15.46:0/2841886095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56133ecd41b0 0x56133f0b3af0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4010e40 tx=0x7f1dd4005f30 comp rx=0 tx=0).stop 2024-09-21T04:04:00.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.537+0000 7f1debb3c740 1 -- 172.21.15.46:0/2841886095 shutdown_connections 2024-09-21T04:04:00.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.537+0000 7f1debb3c740 1 --2- 172.21.15.46:0/2841886095 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x56133ec90da0 0x56133f12e7d0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:00.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.537+0000 7f1debb3c740 1 --2- 172.21.15.46:0/2841886095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56133ecfd070 0x56133f124800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:00.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.537+0000 7f1debb3c740 1 --2- 172.21.15.46:0/2841886095 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133ecdc390 0x56133f0b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:00.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.537+0000 7f1debb3c740 1 --2- 172.21.15.46:0/2841886095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56133ecd41b0 0x56133f0b3af0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:00.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.537+0000 7f1dc2ff5640 0 client.16731 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:00.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.537+0000 7f1debb3c740 1 -- 172.21.15.46:0/2841886095 >> 172.21.15.46:0/2841886095 conn(0x56133ecf1460 msgr2=0x56133f0a56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:00.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.537+0000 7f1debb3c740 1 -- 172.21.15.46:0/2841886095 shutdown_connections 2024-09-21T04:04:00.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.537+0000 7f1debb3c740 1 -- 172.21.15.46:0/2841886095 wait complete. 2024-09-21T04:04:00.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.537+0000 7f1debb3c740 20 client.16731 trim_cache size 0 max 16384 2024-09-21T04:04:00.544 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-21T04:04:00.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.538+0000 7f1de55c8640 1 -- 172.21.15.46:0/1831734985 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f1dc80b6680 msgr2=0x7f1dc80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:00.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.538+0000 7f1de55c8640 1 --2- 172.21.15.46:0/1831734985 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f1dc80b6680 0x7f1dc80b8b90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1dd80acbc0 tx=0x7f1dd8005bb0 comp rx=0 tx=0).stop 2024-09-21T04:04:00.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.538+0000 7f1de55c8640 1 -- 172.21.15.46:0/1831734985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1de0108d00 msgr2=0x7f1de019fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:00.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.538+0000 7f1de55c8640 1 --2- 172.21.15.46:0/1831734985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1de0108d00 0x7f1de019fd20 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f1dd800d750 tx=0x7f1dd800dc10 comp rx=0 tx=0).stop 2024-09-21T04:04:00.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.538+0000 7f1de55c8640 1 -- 172.21.15.46:0/1831734985 shutdown_connections 2024-09-21T04:04:00.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.538+0000 7f1de55c8640 1 --2- 172.21.15.46:0/1831734985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1de0108d00 0x7f1de019fd20 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:00.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.538+0000 7f1de55c8640 1 --2- 172.21.15.46:0/1831734985 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1de01083b0 0x7f1de019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:00.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.538+0000 7f1de55c8640 1 --2- 172.21.15.46:0/1831734985 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f1dc80b6680 0x7f1dc80b8b90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:00.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.538+0000 7f1de55c8640 1 --2- 172.21.15.46:0/1831734985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1de0102a70 0x7f1de019a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:00.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.538+0000 7f1de55c8640 1 -- 172.21.15.46:0/1831734985 >> 172.21.15.46:0/1831734985 conn(0x7f1de0079730 msgr2=0x7f1de0106680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:00.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.538+0000 7f1de55c8640 1 -- 172.21.15.46:0/1831734985 shutdown_connections 2024-09-21T04:04:00.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:00.538+0000 7f1de55c8640 1 -- 172.21.15.46:0/1831734985 wait complete. 2024-09-21T04:04:02.190 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T04:04:02.191 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T04:04:02.219 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:01 smithi046 ceph-mon[30954]: pgmap v593: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:04:02.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:01 smithi105 ceph-mon[34773]: pgmap v593: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:04:02.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:01 smithi162 ceph-mon[35071]: pgmap v593: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:04:02.463 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:04:03.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.046+0000 7f5074cb3640 1 -- 172.21.15.46:0/90103455 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5070103b60 msgr2=0x7f5070103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:03.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.046+0000 7f5074cb3640 1 --2- 172.21.15.46:0/90103455 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5070103b60 0x7f5070103f70 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f5060009900 tx=0x7f506002a410 comp rx=0 tx=0).stop 2024-09-21T04:04:03.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.046+0000 7f5074cb3640 1 -- 172.21.15.46:0/90103455 shutdown_connections 2024-09-21T04:04:03.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.046+0000 7f5074cb3640 1 --2- 172.21.15.46:0/90103455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5070109df0 0x7f5070110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:03.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.046+0000 7f5074cb3640 1 --2- 172.21.15.46:0/90103455 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50701094a0 0x7f50701098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:03.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.046+0000 7f5074cb3640 1 --2- 172.21.15.46:0/90103455 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5070103b60 0x7f5070103f70 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:03.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.046+0000 7f5074cb3640 1 -- 172.21.15.46:0/90103455 >> 172.21.15.46:0/90103455 conn(0x7f507007b850 msgr2=0x7f507007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:03.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.046+0000 7f5074cb3640 1 -- 172.21.15.46:0/90103455 shutdown_connections 2024-09-21T04:04:03.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.046+0000 7f5074cb3640 1 -- 172.21.15.46:0/90103455 wait complete. 2024-09-21T04:04:03.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.047+0000 7f5074cb3640 1 Processor -- start 2024-09-21T04:04:03.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.047+0000 7f5074cb3640 1 -- start start 2024-09-21T04:04:03.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.048+0000 7f5074cb3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5070103b60 0x7f507019a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:03.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.048+0000 7f5074cb3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50701094a0 0x7f507019ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:03.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.048+0000 7f5074cb3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5070109df0 0x7f507019fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:03.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.048+0000 7f5074cb3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5070113b10 con 0x7f5070103b60 2024-09-21T04:04:03.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.048+0000 7f5074cb3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5070113990 con 0x7f50701094a0 2024-09-21T04:04:03.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.048+0000 7f5074cb3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5070113c90 con 0x7f5070109df0 2024-09-21T04:04:03.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.048+0000 7f506e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5070103b60 0x7f507019a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:03.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.048+0000 7f506e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5070103b60 0x7f507019a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43402/0 (socket says 172.21.15.46:43402) 2024-09-21T04:04:03.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.048+0000 7f506e59c640 1 -- 172.21.15.46:0/1267246122 learned_addr learned my addr 172.21.15.46:0/1267246122 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:03.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.048+0000 7f506ed9d640 1 --2- 172.21.15.46:0/1267246122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5070109df0 0x7f507019fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:03.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.048+0000 7f506dd9b640 1 --2- 172.21.15.46:0/1267246122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50701094a0 0x7f507019ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:03.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.048+0000 7f506e59c640 1 -- 172.21.15.46:0/1267246122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5070109df0 msgr2=0x7f507019fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:03.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.048+0000 7f506e59c640 1 --2- 172.21.15.46:0/1267246122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5070109df0 0x7f507019fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:03.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.048+0000 7f506e59c640 1 -- 172.21.15.46:0/1267246122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50701094a0 msgr2=0x7f507019ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:03.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.048+0000 7f506e59c640 1 --2- 172.21.15.46:0/1267246122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50701094a0 0x7f507019ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:03.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.048+0000 7f506e59c640 1 -- 172.21.15.46:0/1267246122 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50701a04d0 con 0x7f5070103b60 2024-09-21T04:04:03.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.048+0000 7f506ed9d640 1 --2- 172.21.15.46:0/1267246122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5070109df0 0x7f507019fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:04:03.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.048+0000 7f506e59c640 1 --2- 172.21.15.46:0/1267246122 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5070103b60 0x7f507019a560 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f5060005940 tx=0x7f50600042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:03.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.049+0000 7f505f7fe640 1 -- 172.21.15.46:0/1267246122 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f506003f030 con 0x7f5070103b60 2024-09-21T04:04:03.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.049+0000 7f5074cb3640 1 -- 172.21.15.46:0/1267246122 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50701a0760 con 0x7f5070103b60 2024-09-21T04:04:03.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.049+0000 7f505f7fe640 1 -- 172.21.15.46:0/1267246122 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5060003cb0 con 0x7f5070103b60 2024-09-21T04:04:03.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.049+0000 7f505f7fe640 1 -- 172.21.15.46:0/1267246122 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5060035070 con 0x7f5070103b60 2024-09-21T04:04:03.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.049+0000 7f5074cb3640 1 -- 172.21.15.46:0/1267246122 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50701a6f20 con 0x7f5070103b60 2024-09-21T04:04:03.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.052+0000 7f507b227740 1 Processor -- start 2024-09-21T04:04:03.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.052+0000 7f507b227740 1 -- start start 2024-09-21T04:04:03.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.052+0000 7f507b227740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fdb4880350 0x55fdb4c27430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:03.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.052+0000 7f507b227740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb4857490 0x55fdb4c27970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:03.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.052+0000 7f507b227740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fdb485f670 0x55fdb4c27eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:03.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.052+0000 7f507b227740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55fdb4b9de60 con 0x55fdb4880350 2024-09-21T04:04:03.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.052+0000 7f507b227740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55fdb4b8d290 con 0x55fdb485f670 2024-09-21T04:04:03.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.052+0000 7f507b227740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fdb4b910a0 con 0x55fdb4857490 2024-09-21T04:04:03.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.052+0000 7f506ed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fdb4880350 0x55fdb4c27430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:03.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.052+0000 7f506ed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fdb4880350 0x55fdb4c27430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43418/0 (socket says 172.21.15.46:43418) 2024-09-21T04:04:03.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.052+0000 7f506ed9d640 1 -- 172.21.15.46:0/1974676743 learned_addr learned my addr 172.21.15.46:0/1974676743 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:03.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.053+0000 7f505f7fe640 1 -- 172.21.15.46:0/1267246122 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f5060042030 con 0x7f5070103b60 2024-09-21T04:04:03.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.053+0000 7f506dd9b640 1 --2- 172.21.15.46:0/1974676743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fdb485f670 0x55fdb4c27eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:03.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.053+0000 7f506ed9d640 1 -- 172.21.15.46:0/1974676743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb4857490 msgr2=0x55fdb4c27970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:03.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.053+0000 7f506ed9d640 1 --2- 172.21.15.46:0/1974676743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb4857490 0x55fdb4c27970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:03.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.053+0000 7f506ed9d640 1 -- 172.21.15.46:0/1974676743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fdb485f670 msgr2=0x55fdb4c27eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:03.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.053+0000 7f506ed9d640 1 --2- 172.21.15.46:0/1974676743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fdb485f670 0x55fdb4c27eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:03.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.053+0000 7f506ed9d640 1 -- 172.21.15.46:0/1974676743 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdb48eb930 con 0x55fdb4880350 2024-09-21T04:04:03.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.053+0000 7f506ed9d640 1 --2- 172.21.15.46:0/1974676743 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fdb4880350 0x55fdb4c27430 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f506800c450 tx=0x7f506800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56e892aea24b11af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:03.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.053+0000 7f505cff9640 1 -- 172.21.15.46:0/1974676743 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5068007430 con 0x55fdb4880350 2024-09-21T04:04:03.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.053+0000 7f505cff9640 1 -- 172.21.15.46:0/1974676743 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5068007a80 con 0x55fdb4880350 2024-09-21T04:04:03.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.053+0000 7f505cff9640 1 -- 172.21.15.46:0/1974676743 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f506800aa00 con 0x55fdb4880350 2024-09-21T04:04:03.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.054+0000 7f505f7fe640 1 --2- 172.21.15.46:0/1267246122 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f50580b6680 0x7f50580b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:03.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.054+0000 7f506e59c640 1 --2- 172.21.15.46:0/1267246122 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f50580b6680 0x7f50580b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:03.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.054+0000 7f505f7fe640 1 -- 172.21.15.46:0/1267246122 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f5060107ca0 con 0x7f5070103b60 2024-09-21T04:04:03.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.054+0000 7f507b227740 1 -- 172.21.15.46:0/1974676743 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fdb4880350 msgr2=0x55fdb4c27430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:03.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.054+0000 7f507b227740 1 --2- 172.21.15.46:0/1974676743 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fdb4880350 0x55fdb4c27430 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f506800c450 tx=0x7f506800c910 comp rx=0 tx=0).stop 2024-09-21T04:04:03.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.054+0000 7f507b227740 1 -- 172.21.15.46:0/1974676743 shutdown_connections 2024-09-21T04:04:03.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.054+0000 7f507b227740 1 --2- 172.21.15.46:0/1974676743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fdb485f670 0x55fdb4c27eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:03.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.054+0000 7f507b227740 1 --2- 172.21.15.46:0/1974676743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb4857490 0x55fdb4c27970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:03.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.054+0000 7f507b227740 1 --2- 172.21.15.46:0/1974676743 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fdb4880350 0x55fdb4c27430 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:03.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.054+0000 7f507b227740 1 -- 172.21.15.46:0/1974676743 >> 172.21.15.46:0/1974676743 conn(0x55fdb4874740 msgr2=0x55fdb4c25320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:03.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.055+0000 7f506e59c640 1 --2- 172.21.15.46:0/1267246122 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f50580b6680 0x7f50580b8b90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55fdb4c260b0 tx=0x7f50600f1040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:03.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.055+0000 7f507b227740 1 -- 172.21.15.46:0/1974676743 shutdown_connections 2024-09-21T04:04:03.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.055+0000 7f507b227740 1 -- 172.21.15.46:0/1974676743 wait complete. 2024-09-21T04:04:03.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.055+0000 7f507b227740 1 -- start start 2024-09-21T04:04:03.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.055+0000 7f507b227740 1 Processor -- start 2024-09-21T04:04:03.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.055+0000 7f507b227740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fdb4857490 0x55fdb4c33040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:03.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.055+0000 7f507b227740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fdb485f670 0x55fdb4c33580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:03.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.056+0000 7f507b227740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb4880350 0x55fdb4c3ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:03.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.056+0000 7f507b227740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55fdb49ee890 con 0x55fdb4857490 2024-09-21T04:04:03.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.056+0000 7f507b227740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55fdb4b27d40 con 0x55fdb485f670 2024-09-21T04:04:03.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.056+0000 7f507b227740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fdb4c35c10 con 0x55fdb4880350 2024-09-21T04:04:03.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.056+0000 7f507b227740 10 client.0 _ll_register_callbacks cb 0x55fdb4b8bc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:04:03.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.056+0000 7f506ed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fdb4857490 0x55fdb4c33040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:03.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.056+0000 7f506ed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fdb4857490 0x55fdb4c33040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43426/0 (socket says 172.21.15.46:43426) 2024-09-21T04:04:03.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.056+0000 7f506ed9d640 1 -- 172.21.15.46:0/2296735060 learned_addr learned my addr 172.21.15.46:0/2296735060 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:03.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.056+0000 7f506dd9b640 1 --2- 172.21.15.46:0/2296735060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fdb485f670 0x55fdb4c33580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:03.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.056+0000 7f506ed9d640 1 --2- 172.21.15.46:0/2296735060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb4880350 0x55fdb4c3ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:03.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.056+0000 7f506ed9d640 1 -- 172.21.15.46:0/2296735060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb4880350 msgr2=0x55fdb4c3ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:03.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.056+0000 7f506ed9d640 1 --2- 172.21.15.46:0/2296735060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb4880350 0x55fdb4c3ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:03.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.056+0000 7f506ed9d640 1 -- 172.21.15.46:0/2296735060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fdb485f670 msgr2=0x55fdb4c33580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:03.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.056+0000 7f506ed9d640 1 --2- 172.21.15.46:0/2296735060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fdb485f670 0x55fdb4c33580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:03.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.056+0000 7f506ed9d640 1 -- 172.21.15.46:0/2296735060 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdb4c3f4f0 con 0x55fdb4857490 2024-09-21T04:04:03.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.056+0000 7f506dd9b640 1 --2- 172.21.15.46:0/2296735060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fdb485f670 0x55fdb4c33580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:04:03.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.056+0000 7f506ed9d640 1 --2- 172.21.15.46:0/2296735060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fdb4857490 0x55fdb4c33040 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f5068004a80 tx=0x7f5068009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5cc0508538f4391 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:03.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.056+0000 7f5055ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:04:03.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.056+0000 7f5055ffb640 1 -- 172.21.15.46:0/2296735060 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f506801b040 con 0x55fdb4857490 2024-09-21T04:04:03.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.056+0000 7f5055ffb640 1 -- 172.21.15.46:0/2296735060 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f50680076e0 con 0x55fdb4857490 2024-09-21T04:04:03.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.056+0000 7f507b227740 1 -- 172.21.15.46:0/2296735060 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5068007a80 con 0x55fdb4857490 2024-09-21T04:04:03.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.057+0000 7f5055ffb640 1 -- 172.21.15.46:0/2296735060 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f50680078e0 con 0x55fdb4857490 2024-09-21T04:04:03.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.057+0000 7f507b227740 10 client.16743 fetch_fsmap learned FSMap version 20 2024-09-21T04:04:03.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.057+0000 7f507b227740 1 -- 172.21.15.46:0/2296735060 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55fdb4c41e20 con 0x55fdb4857490 2024-09-21T04:04:03.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.057+0000 7f5055ffb640 1 -- 172.21.15.46:0/2296735060 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5068007a80 con 0x55fdb4857490 2024-09-21T04:04:03.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.057+0000 7f5055ffb640 1 -- 172.21.15.46:0/2296735060 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f5068016840 con 0x55fdb4857490 2024-09-21T04:04:03.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.057+0000 7f507b227740 10 client.16743 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:04:03.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.057+0000 7f507b227740 10 client.16743 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:04:03.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.057+0000 7f507b227740 20 client.16743 populate_metadata read hostname 'smithi046' 2024-09-21T04:04:03.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.057+0000 7f507b227740 1 --2- 172.21.15.46:0/2296735060 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55fdb483ecd0 0x55fdb4c452f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:03.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.057+0000 7f507b227740 4 client.16743 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:04:03.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.057+0000 7f507b227740 1 -- 172.21.15.46:0/2296735060 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fdb4b9fdb0 con 0x55fdb483ecd0 2024-09-21T04:04:03.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.057+0000 7f506dd9b640 1 --2- 172.21.15.46:0/2296735060 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55fdb483ecd0 0x55fdb4c452f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:03.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.058+0000 7f5055ffb640 10 client.16743 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:03.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.058+0000 7f506dd9b640 1 --2- 172.21.15.46:0/2296735060 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55fdb483ecd0 0x55fdb4c452f0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ac06fa094c0b92b server_cookie=1161453c4c8c4c78 in_seq=0 out_seq=0 2024-09-21T04:04:03.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.059+0000 7f5055ffb640 1 -- 172.21.15.46:0/2296735060 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fdb4b9fdb0 con 0x55fdb483ecd0 2024-09-21T04:04:03.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.059+0000 7f5055ffb640 10 client.16743 handle_command_reply: tid=0 2024-09-21T04:04:03.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.059+0000 7f507b227740 1 client.16743 shutdown 2024-09-21T04:04:03.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.059+0000 7f507b227740 1 -- 172.21.15.46:0/2296735060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fdb4857490 msgr2=0x55fdb4c33040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:03.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.059+0000 7f507b227740 1 --2- 172.21.15.46:0/2296735060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fdb4857490 0x55fdb4c33040 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f5068004a80 tx=0x7f5068009ba0 comp rx=0 tx=0).stop 2024-09-21T04:04:03.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.059+0000 7f507b227740 1 -- 172.21.15.46:0/2296735060 shutdown_connections 2024-09-21T04:04:03.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.059+0000 7f507b227740 1 --2- 172.21.15.46:0/2296735060 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55fdb483ecd0 0x55fdb4c452f0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:03.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.059+0000 7f507b227740 1 --2- 172.21.15.46:0/2296735060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb4880350 0x55fdb4c3ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:03.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.059+0000 7f507b227740 1 --2- 172.21.15.46:0/2296735060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fdb485f670 0x55fdb4c33580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:03.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.059+0000 7f5055ffb640 0 client.16743 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:03.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.059+0000 7f507b227740 1 --2- 172.21.15.46:0/2296735060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fdb4857490 0x55fdb4c33040 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:03.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.059+0000 7f507b227740 1 -- 172.21.15.46:0/2296735060 >> 172.21.15.46:0/2296735060 conn(0x55fdb4874740 msgr2=0x55fdb4c2a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:03.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.059+0000 7f507b227740 1 -- 172.21.15.46:0/2296735060 shutdown_connections 2024-09-21T04:04:03.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.059+0000 7f507b227740 1 -- 172.21.15.46:0/2296735060 wait complete. 2024-09-21T04:04:03.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.059+0000 7f507b227740 20 client.16743 trim_cache size 0 max 16384 2024-09-21T04:04:03.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.077+0000 7f507b227740 1 Processor -- start 2024-09-21T04:04:03.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.077+0000 7f507b227740 1 -- start start 2024-09-21T04:04:03.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.077+0000 7f507b227740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb4857490 0x55fdb4c3eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:03.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.077+0000 7f507b227740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fdb485f670 0x55fdb4c316c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:03.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.077+0000 7f507b227740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fdb4880350 0x55fdb4c31c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:03.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.077+0000 7f507b227740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f50701ad620 con 0x55fdb4880350 2024-09-21T04:04:03.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.077+0000 7f507b227740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f50701afe80 con 0x55fdb485f670 2024-09-21T04:04:03.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.077+0000 7f507b227740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f50701adc70 con 0x55fdb4857490 2024-09-21T04:04:03.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.077+0000 7f506ed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fdb4880350 0x55fdb4c31c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:03.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.077+0000 7f506ed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fdb4880350 0x55fdb4c31c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43436/0 (socket says 172.21.15.46:43436) 2024-09-21T04:04:03.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.077+0000 7f506ed9d640 1 -- 172.21.15.46:0/1543378712 learned_addr learned my addr 172.21.15.46:0/1543378712 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:03.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.077+0000 7f506ed9d640 1 --2- 172.21.15.46:0/1543378712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb4857490 0x55fdb4c3eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:03.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.077+0000 7f506dd9b640 1 --2- 172.21.15.46:0/1543378712 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fdb485f670 0x55fdb4c316c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:03.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.077+0000 7f506ed9d640 1 -- 172.21.15.46:0/1543378712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb4857490 msgr2=0x55fdb4c3eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:03.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.077+0000 7f506ed9d640 1 --2- 172.21.15.46:0/1543378712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb4857490 0x55fdb4c3eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:03.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.077+0000 7f506ed9d640 1 -- 172.21.15.46:0/1543378712 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fdb485f670 msgr2=0x55fdb4c316c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:03.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.077+0000 7f506ed9d640 1 --2- 172.21.15.46:0/1543378712 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fdb485f670 0x55fdb4c316c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:03.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.078+0000 7f506ed9d640 1 -- 172.21.15.46:0/1543378712 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdb4c35af0 con 0x55fdb4880350 2024-09-21T04:04:03.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.078+0000 7f506ed9d640 1 --2- 172.21.15.46:0/1543378712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fdb4880350 0x55fdb4c31c00 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f5068008010 tx=0x7f506800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1645ab6d16dcad01 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:03.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.078+0000 7f5057fff640 1 -- 172.21.15.46:0/1543378712 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5068009c10 con 0x55fdb4880350 2024-09-21T04:04:03.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.078+0000 7f5057fff640 1 -- 172.21.15.46:0/1543378712 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5068009960 con 0x55fdb4880350 2024-09-21T04:04:03.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.078+0000 7f5057fff640 1 -- 172.21.15.46:0/1543378712 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f506800aaa0 con 0x55fdb4880350 2024-09-21T04:04:03.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.079+0000 7f507b227740 1 -- 172.21.15.46:0/1543378712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fdb4880350 msgr2=0x55fdb4c31c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:03.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.079+0000 7f507b227740 1 --2- 172.21.15.46:0/1543378712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fdb4880350 0x55fdb4c31c00 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f5068008010 tx=0x7f506800c910 comp rx=0 tx=0).stop 2024-09-21T04:04:03.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.079+0000 7f507b227740 1 -- 172.21.15.46:0/1543378712 shutdown_connections 2024-09-21T04:04:03.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.079+0000 7f507b227740 1 --2- 172.21.15.46:0/1543378712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fdb4880350 0x55fdb4c31c00 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:03.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.079+0000 7f507b227740 1 --2- 172.21.15.46:0/1543378712 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fdb485f670 0x55fdb4c316c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:03.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.079+0000 7f507b227740 1 --2- 172.21.15.46:0/1543378712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb4857490 0x55fdb4c3eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:03.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.079+0000 7f507b227740 1 -- 172.21.15.46:0/1543378712 >> 172.21.15.46:0/1543378712 conn(0x55fdb4874740 msgr2=0x55fdb4c2df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:03.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.079+0000 7f507b227740 1 -- 172.21.15.46:0/1543378712 shutdown_connections 2024-09-21T04:04:03.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.079+0000 7f507b227740 1 -- 172.21.15.46:0/1543378712 wait complete. 2024-09-21T04:04:03.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.079+0000 7f507b227740 1 -- start start 2024-09-21T04:04:03.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.079+0000 7f507b227740 1 Processor -- start 2024-09-21T04:04:03.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.080+0000 7f507b227740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fdb4857490 0x55fdb4c48b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:03.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.080+0000 7f507b227740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb485f670 0x55fdb4c46000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:03.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.080+0000 7f507b227740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fdb4880350 0x55fdb4c46560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:03.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.080+0000 7f507b227740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f50701ae340 con 0x55fdb4857490 2024-09-21T04:04:03.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.080+0000 7f507b227740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f50701af7b0 con 0x55fdb4880350 2024-09-21T04:04:03.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.080+0000 7f507b227740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f50701aea10 con 0x55fdb485f670 2024-09-21T04:04:03.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.080+0000 7f507b227740 10 client.0 _ll_register_callbacks cb 0x7f5068009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:04:03.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.080+0000 7f506ed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fdb4857490 0x55fdb4c48b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:03.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.080+0000 7f506ed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fdb4857490 0x55fdb4c48b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43444/0 (socket says 172.21.15.46:43444) 2024-09-21T04:04:03.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.080+0000 7f506ed9d640 1 -- 172.21.15.46:0/1023036568 learned_addr learned my addr 172.21.15.46:0/1023036568 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:03.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.080+0000 7f506dd9b640 1 --2- 172.21.15.46:0/1023036568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb485f670 0x55fdb4c46000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:03.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.080+0000 7f506ed9d640 1 --2- 172.21.15.46:0/1023036568 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fdb4880350 0x55fdb4c46560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:03.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.080+0000 7f506ed9d640 1 -- 172.21.15.46:0/1023036568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb485f670 msgr2=0x55fdb4c46000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:03.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.080+0000 7f506ed9d640 1 --2- 172.21.15.46:0/1023036568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb485f670 0x55fdb4c46000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:03.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.080+0000 7f506ed9d640 1 -- 172.21.15.46:0/1023036568 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fdb4880350 msgr2=0x55fdb4c46560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:03.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.080+0000 7f506ed9d640 1 --2- 172.21.15.46:0/1023036568 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fdb4880350 0x55fdb4c46560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:03.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.080+0000 7f506ed9d640 1 -- 172.21.15.46:0/1023036568 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdb4c46cf0 con 0x55fdb4857490 2024-09-21T04:04:03.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.080+0000 7f506ed9d640 1 --2- 172.21.15.46:0/1023036568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fdb4857490 0x55fdb4c48b30 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f5068007c00 tx=0x7f506800c030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dda9b5dbeb3cc83 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:03.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.080+0000 7f5055ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:04:03.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.081+0000 7f5055ffb640 1 -- 172.21.15.46:0/1023036568 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f506800a720 con 0x55fdb4857490 2024-09-21T04:04:03.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.081+0000 7f5055ffb640 1 -- 172.21.15.46:0/1023036568 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f5068012030 con 0x55fdb4857490 2024-09-21T04:04:03.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.081+0000 7f507b227740 1 -- 172.21.15.46:0/1023036568 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5068009960 con 0x55fdb4857490 2024-09-21T04:04:03.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.081+0000 7f5055ffb640 1 -- 172.21.15.46:0/1023036568 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f506800a8c0 con 0x55fdb4857490 2024-09-21T04:04:03.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.081+0000 7f507b227740 10 client.16749 fetch_fsmap learned FSMap version 20 2024-09-21T04:04:03.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.081+0000 7f507b227740 1 -- 172.21.15.46:0/1023036568 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55fdb4cb3e20 con 0x55fdb4857490 2024-09-21T04:04:03.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.081+0000 7f5055ffb640 1 -- 172.21.15.46:0/1023036568 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5068009960 con 0x55fdb4857490 2024-09-21T04:04:03.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.081+0000 7f5055ffb640 1 -- 172.21.15.46:0/1023036568 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f50680209d0 con 0x55fdb4857490 2024-09-21T04:04:03.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.081+0000 7f507b227740 10 client.16749 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:04:03.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.081+0000 7f507b227740 10 client.16749 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:04:03.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.081+0000 7f507b227740 20 client.16749 populate_metadata read hostname 'smithi046' 2024-09-21T04:04:03.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.081+0000 7f507b227740 1 --2- 172.21.15.46:0/1023036568 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55fdb4814080 0x55fdb4cb63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:03.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.082+0000 7f507b227740 4 client.16749 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T04:04:03.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.082+0000 7f507b227740 1 -- 172.21.15.46:0/1023036568 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55fdb4b9b860 con 0x55fdb4814080 2024-09-21T04:04:03.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.082+0000 7f506dd9b640 1 --2- 172.21.15.46:0/1023036568 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55fdb4814080 0x55fdb4cb63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:03.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.082+0000 7f506dd9b640 1 --2- 172.21.15.46:0/1023036568 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55fdb4814080 0x55fdb4cb63e0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5739e221d5ae9bc server_cookie=41b59129e7c57c7e in_seq=0 out_seq=0 2024-09-21T04:04:03.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.082+0000 7f5055ffb640 10 client.16749 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:03.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.084+0000 7f5055ffb640 1 -- 172.21.15.46:0/1023036568 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55fdb4b9b860 con 0x55fdb4814080 2024-09-21T04:04:03.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.084+0000 7f5055ffb640 10 client.16749 handle_command_reply: tid=0 2024-09-21T04:04:03.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.084+0000 7f507b227740 1 client.16749 shutdown 2024-09-21T04:04:03.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.084+0000 7f507b227740 1 -- 172.21.15.46:0/1023036568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fdb4857490 msgr2=0x55fdb4c48b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:03.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.084+0000 7f507b227740 1 --2- 172.21.15.46:0/1023036568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fdb4857490 0x55fdb4c48b30 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f5068007c00 tx=0x7f506800c030 comp rx=0 tx=0).stop 2024-09-21T04:04:03.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.084+0000 7f507b227740 1 -- 172.21.15.46:0/1023036568 shutdown_connections 2024-09-21T04:04:03.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.084+0000 7f507b227740 1 --2- 172.21.15.46:0/1023036568 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55fdb4814080 0x55fdb4cb63e0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:03.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.084+0000 7f507b227740 1 --2- 172.21.15.46:0/1023036568 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fdb4880350 0x55fdb4c46560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:03.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.084+0000 7f507b227740 1 --2- 172.21.15.46:0/1023036568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdb485f670 0x55fdb4c46000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:03.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.084+0000 7f5055ffb640 0 client.16749 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:03.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.084+0000 7f507b227740 1 --2- 172.21.15.46:0/1023036568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55fdb4857490 0x55fdb4c48b30 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:03.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.084+0000 7f507b227740 1 -- 172.21.15.46:0/1023036568 >> 172.21.15.46:0/1023036568 conn(0x55fdb4874740 msgr2=0x55fdb4c31280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:03.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.084+0000 7f507b227740 1 -- 172.21.15.46:0/1023036568 shutdown_connections 2024-09-21T04:04:03.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.084+0000 7f507b227740 1 -- 172.21.15.46:0/1023036568 wait complete. 2024-09-21T04:04:03.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.084+0000 7f507b227740 20 client.16749 trim_cache size 0 max 16384 2024-09-21T04:04:03.090 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T04:04:03.090 INFO:teuthology.orchestra.run.smithi046.stdout: "return_code": 0, 2024-09-21T04:04:03.091 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_tag": "50776be6-bb03-4b39-ad4d-719e50e97356", 2024-09-21T04:04:03.091 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": "asynchronous" 2024-09-21T04:04:03.091 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T04:04:03.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.085+0000 7f5074cb3640 1 -- 172.21.15.46:0/1267246122 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f50580b6680 msgr2=0x7f50580b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:03.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.085+0000 7f5074cb3640 1 --2- 172.21.15.46:0/1267246122 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f50580b6680 0x7f50580b8b90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55fdb4c260b0 tx=0x7f50600f1040 comp rx=0 tx=0).stop 2024-09-21T04:04:03.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.085+0000 7f5074cb3640 1 -- 172.21.15.46:0/1267246122 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5070103b60 msgr2=0x7f507019a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:03.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.085+0000 7f5074cb3640 1 --2- 172.21.15.46:0/1267246122 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5070103b60 0x7f507019a560 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f5060005940 tx=0x7f50600042f0 comp rx=0 tx=0).stop 2024-09-21T04:04:03.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.085+0000 7f5074cb3640 1 -- 172.21.15.46:0/1267246122 shutdown_connections 2024-09-21T04:04:03.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.085+0000 7f5074cb3640 1 --2- 172.21.15.46:0/1267246122 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f50580b6680 0x7f50580b8b90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:03.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.085+0000 7f5074cb3640 1 --2- 172.21.15.46:0/1267246122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5070109df0 0x7f507019fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:03.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.085+0000 7f5074cb3640 1 --2- 172.21.15.46:0/1267246122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50701094a0 0x7f507019ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:03.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.085+0000 7f5074cb3640 1 --2- 172.21.15.46:0/1267246122 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5070103b60 0x7f507019a560 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:03.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.085+0000 7f5074cb3640 1 -- 172.21.15.46:0/1267246122 >> 172.21.15.46:0/1267246122 conn(0x7f507007b850 msgr2=0x7f5070107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:03.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.085+0000 7f5074cb3640 1 -- 172.21.15.46:0/1267246122 shutdown_connections 2024-09-21T04:04:03.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:03.085+0000 7f5074cb3640 1 -- 172.21.15.46:0/1267246122 wait complete. 2024-09-21T04:04:03.793 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T04:04:04.092 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:04:04.214 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:03 smithi046 ceph-mon[30954]: pgmap v594: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T04:04:04.214 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:03 smithi046 ceph-mon[30954]: scrub queued for path: / 2024-09-21T04:04:04.214 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:03 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T04:04:04.214 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:03 smithi046 ceph-mon[30954]: scrub summary: active paths [/] 2024-09-21T04:04:04.214 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:03 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T04:04:04.214 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:03 smithi046 ceph-mon[30954]: scrub summary: idle 2024-09-21T04:04:04.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:03 smithi105 ceph-mon[34773]: pgmap v594: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T04:04:04.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:03 smithi105 ceph-mon[34773]: scrub queued for path: / 2024-09-21T04:04:04.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:03 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T04:04:04.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:03 smithi105 ceph-mon[34773]: scrub summary: active paths [/] 2024-09-21T04:04:04.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:03 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T04:04:04.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:03 smithi105 ceph-mon[34773]: scrub summary: idle 2024-09-21T04:04:04.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:03 smithi162 ceph-mon[35071]: pgmap v594: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T04:04:04.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:03 smithi162 ceph-mon[35071]: scrub queued for path: / 2024-09-21T04:04:04.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:03 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T04:04:04.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:03 smithi162 ceph-mon[35071]: scrub summary: active paths [/] 2024-09-21T04:04:04.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:03 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T04:04:04.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:03 smithi162 ceph-mon[35071]: scrub summary: idle 2024-09-21T04:04:04.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.619+0000 7febb47d4640 1 -- 172.21.15.46:0/2727695864 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febac10ddf0 msgr2=0x7febac110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:04.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.619+0000 7febb47d4640 1 --2- 172.21.15.46:0/2727695864 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febac10ddf0 0x7febac110300 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7feba4009900 tx=0x7feba402a410 comp rx=0 tx=0).stop 2024-09-21T04:04:04.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.619+0000 7febb47d4640 1 -- 172.21.15.46:0/2727695864 shutdown_connections 2024-09-21T04:04:04.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.619+0000 7febb47d4640 1 --2- 172.21.15.46:0/2727695864 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febac10ddf0 0x7febac110300 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:04.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.619+0000 7febb47d4640 1 --2- 172.21.15.46:0/2727695864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febac105270 0x7febac10d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:04.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.619+0000 7febb47d4640 1 --2- 172.21.15.46:0/2727695864 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7febac104840 0x7febac104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:04.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.619+0000 7febb47d4640 1 -- 172.21.15.46:0/2727695864 >> 172.21.15.46:0/2727695864 conn(0x7febac079730 msgr2=0x7febac079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:04.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.619+0000 7febb47d4640 1 -- 172.21.15.46:0/2727695864 shutdown_connections 2024-09-21T04:04:04.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.619+0000 7febb47d4640 1 -- 172.21.15.46:0/2727695864 wait complete. 2024-09-21T04:04:04.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.620+0000 7febb47d4640 1 Processor -- start 2024-09-21T04:04:04.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.620+0000 7febb47d4640 1 -- start start 2024-09-21T04:04:04.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.620+0000 7febb47d4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7febac104840 0x7febac19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:04.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.620+0000 7febb47d4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febac105270 0x7febac19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:04.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.620+0000 7febb47d4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febac10ddf0 0x7febac19fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:04.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.620+0000 7febb47d4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7febac113b70 con 0x7febac105270 2024-09-21T04:04:04.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.620+0000 7febb47d4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7febac1139f0 con 0x7febac104840 2024-09-21T04:04:04.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.620+0000 7febb47d4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7febac113cf0 con 0x7febac10ddf0 2024-09-21T04:04:04.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.620+0000 7febb1d6f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febac105270 0x7febac19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:04.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.620+0000 7febb1d6f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febac105270 0x7febac19ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43458/0 (socket says 172.21.15.46:43458) 2024-09-21T04:04:04.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.620+0000 7febb1d6f640 1 -- 172.21.15.46:0/1409970971 learned_addr learned my addr 172.21.15.46:0/1409970971 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:04.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.620+0000 7febb2d71640 1 --2- 172.21.15.46:0/1409970971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febac10ddf0 0x7febac19fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:04.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.620+0000 7febb2570640 1 --2- 172.21.15.46:0/1409970971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7febac104840 0x7febac19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:04.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.621+0000 7febb1d6f640 1 -- 172.21.15.46:0/1409970971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febac10ddf0 msgr2=0x7febac19fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:04.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.621+0000 7febb1d6f640 1 --2- 172.21.15.46:0/1409970971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febac10ddf0 0x7febac19fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:04.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.621+0000 7febb1d6f640 1 -- 172.21.15.46:0/1409970971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7febac104840 msgr2=0x7febac19a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:04.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.621+0000 7febb1d6f640 1 --2- 172.21.15.46:0/1409970971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7febac104840 0x7febac19a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:04.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.621+0000 7febb1d6f640 1 -- 172.21.15.46:0/1409970971 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febac1a0530 con 0x7febac105270 2024-09-21T04:04:04.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.621+0000 7febb2d71640 1 --2- 172.21.15.46:0/1409970971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febac10ddf0 0x7febac19fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:04:04.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.621+0000 7febb2570640 1 --2- 172.21.15.46:0/1409970971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7febac104840 0x7febac19a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:04:04.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.621+0000 7febb1d6f640 1 --2- 172.21.15.46:0/1409970971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febac105270 0x7febac19ab60 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7feba0006fd0 tx=0x7feba000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:04.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.621+0000 7febab7fe640 1 -- 172.21.15.46:0/1409970971 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba0011830 con 0x7febac105270 2024-09-21T04:04:04.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.621+0000 7febb47d4640 1 -- 172.21.15.46:0/1409970971 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febac1a0820 con 0x7febac105270 2024-09-21T04:04:04.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.621+0000 7febab7fe640 1 -- 172.21.15.46:0/1409970971 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feba0016070 con 0x7febac105270 2024-09-21T04:04:04.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.621+0000 7febab7fe640 1 -- 172.21.15.46:0/1409970971 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba0010e00 con 0x7febac105270 2024-09-21T04:04:04.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.621+0000 7febb47d4640 1 -- 172.21.15.46:0/1409970971 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febac1a6f80 con 0x7febac105270 2024-09-21T04:04:04.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.624+0000 7febbad48740 1 Processor -- start 2024-09-21T04:04:04.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.624+0000 7febbad48740 1 -- start start 2024-09-21T04:04:04.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.624+0000 7febab7fe640 1 -- 172.21.15.46:0/1409970971 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7feba001b480 con 0x7febac105270 2024-09-21T04:04:04.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.624+0000 7febbad48740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564da478a070 0x564da4b31650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:04.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.624+0000 7febbad48740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564da47611b0 0x564da4b31b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:04.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.624+0000 7febbad48740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564da4769390 0x564da4b320d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:04.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.624+0000 7febbad48740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x564da4aa7e50 con 0x564da478a070 2024-09-21T04:04:04.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.624+0000 7febbad48740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x564da4a97280 con 0x564da4769390 2024-09-21T04:04:04.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.624+0000 7febbad48740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564da4a9b090 con 0x564da47611b0 2024-09-21T04:04:04.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.624+0000 7febb2d71640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564da478a070 0x564da4b31650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:04.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.624+0000 7febb2d71640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564da478a070 0x564da4b31650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43470/0 (socket says 172.21.15.46:43470) 2024-09-21T04:04:04.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.624+0000 7febb2d71640 1 -- 172.21.15.46:0/1980269198 learned_addr learned my addr 172.21.15.46:0/1980269198 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:04.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.625+0000 7febb2570640 1 --2- 172.21.15.46:0/1980269198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564da47611b0 0x564da4b31b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:04.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.625+0000 7febb1d6f640 1 --2- 172.21.15.46:0/1980269198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564da4769390 0x564da4b320d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:04.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.625+0000 7febb2d71640 1 -- 172.21.15.46:0/1980269198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564da47611b0 msgr2=0x564da4b31b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:04.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.625+0000 7febb2d71640 1 --2- 172.21.15.46:0/1980269198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564da47611b0 0x564da4b31b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:04.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.625+0000 7febb2d71640 1 -- 172.21.15.46:0/1980269198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564da4769390 msgr2=0x564da4b320d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:04.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.625+0000 7febb2d71640 1 --2- 172.21.15.46:0/1980269198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564da4769390 0x564da4b320d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:04.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.625+0000 7febb2d71640 1 -- 172.21.15.46:0/1980269198 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564da47f5650 con 0x564da478a070 2024-09-21T04:04:04.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.625+0000 7febb1d6f640 1 --2- 172.21.15.46:0/1980269198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564da4769390 0x564da4b320d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:04:04.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.625+0000 7febab7fe640 1 --2- 172.21.15.46:0/1409970971 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7feb940b6680 0x7feb940b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:04.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.625+0000 7febb2d71640 1 --2- 172.21.15.46:0/1980269198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564da478a070 0x564da4b31650 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7feba4009900 tx=0x7feba4031e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d53ddba24ded4b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:04.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.625+0000 7febb2570640 1 --2- 172.21.15.46:0/1409970971 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7feb940b6680 0x7feb940b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:04.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.625+0000 7febab7fe640 1 -- 172.21.15.46:0/1409970971 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7feba00e6cd0 con 0x7febac105270 2024-09-21T04:04:04.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.625+0000 7feba8ff9640 1 -- 172.21.15.46:0/1980269198 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba403f070 con 0x564da478a070 2024-09-21T04:04:04.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.625+0000 7feba8ff9640 1 -- 172.21.15.46:0/1980269198 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feba40316a0 con 0x564da478a070 2024-09-21T04:04:04.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.625+0000 7feba8ff9640 1 -- 172.21.15.46:0/1980269198 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba4035070 con 0x564da478a070 2024-09-21T04:04:04.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.626+0000 7febbad48740 1 -- 172.21.15.46:0/1980269198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564da478a070 msgr2=0x564da4b31650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:04.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.626+0000 7febb2570640 1 --2- 172.21.15.46:0/1409970971 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7feb940b6680 0x7feb940b8b90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x564da4b302d0 tx=0x7feb9c00e040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:04.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.626+0000 7febbad48740 1 --2- 172.21.15.46:0/1980269198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564da478a070 0x564da4b31650 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7feba4009900 tx=0x7feba4031e60 comp rx=0 tx=0).stop 2024-09-21T04:04:04.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.626+0000 7febbad48740 1 -- 172.21.15.46:0/1980269198 shutdown_connections 2024-09-21T04:04:04.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.626+0000 7febbad48740 1 --2- 172.21.15.46:0/1980269198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564da4769390 0x564da4b320d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:04.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.626+0000 7febbad48740 1 --2- 172.21.15.46:0/1980269198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564da47611b0 0x564da4b31b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:04.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.626+0000 7febbad48740 1 --2- 172.21.15.46:0/1980269198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564da478a070 0x564da4b31650 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:04.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.626+0000 7febbad48740 1 -- 172.21.15.46:0/1980269198 >> 172.21.15.46:0/1980269198 conn(0x564da477e460 msgr2=0x564da4b2f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:04.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.627+0000 7febbad48740 1 -- 172.21.15.46:0/1980269198 shutdown_connections 2024-09-21T04:04:04.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.627+0000 7febbad48740 1 -- 172.21.15.46:0/1980269198 wait complete. 2024-09-21T04:04:04.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.627+0000 7febbad48740 1 -- start start 2024-09-21T04:04:04.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.627+0000 7febbad48740 1 Processor -- start 2024-09-21T04:04:04.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.627+0000 7febbad48740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564da47611b0 0x564da4b3cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:04.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.627+0000 7febbad48740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564da4769390 0x564da4b3d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:04.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.627+0000 7febbad48740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564da478a070 0x564da4b490c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:04.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.627+0000 7febbad48740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x564da48f8700 con 0x564da478a070 2024-09-21T04:04:04.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.627+0000 7febbad48740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x564da4a32110 con 0x564da4769390 2024-09-21T04:04:04.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.627+0000 7febbad48740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564da4b3fdd0 con 0x564da47611b0 2024-09-21T04:04:04.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.628+0000 7febbad48740 10 client.0 _ll_register_callbacks cb 0x564da4a4b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:04:04.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.628+0000 7febb2d71640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564da478a070 0x564da4b490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:04.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.628+0000 7febb1d6f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564da4769390 0x564da4b3d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:04.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.628+0000 7febb2570640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564da47611b0 0x564da4b3cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:04.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.628+0000 7febb2d71640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564da478a070 0x564da4b490c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43478/0 (socket says 172.21.15.46:43478) 2024-09-21T04:04:04.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.628+0000 7febb2d71640 1 -- 172.21.15.46:0/2310760075 learned_addr learned my addr 172.21.15.46:0/2310760075 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:04.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.628+0000 7febb2d71640 1 -- 172.21.15.46:0/2310760075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564da47611b0 msgr2=0x564da4b3cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:04.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.628+0000 7febb2d71640 1 --2- 172.21.15.46:0/2310760075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564da47611b0 0x564da4b3cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:04.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.628+0000 7febb2d71640 1 -- 172.21.15.46:0/2310760075 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564da4769390 msgr2=0x564da4b3d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:04.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.628+0000 7febb2d71640 1 --2- 172.21.15.46:0/2310760075 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564da4769390 0x564da4b3d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:04.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.628+0000 7febb2d71640 1 -- 172.21.15.46:0/2310760075 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564da4a5fc40 con 0x564da478a070 2024-09-21T04:04:04.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.628+0000 7febb2d71640 1 --2- 172.21.15.46:0/2310760075 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564da478a070 0x564da4b490c0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7feba402a930 tx=0x7feba40037e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a49d55699832630a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:04.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.628+0000 7feb91ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:04:04.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.629+0000 7feb91ffb640 1 -- 172.21.15.46:0/2310760075 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba4051060 con 0x564da478a070 2024-09-21T04:04:04.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.629+0000 7feb91ffb640 1 -- 172.21.15.46:0/2310760075 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7feba403cc40 con 0x564da478a070 2024-09-21T04:04:04.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.629+0000 7febbad48740 1 -- 172.21.15.46:0/2310760075 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feba40316a0 con 0x564da478a070 2024-09-21T04:04:04.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.629+0000 7feb91ffb640 1 -- 172.21.15.46:0/2310760075 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7feba403f070 con 0x564da478a070 2024-09-21T04:04:04.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.629+0000 7febbad48740 10 client.16761 fetch_fsmap learned FSMap version 20 2024-09-21T04:04:04.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.629+0000 7febbad48740 1 -- 172.21.15.46:0/2310760075 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564da4b4bb40 con 0x564da478a070 2024-09-21T04:04:04.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.629+0000 7feb91ffb640 1 -- 172.21.15.46:0/2310760075 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feba40316a0 con 0x564da478a070 2024-09-21T04:04:04.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.629+0000 7feb91ffb640 1 -- 172.21.15.46:0/2310760075 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7feba4054070 con 0x564da478a070 2024-09-21T04:04:04.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.629+0000 7febbad48740 10 client.16761 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:04:04.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.629+0000 7febbad48740 10 client.16761 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:04:04.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.629+0000 7febbad48740 20 client.16761 populate_metadata read hostname 'smithi046' 2024-09-21T04:04:04.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.629+0000 7febbad48740 1 --2- 172.21.15.46:0/2310760075 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x564da47489f0 0x564da4b4eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:04.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.629+0000 7febbad48740 4 client.16761 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:04:04.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.629+0000 7febbad48740 1 -- 172.21.15.46:0/2310760075 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564da4aa9da0 con 0x564da47489f0 2024-09-21T04:04:04.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.630+0000 7febb2570640 1 --2- 172.21.15.46:0/2310760075 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x564da47489f0 0x564da4b4eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:04.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.630+0000 7feb91ffb640 10 client.16761 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:04.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.630+0000 7febb2570640 1 --2- 172.21.15.46:0/2310760075 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x564da47489f0 0x564da4b4eea0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0250acdbf3ef95c server_cookie=b8303f0bee382797 in_seq=0 out_seq=0 2024-09-21T04:04:04.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.631+0000 7feb91ffb640 1 -- 172.21.15.46:0/2310760075 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564da4aa9da0 con 0x564da47489f0 2024-09-21T04:04:04.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.631+0000 7feb91ffb640 10 client.16761 handle_command_reply: tid=0 2024-09-21T04:04:04.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.631+0000 7febbad48740 1 client.16761 shutdown 2024-09-21T04:04:04.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.631+0000 7febbad48740 1 -- 172.21.15.46:0/2310760075 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564da478a070 msgr2=0x564da4b490c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:04.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.631+0000 7febbad48740 1 --2- 172.21.15.46:0/2310760075 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564da478a070 0x564da4b490c0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7feba402a930 tx=0x7feba40037e0 comp rx=0 tx=0).stop 2024-09-21T04:04:04.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.631+0000 7febbad48740 1 -- 172.21.15.46:0/2310760075 shutdown_connections 2024-09-21T04:04:04.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.631+0000 7febbad48740 1 --2- 172.21.15.46:0/2310760075 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x564da47489f0 0x564da4b4eea0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:04.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.631+0000 7febbad48740 1 --2- 172.21.15.46:0/2310760075 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564da478a070 0x564da4b490c0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:04.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.631+0000 7febbad48740 1 --2- 172.21.15.46:0/2310760075 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564da4769390 0x564da4b3d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:04.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.631+0000 7febbad48740 1 --2- 172.21.15.46:0/2310760075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564da47611b0 0x564da4b3cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:04.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.631+0000 7febbad48740 1 -- 172.21.15.46:0/2310760075 >> 172.21.15.46:0/2310760075 conn(0x564da477e460 msgr2=0x564da4b34830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:04.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.631+0000 7feb91ffb640 0 client.16761 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:04.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.631+0000 7febbad48740 1 -- 172.21.15.46:0/2310760075 shutdown_connections 2024-09-21T04:04:04.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.631+0000 7febbad48740 1 -- 172.21.15.46:0/2310760075 wait complete. 2024-09-21T04:04:04.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.632+0000 7febbad48740 20 client.16761 trim_cache size 0 max 16384 2024-09-21T04:04:04.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.649+0000 7febbad48740 1 Processor -- start 2024-09-21T04:04:04.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.649+0000 7febbad48740 1 -- start start 2024-09-21T04:04:04.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.649+0000 7febbad48740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564da47611b0 0x564da4b3d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:04.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.649+0000 7febbad48740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564da4769390 0x564da4b49030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:04.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.649+0000 7febbad48740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564da478a070 0x564da4b39f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:04.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.649+0000 7febbad48740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7febac1ad670 con 0x564da478a070 2024-09-21T04:04:04.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.649+0000 7febbad48740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7febac1afed0 con 0x564da47611b0 2024-09-21T04:04:04.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.649+0000 7febbad48740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7febac1adcc0 con 0x564da4769390 2024-09-21T04:04:04.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.649+0000 7febb2d71640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564da478a070 0x564da4b39f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:04.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.649+0000 7febb2d71640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564da478a070 0x564da4b39f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43484/0 (socket says 172.21.15.46:43484) 2024-09-21T04:04:04.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.649+0000 7febb2d71640 1 -- 172.21.15.46:0/299398565 learned_addr learned my addr 172.21.15.46:0/299398565 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:04.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.649+0000 7febb1d6f640 1 --2- 172.21.15.46:0/299398565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564da4769390 0x564da4b49030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:04.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.650+0000 7febb2570640 1 --2- 172.21.15.46:0/299398565 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564da47611b0 0x564da4b3d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:04.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.650+0000 7febb2d71640 1 -- 172.21.15.46:0/299398565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564da4769390 msgr2=0x564da4b49030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:04.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.650+0000 7febb2d71640 1 --2- 172.21.15.46:0/299398565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564da4769390 0x564da4b49030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:04.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.650+0000 7febb2d71640 1 -- 172.21.15.46:0/299398565 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564da47611b0 msgr2=0x564da4b3d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:04.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.650+0000 7febb2d71640 1 --2- 172.21.15.46:0/299398565 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564da47611b0 0x564da4b3d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:04.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.650+0000 7febb2d71640 1 -- 172.21.15.46:0/299398565 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564da4b3bcd0 con 0x564da478a070 2024-09-21T04:04:04.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.650+0000 7febb1d6f640 1 --2- 172.21.15.46:0/299398565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564da4769390 0x564da4b49030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:04:04.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.650+0000 7febb2570640 1 --2- 172.21.15.46:0/299398565 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564da47611b0 0x564da4b3d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:04:04.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.650+0000 7febb2d71640 1 --2- 172.21.15.46:0/299398565 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564da478a070 0x564da4b39f60 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7feba4031440 tx=0x7feba40038b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffcf5fd81001569e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:04.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.650+0000 7feb93fff640 1 -- 172.21.15.46:0/299398565 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba4051040 con 0x564da478a070 2024-09-21T04:04:04.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.650+0000 7feb93fff640 1 -- 172.21.15.46:0/299398565 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feba4004ca0 con 0x564da478a070 2024-09-21T04:04:04.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.650+0000 7feb93fff640 1 -- 172.21.15.46:0/299398565 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba4031e60 con 0x564da478a070 2024-09-21T04:04:04.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.651+0000 7febbad48740 1 -- 172.21.15.46:0/299398565 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564da478a070 msgr2=0x564da4b39f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:04.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.651+0000 7febbad48740 1 --2- 172.21.15.46:0/299398565 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564da478a070 0x564da4b39f60 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7feba4031440 tx=0x7feba40038b0 comp rx=0 tx=0).stop 2024-09-21T04:04:04.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.651+0000 7febbad48740 1 -- 172.21.15.46:0/299398565 shutdown_connections 2024-09-21T04:04:04.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.651+0000 7febbad48740 1 --2- 172.21.15.46:0/299398565 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564da478a070 0x564da4b39f60 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:04.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.651+0000 7febbad48740 1 --2- 172.21.15.46:0/299398565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564da4769390 0x564da4b49030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:04.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.651+0000 7febbad48740 1 --2- 172.21.15.46:0/299398565 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564da47611b0 0x564da4b3d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:04.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.651+0000 7febbad48740 1 -- 172.21.15.46:0/299398565 >> 172.21.15.46:0/299398565 conn(0x564da477e460 msgr2=0x564da4b3cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:04.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.651+0000 7febbad48740 1 -- 172.21.15.46:0/299398565 shutdown_connections 2024-09-21T04:04:04.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.651+0000 7febbad48740 1 -- 172.21.15.46:0/299398565 wait complete. 2024-09-21T04:04:04.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.651+0000 7febbad48740 1 -- start start 2024-09-21T04:04:04.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.652+0000 7febbad48740 1 Processor -- start 2024-09-21T04:04:04.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.652+0000 7febbad48740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564da47611b0 0x564da4b528f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:04.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.652+0000 7febbad48740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564da4769390 0x564da4b4fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:04.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.652+0000 7febbad48740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564da478a070 0x564da4b50530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:04.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.652+0000 7febbad48740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7febac1ae390 con 0x564da47611b0 2024-09-21T04:04:04.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.652+0000 7febbad48740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7febac1af800 con 0x564da4769390 2024-09-21T04:04:04.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.652+0000 7febbad48740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7febac1aea60 con 0x564da478a070 2024-09-21T04:04:04.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.652+0000 7febbad48740 10 client.0 _ll_register_callbacks cb 0x7feb9c009790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:04:04.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.652+0000 7febb2570640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564da47611b0 0x564da4b528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:04.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.652+0000 7febb2570640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564da47611b0 0x564da4b528f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43490/0 (socket says 172.21.15.46:43490) 2024-09-21T04:04:04.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.652+0000 7febb2570640 1 -- 172.21.15.46:0/796947720 learned_addr learned my addr 172.21.15.46:0/796947720 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:04.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.652+0000 7febb2d71640 1 --2- 172.21.15.46:0/796947720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564da478a070 0x564da4b50530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:04.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.652+0000 7febb2570640 1 -- 172.21.15.46:0/796947720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564da478a070 msgr2=0x564da4b50530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:04.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.652+0000 7febb2570640 1 --2- 172.21.15.46:0/796947720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564da478a070 0x564da4b50530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:04.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.652+0000 7febb2570640 1 -- 172.21.15.46:0/796947720 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564da4769390 msgr2=0x564da4b4fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:04.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.652+0000 7febb2570640 1 --2- 172.21.15.46:0/796947720 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564da4769390 0x564da4b4fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:04.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.652+0000 7febb2570640 1 -- 172.21.15.46:0/796947720 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564da4bb8620 con 0x564da47611b0 2024-09-21T04:04:04.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.652+0000 7febb2d71640 1 --2- 172.21.15.46:0/796947720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564da478a070 0x564da4b50530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:04:04.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.653+0000 7febb2570640 1 --2- 172.21.15.46:0/796947720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564da47611b0 0x564da4b528f0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7feb9c007840 tx=0x7feb9c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b620887a4b40eaeb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:04.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.653+0000 7feb91ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:04:04.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.653+0000 7feb91ffb640 1 -- 172.21.15.46:0/796947720 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9c030070 con 0x564da47611b0 2024-09-21T04:04:04.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.653+0000 7feb91ffb640 1 -- 172.21.15.46:0/796947720 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7feb9c026bc0 con 0x564da47611b0 2024-09-21T04:04:04.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.653+0000 7febbad48740 1 -- 172.21.15.46:0/796947720 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feba4004ca0 con 0x564da47611b0 2024-09-21T04:04:04.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.653+0000 7feb91ffb640 1 -- 172.21.15.46:0/796947720 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7feb9c03c050 con 0x564da47611b0 2024-09-21T04:04:04.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.653+0000 7febbad48740 10 client.16767 fetch_fsmap learned FSMap version 20 2024-09-21T04:04:04.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.653+0000 7febbad48740 1 -- 172.21.15.46:0/796947720 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564da4bb9780 con 0x564da47611b0 2024-09-21T04:04:04.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.653+0000 7feb91ffb640 1 -- 172.21.15.46:0/796947720 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feba4004ca0 con 0x564da47611b0 2024-09-21T04:04:04.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.653+0000 7feb91ffb640 1 -- 172.21.15.46:0/796947720 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7feb9c024670 con 0x564da47611b0 2024-09-21T04:04:04.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.653+0000 7febbad48740 10 client.16767 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:04:04.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.653+0000 7febbad48740 10 client.16767 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:04:04.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.653+0000 7febbad48740 20 client.16767 populate_metadata read hostname 'smithi046' 2024-09-21T04:04:04.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.653+0000 7febbad48740 1 --2- 172.21.15.46:0/796947720 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x564da471dda0 0x564da4bbbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:04.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.653+0000 7febbad48740 4 client.16767 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T04:04:04.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.654+0000 7febbad48740 1 -- 172.21.15.46:0/796947720 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564da4aa5850 con 0x564da471dda0 2024-09-21T04:04:04.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.654+0000 7febb1d6f640 1 --2- 172.21.15.46:0/796947720 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x564da471dda0 0x564da4bbbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:04.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.654+0000 7febb1d6f640 1 --2- 172.21.15.46:0/796947720 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x564da471dda0 0x564da4bbbf60 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96f344f71e9ebac7 server_cookie=aae0b18adfd02fa6 in_seq=0 out_seq=0 2024-09-21T04:04:04.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.654+0000 7feb91ffb640 10 client.16767 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:04.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.654+0000 7feb91ffb640 1 -- 172.21.15.46:0/796947720 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5202 (crc 0 0 0) 0x564da4aa5850 con 0x564da471dda0 2024-09-21T04:04:04.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.654+0000 7feb91ffb640 10 client.16767 handle_command_reply: tid=0 2024-09-21T04:04:04.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.654+0000 7febbad48740 1 client.16767 shutdown 2024-09-21T04:04:04.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.655+0000 7febbad48740 1 -- 172.21.15.46:0/796947720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564da47611b0 msgr2=0x564da4b528f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:04.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.655+0000 7febbad48740 1 --2- 172.21.15.46:0/796947720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564da47611b0 0x564da4b528f0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7feb9c007840 tx=0x7feb9c004a40 comp rx=0 tx=0).stop 2024-09-21T04:04:04.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.655+0000 7febbad48740 1 -- 172.21.15.46:0/796947720 shutdown_connections 2024-09-21T04:04:04.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.655+0000 7febbad48740 1 --2- 172.21.15.46:0/796947720 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x564da471dda0 0x564da4bbbf60 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:04.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.655+0000 7feb91ffb640 0 client.16767 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:04.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.655+0000 7febbad48740 1 --2- 172.21.15.46:0/796947720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564da478a070 0x564da4b50530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:04.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.655+0000 7febbad48740 1 --2- 172.21.15.46:0/796947720 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564da4769390 0x564da4b4fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:04.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.655+0000 7febbad48740 1 --2- 172.21.15.46:0/796947720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564da47611b0 0x564da4b528f0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:04.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.655+0000 7febbad48740 1 -- 172.21.15.46:0/796947720 >> 172.21.15.46:0/796947720 conn(0x564da477e460 msgr2=0x564da4b32610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:04.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.655+0000 7febbad48740 1 -- 172.21.15.46:0/796947720 shutdown_connections 2024-09-21T04:04:04.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.655+0000 7febbad48740 1 -- 172.21.15.46:0/796947720 wait complete. 2024-09-21T04:04:04.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.655+0000 7febbad48740 20 client.16767 trim_cache size 0 max 16384 2024-09-21T04:04:04.662 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T04:04:04.662 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "no active scrubs running", 2024-09-21T04:04:04.663 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": {}, 2024-09-21T04:04:04.663 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_stats": { 2024-09-21T04:04:04.663 INFO:teuthology.orchestra.run.smithi046.stdout: "50776be6-bb03-4b39-ad4d-719e50e97356": { 2024-09-21T04:04:04.663 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:04:03.083808+0000", 2024-09-21T04:04:04.663 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:04.663 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:04.663 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:04.663 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:04.663 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:04.663 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:04.663 INFO:teuthology.orchestra.run.smithi046.stdout: "cfba6404-dc3f-4ad2-b873-926d5f9007de": { 2024-09-21T04:04:04.663 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:03:23.788611+0000", 2024-09-21T04:04:04.663 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:04.663 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:04.664 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:04.664 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:04.664 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:04.664 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:04.664 INFO:teuthology.orchestra.run.smithi046.stdout: "96aa13fd-aa77-46b5-b20e-a9b203dc7a94": { 2024-09-21T04:04:04.664 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:02:44.727411+0000", 2024-09-21T04:04:04.664 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:04.664 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:04.664 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:04.664 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:04.664 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:04.664 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:04.664 INFO:teuthology.orchestra.run.smithi046.stdout: "64865e31-a445-43e8-9fa3-26fae089b973": { 2024-09-21T04:04:04.665 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:02:37.376562+0000", 2024-09-21T04:04:04.665 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:04.665 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:04.665 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:04.665 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:04.665 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:04.665 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:04.665 INFO:teuthology.orchestra.run.smithi046.stdout: "7a3afabe-6b27-4bce-928a-8c6773a85803": { 2024-09-21T04:04:04.665 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:01:58.413358+0000", 2024-09-21T04:04:04.665 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:04.665 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:04.665 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:04.665 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:04.665 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:04.665 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:04.666 INFO:teuthology.orchestra.run.smithi046.stdout: "08f0c962-df1a-4129-a1a2-b916240d9803": { 2024-09-21T04:04:04.666 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:02.937596+0000", 2024-09-21T04:04:04.666 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:04.666 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:04.666 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:04.666 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:04.666 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:04.666 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:04.666 INFO:teuthology.orchestra.run.smithi046.stdout: "d49f33a7-3d5a-421b-94ba-8b19a4120db1": { 2024-09-21T04:04:04.666 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:50.480786+0000", 2024-09-21T04:04:04.666 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:04.666 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:04.666 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:04.667 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:04.667 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:04.667 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:04.667 INFO:teuthology.orchestra.run.smithi046.stdout: "a871f724-0198-493c-b03e-b2de78aba243": { 2024-09-21T04:04:04.667 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:56:30.082991+0000", 2024-09-21T04:04:04.667 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:04.667 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:04.667 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:04.667 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:04.667 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:04.667 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:04.667 INFO:teuthology.orchestra.run.smithi046.stdout: "edc4b8c7-b702-489d-a925-ae7ad0ff0d9a": { 2024-09-21T04:04:04.667 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:00:40.181950+0000", 2024-09-21T04:04:04.667 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:04.668 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:04.668 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:04.668 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:04.668 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:04.668 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:04.668 INFO:teuthology.orchestra.run.smithi046.stdout: "3bbf7097-70d7-4743-bbce-41465502b35b": { 2024-09-21T04:04:04.668 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:10.661441+0000", 2024-09-21T04:04:04.668 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:04.668 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:04.668 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:04.668 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:04.668 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:04.668 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:04.668 INFO:teuthology.orchestra.run.smithi046.stdout: "e24ec8f1-0d13-478f-9c2c-b51798868ffc": { 2024-09-21T04:04:04.669 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:09.736194+0000", 2024-09-21T04:04:04.669 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:04.669 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:04.669 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:04.669 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:04.669 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:04.669 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:04.669 INFO:teuthology.orchestra.run.smithi046.stdout: "c47f458a-de5e-4952-a575-a81261953667": { 2024-09-21T04:04:04.669 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:48.699411+0000", 2024-09-21T04:04:04.669 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:04.669 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:04.669 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:04.670 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:04.670 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:04.670 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:04.670 INFO:teuthology.orchestra.run.smithi046.stdout: "6103c660-8e77-4b06-ad6c-bb322c26035a": { 2024-09-21T04:04:04.670 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:35.594467+0000", 2024-09-21T04:04:04.670 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:04.670 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:04.670 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:04.670 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:04.670 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:04.670 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:04.670 INFO:teuthology.orchestra.run.smithi046.stdout: "46bb5415-6e16-47c6-a1e4-55f9c623ce90": { 2024-09-21T04:04:04.670 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:14.950674+0000", 2024-09-21T04:04:04.670 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:04.671 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:04.671 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:04.671 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:04.671 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:04.671 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:04.671 INFO:teuthology.orchestra.run.smithi046.stdout: "326aaecf-f38a-4946-988a-d83f25556995": { 2024-09-21T04:04:04.671 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:54.189884+0000", 2024-09-21T04:04:04.671 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:04.671 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:04.671 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:04.671 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:04.671 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:04.671 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:04.671 INFO:teuthology.orchestra.run.smithi046.stdout: "dab67652-8894-4711-be64-cbdfea27a9ba": { 2024-09-21T04:04:04.672 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:28.161616+0000", 2024-09-21T04:04:04.672 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:04.672 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:04.672 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:04.672 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:04.672 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:04.672 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:04.672 INFO:teuthology.orchestra.run.smithi046.stdout: "0d781b95-cf5e-46f2-9875-2923181385e2": { 2024-09-21T04:04:04.672 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:00:33.099094+0000", 2024-09-21T04:04:04.672 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:04.672 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:04.672 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:04.673 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:04.673 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:04.673 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:04.673 INFO:teuthology.orchestra.run.smithi046.stdout: "d7634007-e881-46f7-9833-ac9bd0a3100e": { 2024-09-21T04:04:04.673 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:01:19.459151+0000", 2024-09-21T04:04:04.673 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:04.673 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:04.673 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:04.673 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:04.673 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:04.673 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:04:04.673 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:04:04.673 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T04:04:04.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.656+0000 7febb47d4640 1 -- 172.21.15.46:0/1409970971 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7feb940b6680 msgr2=0x7feb940b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:04.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.656+0000 7febb47d4640 1 --2- 172.21.15.46:0/1409970971 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7feb940b6680 0x7feb940b8b90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x564da4b302d0 tx=0x7feb9c00e040 comp rx=0 tx=0).stop 2024-09-21T04:04:04.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.656+0000 7febb47d4640 1 -- 172.21.15.46:0/1409970971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febac105270 msgr2=0x7febac19ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:04.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.656+0000 7febb47d4640 1 --2- 172.21.15.46:0/1409970971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febac105270 0x7febac19ab60 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7feba0006fd0 tx=0x7feba000b8e0 comp rx=0 tx=0).stop 2024-09-21T04:04:04.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.656+0000 7febb47d4640 1 -- 172.21.15.46:0/1409970971 shutdown_connections 2024-09-21T04:04:04.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.656+0000 7febb47d4640 1 --2- 172.21.15.46:0/1409970971 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7feb940b6680 0x7feb940b8b90 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:04.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.656+0000 7febb47d4640 1 --2- 172.21.15.46:0/1409970971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febac10ddf0 0x7febac19fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:04.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.656+0000 7febb47d4640 1 --2- 172.21.15.46:0/1409970971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febac105270 0x7febac19ab60 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:04.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.656+0000 7febb47d4640 1 --2- 172.21.15.46:0/1409970971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7febac104840 0x7febac19a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:04.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.656+0000 7febb47d4640 1 -- 172.21.15.46:0/1409970971 >> 172.21.15.46:0/1409970971 conn(0x7febac079730 msgr2=0x7febac100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:04.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.656+0000 7febb47d4640 1 -- 172.21.15.46:0/1409970971 shutdown_connections 2024-09-21T04:04:04.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:04.656+0000 7febb47d4640 1 -- 172.21.15.46:0/1409970971 wait complete. 2024-09-21T04:04:05.410 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T04:04:05.411 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:04:05.668 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:04:06.061 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:05 smithi046 ceph-mon[30954]: pgmap v595: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-21T04:04:06.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.150+0000 7f73ba80d640 1 -- 172.21.15.46:0/462274574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73b4103b60 msgr2=0x7f73b4103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:06.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.150+0000 7f73ba80d640 1 --2- 172.21.15.46:0/462274574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73b4103b60 0x7f73b4103f70 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f73a4009900 tx=0x7f73a402a410 comp rx=0 tx=0).stop 2024-09-21T04:04:06.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.151+0000 7f73ba80d640 1 -- 172.21.15.46:0/462274574 shutdown_connections 2024-09-21T04:04:06.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.151+0000 7f73ba80d640 1 --2- 172.21.15.46:0/462274574 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73b4109df0 0x7f73b4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:06.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.151+0000 7f73ba80d640 1 --2- 172.21.15.46:0/462274574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73b41094a0 0x7f73b41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:06.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.151+0000 7f73ba80d640 1 --2- 172.21.15.46:0/462274574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73b4103b60 0x7f73b4103f70 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:06.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.151+0000 7f73ba80d640 1 -- 172.21.15.46:0/462274574 >> 172.21.15.46:0/462274574 conn(0x7f73b407b850 msgr2=0x7f73b407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:06.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.151+0000 7f73ba80d640 1 -- 172.21.15.46:0/462274574 shutdown_connections 2024-09-21T04:04:06.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.151+0000 7f73ba80d640 1 -- 172.21.15.46:0/462274574 wait complete. 2024-09-21T04:04:06.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.151+0000 7f73ba80d640 1 Processor -- start 2024-09-21T04:04:06.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.151+0000 7f73ba80d640 1 -- start start 2024-09-21T04:04:06.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.152+0000 7f73ba80d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73b4103b60 0x7f73b419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:06.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.152+0000 7f73ba80d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73b41094a0 0x7f73b419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:06.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.152+0000 7f73ba80d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73b4109df0 0x7f73b419fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:06.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.152+0000 7f73ba80d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f73b4113ab0 con 0x7f73b41094a0 2024-09-21T04:04:06.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.152+0000 7f73ba80d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f73b4113930 con 0x7f73b4109df0 2024-09-21T04:04:06.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.152+0000 7f73ba80d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f73b4113c30 con 0x7f73b4103b60 2024-09-21T04:04:06.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.152+0000 7f73b37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73b41094a0 0x7f73b419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:06.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.152+0000 7f73b37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73b41094a0 0x7f73b419aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43504/0 (socket says 172.21.15.46:43504) 2024-09-21T04:04:06.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.152+0000 7f73b37fe640 1 -- 172.21.15.46:0/252470369 learned_addr learned my addr 172.21.15.46:0/252470369 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:06.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.152+0000 7f73b8daa640 1 --2- 172.21.15.46:0/252470369 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73b4109df0 0x7f73b419fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:06.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.152+0000 7f73b3fff640 1 --2- 172.21.15.46:0/252470369 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73b4103b60 0x7f73b419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:06.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.152+0000 7f73b37fe640 1 -- 172.21.15.46:0/252470369 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73b4103b60 msgr2=0x7f73b419a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:06.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.152+0000 7f73b37fe640 1 --2- 172.21.15.46:0/252470369 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73b4103b60 0x7f73b419a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:06.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.152+0000 7f73b37fe640 1 -- 172.21.15.46:0/252470369 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73b4109df0 msgr2=0x7f73b419fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:06.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.152+0000 7f73b37fe640 1 --2- 172.21.15.46:0/252470369 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73b4109df0 0x7f73b419fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:06.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.152+0000 7f73b37fe640 1 -- 172.21.15.46:0/252470369 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73b41a0410 con 0x7f73b41094a0 2024-09-21T04:04:06.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.152+0000 7f73b37fe640 1 --2- 172.21.15.46:0/252470369 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73b41094a0 0x7f73b419aa40 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f73a800d950 tx=0x7f73a800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:06.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.153+0000 7f73b17fa640 1 -- 172.21.15.46:0/252470369 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a8017070 con 0x7f73b41094a0 2024-09-21T04:04:06.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.153+0000 7f73ba80d640 1 -- 172.21.15.46:0/252470369 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73b41a0700 con 0x7f73b41094a0 2024-09-21T04:04:06.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.153+0000 7f73b17fa640 1 -- 172.21.15.46:0/252470369 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73a8009c30 con 0x7f73b41094a0 2024-09-21T04:04:06.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.153+0000 7f73b17fa640 1 -- 172.21.15.46:0/252470369 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a80047a0 con 0x7f73b41094a0 2024-09-21T04:04:06.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.153+0000 7f73ba80d640 1 -- 172.21.15.46:0/252470369 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73b41a6e60 con 0x7f73b41094a0 2024-09-21T04:04:06.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.154+0000 7f73ba80d640 1 -- 172.21.15.46:0/252470369 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73b4103f70 con 0x7f73b41094a0 2024-09-21T04:04:06.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.155+0000 7f73b17fa640 1 -- 172.21.15.46:0/252470369 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f73a8004020 con 0x7f73b41094a0 2024-09-21T04:04:06.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.156+0000 7f73b17fa640 1 --2- 172.21.15.46:0/252470369 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f739c0b6680 0x7f739c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:06.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.157+0000 7f73b3fff640 1 --2- 172.21.15.46:0/252470369 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f739c0b6680 0x7f739c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:06.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.157+0000 7f73b17fa640 1 -- 172.21.15.46:0/252470369 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f73a80e7800 con 0x7f73b41094a0 2024-09-21T04:04:06.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.157+0000 7f73b3fff640 1 --2- 172.21.15.46:0/252470369 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f739c0b6680 0x7f739c0b8b90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f73a4005f70 tx=0x7f73a4000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:06.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.160+0000 7f73b17fa640 1 -- 172.21.15.46:0/252470369 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f73a8020020 con 0x7f73b41094a0 2024-09-21T04:04:06.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:05 smithi105 ceph-mon[34773]: pgmap v595: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-21T04:04:06.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:05 smithi162 ceph-mon[35071]: pgmap v595: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-21T04:04:06.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.384+0000 7f73ba80d640 1 -- 172.21.15.46:0/252470369 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f73b419b5d0 con 0x7f73b41094a0 2024-09-21T04:04:06.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.385+0000 7f73b17fa640 1 -- 172.21.15.46:0/252470369 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f73a80addc0 con 0x7f73b41094a0 2024-09-21T04:04:06.387 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T04:04:06.388 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T04:04:06.388 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"btime":"2024-09-21T03:53:23:865820+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1766354184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1766354184},{"type":"v1","addr":"172.21.15.46:6839","nonce":1766354184}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/1901774207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":1901774207},{"type":"v1","addr":"172.21.15.46:6841","nonce":1901774207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3548633196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":3548633196},{"type":"v1","addr":"172.21.15.105:6837","nonce":3548633196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24652,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3551934241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3551934241},{"type":"v1","addr":"172.21.15.162:6835","nonce":3551934241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/48949822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":48949822},{"type":"v1","addr":"172.21.15.162:6837","nonce":48949822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:53:14.452819+0000","modified":"2024-09-21T03:53:23.593278+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24680},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/2196053213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2196053213},{"type":"v1","addr":"172.21.15.162:6839","nonce":2196053213}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.105:6839/3911438406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":3911438406},{"type":"v1","addr":"172.21.15.105:6839","nonce":3911438406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24680,"qdb_cluster":[24680]},"id":1}]} 2024-09-21T04:04:06.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.387+0000 7f73ba80d640 1 -- 172.21.15.46:0/252470369 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f739c0b6680 msgr2=0x7f739c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.387+0000 7f73ba80d640 1 --2- 172.21.15.46:0/252470369 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f739c0b6680 0x7f739c0b8b90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f73a4005f70 tx=0x7f73a4000bc0 comp rx=0 tx=0).stop 2024-09-21T04:04:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.387+0000 7f73ba80d640 1 -- 172.21.15.46:0/252470369 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73b41094a0 msgr2=0x7f73b419aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.387+0000 7f73ba80d640 1 --2- 172.21.15.46:0/252470369 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73b41094a0 0x7f73b419aa40 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f73a800d950 tx=0x7f73a800de10 comp rx=0 tx=0).stop 2024-09-21T04:04:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.387+0000 7f73ba80d640 1 -- 172.21.15.46:0/252470369 shutdown_connections 2024-09-21T04:04:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.387+0000 7f73ba80d640 1 --2- 172.21.15.46:0/252470369 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73b4109df0 0x7f73b419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.387+0000 7f73ba80d640 1 --2- 172.21.15.46:0/252470369 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73b41094a0 0x7f73b419aa40 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.387+0000 7f73ba80d640 1 --2- 172.21.15.46:0/252470369 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f739c0b6680 0x7f739c0b8b90 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.387+0000 7f73ba80d640 1 --2- 172.21.15.46:0/252470369 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73b4103b60 0x7f73b419a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.387+0000 7f73ba80d640 1 -- 172.21.15.46:0/252470369 >> 172.21.15.46:0/252470369 conn(0x7f73b407b850 msgr2=0x7f73b4107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.387+0000 7f73ba80d640 1 -- 172.21.15.46:0/252470369 shutdown_connections 2024-09-21T04:04:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:06.387+0000 7f73ba80d640 1 -- 172.21.15.46:0/252470369 wait complete. 2024-09-21T04:04:07.033 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:06 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/252470369' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:04:07.062 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T04:04:07.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:06 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/252470369' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:04:07.320 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:04:07.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:06 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/252470369' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:04:07.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.820+0000 7f6c9987c640 1 -- 172.21.15.46:0/2282218454 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c94102a60 msgr2=0x7f6c94102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:07.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.820+0000 7f6c9987c640 1 --2- 172.21.15.46:0/2282218454 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c94102a60 0x7f6c94102e70 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c009900 tx=0x7f6c8c02a410 comp rx=0 tx=0).stop 2024-09-21T04:04:07.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.820+0000 7f6c9987c640 1 -- 172.21.15.46:0/2282218454 shutdown_connections 2024-09-21T04:04:07.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.820+0000 7f6c9987c640 1 --2- 172.21.15.46:0/2282218454 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c94108cf0 0x7f6c9410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:07.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.820+0000 7f6c9987c640 1 --2- 172.21.15.46:0/2282218454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c941083a0 0x7f6c941087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:07.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.820+0000 7f6c9987c640 1 --2- 172.21.15.46:0/2282218454 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c94102a60 0x7f6c94102e70 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:07.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.820+0000 7f6c9987c640 1 -- 172.21.15.46:0/2282218454 >> 172.21.15.46:0/2282218454 conn(0x7f6c94079730 msgr2=0x7f6c94079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:07.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.820+0000 7f6c9987c640 1 -- 172.21.15.46:0/2282218454 shutdown_connections 2024-09-21T04:04:07.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.820+0000 7f6c9987c640 1 -- 172.21.15.46:0/2282218454 wait complete. 2024-09-21T04:04:07.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.821+0000 7f6c9987c640 1 Processor -- start 2024-09-21T04:04:07.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.821+0000 7f6c9987c640 1 -- start start 2024-09-21T04:04:07.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.821+0000 7f6c9987c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c94102a60 0x7f6c9419a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:07.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.821+0000 7f6c9987c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c941083a0 0x7f6c9419a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:07.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.821+0000 7f6c9987c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c94108cf0 0x7f6c9419fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:07.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.821+0000 7f6c9987c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6c94112960 con 0x7f6c94108cf0 2024-09-21T04:04:07.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.821+0000 7f6c9987c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6c941127e0 con 0x7f6c94102a60 2024-09-21T04:04:07.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.821+0000 7f6c9987c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6c94112ae0 con 0x7f6c941083a0 2024-09-21T04:04:07.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.822+0000 7f6c937fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c94108cf0 0x7f6c9419fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:07.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.822+0000 7f6c937fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c94108cf0 0x7f6c9419fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43516/0 (socket says 172.21.15.46:43516) 2024-09-21T04:04:07.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.822+0000 7f6c927fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c941083a0 0x7f6c9419a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:07.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.822+0000 7f6c937fe640 1 -- 172.21.15.46:0/3598422630 learned_addr learned my addr 172.21.15.46:0/3598422630 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:07.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.822+0000 7f6c92ffd640 1 --2- 172.21.15.46:0/3598422630 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c94102a60 0x7f6c9419a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:07.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.822+0000 7f6c937fe640 1 -- 172.21.15.46:0/3598422630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c941083a0 msgr2=0x7f6c9419a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:07.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.822+0000 7f6c937fe640 1 --2- 172.21.15.46:0/3598422630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c941083a0 0x7f6c9419a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:07.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.822+0000 7f6c937fe640 1 -- 172.21.15.46:0/3598422630 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c94102a60 msgr2=0x7f6c9419a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:07.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.822+0000 7f6c937fe640 1 --2- 172.21.15.46:0/3598422630 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c94102a60 0x7f6c9419a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:07.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.822+0000 7f6c937fe640 1 -- 172.21.15.46:0/3598422630 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c941a03b0 con 0x7f6c94108cf0 2024-09-21T04:04:07.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.822+0000 7f6c92ffd640 1 --2- 172.21.15.46:0/3598422630 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c94102a60 0x7f6c9419a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:04:07.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.822+0000 7f6c937fe640 1 --2- 172.21.15.46:0/3598422630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c94108cf0 0x7f6c9419fc80 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f6c8400eb10 tx=0x7f6c8400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:07.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.822+0000 7f6c9887a640 1 -- 172.21.15.46:0/3598422630 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c84004b20 con 0x7f6c94108cf0 2024-09-21T04:04:07.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.822+0000 7f6c9887a640 1 -- 172.21.15.46:0/3598422630 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c84004cc0 con 0x7f6c94108cf0 2024-09-21T04:04:07.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.822+0000 7f6c9987c640 1 -- 172.21.15.46:0/3598422630 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c941a06a0 con 0x7f6c94108cf0 2024-09-21T04:04:07.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.822+0000 7f6c9887a640 1 -- 172.21.15.46:0/3598422630 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c84010670 con 0x7f6c94108cf0 2024-09-21T04:04:07.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.822+0000 7f6c9987c640 1 -- 172.21.15.46:0/3598422630 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c941a6e00 con 0x7f6c94108cf0 2024-09-21T04:04:07.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.826+0000 7f6c9fdf0740 1 Processor -- start 2024-09-21T04:04:07.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.826+0000 7f6c9887a640 1 -- 172.21.15.46:0/3598422630 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f6c84005020 con 0x7f6c94108cf0 2024-09-21T04:04:07.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.826+0000 7f6c9fdf0740 1 -- start start 2024-09-21T04:04:07.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.826+0000 7f6c9fdf0740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e2aaacb070 0x55e2aae72290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:07.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.826+0000 7f6c9fdf0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e2aaaa21b0 0x55e2aae727d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:07.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.826+0000 7f6c9fdf0740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2aaaaa390 0x55e2aae72d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:07.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.826+0000 7f6c9fdf0740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55e2aade8ea0 con 0x55e2aaacb070 2024-09-21T04:04:07.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.826+0000 7f6c9fdf0740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55e2aadd82d0 con 0x55e2aaaaa390 2024-09-21T04:04:07.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.826+0000 7f6c9fdf0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e2aaddc0e0 con 0x55e2aaaa21b0 2024-09-21T04:04:07.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.826+0000 7f6c927fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e2aaacb070 0x55e2aae72290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:07.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.826+0000 7f6c927fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e2aaacb070 0x55e2aae72290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43524/0 (socket says 172.21.15.46:43524) 2024-09-21T04:04:07.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.826+0000 7f6c927fc640 1 -- 172.21.15.46:0/384883009 learned_addr learned my addr 172.21.15.46:0/384883009 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:07.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.826+0000 7f6c92ffd640 1 --2- 172.21.15.46:0/384883009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e2aaaa21b0 0x55e2aae727d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:07.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.827+0000 7f6c927fc640 1 --2- 172.21.15.46:0/384883009 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2aaaaa390 0x55e2aae72d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:07.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.827+0000 7f6c927fc640 1 -- 172.21.15.46:0/384883009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e2aaaa21b0 msgr2=0x55e2aae727d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:07.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.827+0000 7f6c927fc640 1 --2- 172.21.15.46:0/384883009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e2aaaa21b0 0x55e2aae727d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:07.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.827+0000 7f6c927fc640 1 -- 172.21.15.46:0/384883009 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2aaaaa390 msgr2=0x55e2aae72d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:07.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.827+0000 7f6c927fc640 1 --2- 172.21.15.46:0/384883009 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2aaaaa390 0x55e2aae72d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:07.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.827+0000 7f6c927fc640 1 -- 172.21.15.46:0/384883009 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2aab36650 con 0x55e2aaacb070 2024-09-21T04:04:07.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.827+0000 7f6c9887a640 1 --2- 172.21.15.46:0/3598422630 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f6c800b6700 0x7f6c800b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:07.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.827+0000 7f6c927fc640 1 --2- 172.21.15.46:0/384883009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e2aaacb070 0x55e2aae72290 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c013630 tx=0x7f6c7c009830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c6a769951ac9b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:07.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.827+0000 7f6c92ffd640 1 --2- 172.21.15.46:0/3598422630 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f6c800b6700 0x7f6c800b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:07.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.827+0000 7f6c9887a640 1 -- 172.21.15.46:0/3598422630 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f6c840e7c00 con 0x7f6c94108cf0 2024-09-21T04:04:07.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.827+0000 7f6c89ffb640 1 -- 172.21.15.46:0/384883009 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c004050 con 0x55e2aaacb070 2024-09-21T04:04:07.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.827+0000 7f6c89ffb640 1 -- 172.21.15.46:0/384883009 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c7c0054d0 con 0x55e2aaacb070 2024-09-21T04:04:07.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.827+0000 7f6c89ffb640 1 -- 172.21.15.46:0/384883009 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c004bc0 con 0x55e2aaacb070 2024-09-21T04:04:07.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.828+0000 7f6c9fdf0740 1 -- 172.21.15.46:0/384883009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e2aaacb070 msgr2=0x55e2aae72290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:07.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.828+0000 7f6c92ffd640 1 --2- 172.21.15.46:0/3598422630 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f6c800b6700 0x7f6c800b8c10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c031440 tx=0x7f6c8c032ed0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:07.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.828+0000 7f6c9fdf0740 1 --2- 172.21.15.46:0/384883009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e2aaacb070 0x55e2aae72290 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c013630 tx=0x7f6c7c009830 comp rx=0 tx=0).stop 2024-09-21T04:04:07.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.828+0000 7f6c9fdf0740 1 -- 172.21.15.46:0/384883009 shutdown_connections 2024-09-21T04:04:07.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.828+0000 7f6c9fdf0740 1 --2- 172.21.15.46:0/384883009 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2aaaaa390 0x55e2aae72d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:07.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.828+0000 7f6c9fdf0740 1 --2- 172.21.15.46:0/384883009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e2aaaa21b0 0x55e2aae727d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:07.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.828+0000 7f6c9fdf0740 1 --2- 172.21.15.46:0/384883009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e2aaacb070 0x55e2aae72290 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:07.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.828+0000 7f6c9fdf0740 1 -- 172.21.15.46:0/384883009 >> 172.21.15.46:0/384883009 conn(0x55e2aaabf460 msgr2=0x55e2aae70180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:07.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.828+0000 7f6c9fdf0740 1 -- 172.21.15.46:0/384883009 shutdown_connections 2024-09-21T04:04:07.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.828+0000 7f6c9fdf0740 1 -- 172.21.15.46:0/384883009 wait complete. 2024-09-21T04:04:07.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.829+0000 7f6c9fdf0740 1 -- start start 2024-09-21T04:04:07.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.829+0000 7f6c9fdf0740 1 Processor -- start 2024-09-21T04:04:07.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.829+0000 7f6c9fdf0740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e2aaaa21b0 0x55e2aae7d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:07.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.829+0000 7f6c9fdf0740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2aaaaa390 0x55e2aae7dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:07.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.829+0000 7f6c9fdf0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e2aaacb070 0x55e2aae89d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:07.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.829+0000 7f6c9fdf0740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55e2aac39700 con 0x55e2aaaa21b0 2024-09-21T04:04:07.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.829+0000 7f6c9fdf0740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55e2aad73160 con 0x55e2aaaaa390 2024-09-21T04:04:07.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.829+0000 7f6c9fdf0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e2aae80a70 con 0x55e2aaacb070 2024-09-21T04:04:07.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.829+0000 7f6c9fdf0740 10 client.0 _ll_register_callbacks cb 0x55e2aad8c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:04:07.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.829+0000 7f6c92ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e2aaaa21b0 0x55e2aae7d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:07.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.829+0000 7f6c92ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e2aaaa21b0 0x55e2aae7d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43532/0 (socket says 172.21.15.46:43532) 2024-09-21T04:04:07.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.829+0000 7f6c92ffd640 1 -- 172.21.15.46:0/573879691 learned_addr learned my addr 172.21.15.46:0/573879691 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:07.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.829+0000 7f6c927fc640 1 --2- 172.21.15.46:0/573879691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2aaaaa390 0x55e2aae7dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:07.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.829+0000 7f6c937fe640 1 --2- 172.21.15.46:0/573879691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e2aaacb070 0x55e2aae89d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:07.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.830+0000 7f6c92ffd640 1 -- 172.21.15.46:0/573879691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e2aaacb070 msgr2=0x55e2aae89d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:07.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.830+0000 7f6c92ffd640 1 --2- 172.21.15.46:0/573879691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e2aaacb070 0x55e2aae89d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:07.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.830+0000 7f6c92ffd640 1 -- 172.21.15.46:0/573879691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2aaaaa390 msgr2=0x55e2aae7dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:07.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.830+0000 7f6c92ffd640 1 --2- 172.21.15.46:0/573879691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2aaaaa390 0x55e2aae7dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:07.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.830+0000 7f6c92ffd640 1 -- 172.21.15.46:0/573879691 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2aada0c90 con 0x55e2aaaa21b0 2024-09-21T04:04:07.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.830+0000 7f6c927fc640 1 --2- 172.21.15.46:0/573879691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2aaaaa390 0x55e2aae7dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:04:07.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.830+0000 7f6c92ffd640 1 --2- 172.21.15.46:0/573879691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e2aaaa21b0 0x55e2aae7d9a0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c033000 tx=0x7f6c8c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d7129634b1de3a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:07.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.830+0000 7f6c72ffd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:04:07.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.830+0000 7f6c72ffd640 1 -- 172.21.15.46:0/573879691 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c035040 con 0x55e2aaaa21b0 2024-09-21T04:04:07.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.830+0000 7f6c9fdf0740 1 -- 172.21.15.46:0/573879691 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c7c0054d0 con 0x55e2aaaa21b0 2024-09-21T04:04:07.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.830+0000 7f6c72ffd640 1 -- 172.21.15.46:0/573879691 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f6c8c004320 con 0x55e2aaaa21b0 2024-09-21T04:04:07.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.830+0000 7f6c72ffd640 1 -- 172.21.15.46:0/573879691 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6c8c005040 con 0x55e2aaaa21b0 2024-09-21T04:04:07.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.830+0000 7f6c9fdf0740 10 client.16785 fetch_fsmap learned FSMap version 20 2024-09-21T04:04:07.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.830+0000 7f6c9fdf0740 1 -- 172.21.15.46:0/573879691 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55e2aae8c830 con 0x55e2aaaa21b0 2024-09-21T04:04:07.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.831+0000 7f6c72ffd640 1 -- 172.21.15.46:0/573879691 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c7c0054d0 con 0x55e2aaaa21b0 2024-09-21T04:04:07.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.831+0000 7f6c72ffd640 1 -- 172.21.15.46:0/573879691 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f6c8c05b050 con 0x55e2aaaa21b0 2024-09-21T04:04:07.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.831+0000 7f6c9fdf0740 10 client.16785 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:04:07.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.831+0000 7f6c9fdf0740 10 client.16785 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:04:07.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.831+0000 7f6c9fdf0740 20 client.16785 populate_metadata read hostname 'smithi046' 2024-09-21T04:04:07.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.831+0000 7f6c9fdf0740 1 --2- 172.21.15.46:0/573879691 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55e2aaa899f0 0x55e2aae8fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:07.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.831+0000 7f6c9fdf0740 4 client.16785 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:04:07.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.831+0000 7f6c9fdf0740 1 -- 172.21.15.46:0/573879691 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e2aadeadf0 con 0x55e2aaa899f0 2024-09-21T04:04:07.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.831+0000 7f6c927fc640 1 --2- 172.21.15.46:0/573879691 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55e2aaa899f0 0x55e2aae8fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:07.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.832+0000 7f6c927fc640 1 --2- 172.21.15.46:0/573879691 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55e2aaa899f0 0x55e2aae8fc90 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8684a583c30c7809 server_cookie=787020edb1451295 in_seq=0 out_seq=0 2024-09-21T04:04:07.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.832+0000 7f6c72ffd640 10 client.16785 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:07.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.832+0000 7f6c72ffd640 1 -- 172.21.15.46:0/573879691 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e2aadeadf0 con 0x55e2aaa899f0 2024-09-21T04:04:07.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.832+0000 7f6c72ffd640 10 client.16785 handle_command_reply: tid=0 2024-09-21T04:04:07.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.832+0000 7f6c9fdf0740 1 client.16785 shutdown 2024-09-21T04:04:07.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.833+0000 7f6c9fdf0740 1 -- 172.21.15.46:0/573879691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e2aaaa21b0 msgr2=0x55e2aae7d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:07.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.833+0000 7f6c9fdf0740 1 --2- 172.21.15.46:0/573879691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e2aaaa21b0 0x55e2aae7d9a0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c033000 tx=0x7f6c8c02a410 comp rx=0 tx=0).stop 2024-09-21T04:04:07.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.833+0000 7f6c9fdf0740 1 -- 172.21.15.46:0/573879691 shutdown_connections 2024-09-21T04:04:07.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.833+0000 7f6c9fdf0740 1 --2- 172.21.15.46:0/573879691 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55e2aaa899f0 0x55e2aae8fc90 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:07.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.833+0000 7f6c9fdf0740 1 --2- 172.21.15.46:0/573879691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e2aaacb070 0x55e2aae89d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:07.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.833+0000 7f6c9fdf0740 1 --2- 172.21.15.46:0/573879691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2aaaaa390 0x55e2aae7dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:07.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.833+0000 7f6c72ffd640 0 client.16785 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:07.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.833+0000 7f6c9fdf0740 1 --2- 172.21.15.46:0/573879691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e2aaaa21b0 0x55e2aae7d9a0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:07.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.833+0000 7f6c9fdf0740 1 -- 172.21.15.46:0/573879691 >> 172.21.15.46:0/573879691 conn(0x55e2aaabf460 msgr2=0x55e2aae75470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:07.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.833+0000 7f6c9fdf0740 1 -- 172.21.15.46:0/573879691 shutdown_connections 2024-09-21T04:04:07.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.833+0000 7f6c9fdf0740 1 -- 172.21.15.46:0/573879691 wait complete. 2024-09-21T04:04:07.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.833+0000 7f6c9fdf0740 20 client.16785 trim_cache size 0 max 16384 2024-09-21T04:04:07.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.847+0000 7f6c9fdf0740 1 Processor -- start 2024-09-21T04:04:07.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.847+0000 7f6c9fdf0740 1 -- start start 2024-09-21T04:04:07.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.847+0000 7f6c9fdf0740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2aaaa21b0 0x55e2aae75aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:07.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.847+0000 7f6c9fdf0740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e2aaaaa390 0x55e2aae89c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:07.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.847+0000 7f6c9fdf0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e2aaacb070 0x55e2aae6fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:07.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.847+0000 7f6c9fdf0740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6c941ab290 con 0x55e2aaaaa390 2024-09-21T04:04:07.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.847+0000 7f6c9fdf0740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6c941adaf0 con 0x55e2aaaa21b0 2024-09-21T04:04:07.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.847+0000 7f6c9fdf0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6c941ab8e0 con 0x55e2aaacb070 2024-09-21T04:04:07.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.847+0000 7f6c927fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e2aaaaa390 0x55e2aae89c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:07.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.847+0000 7f6c927fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e2aaaaa390 0x55e2aae89c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43536/0 (socket says 172.21.15.46:43536) 2024-09-21T04:04:07.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.847+0000 7f6c927fc640 1 -- 172.21.15.46:0/2712675347 learned_addr learned my addr 172.21.15.46:0/2712675347 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:07.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.847+0000 7f6c92ffd640 1 --2- 172.21.15.46:0/2712675347 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2aaaa21b0 0x55e2aae75aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:07.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.848+0000 7f6c937fe640 1 --2- 172.21.15.46:0/2712675347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e2aaacb070 0x55e2aae6fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:07.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.848+0000 7f6c927fc640 1 -- 172.21.15.46:0/2712675347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e2aaacb070 msgr2=0x55e2aae6fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:07.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.848+0000 7f6c927fc640 1 --2- 172.21.15.46:0/2712675347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e2aaacb070 0x55e2aae6fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:07.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.848+0000 7f6c927fc640 1 -- 172.21.15.46:0/2712675347 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2aaaa21b0 msgr2=0x55e2aae75aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:07.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.848+0000 7f6c927fc640 1 --2- 172.21.15.46:0/2712675347 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2aaaa21b0 0x55e2aae75aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:07.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.848+0000 7f6c927fc640 1 -- 172.21.15.46:0/2712675347 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2aae7ff80 con 0x55e2aaaaa390 2024-09-21T04:04:07.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.848+0000 7f6c92ffd640 1 --2- 172.21.15.46:0/2712675347 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2aaaa21b0 0x55e2aae75aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:04:07.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.848+0000 7f6c927fc640 1 --2- 172.21.15.46:0/2712675347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e2aaaaa390 0x55e2aae89c60 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c014f90 tx=0x7f6c7c009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b395f403a79587 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:07.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.848+0000 7f6c897fa640 1 -- 172.21.15.46:0/2712675347 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c02b030 con 0x55e2aaaaa390 2024-09-21T04:04:07.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.848+0000 7f6c897fa640 1 -- 172.21.15.46:0/2712675347 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c7c0054d0 con 0x55e2aaaaa390 2024-09-21T04:04:07.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.848+0000 7f6c897fa640 1 -- 172.21.15.46:0/2712675347 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c0042a0 con 0x55e2aaaaa390 2024-09-21T04:04:07.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.849+0000 7f6c9fdf0740 1 -- 172.21.15.46:0/2712675347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e2aaaaa390 msgr2=0x55e2aae89c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:07.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.849+0000 7f6c9fdf0740 1 --2- 172.21.15.46:0/2712675347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e2aaaaa390 0x55e2aae89c60 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c014f90 tx=0x7f6c7c009640 comp rx=0 tx=0).stop 2024-09-21T04:04:07.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.849+0000 7f6c9fdf0740 1 -- 172.21.15.46:0/2712675347 shutdown_connections 2024-09-21T04:04:07.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.849+0000 7f6c9fdf0740 1 --2- 172.21.15.46:0/2712675347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e2aaacb070 0x55e2aae6fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:07.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.849+0000 7f6c9fdf0740 1 --2- 172.21.15.46:0/2712675347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e2aaaaa390 0x55e2aae89c60 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:07.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.849+0000 7f6c9fdf0740 1 --2- 172.21.15.46:0/2712675347 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2aaaa21b0 0x55e2aae75aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:07.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.849+0000 7f6c9fdf0740 1 -- 172.21.15.46:0/2712675347 >> 172.21.15.46:0/2712675347 conn(0x55e2aaabf460 msgr2=0x55e2aae75390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:07.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.849+0000 7f6c9fdf0740 1 -- 172.21.15.46:0/2712675347 shutdown_connections 2024-09-21T04:04:07.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.849+0000 7f6c9fdf0740 1 -- 172.21.15.46:0/2712675347 wait complete. 2024-09-21T04:04:07.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.849+0000 7f6c9fdf0740 1 -- start start 2024-09-21T04:04:07.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.850+0000 7f6c9fdf0740 1 Processor -- start 2024-09-21T04:04:07.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.850+0000 7f6c9fdf0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e2aaaa21b0 0x55e2aae864c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:07.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.850+0000 7f6c9fdf0740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2aaaaa390 0x55e2aae819c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:07.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.850+0000 7f6c9fdf0740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e2aaacb070 0x55e2aae81f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:07.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.850+0000 7f6c9fdf0740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6c941abfb0 con 0x55e2aaacb070 2024-09-21T04:04:07.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.850+0000 7f6c9fdf0740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6c941ad420 con 0x55e2aaaaa390 2024-09-21T04:04:07.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.850+0000 7f6c9fdf0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6c941ac680 con 0x55e2aaaa21b0 2024-09-21T04:04:07.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.850+0000 7f6c9fdf0740 10 client.0 _ll_register_callbacks cb 0x7f6c8c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:04:07.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.850+0000 7f6c937fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e2aaacb070 0x55e2aae81f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:07.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.850+0000 7f6c937fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e2aaacb070 0x55e2aae81f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43538/0 (socket says 172.21.15.46:43538) 2024-09-21T04:04:07.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.850+0000 7f6c937fe640 1 -- 172.21.15.46:0/2151744365 learned_addr learned my addr 172.21.15.46:0/2151744365 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:07.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.850+0000 7f6c92ffd640 1 --2- 172.21.15.46:0/2151744365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e2aaaa21b0 0x55e2aae864c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:07.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.850+0000 7f6c927fc640 1 --2- 172.21.15.46:0/2151744365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2aaaaa390 0x55e2aae819c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:07.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.850+0000 7f6c937fe640 1 -- 172.21.15.46:0/2151744365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e2aaaa21b0 msgr2=0x55e2aae864c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:07.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.850+0000 7f6c937fe640 1 --2- 172.21.15.46:0/2151744365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e2aaaa21b0 0x55e2aae864c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:07.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.850+0000 7f6c937fe640 1 -- 172.21.15.46:0/2151744365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2aaaaa390 msgr2=0x55e2aae819c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:07.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.850+0000 7f6c937fe640 1 --2- 172.21.15.46:0/2151744365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2aaaaa390 0x55e2aae819c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:07.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.850+0000 7f6c937fe640 1 -- 172.21.15.46:0/2151744365 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2aae826b0 con 0x55e2aaacb070 2024-09-21T04:04:07.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.851+0000 7f6c92ffd640 1 --2- 172.21.15.46:0/2151744365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e2aaaa21b0 0x55e2aae864c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:04:07.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.851+0000 7f6c937fe640 1 --2- 172.21.15.46:0/2151744365 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e2aaacb070 0x55e2aae81f20 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f6c840049d0 tx=0x7f6c840ad410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7705427818b5345 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:07.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.851+0000 7f6c72ffd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:04:07.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.851+0000 7f6c72ffd640 1 -- 172.21.15.46:0/2151744365 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c840ad5d0 con 0x55e2aaacb070 2024-09-21T04:04:07.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.851+0000 7f6c72ffd640 1 -- 172.21.15.46:0/2151744365 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f6c840b7050 con 0x55e2aaacb070 2024-09-21T04:04:07.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.851+0000 7f6c9fdf0740 1 -- 172.21.15.46:0/2151744365 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c7c0054d0 con 0x55e2aaacb070 2024-09-21T04:04:07.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.851+0000 7f6c72ffd640 1 -- 172.21.15.46:0/2151744365 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6c840ae1c0 con 0x55e2aaacb070 2024-09-21T04:04:07.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.851+0000 7f6c9fdf0740 10 client.16791 fetch_fsmap learned FSMap version 20 2024-09-21T04:04:07.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.851+0000 7f6c9fdf0740 1 -- 172.21.15.46:0/2151744365 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55e2aaefa650 con 0x55e2aaacb070 2024-09-21T04:04:07.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.851+0000 7f6c72ffd640 1 -- 172.21.15.46:0/2151744365 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c7c0054d0 con 0x55e2aaacb070 2024-09-21T04:04:07.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.851+0000 7f6c72ffd640 1 -- 172.21.15.46:0/2151744365 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f6c84098020 con 0x55e2aaacb070 2024-09-21T04:04:07.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.852+0000 7f6c9fdf0740 10 client.16791 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:04:07.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.852+0000 7f6c9fdf0740 10 client.16791 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:04:07.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.852+0000 7f6c9fdf0740 20 client.16791 populate_metadata read hostname 'smithi046' 2024-09-21T04:04:07.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.852+0000 7f6c9fdf0740 1 --2- 172.21.15.46:0/2151744365 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55e2aaa5eda0 0x55e2aaefce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:07.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.852+0000 7f6c9fdf0740 4 client.16791 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T04:04:07.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.852+0000 7f6c9fdf0740 1 -- 172.21.15.46:0/2151744365 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e2aae79550 con 0x55e2aaa5eda0 2024-09-21T04:04:07.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.852+0000 7f6c92ffd640 1 --2- 172.21.15.46:0/2151744365 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55e2aaa5eda0 0x55e2aaefce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:07.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.852+0000 7f6c92ffd640 1 --2- 172.21.15.46:0/2151744365 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55e2aaa5eda0 0x55e2aaefce30 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e16e46c4983a89 server_cookie=c419ed7cf408f6c6 in_seq=0 out_seq=0 2024-09-21T04:04:07.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.852+0000 7f6c72ffd640 10 client.16791 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:07.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.852+0000 7f6c72ffd640 1 -- 172.21.15.46:0/2151744365 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e2aae79550 con 0x55e2aaa5eda0 2024-09-21T04:04:07.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.852+0000 7f6c72ffd640 10 client.16791 handle_command_reply: tid=0 2024-09-21T04:04:07.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.852+0000 7f6c9fdf0740 1 client.16791 shutdown 2024-09-21T04:04:07.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.853+0000 7f6c9fdf0740 1 -- 172.21.15.46:0/2151744365 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e2aaacb070 msgr2=0x55e2aae81f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:07.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.853+0000 7f6c9fdf0740 1 --2- 172.21.15.46:0/2151744365 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e2aaacb070 0x55e2aae81f20 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f6c840049d0 tx=0x7f6c840ad410 comp rx=0 tx=0).stop 2024-09-21T04:04:07.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.853+0000 7f6c9fdf0740 1 -- 172.21.15.46:0/2151744365 shutdown_connections 2024-09-21T04:04:07.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.853+0000 7f6c9fdf0740 1 --2- 172.21.15.46:0/2151744365 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55e2aaa5eda0 0x55e2aaefce30 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:07.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.853+0000 7f6c9fdf0740 1 --2- 172.21.15.46:0/2151744365 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e2aaacb070 0x55e2aae81f20 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:07.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.853+0000 7f6c9fdf0740 1 --2- 172.21.15.46:0/2151744365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e2aaaaa390 0x55e2aae819c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:07.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.853+0000 7f6c9fdf0740 1 --2- 172.21.15.46:0/2151744365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e2aaaa21b0 0x55e2aae864c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:07.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.853+0000 7f6c72ffd640 0 client.16791 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:07.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.853+0000 7f6c9fdf0740 1 -- 172.21.15.46:0/2151744365 >> 172.21.15.46:0/2151744365 conn(0x55e2aaabf460 msgr2=0x55e2aae7d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:07.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.853+0000 7f6c9fdf0740 1 -- 172.21.15.46:0/2151744365 shutdown_connections 2024-09-21T04:04:07.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.853+0000 7f6c9fdf0740 1 -- 172.21.15.46:0/2151744365 wait complete. 2024-09-21T04:04:07.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.853+0000 7f6c9fdf0740 20 client.16791 trim_cache size 0 max 16384 2024-09-21T04:04:07.861 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-21T04:04:07.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.854+0000 7f6c9987c640 1 -- 172.21.15.46:0/3598422630 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f6c800b6700 msgr2=0x7f6c800b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:07.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.854+0000 7f6c9987c640 1 --2- 172.21.15.46:0/3598422630 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f6c800b6700 0x7f6c800b8c10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c031440 tx=0x7f6c8c032ed0 comp rx=0 tx=0).stop 2024-09-21T04:04:07.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.854+0000 7f6c9987c640 1 -- 172.21.15.46:0/3598422630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c94108cf0 msgr2=0x7f6c9419fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:07.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.854+0000 7f6c9987c640 1 --2- 172.21.15.46:0/3598422630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c94108cf0 0x7f6c9419fc80 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f6c8400eb10 tx=0x7f6c8400c2d0 comp rx=0 tx=0).stop 2024-09-21T04:04:07.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.854+0000 7f6c9987c640 1 -- 172.21.15.46:0/3598422630 shutdown_connections 2024-09-21T04:04:07.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.854+0000 7f6c9987c640 1 --2- 172.21.15.46:0/3598422630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c94108cf0 0x7f6c9419fc80 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:07.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.854+0000 7f6c9987c640 1 --2- 172.21.15.46:0/3598422630 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f6c800b6700 0x7f6c800b8c10 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:07.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.854+0000 7f6c9987c640 1 --2- 172.21.15.46:0/3598422630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c941083a0 0x7f6c9419a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:07.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.854+0000 7f6c9987c640 1 --2- 172.21.15.46:0/3598422630 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c94102a60 0x7f6c9419a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:07.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.854+0000 7f6c9987c640 1 -- 172.21.15.46:0/3598422630 >> 172.21.15.46:0/3598422630 conn(0x7f6c94079730 msgr2=0x7f6c94101970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:07.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.854+0000 7f6c9987c640 1 -- 172.21.15.46:0/3598422630 shutdown_connections 2024-09-21T04:04:07.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:07.854+0000 7f6c9987c640 1 -- 172.21.15.46:0/3598422630 wait complete. 2024-09-21T04:04:08.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:07 smithi046 ceph-mon[30954]: pgmap v596: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-21T04:04:08.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:07 smithi105 ceph-mon[34773]: pgmap v596: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-21T04:04:08.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:07 smithi162 ceph-mon[35071]: pgmap v596: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-21T04:04:09.658 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T04:04:09.658 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T04:04:09.928 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:04:10.196 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:09 smithi046 ceph-mon[30954]: pgmap v597: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 20 op/s 2024-09-21T04:04:10.196 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:09 smithi046 ceph-mon[30954]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T04:04:10.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:09 smithi105 ceph-mon[34773]: pgmap v597: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 20 op/s 2024-09-21T04:04:10.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:09 smithi105 ceph-mon[34773]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T04:04:10.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:09 smithi162 ceph-mon[35071]: pgmap v597: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 20 op/s 2024-09-21T04:04:10.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:09 smithi162 ceph-mon[35071]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T04:04:10.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.442+0000 7f5a06813640 1 -- 172.21.15.46:0/1051314603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a00108d10 msgr2=0x7f5a0010f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:10.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.442+0000 7f5a06813640 1 --2- 172.21.15.46:0/1051314603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a00108d10 0x7f5a0010f540 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f59f8009ca0 tx=0x7f59f802a8c0 comp rx=0 tx=0).stop 2024-09-21T04:04:10.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.442+0000 7f5a06813640 1 -- 172.21.15.46:0/1051314603 shutdown_connections 2024-09-21T04:04:10.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.442+0000 7f5a06813640 1 --2- 172.21.15.46:0/1051314603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a00108d10 0x7f5a0010f540 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:10.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.442+0000 7f5a06813640 1 --2- 172.21.15.46:0/1051314603 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a001083c0 0x7f5a001087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:10.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.442+0000 7f5a06813640 1 --2- 172.21.15.46:0/1051314603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a00102a80 0x7f5a00102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:10.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.442+0000 7f5a06813640 1 -- 172.21.15.46:0/1051314603 >> 172.21.15.46:0/1051314603 conn(0x7f5a00079740 msgr2=0x7f5a00079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:10.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.442+0000 7f5a06813640 1 -- 172.21.15.46:0/1051314603 shutdown_connections 2024-09-21T04:04:10.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.442+0000 7f5a06813640 1 -- 172.21.15.46:0/1051314603 wait complete. 2024-09-21T04:04:10.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.443+0000 7f5a06813640 1 Processor -- start 2024-09-21T04:04:10.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.443+0000 7f5a06813640 1 -- start start 2024-09-21T04:04:10.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.443+0000 7f5a06813640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a00102a80 0x7f5a0019a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:10.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.443+0000 7f5a06813640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a001083c0 0x7f5a0019aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:10.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.443+0000 7f5a06813640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a00108d10 0x7f5a0019fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:10.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.443+0000 7f5a06813640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5a00113ae0 con 0x7f5a00108d10 2024-09-21T04:04:10.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.443+0000 7f5a06813640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5a00113960 con 0x7f5a001083c0 2024-09-21T04:04:10.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.443+0000 7f5a06813640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5a00113c60 con 0x7f5a00102a80 2024-09-21T04:04:10.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.444+0000 7f5a04db0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a00108d10 0x7f5a0019fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:10.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.444+0000 7f59f7fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a001083c0 0x7f5a0019aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:10.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.444+0000 7f5a04db0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a00108d10 0x7f5a0019fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43548/0 (socket says 172.21.15.46:43548) 2024-09-21T04:04:10.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.444+0000 7f59fffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a00102a80 0x7f5a0019a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:10.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.444+0000 7f5a04db0640 1 -- 172.21.15.46:0/3901865699 learned_addr learned my addr 172.21.15.46:0/3901865699 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:10.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.444+0000 7f5a04db0640 1 -- 172.21.15.46:0/3901865699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a00102a80 msgr2=0x7f5a0019a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:10.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.444+0000 7f5a04db0640 1 --2- 172.21.15.46:0/3901865699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a00102a80 0x7f5a0019a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:10.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.444+0000 7f5a04db0640 1 -- 172.21.15.46:0/3901865699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a001083c0 msgr2=0x7f5a0019aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:10.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.444+0000 7f5a04db0640 1 --2- 172.21.15.46:0/3901865699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a001083c0 0x7f5a0019aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:10.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.444+0000 7f5a04db0640 1 -- 172.21.15.46:0/3901865699 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a001a0460 con 0x7f5a00108d10 2024-09-21T04:04:10.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.444+0000 7f59f7fff640 1 --2- 172.21.15.46:0/3901865699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a001083c0 0x7f5a0019aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:04:10.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.444+0000 7f5a04db0640 1 --2- 172.21.15.46:0/3901865699 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a00108d10 0x7f5a0019fd30 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f59f8005cc0 tx=0x7f59f802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:10.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.444+0000 7f59fdffb640 1 -- 172.21.15.46:0/3901865699 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f8003bf0 con 0x7f5a00108d10 2024-09-21T04:04:10.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.445+0000 7f59fdffb640 1 -- 172.21.15.46:0/3901865699 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59f8003d90 con 0x7f5a00108d10 2024-09-21T04:04:10.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.445+0000 7f59fdffb640 1 -- 172.21.15.46:0/3901865699 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f802fb20 con 0x7f5a00108d10 2024-09-21T04:04:10.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.445+0000 7f5a06813640 1 -- 172.21.15.46:0/3901865699 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a001a06f0 con 0x7f5a00108d10 2024-09-21T04:04:10.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.445+0000 7f5a06813640 1 -- 172.21.15.46:0/3901865699 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a001a6eb0 con 0x7f5a00108d10 2024-09-21T04:04:10.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.448+0000 7f5a0cd87740 1 Processor -- start 2024-09-21T04:04:10.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.449+0000 7f59fdffb640 1 -- 172.21.15.46:0/3901865699 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f59f8004580 con 0x7f5a00108d10 2024-09-21T04:04:10.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.449+0000 7f5a0cd87740 1 -- start start 2024-09-21T04:04:10.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.449+0000 7f5a0cd87740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ef8c2350 0x5559efc69430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:10.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.449+0000 7f5a0cd87740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559ef899490 0x5559efc69970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:10.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.449+0000 7f5a0cd87740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559ef8a1670 0x5559efc69eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:10.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.449+0000 7f5a0cd87740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5559efbdfe60 con 0x5559ef8a1670 2024-09-21T04:04:10.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.449+0000 7f5a0cd87740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5559efbcf290 con 0x5559ef8c2350 2024-09-21T04:04:10.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.449+0000 7f5a0cd87740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5559efbd30a0 con 0x5559ef899490 2024-09-21T04:04:10.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.449+0000 7f59f7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559ef8a1670 0x5559efc69eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:10.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.449+0000 7f59f7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559ef8a1670 0x5559efc69eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43564/0 (socket says 172.21.15.46:43564) 2024-09-21T04:04:10.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.449+0000 7f59f7fff640 1 -- 172.21.15.46:0/1064516463 learned_addr learned my addr 172.21.15.46:0/1064516463 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:10.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.449+0000 7f59fffff640 1 --2- 172.21.15.46:0/1064516463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559ef899490 0x5559efc69970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:10.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.449+0000 7f59f7fff640 1 --2- 172.21.15.46:0/1064516463 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ef8c2350 0x5559efc69430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:10.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.449+0000 7f59fdffb640 1 --2- 172.21.15.46:0/3901865699 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f59ec0b6700 0x7f59ec0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:10.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.450+0000 7f59f7fff640 1 -- 172.21.15.46:0/1064516463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559ef899490 msgr2=0x5559efc69970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:10.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.450+0000 7f59f7fff640 1 --2- 172.21.15.46:0/1064516463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559ef899490 0x5559efc69970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:10.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.450+0000 7f59f7fff640 1 -- 172.21.15.46:0/1064516463 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ef8c2350 msgr2=0x5559efc69430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:10.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.450+0000 7f59f7fff640 1 --2- 172.21.15.46:0/1064516463 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ef8c2350 0x5559efc69430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:10.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.450+0000 7f5a04db0640 1 --2- 172.21.15.46:0/3901865699 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f59ec0b6700 0x7f59ec0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:10.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.450+0000 7f59f7fff640 1 -- 172.21.15.46:0/1064516463 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559ef92d930 con 0x5559ef8a1670 2024-09-21T04:04:10.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.450+0000 7f59fdffb640 1 -- 172.21.15.46:0/3901865699 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8456+0+0 (secure 0 0 0) 0x7f59f8108910 con 0x7f5a00108d10 2024-09-21T04:04:10.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.450+0000 7f59f7fff640 1 --2- 172.21.15.46:0/1064516463 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559ef8a1670 0x5559efc69eb0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f59e8015a90 tx=0x7f59e80098c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0a53bc37d5ac156 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:10.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.450+0000 7f59f67fc640 1 -- 172.21.15.46:0/1064516463 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e800e8a0 con 0x5559ef8a1670 2024-09-21T04:04:10.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.450+0000 7f59f67fc640 1 -- 172.21.15.46:0/1064516463 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59e801d070 con 0x5559ef8a1670 2024-09-21T04:04:10.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.450+0000 7f59f67fc640 1 -- 172.21.15.46:0/1064516463 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e8018ba0 con 0x5559ef8a1670 2024-09-21T04:04:10.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.451+0000 7f5a0cd87740 1 -- 172.21.15.46:0/1064516463 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559ef8a1670 msgr2=0x5559efc69eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:10.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.451+0000 7f5a0cd87740 1 --2- 172.21.15.46:0/1064516463 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559ef8a1670 0x5559efc69eb0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f59e8015a90 tx=0x7f59e80098c0 comp rx=0 tx=0).stop 2024-09-21T04:04:10.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.451+0000 7f5a04db0640 1 --2- 172.21.15.46:0/3901865699 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f59ec0b6700 0x7f59ec0b8c10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f59f8106150 tx=0x7f59f809bb90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:10.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.451+0000 7f5a0cd87740 1 -- 172.21.15.46:0/1064516463 shutdown_connections 2024-09-21T04:04:10.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.451+0000 7f5a0cd87740 1 --2- 172.21.15.46:0/1064516463 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559ef8a1670 0x5559efc69eb0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:10.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.451+0000 7f5a0cd87740 1 --2- 172.21.15.46:0/1064516463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559ef899490 0x5559efc69970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:10.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.451+0000 7f5a0cd87740 1 --2- 172.21.15.46:0/1064516463 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ef8c2350 0x5559efc69430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:10.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.451+0000 7f5a0cd87740 1 -- 172.21.15.46:0/1064516463 >> 172.21.15.46:0/1064516463 conn(0x5559ef8b6740 msgr2=0x5559efc67320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:10.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.451+0000 7f5a0cd87740 1 -- 172.21.15.46:0/1064516463 shutdown_connections 2024-09-21T04:04:10.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.451+0000 7f5a0cd87740 1 -- 172.21.15.46:0/1064516463 wait complete. 2024-09-21T04:04:10.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.452+0000 7f5a0cd87740 1 -- start start 2024-09-21T04:04:10.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.452+0000 7f5a0cd87740 1 Processor -- start 2024-09-21T04:04:10.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.452+0000 7f5a0cd87740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559ef899490 0x5559efc793d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:10.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.452+0000 7f5a0cd87740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ef8a1670 0x5559efc79910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:10.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.452+0000 7f5a0cd87740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559ef8c2350 0x5559efc85240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:10.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.452+0000 7f5a0cd87740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5559efa30890 con 0x5559ef8c2350 2024-09-21T04:04:10.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.452+0000 7f5a0cd87740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5559efb69d40 con 0x5559ef8a1670 2024-09-21T04:04:10.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.452+0000 7f5a0cd87740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5559efc7bee0 con 0x5559ef899490 2024-09-21T04:04:10.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.452+0000 7f5a0cd87740 10 client.0 _ll_register_callbacks cb 0x5559efbcdc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:04:10.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.452+0000 7f59f7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559ef8c2350 0x5559efc85240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:10.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.452+0000 7f59f7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559ef8c2350 0x5559efc85240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43578/0 (socket says 172.21.15.46:43578) 2024-09-21T04:04:10.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.453+0000 7f59f7fff640 1 -- 172.21.15.46:0/3115953564 learned_addr learned my addr 172.21.15.46:0/3115953564 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:10.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.453+0000 7f59f7fff640 1 --2- 172.21.15.46:0/3115953564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559ef899490 0x5559efc793d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:10.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.453+0000 7f59fffff640 1 --2- 172.21.15.46:0/3115953564 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ef8a1670 0x5559efc79910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:10.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.453+0000 7f59f7fff640 1 -- 172.21.15.46:0/3115953564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559ef899490 msgr2=0x5559efc793d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:10.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.453+0000 7f59f7fff640 1 --2- 172.21.15.46:0/3115953564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559ef899490 0x5559efc793d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:10.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.453+0000 7f59f7fff640 1 -- 172.21.15.46:0/3115953564 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ef8a1670 msgr2=0x5559efc79910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:10.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.453+0000 7f59f7fff640 1 --2- 172.21.15.46:0/3115953564 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ef8a1670 0x5559efc79910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:10.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.453+0000 7f59f7fff640 1 -- 172.21.15.46:0/3115953564 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559efc857d0 con 0x5559ef8c2350 2024-09-21T04:04:10.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.453+0000 7f59f7fff640 1 --2- 172.21.15.46:0/3115953564 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559ef8c2350 0x5559efc85240 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f59e8018880 tx=0x7f59e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e63d673879957e23 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:10.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.453+0000 7f59df7fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:04:10.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.453+0000 7f59df7fe640 1 -- 172.21.15.46:0/3115953564 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e8025070 con 0x5559ef8c2350 2024-09-21T04:04:10.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.453+0000 7f59df7fe640 1 -- 172.21.15.46:0/3115953564 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8456+0+0 (secure 0 0 0) 0x7f59e8018d30 con 0x5559ef8c2350 2024-09-21T04:04:10.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.453+0000 7f5a0cd87740 1 -- 172.21.15.46:0/3115953564 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59e801d070 con 0x5559ef8c2350 2024-09-21T04:04:10.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.454+0000 7f59df7fe640 1 -- 172.21.15.46:0/3115953564 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f59e800e8a0 con 0x5559ef8c2350 2024-09-21T04:04:10.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.454+0000 7f5a0cd87740 10 client.16803 fetch_fsmap learned FSMap version 20 2024-09-21T04:04:10.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.454+0000 7f5a0cd87740 1 -- 172.21.15.46:0/3115953564 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5559efc88100 con 0x5559ef8c2350 2024-09-21T04:04:10.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.454+0000 7f59df7fe640 1 -- 172.21.15.46:0/3115953564 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59e801d070 con 0x5559ef8c2350 2024-09-21T04:04:10.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.454+0000 7f59df7fe640 1 -- 172.21.15.46:0/3115953564 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f59e80179a0 con 0x5559ef8c2350 2024-09-21T04:04:10.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.454+0000 7f5a0cd87740 10 client.16803 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:04:10.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.454+0000 7f5a0cd87740 10 client.16803 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:04:10.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.454+0000 7f5a0cd87740 20 client.16803 populate_metadata read hostname 'smithi046' 2024-09-21T04:04:10.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.454+0000 7f5a0cd87740 1 --2- 172.21.15.46:0/3115953564 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5559ef880cd0 0x5559efc8b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:10.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.454+0000 7f5a0cd87740 4 client.16803 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:04:10.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.454+0000 7f5a0cd87740 1 -- 172.21.15.46:0/3115953564 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559efbe1db0 con 0x5559ef880cd0 2024-09-21T04:04:10.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.454+0000 7f59fffff640 1 --2- 172.21.15.46:0/3115953564 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5559ef880cd0 0x5559efc8b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:10.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.455+0000 7f59df7fe640 10 client.16803 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:10.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.455+0000 7f59fffff640 1 --2- 172.21.15.46:0/3115953564 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5559ef880cd0 0x5559efc8b4c0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f40af142a4a2912f server_cookie=1a8833535da4fac in_seq=0 out_seq=0 2024-09-21T04:04:10.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.456+0000 7f59df7fe640 1 -- 172.21.15.46:0/3115953564 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5559efbe1db0 con 0x5559ef880cd0 2024-09-21T04:04:10.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.456+0000 7f59df7fe640 10 client.16803 handle_command_reply: tid=0 2024-09-21T04:04:10.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.456+0000 7f5a0cd87740 1 client.16803 shutdown 2024-09-21T04:04:10.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.456+0000 7f5a0cd87740 1 -- 172.21.15.46:0/3115953564 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559ef8c2350 msgr2=0x5559efc85240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:10.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.456+0000 7f5a0cd87740 1 --2- 172.21.15.46:0/3115953564 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559ef8c2350 0x5559efc85240 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f59e8018880 tx=0x7f59e80046c0 comp rx=0 tx=0).stop 2024-09-21T04:04:10.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.456+0000 7f5a0cd87740 1 -- 172.21.15.46:0/3115953564 shutdown_connections 2024-09-21T04:04:10.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.456+0000 7f5a0cd87740 1 --2- 172.21.15.46:0/3115953564 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5559ef880cd0 0x5559efc8b4c0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:10.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.456+0000 7f5a0cd87740 1 --2- 172.21.15.46:0/3115953564 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559ef8c2350 0x5559efc85240 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:10.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.456+0000 7f5a0cd87740 1 --2- 172.21.15.46:0/3115953564 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ef8a1670 0x5559efc79910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:10.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.456+0000 7f5a0cd87740 1 --2- 172.21.15.46:0/3115953564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559ef899490 0x5559efc793d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:10.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.456+0000 7f5a0cd87740 1 -- 172.21.15.46:0/3115953564 >> 172.21.15.46:0/3115953564 conn(0x5559ef8b6740 msgr2=0x5559efc6c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:10.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.456+0000 7f59df7fe640 0 client.16803 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:10.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.456+0000 7f5a0cd87740 1 -- 172.21.15.46:0/3115953564 shutdown_connections 2024-09-21T04:04:10.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.456+0000 7f5a0cd87740 1 -- 172.21.15.46:0/3115953564 wait complete. 2024-09-21T04:04:10.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.456+0000 7f5a0cd87740 20 client.16803 trim_cache size 0 max 16384 2024-09-21T04:04:10.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.474+0000 7f5a0cd87740 1 Processor -- start 2024-09-21T04:04:10.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.474+0000 7f5a0cd87740 1 -- start start 2024-09-21T04:04:10.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.474+0000 7f5a0cd87740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559ef899490 0x5559efc67210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:10.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.474+0000 7f5a0cd87740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559ef8a1670 0x5559efc7b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:10.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.474+0000 7f5a0cd87740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ef8c2350 0x5559efc78930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:10.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.474+0000 7f5a0cd87740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5a001ab490 con 0x5559ef8a1670 2024-09-21T04:04:10.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.474+0000 7f5a0cd87740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5a001adcf0 con 0x5559ef8c2350 2024-09-21T04:04:10.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.474+0000 7f5a0cd87740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5a001abae0 con 0x5559ef899490 2024-09-21T04:04:10.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.474+0000 7f59fffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559ef8a1670 0x5559efc7b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:10.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.474+0000 7f59fffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559ef8a1670 0x5559efc7b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43580/0 (socket says 172.21.15.46:43580) 2024-09-21T04:04:10.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.474+0000 7f59fffff640 1 -- 172.21.15.46:0/819790790 learned_addr learned my addr 172.21.15.46:0/819790790 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:10.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.474+0000 7f59f7fff640 1 --2- 172.21.15.46:0/819790790 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ef8c2350 0x5559efc78930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:10.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.474+0000 7f59fffff640 1 -- 172.21.15.46:0/819790790 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559ef899490 msgr2=0x5559efc67210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:10.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.474+0000 7f59fffff640 1 --2- 172.21.15.46:0/819790790 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559ef899490 0x5559efc67210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:10.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.474+0000 7f59fffff640 1 -- 172.21.15.46:0/819790790 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ef8c2350 msgr2=0x5559efc78930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:10.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.474+0000 7f59fffff640 1 --2- 172.21.15.46:0/819790790 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ef8c2350 0x5559efc78930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:10.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.474+0000 7f59fffff640 1 -- 172.21.15.46:0/819790790 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559efc776d0 con 0x5559ef8a1670 2024-09-21T04:04:10.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.475+0000 7f59fffff640 1 --2- 172.21.15.46:0/819790790 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559ef8a1670 0x5559efc7b0b0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f59f0000c00 tx=0x7f59f000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=772346a7fd5c2703 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:10.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.475+0000 7f59f5ffb640 1 -- 172.21.15.46:0/819790790 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f0029070 con 0x5559ef8a1670 2024-09-21T04:04:10.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.475+0000 7f59f5ffb640 1 -- 172.21.15.46:0/819790790 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59f0003de0 con 0x5559ef8a1670 2024-09-21T04:04:10.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.475+0000 7f59f5ffb640 1 -- 172.21.15.46:0/819790790 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f0011840 con 0x5559ef8a1670 2024-09-21T04:04:10.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.476+0000 7f5a0cd87740 1 -- 172.21.15.46:0/819790790 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559ef8a1670 msgr2=0x5559efc7b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:10.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.476+0000 7f5a0cd87740 1 --2- 172.21.15.46:0/819790790 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559ef8a1670 0x5559efc7b0b0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f59f0000c00 tx=0x7f59f000b390 comp rx=0 tx=0).stop 2024-09-21T04:04:10.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.476+0000 7f5a0cd87740 1 -- 172.21.15.46:0/819790790 shutdown_connections 2024-09-21T04:04:10.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.476+0000 7f5a0cd87740 1 --2- 172.21.15.46:0/819790790 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ef8c2350 0x5559efc78930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:10.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.476+0000 7f5a0cd87740 1 --2- 172.21.15.46:0/819790790 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559ef8a1670 0x5559efc7b0b0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:10.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.476+0000 7f5a0cd87740 1 --2- 172.21.15.46:0/819790790 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559ef899490 0x5559efc67210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:10.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.476+0000 7f5a0cd87740 1 -- 172.21.15.46:0/819790790 >> 172.21.15.46:0/819790790 conn(0x5559ef8b6740 msgr2=0x5559efc6a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:10.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.476+0000 7f5a0cd87740 1 -- 172.21.15.46:0/819790790 shutdown_connections 2024-09-21T04:04:10.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.476+0000 7f5a0cd87740 1 -- 172.21.15.46:0/819790790 wait complete. 2024-09-21T04:04:10.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.476+0000 7f5a0cd87740 1 -- start start 2024-09-21T04:04:10.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.476+0000 7f5a0cd87740 1 Processor -- start 2024-09-21T04:04:10.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.477+0000 7f5a0cd87740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559ef899490 0x5559efc8ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:10.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.477+0000 7f5a0cd87740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ef8a1670 0x5559efc8d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:10.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.477+0000 7f5a0cd87740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559ef8c2350 0x5559efceec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:10.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.477+0000 7f5a0cd87740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5a001ac1b0 con 0x5559ef8c2350 2024-09-21T04:04:10.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.477+0000 7f5a0cd87740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5a001ad620 con 0x5559ef8a1670 2024-09-21T04:04:10.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.477+0000 7f5a0cd87740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5a001ac880 con 0x5559ef899490 2024-09-21T04:04:10.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.477+0000 7f5a0cd87740 10 client.0 _ll_register_callbacks cb 0x7f59e80153c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:04:10.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.477+0000 7f59f7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559ef8c2350 0x5559efceec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:10.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.477+0000 7f59f7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559ef8c2350 0x5559efceec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43584/0 (socket says 172.21.15.46:43584) 2024-09-21T04:04:10.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.477+0000 7f59f7fff640 1 -- 172.21.15.46:0/1024003724 learned_addr learned my addr 172.21.15.46:0/1024003724 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:10.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.477+0000 7f59fffff640 1 --2- 172.21.15.46:0/1024003724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ef8a1670 0x5559efc8d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:10.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.477+0000 7f59f7fff640 1 --2- 172.21.15.46:0/1024003724 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559ef899490 0x5559efc8ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:10.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.477+0000 7f59f7fff640 1 -- 172.21.15.46:0/1024003724 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559ef899490 msgr2=0x5559efc8ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:10.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.477+0000 7f59f7fff640 1 --2- 172.21.15.46:0/1024003724 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559ef899490 0x5559efc8ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:10.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.477+0000 7f59f7fff640 1 -- 172.21.15.46:0/1024003724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ef8a1670 msgr2=0x5559efc8d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:10.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.477+0000 7f59f7fff640 1 --2- 172.21.15.46:0/1024003724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ef8a1670 0x5559efc8d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:10.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.477+0000 7f59f7fff640 1 -- 172.21.15.46:0/1024003724 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559efcef2f0 con 0x5559ef8c2350 2024-09-21T04:04:10.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.477+0000 7f59fffff640 1 --2- 172.21.15.46:0/1024003724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ef8a1670 0x5559efc8d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:04:10.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.478+0000 7f59f7fff640 1 --2- 172.21.15.46:0/1024003724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559ef8c2350 0x5559efceec80 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f59e8018850 tx=0x7f59e8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6450dab3df4ac187 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:10.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.478+0000 7f59df7fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:04:10.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.478+0000 7f59df7fe640 1 -- 172.21.15.46:0/1024003724 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e8025070 con 0x5559ef8c2350 2024-09-21T04:04:10.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.478+0000 7f59df7fe640 1 -- 172.21.15.46:0/1024003724 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8456+0+0 (secure 0 0 0) 0x7f59e8018b30 con 0x5559ef8c2350 2024-09-21T04:04:10.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.478+0000 7f5a0cd87740 1 -- 172.21.15.46:0/1024003724 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59f0003de0 con 0x5559ef8c2350 2024-09-21T04:04:10.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.478+0000 7f59df7fe640 1 -- 172.21.15.46:0/1024003724 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f59e8040050 con 0x5559ef8c2350 2024-09-21T04:04:10.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.478+0000 7f5a0cd87740 10 client.16809 fetch_fsmap learned FSMap version 20 2024-09-21T04:04:10.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.478+0000 7f5a0cd87740 1 -- 172.21.15.46:0/1024003724 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5559efcf6670 con 0x5559ef8c2350 2024-09-21T04:04:10.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.478+0000 7f59df7fe640 1 -- 172.21.15.46:0/1024003724 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59f0003de0 con 0x5559ef8c2350 2024-09-21T04:04:10.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.478+0000 7f59df7fe640 1 -- 172.21.15.46:0/1024003724 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f59e8013b90 con 0x5559ef8c2350 2024-09-21T04:04:10.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.478+0000 7f5a0cd87740 10 client.16809 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:04:10.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.478+0000 7f5a0cd87740 10 client.16809 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:04:10.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.478+0000 7f5a0cd87740 20 client.16809 populate_metadata read hostname 'smithi046' 2024-09-21T04:04:10.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.478+0000 7f5a0cd87740 1 --2- 172.21.15.46:0/1024003724 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5559ef856080 0x5559efcf8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:10.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.478+0000 7f5a0cd87740 4 client.16809 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T04:04:10.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.478+0000 7f5a0cd87740 1 -- 172.21.15.46:0/1024003724 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5559efbdd860 con 0x5559ef856080 2024-09-21T04:04:10.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.479+0000 7f59fffff640 1 --2- 172.21.15.46:0/1024003724 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5559ef856080 0x5559efcf8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:10.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.479+0000 7f59fffff640 1 --2- 172.21.15.46:0/1024003724 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5559ef856080 0x5559efcf8d10 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe485ecf8973af18 server_cookie=3c7e6de8aecac1b4 in_seq=0 out_seq=0 2024-09-21T04:04:10.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.479+0000 7f59df7fe640 10 client.16809 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:10.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.481+0000 7f59df7fe640 1 -- 172.21.15.46:0/1024003724 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5559efbdd860 con 0x5559ef856080 2024-09-21T04:04:10.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.481+0000 7f59df7fe640 10 client.16809 handle_command_reply: tid=0 2024-09-21T04:04:10.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.481+0000 7f5a0cd87740 1 client.16809 shutdown 2024-09-21T04:04:10.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.481+0000 7f5a0cd87740 1 -- 172.21.15.46:0/1024003724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559ef8c2350 msgr2=0x5559efceec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:10.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.481+0000 7f5a0cd87740 1 --2- 172.21.15.46:0/1024003724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559ef8c2350 0x5559efceec80 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f59e8018850 tx=0x7f59e8008040 comp rx=0 tx=0).stop 2024-09-21T04:04:10.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.481+0000 7f5a0cd87740 1 -- 172.21.15.46:0/1024003724 shutdown_connections 2024-09-21T04:04:10.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.481+0000 7f5a0cd87740 1 --2- 172.21.15.46:0/1024003724 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x5559ef856080 0x5559efcf8d10 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:10.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.481+0000 7f5a0cd87740 1 --2- 172.21.15.46:0/1024003724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559ef8c2350 0x5559efceec80 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:10.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.481+0000 7f59df7fe640 0 client.16809 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:10.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.481+0000 7f5a0cd87740 1 --2- 172.21.15.46:0/1024003724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559ef8a1670 0x5559efc8d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:10.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.481+0000 7f5a0cd87740 1 --2- 172.21.15.46:0/1024003724 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5559ef899490 0x5559efc8ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:10.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.481+0000 7f5a0cd87740 1 -- 172.21.15.46:0/1024003724 >> 172.21.15.46:0/1024003724 conn(0x5559ef8b6740 msgr2=0x5559efc7ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:10.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.482+0000 7f5a0cd87740 1 -- 172.21.15.46:0/1024003724 shutdown_connections 2024-09-21T04:04:10.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.482+0000 7f5a0cd87740 1 -- 172.21.15.46:0/1024003724 wait complete. 2024-09-21T04:04:10.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.482+0000 7f5a0cd87740 20 client.16809 trim_cache size 0 max 16384 2024-09-21T04:04:10.487 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T04:04:10.487 INFO:teuthology.orchestra.run.smithi046.stdout: "return_code": 0, 2024-09-21T04:04:10.487 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_tag": "37d17ccb-273f-4c50-a691-5064dad9d193", 2024-09-21T04:04:10.487 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": "asynchronous" 2024-09-21T04:04:10.487 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T04:04:10.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.482+0000 7f5a06813640 1 -- 172.21.15.46:0/3901865699 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f59ec0b6700 msgr2=0x7f59ec0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:10.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.482+0000 7f5a06813640 1 --2- 172.21.15.46:0/3901865699 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f59ec0b6700 0x7f59ec0b8c10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f59f8106150 tx=0x7f59f809bb90 comp rx=0 tx=0).stop 2024-09-21T04:04:10.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.482+0000 7f5a06813640 1 -- 172.21.15.46:0/3901865699 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a00108d10 msgr2=0x7f5a0019fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:10.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.482+0000 7f5a06813640 1 --2- 172.21.15.46:0/3901865699 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a00108d10 0x7f5a0019fd30 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f59f8005cc0 tx=0x7f59f802f380 comp rx=0 tx=0).stop 2024-09-21T04:04:10.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.482+0000 7f5a06813640 1 -- 172.21.15.46:0/3901865699 shutdown_connections 2024-09-21T04:04:10.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.482+0000 7f5a06813640 1 --2- 172.21.15.46:0/3901865699 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a00108d10 0x7f5a0019fd30 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:10.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.482+0000 7f5a06813640 1 --2- 172.21.15.46:0/3901865699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a001083c0 0x7f5a0019aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:10.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.482+0000 7f5a06813640 1 --2- 172.21.15.46:0/3901865699 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f59ec0b6700 0x7f59ec0b8c10 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:10.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.482+0000 7f5a06813640 1 --2- 172.21.15.46:0/3901865699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a00102a80 0x7f5a0019a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:10.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.482+0000 7f5a06813640 1 -- 172.21.15.46:0/3901865699 >> 172.21.15.46:0/3901865699 conn(0x7f5a00079740 msgr2=0x7f5a001052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:10.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.483+0000 7f5a06813640 1 -- 172.21.15.46:0/3901865699 shutdown_connections 2024-09-21T04:04:10.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:10.483+0000 7f5a06813640 1 -- 172.21.15.46:0/3901865699 wait complete. 2024-09-21T04:04:11.278 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T04:04:11.536 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:04:12.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.150+0000 7f2fa4bc0640 1 -- 172.21.15.46:0/3203659791 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fa0104a30 msgr2=0x7f2fa0104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:12.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.150+0000 7f2fa4bc0640 1 --2- 172.21.15.46:0/3203659791 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fa0104a30 0x7f2fa0104e40 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f2f90009900 tx=0x7f2f9002a3f0 comp rx=0 tx=0).stop 2024-09-21T04:04:12.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.150+0000 7f2fa4bc0640 1 -- 172.21.15.46:0/3203659791 shutdown_connections 2024-09-21T04:04:12.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.150+0000 7f2fa4bc0640 1 --2- 172.21.15.46:0/3203659791 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fa010de90 0x7f2fa0110380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:12.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.150+0000 7f2fa4bc0640 1 --2- 172.21.15.46:0/3203659791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fa0105380 0x7f2fa010d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:12.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.150+0000 7f2fa4bc0640 1 --2- 172.21.15.46:0/3203659791 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fa0104a30 0x7f2fa0104e40 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:12.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.150+0000 7f2fa4bc0640 1 -- 172.21.15.46:0/3203659791 >> 172.21.15.46:0/3203659791 conn(0x7f2fa00796b0 msgr2=0x7f2fa0079ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:12.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.150+0000 7f2fa4bc0640 1 -- 172.21.15.46:0/3203659791 shutdown_connections 2024-09-21T04:04:12.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.150+0000 7f2fa4bc0640 1 -- 172.21.15.46:0/3203659791 wait complete. 2024-09-21T04:04:12.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.151+0000 7f2fa4bc0640 1 Processor -- start 2024-09-21T04:04:12.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.151+0000 7f2fa4bc0640 1 -- start start 2024-09-21T04:04:12.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.151+0000 7f2fa4bc0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fa0104a30 0x7f2fa019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:12.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.151+0000 7f2fa4bc0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fa0105380 0x7f2fa019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:12.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.151+0000 7f2fa4bc0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fa010de90 0x7f2fa019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:12.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.151+0000 7f2fa4bc0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa0113af0 con 0x7f2fa010de90 2024-09-21T04:04:12.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.151+0000 7f2fa4bc0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa0113970 con 0x7f2fa0104a30 2024-09-21T04:04:12.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.151+0000 7f2fa4bc0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa0113c70 con 0x7f2fa0105380 2024-09-21T04:04:12.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.151+0000 7f2f9ed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fa010de90 0x7f2fa019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:12.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.152+0000 7f2f9ed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fa010de90 0x7f2fa019fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46868/0 (socket says 172.21.15.46:46868) 2024-09-21T04:04:12.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.152+0000 7f2f9ed9d640 1 -- 172.21.15.46:0/2299132861 learned_addr learned my addr 172.21.15.46:0/2299132861 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:12.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.152+0000 7f2f9e59c640 1 --2- 172.21.15.46:0/2299132861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fa0104a30 0x7f2fa019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:12.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.152+0000 7f2f9dd9b640 1 --2- 172.21.15.46:0/2299132861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fa0105380 0x7f2fa019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:12.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.152+0000 7f2f9ed9d640 1 -- 172.21.15.46:0/2299132861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fa0105380 msgr2=0x7f2fa019aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:12.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.152+0000 7f2f9ed9d640 1 --2- 172.21.15.46:0/2299132861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fa0105380 0x7f2fa019aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:12.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.152+0000 7f2f9ed9d640 1 -- 172.21.15.46:0/2299132861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fa0104a30 msgr2=0x7f2fa019a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:12.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.152+0000 7f2f9ed9d640 1 --2- 172.21.15.46:0/2299132861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fa0104a30 0x7f2fa019a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:12.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.152+0000 7f2f9ed9d640 1 -- 172.21.15.46:0/2299132861 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa01a0370 con 0x7f2fa010de90 2024-09-21T04:04:12.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.152+0000 7f2f9dd9b640 1 --2- 172.21.15.46:0/2299132861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fa0105380 0x7f2fa019aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:04:12.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.152+0000 7f2f9ed9d640 1 --2- 172.21.15.46:0/2299132861 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fa010de90 0x7f2fa019fd00 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f2f9800cad0 tx=0x7f2f9800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:12.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.152+0000 7f2f8f7fe640 1 -- 172.21.15.46:0/2299132861 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9800ae20 con 0x7f2fa010de90 2024-09-21T04:04:12.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.152+0000 7f2f8f7fe640 1 -- 172.21.15.46:0/2299132861 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f98005020 con 0x7f2fa010de90 2024-09-21T04:04:12.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.152+0000 7f2fa4bc0640 1 -- 172.21.15.46:0/2299132861 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fa01a0660 con 0x7f2fa010de90 2024-09-21T04:04:12.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.152+0000 7f2f8f7fe640 1 -- 172.21.15.46:0/2299132861 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9800f6b0 con 0x7f2fa010de90 2024-09-21T04:04:12.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.152+0000 7f2fa4bc0640 1 -- 172.21.15.46:0/2299132861 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fa01a0b50 con 0x7f2fa010de90 2024-09-21T04:04:12.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.155+0000 7f2fab134740 1 Processor -- start 2024-09-21T04:04:12.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.155+0000 7f2f8f7fe640 1 -- 172.21.15.46:0/2299132861 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f2f980051d0 con 0x7f2fa010de90 2024-09-21T04:04:12.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.155+0000 7f2fab134740 1 -- start start 2024-09-21T04:04:12.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.156+0000 7f2fab134740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f9e6aa070 0x558f9ea51650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:12.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.156+0000 7f2fab134740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558f9e6811b0 0x558f9ea51b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:12.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.156+0000 7f2fab134740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f9e689390 0x558f9ea520d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:12.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.156+0000 7f2fab134740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x558f9e9c7e50 con 0x558f9e6aa070 2024-09-21T04:04:12.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.156+0000 7f2fab134740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x558f9e9b7280 con 0x558f9e689390 2024-09-21T04:04:12.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.156+0000 7f2fab134740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558f9e9bb090 con 0x558f9e6811b0 2024-09-21T04:04:12.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.156+0000 7f2f9dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f9e6aa070 0x558f9ea51650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:12.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.156+0000 7f2f9dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f9e6aa070 0x558f9ea51650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46880/0 (socket says 172.21.15.46:46880) 2024-09-21T04:04:12.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.156+0000 7f2f9dd9b640 1 -- 172.21.15.46:0/3712572133 learned_addr learned my addr 172.21.15.46:0/3712572133 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:12.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.156+0000 7f2f9e59c640 1 --2- 172.21.15.46:0/3712572133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558f9e6811b0 0x558f9ea51b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:12.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.156+0000 7f2f9dd9b640 1 --2- 172.21.15.46:0/3712572133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f9e689390 0x558f9ea520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:12.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.156+0000 7f2f9dd9b640 1 -- 172.21.15.46:0/3712572133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558f9e6811b0 msgr2=0x558f9ea51b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:12.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.156+0000 7f2f9dd9b640 1 --2- 172.21.15.46:0/3712572133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558f9e6811b0 0x558f9ea51b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:12.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.156+0000 7f2f9dd9b640 1 -- 172.21.15.46:0/3712572133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f9e689390 msgr2=0x558f9ea520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:12.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.156+0000 7f2f9dd9b640 1 --2- 172.21.15.46:0/3712572133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f9e689390 0x558f9ea520d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:12.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.156+0000 7f2f9dd9b640 1 -- 172.21.15.46:0/3712572133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f9e715650 con 0x558f9e6aa070 2024-09-21T04:04:12.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.156+0000 7f2f8f7fe640 1 --2- 172.21.15.46:0/2299132861 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f2f880b66b0 0x7f2f880b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:12.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.156+0000 7f2f9e59c640 1 --2- 172.21.15.46:0/2299132861 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f2f880b66b0 0x7f2f880b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:12.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.156+0000 7f2f9dd9b640 1 --2- 172.21.15.46:0/3712572133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f9e6aa070 0x558f9ea51650 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f2f94008e50 tx=0x7f2f940085e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e937fb088fa7ab51 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:12.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.157+0000 7f2f8f7fe640 1 -- 172.21.15.46:0/2299132861 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8456+0+0 (secure 0 0 0) 0x7f2f980e7710 con 0x7f2fa010de90 2024-09-21T04:04:12.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.157+0000 7f2f8cff9640 1 -- 172.21.15.46:0/3712572133 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f94005220 con 0x558f9e6aa070 2024-09-21T04:04:12.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.157+0000 7f2f8cff9640 1 -- 172.21.15.46:0/3712572133 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f94016030 con 0x558f9e6aa070 2024-09-21T04:04:12.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.157+0000 7f2f8cff9640 1 -- 172.21.15.46:0/3712572133 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f940127d0 con 0x558f9e6aa070 2024-09-21T04:04:12.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.158+0000 7f2fab134740 1 -- 172.21.15.46:0/3712572133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f9e6aa070 msgr2=0x558f9ea51650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:12.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.158+0000 7f2f9e59c640 1 --2- 172.21.15.46:0/2299132861 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f2f880b66b0 0x7f2f880b8bc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2f90031440 tx=0x7f2f90009650 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:12.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.158+0000 7f2fab134740 1 --2- 172.21.15.46:0/3712572133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f9e6aa070 0x558f9ea51650 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f2f94008e50 tx=0x7f2f940085e0 comp rx=0 tx=0).stop 2024-09-21T04:04:12.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.158+0000 7f2fab134740 1 -- 172.21.15.46:0/3712572133 shutdown_connections 2024-09-21T04:04:12.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.158+0000 7f2fab134740 1 --2- 172.21.15.46:0/3712572133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f9e689390 0x558f9ea520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:12.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.158+0000 7f2fab134740 1 --2- 172.21.15.46:0/3712572133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558f9e6811b0 0x558f9ea51b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:12.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.158+0000 7f2fab134740 1 --2- 172.21.15.46:0/3712572133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f9e6aa070 0x558f9ea51650 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:12.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.158+0000 7f2fab134740 1 -- 172.21.15.46:0/3712572133 >> 172.21.15.46:0/3712572133 conn(0x558f9e69e460 msgr2=0x558f9ea4f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:12.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.158+0000 7f2fab134740 1 -- 172.21.15.46:0/3712572133 shutdown_connections 2024-09-21T04:04:12.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.158+0000 7f2fab134740 1 -- 172.21.15.46:0/3712572133 wait complete. 2024-09-21T04:04:12.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.158+0000 7f2fab134740 1 -- start start 2024-09-21T04:04:12.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.158+0000 7f2fab134740 1 Processor -- start 2024-09-21T04:04:12.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.159+0000 7f2fab134740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f9e6811b0 0x558f9ea5ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:12.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.159+0000 7f2fab134740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558f9e689390 0x558f9ea5d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:12.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.159+0000 7f2fab134740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f9e6aa070 0x558f9ea6d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:12.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.159+0000 7f2fab134740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x558f9e818700 con 0x558f9e6aa070 2024-09-21T04:04:12.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.159+0000 7f2fab134740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x558f9e952110 con 0x558f9e6811b0 2024-09-21T04:04:12.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.159+0000 7f2fab134740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558f9ea64240 con 0x558f9e689390 2024-09-21T04:04:12.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.159+0000 7f2fab134740 10 client.0 _ll_register_callbacks cb 0x558f9e96b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:04:12.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.159+0000 7f2f9ed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f9e6aa070 0x558f9ea6d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:12.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.159+0000 7f2f9ed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f9e6aa070 0x558f9ea6d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46888/0 (socket says 172.21.15.46:46888) 2024-09-21T04:04:12.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.159+0000 7f2f9ed9d640 1 -- 172.21.15.46:0/3041069218 learned_addr learned my addr 172.21.15.46:0/3041069218 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:12.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.159+0000 7f2f9e59c640 1 --2- 172.21.15.46:0/3041069218 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f9e6811b0 0x558f9ea5ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:12.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.159+0000 7f2f9dd9b640 1 --2- 172.21.15.46:0/3041069218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558f9e689390 0x558f9ea5d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:12.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.159+0000 7f2f9ed9d640 1 -- 172.21.15.46:0/3041069218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558f9e689390 msgr2=0x558f9ea5d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:12.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.159+0000 7f2f9ed9d640 1 --2- 172.21.15.46:0/3041069218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558f9e689390 0x558f9ea5d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:12.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.159+0000 7f2f9ed9d640 1 -- 172.21.15.46:0/3041069218 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f9e6811b0 msgr2=0x558f9ea5ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:12.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.159+0000 7f2f9ed9d640 1 --2- 172.21.15.46:0/3041069218 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f9e6811b0 0x558f9ea5ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:12.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.159+0000 7f2f9ed9d640 1 -- 172.21.15.46:0/3041069218 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f9e97fc40 con 0x558f9e6aa070 2024-09-21T04:04:12.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.160+0000 7f2f9ed9d640 1 --2- 172.21.15.46:0/3041069218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f9e6aa070 0x558f9ea6d530 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f2f980a9b70 tx=0x7f2f980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4050ab05df0d27d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:12.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.160+0000 7f2f85ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:04:12.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.160+0000 7f2f85ffb640 1 -- 172.21.15.46:0/3041069218 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9801d040 con 0x558f9e6aa070 2024-09-21T04:04:12.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.160+0000 7f2f85ffb640 1 -- 172.21.15.46:0/3041069218 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8456+0+0 (secure 0 0 0) 0x7f2f980ac270 con 0x558f9e6aa070 2024-09-21T04:04:12.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.160+0000 7f2fab134740 1 -- 172.21.15.46:0/3041069218 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f94016030 con 0x558f9e6aa070 2024-09-21T04:04:12.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.160+0000 7f2f85ffb640 1 -- 172.21.15.46:0/3041069218 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2f980b2080 con 0x558f9e6aa070 2024-09-21T04:04:12.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.160+0000 7f2fab134740 10 client.16821 fetch_fsmap learned FSMap version 20 2024-09-21T04:04:12.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.160+0000 7f2fab134740 1 -- 172.21.15.46:0/3041069218 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x558f9ea6ff90 con 0x558f9e6aa070 2024-09-21T04:04:12.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.160+0000 7f2f85ffb640 1 -- 172.21.15.46:0/3041069218 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f94016030 con 0x558f9e6aa070 2024-09-21T04:04:12.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.160+0000 7f2f85ffb640 1 -- 172.21.15.46:0/3041069218 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f2f98094ce0 con 0x558f9e6aa070 2024-09-21T04:04:12.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.160+0000 7f2fab134740 10 client.16821 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:04:12.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.160+0000 7f2fab134740 10 client.16821 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:04:12.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.160+0000 7f2fab134740 20 client.16821 populate_metadata read hostname 'smithi046' 2024-09-21T04:04:12.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.160+0000 7f2fab134740 1 --2- 172.21.15.46:0/3041069218 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558f9e6689f0 0x558f9ea733f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:12.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.161+0000 7f2fab134740 4 client.16821 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:04:12.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.161+0000 7f2fab134740 1 -- 172.21.15.46:0/3041069218 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f9e9c9da0 con 0x558f9e6689f0 2024-09-21T04:04:12.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.161+0000 7f2f9e59c640 1 --2- 172.21.15.46:0/3041069218 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558f9e6689f0 0x558f9ea733f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:12.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.161+0000 7f2f85ffb640 10 client.16821 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:12.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.161+0000 7f2f9e59c640 1 --2- 172.21.15.46:0/3041069218 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558f9e6689f0 0x558f9ea733f0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=583b169e3da9066b server_cookie=b9000435fc2ba490 in_seq=0 out_seq=0 2024-09-21T04:04:12.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.162+0000 7f2f85ffb640 1 -- 172.21.15.46:0/3041069218 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558f9e9c9da0 con 0x558f9e6689f0 2024-09-21T04:04:12.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.162+0000 7f2f85ffb640 10 client.16821 handle_command_reply: tid=0 2024-09-21T04:04:12.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.162+0000 7f2fab134740 1 client.16821 shutdown 2024-09-21T04:04:12.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.162+0000 7f2fab134740 1 -- 172.21.15.46:0/3041069218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f9e6aa070 msgr2=0x558f9ea6d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:12.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.162+0000 7f2fab134740 1 --2- 172.21.15.46:0/3041069218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f9e6aa070 0x558f9ea6d530 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f2f980a9b70 tx=0x7f2f980057f0 comp rx=0 tx=0).stop 2024-09-21T04:04:12.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.162+0000 7f2fab134740 1 -- 172.21.15.46:0/3041069218 shutdown_connections 2024-09-21T04:04:12.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.162+0000 7f2fab134740 1 --2- 172.21.15.46:0/3041069218 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558f9e6689f0 0x558f9ea733f0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:12.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.162+0000 7f2fab134740 1 --2- 172.21.15.46:0/3041069218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f9e6aa070 0x558f9ea6d530 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:12.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.162+0000 7f2fab134740 1 --2- 172.21.15.46:0/3041069218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558f9e689390 0x558f9ea5d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:12.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.162+0000 7f2fab134740 1 --2- 172.21.15.46:0/3041069218 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f9e6811b0 0x558f9ea5ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:12.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.162+0000 7f2fab134740 1 -- 172.21.15.46:0/3041069218 >> 172.21.15.46:0/3041069218 conn(0x558f9e69e460 msgr2=0x558f9ea54830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:12.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.162+0000 7f2f85ffb640 0 client.16821 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:12.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.162+0000 7f2fab134740 1 -- 172.21.15.46:0/3041069218 shutdown_connections 2024-09-21T04:04:12.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.162+0000 7f2fab134740 1 -- 172.21.15.46:0/3041069218 wait complete. 2024-09-21T04:04:12.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.163+0000 7f2fab134740 20 client.16821 trim_cache size 0 max 16384 2024-09-21T04:04:12.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.180+0000 7f2fab134740 1 Processor -- start 2024-09-21T04:04:12.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.180+0000 7f2fab134740 1 -- start start 2024-09-21T04:04:12.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.180+0000 7f2fab134740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f9e6811b0 0x558f9ea52d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:12.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.180+0000 7f2fab134740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f9e689390 0x558f9ea4eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:12.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.180+0000 7f2fab134740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558f9e6aa070 0x558f9ea4f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:12.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.180+0000 7f2fab134740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa01ab2a0 con 0x558f9e6811b0 2024-09-21T04:04:12.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.180+0000 7f2fab134740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa01adb20 con 0x558f9e689390 2024-09-21T04:04:12.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.180+0000 7f2fab134740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa01ab910 con 0x558f9e6aa070 2024-09-21T04:04:12.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.180+0000 7f2f9e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f9e6811b0 0x558f9ea52d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:12.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.180+0000 7f2f9e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f9e6811b0 0x558f9ea52d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46900/0 (socket says 172.21.15.46:46900) 2024-09-21T04:04:12.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.180+0000 7f2f9e59c640 1 -- 172.21.15.46:0/2185004001 learned_addr learned my addr 172.21.15.46:0/2185004001 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:12.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.181+0000 7f2f9e59c640 1 -- 172.21.15.46:0/2185004001 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558f9e6aa070 msgr2=0x558f9ea4f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:12.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.181+0000 7f2f9e59c640 1 --2- 172.21.15.46:0/2185004001 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558f9e6aa070 0x558f9ea4f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:12.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.181+0000 7f2f9e59c640 1 -- 172.21.15.46:0/2185004001 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f9e689390 msgr2=0x558f9ea4eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:12.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.181+0000 7f2f9e59c640 1 --2- 172.21.15.46:0/2185004001 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f9e689390 0x558f9ea4eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:12.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.181+0000 7f2f9e59c640 1 -- 172.21.15.46:0/2185004001 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f9ea53940 con 0x558f9e6811b0 2024-09-21T04:04:12.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.181+0000 7f2f9e59c640 1 --2- 172.21.15.46:0/2185004001 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f9e6811b0 0x558f9ea52d90 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f2f9002a910 tx=0x7f2f9003f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88300e3bf566ce5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:12.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.181+0000 7f2f87fff640 1 -- 172.21.15.46:0/2185004001 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f90035040 con 0x558f9e6811b0 2024-09-21T04:04:12.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.181+0000 7f2f87fff640 1 -- 172.21.15.46:0/2185004001 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f90056070 con 0x558f9e6811b0 2024-09-21T04:04:12.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.181+0000 7f2f87fff640 1 -- 172.21.15.46:0/2185004001 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9005bce0 con 0x558f9e6811b0 2024-09-21T04:04:12.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.182+0000 7f2fab134740 1 -- 172.21.15.46:0/2185004001 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f9e6811b0 msgr2=0x558f9ea52d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:12.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.182+0000 7f2fab134740 1 --2- 172.21.15.46:0/2185004001 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f9e6811b0 0x558f9ea52d90 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f2f9002a910 tx=0x7f2f9003f000 comp rx=0 tx=0).stop 2024-09-21T04:04:12.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.182+0000 7f2fab134740 1 -- 172.21.15.46:0/2185004001 shutdown_connections 2024-09-21T04:04:12.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.182+0000 7f2fab134740 1 --2- 172.21.15.46:0/2185004001 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558f9e6aa070 0x558f9ea4f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:12.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.182+0000 7f2fab134740 1 --2- 172.21.15.46:0/2185004001 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f9e689390 0x558f9ea4eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:12.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.182+0000 7f2fab134740 1 --2- 172.21.15.46:0/2185004001 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f9e6811b0 0x558f9ea52d90 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:12.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.182+0000 7f2fab134740 1 -- 172.21.15.46:0/2185004001 >> 172.21.15.46:0/2185004001 conn(0x558f9e69e460 msgr2=0x558f9ea52680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:12.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.182+0000 7f2fab134740 1 -- 172.21.15.46:0/2185004001 shutdown_connections 2024-09-21T04:04:12.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.182+0000 7f2fab134740 1 -- 172.21.15.46:0/2185004001 wait complete. 2024-09-21T04:04:12.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.182+0000 7f2fab134740 1 -- start start 2024-09-21T04:04:12.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.182+0000 7f2fab134740 1 Processor -- start 2024-09-21T04:04:12.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.183+0000 7f2fab134740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558f9e6811b0 0x558f9ea65840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:12.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.183+0000 7f2fab134740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f9e689390 0x558f9ea65d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:12.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.183+0000 7f2fab134740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f9e6aa070 0x558f9eadce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:12.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.183+0000 7f2fab134740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa01abfe0 con 0x558f9e689390 2024-09-21T04:04:12.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.183+0000 7f2fab134740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa01ad450 con 0x558f9e6aa070 2024-09-21T04:04:12.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.183+0000 7f2fab134740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa01ac6b0 con 0x558f9e6811b0 2024-09-21T04:04:12.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.183+0000 7f2fab134740 10 client.0 _ll_register_callbacks cb 0x7f2f980a9c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:04:12.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.183+0000 7f2f9dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f9e689390 0x558f9ea65d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:12.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.183+0000 7f2f9dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f9e689390 0x558f9ea65d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46908/0 (socket says 172.21.15.46:46908) 2024-09-21T04:04:12.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.183+0000 7f2f9dd9b640 1 -- 172.21.15.46:0/4045439255 learned_addr learned my addr 172.21.15.46:0/4045439255 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:12.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.183+0000 7f2f9e59c640 1 --2- 172.21.15.46:0/4045439255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558f9e6811b0 0x558f9ea65840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:12.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.183+0000 7f2f9ed9d640 1 --2- 172.21.15.46:0/4045439255 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f9e6aa070 0x558f9eadce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:12.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.183+0000 7f2f9dd9b640 1 -- 172.21.15.46:0/4045439255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558f9e6811b0 msgr2=0x558f9ea65840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:12.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.183+0000 7f2f9dd9b640 1 --2- 172.21.15.46:0/4045439255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558f9e6811b0 0x558f9ea65840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:12.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.183+0000 7f2f9dd9b640 1 -- 172.21.15.46:0/4045439255 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f9e6aa070 msgr2=0x558f9eadce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:12.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.183+0000 7f2f9dd9b640 1 --2- 172.21.15.46:0/4045439255 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f9e6aa070 0x558f9eadce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:12.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.183+0000 7f2f9dd9b640 1 -- 172.21.15.46:0/4045439255 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f9eadd340 con 0x558f9e689390 2024-09-21T04:04:12.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.183+0000 7f2f9dd9b640 1 --2- 172.21.15.46:0/4045439255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f9e689390 0x558f9ea65d80 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f2f94008e50 tx=0x7f2f940048b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=833782ea560be7c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:12.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.183+0000 7f2f85ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:04:12.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.184+0000 7f2f85ffb640 1 -- 172.21.15.46:0/4045439255 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9402a060 con 0x558f9e689390 2024-09-21T04:04:12.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.184+0000 7f2f85ffb640 1 -- 172.21.15.46:0/4045439255 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8456+0+0 (secure 0 0 0) 0x7f2f94004fc0 con 0x558f9e689390 2024-09-21T04:04:12.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.184+0000 7f2fab134740 1 -- 172.21.15.46:0/4045439255 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f90056070 con 0x558f9e689390 2024-09-21T04:04:12.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.184+0000 7f2f85ffb640 1 -- 172.21.15.46:0/4045439255 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2f940051c0 con 0x558f9e689390 2024-09-21T04:04:12.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.184+0000 7f2fab134740 10 client.16827 fetch_fsmap learned FSMap version 20 2024-09-21T04:04:12.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.184+0000 7f2fab134740 1 -- 172.21.15.46:0/4045439255 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x558f9eade420 con 0x558f9e689390 2024-09-21T04:04:12.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.184+0000 7f2f85ffb640 1 -- 172.21.15.46:0/4045439255 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f90056070 con 0x558f9e689390 2024-09-21T04:04:12.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.184+0000 7f2f85ffb640 1 -- 172.21.15.46:0/4045439255 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f2f9402f930 con 0x558f9e689390 2024-09-21T04:04:12.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.184+0000 7f2fab134740 10 client.16827 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:04:12.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.184+0000 7f2fab134740 10 client.16827 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:04:12.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.184+0000 7f2fab134740 20 client.16827 populate_metadata read hostname 'smithi046' 2024-09-21T04:04:12.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.184+0000 7f2fab134740 1 --2- 172.21.15.46:0/4045439255 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558f9e63dda0 0x558f9eae0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:12.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.184+0000 7f2fab134740 4 client.16827 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T04:04:12.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.184+0000 7f2fab134740 1 -- 172.21.15.46:0/4045439255 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558f9e9c5850 con 0x558f9e63dda0 2024-09-21T04:04:12.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.185+0000 7f2f9e59c640 1 --2- 172.21.15.46:0/4045439255 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558f9e63dda0 0x558f9eae0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:12.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.185+0000 7f2f9e59c640 1 --2- 172.21.15.46:0/4045439255 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558f9e63dda0 0x558f9eae0870 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=297e3bc897158f51 server_cookie=e51a08270bb60d69 in_seq=0 out_seq=0 2024-09-21T04:04:12.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.185+0000 7f2f85ffb640 10 client.16827 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:12.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.185+0000 7f2f85ffb640 1 -- 172.21.15.46:0/4045439255 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5682 (crc 0 0 0) 0x558f9e9c5850 con 0x558f9e63dda0 2024-09-21T04:04:12.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.185+0000 7f2f85ffb640 10 client.16827 handle_command_reply: tid=0 2024-09-21T04:04:12.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.185+0000 7f2fab134740 1 client.16827 shutdown 2024-09-21T04:04:12.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.186+0000 7f2fab134740 1 -- 172.21.15.46:0/4045439255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f9e689390 msgr2=0x558f9ea65d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:12.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.186+0000 7f2fab134740 1 --2- 172.21.15.46:0/4045439255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f9e689390 0x558f9ea65d80 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f2f94008e50 tx=0x7f2f940048b0 comp rx=0 tx=0).stop 2024-09-21T04:04:12.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.186+0000 7f2fab134740 1 -- 172.21.15.46:0/4045439255 shutdown_connections 2024-09-21T04:04:12.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.186+0000 7f2fab134740 1 --2- 172.21.15.46:0/4045439255 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x558f9e63dda0 0x558f9eae0870 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:12.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.186+0000 7f2fab134740 1 --2- 172.21.15.46:0/4045439255 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f9e6aa070 0x558f9eadce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:12.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.186+0000 7f2fab134740 1 --2- 172.21.15.46:0/4045439255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558f9e689390 0x558f9ea65d80 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:12.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.186+0000 7f2f85ffb640 0 client.16827 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:12.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.186+0000 7f2fab134740 1 --2- 172.21.15.46:0/4045439255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558f9e6811b0 0x558f9ea65840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:12.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.186+0000 7f2fab134740 1 -- 172.21.15.46:0/4045439255 >> 172.21.15.46:0/4045439255 conn(0x558f9e69e460 msgr2=0x558f9ea5dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:12.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.186+0000 7f2fab134740 1 -- 172.21.15.46:0/4045439255 shutdown_connections 2024-09-21T04:04:12.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.186+0000 7f2fab134740 1 -- 172.21.15.46:0/4045439255 wait complete. 2024-09-21T04:04:12.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.186+0000 7f2fab134740 20 client.16827 trim_cache size 0 max 16384 2024-09-21T04:04:12.193 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T04:04:12.193 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T04:04:12.193 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2024-09-21T04:04:12.193 INFO:teuthology.orchestra.run.smithi046.stdout: "37d17ccb-273f-4c50-a691-5064dad9d193": { 2024-09-21T04:04:12.193 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:12.193 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "37d17ccb-273f-4c50-a691-5064dad9d193", 2024-09-21T04:04:12.193 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2024-09-21T04:04:12.193 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:04:12.193 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:12.194 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_stats": { 2024-09-21T04:04:12.194 INFO:teuthology.orchestra.run.smithi046.stdout: "37d17ccb-273f-4c50-a691-5064dad9d193": { 2024-09-21T04:04:12.194 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:04:10.480657+0000", 2024-09-21T04:04:12.194 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:12.194 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:12.194 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:12.194 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:12.194 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:12.194 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:12.194 INFO:teuthology.orchestra.run.smithi046.stdout: "50776be6-bb03-4b39-ad4d-719e50e97356": { 2024-09-21T04:04:12.194 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:04:03.083808+0000", 2024-09-21T04:04:12.194 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:12.194 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:12.194 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:12.195 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:12.195 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:12.195 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:12.195 INFO:teuthology.orchestra.run.smithi046.stdout: "cfba6404-dc3f-4ad2-b873-926d5f9007de": { 2024-09-21T04:04:12.195 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:03:23.788611+0000", 2024-09-21T04:04:12.195 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:12.195 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:12.195 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:12.195 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:12.195 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:12.195 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:12.195 INFO:teuthology.orchestra.run.smithi046.stdout: "96aa13fd-aa77-46b5-b20e-a9b203dc7a94": { 2024-09-21T04:04:12.195 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:02:44.727411+0000", 2024-09-21T04:04:12.196 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:12.196 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:12.196 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:12.196 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:12.196 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:12.196 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:12.196 INFO:teuthology.orchestra.run.smithi046.stdout: "64865e31-a445-43e8-9fa3-26fae089b973": { 2024-09-21T04:04:12.196 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:02:37.376562+0000", 2024-09-21T04:04:12.196 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:12.196 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:12.196 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:12.196 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:12.196 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:12.196 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:12.197 INFO:teuthology.orchestra.run.smithi046.stdout: "7a3afabe-6b27-4bce-928a-8c6773a85803": { 2024-09-21T04:04:12.197 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:01:58.413358+0000", 2024-09-21T04:04:12.197 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:12.197 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:12.197 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:12.197 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:12.197 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:12.197 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:12.197 INFO:teuthology.orchestra.run.smithi046.stdout: "08f0c962-df1a-4129-a1a2-b916240d9803": { 2024-09-21T04:04:12.197 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:02.937596+0000", 2024-09-21T04:04:12.197 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:12.197 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:12.197 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:12.197 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:12.198 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:12.198 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:12.198 INFO:teuthology.orchestra.run.smithi046.stdout: "d49f33a7-3d5a-421b-94ba-8b19a4120db1": { 2024-09-21T04:04:12.198 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:50.480786+0000", 2024-09-21T04:04:12.198 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:12.198 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:12.198 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:12.198 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:12.198 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:12.198 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:12.198 INFO:teuthology.orchestra.run.smithi046.stdout: "a871f724-0198-493c-b03e-b2de78aba243": { 2024-09-21T04:04:12.198 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:56:30.082991+0000", 2024-09-21T04:04:12.198 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:12.198 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:12.199 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:12.199 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:12.199 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:12.199 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:12.199 INFO:teuthology.orchestra.run.smithi046.stdout: "edc4b8c7-b702-489d-a925-ae7ad0ff0d9a": { 2024-09-21T04:04:12.199 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:00:40.181950+0000", 2024-09-21T04:04:12.199 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:12.199 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:12.199 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:12.199 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:12.199 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:12.199 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:12.199 INFO:teuthology.orchestra.run.smithi046.stdout: "3bbf7097-70d7-4743-bbce-41465502b35b": { 2024-09-21T04:04:12.200 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:10.661441+0000", 2024-09-21T04:04:12.200 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:12.200 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:12.200 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:12.200 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:12.200 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:12.200 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:12.200 INFO:teuthology.orchestra.run.smithi046.stdout: "e24ec8f1-0d13-478f-9c2c-b51798868ffc": { 2024-09-21T04:04:12.200 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:09.736194+0000", 2024-09-21T04:04:12.200 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:12.200 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:12.200 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:12.200 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:12.200 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:12.200 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:12.201 INFO:teuthology.orchestra.run.smithi046.stdout: "c47f458a-de5e-4952-a575-a81261953667": { 2024-09-21T04:04:12.201 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:48.699411+0000", 2024-09-21T04:04:12.201 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:12.201 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:12.201 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:12.201 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:12.201 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:12.201 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:12.201 INFO:teuthology.orchestra.run.smithi046.stdout: "6103c660-8e77-4b06-ad6c-bb322c26035a": { 2024-09-21T04:04:12.201 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:35.594467+0000", 2024-09-21T04:04:12.201 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:12.201 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:12.201 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:12.201 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:12.202 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:12.202 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:12.202 INFO:teuthology.orchestra.run.smithi046.stdout: "46bb5415-6e16-47c6-a1e4-55f9c623ce90": { 2024-09-21T04:04:12.202 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:14.950674+0000", 2024-09-21T04:04:12.202 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:12.202 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:12.202 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:12.202 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:12.202 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:12.202 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:12.202 INFO:teuthology.orchestra.run.smithi046.stdout: "326aaecf-f38a-4946-988a-d83f25556995": { 2024-09-21T04:04:12.202 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:54.189884+0000", 2024-09-21T04:04:12.202 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:12.203 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:12.203 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:12.203 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:12.203 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:12.203 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:12.203 INFO:teuthology.orchestra.run.smithi046.stdout: "dab67652-8894-4711-be64-cbdfea27a9ba": { 2024-09-21T04:04:12.203 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:28.161616+0000", 2024-09-21T04:04:12.203 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:12.203 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:12.203 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:12.203 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:12.203 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:12.203 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:12.203 INFO:teuthology.orchestra.run.smithi046.stdout: "0d781b95-cf5e-46f2-9875-2923181385e2": { 2024-09-21T04:04:12.204 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:00:33.099094+0000", 2024-09-21T04:04:12.204 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:12.204 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:12.204 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:12.204 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:12.204 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:12.204 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:12.204 INFO:teuthology.orchestra.run.smithi046.stdout: "d7634007-e881-46f7-9833-ac9bd0a3100e": { 2024-09-21T04:04:12.204 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:01:19.459151+0000", 2024-09-21T04:04:12.204 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:12.204 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:12.205 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:12.205 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:12.205 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:12.205 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:04:12.205 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:04:12.205 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T04:04:12.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.186+0000 7f2fa4bc0640 1 -- 172.21.15.46:0/2299132861 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f2f880b66b0 msgr2=0x7f2f880b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:12.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.186+0000 7f2fa4bc0640 1 --2- 172.21.15.46:0/2299132861 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f2f880b66b0 0x7f2f880b8bc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2f90031440 tx=0x7f2f90009650 comp rx=0 tx=0).stop 2024-09-21T04:04:12.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.186+0000 7f2fa4bc0640 1 -- 172.21.15.46:0/2299132861 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fa010de90 msgr2=0x7f2fa019fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:12.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.186+0000 7f2fa4bc0640 1 --2- 172.21.15.46:0/2299132861 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fa010de90 0x7f2fa019fd00 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f2f9800cad0 tx=0x7f2f9800cf90 comp rx=0 tx=0).stop 2024-09-21T04:04:12.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.186+0000 7f2fa4bc0640 1 -- 172.21.15.46:0/2299132861 shutdown_connections 2024-09-21T04:04:12.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.186+0000 7f2fa4bc0640 1 --2- 172.21.15.46:0/2299132861 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fa010de90 0x7f2fa019fd00 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:12.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.186+0000 7f2fa4bc0640 1 --2- 172.21.15.46:0/2299132861 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f2f880b66b0 0x7f2f880b8bc0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:12.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.186+0000 7f2fa4bc0640 1 --2- 172.21.15.46:0/2299132861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fa0105380 0x7f2fa019aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:12.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.186+0000 7f2fa4bc0640 1 --2- 172.21.15.46:0/2299132861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fa0104a30 0x7f2fa019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:12.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.186+0000 7f2fa4bc0640 1 -- 172.21.15.46:0/2299132861 >> 172.21.15.46:0/2299132861 conn(0x7f2fa00796b0 msgr2=0x7f2fa0100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:12.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.187+0000 7f2fa4bc0640 1 -- 172.21.15.46:0/2299132861 shutdown_connections 2024-09-21T04:04:12.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:12.187+0000 7f2fa4bc0640 1 -- 172.21.15.46:0/2299132861 wait complete. 2024-09-21T04:04:12.206 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:11 smithi046 ceph-mon[30954]: pgmap v599: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-21T04:04:12.206 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:11 smithi046 ceph-mon[30954]: scrub queued for path: / 2024-09-21T04:04:12.206 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:11 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T04:04:12.207 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:11 smithi046 ceph-mon[30954]: scrub summary: active paths [/] 2024-09-21T04:04:12.207 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:11 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T04:04:12.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:11 smithi105 ceph-mon[34773]: pgmap v599: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-21T04:04:12.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:11 smithi105 ceph-mon[34773]: scrub queued for path: / 2024-09-21T04:04:12.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:11 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T04:04:12.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:11 smithi105 ceph-mon[34773]: scrub summary: active paths [/] 2024-09-21T04:04:12.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:11 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T04:04:12.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:11 smithi162 ceph-mon[35071]: pgmap v599: 97 pgs: 97 active+clean; 14 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-21T04:04:12.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:11 smithi162 ceph-mon[35071]: scrub queued for path: / 2024-09-21T04:04:12.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:11 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T04:04:12.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:11 smithi162 ceph-mon[35071]: scrub summary: active paths [/] 2024-09-21T04:04:12.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:11 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T04:04:13.080 INFO:tasks.cephfs.filesystem:scrub status for tag:37d17ccb-273f-4c50-a691-5064dad9d193 - {'path': '/', 'tag': '37d17ccb-273f-4c50-a691-5064dad9d193', 'options': 'recursive,force'} 2024-09-21T04:04:14.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:13 smithi046 ceph-mon[30954]: pgmap v600: 97 pgs: 97 active+clean; 14 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 6 op/s 2024-09-21T04:04:14.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:13 smithi046 ceph-mon[30954]: scrub summary: idle 2024-09-21T04:04:14.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:13 smithi105 ceph-mon[34773]: pgmap v600: 97 pgs: 97 active+clean; 14 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 6 op/s 2024-09-21T04:04:14.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:13 smithi105 ceph-mon[34773]: scrub summary: idle 2024-09-21T04:04:14.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:13 smithi162 ceph-mon[35071]: pgmap v600: 97 pgs: 97 active+clean; 14 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 27 KiB/s wr, 6 op/s 2024-09-21T04:04:14.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:13 smithi162 ceph-mon[35071]: scrub summary: idle 2024-09-21T04:04:16.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:15 smithi046 ceph-mon[30954]: pgmap v601: 97 pgs: 97 active+clean; 14 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 204 B/s wr, 4 op/s 2024-09-21T04:04:16.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:15 smithi105 ceph-mon[34773]: pgmap v601: 97 pgs: 97 active+clean; 14 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 204 B/s wr, 4 op/s 2024-09-21T04:04:16.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:15 smithi162 ceph-mon[35071]: pgmap v601: 97 pgs: 97 active+clean; 14 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 204 B/s wr, 4 op/s 2024-09-21T04:04:18.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:17 smithi046 ceph-mon[30954]: pgmap v602: 97 pgs: 97 active+clean; 14 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 204 B/s wr, 4 op/s 2024-09-21T04:04:18.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:17 smithi046 ceph-mon[30954]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T04:04:18.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:17 smithi105 ceph-mon[34773]: pgmap v602: 97 pgs: 97 active+clean; 14 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 204 B/s wr, 4 op/s 2024-09-21T04:04:18.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:17 smithi105 ceph-mon[34773]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T04:04:18.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:17 smithi162 ceph-mon[35071]: pgmap v602: 97 pgs: 97 active+clean; 14 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 204 B/s wr, 4 op/s 2024-09-21T04:04:18.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:17 smithi162 ceph-mon[35071]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T04:04:20.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:19 smithi046 ceph-mon[30954]: pgmap v604: 97 pgs: 97 active+clean; 14 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 220 B/s wr, 3 op/s 2024-09-21T04:04:20.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:19 smithi105 ceph-mon[34773]: pgmap v604: 97 pgs: 97 active+clean; 14 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 220 B/s wr, 3 op/s 2024-09-21T04:04:20.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:19 smithi162 ceph-mon[35071]: pgmap v604: 97 pgs: 97 active+clean; 14 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 220 B/s wr, 3 op/s 2024-09-21T04:04:22.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:21 smithi046 ceph-mon[30954]: pgmap v605: 97 pgs: 97 active+clean; 14 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 204 B/s wr, 3 op/s 2024-09-21T04:04:22.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:21 smithi105 ceph-mon[34773]: pgmap v605: 97 pgs: 97 active+clean; 14 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 204 B/s wr, 3 op/s 2024-09-21T04:04:22.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:21 smithi162 ceph-mon[35071]: pgmap v605: 97 pgs: 97 active+clean; 14 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 204 B/s wr, 3 op/s 2024-09-21T04:04:24.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:23 smithi046 ceph-mon[30954]: pgmap v606: 97 pgs: 97 active+clean; 14 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T04:04:24.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:23 smithi105 ceph-mon[34773]: pgmap v606: 97 pgs: 97 active+clean; 14 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T04:04:24.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:23 smithi162 ceph-mon[35071]: pgmap v606: 97 pgs: 97 active+clean; 14 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T04:04:26.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:25 smithi046 ceph-mon[30954]: pgmap v607: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T04:04:26.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:25 smithi105 ceph-mon[34773]: pgmap v607: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T04:04:26.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:25 smithi162 ceph-mon[35071]: pgmap v607: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T04:04:27.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:26 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:04:27.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:26 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:04:27.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:26 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:04:28.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:27 smithi046 ceph-mon[30954]: pgmap v608: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T04:04:28.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:27 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:04:28.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:27 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:04:28.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:27 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:04:28.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:27 smithi105 ceph-mon[34773]: pgmap v608: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T04:04:28.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:27 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:04:28.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:27 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:04:28.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:27 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:04:28.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:27 smithi162 ceph-mon[35071]: pgmap v608: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T04:04:28.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:27 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:04:28.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:27 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:04:28.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:27 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:04:30.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:29 smithi046 ceph-mon[30954]: pgmap v609: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-21T04:04:30.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:29 smithi105 ceph-mon[34773]: pgmap v609: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-21T04:04:30.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:29 smithi162 ceph-mon[35071]: pgmap v609: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-21T04:04:32.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:31 smithi046 ceph-mon[30954]: pgmap v610: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:04:32.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:31 smithi105 ceph-mon[34773]: pgmap v610: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:04:32.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:31 smithi162 ceph-mon[35071]: pgmap v610: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:04:34.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:33 smithi046 ceph-mon[30954]: pgmap v611: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T04:04:34.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:33 smithi105 ceph-mon[34773]: pgmap v611: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T04:04:34.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:33 smithi162 ceph-mon[35071]: pgmap v611: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T04:04:36.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:35 smithi046 ceph-mon[30954]: pgmap v612: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:04:36.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:35 smithi105 ceph-mon[34773]: pgmap v612: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:04:36.375 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:35 smithi162 ceph-mon[35071]: pgmap v612: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:04:37.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:37 smithi105 ceph-mon[34773]: pgmap v613: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:04:37.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:37 smithi162 ceph-mon[35071]: pgmap v613: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:04:37.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:37 smithi046 ceph-mon[30954]: pgmap v613: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:04:39.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:39 smithi105 ceph-mon[34773]: pgmap v614: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:04:39.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:39 smithi162 ceph-mon[35071]: pgmap v614: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:04:39.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:39 smithi046 ceph-mon[30954]: pgmap v614: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:04:41.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:41 smithi105 ceph-mon[34773]: pgmap v615: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:04:41.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:41 smithi162 ceph-mon[35071]: pgmap v615: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:04:41.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:41 smithi046 ceph-mon[30954]: pgmap v615: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:04:43.081 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T04:04:43.358 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:04:43.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:43 smithi046 ceph-mon[30954]: pgmap v616: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T04:04:43.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:43 smithi105 ceph-mon[34773]: pgmap v616: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T04:04:43.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:43 smithi162 ceph-mon[35071]: pgmap v616: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T04:04:43.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.871+0000 7fa86958e640 1 -- 172.21.15.46:0/1323158640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa864105300 msgr2=0x7fa86410d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:43.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.871+0000 7fa86958e640 1 --2- 172.21.15.46:0/1323158640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa864105300 0x7fa86410d850 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fa858009900 tx=0x7fa85802a410 comp rx=0 tx=0).stop 2024-09-21T04:04:43.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.872+0000 7fa86958e640 1 -- 172.21.15.46:0/1323158640 shutdown_connections 2024-09-21T04:04:43.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.872+0000 7fa86958e640 1 --2- 172.21.15.46:0/1323158640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa86410de10 0x7fa864110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:43.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.872+0000 7fa86958e640 1 --2- 172.21.15.46:0/1323158640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa864105300 0x7fa86410d850 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:43.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.872+0000 7fa86958e640 1 --2- 172.21.15.46:0/1323158640 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8641049b0 0x7fa864104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:43.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.872+0000 7fa86958e640 1 -- 172.21.15.46:0/1323158640 >> 172.21.15.46:0/1323158640 conn(0x7fa864079730 msgr2=0x7fa864079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:43.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.872+0000 7fa86958e640 1 -- 172.21.15.46:0/1323158640 shutdown_connections 2024-09-21T04:04:43.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.872+0000 7fa86958e640 1 -- 172.21.15.46:0/1323158640 wait complete. 2024-09-21T04:04:43.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.872+0000 7fa86958e640 1 Processor -- start 2024-09-21T04:04:43.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.873+0000 7fa86958e640 1 -- start start 2024-09-21T04:04:43.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.873+0000 7fa86958e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8641049b0 0x7fa86419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:43.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.873+0000 7fa86958e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa864105300 0x7fa86419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:43.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.873+0000 7fa86958e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa86410de10 0x7fa86419fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:43.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.873+0000 7fa86958e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa864113a70 con 0x7fa86410de10 2024-09-21T04:04:43.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.873+0000 7fa86958e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa8641138f0 con 0x7fa864105300 2024-09-21T04:04:43.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.873+0000 7fa86958e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa864113bf0 con 0x7fa8641049b0 2024-09-21T04:04:43.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.873+0000 7fa8637fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa86410de10 0x7fa86419fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:43.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.873+0000 7fa8637fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa86410de10 0x7fa86419fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40558/0 (socket says 172.21.15.46:40558) 2024-09-21T04:04:43.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.873+0000 7fa8637fe640 1 -- 172.21.15.46:0/4254447152 learned_addr learned my addr 172.21.15.46:0/4254447152 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:43.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.873+0000 7fa862ffd640 1 --2- 172.21.15.46:0/4254447152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8641049b0 0x7fa86419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:43.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.873+0000 7fa8627fc640 1 --2- 172.21.15.46:0/4254447152 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa864105300 0x7fa86419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:43.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.873+0000 7fa8637fe640 1 -- 172.21.15.46:0/4254447152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8641049b0 msgr2=0x7fa86419a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:43.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.873+0000 7fa8637fe640 1 --2- 172.21.15.46:0/4254447152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8641049b0 0x7fa86419a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:43.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.873+0000 7fa8637fe640 1 -- 172.21.15.46:0/4254447152 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa864105300 msgr2=0x7fa86419aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:43.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.873+0000 7fa8637fe640 1 --2- 172.21.15.46:0/4254447152 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa864105300 0x7fa86419aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:43.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.873+0000 7fa8637fe640 1 -- 172.21.15.46:0/4254447152 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8641a0410 con 0x7fa86410de10 2024-09-21T04:04:43.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.874+0000 7fa8637fe640 1 --2- 172.21.15.46:0/4254447152 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa86410de10 0x7fa86419fce0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fa85c00eaa0 tx=0x7fa85c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:43.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.874+0000 7fa84bfff640 1 -- 172.21.15.46:0/4254447152 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85c00cdb0 con 0x7fa86410de10 2024-09-21T04:04:43.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.874+0000 7fa86958e640 1 -- 172.21.15.46:0/4254447152 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8641a0700 con 0x7fa86410de10 2024-09-21T04:04:43.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.874+0000 7fa84bfff640 1 -- 172.21.15.46:0/4254447152 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa85c005020 con 0x7fa86410de10 2024-09-21T04:04:43.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.874+0000 7fa84bfff640 1 -- 172.21.15.46:0/4254447152 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85c0116d0 con 0x7fa86410de10 2024-09-21T04:04:43.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.874+0000 7fa86958e640 1 -- 172.21.15.46:0/4254447152 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8641a6e60 con 0x7fa86410de10 2024-09-21T04:04:43.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.877+0000 7fa86fb02740 1 Processor -- start 2024-09-21T04:04:43.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.878+0000 7fa84bfff640 1 -- 172.21.15.46:0/4254447152 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7fa85c0051d0 con 0x7fa86410de10 2024-09-21T04:04:43.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.878+0000 7fa86fb02740 1 -- start start 2024-09-21T04:04:43.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.878+0000 7fa86fb02740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e8a5fd070 0x560e8a9a4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:43.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.878+0000 7fa86fb02740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e8a5d41b0 0x560e8a9a4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:43.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.878+0000 7fa86fb02740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e8a5dc390 0x560e8a9a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:43.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.878+0000 7fa86fb02740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x560e8a91ae50 con 0x560e8a5dc390 2024-09-21T04:04:43.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.878+0000 7fa86fb02740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x560e8a90a280 con 0x560e8a5fd070 2024-09-21T04:04:43.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.878+0000 7fa86fb02740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560e8a90e090 con 0x560e8a5d41b0 2024-09-21T04:04:43.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.878+0000 7fa8627fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e8a5dc390 0x560e8a9a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:43.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.879+0000 7fa8627fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e8a5dc390 0x560e8a9a50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40574/0 (socket says 172.21.15.46:40574) 2024-09-21T04:04:43.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.879+0000 7fa8627fc640 1 -- 172.21.15.46:0/1988789802 learned_addr learned my addr 172.21.15.46:0/1988789802 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:43.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.879+0000 7fa862ffd640 1 --2- 172.21.15.46:0/1988789802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e8a5d41b0 0x560e8a9a4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:43.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.879+0000 7fa8627fc640 1 --2- 172.21.15.46:0/1988789802 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e8a5fd070 0x560e8a9a4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:43.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.879+0000 7fa862ffd640 1 -- 172.21.15.46:0/1988789802 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e8a5fd070 msgr2=0x560e8a9a4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:43.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.879+0000 7fa862ffd640 1 --2- 172.21.15.46:0/1988789802 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e8a5fd070 0x560e8a9a4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:43.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.879+0000 7fa862ffd640 1 -- 172.21.15.46:0/1988789802 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e8a5dc390 msgr2=0x560e8a9a50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:43.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.879+0000 7fa862ffd640 1 --2- 172.21.15.46:0/1988789802 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e8a5dc390 0x560e8a9a50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:43.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.879+0000 7fa862ffd640 1 -- 172.21.15.46:0/1988789802 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e8a668650 con 0x560e8a5d41b0 2024-09-21T04:04:43.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.879+0000 7fa84bfff640 1 --2- 172.21.15.46:0/4254447152 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa84c0b6700 0x7fa84c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:43.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.879+0000 7fa862ffd640 1 --2- 172.21.15.46:0/1988789802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e8a5d41b0 0x560e8a9a4b90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa85400ab20 tx=0x7fa85400f3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a89e667c4c3dcdfe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:43.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.879+0000 7fa8627fc640 1 --2- 172.21.15.46:0/4254447152 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa84c0b6700 0x7fa84c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:43.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.879+0000 7fa84bfff640 1 -- 172.21.15.46:0/4254447152 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fa85c0e7750 con 0x7fa86410de10 2024-09-21T04:04:43.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.879+0000 7fa8497fa640 1 -- 172.21.15.46:0/1988789802 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa854004020 con 0x560e8a5d41b0 2024-09-21T04:04:43.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.880+0000 7fa8497fa640 1 -- 172.21.15.46:0/1988789802 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8540054d0 con 0x560e8a5d41b0 2024-09-21T04:04:43.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.880+0000 7fa8497fa640 1 -- 172.21.15.46:0/1988789802 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa854004c10 con 0x560e8a5d41b0 2024-09-21T04:04:43.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.880+0000 7fa86fb02740 1 -- 172.21.15.46:0/1988789802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e8a5d41b0 msgr2=0x560e8a9a4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:43.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.880+0000 7fa86fb02740 1 --2- 172.21.15.46:0/1988789802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e8a5d41b0 0x560e8a9a4b90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa85400ab20 tx=0x7fa85400f3c0 comp rx=0 tx=0).stop 2024-09-21T04:04:43.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.880+0000 7fa8627fc640 1 --2- 172.21.15.46:0/4254447152 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa84c0b6700 0x7fa84c0b8c10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa8580096c0 tx=0x7fa858000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:43.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.880+0000 7fa86fb02740 1 -- 172.21.15.46:0/1988789802 shutdown_connections 2024-09-21T04:04:43.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.880+0000 7fa86fb02740 1 --2- 172.21.15.46:0/1988789802 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e8a5dc390 0x560e8a9a50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:43.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.880+0000 7fa86fb02740 1 --2- 172.21.15.46:0/1988789802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e8a5d41b0 0x560e8a9a4b90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:43.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.880+0000 7fa86fb02740 1 --2- 172.21.15.46:0/1988789802 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e8a5fd070 0x560e8a9a4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:43.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.880+0000 7fa86fb02740 1 -- 172.21.15.46:0/1988789802 >> 172.21.15.46:0/1988789802 conn(0x560e8a5f1460 msgr2=0x560e8a9a2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:43.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.881+0000 7fa86fb02740 1 -- 172.21.15.46:0/1988789802 shutdown_connections 2024-09-21T04:04:43.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.881+0000 7fa86fb02740 1 -- 172.21.15.46:0/1988789802 wait complete. 2024-09-21T04:04:43.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.881+0000 7fa86fb02740 1 -- start start 2024-09-21T04:04:43.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.881+0000 7fa86fb02740 1 Processor -- start 2024-09-21T04:04:43.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.881+0000 7fa86fb02740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e8a5d41b0 0x560e8a9b4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:43.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.881+0000 7fa86fb02740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e8a5dc390 0x560e8a9b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:43.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.881+0000 7fa86fb02740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e8a5fd070 0x560e8a9b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:43.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.881+0000 7fa86fb02740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x560e8a76b700 con 0x560e8a5d41b0 2024-09-21T04:04:43.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.881+0000 7fa86fb02740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x560e8a8a5110 con 0x560e8a5dc390 2024-09-21T04:04:43.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.881+0000 7fa86fb02740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560e8a9b7190 con 0x560e8a5fd070 2024-09-21T04:04:43.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.881+0000 7fa86fb02740 10 client.0 _ll_register_callbacks cb 0x560e8a8be990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:04:43.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.881+0000 7fa862ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e8a5d41b0 0x560e8a9b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:43.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.881+0000 7fa862ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e8a5d41b0 0x560e8a9b4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40582/0 (socket says 172.21.15.46:40582) 2024-09-21T04:04:43.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.881+0000 7fa862ffd640 1 -- 172.21.15.46:0/3212480262 learned_addr learned my addr 172.21.15.46:0/3212480262 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:43.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.882+0000 7fa8637fe640 1 --2- 172.21.15.46:0/3212480262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e8a5fd070 0x560e8a9b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:43.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.882+0000 7fa8627fc640 1 --2- 172.21.15.46:0/3212480262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e8a5dc390 0x560e8a9b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:43.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.882+0000 7fa862ffd640 1 -- 172.21.15.46:0/3212480262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e8a5fd070 msgr2=0x560e8a9b4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:43.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.882+0000 7fa862ffd640 1 --2- 172.21.15.46:0/3212480262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e8a5fd070 0x560e8a9b4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:43.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.882+0000 7fa862ffd640 1 -- 172.21.15.46:0/3212480262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e8a5dc390 msgr2=0x560e8a9b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:43.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.882+0000 7fa862ffd640 1 --2- 172.21.15.46:0/3212480262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e8a5dc390 0x560e8a9b45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:43.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.882+0000 7fa862ffd640 1 -- 172.21.15.46:0/3212480262 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e8a8d2c40 con 0x560e8a5d41b0 2024-09-21T04:04:43.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.882+0000 7fa862ffd640 1 --2- 172.21.15.46:0/3212480262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e8a5d41b0 0x560e8a9b4090 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fa854000c00 tx=0x7fa854004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6af4c20b2a0d6e22 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:43.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.882+0000 7fa846ff5640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:04:43.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.882+0000 7fa846ff5640 1 -- 172.21.15.46:0/3212480262 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa854027020 con 0x560e8a5d41b0 2024-09-21T04:04:43.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.882+0000 7fa86fb02740 1 -- 172.21.15.46:0/3212480262 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8540054d0 con 0x560e8a5d41b0 2024-09-21T04:04:43.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.882+0000 7fa846ff5640 1 -- 172.21.15.46:0/3212480262 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fa854004f40 con 0x560e8a5d41b0 2024-09-21T04:04:43.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.883+0000 7fa846ff5640 1 -- 172.21.15.46:0/3212480262 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa854032050 con 0x560e8a5d41b0 2024-09-21T04:04:43.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.883+0000 7fa86fb02740 10 client.16839 fetch_fsmap learned FSMap version 20 2024-09-21T04:04:43.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.883+0000 7fa86fb02740 1 -- 172.21.15.46:0/3212480262 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560e8a9c2e50 con 0x560e8a5d41b0 2024-09-21T04:04:43.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.884+0000 7fa846ff5640 1 -- 172.21.15.46:0/3212480262 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8540046c0 con 0x560e8a5d41b0 2024-09-21T04:04:43.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.884+0000 7fa846ff5640 1 -- 172.21.15.46:0/3212480262 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa854022070 con 0x560e8a5d41b0 2024-09-21T04:04:43.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.884+0000 7fa86fb02740 10 client.16839 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:04:43.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.884+0000 7fa86fb02740 10 client.16839 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:04:43.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.884+0000 7fa86fb02740 20 client.16839 populate_metadata read hostname 'smithi046' 2024-09-21T04:04:43.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.884+0000 7fa86fb02740 1 --2- 172.21.15.46:0/3212480262 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560e8a5bb9f0 0x560e8a9c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:43.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.884+0000 7fa86fb02740 4 client.16839 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:04:43.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.884+0000 7fa86fb02740 1 -- 172.21.15.46:0/3212480262 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa8540054d0 con 0x560e8a5bb9f0 2024-09-21T04:04:43.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.884+0000 7fa8627fc640 1 --2- 172.21.15.46:0/3212480262 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560e8a5bb9f0 0x560e8a9c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:43.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.885+0000 7fa8627fc640 1 --2- 172.21.15.46:0/3212480262 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560e8a5bb9f0 0x560e8a9c62c0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4feea8d7bb646d61 server_cookie=657a9a6f1279216c in_seq=0 out_seq=0 2024-09-21T04:04:43.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.885+0000 7fa846ff5640 10 client.16839 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:43.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.886+0000 7fa846ff5640 1 -- 172.21.15.46:0/3212480262 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fa8540054d0 con 0x560e8a5bb9f0 2024-09-21T04:04:43.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.886+0000 7fa846ff5640 10 client.16839 handle_command_reply: tid=0 2024-09-21T04:04:43.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.886+0000 7fa86fb02740 1 client.16839 shutdown 2024-09-21T04:04:43.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.886+0000 7fa86fb02740 1 -- 172.21.15.46:0/3212480262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e8a5d41b0 msgr2=0x560e8a9b4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:43.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.886+0000 7fa86fb02740 1 --2- 172.21.15.46:0/3212480262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e8a5d41b0 0x560e8a9b4090 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fa854000c00 tx=0x7fa854004b40 comp rx=0 tx=0).stop 2024-09-21T04:04:43.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.886+0000 7fa86fb02740 1 -- 172.21.15.46:0/3212480262 shutdown_connections 2024-09-21T04:04:43.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.886+0000 7fa86fb02740 1 --2- 172.21.15.46:0/3212480262 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560e8a5bb9f0 0x560e8a9c62c0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:43.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.886+0000 7fa86fb02740 1 --2- 172.21.15.46:0/3212480262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e8a5fd070 0x560e8a9b4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:43.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.886+0000 7fa86fb02740 1 --2- 172.21.15.46:0/3212480262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e8a5dc390 0x560e8a9b45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:43.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.886+0000 7fa86fb02740 1 --2- 172.21.15.46:0/3212480262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e8a5d41b0 0x560e8a9b4090 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:43.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.886+0000 7fa86fb02740 1 -- 172.21.15.46:0/3212480262 >> 172.21.15.46:0/3212480262 conn(0x560e8a5f1460 msgr2=0x560e8a9a0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:43.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.886+0000 7fa846ff5640 0 client.16839 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:43.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.886+0000 7fa86fb02740 1 -- 172.21.15.46:0/3212480262 shutdown_connections 2024-09-21T04:04:43.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.886+0000 7fa86fb02740 1 -- 172.21.15.46:0/3212480262 wait complete. 2024-09-21T04:04:43.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.886+0000 7fa86fb02740 20 client.16839 trim_cache size 0 max 16384 2024-09-21T04:04:43.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.904+0000 7fa86fb02740 1 Processor -- start 2024-09-21T04:04:43.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.904+0000 7fa86fb02740 1 -- start start 2024-09-21T04:04:43.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.905+0000 7fa86fb02740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e8a5d41b0 0x560e8a9b5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:43.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.905+0000 7fa86fb02740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e8a5dc390 0x560e8a9a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:43.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.905+0000 7fa86fb02740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e8a5fd070 0x560e8a9a20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:43.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.905+0000 7fa86fb02740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa8641ab410 con 0x560e8a5d41b0 2024-09-21T04:04:43.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.905+0000 7fa86fb02740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa8641adc70 con 0x560e8a5dc390 2024-09-21T04:04:43.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.905+0000 7fa86fb02740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa8641aba60 con 0x560e8a5fd070 2024-09-21T04:04:43.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.905+0000 7fa862ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e8a5d41b0 0x560e8a9b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:43.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.905+0000 7fa862ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e8a5d41b0 0x560e8a9b5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40588/0 (socket says 172.21.15.46:40588) 2024-09-21T04:04:43.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.905+0000 7fa862ffd640 1 -- 172.21.15.46:0/1084288257 learned_addr learned my addr 172.21.15.46:0/1084288257 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:43.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.905+0000 7fa8627fc640 1 --2- 172.21.15.46:0/1084288257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e8a5dc390 0x560e8a9a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:43.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.905+0000 7fa862ffd640 1 -- 172.21.15.46:0/1084288257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e8a5fd070 msgr2=0x560e8a9a20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:43.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.905+0000 7fa862ffd640 1 --2- 172.21.15.46:0/1084288257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e8a5fd070 0x560e8a9a20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:43.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.905+0000 7fa862ffd640 1 -- 172.21.15.46:0/1084288257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e8a5dc390 msgr2=0x560e8a9a1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:43.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.905+0000 7fa862ffd640 1 --2- 172.21.15.46:0/1084288257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e8a5dc390 0x560e8a9a1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:43.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.905+0000 7fa862ffd640 1 -- 172.21.15.46:0/1084288257 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e8a9b2590 con 0x560e8a5d41b0 2024-09-21T04:04:43.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.905+0000 7fa862ffd640 1 --2- 172.21.15.46:0/1084288257 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e8a5d41b0 0x560e8a9b5540 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fa85400a540 tx=0x7fa854005c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a15a577e5ee5771e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:43.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.906+0000 7fa848ff9640 1 -- 172.21.15.46:0/1084288257 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85401c030 con 0x560e8a5d41b0 2024-09-21T04:04:43.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.906+0000 7fa848ff9640 1 -- 172.21.15.46:0/1084288257 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa85400a720 con 0x560e8a5d41b0 2024-09-21T04:04:43.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.906+0000 7fa848ff9640 1 -- 172.21.15.46:0/1084288257 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa854004f40 con 0x560e8a5d41b0 2024-09-21T04:04:43.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.907+0000 7fa86fb02740 1 -- 172.21.15.46:0/1084288257 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e8a5d41b0 msgr2=0x560e8a9b5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:43.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.907+0000 7fa86fb02740 1 --2- 172.21.15.46:0/1084288257 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e8a5d41b0 0x560e8a9b5540 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fa85400a540 tx=0x7fa854005c40 comp rx=0 tx=0).stop 2024-09-21T04:04:43.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.907+0000 7fa86fb02740 1 -- 172.21.15.46:0/1084288257 shutdown_connections 2024-09-21T04:04:43.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.907+0000 7fa86fb02740 1 --2- 172.21.15.46:0/1084288257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e8a5fd070 0x560e8a9a20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:43.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.907+0000 7fa86fb02740 1 --2- 172.21.15.46:0/1084288257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e8a5dc390 0x560e8a9a1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:43.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.907+0000 7fa86fb02740 1 --2- 172.21.15.46:0/1084288257 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e8a5d41b0 0x560e8a9b5540 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:43.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.907+0000 7fa86fb02740 1 -- 172.21.15.46:0/1084288257 >> 172.21.15.46:0/1084288257 conn(0x560e8a5f1460 msgr2=0x560e8a9a6040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:43.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.907+0000 7fa86fb02740 1 -- 172.21.15.46:0/1084288257 shutdown_connections 2024-09-21T04:04:43.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.907+0000 7fa86fb02740 1 -- 172.21.15.46:0/1084288257 wait complete. 2024-09-21T04:04:43.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.907+0000 7fa86fb02740 1 -- start start 2024-09-21T04:04:43.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.907+0000 7fa86fb02740 1 Processor -- start 2024-09-21T04:04:43.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.907+0000 7fa86fb02740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e8a5d41b0 0x560e8a9c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:43.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.907+0000 7fa86fb02740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e8a5dc390 0x560e8a9c7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:43.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.907+0000 7fa86fb02740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e8a5fd070 0x560e8a9c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:43.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.908+0000 7fa86fb02740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa8641ac130 con 0x560e8a5d41b0 2024-09-21T04:04:43.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.908+0000 7fa86fb02740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa8641ad5a0 con 0x560e8a5dc390 2024-09-21T04:04:43.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.908+0000 7fa86fb02740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa8641ac800 con 0x560e8a5fd070 2024-09-21T04:04:43.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.908+0000 7fa86fb02740 10 client.0 _ll_register_callbacks cb 0x7fa858032b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:04:43.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.908+0000 7fa8627fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e8a5dc390 0x560e8a9c7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:43.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.908+0000 7fa862ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e8a5d41b0 0x560e8a9c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:43.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.908+0000 7fa8627fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e8a5dc390 0x560e8a9c7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.46:42444/0 (socket says 172.21.15.46:42444) 2024-09-21T04:04:43.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.908+0000 7fa8627fc640 1 -- 172.21.15.46:0/675108882 learned_addr learned my addr 172.21.15.46:0/675108882 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:43.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.908+0000 7fa8637fe640 1 --2- 172.21.15.46:0/675108882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e8a5fd070 0x560e8a9c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:43.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.908+0000 7fa8627fc640 1 -- 172.21.15.46:0/675108882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e8a5fd070 msgr2=0x560e8a9c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:43.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.908+0000 7fa8627fc640 1 --2- 172.21.15.46:0/675108882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e8a5fd070 0x560e8a9c75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:43.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.908+0000 7fa8627fc640 1 -- 172.21.15.46:0/675108882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e8a5d41b0 msgr2=0x560e8a9c9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:43.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.908+0000 7fa8627fc640 1 --2- 172.21.15.46:0/675108882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e8a5d41b0 0x560e8a9c9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:43.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.908+0000 7fa8627fc640 1 -- 172.21.15.46:0/675108882 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e8a9c7d30 con 0x560e8a5dc390 2024-09-21T04:04:43.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.908+0000 7fa862ffd640 1 --2- 172.21.15.46:0/675108882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e8a5d41b0 0x560e8a9c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:04:43.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.908+0000 7fa8627fc640 1 --2- 172.21.15.46:0/675108882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e8a5dc390 0x560e8a9c7000 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa858009230 tx=0x7fa858031400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15f87cdd81b9c8b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:43.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.908+0000 7fa846ff5640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-21T04:04:43.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.909+0000 7fa846ff5640 1 -- 172.21.15.46:0/675108882 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa858059060 con 0x560e8a5dc390 2024-09-21T04:04:43.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.909+0000 7fa846ff5640 1 -- 172.21.15.46:0/675108882 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fa858004450 con 0x560e8a5dc390 2024-09-21T04:04:43.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.909+0000 7fa86fb02740 1 -- 172.21.15.46:0/675108882 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa85400a720 con 0x560e8a5dc390 2024-09-21T04:04:43.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.909+0000 7fa846ff5640 1 -- 172.21.15.46:0/675108882 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa858035040 con 0x560e8a5dc390 2024-09-21T04:04:43.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.909+0000 7fa86fb02740 10 client.26222 fetch_fsmap learned FSMap version 20 2024-09-21T04:04:43.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.909+0000 7fa86fb02740 1 -- 172.21.15.46:0/675108882 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560e8aa30a60 con 0x560e8a5dc390 2024-09-21T04:04:43.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.909+0000 7fa846ff5640 1 -- 172.21.15.46:0/675108882 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa85400a720 con 0x560e8a5dc390 2024-09-21T04:04:43.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.909+0000 7fa846ff5640 1 -- 172.21.15.46:0/675108882 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa85805c020 con 0x560e8a5dc390 2024-09-21T04:04:43.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.909+0000 7fa86fb02740 10 client.26222 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:04:43.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.909+0000 7fa86fb02740 10 client.26222 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:04:43.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.909+0000 7fa86fb02740 20 client.26222 populate_metadata read hostname 'smithi046' 2024-09-21T04:04:43.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.909+0000 7fa86fb02740 1 --2- 172.21.15.46:0/675108882 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560e8a590da0 0x560e8aa331d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:43.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.909+0000 7fa86fb02740 4 client.26222 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T04:04:43.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.909+0000 7fa86fb02740 1 -- 172.21.15.46:0/675108882 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560e8a91cda0 con 0x560e8a590da0 2024-09-21T04:04:43.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.910+0000 7fa862ffd640 1 --2- 172.21.15.46:0/675108882 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560e8a590da0 0x560e8aa331d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:43.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.910+0000 7fa862ffd640 1 --2- 172.21.15.46:0/675108882 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560e8a590da0 0x560e8aa331d0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2589d0005f46c9cd server_cookie=68813e59d84585cf in_seq=0 out_seq=0 2024-09-21T04:04:43.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.910+0000 7fa846ff5640 10 client.26222 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:43.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.910+0000 7fa846ff5640 1 -- 172.21.15.46:0/675108882 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5486 (crc 0 0 0) 0x560e8a91cda0 con 0x560e8a590da0 2024-09-21T04:04:43.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.910+0000 7fa846ff5640 10 client.26222 handle_command_reply: tid=0 2024-09-21T04:04:43.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.910+0000 7fa86fb02740 1 client.26222 shutdown 2024-09-21T04:04:43.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.910+0000 7fa86fb02740 1 -- 172.21.15.46:0/675108882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e8a5dc390 msgr2=0x560e8a9c7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:43.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.910+0000 7fa86fb02740 1 --2- 172.21.15.46:0/675108882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e8a5dc390 0x560e8a9c7000 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa858009230 tx=0x7fa858031400 comp rx=0 tx=0).stop 2024-09-21T04:04:43.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.911+0000 7fa86fb02740 1 -- 172.21.15.46:0/675108882 shutdown_connections 2024-09-21T04:04:43.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.911+0000 7fa86fb02740 1 --2- 172.21.15.46:0/675108882 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560e8a590da0 0x560e8aa331d0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:43.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.911+0000 7fa86fb02740 1 --2- 172.21.15.46:0/675108882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560e8a5fd070 0x560e8a9c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:43.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.911+0000 7fa86fb02740 1 --2- 172.21.15.46:0/675108882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560e8a5dc390 0x560e8a9c7000 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:43.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.911+0000 7fa86fb02740 1 --2- 172.21.15.46:0/675108882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560e8a5d41b0 0x560e8a9c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:43.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.911+0000 7fa86fb02740 1 -- 172.21.15.46:0/675108882 >> 172.21.15.46:0/675108882 conn(0x560e8a5f1460 msgr2=0x560e8a9a5680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:43.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.911+0000 7fa846ff5640 0 client.26222 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:43.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.911+0000 7fa86fb02740 1 -- 172.21.15.46:0/675108882 shutdown_connections 2024-09-21T04:04:43.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.911+0000 7fa86fb02740 1 -- 172.21.15.46:0/675108882 wait complete. 2024-09-21T04:04:43.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.911+0000 7fa86fb02740 20 client.26222 trim_cache size 0 max 16384 2024-09-21T04:04:43.917 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T04:04:43.918 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "no active scrubs running", 2024-09-21T04:04:43.918 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": {}, 2024-09-21T04:04:43.918 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_stats": { 2024-09-21T04:04:43.918 INFO:teuthology.orchestra.run.smithi046.stdout: "37d17ccb-273f-4c50-a691-5064dad9d193": { 2024-09-21T04:04:43.918 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:04:10.480657+0000", 2024-09-21T04:04:43.918 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:43.918 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:43.918 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:43.918 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:43.918 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:43.918 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:43.918 INFO:teuthology.orchestra.run.smithi046.stdout: "50776be6-bb03-4b39-ad4d-719e50e97356": { 2024-09-21T04:04:43.918 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:04:03.083808+0000", 2024-09-21T04:04:43.919 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:43.919 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:43.919 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:43.919 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:43.919 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:43.919 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:43.919 INFO:teuthology.orchestra.run.smithi046.stdout: "cfba6404-dc3f-4ad2-b873-926d5f9007de": { 2024-09-21T04:04:43.919 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:03:23.788611+0000", 2024-09-21T04:04:43.919 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:43.919 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:43.919 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:43.919 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:43.919 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:43.920 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:43.920 INFO:teuthology.orchestra.run.smithi046.stdout: "96aa13fd-aa77-46b5-b20e-a9b203dc7a94": { 2024-09-21T04:04:43.920 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:02:44.727411+0000", 2024-09-21T04:04:43.920 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:43.920 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:43.920 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:43.920 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:43.920 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:43.920 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:43.920 INFO:teuthology.orchestra.run.smithi046.stdout: "64865e31-a445-43e8-9fa3-26fae089b973": { 2024-09-21T04:04:43.920 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:02:37.376562+0000", 2024-09-21T04:04:43.920 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:43.920 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:43.920 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:43.921 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:43.921 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:43.921 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:43.921 INFO:teuthology.orchestra.run.smithi046.stdout: "7a3afabe-6b27-4bce-928a-8c6773a85803": { 2024-09-21T04:04:43.921 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:01:58.413358+0000", 2024-09-21T04:04:43.921 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:43.921 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:43.921 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:43.921 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:43.921 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:43.921 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:43.921 INFO:teuthology.orchestra.run.smithi046.stdout: "08f0c962-df1a-4129-a1a2-b916240d9803": { 2024-09-21T04:04:43.921 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:02.937596+0000", 2024-09-21T04:04:43.922 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:43.922 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:43.922 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:43.922 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:43.922 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:43.922 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:43.922 INFO:teuthology.orchestra.run.smithi046.stdout: "d49f33a7-3d5a-421b-94ba-8b19a4120db1": { 2024-09-21T04:04:43.922 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:50.480786+0000", 2024-09-21T04:04:43.922 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:43.922 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:43.922 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:43.922 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:43.922 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:43.923 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:43.923 INFO:teuthology.orchestra.run.smithi046.stdout: "a871f724-0198-493c-b03e-b2de78aba243": { 2024-09-21T04:04:43.923 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:56:30.082991+0000", 2024-09-21T04:04:43.923 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:43.923 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:43.923 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:43.923 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:43.923 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:43.923 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:43.923 INFO:teuthology.orchestra.run.smithi046.stdout: "edc4b8c7-b702-489d-a925-ae7ad0ff0d9a": { 2024-09-21T04:04:43.923 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:00:40.181950+0000", 2024-09-21T04:04:43.923 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:43.923 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:43.923 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:43.924 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:43.924 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:43.924 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:43.924 INFO:teuthology.orchestra.run.smithi046.stdout: "3bbf7097-70d7-4743-bbce-41465502b35b": { 2024-09-21T04:04:43.924 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:10.661441+0000", 2024-09-21T04:04:43.924 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:43.924 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:43.924 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:43.924 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:43.924 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:43.924 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:43.924 INFO:teuthology.orchestra.run.smithi046.stdout: "e24ec8f1-0d13-478f-9c2c-b51798868ffc": { 2024-09-21T04:04:43.924 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:09.736194+0000", 2024-09-21T04:04:43.924 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:43.925 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:43.925 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:43.925 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:43.925 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:43.925 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:43.925 INFO:teuthology.orchestra.run.smithi046.stdout: "c47f458a-de5e-4952-a575-a81261953667": { 2024-09-21T04:04:43.925 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:48.699411+0000", 2024-09-21T04:04:43.925 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:43.925 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:43.925 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:43.925 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:43.925 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:43.925 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:43.925 INFO:teuthology.orchestra.run.smithi046.stdout: "6103c660-8e77-4b06-ad6c-bb322c26035a": { 2024-09-21T04:04:43.926 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:35.594467+0000", 2024-09-21T04:04:43.926 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:43.926 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:43.926 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:43.926 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:43.926 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:43.926 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:43.926 INFO:teuthology.orchestra.run.smithi046.stdout: "46bb5415-6e16-47c6-a1e4-55f9c623ce90": { 2024-09-21T04:04:43.926 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:14.950674+0000", 2024-09-21T04:04:43.926 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:43.926 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:43.926 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:43.926 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:43.926 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:43.927 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:43.927 INFO:teuthology.orchestra.run.smithi046.stdout: "326aaecf-f38a-4946-988a-d83f25556995": { 2024-09-21T04:04:43.927 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:54.189884+0000", 2024-09-21T04:04:43.927 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:43.927 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:43.927 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:43.927 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:43.927 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:43.927 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:43.927 INFO:teuthology.orchestra.run.smithi046.stdout: "dab67652-8894-4711-be64-cbdfea27a9ba": { 2024-09-21T04:04:43.927 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:28.161616+0000", 2024-09-21T04:04:43.927 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:43.927 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:43.928 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:43.928 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:43.928 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:43.928 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:43.928 INFO:teuthology.orchestra.run.smithi046.stdout: "0d781b95-cf5e-46f2-9875-2923181385e2": { 2024-09-21T04:04:43.928 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:00:33.099094+0000", 2024-09-21T04:04:43.928 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:43.928 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:43.928 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:43.928 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:43.928 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:43.928 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:43.928 INFO:teuthology.orchestra.run.smithi046.stdout: "d7634007-e881-46f7-9833-ac9bd0a3100e": { 2024-09-21T04:04:43.929 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:01:19.459151+0000", 2024-09-21T04:04:43.929 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:43.929 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:43.929 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:43.929 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:43.929 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:43.929 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:04:43.929 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:04:43.929 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T04:04:43.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.911+0000 7fa86958e640 1 -- 172.21.15.46:0/4254447152 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa84c0b6700 msgr2=0x7fa84c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:43.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.911+0000 7fa86958e640 1 --2- 172.21.15.46:0/4254447152 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa84c0b6700 0x7fa84c0b8c10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa8580096c0 tx=0x7fa858000bc0 comp rx=0 tx=0).stop 2024-09-21T04:04:43.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.911+0000 7fa86958e640 1 -- 172.21.15.46:0/4254447152 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa86410de10 msgr2=0x7fa86419fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:43.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.911+0000 7fa86958e640 1 --2- 172.21.15.46:0/4254447152 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa86410de10 0x7fa86419fce0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fa85c00eaa0 tx=0x7fa85c00ef60 comp rx=0 tx=0).stop 2024-09-21T04:04:43.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.912+0000 7fa86958e640 1 -- 172.21.15.46:0/4254447152 shutdown_connections 2024-09-21T04:04:43.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.912+0000 7fa86958e640 1 --2- 172.21.15.46:0/4254447152 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa86410de10 0x7fa86419fce0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:43.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.912+0000 7fa86958e640 1 --2- 172.21.15.46:0/4254447152 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa864105300 0x7fa86419aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:43.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.912+0000 7fa86958e640 1 --2- 172.21.15.46:0/4254447152 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa84c0b6700 0x7fa84c0b8c10 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:43.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.912+0000 7fa86958e640 1 --2- 172.21.15.46:0/4254447152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8641049b0 0x7fa86419a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:43.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.912+0000 7fa86958e640 1 -- 172.21.15.46:0/4254447152 >> 172.21.15.46:0/4254447152 conn(0x7fa864079730 msgr2=0x7fa864100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:43.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.912+0000 7fa86958e640 1 -- 172.21.15.46:0/4254447152 shutdown_connections 2024-09-21T04:04:43.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:43.912+0000 7fa86958e640 1 -- 172.21.15.46:0/4254447152 wait complete. 2024-09-21T04:04:44.871 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T04:04:44.871 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:04:45.129 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:04:45.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:45 smithi046 ceph-mon[30954]: pgmap v617: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:04:45.568 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:45 smithi105 ceph-mon[34773]: pgmap v617: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:04:45.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.620+0000 7fb2dacc3640 1 -- 172.21.15.46:0/2316138092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2d4108f60 msgr2=0x7fb2d410f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:45.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.620+0000 7fb2dacc3640 1 --2- 172.21.15.46:0/2316138092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2d4108f60 0x7fb2d410f790 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc009ca0 tx=0x7fb2cc02a8c0 comp rx=0 tx=0).stop 2024-09-21T04:04:45.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.620+0000 7fb2dacc3640 1 -- 172.21.15.46:0/2316138092 shutdown_connections 2024-09-21T04:04:45.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.620+0000 7fb2dacc3640 1 --2- 172.21.15.46:0/2316138092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2d4108f60 0x7fb2d410f790 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:45.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.620+0000 7fb2dacc3640 1 --2- 172.21.15.46:0/2316138092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2d4108610 0x7fb2d4108a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:45.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.620+0000 7fb2dacc3640 1 --2- 172.21.15.46:0/2316138092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2d41031d0 0x7fb2d41035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:45.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.620+0000 7fb2dacc3640 1 -- 172.21.15.46:0/2316138092 >> 172.21.15.46:0/2316138092 conn(0x7fb2d4079e40 msgr2=0x7fb2d407a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:45.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.620+0000 7fb2dacc3640 1 -- 172.21.15.46:0/2316138092 shutdown_connections 2024-09-21T04:04:45.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.620+0000 7fb2dacc3640 1 -- 172.21.15.46:0/2316138092 wait complete. 2024-09-21T04:04:45.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.621+0000 7fb2dacc3640 1 Processor -- start 2024-09-21T04:04:45.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.621+0000 7fb2dacc3640 1 -- start start 2024-09-21T04:04:45.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.621+0000 7fb2dacc3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2d41031d0 0x7fb2d419a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:45.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.621+0000 7fb2dacc3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2d4108610 0x7fb2d419ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:45.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.621+0000 7fb2dacc3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2d4108f60 0x7fb2d419fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:45.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.621+0000 7fb2dacc3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d4112c20 con 0x7fb2d41031d0 2024-09-21T04:04:45.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.621+0000 7fb2dacc3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d4112aa0 con 0x7fb2d4108610 2024-09-21T04:04:45.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.621+0000 7fb2dacc3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d4112da0 con 0x7fb2d4108f60 2024-09-21T04:04:45.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.621+0000 7fb2d8a5f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2d41031d0 0x7fb2d419a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:45.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.621+0000 7fb2d8a5f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2d41031d0 0x7fb2d419a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40618/0 (socket says 172.21.15.46:40618) 2024-09-21T04:04:45.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.621+0000 7fb2d8a5f640 1 -- 172.21.15.46:0/1607228467 learned_addr learned my addr 172.21.15.46:0/1607228467 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:45.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.621+0000 7fb2d9260640 1 --2- 172.21.15.46:0/1607228467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2d4108f60 0x7fb2d419fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:45.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.621+0000 7fb2d3fff640 1 --2- 172.21.15.46:0/1607228467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2d4108610 0x7fb2d419ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:45.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.622+0000 7fb2d8a5f640 1 -- 172.21.15.46:0/1607228467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2d4108f60 msgr2=0x7fb2d419fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:45.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.622+0000 7fb2d8a5f640 1 --2- 172.21.15.46:0/1607228467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2d4108f60 0x7fb2d419fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:45.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.622+0000 7fb2d8a5f640 1 -- 172.21.15.46:0/1607228467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2d4108610 msgr2=0x7fb2d419ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:45.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.622+0000 7fb2d8a5f640 1 --2- 172.21.15.46:0/1607228467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2d4108610 0x7fb2d419ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:45.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.622+0000 7fb2d8a5f640 1 -- 172.21.15.46:0/1607228467 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d41a0530 con 0x7fb2d41031d0 2024-09-21T04:04:45.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.622+0000 7fb2d3fff640 1 --2- 172.21.15.46:0/1607228467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2d4108610 0x7fb2d419ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:04:45.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.622+0000 7fb2d8a5f640 1 --2- 172.21.15.46:0/1607228467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2d41031d0 0x7fb2d419a680 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fb2c400c920 tx=0x7fb2c400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:45.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.622+0000 7fb2d1ffb640 1 -- 172.21.15.46:0/1607228467 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c4007c70 con 0x7fb2d41031d0 2024-09-21T04:04:45.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.622+0000 7fb2d1ffb640 1 -- 172.21.15.46:0/1607228467 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2c4007e10 con 0x7fb2d41031d0 2024-09-21T04:04:45.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.622+0000 7fb2d1ffb640 1 -- 172.21.15.46:0/1607228467 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c4018820 con 0x7fb2d41031d0 2024-09-21T04:04:45.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.622+0000 7fb2dacc3640 1 -- 172.21.15.46:0/1607228467 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2d41a0820 con 0x7fb2d41031d0 2024-09-21T04:04:45.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.622+0000 7fb2dacc3640 1 -- 172.21.15.46:0/1607228467 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2d41a7040 con 0x7fb2d41031d0 2024-09-21T04:04:45.627 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:45 smithi162 ceph-mon[35071]: pgmap v617: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:04:45.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.623+0000 7fb2dacc3640 1 -- 172.21.15.46:0/1607228467 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2d41035e0 con 0x7fb2d41031d0 2024-09-21T04:04:45.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.625+0000 7fb2d1ffb640 1 -- 172.21.15.46:0/1607228467 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7fb2c400f450 con 0x7fb2d41031d0 2024-09-21T04:04:45.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.625+0000 7fb2d1ffb640 1 --2- 172.21.15.46:0/1607228467 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb2bc0b6730 0x7fb2bc0b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:45.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.626+0000 7fb2d3fff640 1 --2- 172.21.15.46:0/1607228467 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb2bc0b6730 0x7fb2bc0b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:45.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.626+0000 7fb2d1ffb640 1 -- 172.21.15.46:0/1607228467 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fb2c40e79f0 con 0x7fb2d41031d0 2024-09-21T04:04:45.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.626+0000 7fb2d3fff640 1 --2- 172.21.15.46:0/1607228467 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb2bc0b6730 0x7fb2bc0b8c40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb2d406b0d0 tx=0x7fb2c8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:45.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.629+0000 7fb2d1ffb640 1 -- 172.21.15.46:0/1607228467 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb2c4014030 con 0x7fb2d41031d0 2024-09-21T04:04:45.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.855+0000 7fb2dacc3640 1 -- 172.21.15.46:0/1607228467 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb2d419b7b0 con 0x7fb2d41031d0 2024-09-21T04:04:45.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.856+0000 7fb2d1ffb640 1 -- 172.21.15.46:0/1607228467 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7fb2c40ae0c0 con 0x7fb2d41031d0 2024-09-21T04:04:45.859 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T04:04:45.859 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"btime":"2024-09-21T03:53:23:865820+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1766354184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1766354184},{"type":"v1","addr":"172.21.15.46:6839","nonce":1766354184}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/1901774207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":1901774207},{"type":"v1","addr":"172.21.15.46:6841","nonce":1901774207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3548633196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":3548633196},{"type":"v1","addr":"172.21.15.105:6837","nonce":3548633196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24652,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3551934241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3551934241},{"type":"v1","addr":"172.21.15.162:6835","nonce":3551934241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/48949822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":48949822},{"type":"v1","addr":"172.21.15.162:6837","nonce":48949822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:53:14.452819+0000","modified":"2024-09-21T03:53:23.593278+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24680},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/2196053213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2196053213},{"type":"v1","addr":"172.21.15.162:6839","nonce":2196053213}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.105:6839/3911438406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":3911438406},{"type":"v1","addr":"172.21.15.105:6839","nonce":3911438406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24680,"qdb_cluster":[24680]},"id":1}]} 2024-09-21T04:04:45.859 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T04:04:45.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.858+0000 7fb2dacc3640 1 -- 172.21.15.46:0/1607228467 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb2bc0b6730 msgr2=0x7fb2bc0b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:45.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.858+0000 7fb2dacc3640 1 --2- 172.21.15.46:0/1607228467 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb2bc0b6730 0x7fb2bc0b8c40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb2d406b0d0 tx=0x7fb2c8005f90 comp rx=0 tx=0).stop 2024-09-21T04:04:45.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.858+0000 7fb2dacc3640 1 -- 172.21.15.46:0/1607228467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2d41031d0 msgr2=0x7fb2d419a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:45.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.858+0000 7fb2dacc3640 1 --2- 172.21.15.46:0/1607228467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2d41031d0 0x7fb2d419a680 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fb2c400c920 tx=0x7fb2c400cde0 comp rx=0 tx=0).stop 2024-09-21T04:04:45.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.858+0000 7fb2dacc3640 1 -- 172.21.15.46:0/1607228467 shutdown_connections 2024-09-21T04:04:45.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.858+0000 7fb2dacc3640 1 --2- 172.21.15.46:0/1607228467 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fb2bc0b6730 0x7fb2bc0b8c40 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:45.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.858+0000 7fb2dacc3640 1 --2- 172.21.15.46:0/1607228467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2d4108f60 0x7fb2d419fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:45.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.858+0000 7fb2dacc3640 1 --2- 172.21.15.46:0/1607228467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2d4108610 0x7fb2d419ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:45.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.858+0000 7fb2dacc3640 1 --2- 172.21.15.46:0/1607228467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2d41031d0 0x7fb2d419a680 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:45.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.858+0000 7fb2dacc3640 1 -- 172.21.15.46:0/1607228467 >> 172.21.15.46:0/1607228467 conn(0x7fb2d4079e40 msgr2=0x7fb2d4101250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:45.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.858+0000 7fb2dacc3640 1 -- 172.21.15.46:0/1607228467 shutdown_connections 2024-09-21T04:04:45.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:45.858+0000 7fb2dacc3640 1 -- 172.21.15.46:0/1607228467 wait complete. 2024-09-21T04:04:46.476 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:46 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/1607228467' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:04:46.504 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T04:04:46.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:46 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/1607228467' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:04:46.764 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:04:46.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:46 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/1607228467' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:04:47.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.254+0000 7f37850f8640 1 -- 172.21.15.46:0/2618867551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3780102a60 msgr2=0x7f3780102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:47.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.254+0000 7f37850f8640 1 --2- 172.21.15.46:0/2618867551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3780102a60 0x7f3780102e70 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f3770009ca0 tx=0x7f377002a8c0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.254+0000 7f37850f8640 1 -- 172.21.15.46:0/2618867551 shutdown_connections 2024-09-21T04:04:47.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.254+0000 7f37850f8640 1 --2- 172.21.15.46:0/2618867551 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3780108cf0 0x7f378010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.254+0000 7f37850f8640 1 --2- 172.21.15.46:0/2618867551 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37801083a0 0x7f37801087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.254+0000 7f37850f8640 1 --2- 172.21.15.46:0/2618867551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3780102a60 0x7f3780102e70 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.254+0000 7f37850f8640 1 -- 172.21.15.46:0/2618867551 >> 172.21.15.46:0/2618867551 conn(0x7f3780079730 msgr2=0x7f3780079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:47.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.254+0000 7f37850f8640 1 -- 172.21.15.46:0/2618867551 shutdown_connections 2024-09-21T04:04:47.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.254+0000 7f37850f8640 1 -- 172.21.15.46:0/2618867551 wait complete. 2024-09-21T04:04:47.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.255+0000 7f37850f8640 1 Processor -- start 2024-09-21T04:04:47.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.255+0000 7f37850f8640 1 -- start start 2024-09-21T04:04:47.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.255+0000 7f37850f8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3780102a60 0x7f378019c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:47.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.255+0000 7f37850f8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37801083a0 0x7f378019cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:47.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.255+0000 7f37850f8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3780108cf0 0x7f37801a1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:47.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.255+0000 7f37850f8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3780113a80 con 0x7f3780102a60 2024-09-21T04:04:47.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.255+0000 7f37850f8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3780113900 con 0x7f37801083a0 2024-09-21T04:04:47.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.255+0000 7f37850f8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3780113c00 con 0x7f3780108cf0 2024-09-21T04:04:47.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.256+0000 7f377ed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3780102a60 0x7f378019c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:47.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.256+0000 7f377ed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3780102a60 0x7f378019c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40638/0 (socket says 172.21.15.46:40638) 2024-09-21T04:04:47.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.256+0000 7f377ed9d640 1 -- 172.21.15.46:0/222091454 learned_addr learned my addr 172.21.15.46:0/222091454 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:47.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.256+0000 7f377e59c640 1 --2- 172.21.15.46:0/222091454 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37801083a0 0x7f378019cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:47.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.256+0000 7f377f59e640 1 --2- 172.21.15.46:0/222091454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3780108cf0 0x7f37801a1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:47.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.256+0000 7f377ed9d640 1 -- 172.21.15.46:0/222091454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3780108cf0 msgr2=0x7f37801a1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:47.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.256+0000 7f377ed9d640 1 --2- 172.21.15.46:0/222091454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3780108cf0 0x7f37801a1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.256+0000 7f377ed9d640 1 -- 172.21.15.46:0/222091454 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37801083a0 msgr2=0x7f378019cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:47.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.256+0000 7f377ed9d640 1 --2- 172.21.15.46:0/222091454 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37801083a0 0x7f378019cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.256+0000 7f377ed9d640 1 -- 172.21.15.46:0/222091454 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37801a2620 con 0x7f3780102a60 2024-09-21T04:04:47.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.256+0000 7f377ed9d640 1 --2- 172.21.15.46:0/222091454 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3780102a60 0x7f378019c6b0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f3770006010 tx=0x7f37700319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:47.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.256+0000 7f3777fff640 1 -- 172.21.15.46:0/222091454 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3770003bf0 con 0x7f3780102a60 2024-09-21T04:04:47.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.256+0000 7f3777fff640 1 -- 172.21.15.46:0/222091454 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3770003d90 con 0x7f3780102a60 2024-09-21T04:04:47.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.256+0000 7f37850f8640 1 -- 172.21.15.46:0/222091454 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37801a28b0 con 0x7f3780102a60 2024-09-21T04:04:47.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.256+0000 7f3777fff640 1 -- 172.21.15.46:0/222091454 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377002fc20 con 0x7f3780102a60 2024-09-21T04:04:47.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.256+0000 7f37850f8640 1 -- 172.21.15.46:0/222091454 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37801a9070 con 0x7f3780102a60 2024-09-21T04:04:47.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.259+0000 7f378b66c740 1 Processor -- start 2024-09-21T04:04:47.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.260+0000 7f378b66c740 1 -- start start 2024-09-21T04:04:47.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.260+0000 7f378b66c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d43d5ce070 0x55d43d9756a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:47.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.260+0000 7f378b66c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d43d5a51b0 0x55d43d975be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:47.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.260+0000 7f378b66c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d43d5ad390 0x55d43d976120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:47.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.260+0000 7f378b66c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55d43d8ebea0 con 0x55d43d5ad390 2024-09-21T04:04:47.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.260+0000 7f378b66c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55d43d8db2d0 con 0x55d43d5a51b0 2024-09-21T04:04:47.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.260+0000 7f378b66c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d43d8df0e0 con 0x55d43d5ce070 2024-09-21T04:04:47.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.260+0000 7f3777fff640 1 -- 172.21.15.46:0/222091454 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f37700305c0 con 0x7f3780102a60 2024-09-21T04:04:47.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.260+0000 7f377e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d43d5ad390 0x55d43d976120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:47.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.260+0000 7f377e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d43d5ad390 0x55d43d976120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40646/0 (socket says 172.21.15.46:40646) 2024-09-21T04:04:47.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.260+0000 7f377e59c640 1 -- 172.21.15.46:0/25489661 learned_addr learned my addr 172.21.15.46:0/25489661 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:47.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.261+0000 7f377f59e640 1 --2- 172.21.15.46:0/25489661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d43d5ce070 0x55d43d9756a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:47.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.261+0000 7f377ed9d640 1 --2- 172.21.15.46:0/25489661 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d43d5a51b0 0x55d43d975be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:47.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.261+0000 7f377e59c640 1 -- 172.21.15.46:0/25489661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d43d5ce070 msgr2=0x55d43d9756a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:47.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.261+0000 7f377e59c640 1 --2- 172.21.15.46:0/25489661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d43d5ce070 0x55d43d9756a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.261+0000 7f377e59c640 1 -- 172.21.15.46:0/25489661 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d43d5a51b0 msgr2=0x55d43d975be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:47.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.261+0000 7f377e59c640 1 --2- 172.21.15.46:0/25489661 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d43d5a51b0 0x55d43d975be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.261+0000 7f377e59c640 1 -- 172.21.15.46:0/25489661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d43d639650 con 0x55d43d5ad390 2024-09-21T04:04:47.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.261+0000 7f377ed9d640 1 --2- 172.21.15.46:0/25489661 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d43d5a51b0 0x55d43d975be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:04:47.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.262+0000 7f377e59c640 1 --2- 172.21.15.46:0/25489661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d43d5ad390 0x55d43d976120 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f376800bc70 tx=0x7f37680107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12115d881be1f57f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:47.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.262+0000 7f37757fa640 1 -- 172.21.15.46:0/25489661 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3768005220 con 0x55d43d5ad390 2024-09-21T04:04:47.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.262+0000 7f37757fa640 1 -- 172.21.15.46:0/25489661 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f376800be20 con 0x55d43d5ad390 2024-09-21T04:04:47.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.262+0000 7f37757fa640 1 -- 172.21.15.46:0/25489661 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3768011680 con 0x55d43d5ad390 2024-09-21T04:04:47.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.262+0000 7f3777fff640 1 --2- 172.21.15.46:0/222091454 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f376c0b6680 0x7f376c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:47.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.262+0000 7f377f59e640 1 --2- 172.21.15.46:0/222091454 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f376c0b6680 0x7f376c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:47.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.262+0000 7f3777fff640 1 -- 172.21.15.46:0/222091454 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7f3770108940 con 0x7f3780102a60 2024-09-21T04:04:47.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.263+0000 7f378b66c740 1 -- 172.21.15.46:0/25489661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d43d5ad390 msgr2=0x55d43d976120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:47.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.263+0000 7f377f59e640 1 --2- 172.21.15.46:0/222091454 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f376c0b6680 0x7f376c0b8b90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3778005fd0 tx=0x7f3778005f60 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:47.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.263+0000 7f378b66c740 1 --2- 172.21.15.46:0/25489661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d43d5ad390 0x55d43d976120 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f376800bc70 tx=0x7f37680107a0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.263+0000 7f378b66c740 1 -- 172.21.15.46:0/25489661 shutdown_connections 2024-09-21T04:04:47.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.263+0000 7f378b66c740 1 --2- 172.21.15.46:0/25489661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d43d5ad390 0x55d43d976120 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.263+0000 7f378b66c740 1 --2- 172.21.15.46:0/25489661 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d43d5a51b0 0x55d43d975be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.263+0000 7f378b66c740 1 --2- 172.21.15.46:0/25489661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d43d5ce070 0x55d43d9756a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.263+0000 7f378b66c740 1 -- 172.21.15.46:0/25489661 >> 172.21.15.46:0/25489661 conn(0x55d43d5c2460 msgr2=0x55d43d973590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:47.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.263+0000 7f378b66c740 1 -- 172.21.15.46:0/25489661 shutdown_connections 2024-09-21T04:04:47.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.263+0000 7f378b66c740 1 -- 172.21.15.46:0/25489661 wait complete. 2024-09-21T04:04:47.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.264+0000 7f378b66c740 1 -- start start 2024-09-21T04:04:47.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.264+0000 7f378b66c740 1 Processor -- start 2024-09-21T04:04:47.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.264+0000 7f378b66c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d43d5a51b0 0x55d43d980da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:47.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.264+0000 7f378b66c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d43d5ad390 0x55d43d9812e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:47.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.264+0000 7f378b66c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d43d5ce070 0x55d43d98d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:47.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.264+0000 7f378b66c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55d43d73c700 con 0x55d43d5ce070 2024-09-21T04:04:47.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.264+0000 7f378b66c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55d43d876160 con 0x55d43d5ad390 2024-09-21T04:04:47.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.264+0000 7f378b66c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d43d983e80 con 0x55d43d5a51b0 2024-09-21T04:04:47.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.264+0000 7f378b66c740 10 client.0 _ll_register_callbacks cb 0x55d43d88f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:04:47.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.264+0000 7f377f59e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d43d5ce070 0x55d43d98d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:47.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.264+0000 7f377f59e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d43d5ce070 0x55d43d98d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40658/0 (socket says 172.21.15.46:40658) 2024-09-21T04:04:47.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.264+0000 7f377f59e640 1 -- 172.21.15.46:0/4201538781 learned_addr learned my addr 172.21.15.46:0/4201538781 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:47.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.264+0000 7f377e59c640 1 --2- 172.21.15.46:0/4201538781 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d43d5ad390 0x55d43d9812e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:47.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.264+0000 7f377ed9d640 1 --2- 172.21.15.46:0/4201538781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d43d5a51b0 0x55d43d980da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:47.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.264+0000 7f377f59e640 1 -- 172.21.15.46:0/4201538781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d43d5a51b0 msgr2=0x55d43d980da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:47.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.264+0000 7f377f59e640 1 --2- 172.21.15.46:0/4201538781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d43d5a51b0 0x55d43d980da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.265+0000 7f377f59e640 1 -- 172.21.15.46:0/4201538781 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d43d5ad390 msgr2=0x55d43d9812e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:47.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.265+0000 7f377f59e640 1 --2- 172.21.15.46:0/4201538781 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d43d5ad390 0x55d43d9812e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.265+0000 7f377f59e640 1 -- 172.21.15.46:0/4201538781 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d43d8a3c90 con 0x55d43d5ce070 2024-09-21T04:04:47.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.265+0000 7f377f59e640 1 --2- 172.21.15.46:0/4201538781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d43d5ce070 0x55d43d98d170 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f3778010e50 tx=0x7f37780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df2b55d3af753d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:47.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.265+0000 7f37667fc640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:04:47.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.265+0000 7f37667fc640 1 -- 172.21.15.46:0/4201538781 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377802a060 con 0x55d43d5ce070 2024-09-21T04:04:47.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.265+0000 7f37667fc640 1 -- 172.21.15.46:0/4201538781 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7f377801b670 con 0x55d43d5ce070 2024-09-21T04:04:47.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.265+0000 7f378b66c740 1 -- 172.21.15.46:0/4201538781 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f376800be20 con 0x55d43d5ce070 2024-09-21T04:04:47.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.265+0000 7f37667fc640 1 -- 172.21.15.46:0/4201538781 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f377801de10 con 0x55d43d5ce070 2024-09-21T04:04:47.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.265+0000 7f378b66c740 10 client.16863 fetch_fsmap learned FSMap version 20 2024-09-21T04:04:47.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.265+0000 7f378b66c740 1 -- 172.21.15.46:0/4201538781 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55d43d98fbc0 con 0x55d43d5ce070 2024-09-21T04:04:47.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.265+0000 7f37667fc640 1 -- 172.21.15.46:0/4201538781 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f376800be20 con 0x55d43d5ce070 2024-09-21T04:04:47.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.266+0000 7f37667fc640 1 -- 172.21.15.46:0/4201538781 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f377802d020 con 0x55d43d5ce070 2024-09-21T04:04:47.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.266+0000 7f378b66c740 10 client.16863 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:04:47.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.266+0000 7f378b66c740 10 client.16863 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:04:47.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.266+0000 7f378b66c740 20 client.16863 populate_metadata read hostname 'smithi046' 2024-09-21T04:04:47.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.266+0000 7f378b66c740 1 --2- 172.21.15.46:0/4201538781 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55d43d58c9f0 0x55d43d993130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:47.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.266+0000 7f378b66c740 4 client.16863 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:04:47.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.266+0000 7f378b66c740 1 -- 172.21.15.46:0/4201538781 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d43d8eddf0 con 0x55d43d58c9f0 2024-09-21T04:04:47.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.266+0000 7f377ed9d640 1 --2- 172.21.15.46:0/4201538781 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55d43d58c9f0 0x55d43d993130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:47.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.266+0000 7f377ed9d640 1 --2- 172.21.15.46:0/4201538781 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55d43d58c9f0 0x55d43d993130 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8d619e9fd29066d server_cookie=4e2e90a4ed7b957d in_seq=0 out_seq=0 2024-09-21T04:04:47.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.266+0000 7f37667fc640 10 client.16863 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:47.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.267+0000 7f37667fc640 1 -- 172.21.15.46:0/4201538781 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d43d8eddf0 con 0x55d43d58c9f0 2024-09-21T04:04:47.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.267+0000 7f37667fc640 10 client.16863 handle_command_reply: tid=0 2024-09-21T04:04:47.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.267+0000 7f378b66c740 1 client.16863 shutdown 2024-09-21T04:04:47.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.267+0000 7f378b66c740 1 -- 172.21.15.46:0/4201538781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d43d5ce070 msgr2=0x55d43d98d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:47.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.267+0000 7f378b66c740 1 --2- 172.21.15.46:0/4201538781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d43d5ce070 0x55d43d98d170 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f3778010e50 tx=0x7f37780046c0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.267+0000 7f378b66c740 1 -- 172.21.15.46:0/4201538781 shutdown_connections 2024-09-21T04:04:47.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.267+0000 7f378b66c740 1 --2- 172.21.15.46:0/4201538781 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55d43d58c9f0 0x55d43d993130 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.267+0000 7f378b66c740 1 --2- 172.21.15.46:0/4201538781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d43d5ce070 0x55d43d98d170 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.267+0000 7f378b66c740 1 --2- 172.21.15.46:0/4201538781 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d43d5ad390 0x55d43d9812e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.267+0000 7f378b66c740 1 --2- 172.21.15.46:0/4201538781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d43d5a51b0 0x55d43d980da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.267+0000 7f378b66c740 1 -- 172.21.15.46:0/4201538781 >> 172.21.15.46:0/4201538781 conn(0x55d43d5c2460 msgr2=0x55d43d978830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:47.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.267+0000 7f37667fc640 0 client.16863 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:47.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.268+0000 7f378b66c740 1 -- 172.21.15.46:0/4201538781 shutdown_connections 2024-09-21T04:04:47.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.268+0000 7f378b66c740 1 -- 172.21.15.46:0/4201538781 wait complete. 2024-09-21T04:04:47.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.268+0000 7f378b66c740 20 client.16863 trim_cache size 0 max 16384 2024-09-21T04:04:47.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.281+0000 7f378b66c740 1 Processor -- start 2024-09-21T04:04:47.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.281+0000 7f378b66c740 1 -- start start 2024-09-21T04:04:47.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.281+0000 7f378b66c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d43d5a51b0 0x55d43d981260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:47.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.281+0000 7f378b66c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d43d5ad390 0x55d43d98d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:47.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.281+0000 7f378b66c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d43d5ce070 0x55d43d98d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:47.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.281+0000 7f378b66c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f37801af740 con 0x55d43d5ad390 2024-09-21T04:04:47.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.281+0000 7f378b66c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f37801b1fa0 con 0x55d43d5ce070 2024-09-21T04:04:47.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.281+0000 7f378b66c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f37801afd90 con 0x55d43d5a51b0 2024-09-21T04:04:47.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.281+0000 7f377e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d43d5ad390 0x55d43d98d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:47.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.281+0000 7f377e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d43d5ad390 0x55d43d98d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40660/0 (socket says 172.21.15.46:40660) 2024-09-21T04:04:47.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.281+0000 7f377e59c640 1 -- 172.21.15.46:0/521295215 learned_addr learned my addr 172.21.15.46:0/521295215 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:47.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.282+0000 7f377e59c640 1 -- 172.21.15.46:0/521295215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d43d5a51b0 msgr2=0x55d43d981260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:47.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.282+0000 7f377ed9d640 1 --2- 172.21.15.46:0/521295215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d43d5a51b0 0x55d43d981260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:47.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.282+0000 7f377e59c640 1 --2- 172.21.15.46:0/521295215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d43d5a51b0 0x55d43d981260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.282+0000 7f377e59c640 1 -- 172.21.15.46:0/521295215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d43d5ce070 msgr2=0x55d43d98d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:47.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.282+0000 7f377f59e640 1 --2- 172.21.15.46:0/521295215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d43d5ce070 0x55d43d98d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:47.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.282+0000 7f377e59c640 1 --2- 172.21.15.46:0/521295215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d43d5ce070 0x55d43d98d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.282+0000 7f377e59c640 1 -- 172.21.15.46:0/521295215 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d43d97f2a0 con 0x55d43d5ad390 2024-09-21T04:04:47.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.282+0000 7f377e59c640 1 --2- 172.21.15.46:0/521295215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d43d5ad390 0x55d43d98d070 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f376800bc70 tx=0x7f3768005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5f13cba69d279d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:47.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.282+0000 7f3774ff9640 1 -- 172.21.15.46:0/521295215 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376802a070 con 0x55d43d5ad390 2024-09-21T04:04:47.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.282+0000 7f3774ff9640 1 -- 172.21.15.46:0/521295215 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37680052b0 con 0x55d43d5ad390 2024-09-21T04:04:47.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.282+0000 7f3774ff9640 1 -- 172.21.15.46:0/521295215 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37680116a0 con 0x55d43d5ad390 2024-09-21T04:04:47.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.283+0000 7f378b66c740 1 -- 172.21.15.46:0/521295215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d43d5ad390 msgr2=0x55d43d98d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:47.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.283+0000 7f378b66c740 1 --2- 172.21.15.46:0/521295215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d43d5ad390 0x55d43d98d070 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f376800bc70 tx=0x7f3768005040 comp rx=0 tx=0).stop 2024-09-21T04:04:47.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.283+0000 7f378b66c740 1 -- 172.21.15.46:0/521295215 shutdown_connections 2024-09-21T04:04:47.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.283+0000 7f378b66c740 1 --2- 172.21.15.46:0/521295215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d43d5ce070 0x55d43d98d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.283+0000 7f378b66c740 1 --2- 172.21.15.46:0/521295215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d43d5ad390 0x55d43d98d070 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.283+0000 7f378b66c740 1 --2- 172.21.15.46:0/521295215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d43d5a51b0 0x55d43d981260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.283+0000 7f378b66c740 1 -- 172.21.15.46:0/521295215 >> 172.21.15.46:0/521295215 conn(0x55d43d5c2460 msgr2=0x55d43d980b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:47.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.283+0000 7f378b66c740 1 -- 172.21.15.46:0/521295215 shutdown_connections 2024-09-21T04:04:47.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.283+0000 7f378b66c740 1 -- 172.21.15.46:0/521295215 wait complete. 2024-09-21T04:04:47.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.283+0000 7f378b66c740 1 -- start start 2024-09-21T04:04:47.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.284+0000 7f378b66c740 1 Processor -- start 2024-09-21T04:04:47.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.284+0000 7f378b66c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d43d5a51b0 0x55d43d985190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:47.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.284+0000 7f378b66c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d43d5ad390 0x55d43d9856d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:47.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.284+0000 7f378b66c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d43d5ce070 0x55d43d985c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:47.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.284+0000 7f378b66c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f37801b0460 con 0x55d43d5ce070 2024-09-21T04:04:47.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.284+0000 7f378b66c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f37801b18d0 con 0x55d43d5a51b0 2024-09-21T04:04:47.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.284+0000 7f378b66c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f37801b0b30 con 0x55d43d5ad390 2024-09-21T04:04:47.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.284+0000 7f378b66c740 10 client.0 _ll_register_callbacks cb 0x7f377800a7c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:04:47.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.284+0000 7f377f59e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d43d5ce070 0x55d43d985c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:47.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.284+0000 7f377ed9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d43d5a51b0 0x55d43d985190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:47.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.284+0000 7f377f59e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d43d5ce070 0x55d43d985c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40670/0 (socket says 172.21.15.46:40670) 2024-09-21T04:04:47.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.284+0000 7f377f59e640 1 -- 172.21.15.46:0/2813911411 learned_addr learned my addr 172.21.15.46:0/2813911411 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:47.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.284+0000 7f377e59c640 1 --2- 172.21.15.46:0/2813911411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d43d5ad390 0x55d43d9856d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:47.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.284+0000 7f377f59e640 1 -- 172.21.15.46:0/2813911411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d43d5ad390 msgr2=0x55d43d9856d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:47.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.284+0000 7f377f59e640 1 --2- 172.21.15.46:0/2813911411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d43d5ad390 0x55d43d9856d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.284+0000 7f377f59e640 1 -- 172.21.15.46:0/2813911411 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d43d5a51b0 msgr2=0x55d43d985190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:47.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.284+0000 7f377f59e640 1 --2- 172.21.15.46:0/2813911411 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d43d5a51b0 0x55d43d985190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.284+0000 7f377f59e640 1 -- 172.21.15.46:0/2813911411 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d43d9fcbe0 con 0x55d43d5ce070 2024-09-21T04:04:47.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.284+0000 7f377ed9d640 1 --2- 172.21.15.46:0/2813911411 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d43d5a51b0 0x55d43d985190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:04:47.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.285+0000 7f377f59e640 1 --2- 172.21.15.46:0/2813911411 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d43d5ce070 0x55d43d985c10 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f3778017040 tx=0x7f377801dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14e26e97e84232e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:47.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.285+0000 7f37667fc640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:04:47.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.285+0000 7f37667fc640 1 -- 172.21.15.46:0/2813911411 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3778005450 con 0x55d43d5ce070 2024-09-21T04:04:47.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.285+0000 7f37667fc640 1 -- 172.21.15.46:0/2813911411 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7f3778004730 con 0x55d43d5ce070 2024-09-21T04:04:47.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.285+0000 7f378b66c740 1 -- 172.21.15.46:0/2813911411 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37680052b0 con 0x55d43d5ce070 2024-09-21T04:04:47.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.285+0000 7f37667fc640 1 -- 172.21.15.46:0/2813911411 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f377802a020 con 0x55d43d5ce070 2024-09-21T04:04:47.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.285+0000 7f378b66c740 10 client.16869 fetch_fsmap learned FSMap version 20 2024-09-21T04:04:47.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.285+0000 7f378b66c740 1 -- 172.21.15.46:0/2813911411 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55d43d9fde40 con 0x55d43d5ce070 2024-09-21T04:04:47.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.285+0000 7f37667fc640 1 -- 172.21.15.46:0/2813911411 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37680052b0 con 0x55d43d5ce070 2024-09-21T04:04:47.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.286+0000 7f37667fc640 1 -- 172.21.15.46:0/2813911411 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f3778037070 con 0x55d43d5ce070 2024-09-21T04:04:47.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.286+0000 7f378b66c740 10 client.16869 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:04:47.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.286+0000 7f378b66c740 10 client.16869 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:04:47.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.286+0000 7f378b66c740 20 client.16869 populate_metadata read hostname 'smithi046' 2024-09-21T04:04:47.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.286+0000 7f378b66c740 1 --2- 172.21.15.46:0/2813911411 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55d43d561da0 0x55d43da00550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:47.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.286+0000 7f378b66c740 4 client.16869 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T04:04:47.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.286+0000 7f378b66c740 1 -- 172.21.15.46:0/2813911411 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d43d8e98a0 con 0x55d43d561da0 2024-09-21T04:04:47.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.286+0000 7f377ed9d640 1 --2- 172.21.15.46:0/2813911411 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55d43d561da0 0x55d43da00550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:47.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.286+0000 7f377ed9d640 1 --2- 172.21.15.46:0/2813911411 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55d43d561da0 0x55d43da00550 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4eb7af06bfaa42b8 server_cookie=111cee31c040c3a9 in_seq=0 out_seq=0 2024-09-21T04:04:47.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.286+0000 7f37667fc640 10 client.16869 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:47.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.286+0000 7f37667fc640 1 -- 172.21.15.46:0/2813911411 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d43d8e98a0 con 0x55d43d561da0 2024-09-21T04:04:47.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.286+0000 7f37667fc640 10 client.16869 handle_command_reply: tid=0 2024-09-21T04:04:47.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.286+0000 7f378b66c740 1 client.16869 shutdown 2024-09-21T04:04:47.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.287+0000 7f378b66c740 1 -- 172.21.15.46:0/2813911411 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d43d5ce070 msgr2=0x55d43d985c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:47.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.287+0000 7f378b66c740 1 --2- 172.21.15.46:0/2813911411 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d43d5ce070 0x55d43d985c10 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f3778017040 tx=0x7f377801dda0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.287+0000 7f378b66c740 1 -- 172.21.15.46:0/2813911411 shutdown_connections 2024-09-21T04:04:47.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.287+0000 7f378b66c740 1 --2- 172.21.15.46:0/2813911411 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55d43d561da0 0x55d43da00550 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.287+0000 7f378b66c740 1 --2- 172.21.15.46:0/2813911411 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d43d5ce070 0x55d43d985c10 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.287+0000 7f378b66c740 1 --2- 172.21.15.46:0/2813911411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d43d5ad390 0x55d43d9856d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.287+0000 7f378b66c740 1 --2- 172.21.15.46:0/2813911411 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d43d5a51b0 0x55d43d985190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.287+0000 7f378b66c740 1 -- 172.21.15.46:0/2813911411 >> 172.21.15.46:0/2813911411 conn(0x55d43d5c2460 msgr2=0x55d43d9765a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:47.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.287+0000 7f37667fc640 0 client.16869 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:47.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.287+0000 7f378b66c740 1 -- 172.21.15.46:0/2813911411 shutdown_connections 2024-09-21T04:04:47.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.287+0000 7f378b66c740 1 -- 172.21.15.46:0/2813911411 wait complete. 2024-09-21T04:04:47.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.287+0000 7f378b66c740 20 client.16869 trim_cache size 0 max 16384 2024-09-21T04:04:47.294 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-21T04:04:47.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.287+0000 7f37850f8640 1 -- 172.21.15.46:0/222091454 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f376c0b6680 msgr2=0x7f376c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:47.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.287+0000 7f37850f8640 1 --2- 172.21.15.46:0/222091454 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f376c0b6680 0x7f376c0b8b90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3778005fd0 tx=0x7f3778005f60 comp rx=0 tx=0).stop 2024-09-21T04:04:47.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.287+0000 7f37850f8640 1 -- 172.21.15.46:0/222091454 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3780102a60 msgr2=0x7f378019c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:47.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.287+0000 7f37850f8640 1 --2- 172.21.15.46:0/222091454 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3780102a60 0x7f378019c6b0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f3770006010 tx=0x7f37700319f0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.288+0000 7f37850f8640 1 -- 172.21.15.46:0/222091454 shutdown_connections 2024-09-21T04:04:47.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.288+0000 7f37850f8640 1 --2- 172.21.15.46:0/222091454 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f376c0b6680 0x7f376c0b8b90 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.288+0000 7f37850f8640 1 --2- 172.21.15.46:0/222091454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3780108cf0 0x7f37801a1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.288+0000 7f37850f8640 1 --2- 172.21.15.46:0/222091454 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37801083a0 0x7f378019cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.288+0000 7f37850f8640 1 --2- 172.21.15.46:0/222091454 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3780102a60 0x7f378019c6b0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:47.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.288+0000 7f37850f8640 1 -- 172.21.15.46:0/222091454 >> 172.21.15.46:0/222091454 conn(0x7f3780079730 msgr2=0x7f378010e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:47.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.288+0000 7f37850f8640 1 -- 172.21.15.46:0/222091454 shutdown_connections 2024-09-21T04:04:47.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:47.288+0000 7f37850f8640 1 -- 172.21.15.46:0/222091454 wait complete. 2024-09-21T04:04:47.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:47 smithi046 ceph-mon[30954]: pgmap v618: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:04:47.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:47 smithi162 ceph-mon[35071]: pgmap v618: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:04:47.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:47 smithi105 ceph-mon[34773]: pgmap v618: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:04:48.983 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T04:04:48.984 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T04:04:49.256 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:04:49.620 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:49 smithi105 ceph-mon[34773]: pgmap v619: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:04:49.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:49 smithi162 ceph-mon[35071]: pgmap v619: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:04:49.649 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:49 smithi046 ceph-mon[30954]: pgmap v619: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:04:49.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.742+0000 7f4632c6e640 1 -- 172.21.15.46:0/2300092952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f462c108d20 msgr2=0x7f462c10f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:49.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.742+0000 7f4632c6e640 1 --2- 172.21.15.46:0/2300092952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f462c108d20 0x7f462c10f550 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f4624009ca0 tx=0x7f462402a8c0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.742+0000 7f4632c6e640 1 -- 172.21.15.46:0/2300092952 shutdown_connections 2024-09-21T04:04:49.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.742+0000 7f4632c6e640 1 --2- 172.21.15.46:0/2300092952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f462c108d20 0x7f462c10f550 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.742+0000 7f4632c6e640 1 --2- 172.21.15.46:0/2300092952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f462c1083d0 0x7f462c1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.742+0000 7f4632c6e640 1 --2- 172.21.15.46:0/2300092952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f462c102a90 0x7f462c102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.742+0000 7f4632c6e640 1 -- 172.21.15.46:0/2300092952 >> 172.21.15.46:0/2300092952 conn(0x7f462c079750 msgr2=0x7f462c079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:49.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.742+0000 7f4632c6e640 1 -- 172.21.15.46:0/2300092952 shutdown_connections 2024-09-21T04:04:49.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.742+0000 7f4632c6e640 1 -- 172.21.15.46:0/2300092952 wait complete. 2024-09-21T04:04:49.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.743+0000 7f4632c6e640 1 Processor -- start 2024-09-21T04:04:49.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.743+0000 7f4632c6e640 1 -- start start 2024-09-21T04:04:49.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.743+0000 7f4632c6e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f462c102a90 0x7f462c0ff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:49.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.743+0000 7f4632c6e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f462c1083d0 0x7f462c0ffb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:49.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.743+0000 7f4632c6e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f462c108d20 0x7f462c100070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:49.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.743+0000 7f4632c6e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f462c112990 con 0x7f462c108d20 2024-09-21T04:04:49.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.743+0000 7f4632c6e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f462c112810 con 0x7f462c1083d0 2024-09-21T04:04:49.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.743+0000 7f4632c6e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f462c112b10 con 0x7f462c102a90 2024-09-21T04:04:49.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.744+0000 7f463120b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f462c108d20 0x7f462c100070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:49.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.744+0000 7f463120b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f462c108d20 0x7f462c100070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40690/0 (socket says 172.21.15.46:40690) 2024-09-21T04:04:49.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.744+0000 7f463120b640 1 -- 172.21.15.46:0/3260807619 learned_addr learned my addr 172.21.15.46:0/3260807619 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:49.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.744+0000 7f4630a0a640 1 --2- 172.21.15.46:0/3260807619 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f462c102a90 0x7f462c0ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:49.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.744+0000 7f4623fff640 1 --2- 172.21.15.46:0/3260807619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f462c1083d0 0x7f462c0ffb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:49.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.744+0000 7f463120b640 1 -- 172.21.15.46:0/3260807619 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f462c102a90 msgr2=0x7f462c0ff5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:49.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.744+0000 7f463120b640 1 --2- 172.21.15.46:0/3260807619 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f462c102a90 0x7f462c0ff5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.744+0000 7f463120b640 1 -- 172.21.15.46:0/3260807619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f462c1083d0 msgr2=0x7f462c0ffb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:49.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.744+0000 7f463120b640 1 --2- 172.21.15.46:0/3260807619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f462c1083d0 0x7f462c0ffb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.744+0000 7f463120b640 1 -- 172.21.15.46:0/3260807619 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f462c1a8790 con 0x7f462c108d20 2024-09-21T04:04:49.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.744+0000 7f463120b640 1 --2- 172.21.15.46:0/3260807619 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f462c108d20 0x7f462c100070 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f4624005cc0 tx=0x7f462402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:49.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.744+0000 7f4621ffb640 1 -- 172.21.15.46:0/3260807619 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4624003bf0 con 0x7f462c108d20 2024-09-21T04:04:49.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.744+0000 7f4621ffb640 1 -- 172.21.15.46:0/3260807619 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4624003d90 con 0x7f462c108d20 2024-09-21T04:04:49.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.744+0000 7f4632c6e640 1 -- 172.21.15.46:0/3260807619 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f462c1a8a20 con 0x7f462c108d20 2024-09-21T04:04:49.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.744+0000 7f4621ffb640 1 -- 172.21.15.46:0/3260807619 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f462402fbc0 con 0x7f462c108d20 2024-09-21T04:04:49.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.745+0000 7f4632c6e640 1 -- 172.21.15.46:0/3260807619 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f462c1a8f60 con 0x7f462c108d20 2024-09-21T04:04:49.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.747+0000 7f46391e2740 1 Processor -- start 2024-09-21T04:04:49.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.747+0000 7f4621ffb640 1 -- 172.21.15.46:0/3260807619 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f462402fd60 con 0x7f462c108d20 2024-09-21T04:04:49.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.747+0000 7f46391e2740 1 -- start start 2024-09-21T04:04:49.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.748+0000 7f46391e2740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dfae2a3350 0x55dfae64a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:49.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.748+0000 7f46391e2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dfae27a490 0x55dfae64a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:49.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.748+0000 7f46391e2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dfae282670 0x55dfae64aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:49.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.748+0000 7f46391e2740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55dfae5c0e60 con 0x55dfae2a3350 2024-09-21T04:04:49.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.748+0000 7f46391e2740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55dfae5b0290 con 0x55dfae27a490 2024-09-21T04:04:49.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.748+0000 7f46391e2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55dfae5b40a0 con 0x55dfae282670 2024-09-21T04:04:49.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.748+0000 7f4623fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dfae2a3350 0x55dfae64a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:49.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.748+0000 7f4623fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dfae2a3350 0x55dfae64a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40698/0 (socket says 172.21.15.46:40698) 2024-09-21T04:04:49.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.748+0000 7f4623fff640 1 -- 172.21.15.46:0/475343065 learned_addr learned my addr 172.21.15.46:0/475343065 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:49.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.748+0000 7f4630a0a640 1 --2- 172.21.15.46:0/475343065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dfae27a490 0x55dfae64a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:49.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.748+0000 7f4621ffb640 1 --2- 172.21.15.46:0/3260807619 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f46140b6680 0x7f46140b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:49.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.748+0000 7f4623fff640 1 -- 172.21.15.46:0/475343065 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dfae282670 msgr2=0x55dfae64aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:49.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.748+0000 7f4623fff640 1 --2- 172.21.15.46:0/475343065 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dfae282670 0x55dfae64aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.748+0000 7f4623fff640 1 -- 172.21.15.46:0/475343065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dfae27a490 msgr2=0x55dfae64a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:49.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.748+0000 7f4623fff640 1 --2- 172.21.15.46:0/475343065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dfae27a490 0x55dfae64a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.748+0000 7f4623fff640 1 -- 172.21.15.46:0/475343065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfae30e930 con 0x55dfae2a3350 2024-09-21T04:04:49.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.748+0000 7f4630a0a640 1 --2- 172.21.15.46:0/475343065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dfae27a490 0x55dfae64a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:04:49.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.748+0000 7f463120b640 1 --2- 172.21.15.46:0/3260807619 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f46140b6680 0x7f46140b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:49.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.749+0000 7f4621ffb640 1 -- 172.21.15.46:0/3260807619 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7f4624108bf0 con 0x7f462c108d20 2024-09-21T04:04:49.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.749+0000 7f4623fff640 1 --2- 172.21.15.46:0/475343065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dfae2a3350 0x55dfae64a430 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f461c00cba0 tx=0x7f461c010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef7fbe5e195ae8f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:49.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.749+0000 7f4612ffd640 1 -- 172.21.15.46:0/475343065 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f461c016030 con 0x55dfae2a3350 2024-09-21T04:04:49.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.749+0000 7f4612ffd640 1 -- 172.21.15.46:0/475343065 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f461c012930 con 0x55dfae2a3350 2024-09-21T04:04:49.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.749+0000 7f4612ffd640 1 -- 172.21.15.46:0/475343065 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f461c0117a0 con 0x55dfae2a3350 2024-09-21T04:04:49.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.750+0000 7f46391e2740 1 -- 172.21.15.46:0/475343065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dfae2a3350 msgr2=0x55dfae64a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:49.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.750+0000 7f463120b640 1 --2- 172.21.15.46:0/3260807619 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f46140b6680 0x7f46140b8b90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4624106460 tx=0x7f46240b6040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:49.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.750+0000 7f46391e2740 1 --2- 172.21.15.46:0/475343065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dfae2a3350 0x55dfae64a430 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f461c00cba0 tx=0x7f461c010740 comp rx=0 tx=0).stop 2024-09-21T04:04:49.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.750+0000 7f46391e2740 1 -- 172.21.15.46:0/475343065 shutdown_connections 2024-09-21T04:04:49.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.750+0000 7f46391e2740 1 --2- 172.21.15.46:0/475343065 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dfae282670 0x55dfae64aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.750+0000 7f46391e2740 1 --2- 172.21.15.46:0/475343065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dfae27a490 0x55dfae64a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.750+0000 7f46391e2740 1 --2- 172.21.15.46:0/475343065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dfae2a3350 0x55dfae64a430 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.750+0000 7f46391e2740 1 -- 172.21.15.46:0/475343065 >> 172.21.15.46:0/475343065 conn(0x55dfae297740 msgr2=0x55dfae648320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:49.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.750+0000 7f46391e2740 1 -- 172.21.15.46:0/475343065 shutdown_connections 2024-09-21T04:04:49.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.750+0000 7f46391e2740 1 -- 172.21.15.46:0/475343065 wait complete. 2024-09-21T04:04:49.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.750+0000 7f46391e2740 1 -- start start 2024-09-21T04:04:49.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.750+0000 7f46391e2740 1 Processor -- start 2024-09-21T04:04:49.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.751+0000 7f46391e2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dfae27a490 0x55dfae6560d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:49.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.751+0000 7f46391e2740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dfae282670 0x55dfae656690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:49.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.751+0000 7f46391e2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dfae2a3350 0x55dfae661f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:49.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.751+0000 7f46391e2740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55dfae411890 con 0x55dfae282670 2024-09-21T04:04:49.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.751+0000 7f46391e2740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55dfae54ad40 con 0x55dfae27a490 2024-09-21T04:04:49.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.751+0000 7f46391e2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55dfae658c10 con 0x55dfae2a3350 2024-09-21T04:04:49.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.751+0000 7f46391e2740 10 client.0 _ll_register_callbacks cb 0x55dfae5aec80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:04:49.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.751+0000 7f4630a0a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dfae282670 0x55dfae656690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:49.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.751+0000 7f4630a0a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dfae282670 0x55dfae656690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40700/0 (socket says 172.21.15.46:40700) 2024-09-21T04:04:49.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.751+0000 7f4630a0a640 1 -- 172.21.15.46:0/2585624248 learned_addr learned my addr 172.21.15.46:0/2585624248 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:49.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.751+0000 7f4623fff640 1 --2- 172.21.15.46:0/2585624248 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dfae27a490 0x55dfae6560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:49.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.751+0000 7f4623fff640 1 --2- 172.21.15.46:0/2585624248 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dfae2a3350 0x55dfae661f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:49.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.751+0000 7f4630a0a640 1 -- 172.21.15.46:0/2585624248 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dfae2a3350 msgr2=0x55dfae661f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:49.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.751+0000 7f4630a0a640 1 --2- 172.21.15.46:0/2585624248 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dfae2a3350 0x55dfae661f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.751+0000 7f4630a0a640 1 -- 172.21.15.46:0/2585624248 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dfae27a490 msgr2=0x55dfae6560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:49.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.751+0000 7f4630a0a640 1 --2- 172.21.15.46:0/2585624248 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dfae27a490 0x55dfae6560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.751+0000 7f4630a0a640 1 -- 172.21.15.46:0/2585624248 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfae6625a0 con 0x55dfae282670 2024-09-21T04:04:49.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.751+0000 7f4623fff640 1 --2- 172.21.15.46:0/2585624248 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dfae27a490 0x55dfae6560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:04:49.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.752+0000 7f4630a0a640 1 --2- 172.21.15.46:0/2585624248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dfae282670 0x55dfae656690 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f4628005bc0 tx=0x7f462800bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e760f2037de17efc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:49.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.752+0000 7f460bfff640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:04:49.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.752+0000 7f460bfff640 1 -- 172.21.15.46:0/2585624248 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f462801b440 con 0x55dfae282670 2024-09-21T04:04:49.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.752+0000 7f460bfff640 1 -- 172.21.15.46:0/2585624248 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7f462801b5e0 con 0x55dfae282670 2024-09-21T04:04:49.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.752+0000 7f46391e2740 1 -- 172.21.15.46:0/2585624248 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f461c012930 con 0x55dfae282670 2024-09-21T04:04:49.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.752+0000 7f460bfff640 1 -- 172.21.15.46:0/2585624248 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4628005020 con 0x55dfae282670 2024-09-21T04:04:49.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.752+0000 7f46391e2740 10 client.16881 fetch_fsmap learned FSMap version 20 2024-09-21T04:04:49.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.752+0000 7f46391e2740 1 -- 172.21.15.46:0/2585624248 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55dfae664f10 con 0x55dfae282670 2024-09-21T04:04:49.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.752+0000 7f460bfff640 1 -- 172.21.15.46:0/2585624248 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f461c012930 con 0x55dfae282670 2024-09-21T04:04:49.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.752+0000 7f460bfff640 1 -- 172.21.15.46:0/2585624248 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f4628019020 con 0x55dfae282670 2024-09-21T04:04:49.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.752+0000 7f46391e2740 10 client.16881 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:04:49.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.753+0000 7f46391e2740 10 client.16881 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:04:49.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.753+0000 7f46391e2740 20 client.16881 populate_metadata read hostname 'smithi046' 2024-09-21T04:04:49.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.753+0000 7f46391e2740 1 --2- 172.21.15.46:0/2585624248 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55dfae261cd0 0x55dfae668450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:49.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.753+0000 7f46391e2740 4 client.16881 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:04:49.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.753+0000 7f46391e2740 1 -- 172.21.15.46:0/2585624248 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dfae5c2db0 con 0x55dfae261cd0 2024-09-21T04:04:49.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.753+0000 7f4623fff640 1 --2- 172.21.15.46:0/2585624248 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55dfae261cd0 0x55dfae668450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:49.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.753+0000 7f4623fff640 1 --2- 172.21.15.46:0/2585624248 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55dfae261cd0 0x55dfae668450 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f54b3727e4fb374f server_cookie=f49797e5469025de in_seq=0 out_seq=0 2024-09-21T04:04:49.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.753+0000 7f460bfff640 10 client.16881 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:49.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.754+0000 7f460bfff640 1 -- 172.21.15.46:0/2585624248 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dfae5c2db0 con 0x55dfae261cd0 2024-09-21T04:04:49.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.754+0000 7f460bfff640 10 client.16881 handle_command_reply: tid=0 2024-09-21T04:04:49.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.754+0000 7f46391e2740 1 client.16881 shutdown 2024-09-21T04:04:49.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.754+0000 7f46391e2740 1 -- 172.21.15.46:0/2585624248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dfae282670 msgr2=0x55dfae656690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:49.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.754+0000 7f46391e2740 1 --2- 172.21.15.46:0/2585624248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dfae282670 0x55dfae656690 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f4628005bc0 tx=0x7f462800bf00 comp rx=0 tx=0).stop 2024-09-21T04:04:49.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.754+0000 7f46391e2740 1 -- 172.21.15.46:0/2585624248 shutdown_connections 2024-09-21T04:04:49.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.754+0000 7f46391e2740 1 --2- 172.21.15.46:0/2585624248 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55dfae261cd0 0x55dfae668450 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.755+0000 7f460bfff640 0 client.16881 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:49.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.755+0000 7f46391e2740 1 --2- 172.21.15.46:0/2585624248 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dfae2a3350 0x55dfae661f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.755+0000 7f46391e2740 1 --2- 172.21.15.46:0/2585624248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dfae282670 0x55dfae656690 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.755+0000 7f46391e2740 1 --2- 172.21.15.46:0/2585624248 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dfae27a490 0x55dfae6560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.755+0000 7f46391e2740 1 -- 172.21.15.46:0/2585624248 >> 172.21.15.46:0/2585624248 conn(0x55dfae297740 msgr2=0x55dfae64d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:49.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.755+0000 7f46391e2740 1 -- 172.21.15.46:0/2585624248 shutdown_connections 2024-09-21T04:04:49.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.755+0000 7f46391e2740 1 -- 172.21.15.46:0/2585624248 wait complete. 2024-09-21T04:04:49.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.755+0000 7f46391e2740 20 client.16881 trim_cache size 0 max 16384 2024-09-21T04:04:49.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.772+0000 7f46391e2740 1 Processor -- start 2024-09-21T04:04:49.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.772+0000 7f46391e2740 1 -- start start 2024-09-21T04:04:49.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.773+0000 7f46391e2740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dfae261cd0 0x55dfae661e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:49.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.773+0000 7f46391e2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dfae27a490 0x55dfae64d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:49.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.773+0000 7f46391e2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dfae282670 0x55dfae64da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:49.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.773+0000 7f46391e2740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f462c1af7b0 con 0x55dfae261cd0 2024-09-21T04:04:49.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.773+0000 7f46391e2740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f462c1b2010 con 0x55dfae282670 2024-09-21T04:04:49.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.773+0000 7f46391e2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f462c1afe00 con 0x55dfae27a490 2024-09-21T04:04:49.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.773+0000 7f4623fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dfae261cd0 0x55dfae661e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:49.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.773+0000 7f4623fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dfae261cd0 0x55dfae661e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40712/0 (socket says 172.21.15.46:40712) 2024-09-21T04:04:49.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.773+0000 7f4623fff640 1 -- 172.21.15.46:0/1446699505 learned_addr learned my addr 172.21.15.46:0/1446699505 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:49.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.773+0000 7f4623fff640 1 -- 172.21.15.46:0/1446699505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dfae27a490 msgr2=0x55dfae64d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:49.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.773+0000 7f4623fff640 1 --2- 172.21.15.46:0/1446699505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dfae27a490 0x55dfae64d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.773+0000 7f4623fff640 1 -- 172.21.15.46:0/1446699505 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dfae282670 msgr2=0x55dfae64da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:49.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.773+0000 7f4623fff640 1 --2- 172.21.15.46:0/1446699505 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dfae282670 0x55dfae64da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.773+0000 7f4623fff640 1 -- 172.21.15.46:0/1446699505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfae64c720 con 0x55dfae261cd0 2024-09-21T04:04:49.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.773+0000 7f4623fff640 1 --2- 172.21.15.46:0/1446699505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dfae261cd0 0x55dfae661e30 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f461c00cfd0 tx=0x7f461c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ca4d6ae01a81fe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:49.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.773+0000 7f46127fc640 1 -- 172.21.15.46:0/1446699505 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f461c02a040 con 0x55dfae261cd0 2024-09-21T04:04:49.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.773+0000 7f46127fc640 1 -- 172.21.15.46:0/1446699505 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f461c0054e0 con 0x55dfae261cd0 2024-09-21T04:04:49.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.773+0000 7f46127fc640 1 -- 172.21.15.46:0/1446699505 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f461c016040 con 0x55dfae261cd0 2024-09-21T04:04:49.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.774+0000 7f46391e2740 1 -- 172.21.15.46:0/1446699505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dfae261cd0 msgr2=0x55dfae661e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:49.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.774+0000 7f46391e2740 1 --2- 172.21.15.46:0/1446699505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dfae261cd0 0x55dfae661e30 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f461c00cfd0 tx=0x7f461c0058a0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.774+0000 7f46391e2740 1 -- 172.21.15.46:0/1446699505 shutdown_connections 2024-09-21T04:04:49.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.774+0000 7f46391e2740 1 --2- 172.21.15.46:0/1446699505 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dfae282670 0x55dfae64da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.774+0000 7f46391e2740 1 --2- 172.21.15.46:0/1446699505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dfae27a490 0x55dfae64d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.774+0000 7f46391e2740 1 --2- 172.21.15.46:0/1446699505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dfae261cd0 0x55dfae661e30 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.774+0000 7f46391e2740 1 -- 172.21.15.46:0/1446699505 >> 172.21.15.46:0/1446699505 conn(0x55dfae297740 msgr2=0x55dfae654750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:49.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.774+0000 7f46391e2740 1 -- 172.21.15.46:0/1446699505 shutdown_connections 2024-09-21T04:04:49.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.774+0000 7f46391e2740 1 -- 172.21.15.46:0/1446699505 wait complete. 2024-09-21T04:04:49.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.774+0000 7f46391e2740 1 -- start start 2024-09-21T04:04:49.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.775+0000 7f46391e2740 1 Processor -- start 2024-09-21T04:04:49.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.775+0000 7f46391e2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dfae261cd0 0x55dfae65dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:49.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.775+0000 7f46391e2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dfae27a490 0x55dfae65e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:49.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.775+0000 7f46391e2740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dfae282670 0x55dfae658e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:49.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.775+0000 7f46391e2740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f462c1b04d0 con 0x55dfae282670 2024-09-21T04:04:49.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.775+0000 7f46391e2740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f462c1b1940 con 0x55dfae261cd0 2024-09-21T04:04:49.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.775+0000 7f46391e2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f462c1b0ba0 con 0x55dfae27a490 2024-09-21T04:04:49.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.775+0000 7f46391e2740 10 client.0 _ll_register_callbacks cb 0x7f4628005870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:04:49.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.775+0000 7f4623fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dfae282670 0x55dfae658e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:49.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.775+0000 7f4623fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dfae282670 0x55dfae658e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40724/0 (socket says 172.21.15.46:40724) 2024-09-21T04:04:49.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.775+0000 7f4623fff640 1 -- 172.21.15.46:0/1243110034 learned_addr learned my addr 172.21.15.46:0/1243110034 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:49.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.775+0000 7f4630a0a640 1 --2- 172.21.15.46:0/1243110034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dfae27a490 0x55dfae65e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:49.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.775+0000 7f4623fff640 1 --2- 172.21.15.46:0/1243110034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dfae261cd0 0x55dfae65dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:49.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.776+0000 7f4623fff640 1 -- 172.21.15.46:0/1243110034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dfae27a490 msgr2=0x55dfae65e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:49.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.776+0000 7f4623fff640 1 --2- 172.21.15.46:0/1243110034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dfae27a490 0x55dfae65e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.776+0000 7f4623fff640 1 -- 172.21.15.46:0/1243110034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dfae261cd0 msgr2=0x55dfae65dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:49.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.776+0000 7f4623fff640 1 --2- 172.21.15.46:0/1243110034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dfae261cd0 0x55dfae65dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.776+0000 7f4623fff640 1 -- 172.21.15.46:0/1243110034 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfae659390 con 0x55dfae282670 2024-09-21T04:04:49.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.776+0000 7f4623fff640 1 --2- 172.21.15.46:0/1243110034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dfae282670 0x55dfae658e50 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f461c005fd0 tx=0x7f461c013930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa4799355c1b65d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:49.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.776+0000 7f460bfff640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:04:49.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.776+0000 7f460bfff640 1 -- 172.21.15.46:0/1243110034 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f461c02a070 con 0x55dfae282670 2024-09-21T04:04:49.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.776+0000 7f460bfff640 1 -- 172.21.15.46:0/1243110034 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7f461c004320 con 0x55dfae282670 2024-09-21T04:04:49.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.776+0000 7f46391e2740 1 -- 172.21.15.46:0/1243110034 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f461c0054e0 con 0x55dfae282670 2024-09-21T04:04:49.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.776+0000 7f460bfff640 1 -- 172.21.15.46:0/1243110034 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f461c016040 con 0x55dfae282670 2024-09-21T04:04:49.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.776+0000 7f46391e2740 10 client.16887 fetch_fsmap learned FSMap version 20 2024-09-21T04:04:49.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.776+0000 7f46391e2740 1 -- 172.21.15.46:0/1243110034 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55dfae6d3510 con 0x55dfae282670 2024-09-21T04:04:49.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.776+0000 7f460bfff640 1 -- 172.21.15.46:0/1243110034 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f461c0054e0 con 0x55dfae282670 2024-09-21T04:04:49.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.777+0000 7f460bfff640 1 -- 172.21.15.46:0/1243110034 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f461c003cf0 con 0x55dfae282670 2024-09-21T04:04:49.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.777+0000 7f46391e2740 10 client.16887 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:04:49.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.777+0000 7f46391e2740 10 client.16887 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:04:49.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.777+0000 7f46391e2740 20 client.16887 populate_metadata read hostname 'smithi046' 2024-09-21T04:04:49.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.777+0000 7f46391e2740 1 --2- 172.21.15.46:0/1243110034 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55dfae2a3350 0x55dfae6d5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:49.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.777+0000 7f46391e2740 4 client.16887 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T04:04:49.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.777+0000 7f46391e2740 1 -- 172.21.15.46:0/1243110034 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55dfae5be860 con 0x55dfae2a3350 2024-09-21T04:04:49.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.777+0000 7f4630a0a640 1 --2- 172.21.15.46:0/1243110034 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55dfae2a3350 0x55dfae6d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:49.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.777+0000 7f460bfff640 10 client.16887 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:49.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.777+0000 7f4630a0a640 1 --2- 172.21.15.46:0/1243110034 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55dfae2a3350 0x55dfae6d5b00 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=527508c13950e79d server_cookie=e05f57232529d167 in_seq=0 out_seq=0 2024-09-21T04:04:49.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.779+0000 7f460bfff640 1 -- 172.21.15.46:0/1243110034 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55dfae5be860 con 0x55dfae2a3350 2024-09-21T04:04:49.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.779+0000 7f460bfff640 10 client.16887 handle_command_reply: tid=0 2024-09-21T04:04:49.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.779+0000 7f46391e2740 1 client.16887 shutdown 2024-09-21T04:04:49.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.780+0000 7f46391e2740 1 -- 172.21.15.46:0/1243110034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dfae282670 msgr2=0x55dfae658e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:49.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.780+0000 7f46391e2740 1 --2- 172.21.15.46:0/1243110034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dfae282670 0x55dfae658e50 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f461c005fd0 tx=0x7f461c013930 comp rx=0 tx=0).stop 2024-09-21T04:04:49.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.780+0000 7f46391e2740 1 -- 172.21.15.46:0/1243110034 shutdown_connections 2024-09-21T04:04:49.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.780+0000 7f46391e2740 1 --2- 172.21.15.46:0/1243110034 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55dfae2a3350 0x55dfae6d5b00 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.780+0000 7f46391e2740 1 --2- 172.21.15.46:0/1243110034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dfae282670 0x55dfae658e50 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.780+0000 7f46391e2740 1 --2- 172.21.15.46:0/1243110034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dfae27a490 0x55dfae65e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.780+0000 7f460bfff640 0 client.16887 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:49.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.780+0000 7f46391e2740 1 --2- 172.21.15.46:0/1243110034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dfae261cd0 0x55dfae65dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.780+0000 7f46391e2740 1 -- 172.21.15.46:0/1243110034 >> 172.21.15.46:0/1243110034 conn(0x55dfae297740 msgr2=0x55dfae64d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:49.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.780+0000 7f46391e2740 1 -- 172.21.15.46:0/1243110034 shutdown_connections 2024-09-21T04:04:49.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.780+0000 7f46391e2740 1 -- 172.21.15.46:0/1243110034 wait complete. 2024-09-21T04:04:49.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.780+0000 7f46391e2740 20 client.16887 trim_cache size 0 max 16384 2024-09-21T04:04:49.892 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T04:04:49.892 INFO:teuthology.orchestra.run.smithi046.stdout: "return_code": 0, 2024-09-21T04:04:49.892 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_tag": "74b0aad6-c059-48e7-8d5d-3eb1ee2fb7c5", 2024-09-21T04:04:49.892 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": "asynchronous" 2024-09-21T04:04:49.892 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T04:04:49.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.781+0000 7f4632c6e640 1 -- 172.21.15.46:0/3260807619 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f46140b6680 msgr2=0x7f46140b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:49.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.781+0000 7f4632c6e640 1 --2- 172.21.15.46:0/3260807619 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f46140b6680 0x7f46140b8b90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4624106460 tx=0x7f46240b6040 comp rx=0 tx=0).stop 2024-09-21T04:04:49.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.781+0000 7f4632c6e640 1 -- 172.21.15.46:0/3260807619 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f462c108d20 msgr2=0x7f462c100070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:49.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.781+0000 7f4632c6e640 1 --2- 172.21.15.46:0/3260807619 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f462c108d20 0x7f462c100070 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f4624005cc0 tx=0x7f462402f380 comp rx=0 tx=0).stop 2024-09-21T04:04:49.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.781+0000 7f4632c6e640 1 -- 172.21.15.46:0/3260807619 shutdown_connections 2024-09-21T04:04:49.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.781+0000 7f4632c6e640 1 --2- 172.21.15.46:0/3260807619 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f462c108d20 0x7f462c100070 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.781+0000 7f4632c6e640 1 --2- 172.21.15.46:0/3260807619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f462c1083d0 0x7f462c0ffb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.781+0000 7f4632c6e640 1 --2- 172.21.15.46:0/3260807619 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f46140b6680 0x7f46140b8b90 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.781+0000 7f4632c6e640 1 --2- 172.21.15.46:0/3260807619 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f462c102a90 0x7f462c0ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.781+0000 7f4632c6e640 1 -- 172.21.15.46:0/3260807619 >> 172.21.15.46:0/3260807619 conn(0x7f462c079750 msgr2=0x7f462c06bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:49.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.781+0000 7f4632c6e640 1 -- 172.21.15.46:0/3260807619 shutdown_connections 2024-09-21T04:04:49.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:49.781+0000 7f4632c6e640 1 -- 172.21.15.46:0/3260807619 wait complete. 2024-09-21T04:04:50.635 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T04:04:50.896 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:04:51.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.395+0000 7f3e9660d640 1 -- 172.21.15.46:0/1614326599 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e901083d0 msgr2=0x7f3e901087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:51.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.395+0000 7f3e9660d640 1 --2- 172.21.15.46:0/1614326599 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e901083d0 0x7f3e901087e0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f3e84009900 tx=0x7f3e8402a410 comp rx=0 tx=0).stop 2024-09-21T04:04:51.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.395+0000 7f3e9660d640 1 -- 172.21.15.46:0/1614326599 shutdown_connections 2024-09-21T04:04:51.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.395+0000 7f3e9660d640 1 --2- 172.21.15.46:0/1614326599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e90108d20 0x7f3e9010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:51.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.395+0000 7f3e9660d640 1 --2- 172.21.15.46:0/1614326599 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e901083d0 0x7f3e901087e0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:51.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.395+0000 7f3e9660d640 1 --2- 172.21.15.46:0/1614326599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e90102ae0 0x7f3e90102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:51.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.395+0000 7f3e9660d640 1 -- 172.21.15.46:0/1614326599 >> 172.21.15.46:0/1614326599 conn(0x7f3e90079760 msgr2=0x7f3e90079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:51.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.395+0000 7f3e9660d640 1 -- 172.21.15.46:0/1614326599 shutdown_connections 2024-09-21T04:04:51.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.395+0000 7f3e9660d640 1 -- 172.21.15.46:0/1614326599 wait complete. 2024-09-21T04:04:51.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.396+0000 7f3e9660d640 1 Processor -- start 2024-09-21T04:04:51.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.396+0000 7f3e9660d640 1 -- start start 2024-09-21T04:04:51.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.396+0000 7f3e9660d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e90102ae0 0x7f3e901982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:51.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.396+0000 7f3e9660d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e901083d0 0x7f3e90198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:51.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.396+0000 7f3e9660d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e90108d20 0x7f3e9019db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:51.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.397+0000 7f3e9660d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3e90111880 con 0x7f3e901083d0 2024-09-21T04:04:51.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.397+0000 7f3e9660d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3e90111700 con 0x7f3e90108d20 2024-09-21T04:04:51.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.397+0000 7f3e9660d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3e90111a00 con 0x7f3e90102ae0 2024-09-21T04:04:51.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.397+0000 7f3e8f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e901083d0 0x7f3e90198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:51.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.397+0000 7f3e8f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e901083d0 0x7f3e90198890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40752/0 (socket says 172.21.15.46:40752) 2024-09-21T04:04:51.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.397+0000 7f3e8f7fe640 1 -- 172.21.15.46:0/2086218902 learned_addr learned my addr 172.21.15.46:0/2086218902 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:51.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.397+0000 7f3e8ffff640 1 --2- 172.21.15.46:0/2086218902 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e90102ae0 0x7f3e901982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:51.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.397+0000 7f3e94baa640 1 --2- 172.21.15.46:0/2086218902 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e90108d20 0x7f3e9019db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:51.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.397+0000 7f3e8f7fe640 1 -- 172.21.15.46:0/2086218902 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e90102ae0 msgr2=0x7f3e901982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:51.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.397+0000 7f3e8f7fe640 1 --2- 172.21.15.46:0/2086218902 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e90102ae0 0x7f3e901982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:51.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.397+0000 7f3e8f7fe640 1 -- 172.21.15.46:0/2086218902 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e90108d20 msgr2=0x7f3e9019db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:51.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.397+0000 7f3e8f7fe640 1 --2- 172.21.15.46:0/2086218902 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e90108d20 0x7f3e9019db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:51.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.397+0000 7f3e8f7fe640 1 -- 172.21.15.46:0/2086218902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e9019e1a0 con 0x7f3e901083d0 2024-09-21T04:04:51.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.397+0000 7f3e8f7fe640 1 --2- 172.21.15.46:0/2086218902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e901083d0 0x7f3e90198890 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f3e84032fd0 tx=0x7f3e84004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:51.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.397+0000 7f3e8d7fa640 1 -- 172.21.15.46:0/2086218902 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8403f030 con 0x7f3e901083d0 2024-09-21T04:04:51.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.397+0000 7f3e9660d640 1 -- 172.21.15.46:0/2086218902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e9019e430 con 0x7f3e901083d0 2024-09-21T04:04:51.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.398+0000 7f3e8d7fa640 1 -- 172.21.15.46:0/2086218902 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e84004490 con 0x7f3e901083d0 2024-09-21T04:04:51.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.398+0000 7f3e8d7fa640 1 -- 172.21.15.46:0/2086218902 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e84035070 con 0x7f3e901083d0 2024-09-21T04:04:51.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.398+0000 7f3e9660d640 1 -- 172.21.15.46:0/2086218902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e9019e960 con 0x7f3e901083d0 2024-09-21T04:04:51.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.401+0000 7f3e9cb81740 1 Processor -- start 2024-09-21T04:04:51.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.401+0000 7f3e9cb81740 1 -- start start 2024-09-21T04:04:51.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.401+0000 7f3e9cb81740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55638cfd1070 0x55638d378650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:51.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.401+0000 7f3e9cb81740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55638cfa81b0 0x55638d378b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:51.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.401+0000 7f3e9cb81740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55638cfb0390 0x55638d3790d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:51.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.401+0000 7f3e9cb81740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55638d2eee50 con 0x55638cfd1070 2024-09-21T04:04:51.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.401+0000 7f3e9cb81740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55638d2de280 con 0x55638cfa81b0 2024-09-21T04:04:51.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.401+0000 7f3e9cb81740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55638d2e2090 con 0x55638cfb0390 2024-09-21T04:04:51.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.401+0000 7f3e94baa640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55638cfd1070 0x55638d378650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:51.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.401+0000 7f3e94baa640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55638cfd1070 0x55638d378650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40766/0 (socket says 172.21.15.46:40766) 2024-09-21T04:04:51.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.401+0000 7f3e94baa640 1 -- 172.21.15.46:0/1587185431 learned_addr learned my addr 172.21.15.46:0/1587185431 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:51.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.401+0000 7f3e8d7fa640 1 -- 172.21.15.46:0/2086218902 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f3e84042030 con 0x7f3e901083d0 2024-09-21T04:04:51.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.401+0000 7f3e8ffff640 1 --2- 172.21.15.46:0/1587185431 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55638cfa81b0 0x55638d378b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:51.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.402+0000 7f3e94baa640 1 -- 172.21.15.46:0/1587185431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55638cfb0390 msgr2=0x55638d3790d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T04:04:51.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.402+0000 7f3e94baa640 1 --2- 172.21.15.46:0/1587185431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55638cfb0390 0x55638d3790d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:51.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.402+0000 7f3e94baa640 1 -- 172.21.15.46:0/1587185431 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55638cfa81b0 msgr2=0x55638d378b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:51.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.402+0000 7f3e94baa640 1 --2- 172.21.15.46:0/1587185431 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55638cfa81b0 0x55638d378b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:51.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.402+0000 7f3e94baa640 1 -- 172.21.15.46:0/1587185431 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55638d03c650 con 0x55638cfd1070 2024-09-21T04:04:51.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.402+0000 7f3e8ffff640 1 --2- 172.21.15.46:0/1587185431 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55638cfa81b0 0x55638d378b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:04:51.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.402+0000 7f3e94baa640 1 --2- 172.21.15.46:0/1587185431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55638cfd1070 0x55638d378650 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f3e88007ec0 tx=0x7f3e8800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edf0b240f2ce8ffe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:51.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.402+0000 7f3e767fc640 1 -- 172.21.15.46:0/1587185431 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e88010840 con 0x55638cfd1070 2024-09-21T04:04:51.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.402+0000 7f3e767fc640 1 -- 172.21.15.46:0/1587185431 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e880183f0 con 0x55638cfd1070 2024-09-21T04:04:51.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.402+0000 7f3e767fc640 1 -- 172.21.15.46:0/1587185431 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e88017600 con 0x55638cfd1070 2024-09-21T04:04:51.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.402+0000 7f3e8d7fa640 1 --2- 172.21.15.46:0/2086218902 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f3e780b88c0 0x7f3e780badd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:51.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.402+0000 7f3e8ffff640 1 --2- 172.21.15.46:0/2086218902 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f3e780b88c0 0x7f3e780badd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:51.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.403+0000 7f3e8d7fa640 1 -- 172.21.15.46:0/2086218902 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7f3e84107b60 con 0x7f3e901083d0 2024-09-21T04:04:51.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.403+0000 7f3e9cb81740 1 -- 172.21.15.46:0/1587185431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55638cfd1070 msgr2=0x55638d378650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:51.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.403+0000 7f3e8ffff640 1 --2- 172.21.15.46:0/2086218902 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f3e780b88c0 0x7f3e780badd0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x55638d3772d0 tx=0x7f3e8000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.403+0000 7f3e9cb81740 1 --2- 172.21.15.46:0/1587185431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55638cfd1070 0x55638d378650 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f3e88007ec0 tx=0x7f3e8800f790 comp rx=0 tx=0).stop 2024-09-21T04:04:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.403+0000 7f3e9cb81740 1 -- 172.21.15.46:0/1587185431 shutdown_connections 2024-09-21T04:04:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.403+0000 7f3e9cb81740 1 --2- 172.21.15.46:0/1587185431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55638cfb0390 0x55638d3790d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.403+0000 7f3e9cb81740 1 --2- 172.21.15.46:0/1587185431 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55638cfa81b0 0x55638d378b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.403+0000 7f3e9cb81740 1 --2- 172.21.15.46:0/1587185431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55638cfd1070 0x55638d378650 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.403+0000 7f3e9cb81740 1 -- 172.21.15.46:0/1587185431 >> 172.21.15.46:0/1587185431 conn(0x55638cfc5460 msgr2=0x55638d376540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.403+0000 7f3e9cb81740 1 -- 172.21.15.46:0/1587185431 shutdown_connections 2024-09-21T04:04:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.403+0000 7f3e9cb81740 1 -- 172.21.15.46:0/1587185431 wait complete. 2024-09-21T04:04:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.403+0000 7f3e9cb81740 1 -- start start 2024-09-21T04:04:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.404+0000 7f3e9cb81740 1 Processor -- start 2024-09-21T04:04:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.404+0000 7f3e9cb81740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55638cfa81b0 0x55638d383d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.404+0000 7f3e9cb81740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55638cfb0390 0x55638d3842a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.404+0000 7f3e9cb81740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55638cfd1070 0x55638d390150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.404+0000 7f3e9cb81740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55638d13f700 con 0x55638cfb0390 2024-09-21T04:04:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.404+0000 7f3e9cb81740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55638d279110 con 0x55638cfd1070 2024-09-21T04:04:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.404+0000 7f3e9cb81740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55638d386e30 con 0x55638cfa81b0 2024-09-21T04:04:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.404+0000 7f3e9cb81740 10 client.0 _ll_register_callbacks cb 0x55638d292990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:04:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.404+0000 7f3e8f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55638cfb0390 0x55638d3842a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.404+0000 7f3e8f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55638cfb0390 0x55638d3842a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40776/0 (socket says 172.21.15.46:40776) 2024-09-21T04:04:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.404+0000 7f3e8f7fe640 1 -- 172.21.15.46:0/15119908 learned_addr learned my addr 172.21.15.46:0/15119908 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.404+0000 7f3e8ffff640 1 --2- 172.21.15.46:0/15119908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55638cfa81b0 0x55638d383d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.404+0000 7f3e94baa640 1 --2- 172.21.15.46:0/15119908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55638cfd1070 0x55638d390150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.405+0000 7f3e8f7fe640 1 -- 172.21.15.46:0/15119908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55638cfa81b0 msgr2=0x55638d383d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.405+0000 7f3e8f7fe640 1 --2- 172.21.15.46:0/15119908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55638cfa81b0 0x55638d383d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.405+0000 7f3e8f7fe640 1 -- 172.21.15.46:0/15119908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55638cfd1070 msgr2=0x55638d390150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.405+0000 7f3e8f7fe640 1 --2- 172.21.15.46:0/15119908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55638cfd1070 0x55638d390150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:51.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.405+0000 7f3e8f7fe640 1 -- 172.21.15.46:0/15119908 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55638d2a6c40 con 0x55638cfb0390 2024-09-21T04:04:51.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.405+0000 7f3e8f7fe640 1 --2- 172.21.15.46:0/15119908 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55638cfb0390 0x55638d3842a0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f3e84105920 tx=0x7f3e84105820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4840be9c0a13b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:51.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.405+0000 7f3e6f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:04:51.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.405+0000 7f3e6f7fe640 1 -- 172.21.15.46:0/15119908 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e84049070 con 0x55638cfb0390 2024-09-21T04:04:51.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.405+0000 7f3e6f7fe640 1 -- 172.21.15.46:0/15119908 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7f3e840c9d40 con 0x55638cfb0390 2024-09-21T04:04:51.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.405+0000 7f3e9cb81740 1 -- 172.21.15.46:0/15119908 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e880183f0 con 0x55638cfb0390 2024-09-21T04:04:51.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.405+0000 7f3e6f7fe640 1 -- 172.21.15.46:0/15119908 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3e840cd420 con 0x55638cfb0390 2024-09-21T04:04:51.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.405+0000 7f3e9cb81740 10 client.16899 fetch_fsmap learned FSMap version 20 2024-09-21T04:04:51.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.405+0000 7f3e9cb81740 1 -- 172.21.15.46:0/15119908 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55638d392ae0 con 0x55638cfb0390 2024-09-21T04:04:51.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.405+0000 7f3e6f7fe640 1 -- 172.21.15.46:0/15119908 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e880183f0 con 0x55638cfb0390 2024-09-21T04:04:51.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.406+0000 7f3e6f7fe640 1 -- 172.21.15.46:0/15119908 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f3e8403bc20 con 0x55638cfb0390 2024-09-21T04:04:51.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.406+0000 7f3e9cb81740 10 client.16899 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:04:51.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.406+0000 7f3e9cb81740 10 client.16899 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:04:51.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.406+0000 7f3e9cb81740 20 client.16899 populate_metadata read hostname 'smithi046' 2024-09-21T04:04:51.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.406+0000 7f3e9cb81740 1 --2- 172.21.15.46:0/15119908 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55638cf8f9f0 0x55638d395f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.406+0000 7f3e9cb81740 4 client.16899 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:04:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.406+0000 7f3e9cb81740 1 -- 172.21.15.46:0/15119908 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55638d2f0da0 con 0x55638cf8f9f0 2024-09-21T04:04:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.406+0000 7f3e8ffff640 1 --2- 172.21.15.46:0/15119908 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55638cf8f9f0 0x55638d395f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.406+0000 7f3e8ffff640 1 --2- 172.21.15.46:0/15119908 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55638cf8f9f0 0x55638d395f00 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=508d8116b1f72d3a server_cookie=66dd0ffc5b164499 in_seq=0 out_seq=0 2024-09-21T04:04:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.406+0000 7f3e6f7fe640 10 client.16899 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.407+0000 7f3e6f7fe640 1 -- 172.21.15.46:0/15119908 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55638d2f0da0 con 0x55638cf8f9f0 2024-09-21T04:04:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.407+0000 7f3e6f7fe640 10 client.16899 handle_command_reply: tid=0 2024-09-21T04:04:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.407+0000 7f3e9cb81740 1 client.16899 shutdown 2024-09-21T04:04:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.407+0000 7f3e9cb81740 1 -- 172.21.15.46:0/15119908 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55638cfb0390 msgr2=0x55638d3842a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.407+0000 7f3e9cb81740 1 --2- 172.21.15.46:0/15119908 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55638cfb0390 0x55638d3842a0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f3e84105920 tx=0x7f3e84105820 comp rx=0 tx=0).stop 2024-09-21T04:04:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.407+0000 7f3e9cb81740 1 -- 172.21.15.46:0/15119908 shutdown_connections 2024-09-21T04:04:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.407+0000 7f3e9cb81740 1 --2- 172.21.15.46:0/15119908 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55638cf8f9f0 0x55638d395f00 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.408+0000 7f3e6f7fe640 0 client.16899 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.408+0000 7f3e9cb81740 1 --2- 172.21.15.46:0/15119908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55638cfd1070 0x55638d390150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.408+0000 7f3e9cb81740 1 --2- 172.21.15.46:0/15119908 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55638cfb0390 0x55638d3842a0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.408+0000 7f3e9cb81740 1 --2- 172.21.15.46:0/15119908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55638cfa81b0 0x55638d383d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.408+0000 7f3e9cb81740 1 -- 172.21.15.46:0/15119908 >> 172.21.15.46:0/15119908 conn(0x55638cfc5460 msgr2=0x55638d37b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.408+0000 7f3e9cb81740 1 -- 172.21.15.46:0/15119908 shutdown_connections 2024-09-21T04:04:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.408+0000 7f3e9cb81740 1 -- 172.21.15.46:0/15119908 wait complete. 2024-09-21T04:04:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.408+0000 7f3e9cb81740 20 client.16899 trim_cache size 0 max 16384 2024-09-21T04:04:51.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.425+0000 7f3e9cb81740 1 Processor -- start 2024-09-21T04:04:51.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.425+0000 7f3e9cb81740 1 -- start start 2024-09-21T04:04:51.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.425+0000 7f3e9cb81740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55638cfa81b0 0x55638d385990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:51.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.425+0000 7f3e9cb81740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55638cfb0390 0x55638d390050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:51.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.425+0000 7f3e9cb81740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55638cfd1070 0x55638d380f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:51.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.425+0000 7f3e9cb81740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3e901ab3b0 con 0x55638cfb0390 2024-09-21T04:04:51.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.425+0000 7f3e9cb81740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3e901adc10 con 0x55638cfd1070 2024-09-21T04:04:51.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.425+0000 7f3e9cb81740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3e901aba00 con 0x55638cfa81b0 2024-09-21T04:04:51.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.426+0000 7f3e8f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55638cfb0390 0x55638d390050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:51.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.426+0000 7f3e8f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55638cfb0390 0x55638d390050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40788/0 (socket says 172.21.15.46:40788) 2024-09-21T04:04:51.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.426+0000 7f3e8f7fe640 1 -- 172.21.15.46:0/954961532 learned_addr learned my addr 172.21.15.46:0/954961532 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:51.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.426+0000 7f3e8ffff640 1 --2- 172.21.15.46:0/954961532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55638cfa81b0 0x55638d385990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:51.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.426+0000 7f3e94baa640 1 --2- 172.21.15.46:0/954961532 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55638cfd1070 0x55638d380f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:51.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.426+0000 7f3e8f7fe640 1 -- 172.21.15.46:0/954961532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55638cfa81b0 msgr2=0x55638d385990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:51.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.426+0000 7f3e8f7fe640 1 --2- 172.21.15.46:0/954961532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55638cfa81b0 0x55638d385990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:51.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.426+0000 7f3e8f7fe640 1 -- 172.21.15.46:0/954961532 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55638cfd1070 msgr2=0x55638d380f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:51.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.426+0000 7f3e8f7fe640 1 --2- 172.21.15.46:0/954961532 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55638cfd1070 0x55638d380f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:51.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.426+0000 7f3e8f7fe640 1 -- 172.21.15.46:0/954961532 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55638d37a940 con 0x55638cfb0390 2024-09-21T04:04:51.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.426+0000 7f3e8f7fe640 1 --2- 172.21.15.46:0/954961532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55638cfb0390 0x55638d390050 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f3e84003fd0 tx=0x7f3e840d23e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b73522ef263f70d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:51.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.426+0000 7f3e75ffb640 1 -- 172.21.15.46:0/954961532 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e84049020 con 0x55638cfb0390 2024-09-21T04:04:51.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.426+0000 7f3e75ffb640 1 -- 172.21.15.46:0/954961532 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e840cd5e0 con 0x55638cfb0390 2024-09-21T04:04:51.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.426+0000 7f3e75ffb640 1 -- 172.21.15.46:0/954961532 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e840c9240 con 0x55638cfb0390 2024-09-21T04:04:51.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.427+0000 7f3e9cb81740 1 -- 172.21.15.46:0/954961532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55638cfb0390 msgr2=0x55638d390050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:51.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.427+0000 7f3e9cb81740 1 --2- 172.21.15.46:0/954961532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55638cfb0390 0x55638d390050 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f3e84003fd0 tx=0x7f3e840d23e0 comp rx=0 tx=0).stop 2024-09-21T04:04:51.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.427+0000 7f3e9cb81740 1 -- 172.21.15.46:0/954961532 shutdown_connections 2024-09-21T04:04:51.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.427+0000 7f3e9cb81740 1 --2- 172.21.15.46:0/954961532 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55638cfd1070 0x55638d380f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:51.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.427+0000 7f3e9cb81740 1 --2- 172.21.15.46:0/954961532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55638cfb0390 0x55638d390050 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:51.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.427+0000 7f3e9cb81740 1 --2- 172.21.15.46:0/954961532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55638cfa81b0 0x55638d385990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:51.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.427+0000 7f3e9cb81740 1 -- 172.21.15.46:0/954961532 >> 172.21.15.46:0/954961532 conn(0x55638cfc5460 msgr2=0x55638d385280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:51.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.427+0000 7f3e9cb81740 1 -- 172.21.15.46:0/954961532 shutdown_connections 2024-09-21T04:04:51.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.427+0000 7f3e9cb81740 1 -- 172.21.15.46:0/954961532 wait complete. 2024-09-21T04:04:51.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.428+0000 7f3e9cb81740 1 -- start start 2024-09-21T04:04:51.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.428+0000 7f3e9cb81740 1 Processor -- start 2024-09-21T04:04:51.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.428+0000 7f3e9cb81740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55638cfa81b0 0x55638d38c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:51.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.428+0000 7f3e9cb81740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55638cfb0390 0x55638d388cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:51.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.428+0000 7f3e9cb81740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55638cfd1070 0x55638d3891f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:51.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.428+0000 7f3e9cb81740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3e901ac0d0 con 0x55638cfa81b0 2024-09-21T04:04:51.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.428+0000 7f3e9cb81740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3e901ad540 con 0x55638cfb0390 2024-09-21T04:04:51.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.428+0000 7f3e9cb81740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3e901ac7a0 con 0x55638cfd1070 2024-09-21T04:04:51.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.428+0000 7f3e9cb81740 10 client.0 _ll_register_callbacks cb 0x7f3e84005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:04:51.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.428+0000 7f3e8ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55638cfa81b0 0x55638d38c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:51.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.428+0000 7f3e8ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55638cfa81b0 0x55638d38c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40790/0 (socket says 172.21.15.46:40790) 2024-09-21T04:04:51.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.428+0000 7f3e8ffff640 1 -- 172.21.15.46:0/676709063 learned_addr learned my addr 172.21.15.46:0/676709063 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:04:51.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.428+0000 7f3e94baa640 1 --2- 172.21.15.46:0/676709063 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55638cfd1070 0x55638d3891f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:51.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.429+0000 7f3e8f7fe640 1 --2- 172.21.15.46:0/676709063 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55638cfb0390 0x55638d388cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:51.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.429+0000 7f3e8ffff640 1 -- 172.21.15.46:0/676709063 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55638cfd1070 msgr2=0x55638d3891f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:51.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.429+0000 7f3e8ffff640 1 --2- 172.21.15.46:0/676709063 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55638cfd1070 0x55638d3891f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:51.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.429+0000 7f3e8ffff640 1 -- 172.21.15.46:0/676709063 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55638cfb0390 msgr2=0x55638d388cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:51.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.429+0000 7f3e8ffff640 1 --2- 172.21.15.46:0/676709063 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55638cfb0390 0x55638d388cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:51.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.429+0000 7f3e8ffff640 1 -- 172.21.15.46:0/676709063 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55638d3898e0 con 0x55638cfa81b0 2024-09-21T04:04:51.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.429+0000 7f3e94baa640 1 --2- 172.21.15.46:0/676709063 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55638cfd1070 0x55638d3891f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:04:51.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.429+0000 7f3e8f7fe640 1 --2- 172.21.15.46:0/676709063 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55638cfb0390 0x55638d388cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:04:51.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.429+0000 7f3e8ffff640 1 --2- 172.21.15.46:0/676709063 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55638cfa81b0 0x55638d38c7f0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x55638d396600 tx=0x7f3e80014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bb5e604f74a60b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:51.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.429+0000 7f3e6f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:04:51.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.429+0000 7f3e6f7fe640 1 -- 172.21.15.46:0/676709063 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8001f830 con 0x55638cfa81b0 2024-09-21T04:04:51.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.429+0000 7f3e6f7fe640 1 -- 172.21.15.46:0/676709063 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7f3e8001f9d0 con 0x55638cfa81b0 2024-09-21T04:04:51.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.429+0000 7f3e9cb81740 1 -- 172.21.15.46:0/676709063 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e840cd5e0 con 0x55638cfa81b0 2024-09-21T04:04:51.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.429+0000 7f3e6f7fe640 1 -- 172.21.15.46:0/676709063 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3e8001fbd0 con 0x55638cfa81b0 2024-09-21T04:04:51.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.429+0000 7f3e9cb81740 10 client.16905 fetch_fsmap learned FSMap version 20 2024-09-21T04:04:51.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.429+0000 7f3e9cb81740 1 -- 172.21.15.46:0/676709063 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55638d4017b0 con 0x55638cfa81b0 2024-09-21T04:04:51.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.429+0000 7f3e6f7fe640 1 -- 172.21.15.46:0/676709063 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e840cd5e0 con 0x55638cfa81b0 2024-09-21T04:04:51.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.430+0000 7f3e6f7fe640 1 -- 172.21.15.46:0/676709063 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f3e80038020 con 0x55638cfa81b0 2024-09-21T04:04:51.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.430+0000 7f3e9cb81740 10 client.16905 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:04:51.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.430+0000 7f3e9cb81740 10 client.16905 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:04:51.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.430+0000 7f3e9cb81740 20 client.16905 populate_metadata read hostname 'smithi046' 2024-09-21T04:04:51.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.430+0000 7f3e9cb81740 1 --2- 172.21.15.46:0/676709063 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55638cf64da0 0x55638d403f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:51.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.430+0000 7f3e9cb81740 4 client.16905 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T04:04:51.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.430+0000 7f3e9cb81740 1 -- 172.21.15.46:0/676709063 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55638d2ec850 con 0x55638cf64da0 2024-09-21T04:04:51.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.430+0000 7f3e8f7fe640 1 --2- 172.21.15.46:0/676709063 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55638cf64da0 0x55638d403f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:51.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.430+0000 7f3e6f7fe640 10 client.16905 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:51.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.430+0000 7f3e8f7fe640 1 --2- 172.21.15.46:0/676709063 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55638cf64da0 0x55638d403f50 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=160579fc2b01d0bb server_cookie=24c873ad3523a009 in_seq=0 out_seq=0 2024-09-21T04:04:51.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.431+0000 7f3e6f7fe640 1 -- 172.21.15.46:0/676709063 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5966 (crc 0 0 0) 0x55638d2ec850 con 0x55638cf64da0 2024-09-21T04:04:51.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.431+0000 7f3e6f7fe640 10 client.16905 handle_command_reply: tid=0 2024-09-21T04:04:51.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.431+0000 7f3e9cb81740 1 client.16905 shutdown 2024-09-21T04:04:51.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.431+0000 7f3e9cb81740 1 -- 172.21.15.46:0/676709063 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55638cfa81b0 msgr2=0x55638d38c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:51.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.431+0000 7f3e9cb81740 1 --2- 172.21.15.46:0/676709063 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55638cfa81b0 0x55638d38c7f0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x55638d396600 tx=0x7f3e80014000 comp rx=0 tx=0).stop 2024-09-21T04:04:51.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.431+0000 7f3e9cb81740 1 -- 172.21.15.46:0/676709063 shutdown_connections 2024-09-21T04:04:51.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.431+0000 7f3e9cb81740 1 --2- 172.21.15.46:0/676709063 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55638cf64da0 0x55638d403f50 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:51.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.431+0000 7f3e9cb81740 1 --2- 172.21.15.46:0/676709063 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55638cfd1070 0x55638d3891f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:51.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.431+0000 7f3e9cb81740 1 --2- 172.21.15.46:0/676709063 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55638cfb0390 0x55638d388cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:51.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.431+0000 7f3e9cb81740 1 --2- 172.21.15.46:0/676709063 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55638cfa81b0 0x55638d38c7f0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:51.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.431+0000 7f3e9cb81740 1 -- 172.21.15.46:0/676709063 >> 172.21.15.46:0/676709063 conn(0x55638cfc5460 msgr2=0x55638d37b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:51.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.431+0000 7f3e6f7fe640 0 client.16905 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:04:51.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.431+0000 7f3e9cb81740 1 -- 172.21.15.46:0/676709063 shutdown_connections 2024-09-21T04:04:51.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.431+0000 7f3e9cb81740 1 -- 172.21.15.46:0/676709063 wait complete. 2024-09-21T04:04:51.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.431+0000 7f3e9cb81740 20 client.16905 trim_cache size 0 max 16384 2024-09-21T04:04:51.439 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T04:04:51.439 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T04:04:51.439 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2024-09-21T04:04:51.439 INFO:teuthology.orchestra.run.smithi046.stdout: "74b0aad6-c059-48e7-8d5d-3eb1ee2fb7c5": { 2024-09-21T04:04:51.439 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:51.439 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "74b0aad6-c059-48e7-8d5d-3eb1ee2fb7c5", 2024-09-21T04:04:51.439 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2024-09-21T04:04:51.439 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:04:51.440 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:51.440 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_stats": { 2024-09-21T04:04:51.440 INFO:teuthology.orchestra.run.smithi046.stdout: "37d17ccb-273f-4c50-a691-5064dad9d193": { 2024-09-21T04:04:51.440 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:04:10.480657+0000", 2024-09-21T04:04:51.440 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:51.440 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:51.440 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:51.440 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:51.440 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:51.440 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:51.440 INFO:teuthology.orchestra.run.smithi046.stdout: "50776be6-bb03-4b39-ad4d-719e50e97356": { 2024-09-21T04:04:51.440 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:04:03.083808+0000", 2024-09-21T04:04:51.440 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:51.440 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:51.441 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:51.441 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:51.441 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:51.441 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:51.441 INFO:teuthology.orchestra.run.smithi046.stdout: "cfba6404-dc3f-4ad2-b873-926d5f9007de": { 2024-09-21T04:04:51.441 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:03:23.788611+0000", 2024-09-21T04:04:51.441 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:51.441 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:51.441 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:51.441 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:51.441 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:51.441 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:51.442 INFO:teuthology.orchestra.run.smithi046.stdout: "96aa13fd-aa77-46b5-b20e-a9b203dc7a94": { 2024-09-21T04:04:51.442 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:02:44.727411+0000", 2024-09-21T04:04:51.442 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:51.442 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:51.442 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:51.442 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:51.442 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:51.442 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:51.442 INFO:teuthology.orchestra.run.smithi046.stdout: "64865e31-a445-43e8-9fa3-26fae089b973": { 2024-09-21T04:04:51.442 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:02:37.376562+0000", 2024-09-21T04:04:51.442 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:51.442 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:51.442 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:51.443 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:51.443 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:51.443 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:51.443 INFO:teuthology.orchestra.run.smithi046.stdout: "7a3afabe-6b27-4bce-928a-8c6773a85803": { 2024-09-21T04:04:51.443 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:01:58.413358+0000", 2024-09-21T04:04:51.443 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:51.443 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:51.443 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:51.443 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:51.443 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:51.443 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:51.443 INFO:teuthology.orchestra.run.smithi046.stdout: "08f0c962-df1a-4129-a1a2-b916240d9803": { 2024-09-21T04:04:51.443 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:02.937596+0000", 2024-09-21T04:04:51.443 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:51.443 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:51.444 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:51.444 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:51.444 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:51.444 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:51.444 INFO:teuthology.orchestra.run.smithi046.stdout: "d49f33a7-3d5a-421b-94ba-8b19a4120db1": { 2024-09-21T04:04:51.444 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:50.480786+0000", 2024-09-21T04:04:51.444 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:51.444 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:51.444 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:51.444 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:51.444 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:51.444 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:51.445 INFO:teuthology.orchestra.run.smithi046.stdout: "a871f724-0198-493c-b03e-b2de78aba243": { 2024-09-21T04:04:51.445 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:56:30.082991+0000", 2024-09-21T04:04:51.445 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:51.445 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:51.445 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:51.445 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:51.445 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:51.445 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:51.445 INFO:teuthology.orchestra.run.smithi046.stdout: "edc4b8c7-b702-489d-a925-ae7ad0ff0d9a": { 2024-09-21T04:04:51.445 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:00:40.181950+0000", 2024-09-21T04:04:51.445 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:51.445 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:51.445 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:51.445 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:51.446 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:51.446 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:51.446 INFO:teuthology.orchestra.run.smithi046.stdout: "3bbf7097-70d7-4743-bbce-41465502b35b": { 2024-09-21T04:04:51.446 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:10.661441+0000", 2024-09-21T04:04:51.446 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:51.446 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:51.446 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:51.446 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:51.446 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:51.446 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:51.446 INFO:teuthology.orchestra.run.smithi046.stdout: "e24ec8f1-0d13-478f-9c2c-b51798868ffc": { 2024-09-21T04:04:51.446 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:09.736194+0000", 2024-09-21T04:04:51.446 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:51.446 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:51.447 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:51.447 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:51.447 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:51.447 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:51.447 INFO:teuthology.orchestra.run.smithi046.stdout: "c47f458a-de5e-4952-a575-a81261953667": { 2024-09-21T04:04:51.447 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:48.699411+0000", 2024-09-21T04:04:51.447 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:51.447 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:51.447 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:51.447 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:51.447 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:51.447 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:51.447 INFO:teuthology.orchestra.run.smithi046.stdout: "6103c660-8e77-4b06-ad6c-bb322c26035a": { 2024-09-21T04:04:51.448 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:35.594467+0000", 2024-09-21T04:04:51.448 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:51.448 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:51.448 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:51.448 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:51.448 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:51.448 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:51.448 INFO:teuthology.orchestra.run.smithi046.stdout: "46bb5415-6e16-47c6-a1e4-55f9c623ce90": { 2024-09-21T04:04:51.448 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:14.950674+0000", 2024-09-21T04:04:51.448 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:51.448 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:51.448 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:51.448 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:51.448 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:51.449 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:51.449 INFO:teuthology.orchestra.run.smithi046.stdout: "74b0aad6-c059-48e7-8d5d-3eb1ee2fb7c5": { 2024-09-21T04:04:51.449 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:04:49.777855+0000", 2024-09-21T04:04:51.449 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:51.449 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:51.449 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:51.449 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:51.449 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:51.449 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:51.449 INFO:teuthology.orchestra.run.smithi046.stdout: "326aaecf-f38a-4946-988a-d83f25556995": { 2024-09-21T04:04:51.449 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:54.189884+0000", 2024-09-21T04:04:51.449 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:51.449 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:51.450 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:51.450 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:51.450 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:51.450 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:51.450 INFO:teuthology.orchestra.run.smithi046.stdout: "dab67652-8894-4711-be64-cbdfea27a9ba": { 2024-09-21T04:04:51.450 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:28.161616+0000", 2024-09-21T04:04:51.450 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:51.450 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:51.450 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:51.450 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:51.450 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:51.450 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:51.450 INFO:teuthology.orchestra.run.smithi046.stdout: "0d781b95-cf5e-46f2-9875-2923181385e2": { 2024-09-21T04:04:51.451 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:00:33.099094+0000", 2024-09-21T04:04:51.451 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:51.451 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:51.451 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:51.451 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:51.451 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:51.451 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:04:51.451 INFO:teuthology.orchestra.run.smithi046.stdout: "d7634007-e881-46f7-9833-ac9bd0a3100e": { 2024-09-21T04:04:51.451 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:01:19.459151+0000", 2024-09-21T04:04:51.451 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:04:51.451 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:04:51.451 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:04:51.451 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:04:51.451 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:04:51.452 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:04:51.452 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:04:51.452 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T04:04:51.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.432+0000 7f3e9660d640 1 -- 172.21.15.46:0/2086218902 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f3e780b88c0 msgr2=0x7f3e780badd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:51.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.432+0000 7f3e9660d640 1 --2- 172.21.15.46:0/2086218902 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f3e780b88c0 0x7f3e780badd0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x55638d3772d0 tx=0x7f3e8000b390 comp rx=0 tx=0).stop 2024-09-21T04:04:51.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.432+0000 7f3e9660d640 1 -- 172.21.15.46:0/2086218902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e901083d0 msgr2=0x7f3e90198890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:51.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.432+0000 7f3e9660d640 1 --2- 172.21.15.46:0/2086218902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e901083d0 0x7f3e90198890 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f3e84032fd0 tx=0x7f3e84004270 comp rx=0 tx=0).stop 2024-09-21T04:04:51.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.432+0000 7f3e9660d640 1 -- 172.21.15.46:0/2086218902 shutdown_connections 2024-09-21T04:04:51.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.432+0000 7f3e9660d640 1 --2- 172.21.15.46:0/2086218902 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e90108d20 0x7f3e9019db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:51.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.432+0000 7f3e9660d640 1 --2- 172.21.15.46:0/2086218902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e901083d0 0x7f3e90198890 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:51.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.432+0000 7f3e9660d640 1 --2- 172.21.15.46:0/2086218902 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f3e780b88c0 0x7f3e780badd0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:51.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.432+0000 7f3e9660d640 1 --2- 172.21.15.46:0/2086218902 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e90102ae0 0x7f3e901982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:51.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.432+0000 7f3e9660d640 1 -- 172.21.15.46:0/2086218902 >> 172.21.15.46:0/2086218902 conn(0x7f3e90079760 msgr2=0x7f3e90104490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:51.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.432+0000 7f3e9660d640 1 -- 172.21.15.46:0/2086218902 shutdown_connections 2024-09-21T04:04:51.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:04:51.432+0000 7f3e9660d640 1 -- 172.21.15.46:0/2086218902 wait complete. 2024-09-21T04:04:51.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:51 smithi162 ceph-mon[35071]: scrub queued for path: / 2024-09-21T04:04:51.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:51 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T04:04:51.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:51 smithi162 ceph-mon[35071]: scrub summary: active paths [/] 2024-09-21T04:04:51.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:51 smithi162 ceph-mon[35071]: scrub summary: idle+waiting paths [/] 2024-09-21T04:04:51.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:51 smithi162 ceph-mon[35071]: pgmap v620: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:04:51.747 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:51 smithi046 ceph-mon[30954]: scrub queued for path: / 2024-09-21T04:04:51.747 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:51 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T04:04:51.747 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:51 smithi046 ceph-mon[30954]: scrub summary: active paths [/] 2024-09-21T04:04:51.747 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:51 smithi046 ceph-mon[30954]: scrub summary: idle+waiting paths [/] 2024-09-21T04:04:51.747 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:51 smithi046 ceph-mon[30954]: pgmap v620: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:04:51.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:51 smithi105 ceph-mon[34773]: scrub queued for path: / 2024-09-21T04:04:51.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:51 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T04:04:51.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:51 smithi105 ceph-mon[34773]: scrub summary: active paths [/] 2024-09-21T04:04:51.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:51 smithi105 ceph-mon[34773]: scrub summary: idle+waiting paths [/] 2024-09-21T04:04:51.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:51 smithi105 ceph-mon[34773]: pgmap v620: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:04:52.341 INFO:tasks.cephfs.filesystem:scrub status for tag:74b0aad6-c059-48e7-8d5d-3eb1ee2fb7c5 - {'path': '/', 'tag': '74b0aad6-c059-48e7-8d5d-3eb1ee2fb7c5', 'options': 'recursive,force'} 2024-09-21T04:04:53.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:53 smithi162 ceph-mon[35071]: pgmap v621: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-21T04:04:53.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:53 smithi046 ceph-mon[30954]: pgmap v621: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-21T04:04:53.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:53 smithi105 ceph-mon[34773]: pgmap v621: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-21T04:04:54.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:54 smithi162 ceph-mon[35071]: scrub summary: idle 2024-09-21T04:04:54.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:54 smithi046 ceph-mon[30954]: scrub summary: idle 2024-09-21T04:04:54.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:54 smithi105 ceph-mon[34773]: scrub summary: idle 2024-09-21T04:04:55.502 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:55 smithi046 ceph-mon[30954]: pgmap v622: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T04:04:55.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:55 smithi162 ceph-mon[35071]: pgmap v622: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T04:04:55.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:55 smithi105 ceph-mon[34773]: pgmap v622: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T04:04:57.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:57 smithi162 ceph-mon[35071]: pgmap v623: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T04:04:57.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:57 smithi046 ceph-mon[30954]: pgmap v623: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T04:04:57.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:57 smithi105 ceph-mon[34773]: pgmap v623: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T04:04:59.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:04:59 smithi162 ceph-mon[35071]: pgmap v624: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T04:04:59.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:04:59 smithi046 ceph-mon[30954]: pgmap v624: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T04:04:59.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:04:59 smithi105 ceph-mon[34773]: pgmap v624: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-21T04:05:01.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:01 smithi162 ceph-mon[35071]: pgmap v625: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T04:05:01.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:01 smithi046 ceph-mon[30954]: pgmap v625: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T04:05:01.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:01 smithi105 ceph-mon[34773]: pgmap v625: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-21T04:05:03.392 DEBUG:teuthology.orchestra.run.smithi046:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-21T04:05:03.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.518+0000 7f0984b58640 1 -- 172.21.15.46:0/381881719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0980109d80 msgr2=0x7f09801105b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:03.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.518+0000 7f0984b58640 1 --2- 172.21.15.46:0/381881719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0980109d80 0x7f09801105b0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f0978009ca0 tx=0x7f097802a8c0 comp rx=0 tx=0).stop 2024-09-21T04:05:03.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.518+0000 7f0984b58640 1 -- 172.21.15.46:0/381881719 shutdown_connections 2024-09-21T04:05:03.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.518+0000 7f0984b58640 1 --2- 172.21.15.46:0/381881719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0980109d80 0x7f09801105b0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:03.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.518+0000 7f0984b58640 1 --2- 172.21.15.46:0/381881719 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0980109430 0x7f0980109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:03.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.518+0000 7f0984b58640 1 --2- 172.21.15.46:0/381881719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0980103b00 0x7f0980103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:03.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.518+0000 7f0984b58640 1 -- 172.21.15.46:0/381881719 >> 172.21.15.46:0/381881719 conn(0x7f09800ff500 msgr2=0x7f0980101950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:03.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.518+0000 7f0984b58640 1 -- 172.21.15.46:0/381881719 shutdown_connections 2024-09-21T04:05:03.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.518+0000 7f0984b58640 1 -- 172.21.15.46:0/381881719 wait complete. 2024-09-21T04:05:03.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.519+0000 7f0984b58640 1 Processor -- start 2024-09-21T04:05:03.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.519+0000 7f0984b58640 1 -- start start 2024-09-21T04:05:03.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.519+0000 7f0984b58640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0980103b00 0x7f098019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:03.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.519+0000 7f0984b58640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0980109430 0x7f098019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:03.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.519+0000 7f0984b58640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0980109d80 0x7f098019fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:03.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.519+0000 7f0984b58640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0980113a40 con 0x7f0980103b00 2024-09-21T04:05:03.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.519+0000 7f0984b58640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f09801138c0 con 0x7f0980109d80 2024-09-21T04:05:03.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.519+0000 7f0984b58640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0980113bc0 con 0x7f0980109430 2024-09-21T04:05:03.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.519+0000 7f097e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0980103b00 0x7f098019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:03.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.519+0000 7f097e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0980103b00 0x7f098019a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46472/0 (socket says 172.21.15.46:46472) 2024-09-21T04:05:03.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.519+0000 7f097e59c640 1 -- 172.21.15.46:0/29484088 learned_addr learned my addr 172.21.15.46:0/29484088 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:05:03.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.519+0000 7f097dd9b640 1 --2- 172.21.15.46:0/29484088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0980109430 0x7f098019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:03.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.519+0000 7f097ed9d640 1 --2- 172.21.15.46:0/29484088 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0980109d80 0x7f098019fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:03.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.519+0000 7f097e59c640 1 -- 172.21.15.46:0/29484088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0980109430 msgr2=0x7f098019aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:03.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.519+0000 7f097e59c640 1 --2- 172.21.15.46:0/29484088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0980109430 0x7f098019aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:03.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.519+0000 7f097e59c640 1 -- 172.21.15.46:0/29484088 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0980109d80 msgr2=0x7f098019fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:03.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.519+0000 7f097e59c640 1 --2- 172.21.15.46:0/29484088 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0980109d80 0x7f098019fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:03.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.519+0000 7f097e59c640 1 -- 172.21.15.46:0/29484088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09801a0410 con 0x7f0980103b00 2024-09-21T04:05:03.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.520+0000 7f097ed9d640 1 --2- 172.21.15.46:0/29484088 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0980109d80 0x7f098019fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:05:03.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.520+0000 7f097e59c640 1 --2- 172.21.15.46:0/29484088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0980103b00 0x7f098019a4e0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f097000e9f0 tx=0x7f097000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:03.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.520+0000 7f096f7fe640 1 -- 172.21.15.46:0/29484088 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097000cd80 con 0x7f0980103b00 2024-09-21T04:05:03.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.520+0000 7f096f7fe640 1 -- 172.21.15.46:0/29484088 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09700054d0 con 0x7f0980103b00 2024-09-21T04:05:03.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.520+0000 7f0984b58640 1 -- 172.21.15.46:0/29484088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09801a0700 con 0x7f0980103b00 2024-09-21T04:05:03.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.520+0000 7f096f7fe640 1 -- 172.21.15.46:0/29484088 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0970010690 con 0x7f0980103b00 2024-09-21T04:05:03.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.520+0000 7f0984b58640 1 -- 172.21.15.46:0/29484088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09801a6e90 con 0x7f0980103b00 2024-09-21T04:05:03.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.521+0000 7f0984b58640 1 -- 172.21.15.46:0/29484088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0980103f10 con 0x7f0980103b00 2024-09-21T04:05:03.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.523+0000 7f096f7fe640 1 -- 172.21.15.46:0/29484088 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f0970004e30 con 0x7f0980103b00 2024-09-21T04:05:03.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.523+0000 7f096f7fe640 1 --2- 172.21.15.46:0/29484088 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f09680b6680 0x7f09680b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:03.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.524+0000 7f097dd9b640 1 --2- 172.21.15.46:0/29484088 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f09680b6680 0x7f09680b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:03.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.524+0000 7f096f7fe640 1 -- 172.21.15.46:0/29484088 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7f09700e7e00 con 0x7f0980103b00 2024-09-21T04:05:03.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.524+0000 7f097dd9b640 1 --2- 172.21.15.46:0/29484088 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f09680b6680 0x7f09680b8b90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0980102d50 tx=0x7f0974005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:03.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.527+0000 7f096f7fe640 1 -- 172.21.15.46:0/29484088 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0970056710 con 0x7f0980103b00 2024-09-21T04:05:03.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:03 smithi162 ceph-mon[35071]: pgmap v626: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 16 op/s 2024-09-21T04:05:03.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.735+0000 7f0984b58640 1 -- 172.21.15.46:0/29484088 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f0980063800 con 0x7f09680b6680 2024-09-21T04:05:03.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.743+0000 7f096f7fe640 1 -- 172.21.15.46:0/29484088 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f0980063800 con 0x7f09680b6680 2024-09-21T04:05:03.746 INFO:teuthology.orchestra.run.smithi046.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-21T00:00:00", "created": "2024-09-21T03:55:02", "first": "2024-09-21T03:56:00", "last": "2024-09-21T04:05:00", "last_pruned": "2024-09-21T04:04:00", "created_count": 10, "pruned_count": 3, "active": true} 2024-09-21T04:05:03.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.745+0000 7f0984b58640 1 -- 172.21.15.46:0/29484088 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f09680b6680 msgr2=0x7f09680b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:03.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.745+0000 7f0984b58640 1 --2- 172.21.15.46:0/29484088 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f09680b6680 0x7f09680b8b90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0980102d50 tx=0x7f0974005f90 comp rx=0 tx=0).stop 2024-09-21T04:05:03.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.745+0000 7f0984b58640 1 -- 172.21.15.46:0/29484088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0980103b00 msgr2=0x7f098019a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:03.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.745+0000 7f0984b58640 1 --2- 172.21.15.46:0/29484088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0980103b00 0x7f098019a4e0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f097000e9f0 tx=0x7f097000edf0 comp rx=0 tx=0).stop 2024-09-21T04:05:03.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.745+0000 7f0984b58640 1 -- 172.21.15.46:0/29484088 shutdown_connections 2024-09-21T04:05:03.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.745+0000 7f0984b58640 1 --2- 172.21.15.46:0/29484088 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0980109d80 0x7f098019fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:03.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.745+0000 7f0984b58640 1 --2- 172.21.15.46:0/29484088 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f09680b6680 0x7f09680b8b90 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:03.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.745+0000 7f0984b58640 1 --2- 172.21.15.46:0/29484088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0980109430 0x7f098019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:03.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.745+0000 7f0984b58640 1 --2- 172.21.15.46:0/29484088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0980103b00 0x7f098019a4e0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:03.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.745+0000 7f0984b58640 1 -- 172.21.15.46:0/29484088 >> 172.21.15.46:0/29484088 conn(0x7f09800ff500 msgr2=0x7f09801069d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:03.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.745+0000 7f0984b58640 1 -- 172.21.15.46:0/29484088 shutdown_connections 2024-09-21T04:05:03.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.745+0000 7f0984b58640 1 -- 172.21.15.46:0/29484088 wait complete. 2024-09-21T04:05:03.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:03 smithi046 ceph-mon[30954]: pgmap v626: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 16 op/s 2024-09-21T04:05:03.759 DEBUG:teuthology.orchestra.run.smithi046:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-21T04:05:03.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:03 smithi105 ceph-mon[34773]: pgmap v626: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 16 op/s 2024-09-21T04:05:03.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.872+0000 7fe05fdf9640 1 -- 172.21.15.46:0/2634056030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe05806c3c0 msgr2=0x7fe05810fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:03.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.872+0000 7fe05fdf9640 1 --2- 172.21.15.46:0/2634056030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe05806c3c0 0x7fe05810fd00 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fe048009900 tx=0x7fe04802a410 comp rx=0 tx=0).stop 2024-09-21T04:05:03.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.873+0000 7fe05fdf9640 1 -- 172.21.15.46:0/2634056030 shutdown_connections 2024-09-21T04:05:03.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.873+0000 7fe05fdf9640 1 --2- 172.21.15.46:0/2634056030 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe058110240 0x7fe058112660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:03.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.873+0000 7fe05fdf9640 1 --2- 172.21.15.46:0/2634056030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe05806c3c0 0x7fe05810fd00 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:03.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.873+0000 7fe05fdf9640 1 --2- 172.21.15.46:0/2634056030 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe05806ba70 0x7fe05806be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:03.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.873+0000 7fe05fdf9640 1 -- 172.21.15.46:0/2634056030 >> 172.21.15.46:0/2634056030 conn(0x7fe0580784e0 msgr2=0x7fe0580788f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:03.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.873+0000 7fe05fdf9640 1 -- 172.21.15.46:0/2634056030 shutdown_connections 2024-09-21T04:05:03.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.873+0000 7fe05fdf9640 1 -- 172.21.15.46:0/2634056030 wait complete. 2024-09-21T04:05:03.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.873+0000 7fe05fdf9640 1 Processor -- start 2024-09-21T04:05:03.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.873+0000 7fe05fdf9640 1 -- start start 2024-09-21T04:05:03.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.874+0000 7fe05fdf9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe05806ba70 0x7fe0581086f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:03.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.874+0000 7fe05fdf9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe05806c3c0 0x7fe0581049c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:03.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.874+0000 7fe05fdf9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe058110240 0x7fe0581050f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:03.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.874+0000 7fe05fdf9640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe058115bf0 con 0x7fe058110240 2024-09-21T04:05:03.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.874+0000 7fe05fdf9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe058115a70 con 0x7fe05806c3c0 2024-09-21T04:05:03.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.874+0000 7fe05fdf9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe058115d70 con 0x7fe05806ba70 2024-09-21T04:05:03.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.874+0000 7fe05e396640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe058110240 0x7fe0581050f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:03.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.874+0000 7fe05e396640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe058110240 0x7fe0581050f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46486/0 (socket says 172.21.15.46:46486) 2024-09-21T04:05:03.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.874+0000 7fe05e396640 1 -- 172.21.15.46:0/345006657 learned_addr learned my addr 172.21.15.46:0/345006657 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:05:03.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.874+0000 7fe05d394640 1 --2- 172.21.15.46:0/345006657 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe05806c3c0 0x7fe0581049c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:03.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.874+0000 7fe05e396640 1 -- 172.21.15.46:0/345006657 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe05806ba70 msgr2=0x7fe0581086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:03.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.874+0000 7fe05db95640 1 --2- 172.21.15.46:0/345006657 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe05806ba70 0x7fe0581086f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:03.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.874+0000 7fe05e396640 1 --2- 172.21.15.46:0/345006657 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe05806ba70 0x7fe0581086f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:03.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.874+0000 7fe05e396640 1 -- 172.21.15.46:0/345006657 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe05806c3c0 msgr2=0x7fe0581049c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:03.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.874+0000 7fe05e396640 1 --2- 172.21.15.46:0/345006657 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe05806c3c0 0x7fe0581049c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:03.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.874+0000 7fe05e396640 1 -- 172.21.15.46:0/345006657 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0581acb50 con 0x7fe058110240 2024-09-21T04:05:03.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.874+0000 7fe05d394640 1 --2- 172.21.15.46:0/345006657 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe05806c3c0 0x7fe0581049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:05:03.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.874+0000 7fe05e396640 1 --2- 172.21.15.46:0/345006657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe058110240 0x7fe0581050f0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fe05000eaa0 tx=0x7fe05000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:03.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.874+0000 7fe04effd640 1 -- 172.21.15.46:0/345006657 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05000cdb0 con 0x7fe058110240 2024-09-21T04:05:03.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.874+0000 7fe04effd640 1 -- 172.21.15.46:0/345006657 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe050005020 con 0x7fe058110240 2024-09-21T04:05:03.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.875+0000 7fe05fdf9640 1 -- 172.21.15.46:0/345006657 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0581acd80 con 0x7fe058110240 2024-09-21T04:05:03.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.875+0000 7fe04effd640 1 -- 172.21.15.46:0/345006657 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0500116d0 con 0x7fe058110240 2024-09-21T04:05:03.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.875+0000 7fe05fdf9640 1 -- 172.21.15.46:0/345006657 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0581ad240 con 0x7fe058110240 2024-09-21T04:05:03.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.875+0000 7fe05fdf9640 1 -- 172.21.15.46:0/345006657 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe058102b30 con 0x7fe058110240 2024-09-21T04:05:03.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.878+0000 7fe04effd640 1 -- 172.21.15.46:0/345006657 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7fe0500051d0 con 0x7fe058110240 2024-09-21T04:05:03.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.879+0000 7fe04effd640 1 --2- 172.21.15.46:0/345006657 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe0440b6700 0x7fe0440b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:03.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.879+0000 7fe05db95640 1 --2- 172.21.15.46:0/345006657 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe0440b6700 0x7fe0440b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:03.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.879+0000 7fe04effd640 1 -- 172.21.15.46:0/345006657 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fe0500e7c40 con 0x7fe058110240 2024-09-21T04:05:03.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.879+0000 7fe05db95640 1 --2- 172.21.15.46:0/345006657 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe0440b6700 0x7fe0440b8c10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe054005fd0 tx=0x7fe054005c70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:03.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:03.882+0000 7fe04effd640 1 -- 172.21.15.46:0/345006657 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe050016030 con 0x7fe058110240 2024-09-21T04:05:04.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:04.092+0000 7fe05fdf9640 1 -- 172.21.15.46:0/345006657 --> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fe058111c30 con 0x7fe0440b6700 2024-09-21T04:05:04.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:04.100+0000 7fe04effd640 1 -- 172.21.15.46:0/345006657 <== mgr.14223 v2:172.21.15.46:6800/1928997883 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fe058111c30 con 0x7fe0440b6700 2024-09-21T04:05:04.102 INFO:teuthology.orchestra.run.smithi046.stdout:/ 1m 6m3h 2024-09-21T04:05:04.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:04.102+0000 7fe05fdf9640 1 -- 172.21.15.46:0/345006657 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe0440b6700 msgr2=0x7fe0440b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:04.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:04.102+0000 7fe05fdf9640 1 --2- 172.21.15.46:0/345006657 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe0440b6700 0x7fe0440b8c10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe054005fd0 tx=0x7fe054005c70 comp rx=0 tx=0).stop 2024-09-21T04:05:04.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:04.102+0000 7fe05fdf9640 1 -- 172.21.15.46:0/345006657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe058110240 msgr2=0x7fe0581050f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:04.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:04.102+0000 7fe05fdf9640 1 --2- 172.21.15.46:0/345006657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe058110240 0x7fe0581050f0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fe05000eaa0 tx=0x7fe05000ef60 comp rx=0 tx=0).stop 2024-09-21T04:05:04.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:04.102+0000 7fe05fdf9640 1 -- 172.21.15.46:0/345006657 shutdown_connections 2024-09-21T04:05:04.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:04.102+0000 7fe05fdf9640 1 --2- 172.21.15.46:0/345006657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe058110240 0x7fe0581050f0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:04.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:04.102+0000 7fe05fdf9640 1 --2- 172.21.15.46:0/345006657 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe05806c3c0 0x7fe0581049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:04.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:04.102+0000 7fe05fdf9640 1 --2- 172.21.15.46:0/345006657 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fe0440b6700 0x7fe0440b8c10 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:04.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:04.102+0000 7fe05fdf9640 1 --2- 172.21.15.46:0/345006657 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe05806ba70 0x7fe0581086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:04.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:04.102+0000 7fe05fdf9640 1 -- 172.21.15.46:0/345006657 >> 172.21.15.46:0/345006657 conn(0x7fe0580784e0 msgr2=0x7fe058111520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:04.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:04.102+0000 7fe05fdf9640 1 -- 172.21.15.46:0/345006657 shutdown_connections 2024-09-21T04:05:04.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:04.102+0000 7fe05fdf9640 1 -- 172.21.15.46:0/345006657 wait complete. 2024-09-21T04:05:04.116 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-21T04:05:04.134 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-21T04:05:04.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:04 smithi046 ceph-mon[30954]: from='client.16911 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:04.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:04 smithi162 ceph-mon[35071]: from='client.16911 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:04.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:04 smithi105 ceph-mon[34773]: from='client.16911 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:05.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:05 smithi162 ceph-mon[35071]: from='client.16917 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:05.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:05 smithi162 ceph-mon[35071]: pgmap v627: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T04:05:05.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:05 smithi046 ceph-mon[30954]: from='client.16917 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:05.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:05 smithi046 ceph-mon[30954]: pgmap v627: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T04:05:05.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:05 smithi105 ceph-mon[34773]: from='client.16917 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:05:05.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:05 smithi105 ceph-mon[34773]: pgmap v627: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T04:05:07.626 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:07 smithi162 ceph-mon[35071]: pgmap v628: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T04:05:07.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:07 smithi046 ceph-mon[30954]: pgmap v628: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T04:05:07.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:07 smithi105 ceph-mon[34773]: pgmap v628: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T04:05:09.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:09 smithi162 ceph-mon[35071]: pgmap v629: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T04:05:09.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:09 smithi046 ceph-mon[30954]: pgmap v629: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T04:05:09.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:09 smithi105 ceph-mon[34773]: pgmap v629: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T04:05:11.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:11 smithi162 ceph-mon[35071]: pgmap v630: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-21T04:05:11.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:11 smithi046 ceph-mon[30954]: pgmap v630: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-21T04:05:11.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:11 smithi105 ceph-mon[34773]: pgmap v630: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-21T04:05:13.625 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:13 smithi162 ceph-mon[35071]: pgmap v631: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-21T04:05:13.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:13 smithi046 ceph-mon[30954]: pgmap v631: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-21T04:05:13.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:13 smithi105 ceph-mon[34773]: pgmap v631: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-21T04:05:15.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:15 smithi046 ceph-mon[30954]: pgmap v632: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-09-21T04:05:15.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:15 smithi105 ceph-mon[34773]: pgmap v632: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-09-21T04:05:15.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:15 smithi162 ceph-mon[35071]: pgmap v632: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-09-21T04:05:17.678 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:17 smithi162 ceph-mon[35071]: pgmap v633: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T04:05:17.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:17 smithi046 ceph-mon[30954]: pgmap v633: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T04:05:17.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:17 smithi105 ceph-mon[34773]: pgmap v633: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T04:05:19.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:19 smithi046 ceph-mon[30954]: pgmap v634: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T04:05:19.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:19 smithi105 ceph-mon[34773]: pgmap v634: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T04:05:19.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:19 smithi162 ceph-mon[35071]: pgmap v634: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T04:05:21.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:21 smithi046 ceph-mon[30954]: pgmap v635: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T04:05:21.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:21 smithi105 ceph-mon[34773]: pgmap v635: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T04:05:21.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:21 smithi162 ceph-mon[35071]: pgmap v635: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T04:05:22.342 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T04:05:22.618 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:05:23.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.128+0000 7fbb4056e640 1 -- 172.21.15.46:0/2367048464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb381020c0 msgr2=0x7fbb381024d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:23.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.128+0000 7fbb4056e640 1 --2- 172.21.15.46:0/2367048464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb381020c0 0x7fbb381024d0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fbb34009900 tx=0x7fbb3402a410 comp rx=0 tx=0).stop 2024-09-21T04:05:23.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.128+0000 7fbb4056e640 1 -- 172.21.15.46:0/2367048464 shutdown_connections 2024-09-21T04:05:23.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.128+0000 7fbb4056e640 1 --2- 172.21.15.46:0/2367048464 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb38106c00 0x7fbb38110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:23.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.128+0000 7fbb4056e640 1 --2- 172.21.15.46:0/2367048464 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb381062b0 0x7fbb381066c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:23.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.128+0000 7fbb4056e640 1 --2- 172.21.15.46:0/2367048464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb381020c0 0x7fbb381024d0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:23.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.128+0000 7fbb4056e640 1 -- 172.21.15.46:0/2367048464 >> 172.21.15.46:0/2367048464 conn(0x7fbb38079e40 msgr2=0x7fbb3807a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:23.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.128+0000 7fbb4056e640 1 -- 172.21.15.46:0/2367048464 shutdown_connections 2024-09-21T04:05:23.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.128+0000 7fbb4056e640 1 -- 172.21.15.46:0/2367048464 wait complete. 2024-09-21T04:05:23.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.128+0000 7fbb4056e640 1 Processor -- start 2024-09-21T04:05:23.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.129+0000 7fbb4056e640 1 -- start start 2024-09-21T04:05:23.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.129+0000 7fbb4056e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb381020c0 0x7fbb3819a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:23.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.129+0000 7fbb4056e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb381062b0 0x7fbb3819aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:23.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.129+0000 7fbb4056e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb38106c00 0x7fbb3819fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:23.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.129+0000 7fbb4056e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fbb38113b00 con 0x7fbb381020c0 2024-09-21T04:05:23.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.129+0000 7fbb4056e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbb38113980 con 0x7fbb38106c00 2024-09-21T04:05:23.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.129+0000 7fbb4056e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbb38113c80 con 0x7fbb381062b0 2024-09-21T04:05:23.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.129+0000 7fbb3e30a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb381020c0 0x7fbb3819a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:23.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.129+0000 7fbb3e30a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb381020c0 0x7fbb3819a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50976/0 (socket says 172.21.15.46:50976) 2024-09-21T04:05:23.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.129+0000 7fbb3e30a640 1 -- 172.21.15.46:0/2417119288 learned_addr learned my addr 172.21.15.46:0/2417119288 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:05:23.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.129+0000 7fbb3db09640 1 --2- 172.21.15.46:0/2417119288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb381062b0 0x7fbb3819aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:23.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.129+0000 7fbb3e30a640 1 -- 172.21.15.46:0/2417119288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb381062b0 msgr2=0x7fbb3819aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:23.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.129+0000 7fbb3e30a640 1 --2- 172.21.15.46:0/2417119288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb381062b0 0x7fbb3819aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:23.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.129+0000 7fbb3e30a640 1 -- 172.21.15.46:0/2417119288 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb38106c00 msgr2=0x7fbb3819fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:23.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.129+0000 7fbb3e30a640 1 --2- 172.21.15.46:0/2417119288 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb38106c00 0x7fbb3819fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:23.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.129+0000 7fbb3e30a640 1 -- 172.21.15.46:0/2417119288 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb381a0440 con 0x7fbb381020c0 2024-09-21T04:05:23.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.129+0000 7fbb3db09640 1 --2- 172.21.15.46:0/2417119288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb381062b0 0x7fbb3819aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:05:23.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.129+0000 7fbb3e30a640 1 --2- 172.21.15.46:0/2417119288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb381020c0 0x7fbb3819a4d0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fbb34005940 tx=0x7fbb340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:23.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.130+0000 7fbb2f7fe640 1 -- 172.21.15.46:0/2417119288 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3403f030 con 0x7fbb381020c0 2024-09-21T04:05:23.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.130+0000 7fbb2f7fe640 1 -- 172.21.15.46:0/2417119288 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb34003cb0 con 0x7fbb381020c0 2024-09-21T04:05:23.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.130+0000 7fbb4056e640 1 -- 172.21.15.46:0/2417119288 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb381a06d0 con 0x7fbb381020c0 2024-09-21T04:05:23.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.130+0000 7fbb2f7fe640 1 -- 172.21.15.46:0/2417119288 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb34035070 con 0x7fbb381020c0 2024-09-21T04:05:23.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.130+0000 7fbb4056e640 1 -- 172.21.15.46:0/2417119288 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb381a6e90 con 0x7fbb381020c0 2024-09-21T04:05:23.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.132+0000 7fbb46ae2740 1 Processor -- start 2024-09-21T04:05:23.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.133+0000 7fbb46ae2740 1 -- start start 2024-09-21T04:05:23.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.133+0000 7fbb2f7fe640 1 -- 172.21.15.46:0/2417119288 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7fbb34042030 con 0x7fbb381020c0 2024-09-21T04:05:23.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.133+0000 7fbb46ae2740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3146bb070 0x55d314a62650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:23.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.133+0000 7fbb46ae2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d3146921b0 0x55d314a62b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:23.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.133+0000 7fbb46ae2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d31469a390 0x55d314a630d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:23.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.133+0000 7fbb46ae2740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55d3149d8e50 con 0x55d3146bb070 2024-09-21T04:05:23.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.133+0000 7fbb46ae2740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55d3149c8280 con 0x55d3146921b0 2024-09-21T04:05:23.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.133+0000 7fbb46ae2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d3149cc090 con 0x55d31469a390 2024-09-21T04:05:23.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.133+0000 7fbb3eb0b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3146bb070 0x55d314a62650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:23.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.133+0000 7fbb3eb0b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3146bb070 0x55d314a62650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50978/0 (socket says 172.21.15.46:50978) 2024-09-21T04:05:23.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.133+0000 7fbb3eb0b640 1 -- 172.21.15.46:0/3915140165 learned_addr learned my addr 172.21.15.46:0/3915140165 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:05:23.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.133+0000 7fbb3e30a640 1 --2- 172.21.15.46:0/3915140165 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d3146921b0 0x55d314a62b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:23.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.133+0000 7fbb3db09640 1 --2- 172.21.15.46:0/3915140165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d31469a390 0x55d314a630d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:23.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.133+0000 7fbb3eb0b640 1 -- 172.21.15.46:0/3915140165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d31469a390 msgr2=0x55d314a630d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:23.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.133+0000 7fbb3eb0b640 1 --2- 172.21.15.46:0/3915140165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d31469a390 0x55d314a630d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:23.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.133+0000 7fbb3eb0b640 1 -- 172.21.15.46:0/3915140165 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d3146921b0 msgr2=0x55d314a62b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:23.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.133+0000 7fbb3eb0b640 1 --2- 172.21.15.46:0/3915140165 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d3146921b0 0x55d314a62b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:23.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.133+0000 7fbb3eb0b640 1 -- 172.21.15.46:0/3915140165 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d314726650 con 0x55d3146bb070 2024-09-21T04:05:23.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.134+0000 7fbb2f7fe640 1 --2- 172.21.15.46:0/2417119288 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fbb240b6680 0x7fbb240b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:23.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.134+0000 7fbb3eb0b640 1 --2- 172.21.15.46:0/3915140165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3146bb070 0x55d314a62650 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fbb30009d50 tx=0x7fbb3000d6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74224e509fff9423 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:23.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.134+0000 7fbb3e30a640 1 --2- 172.21.15.46:0/2417119288 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fbb240b6680 0x7fbb240b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:23.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.134+0000 7fbb2f7fe640 1 -- 172.21.15.46:0/2417119288 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fbb34107c60 con 0x7fbb381020c0 2024-09-21T04:05:23.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.134+0000 7fbb2cff9640 1 -- 172.21.15.46:0/3915140165 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb30003970 con 0x55d3146bb070 2024-09-21T04:05:23.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.134+0000 7fbb2cff9640 1 -- 172.21.15.46:0/3915140165 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb30004020 con 0x55d3146bb070 2024-09-21T04:05:23.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.134+0000 7fbb2cff9640 1 -- 172.21.15.46:0/3915140165 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb300106c0 con 0x55d3146bb070 2024-09-21T04:05:23.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.135+0000 7fbb46ae2740 1 -- 172.21.15.46:0/3915140165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3146bb070 msgr2=0x55d314a62650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:23.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.135+0000 7fbb3e30a640 1 --2- 172.21.15.46:0/2417119288 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fbb240b6680 0x7fbb240b8b90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbb341054d0 tx=0x7fbb3410b7b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:23.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.135+0000 7fbb46ae2740 1 --2- 172.21.15.46:0/3915140165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3146bb070 0x55d314a62650 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fbb30009d50 tx=0x7fbb3000d6b0 comp rx=0 tx=0).stop 2024-09-21T04:05:23.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.135+0000 7fbb46ae2740 1 -- 172.21.15.46:0/3915140165 shutdown_connections 2024-09-21T04:05:23.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.135+0000 7fbb46ae2740 1 --2- 172.21.15.46:0/3915140165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d31469a390 0x55d314a630d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:23.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.135+0000 7fbb46ae2740 1 --2- 172.21.15.46:0/3915140165 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d3146921b0 0x55d314a62b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:23.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.135+0000 7fbb46ae2740 1 --2- 172.21.15.46:0/3915140165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3146bb070 0x55d314a62650 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:23.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.135+0000 7fbb46ae2740 1 -- 172.21.15.46:0/3915140165 >> 172.21.15.46:0/3915140165 conn(0x55d3146af460 msgr2=0x55d314a60540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:23.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.135+0000 7fbb46ae2740 1 -- 172.21.15.46:0/3915140165 shutdown_connections 2024-09-21T04:05:23.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.135+0000 7fbb46ae2740 1 -- 172.21.15.46:0/3915140165 wait complete. 2024-09-21T04:05:23.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.136+0000 7fbb46ae2740 1 -- start start 2024-09-21T04:05:23.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.136+0000 7fbb46ae2740 1 Processor -- start 2024-09-21T04:05:23.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.136+0000 7fbb46ae2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d3146921b0 0x55d314a720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:23.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.136+0000 7fbb46ae2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d31469a390 0x55d314a72630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:23.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.136+0000 7fbb46ae2740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3146bb070 0x55d314a7e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:23.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.136+0000 7fbb46ae2740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55d314829700 con 0x55d3146bb070 2024-09-21T04:05:23.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.136+0000 7fbb46ae2740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55d314963110 con 0x55d3146921b0 2024-09-21T04:05:23.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.136+0000 7fbb46ae2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d314a75190 con 0x55d31469a390 2024-09-21T04:05:23.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.136+0000 7fbb46ae2740 10 client.0 _ll_register_callbacks cb 0x55d31497c990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:05:23.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.136+0000 7fbb3eb0b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3146bb070 0x55d314a7e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:23.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.136+0000 7fbb3eb0b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3146bb070 0x55d314a7e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50982/0 (socket says 172.21.15.46:50982) 2024-09-21T04:05:23.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.136+0000 7fbb3eb0b640 1 -- 172.21.15.46:0/1174082119 learned_addr learned my addr 172.21.15.46:0/1174082119 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:05:23.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.137+0000 7fbb3db09640 1 --2- 172.21.15.46:0/1174082119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d31469a390 0x55d314a72630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:23.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.137+0000 7fbb3eb0b640 1 --2- 172.21.15.46:0/1174082119 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d3146921b0 0x55d314a720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:23.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.137+0000 7fbb3eb0b640 1 -- 172.21.15.46:0/1174082119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d31469a390 msgr2=0x55d314a72630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:23.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.137+0000 7fbb3eb0b640 1 --2- 172.21.15.46:0/1174082119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d31469a390 0x55d314a72630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:23.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.137+0000 7fbb3eb0b640 1 -- 172.21.15.46:0/1174082119 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d3146921b0 msgr2=0x55d314a720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:23.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.137+0000 7fbb3eb0b640 1 --2- 172.21.15.46:0/1174082119 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d3146921b0 0x55d314a720f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:23.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.137+0000 7fbb3eb0b640 1 -- 172.21.15.46:0/1174082119 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d314990c40 con 0x55d3146bb070 2024-09-21T04:05:23.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.137+0000 7fbb3eb0b640 1 --2- 172.21.15.46:0/1174082119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3146bb070 0x55d314a7e4f0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fbb30009b10 tx=0x7fbb3000df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34df981433752cf6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:23.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.137+0000 7fbb21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:05:23.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.137+0000 7fbb21ffb640 1 -- 172.21.15.46:0/1174082119 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3001e070 con 0x55d3146bb070 2024-09-21T04:05:23.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.137+0000 7fbb21ffb640 1 -- 172.21.15.46:0/1174082119 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fbb30004d20 con 0x55d3146bb070 2024-09-21T04:05:23.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.137+0000 7fbb46ae2740 1 -- 172.21.15.46:0/1174082119 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb30004020 con 0x55d3146bb070 2024-09-21T04:05:23.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.137+0000 7fbb21ffb640 1 -- 172.21.15.46:0/1174082119 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fbb30003970 con 0x55d3146bb070 2024-09-21T04:05:23.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.138+0000 7fbb46ae2740 10 client.16929 fetch_fsmap learned FSMap version 20 2024-09-21T04:05:23.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.138+0000 7fbb46ae2740 1 -- 172.21.15.46:0/1174082119 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55d314a80eb0 con 0x55d3146bb070 2024-09-21T04:05:23.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.138+0000 7fbb21ffb640 1 -- 172.21.15.46:0/1174082119 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb30004020 con 0x55d3146bb070 2024-09-21T04:05:23.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.138+0000 7fbb21ffb640 1 -- 172.21.15.46:0/1174082119 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fbb30010b40 con 0x55d3146bb070 2024-09-21T04:05:23.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.138+0000 7fbb46ae2740 10 client.16929 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:05:23.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.138+0000 7fbb46ae2740 10 client.16929 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:05:23.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.138+0000 7fbb46ae2740 20 client.16929 populate_metadata read hostname 'smithi046' 2024-09-21T04:05:23.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.138+0000 7fbb46ae2740 1 --2- 172.21.15.46:0/1174082119 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55d3146799f0 0x55d314a84270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:23.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.138+0000 7fbb46ae2740 4 client.16929 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:05:23.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.138+0000 7fbb46ae2740 1 -- 172.21.15.46:0/1174082119 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3149dada0 con 0x55d3146799f0 2024-09-21T04:05:23.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.138+0000 7fbb3db09640 1 --2- 172.21.15.46:0/1174082119 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55d3146799f0 0x55d314a84270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:23.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.139+0000 7fbb3db09640 1 --2- 172.21.15.46:0/1174082119 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55d3146799f0 0x55d314a84270 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f17b2537d1a83406 server_cookie=a8d0157cc727a5d6 in_seq=0 out_seq=0 2024-09-21T04:05:23.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.139+0000 7fbb21ffb640 10 client.16929 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:05:23.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.140+0000 7fbb21ffb640 1 -- 172.21.15.46:0/1174082119 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d3149dada0 con 0x55d3146799f0 2024-09-21T04:05:23.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.140+0000 7fbb21ffb640 10 client.16929 handle_command_reply: tid=0 2024-09-21T04:05:23.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.140+0000 7fbb46ae2740 1 client.16929 shutdown 2024-09-21T04:05:23.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.140+0000 7fbb46ae2740 1 -- 172.21.15.46:0/1174082119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3146bb070 msgr2=0x55d314a7e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:23.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.140+0000 7fbb46ae2740 1 --2- 172.21.15.46:0/1174082119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3146bb070 0x55d314a7e4f0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fbb30009b10 tx=0x7fbb3000df90 comp rx=0 tx=0).stop 2024-09-21T04:05:23.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.140+0000 7fbb46ae2740 1 -- 172.21.15.46:0/1174082119 shutdown_connections 2024-09-21T04:05:23.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.140+0000 7fbb46ae2740 1 --2- 172.21.15.46:0/1174082119 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55d3146799f0 0x55d314a84270 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:23.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.140+0000 7fbb46ae2740 1 --2- 172.21.15.46:0/1174082119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3146bb070 0x55d314a7e4f0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:23.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.140+0000 7fbb46ae2740 1 --2- 172.21.15.46:0/1174082119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d31469a390 0x55d314a72630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:23.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.140+0000 7fbb46ae2740 1 --2- 172.21.15.46:0/1174082119 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d3146921b0 0x55d314a720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:23.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.140+0000 7fbb46ae2740 1 -- 172.21.15.46:0/1174082119 >> 172.21.15.46:0/1174082119 conn(0x55d3146af460 msgr2=0x55d314a5eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:23.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.140+0000 7fbb21ffb640 0 client.16929 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:05:23.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.140+0000 7fbb46ae2740 1 -- 172.21.15.46:0/1174082119 shutdown_connections 2024-09-21T04:05:23.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.140+0000 7fbb46ae2740 1 -- 172.21.15.46:0/1174082119 wait complete. 2024-09-21T04:05:23.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.140+0000 7fbb46ae2740 20 client.16929 trim_cache size 0 max 16384 2024-09-21T04:05:23.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.158+0000 7fbb46ae2740 1 Processor -- start 2024-09-21T04:05:23.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.158+0000 7fbb46ae2740 1 -- start start 2024-09-21T04:05:23.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.158+0000 7fbb46ae2740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3146921b0 0x55d314a73fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:23.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.158+0000 7fbb46ae2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d31469a390 0x55d314a7e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:23.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.158+0000 7fbb46ae2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d3146bb070 0x55d314a63d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:23.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.158+0000 7fbb46ae2740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fbb381ab3e0 con 0x55d3146921b0 2024-09-21T04:05:23.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.158+0000 7fbb46ae2740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbb381adc40 con 0x55d3146bb070 2024-09-21T04:05:23.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.158+0000 7fbb46ae2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbb381aba30 con 0x55d31469a390 2024-09-21T04:05:23.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.158+0000 7fbb3eb0b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3146921b0 0x55d314a73fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:23.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.158+0000 7fbb3eb0b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3146921b0 0x55d314a73fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50990/0 (socket says 172.21.15.46:50990) 2024-09-21T04:05:23.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.158+0000 7fbb3eb0b640 1 -- 172.21.15.46:0/498104178 learned_addr learned my addr 172.21.15.46:0/498104178 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:05:23.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.158+0000 7fbb3db09640 1 --2- 172.21.15.46:0/498104178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d31469a390 0x55d314a7e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:23.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.158+0000 7fbb3eb0b640 1 -- 172.21.15.46:0/498104178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d31469a390 msgr2=0x55d314a7e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:23.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.158+0000 7fbb3eb0b640 1 --2- 172.21.15.46:0/498104178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d31469a390 0x55d314a7e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:23.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.158+0000 7fbb3eb0b640 1 -- 172.21.15.46:0/498104178 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d3146bb070 msgr2=0x55d314a63d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:23.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.158+0000 7fbb3eb0b640 1 --2- 172.21.15.46:0/498104178 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d3146bb070 0x55d314a63d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:23.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.158+0000 7fbb3eb0b640 1 -- 172.21.15.46:0/498104178 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d314a64d90 con 0x55d3146921b0 2024-09-21T04:05:23.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.159+0000 7fbb3eb0b640 1 --2- 172.21.15.46:0/498104178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3146921b0 0x55d314a73fd0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fbb30009d50 tx=0x7fbb30000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac45dde60cc19462 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:23.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.159+0000 7fbb23fff640 1 -- 172.21.15.46:0/498104178 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3001e070 con 0x55d3146921b0 2024-09-21T04:05:23.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.159+0000 7fbb23fff640 1 -- 172.21.15.46:0/498104178 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb3001f040 con 0x55d3146921b0 2024-09-21T04:05:23.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.159+0000 7fbb23fff640 1 -- 172.21.15.46:0/498104178 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3002aca0 con 0x55d3146921b0 2024-09-21T04:05:23.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.159+0000 7fbb46ae2740 1 -- 172.21.15.46:0/498104178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3146921b0 msgr2=0x55d314a73fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:23.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.159+0000 7fbb46ae2740 1 --2- 172.21.15.46:0/498104178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3146921b0 0x55d314a73fd0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fbb30009d50 tx=0x7fbb30000f40 comp rx=0 tx=0).stop 2024-09-21T04:05:23.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.160+0000 7fbb46ae2740 1 -- 172.21.15.46:0/498104178 shutdown_connections 2024-09-21T04:05:23.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.160+0000 7fbb46ae2740 1 --2- 172.21.15.46:0/498104178 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d3146bb070 0x55d314a63d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:23.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.160+0000 7fbb46ae2740 1 --2- 172.21.15.46:0/498104178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d31469a390 0x55d314a7e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:23.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.160+0000 7fbb46ae2740 1 --2- 172.21.15.46:0/498104178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3146921b0 0x55d314a73fd0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:23.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.160+0000 7fbb46ae2740 1 -- 172.21.15.46:0/498104178 >> 172.21.15.46:0/498104178 conn(0x55d3146af460 msgr2=0x55d314a63680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:23.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.160+0000 7fbb46ae2740 1 -- 172.21.15.46:0/498104178 shutdown_connections 2024-09-21T04:05:23.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.160+0000 7fbb46ae2740 1 -- 172.21.15.46:0/498104178 wait complete. 2024-09-21T04:05:23.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.160+0000 7fbb46ae2740 1 -- start start 2024-09-21T04:05:23.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.160+0000 7fbb46ae2740 1 Processor -- start 2024-09-21T04:05:23.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.160+0000 7fbb46ae2740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3146921b0 0x55d314a7aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:23.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.160+0000 7fbb46ae2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d31469a390 0x55d314a75f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:23.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.160+0000 7fbb46ae2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3146bb070 0x55d314a764d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:23.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.160+0000 7fbb46ae2740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fbb381ac100 con 0x55d3146921b0 2024-09-21T04:05:23.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.160+0000 7fbb46ae2740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbb381ad570 con 0x55d31469a390 2024-09-21T04:05:23.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.160+0000 7fbb46ae2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbb381ac7d0 con 0x55d3146bb070 2024-09-21T04:05:23.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.160+0000 7fbb46ae2740 10 client.0 _ll_register_callbacks cb 0x7fbb3410b680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:05:23.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.161+0000 7fbb3eb0b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3146921b0 0x55d314a7aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:23.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.161+0000 7fbb3eb0b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3146921b0 0x55d314a7aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51004/0 (socket says 172.21.15.46:51004) 2024-09-21T04:05:23.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.161+0000 7fbb3eb0b640 1 -- 172.21.15.46:0/844329452 learned_addr learned my addr 172.21.15.46:0/844329452 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:05:23.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.161+0000 7fbb3db09640 1 --2- 172.21.15.46:0/844329452 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d31469a390 0x55d314a75f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:23.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.161+0000 7fbb3eb0b640 1 --2- 172.21.15.46:0/844329452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3146bb070 0x55d314a764d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:23.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.161+0000 7fbb3eb0b640 1 -- 172.21.15.46:0/844329452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3146bb070 msgr2=0x55d314a764d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:23.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.161+0000 7fbb3eb0b640 1 --2- 172.21.15.46:0/844329452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3146bb070 0x55d314a764d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:23.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.161+0000 7fbb3eb0b640 1 -- 172.21.15.46:0/844329452 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d31469a390 msgr2=0x55d314a75f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:23.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.161+0000 7fbb3eb0b640 1 --2- 172.21.15.46:0/844329452 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d31469a390 0x55d314a75f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:23.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.161+0000 7fbb3eb0b640 1 -- 172.21.15.46:0/844329452 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d314a76b10 con 0x55d3146921b0 2024-09-21T04:05:23.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.161+0000 7fbb3eb0b640 1 --2- 172.21.15.46:0/844329452 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3146921b0 0x55d314a7aae0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fbb30010f40 tx=0x7fbb3000de60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f55bb49cd9f25a32 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:23.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.161+0000 7fbb21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:05:23.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.161+0000 7fbb21ffb640 1 -- 172.21.15.46:0/844329452 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3001e050 con 0x55d3146921b0 2024-09-21T04:05:23.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.161+0000 7fbb21ffb640 1 -- 172.21.15.46:0/844329452 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fbb3003e040 con 0x55d3146921b0 2024-09-21T04:05:23.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.161+0000 7fbb46ae2740 1 -- 172.21.15.46:0/844329452 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb3001f040 con 0x55d3146921b0 2024-09-21T04:05:23.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.162+0000 7fbb21ffb640 1 -- 172.21.15.46:0/844329452 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fbb3004a050 con 0x55d3146921b0 2024-09-21T04:05:23.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.162+0000 7fbb46ae2740 10 client.16935 fetch_fsmap learned FSMap version 20 2024-09-21T04:05:23.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.162+0000 7fbb46ae2740 1 -- 172.21.15.46:0/844329452 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55d314aee8d0 con 0x55d3146921b0 2024-09-21T04:05:23.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.162+0000 7fbb21ffb640 1 -- 172.21.15.46:0/844329452 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb3001f040 con 0x55d3146921b0 2024-09-21T04:05:23.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.162+0000 7fbb21ffb640 1 -- 172.21.15.46:0/844329452 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fbb3002acb0 con 0x55d3146921b0 2024-09-21T04:05:23.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.162+0000 7fbb46ae2740 10 client.16935 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:05:23.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.162+0000 7fbb46ae2740 10 client.16935 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:05:23.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.162+0000 7fbb46ae2740 20 client.16935 populate_metadata read hostname 'smithi046' 2024-09-21T04:05:23.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.162+0000 7fbb46ae2740 1 --2- 172.21.15.46:0/844329452 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55d31464eda0 0x55d314af0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:23.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.162+0000 7fbb46ae2740 4 client.16935 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T04:05:23.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.162+0000 7fbb46ae2740 1 -- 172.21.15.46:0/844329452 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d3149d6850 con 0x55d31464eda0 2024-09-21T04:05:23.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.162+0000 7fbb3db09640 1 --2- 172.21.15.46:0/844329452 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55d31464eda0 0x55d314af0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:23.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.163+0000 7fbb3db09640 1 --2- 172.21.15.46:0/844329452 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55d31464eda0 0x55d314af0f70 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=943c55b1b94d3f0d server_cookie=f53e5d7acde0c440 in_seq=0 out_seq=0 2024-09-21T04:05:23.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.163+0000 7fbb21ffb640 10 client.16935 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:05:23.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.163+0000 7fbb21ffb640 1 -- 172.21.15.46:0/844329452 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5770 (crc 0 0 0) 0x55d3149d6850 con 0x55d31464eda0 2024-09-21T04:05:23.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.163+0000 7fbb21ffb640 10 client.16935 handle_command_reply: tid=0 2024-09-21T04:05:23.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.163+0000 7fbb46ae2740 1 client.16935 shutdown 2024-09-21T04:05:23.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.163+0000 7fbb46ae2740 1 -- 172.21.15.46:0/844329452 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3146921b0 msgr2=0x55d314a7aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:23.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.163+0000 7fbb46ae2740 1 --2- 172.21.15.46:0/844329452 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3146921b0 0x55d314a7aae0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fbb30010f40 tx=0x7fbb3000de60 comp rx=0 tx=0).stop 2024-09-21T04:05:23.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.163+0000 7fbb46ae2740 1 -- 172.21.15.46:0/844329452 shutdown_connections 2024-09-21T04:05:23.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.163+0000 7fbb46ae2740 1 --2- 172.21.15.46:0/844329452 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x55d31464eda0 0x55d314af0f70 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:23.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.163+0000 7fbb46ae2740 1 --2- 172.21.15.46:0/844329452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d3146bb070 0x55d314a764d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:23.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.163+0000 7fbb46ae2740 1 --2- 172.21.15.46:0/844329452 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d31469a390 0x55d314a75f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:23.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.163+0000 7fbb46ae2740 1 --2- 172.21.15.46:0/844329452 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3146921b0 0x55d314a7aae0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:23.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.163+0000 7fbb46ae2740 1 -- 172.21.15.46:0/844329452 >> 172.21.15.46:0/844329452 conn(0x55d3146af460 msgr2=0x55d314a681b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:23.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.163+0000 7fbb21ffb640 0 client.16935 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:05:23.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.163+0000 7fbb46ae2740 1 -- 172.21.15.46:0/844329452 shutdown_connections 2024-09-21T04:05:23.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.164+0000 7fbb46ae2740 1 -- 172.21.15.46:0/844329452 wait complete. 2024-09-21T04:05:23.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.164+0000 7fbb46ae2740 20 client.16935 trim_cache size 0 max 16384 2024-09-21T04:05:23.172 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T04:05:23.172 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "no active scrubs running", 2024-09-21T04:05:23.172 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": {}, 2024-09-21T04:05:23.172 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_stats": { 2024-09-21T04:05:23.172 INFO:teuthology.orchestra.run.smithi046.stdout: "37d17ccb-273f-4c50-a691-5064dad9d193": { 2024-09-21T04:05:23.172 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:04:10.480657+0000", 2024-09-21T04:05:23.172 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:05:23.173 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:05:23.173 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:05:23.173 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:05:23.173 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:05:23.173 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:23.173 INFO:teuthology.orchestra.run.smithi046.stdout: "50776be6-bb03-4b39-ad4d-719e50e97356": { 2024-09-21T04:05:23.173 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:04:03.083808+0000", 2024-09-21T04:05:23.173 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:05:23.173 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:05:23.173 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:05:23.173 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:05:23.173 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:05:23.173 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:23.174 INFO:teuthology.orchestra.run.smithi046.stdout: "cfba6404-dc3f-4ad2-b873-926d5f9007de": { 2024-09-21T04:05:23.174 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:03:23.788611+0000", 2024-09-21T04:05:23.174 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:05:23.174 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:05:23.174 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:05:23.174 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:05:23.174 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:05:23.174 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:23.174 INFO:teuthology.orchestra.run.smithi046.stdout: "96aa13fd-aa77-46b5-b20e-a9b203dc7a94": { 2024-09-21T04:05:23.174 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:02:44.727411+0000", 2024-09-21T04:05:23.174 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:05:23.174 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:05:23.175 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:05:23.175 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:05:23.175 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:05:23.175 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:23.175 INFO:teuthology.orchestra.run.smithi046.stdout: "64865e31-a445-43e8-9fa3-26fae089b973": { 2024-09-21T04:05:23.175 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:02:37.376562+0000", 2024-09-21T04:05:23.175 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:05:23.175 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:05:23.175 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:05:23.175 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:05:23.175 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:05:23.175 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:23.175 INFO:teuthology.orchestra.run.smithi046.stdout: "7a3afabe-6b27-4bce-928a-8c6773a85803": { 2024-09-21T04:05:23.176 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:01:58.413358+0000", 2024-09-21T04:05:23.176 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:05:23.176 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:05:23.176 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:05:23.176 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:05:23.176 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:05:23.176 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:23.176 INFO:teuthology.orchestra.run.smithi046.stdout: "08f0c962-df1a-4129-a1a2-b916240d9803": { 2024-09-21T04:05:23.176 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:02.937596+0000", 2024-09-21T04:05:23.176 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:05:23.176 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:05:23.176 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:05:23.176 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:05:23.176 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:05:23.177 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:23.177 INFO:teuthology.orchestra.run.smithi046.stdout: "d49f33a7-3d5a-421b-94ba-8b19a4120db1": { 2024-09-21T04:05:23.177 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:50.480786+0000", 2024-09-21T04:05:23.177 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:05:23.177 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:05:23.177 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:05:23.177 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:05:23.177 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:05:23.177 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:23.177 INFO:teuthology.orchestra.run.smithi046.stdout: "a871f724-0198-493c-b03e-b2de78aba243": { 2024-09-21T04:05:23.177 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:56:30.082991+0000", 2024-09-21T04:05:23.177 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:05:23.177 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:05:23.178 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:05:23.178 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:05:23.178 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:05:23.178 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:23.178 INFO:teuthology.orchestra.run.smithi046.stdout: "edc4b8c7-b702-489d-a925-ae7ad0ff0d9a": { 2024-09-21T04:05:23.178 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:00:40.181950+0000", 2024-09-21T04:05:23.178 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:05:23.178 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:05:23.178 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:05:23.178 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:05:23.178 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:05:23.178 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:23.178 INFO:teuthology.orchestra.run.smithi046.stdout: "3bbf7097-70d7-4743-bbce-41465502b35b": { 2024-09-21T04:05:23.178 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:55:10.661441+0000", 2024-09-21T04:05:23.179 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:05:23.179 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:05:23.179 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:05:23.179 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:05:23.179 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:05:23.179 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:23.179 INFO:teuthology.orchestra.run.smithi046.stdout: "e24ec8f1-0d13-478f-9c2c-b51798868ffc": { 2024-09-21T04:05:23.179 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:09.736194+0000", 2024-09-21T04:05:23.179 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:05:23.179 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:05:23.179 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:05:23.179 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:05:23.179 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:05:23.180 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:23.180 INFO:teuthology.orchestra.run.smithi046.stdout: "c47f458a-de5e-4952-a575-a81261953667": { 2024-09-21T04:05:23.180 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:57:48.699411+0000", 2024-09-21T04:05:23.180 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:05:23.180 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:05:23.180 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:05:23.180 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:05:23.180 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:05:23.180 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:23.180 INFO:teuthology.orchestra.run.smithi046.stdout: "6103c660-8e77-4b06-ad6c-bb322c26035a": { 2024-09-21T04:05:23.180 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:35.594467+0000", 2024-09-21T04:05:23.180 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:05:23.180 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:05:23.180 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:05:23.181 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:05:23.181 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:05:23.181 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:23.181 INFO:teuthology.orchestra.run.smithi046.stdout: "46bb5415-6e16-47c6-a1e4-55f9c623ce90": { 2024-09-21T04:05:23.181 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:14.950674+0000", 2024-09-21T04:05:23.181 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:05:23.181 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:05:23.181 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:05:23.181 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:05:23.181 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:05:23.181 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:23.181 INFO:teuthology.orchestra.run.smithi046.stdout: "74b0aad6-c059-48e7-8d5d-3eb1ee2fb7c5": { 2024-09-21T04:05:23.181 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:04:49.777855+0000", 2024-09-21T04:05:23.181 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:05:23.182 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:05:23.182 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:05:23.182 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:05:23.182 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:05:23.182 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:23.182 INFO:teuthology.orchestra.run.smithi046.stdout: "326aaecf-f38a-4946-988a-d83f25556995": { 2024-09-21T04:05:23.182 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:59:54.189884+0000", 2024-09-21T04:05:23.182 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:05:23.182 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:05:23.182 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:05:23.182 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:05:23.182 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:05:23.182 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:23.182 INFO:teuthology.orchestra.run.smithi046.stdout: "dab67652-8894-4711-be64-cbdfea27a9ba": { 2024-09-21T04:05:23.183 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T03:58:28.161616+0000", 2024-09-21T04:05:23.183 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:05:23.183 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:05:23.183 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:05:23.183 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:05:23.183 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:05:23.183 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:23.183 INFO:teuthology.orchestra.run.smithi046.stdout: "0d781b95-cf5e-46f2-9875-2923181385e2": { 2024-09-21T04:05:23.183 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:00:33.099094+0000", 2024-09-21T04:05:23.183 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:05:23.183 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:05:23.183 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:05:23.184 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:05:23.184 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:05:23.184 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:23.184 INFO:teuthology.orchestra.run.smithi046.stdout: "d7634007-e881-46f7-9833-ac9bd0a3100e": { 2024-09-21T04:05:23.184 INFO:teuthology.orchestra.run.smithi046.stdout: "start_time": "2024-09-21T04:01:19.459151+0000", 2024-09-21T04:05:23.184 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-21T04:05:23.184 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_started": 0, 2024-09-21T04:05:23.184 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_passed": 0, 2024-09-21T04:05:23.184 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_failed": 0, 2024-09-21T04:05:23.184 INFO:teuthology.orchestra.run.smithi046.stdout: "uninline_skipped": 0 2024-09-21T04:05:23.184 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:23.184 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:23.184 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T04:05:23.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.164+0000 7fbb4056e640 1 -- 172.21.15.46:0/2417119288 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fbb240b6680 msgr2=0x7fbb240b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:23.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.164+0000 7fbb4056e640 1 --2- 172.21.15.46:0/2417119288 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fbb240b6680 0x7fbb240b8b90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbb341054d0 tx=0x7fbb3410b7b0 comp rx=0 tx=0).stop 2024-09-21T04:05:23.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.164+0000 7fbb4056e640 1 -- 172.21.15.46:0/2417119288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb381020c0 msgr2=0x7fbb3819a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:23.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.164+0000 7fbb4056e640 1 --2- 172.21.15.46:0/2417119288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb381020c0 0x7fbb3819a4d0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fbb34005940 tx=0x7fbb340042f0 comp rx=0 tx=0).stop 2024-09-21T04:05:23.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.164+0000 7fbb4056e640 1 -- 172.21.15.46:0/2417119288 shutdown_connections 2024-09-21T04:05:23.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.164+0000 7fbb4056e640 1 --2- 172.21.15.46:0/2417119288 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb38106c00 0x7fbb3819fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:23.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.164+0000 7fbb4056e640 1 --2- 172.21.15.46:0/2417119288 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fbb240b6680 0x7fbb240b8b90 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:23.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.164+0000 7fbb4056e640 1 --2- 172.21.15.46:0/2417119288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb381062b0 0x7fbb3819aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:23.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.164+0000 7fbb4056e640 1 --2- 172.21.15.46:0/2417119288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb381020c0 0x7fbb3819a4d0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:23.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.164+0000 7fbb4056e640 1 -- 172.21.15.46:0/2417119288 >> 172.21.15.46:0/2417119288 conn(0x7fbb38079e40 msgr2=0x7fbb381080c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:23.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.164+0000 7fbb4056e640 1 -- 172.21.15.46:0/2417119288 shutdown_connections 2024-09-21T04:05:23.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:23.164+0000 7fbb4056e640 1 -- 172.21.15.46:0/2417119288 wait complete. 2024-09-21T04:05:23.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:23 smithi046 ceph-mon[30954]: pgmap v636: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 2 op/s 2024-09-21T04:05:23.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:23 smithi105 ceph-mon[34773]: pgmap v636: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 2 op/s 2024-09-21T04:05:23.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:23 smithi162 ceph-mon[35071]: pgmap v636: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 2 op/s 2024-09-21T04:05:24.067 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T04:05:24.068 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:05:24.332 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:05:24.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.835+0000 7fccd2582640 1 -- 172.21.15.46:0/3844646515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcccc104860 msgr2=0x7fcccc104c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:24.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.835+0000 7fccd2582640 1 --2- 172.21.15.46:0/3844646515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcccc104860 0x7fcccc104c70 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fccbc009900 tx=0x7fccbc02a410 comp rx=0 tx=0).stop 2024-09-21T04:05:24.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.835+0000 7fccd2582640 1 -- 172.21.15.46:0/3844646515 shutdown_connections 2024-09-21T04:05:24.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.835+0000 7fccd2582640 1 --2- 172.21.15.46:0/3844646515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcccc10de10 0x7fcccc1102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:24.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.835+0000 7fccd2582640 1 --2- 172.21.15.46:0/3844646515 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcccc105290 0x7fcccc10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:24.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.835+0000 7fccd2582640 1 --2- 172.21.15.46:0/3844646515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcccc104860 0x7fcccc104c70 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:24.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.835+0000 7fccd2582640 1 -- 172.21.15.46:0/3844646515 >> 172.21.15.46:0/3844646515 conn(0x7fcccc079730 msgr2=0x7fcccc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:24.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.835+0000 7fccd2582640 1 -- 172.21.15.46:0/3844646515 shutdown_connections 2024-09-21T04:05:24.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.835+0000 7fccd2582640 1 -- 172.21.15.46:0/3844646515 wait complete. 2024-09-21T04:05:24.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.836+0000 7fccd2582640 1 Processor -- start 2024-09-21T04:05:24.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.836+0000 7fccd2582640 1 -- start start 2024-09-21T04:05:24.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.836+0000 7fccd2582640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcccc104860 0x7fcccc102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:24.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.836+0000 7fccd2582640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcccc105290 0x7fcccc102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:24.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.836+0000 7fccd2582640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcccc10de10 0x7fcccc1031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:24.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.836+0000 7fccd2582640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc113ae0 con 0x7fcccc105290 2024-09-21T04:05:24.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.836+0000 7fccd2582640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc113960 con 0x7fcccc10de10 2024-09-21T04:05:24.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.836+0000 7fccd2582640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc113c60 con 0x7fcccc104860 2024-09-21T04:05:24.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.836+0000 7fcccb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcccc105290 0x7fcccc102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:24.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.836+0000 7fcccb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcccc105290 0x7fcccc102cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51008/0 (socket says 172.21.15.46:51008) 2024-09-21T04:05:24.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.836+0000 7fcccb7fe640 1 -- 172.21.15.46:0/914335589 learned_addr learned my addr 172.21.15.46:0/914335589 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:05:24.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.836+0000 7fcccbfff640 1 --2- 172.21.15.46:0/914335589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcccc104860 0x7fcccc102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:24.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.837+0000 7fccd0b1f640 1 --2- 172.21.15.46:0/914335589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcccc10de10 0x7fcccc1031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:24.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.837+0000 7fcccb7fe640 1 -- 172.21.15.46:0/914335589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcccc104860 msgr2=0x7fcccc102770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:24.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.837+0000 7fcccb7fe640 1 --2- 172.21.15.46:0/914335589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcccc104860 0x7fcccc102770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:24.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.837+0000 7fcccb7fe640 1 -- 172.21.15.46:0/914335589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcccc10de10 msgr2=0x7fcccc1031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:24.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.837+0000 7fcccb7fe640 1 --2- 172.21.15.46:0/914335589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcccc10de10 0x7fcccc1031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:24.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.837+0000 7fcccb7fe640 1 -- 172.21.15.46:0/914335589 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcccc1a8810 con 0x7fcccc105290 2024-09-21T04:05:24.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.837+0000 7fcccb7fe640 1 --2- 172.21.15.46:0/914335589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcccc105290 0x7fcccc102cb0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fccc000c970 tx=0x7fccc000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:24.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.837+0000 7fccc97fa640 1 -- 172.21.15.46:0/914335589 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc0007bb0 con 0x7fcccc105290 2024-09-21T04:05:24.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.837+0000 7fccd2582640 1 -- 172.21.15.46:0/914335589 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcccc1a8b00 con 0x7fcccc105290 2024-09-21T04:05:24.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.837+0000 7fccc97fa640 1 -- 172.21.15.46:0/914335589 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccc0007d50 con 0x7fcccc105290 2024-09-21T04:05:24.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.837+0000 7fccc97fa640 1 -- 172.21.15.46:0/914335589 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc0004e10 con 0x7fcccc105290 2024-09-21T04:05:24.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.837+0000 7fccd2582640 1 -- 172.21.15.46:0/914335589 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcccc1a9090 con 0x7fcccc105290 2024-09-21T04:05:24.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.838+0000 7fccd2582640 1 -- 172.21.15.46:0/914335589 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcccc104c70 con 0x7fcccc105290 2024-09-21T04:05:24.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.840+0000 7fccc97fa640 1 -- 172.21.15.46:0/914335589 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7fccc0004fb0 con 0x7fcccc105290 2024-09-21T04:05:24.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.841+0000 7fccc97fa640 1 --2- 172.21.15.46:0/914335589 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fccb40b6680 0x7fccb40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:24.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.841+0000 7fcccbfff640 1 --2- 172.21.15.46:0/914335589 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fccb40b6680 0x7fccb40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:24.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.841+0000 7fccc97fa640 1 -- 172.21.15.46:0/914335589 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fccc00e7810 con 0x7fcccc105290 2024-09-21T04:05:24.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.841+0000 7fcccbfff640 1 --2- 172.21.15.46:0/914335589 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fccb40b6680 0x7fccb40b8b90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fccbc000c00 tx=0x7fccbc031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:24.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:24.844+0000 7fccc97fa640 1 -- 172.21.15.46:0/914335589 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fccc0014030 con 0x7fcccc105290 2024-09-21T04:05:25.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:25.069+0000 7fccd2582640 1 -- 172.21.15.46:0/914335589 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcccc103a70 con 0x7fcccc105290 2024-09-21T04:05:25.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:25.069+0000 7fccc97fa640 1 -- 172.21.15.46:0/914335589 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7fcccc103a70 con 0x7fcccc105290 2024-09-21T04:05:25.072 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T04:05:25.072 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"btime":"2024-09-21T03:53:23:865820+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1766354184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1766354184},{"type":"v1","addr":"172.21.15.46:6839","nonce":1766354184}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/1901774207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":1901774207},{"type":"v1","addr":"172.21.15.46:6841","nonce":1901774207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3548633196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":3548633196},{"type":"v1","addr":"172.21.15.105:6837","nonce":3548633196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24652,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3551934241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3551934241},{"type":"v1","addr":"172.21.15.162:6835","nonce":3551934241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/48949822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":48949822},{"type":"v1","addr":"172.21.15.162:6837","nonce":48949822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:53:14.452819+0000","modified":"2024-09-21T03:53:23.593278+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24680},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/2196053213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2196053213},{"type":"v1","addr":"172.21.15.162:6839","nonce":2196053213}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.105:6839/3911438406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":3911438406},{"type":"v1","addr":"172.21.15.105:6839","nonce":3911438406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24680,"qdb_cluster":[24680]},"id":1}]} 2024-09-21T04:05:25.072 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T04:05:25.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:25.072+0000 7fccd2582640 1 -- 172.21.15.46:0/914335589 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fccb40b6680 msgr2=0x7fccb40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:25.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:25.072+0000 7fccd2582640 1 --2- 172.21.15.46:0/914335589 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fccb40b6680 0x7fccb40b8b90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fccbc000c00 tx=0x7fccbc031400 comp rx=0 tx=0).stop 2024-09-21T04:05:25.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:25.072+0000 7fccd2582640 1 -- 172.21.15.46:0/914335589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcccc105290 msgr2=0x7fcccc102cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:25.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:25.072+0000 7fccd2582640 1 --2- 172.21.15.46:0/914335589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcccc105290 0x7fcccc102cb0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fccc000c970 tx=0x7fccc000ce30 comp rx=0 tx=0).stop 2024-09-21T04:05:25.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:25.072+0000 7fccd2582640 1 -- 172.21.15.46:0/914335589 shutdown_connections 2024-09-21T04:05:25.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:25.072+0000 7fccd2582640 1 --2- 172.21.15.46:0/914335589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcccc10de10 0x7fcccc1031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:25.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:25.072+0000 7fccd2582640 1 --2- 172.21.15.46:0/914335589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcccc105290 0x7fcccc102cb0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:25.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:25.072+0000 7fccd2582640 1 --2- 172.21.15.46:0/914335589 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fccb40b6680 0x7fccb40b8b90 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:25.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:25.072+0000 7fccd2582640 1 --2- 172.21.15.46:0/914335589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcccc104860 0x7fcccc102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:25.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:25.072+0000 7fccd2582640 1 -- 172.21.15.46:0/914335589 >> 172.21.15.46:0/914335589 conn(0x7fcccc079730 msgr2=0x7fcccc1007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:25.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:25.072+0000 7fccd2582640 1 -- 172.21.15.46:0/914335589 shutdown_connections 2024-09-21T04:05:25.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:25.072+0000 7fccd2582640 1 -- 172.21.15.46:0/914335589 wait complete. 2024-09-21T04:05:25.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:25 smithi046 ceph-mon[30954]: pgmap v637: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:05:25.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:25 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/914335589' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:05:25.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:25 smithi105 ceph-mon[34773]: pgmap v637: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:05:25.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:25 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/914335589' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:05:25.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:25 smithi162 ceph-mon[35071]: pgmap v637: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:05:25.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:25 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/914335589' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:05:25.908 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T04:05:26.171 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:05:26.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.765+0000 7ff8117fb640 1 -- 172.21.15.46:0/4193530355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff80c109df0 msgr2=0x7ff80c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:26.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.765+0000 7ff8117fb640 1 --2- 172.21.15.46:0/4193530355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff80c109df0 0x7ff80c110620 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7ff804009ca0 tx=0x7ff80402a8c0 comp rx=0 tx=0).stop 2024-09-21T04:05:26.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.765+0000 7ff8117fb640 1 -- 172.21.15.46:0/4193530355 shutdown_connections 2024-09-21T04:05:26.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.765+0000 7ff8117fb640 1 --2- 172.21.15.46:0/4193530355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff80c109df0 0x7ff80c110620 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:26.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.765+0000 7ff8117fb640 1 --2- 172.21.15.46:0/4193530355 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff80c1094a0 0x7ff80c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:26.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.765+0000 7ff8117fb640 1 --2- 172.21.15.46:0/4193530355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff80c103b60 0x7ff80c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:26.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.765+0000 7ff8117fb640 1 -- 172.21.15.46:0/4193530355 >> 172.21.15.46:0/4193530355 conn(0x7ff80c07b850 msgr2=0x7ff80c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:26.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.765+0000 7ff8117fb640 1 -- 172.21.15.46:0/4193530355 shutdown_connections 2024-09-21T04:05:26.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.765+0000 7ff8117fb640 1 -- 172.21.15.46:0/4193530355 wait complete. 2024-09-21T04:05:26.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.766+0000 7ff8117fb640 1 Processor -- start 2024-09-21T04:05:26.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.766+0000 7ff8117fb640 1 -- start start 2024-09-21T04:05:26.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.766+0000 7ff8117fb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff80c103b60 0x7ff80c19a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:26.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.766+0000 7ff8117fb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff80c1094a0 0x7ff80c19aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:26.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.766+0000 7ff8117fb640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff80c109df0 0x7ff80c19fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:26.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.766+0000 7ff8117fb640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff80c113ab0 con 0x7ff80c1094a0 2024-09-21T04:05:26.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.766+0000 7ff8117fb640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff80c113930 con 0x7ff80c103b60 2024-09-21T04:05:26.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.766+0000 7ff8117fb640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff80c113c30 con 0x7ff80c109df0 2024-09-21T04:05:26.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.766+0000 7ff803fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff80c1094a0 0x7ff80c19aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:26.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.767+0000 7ff803fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff80c1094a0 0x7ff80c19aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51024/0 (socket says 172.21.15.46:51024) 2024-09-21T04:05:26.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.767+0000 7ff803fff640 1 -- 172.21.15.46:0/1626957462 learned_addr learned my addr 172.21.15.46:0/1626957462 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:05:26.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.767+0000 7ff80b7fe640 1 --2- 172.21.15.46:0/1626957462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff80c109df0 0x7ff80c19fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:26.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.767+0000 7ff80affd640 1 --2- 172.21.15.46:0/1626957462 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff80c103b60 0x7ff80c19a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:26.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.767+0000 7ff803fff640 1 -- 172.21.15.46:0/1626957462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff80c109df0 msgr2=0x7ff80c19fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:26.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.767+0000 7ff803fff640 1 --2- 172.21.15.46:0/1626957462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff80c109df0 0x7ff80c19fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:26.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.767+0000 7ff803fff640 1 -- 172.21.15.46:0/1626957462 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff80c103b60 msgr2=0x7ff80c19a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:26.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.767+0000 7ff803fff640 1 --2- 172.21.15.46:0/1626957462 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff80c103b60 0x7ff80c19a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:26.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.767+0000 7ff803fff640 1 -- 172.21.15.46:0/1626957462 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff80c1a03d0 con 0x7ff80c1094a0 2024-09-21T04:05:26.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.767+0000 7ff80affd640 1 --2- 172.21.15.46:0/1626957462 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff80c103b60 0x7ff80c19a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:05:26.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.767+0000 7ff803fff640 1 --2- 172.21.15.46:0/1626957462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff80c1094a0 0x7ff80c19aa00 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7ff7f400d750 tx=0x7ff7f400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:26.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.767+0000 7ff808ff9640 1 -- 172.21.15.46:0/1626957462 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f4017070 con 0x7ff80c1094a0 2024-09-21T04:05:26.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.767+0000 7ff808ff9640 1 -- 172.21.15.46:0/1626957462 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7f40054d0 con 0x7ff80c1094a0 2024-09-21T04:05:26.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.767+0000 7ff8117fb640 1 -- 172.21.15.46:0/1626957462 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff80c1a06c0 con 0x7ff80c1094a0 2024-09-21T04:05:26.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.767+0000 7ff808ff9640 1 -- 172.21.15.46:0/1626957462 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f4004c30 con 0x7ff80c1094a0 2024-09-21T04:05:26.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.767+0000 7ff8117fb640 1 -- 172.21.15.46:0/1626957462 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff80c1a6e20 con 0x7ff80c1094a0 2024-09-21T04:05:26.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.770+0000 7ff817d6f740 1 Processor -- start 2024-09-21T04:05:26.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.770+0000 7ff817d6f740 1 -- start start 2024-09-21T04:05:26.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.771+0000 7ff817d6f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c234dc070 0x560c238836a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:26.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.771+0000 7ff817d6f740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c234b31b0 0x560c23883be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:26.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.771+0000 7ff817d6f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c234bb390 0x560c23884120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:26.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.771+0000 7ff817d6f740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x560c237f9ea0 con 0x560c234b31b0 2024-09-21T04:05:26.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.771+0000 7ff817d6f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x560c237e92d0 con 0x560c234dc070 2024-09-21T04:05:26.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.771+0000 7ff817d6f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560c237ed0e0 con 0x560c234bb390 2024-09-21T04:05:26.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.771+0000 7ff808ff9640 1 -- 172.21.15.46:0/1626957462 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7ff7f4004dd0 con 0x7ff80c1094a0 2024-09-21T04:05:26.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.771+0000 7ff80affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c234b31b0 0x560c23883be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:26.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.771+0000 7ff80affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c234b31b0 0x560c23883be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51032/0 (socket says 172.21.15.46:51032) 2024-09-21T04:05:26.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.771+0000 7ff80affd640 1 -- 172.21.15.46:0/3978848026 learned_addr learned my addr 172.21.15.46:0/3978848026 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:05:26.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.771+0000 7ff80b7fe640 1 --2- 172.21.15.46:0/3978848026 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c234dc070 0x560c238836a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:26.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.771+0000 7ff803fff640 1 --2- 172.21.15.46:0/3978848026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c234bb390 0x560c23884120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:26.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.771+0000 7ff80affd640 1 -- 172.21.15.46:0/3978848026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c234bb390 msgr2=0x560c23884120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:26.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.771+0000 7ff80affd640 1 --2- 172.21.15.46:0/3978848026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c234bb390 0x560c23884120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:26.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.771+0000 7ff80affd640 1 -- 172.21.15.46:0/3978848026 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c234dc070 msgr2=0x560c238836a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:26.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.771+0000 7ff80affd640 1 --2- 172.21.15.46:0/3978848026 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c234dc070 0x560c238836a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:26.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.771+0000 7ff80affd640 1 -- 172.21.15.46:0/3978848026 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c23547650 con 0x560c234b31b0 2024-09-21T04:05:26.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.772+0000 7ff80affd640 1 --2- 172.21.15.46:0/3978848026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c234b31b0 0x560c23883be0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc00cca0 tx=0x7ff7fc00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaae74101bd478e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:26.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.772+0000 7ff808ff9640 1 --2- 172.21.15.46:0/1626957462 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff7f80b6680 0x7ff7f80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:26.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.772+0000 7ff8017fa640 1 -- 172.21.15.46:0/3978848026 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc005220 con 0x560c234b31b0 2024-09-21T04:05:26.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.772+0000 7ff8017fa640 1 -- 172.21.15.46:0/3978848026 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7fc004c50 con 0x560c234b31b0 2024-09-21T04:05:26.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.772+0000 7ff8017fa640 1 -- 172.21.15.46:0/3978848026 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc010790 con 0x560c234b31b0 2024-09-21T04:05:26.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.772+0000 7ff80b7fe640 1 --2- 172.21.15.46:0/1626957462 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff7f80b6680 0x7ff7f80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:26.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.772+0000 7ff808ff9640 1 -- 172.21.15.46:0/1626957462 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7ff7f40e70d0 con 0x7ff80c1094a0 2024-09-21T04:05:26.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.773+0000 7ff817d6f740 1 -- 172.21.15.46:0/3978848026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c234b31b0 msgr2=0x560c23883be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:26.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.773+0000 7ff80b7fe640 1 --2- 172.21.15.46:0/1626957462 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff7f80b6680 0x7ff7f80b8b90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff804006010 tx=0x7ff80402f310 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:26.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.773+0000 7ff817d6f740 1 --2- 172.21.15.46:0/3978848026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c234b31b0 0x560c23883be0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc00cca0 tx=0x7ff7fc00e720 comp rx=0 tx=0).stop 2024-09-21T04:05:26.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.773+0000 7ff817d6f740 1 -- 172.21.15.46:0/3978848026 shutdown_connections 2024-09-21T04:05:26.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.773+0000 7ff817d6f740 1 --2- 172.21.15.46:0/3978848026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c234bb390 0x560c23884120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:26.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.773+0000 7ff817d6f740 1 --2- 172.21.15.46:0/3978848026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c234b31b0 0x560c23883be0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:26.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.773+0000 7ff817d6f740 1 --2- 172.21.15.46:0/3978848026 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c234dc070 0x560c238836a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:26.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.773+0000 7ff817d6f740 1 -- 172.21.15.46:0/3978848026 >> 172.21.15.46:0/3978848026 conn(0x560c234d0460 msgr2=0x560c23881590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:26.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.773+0000 7ff817d6f740 1 -- 172.21.15.46:0/3978848026 shutdown_connections 2024-09-21T04:05:26.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.773+0000 7ff817d6f740 1 -- 172.21.15.46:0/3978848026 wait complete. 2024-09-21T04:05:26.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.773+0000 7ff817d6f740 1 -- start start 2024-09-21T04:05:26.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.774+0000 7ff817d6f740 1 Processor -- start 2024-09-21T04:05:26.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.774+0000 7ff817d6f740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c234b31b0 0x560c2388ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:26.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.774+0000 7ff817d6f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c234bb390 0x560c2388f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:26.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.774+0000 7ff817d6f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c234dc070 0x560c2389b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:26.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.774+0000 7ff817d6f740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x560c2364a700 con 0x560c234b31b0 2024-09-21T04:05:26.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.774+0000 7ff817d6f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x560c23784160 con 0x560c234dc070 2024-09-21T04:05:26.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.774+0000 7ff817d6f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560c23891e80 con 0x560c234bb390 2024-09-21T04:05:26.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.774+0000 7ff817d6f740 10 client.0 _ll_register_callbacks cb 0x560c2379d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:05:26.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.774+0000 7ff80affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c234b31b0 0x560c2388ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:26.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.774+0000 7ff80affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c234b31b0 0x560c2388ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51038/0 (socket says 172.21.15.46:51038) 2024-09-21T04:05:26.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.774+0000 7ff80affd640 1 -- 172.21.15.46:0/728304909 learned_addr learned my addr 172.21.15.46:0/728304909 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:05:26.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.774+0000 7ff803fff640 1 --2- 172.21.15.46:0/728304909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c234bb390 0x560c2388f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:26.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.774+0000 7ff80affd640 1 -- 172.21.15.46:0/728304909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c234bb390 msgr2=0x560c2388f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:26.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.774+0000 7ff80affd640 1 --2- 172.21.15.46:0/728304909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c234bb390 0x560c2388f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:26.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.774+0000 7ff80affd640 1 -- 172.21.15.46:0/728304909 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c234dc070 msgr2=0x560c2389b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:26.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.774+0000 7ff80affd640 1 --2- 172.21.15.46:0/728304909 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c234dc070 0x560c2389b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:26.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.774+0000 7ff80affd640 1 -- 172.21.15.46:0/728304909 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c237b1c90 con 0x560c234b31b0 2024-09-21T04:05:26.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.775+0000 7ff80affd640 1 --2- 172.21.15.46:0/728304909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c234b31b0 0x560c2388ed70 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc00ef90 tx=0x7ff7fc00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34fb04ec44152b82 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:26.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.775+0000 7ff7f27fc640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:05:26.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.775+0000 7ff7f27fc640 1 -- 172.21.15.46:0/728304909 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc02a060 con 0x560c234b31b0 2024-09-21T04:05:26.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.775+0000 7ff7f27fc640 1 -- 172.21.15.46:0/728304909 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7ff7fc005010 con 0x560c234b31b0 2024-09-21T04:05:26.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.775+0000 7ff817d6f740 1 -- 172.21.15.46:0/728304909 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7fc004c50 con 0x560c234b31b0 2024-09-21T04:05:26.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.775+0000 7ff7f27fc640 1 -- 172.21.15.46:0/728304909 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff7fc004aa0 con 0x560c234b31b0 2024-09-21T04:05:26.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.775+0000 7ff817d6f740 10 client.16953 fetch_fsmap learned FSMap version 20 2024-09-21T04:05:26.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.775+0000 7ff817d6f740 1 -- 172.21.15.46:0/728304909 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560c2389db80 con 0x560c234b31b0 2024-09-21T04:05:26.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.775+0000 7ff7f27fc640 1 -- 172.21.15.46:0/728304909 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7fc004c50 con 0x560c234b31b0 2024-09-21T04:05:26.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.775+0000 7ff7f27fc640 1 -- 172.21.15.46:0/728304909 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff7fc02d030 con 0x560c234b31b0 2024-09-21T04:05:26.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.776+0000 7ff817d6f740 10 client.16953 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:05:26.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.776+0000 7ff817d6f740 10 client.16953 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:05:26.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.776+0000 7ff817d6f740 20 client.16953 populate_metadata read hostname 'smithi046' 2024-09-21T04:05:26.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.776+0000 7ff817d6f740 1 --2- 172.21.15.46:0/728304909 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560c2349a9f0 0x560c238a0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:26.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.776+0000 7ff817d6f740 4 client.16953 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:05:26.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.776+0000 7ff817d6f740 1 -- 172.21.15.46:0/728304909 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c237fbdf0 con 0x560c2349a9f0 2024-09-21T04:05:26.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.776+0000 7ff803fff640 1 --2- 172.21.15.46:0/728304909 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560c2349a9f0 0x560c238a0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:26.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.776+0000 7ff803fff640 1 --2- 172.21.15.46:0/728304909 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560c2349a9f0 0x560c238a0f90 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1cc9465bd12fc9c6 server_cookie=48d9c861007ee05d in_seq=0 out_seq=0 2024-09-21T04:05:26.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.776+0000 7ff7f27fc640 10 client.16953 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:05:26.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.777+0000 7ff7f27fc640 1 -- 172.21.15.46:0/728304909 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560c237fbdf0 con 0x560c2349a9f0 2024-09-21T04:05:26.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.777+0000 7ff7f27fc640 10 client.16953 handle_command_reply: tid=0 2024-09-21T04:05:26.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.777+0000 7ff817d6f740 1 client.16953 shutdown 2024-09-21T04:05:26.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.777+0000 7ff817d6f740 1 -- 172.21.15.46:0/728304909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c234b31b0 msgr2=0x560c2388ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:26.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.777+0000 7ff817d6f740 1 --2- 172.21.15.46:0/728304909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c234b31b0 0x560c2388ed70 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc00ef90 tx=0x7ff7fc00c9e0 comp rx=0 tx=0).stop 2024-09-21T04:05:26.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.777+0000 7ff817d6f740 1 -- 172.21.15.46:0/728304909 shutdown_connections 2024-09-21T04:05:26.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.777+0000 7ff817d6f740 1 --2- 172.21.15.46:0/728304909 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560c2349a9f0 0x560c238a0f90 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:26.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.777+0000 7ff817d6f740 1 --2- 172.21.15.46:0/728304909 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c234dc070 0x560c2389b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:26.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.777+0000 7ff817d6f740 1 --2- 172.21.15.46:0/728304909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c234bb390 0x560c2388f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:26.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.777+0000 7ff817d6f740 1 --2- 172.21.15.46:0/728304909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c234b31b0 0x560c2388ed70 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:26.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.777+0000 7ff817d6f740 1 -- 172.21.15.46:0/728304909 >> 172.21.15.46:0/728304909 conn(0x560c234d0460 msgr2=0x560c23886830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:26.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.777+0000 7ff7f27fc640 0 client.16953 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:05:26.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.778+0000 7ff817d6f740 1 -- 172.21.15.46:0/728304909 shutdown_connections 2024-09-21T04:05:26.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.778+0000 7ff817d6f740 1 -- 172.21.15.46:0/728304909 wait complete. 2024-09-21T04:05:26.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.778+0000 7ff817d6f740 20 client.16953 trim_cache size 0 max 16384 2024-09-21T04:05:26.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.791+0000 7ff817d6f740 1 Processor -- start 2024-09-21T04:05:26.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.791+0000 7ff817d6f740 1 -- start start 2024-09-21T04:05:26.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.791+0000 7ff817d6f740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c234b31b0 0x560c2388f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:26.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.791+0000 7ff817d6f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c234bb390 0x560c2389b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:26.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.791+0000 7ff817d6f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c234dc070 0x560c2388bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:26.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.791+0000 7ff817d6f740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff80c1ad570 con 0x560c234b31b0 2024-09-21T04:05:26.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.791+0000 7ff817d6f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff80c1afdd0 con 0x560c234dc070 2024-09-21T04:05:26.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.791+0000 7ff817d6f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff80c1adbc0 con 0x560c234bb390 2024-09-21T04:05:26.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.791+0000 7ff80affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c234b31b0 0x560c2388f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:26.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.791+0000 7ff80affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c234b31b0 0x560c2388f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51052/0 (socket says 172.21.15.46:51052) 2024-09-21T04:05:26.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.791+0000 7ff80affd640 1 -- 172.21.15.46:0/1905972113 learned_addr learned my addr 172.21.15.46:0/1905972113 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:05:26.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.792+0000 7ff80b7fe640 1 --2- 172.21.15.46:0/1905972113 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c234dc070 0x560c2388bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:26.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.792+0000 7ff803fff640 1 --2- 172.21.15.46:0/1905972113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c234bb390 0x560c2389b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:26.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.792+0000 7ff80affd640 1 -- 172.21.15.46:0/1905972113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c234bb390 msgr2=0x560c2389b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:26.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.792+0000 7ff80affd640 1 --2- 172.21.15.46:0/1905972113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c234bb390 0x560c2389b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:26.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.792+0000 7ff80affd640 1 -- 172.21.15.46:0/1905972113 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c234dc070 msgr2=0x560c2388bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:26.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.792+0000 7ff80affd640 1 --2- 172.21.15.46:0/1905972113 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c234dc070 0x560c2388bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:26.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.792+0000 7ff80affd640 1 -- 172.21.15.46:0/1905972113 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c23890030 con 0x560c234b31b0 2024-09-21T04:05:26.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.792+0000 7ff80affd640 1 --2- 172.21.15.46:0/1905972113 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c234b31b0 0x560c2388f230 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc005690 tx=0x7ff7fc005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a631a8b576a179 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:26.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.792+0000 7ff800ff9640 1 -- 172.21.15.46:0/1905972113 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc025880 con 0x560c234b31b0 2024-09-21T04:05:26.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.792+0000 7ff800ff9640 1 -- 172.21.15.46:0/1905972113 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7fc0049d0 con 0x560c234b31b0 2024-09-21T04:05:26.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.792+0000 7ff800ff9640 1 -- 172.21.15.46:0/1905972113 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc010700 con 0x560c234b31b0 2024-09-21T04:05:26.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.793+0000 7ff817d6f740 1 -- 172.21.15.46:0/1905972113 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c234b31b0 msgr2=0x560c2388f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:26.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.793+0000 7ff817d6f740 1 --2- 172.21.15.46:0/1905972113 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c234b31b0 0x560c2388f230 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc005690 tx=0x7ff7fc005a10 comp rx=0 tx=0).stop 2024-09-21T04:05:26.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.793+0000 7ff817d6f740 1 -- 172.21.15.46:0/1905972113 shutdown_connections 2024-09-21T04:05:26.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.793+0000 7ff817d6f740 1 --2- 172.21.15.46:0/1905972113 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c234dc070 0x560c2388bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:26.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.793+0000 7ff817d6f740 1 --2- 172.21.15.46:0/1905972113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c234bb390 0x560c2389b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:26.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.793+0000 7ff817d6f740 1 --2- 172.21.15.46:0/1905972113 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c234b31b0 0x560c2388f230 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:26.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.793+0000 7ff817d6f740 1 -- 172.21.15.46:0/1905972113 >> 172.21.15.46:0/1905972113 conn(0x560c234d0460 msgr2=0x560c2388eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:26.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.793+0000 7ff817d6f740 1 -- 172.21.15.46:0/1905972113 shutdown_connections 2024-09-21T04:05:26.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.793+0000 7ff817d6f740 1 -- 172.21.15.46:0/1905972113 wait complete. 2024-09-21T04:05:26.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.794+0000 7ff817d6f740 1 -- start start 2024-09-21T04:05:26.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.794+0000 7ff817d6f740 1 Processor -- start 2024-09-21T04:05:26.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.794+0000 7ff817d6f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c234b31b0 0x560c238975e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:26.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.794+0000 7ff817d6f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c234bb390 0x560c23892a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:26.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.794+0000 7ff817d6f740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c234dc070 0x560c23892fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:26.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.794+0000 7ff817d6f740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff80c1ae290 con 0x560c234dc070 2024-09-21T04:05:26.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.794+0000 7ff817d6f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff80c1af700 con 0x560c234bb390 2024-09-21T04:05:26.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.794+0000 7ff817d6f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff80c1ae960 con 0x560c234b31b0 2024-09-21T04:05:26.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.794+0000 7ff817d6f740 10 client.0 _ll_register_callbacks cb 0x7ff7fc014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:05:26.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.794+0000 7ff80b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c234dc070 0x560c23892fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:26.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.794+0000 7ff80b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c234dc070 0x560c23892fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51060/0 (socket says 172.21.15.46:51060) 2024-09-21T04:05:26.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.794+0000 7ff80b7fe640 1 -- 172.21.15.46:0/4208292223 learned_addr learned my addr 172.21.15.46:0/4208292223 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:05:26.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.794+0000 7ff80affd640 1 --2- 172.21.15.46:0/4208292223 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c234b31b0 0x560c238975e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:26.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.794+0000 7ff803fff640 1 --2- 172.21.15.46:0/4208292223 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c234bb390 0x560c23892a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:26.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.795+0000 7ff80b7fe640 1 -- 172.21.15.46:0/4208292223 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c234b31b0 msgr2=0x560c238975e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:26.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.795+0000 7ff80b7fe640 1 --2- 172.21.15.46:0/4208292223 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c234b31b0 0x560c238975e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:26.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.795+0000 7ff80b7fe640 1 -- 172.21.15.46:0/4208292223 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c234bb390 msgr2=0x560c23892a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:26.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.795+0000 7ff80b7fe640 1 --2- 172.21.15.46:0/4208292223 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c234bb390 0x560c23892a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:26.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.795+0000 7ff80b7fe640 1 -- 172.21.15.46:0/4208292223 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c23893510 con 0x560c234dc070 2024-09-21T04:05:26.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.795+0000 7ff80b7fe640 1 --2- 172.21.15.46:0/4208292223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c234dc070 0x560c23892fd0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7ff804035000 tx=0x7ff804031660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f780f8608a7b8e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:26.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.795+0000 7ff7f27fc640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-21T04:05:26.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.795+0000 7ff7f27fc640 1 -- 172.21.15.46:0/4208292223 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff804004040 con 0x560c234dc070 2024-09-21T04:05:26.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.795+0000 7ff7f27fc640 1 -- 172.21.15.46:0/4208292223 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7ff804042030 con 0x560c234dc070 2024-09-21T04:05:26.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.795+0000 7ff817d6f740 1 -- 172.21.15.46:0/4208292223 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7fc0049d0 con 0x560c234dc070 2024-09-21T04:05:26.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.795+0000 7ff7f27fc640 1 -- 172.21.15.46:0/4208292223 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff8040041e0 con 0x560c234dc070 2024-09-21T04:05:26.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.795+0000 7ff817d6f740 10 client.16959 fetch_fsmap learned FSMap version 20 2024-09-21T04:05:26.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.795+0000 7ff817d6f740 1 -- 172.21.15.46:0/4208292223 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560c2390b370 con 0x560c234dc070 2024-09-21T04:05:26.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.796+0000 7ff7f27fc640 1 -- 172.21.15.46:0/4208292223 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7fc0049d0 con 0x560c234dc070 2024-09-21T04:05:26.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.796+0000 7ff7f27fc640 1 -- 172.21.15.46:0/4208292223 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff80402faa0 con 0x560c234dc070 2024-09-21T04:05:26.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.796+0000 7ff817d6f740 10 client.16959 fetch_fsmap finished waiting for FSMap version 20 2024-09-21T04:05:26.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.796+0000 7ff817d6f740 10 client.16959 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T04:05:26.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.796+0000 7ff817d6f740 20 client.16959 populate_metadata read hostname 'smithi046' 2024-09-21T04:05:26.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.796+0000 7ff817d6f740 1 --2- 172.21.15.46:0/4208292223 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560c2346fda0 0x560c2390db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:26.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.796+0000 7ff817d6f740 4 client.16959 mds_command: new command op to 24680 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T04:05:26.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.796+0000 7ff817d6f740 1 -- 172.21.15.46:0/4208292223 --> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560c237f78a0 con 0x560c2346fda0 2024-09-21T04:05:26.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.796+0000 7ff80affd640 1 --2- 172.21.15.46:0/4208292223 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560c2346fda0 0x560c2390db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:26.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.797+0000 7ff80affd640 1 --2- 172.21.15.46:0/4208292223 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560c2346fda0 0x560c2390db90 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ced86d1b0a67bf77 server_cookie=e90e3feb28d77c1f in_seq=0 out_seq=0 2024-09-21T04:05:26.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.797+0000 7ff7f27fc640 10 client.16959 ms_handle_connect on v2:172.21.15.105:6838/3911438406 2024-09-21T04:05:26.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.797+0000 7ff7f27fc640 1 -- 172.21.15.46:0/4208292223 <== mds.0 v2:172.21.15.105:6838/3911438406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560c237f78a0 con 0x560c2346fda0 2024-09-21T04:05:26.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.797+0000 7ff7f27fc640 10 client.16959 handle_command_reply: tid=0 2024-09-21T04:05:26.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.797+0000 7ff817d6f740 1 client.16959 shutdown 2024-09-21T04:05:26.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.797+0000 7ff817d6f740 1 -- 172.21.15.46:0/4208292223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c234dc070 msgr2=0x560c23892fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:26.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.797+0000 7ff817d6f740 1 --2- 172.21.15.46:0/4208292223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c234dc070 0x560c23892fd0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7ff804035000 tx=0x7ff804031660 comp rx=0 tx=0).stop 2024-09-21T04:05:26.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.797+0000 7ff817d6f740 1 -- 172.21.15.46:0/4208292223 shutdown_connections 2024-09-21T04:05:26.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.797+0000 7ff817d6f740 1 --2- 172.21.15.46:0/4208292223 >> [v2:172.21.15.105:6838/3911438406,v1:172.21.15.105:6839/3911438406] conn(0x560c2346fda0 0x560c2390db90 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:26.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.797+0000 7ff817d6f740 1 --2- 172.21.15.46:0/4208292223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x560c234dc070 0x560c23892fd0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:26.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.797+0000 7ff817d6f740 1 --2- 172.21.15.46:0/4208292223 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c234bb390 0x560c23892a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:26.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.797+0000 7ff7f27fc640 0 client.16959 ms_handle_reset on v2:172.21.15.105:6838/3911438406 2024-09-21T04:05:26.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.797+0000 7ff817d6f740 1 --2- 172.21.15.46:0/4208292223 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560c234b31b0 0x560c238975e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:26.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.797+0000 7ff817d6f740 1 -- 172.21.15.46:0/4208292223 >> 172.21.15.46:0/4208292223 conn(0x560c234d0460 msgr2=0x560c2388d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:26.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.797+0000 7ff817d6f740 1 -- 172.21.15.46:0/4208292223 shutdown_connections 2024-09-21T04:05:26.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.797+0000 7ff817d6f740 1 -- 172.21.15.46:0/4208292223 wait complete. 2024-09-21T04:05:26.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.797+0000 7ff817d6f740 20 client.16959 trim_cache size 0 max 16384 2024-09-21T04:05:26.804 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-21T04:05:26.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.798+0000 7ff8117fb640 1 -- 172.21.15.46:0/1626957462 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff7f80b6680 msgr2=0x7ff7f80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:26.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.798+0000 7ff8117fb640 1 --2- 172.21.15.46:0/1626957462 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff7f80b6680 0x7ff7f80b8b90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff804006010 tx=0x7ff80402f310 comp rx=0 tx=0).stop 2024-09-21T04:05:26.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.798+0000 7ff8117fb640 1 -- 172.21.15.46:0/1626957462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff80c1094a0 msgr2=0x7ff80c19aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:26.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.798+0000 7ff8117fb640 1 --2- 172.21.15.46:0/1626957462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff80c1094a0 0x7ff80c19aa00 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7ff7f400d750 tx=0x7ff7f400dc10 comp rx=0 tx=0).stop 2024-09-21T04:05:26.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.798+0000 7ff8117fb640 1 -- 172.21.15.46:0/1626957462 shutdown_connections 2024-09-21T04:05:26.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.798+0000 7ff8117fb640 1 --2- 172.21.15.46:0/1626957462 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff7f80b6680 0x7ff7f80b8b90 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:26.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.798+0000 7ff8117fb640 1 --2- 172.21.15.46:0/1626957462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff80c109df0 0x7ff80c19fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:26.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.798+0000 7ff8117fb640 1 --2- 172.21.15.46:0/1626957462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff80c1094a0 0x7ff80c19aa00 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:26.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.798+0000 7ff8117fb640 1 --2- 172.21.15.46:0/1626957462 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff80c103b60 0x7ff80c19a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:26.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.798+0000 7ff8117fb640 1 -- 172.21.15.46:0/1626957462 >> 172.21.15.46:0/1626957462 conn(0x7ff80c07b850 msgr2=0x7ff80c1074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:26.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.798+0000 7ff8117fb640 1 -- 172.21.15.46:0/1626957462 shutdown_connections 2024-09-21T04:05:26.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:26.798+0000 7ff8117fb640 1 -- 172.21.15.46:0/1626957462 wait complete. 2024-09-21T04:05:27.572 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/thrasher.py", line 50, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-21T04:05:27.573 INFO:tasks.fwd_scrub:done joining 2024-09-21T04:05:27.573 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-21T04:05:27.583 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T04:05:27.668 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:27 smithi162 ceph-mon[35071]: pgmap v638: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:05:27.668 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:27 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:05:27.679 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:27 smithi105 ceph-mon[34773]: pgmap v638: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:05:27.679 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:27 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:05:27.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.704+0000 7f8274aec640 1 -- 172.21.15.46:0/1967775443 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8270109d60 msgr2=0x7f8270110590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:27.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.704+0000 7f8274aec640 1 --2- 172.21.15.46:0/1967775443 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8270109d60 0x7f8270110590 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f8268009ca0 tx=0x7f826802a8c0 comp rx=0 tx=0).stop 2024-09-21T04:05:27.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.705+0000 7f8274aec640 1 -- 172.21.15.46:0/1967775443 shutdown_connections 2024-09-21T04:05:27.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.705+0000 7f8274aec640 1 --2- 172.21.15.46:0/1967775443 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8270109d60 0x7f8270110590 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:27.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.705+0000 7f8274aec640 1 --2- 172.21.15.46:0/1967775443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8270109410 0x7f8270109820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:27.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.705+0000 7f8274aec640 1 --2- 172.21.15.46:0/1967775443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8270103ae0 0x7f8270103ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:27.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.705+0000 7f8274aec640 1 -- 172.21.15.46:0/1967775443 >> 172.21.15.46:0/1967775443 conn(0x7f82700ff500 msgr2=0x7f8270101950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:27.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.705+0000 7f8274aec640 1 -- 172.21.15.46:0/1967775443 shutdown_connections 2024-09-21T04:05:27.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.705+0000 7f8274aec640 1 -- 172.21.15.46:0/1967775443 wait complete. 2024-09-21T04:05:27.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.706+0000 7f8274aec640 1 Processor -- start 2024-09-21T04:05:27.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.706+0000 7f8274aec640 1 -- start start 2024-09-21T04:05:27.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.706+0000 7f8274aec640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8270103ae0 0x7f8270075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:27.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.706+0000 7f8274aec640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8270109410 0x7f8270075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:27.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.706+0000 7f8274aec640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8270109d60 0x7f8270076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:27.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.706+0000 7f8274aec640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8270113a20 con 0x7f8270103ae0 2024-09-21T04:05:27.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.706+0000 7f8274aec640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f82701138a0 con 0x7f8270109410 2024-09-21T04:05:27.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.706+0000 7f8274aec640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8270113ba0 con 0x7f8270109d60 2024-09-21T04:05:27.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.706+0000 7f826e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8270103ae0 0x7f8270075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:27.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.706+0000 7f826e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8270103ae0 0x7f8270075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51070/0 (socket says 172.21.15.46:51070) 2024-09-21T04:05:27.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.706+0000 7f826e59c640 1 -- 172.21.15.46:0/3326630385 learned_addr learned my addr 172.21.15.46:0/3326630385 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:05:27.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.706+0000 7f826dd9b640 1 --2- 172.21.15.46:0/3326630385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8270109410 0x7f8270075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:27.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.706+0000 7f826ed9d640 1 --2- 172.21.15.46:0/3326630385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8270109d60 0x7f8270076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:27.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.706+0000 7f826e59c640 1 -- 172.21.15.46:0/3326630385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8270109d60 msgr2=0x7f8270076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:27.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.706+0000 7f826e59c640 1 --2- 172.21.15.46:0/3326630385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8270109d60 0x7f8270076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:27.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.706+0000 7f826e59c640 1 -- 172.21.15.46:0/3326630385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8270109410 msgr2=0x7f8270075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:27.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.706+0000 7f826e59c640 1 --2- 172.21.15.46:0/3326630385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8270109410 0x7f8270075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:27.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.706+0000 7f826e59c640 1 -- 172.21.15.46:0/3326630385 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82701a86b0 con 0x7f8270103ae0 2024-09-21T04:05:27.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.706+0000 7f826dd9b640 1 --2- 172.21.15.46:0/3326630385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8270109410 0x7f8270075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:05:27.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.707+0000 7f826e59c640 1 --2- 172.21.15.46:0/3326630385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8270103ae0 0x7f8270075710 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f826000e9f0 tx=0x7f826000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:27.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.707+0000 7f825f7fe640 1 -- 172.21.15.46:0/3326630385 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826000cd80 con 0x7f8270103ae0 2024-09-21T04:05:27.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.707+0000 7f8274aec640 1 -- 172.21.15.46:0/3326630385 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82701a89a0 con 0x7f8270103ae0 2024-09-21T04:05:27.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.707+0000 7f825f7fe640 1 -- 172.21.15.46:0/3326630385 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82600108e0 con 0x7f8270103ae0 2024-09-21T04:05:27.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.707+0000 7f825f7fe640 1 -- 172.21.15.46:0/3326630385 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8260018980 con 0x7f8270103ae0 2024-09-21T04:05:27.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.707+0000 7f8274aec640 1 -- 172.21.15.46:0/3326630385 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82701a8f40 con 0x7f8270103ae0 2024-09-21T04:05:27.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.708+0000 7f8274aec640 1 -- 172.21.15.46:0/3326630385 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8270103ef0 con 0x7f8270103ae0 2024-09-21T04:05:27.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.710+0000 7f825f7fe640 1 -- 172.21.15.46:0/3326630385 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f8260010430 con 0x7f8270103ae0 2024-09-21T04:05:27.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.711+0000 7f825f7fe640 1 --2- 172.21.15.46:0/3326630385 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f82580b66b0 0x7f82580b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:27.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.711+0000 7f825f7fe640 1 -- 172.21.15.46:0/3326630385 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7f82600e7dc0 con 0x7f8270103ae0 2024-09-21T04:05:27.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.711+0000 7f826dd9b640 1 --2- 172.21.15.46:0/3326630385 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f82580b66b0 0x7f82580b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:27.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.712+0000 7f826dd9b640 1 --2- 172.21.15.46:0/3326630385 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f82580b66b0 0x7f82580b8bc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8270108e40 tx=0x7f8264005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:27.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.718+0000 7f825f7fe640 1 -- 172.21.15.46:0/3326630385 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f82600b2760 con 0x7f8270103ae0 2024-09-21T04:05:27.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:27 smithi046 ceph-mon[30954]: pgmap v638: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:05:27.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:27 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:05:27.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.922+0000 7f8274aec640 1 -- 172.21.15.46:0/3326630385 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f827002e640 con 0x7f8270103ae0 2024-09-21T04:05:27.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.924+0000 7f825f7fe640 1 -- 172.21.15.46:0/3326630385 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22966 (secure 0 0 0) 0x7f82600b76a0 con 0x7f8270103ae0 2024-09-21T04:05:27.927 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T04:05:27.927 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":83,"fsid":"a82de5ec-77cb-11ef-baf5-efdc52797490","created":"2024-09-21T03:44:31.512271+0000","modified":"2024-09-21T04:04:17.837036+0000","last_up_change":"2024-09-21T03:52:22.609789+0000","last_in_change":"2024-09-21T03:51:58.812316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:48:30.407205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:53:09.943833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:53:12.521980+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":13,"snap_epoch":82,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ff9e1a8-fec7-422c-b594-880efe4684f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6803","nonce":791989880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6805","nonce":791989880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6809","nonce":791989880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6807","nonce":791989880}]},"public_addr":"172.21.15.46:6803/791989880","cluster_addr":"172.21.15.46:6805/791989880","heartbeat_back_addr":"172.21.15.46:6809/791989880","heartbeat_front_addr":"172.21.15.46:6807/791989880","state":["exists","up"]},{"osd":1,"uuid":"3df1bee7-615e-44d0-bd43-2370db6cd06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6801","nonce":1123652172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6803","nonce":1123652172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6807","nonce":1123652172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6805","nonce":1123652172}]},"public_addr":"172.21.15.105:6801/1123652172","cluster_addr":"172.21.15.105:6803/1123652172","heartbeat_back_addr":"172.21.15.105:6807/1123652172","heartbeat_front_addr":"172.21.15.105:6805/1123652172","state":["exists","up"]},{"osd":2,"uuid":"52d0e57f-cfca-447a-8a57-b1d5364cb4d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6801","nonce":34930776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6803","nonce":34930776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6807","nonce":34930776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6805","nonce":34930776}]},"public_addr":"172.21.15.162:6801/34930776","cluster_addr":"172.21.15.162:6803/34930776","heartbeat_back_addr":"172.21.15.162:6807/34930776","heartbeat_front_addr":"172.21.15.162:6805/34930776","state":["exists","up"]},{"osd":3,"uuid":"6f25f721-fc50-4b80-944b-d3df28e7a2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6811","nonce":1355580104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6813","nonce":1355580104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6817","nonce":1355580104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6815","nonce":1355580104}]},"public_addr":"172.21.15.46:6811/1355580104","cluster_addr":"172.21.15.46:6813/1355580104","heartbeat_back_addr":"172.21.15.46:6817/1355580104","heartbeat_front_addr":"172.21.15.46:6815/1355580104","state":["exists","up"]},{"osd":4,"uuid":"c2f41084-e5a1-4b5f-b799-a84b38da63a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6809","nonce":3566174660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6811","nonce":3566174660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6815","nonce":3566174660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6813","nonce":3566174660}]},"public_addr":"172.21.15.105:6809/3566174660","cluster_addr":"172.21.15.105:6811/3566174660","heartbeat_back_addr":"172.21.15.105:6815/3566174660","heartbeat_front_addr":"172.21.15.105:6813/3566174660","state":["exists","up"]},{"osd":5,"uuid":"b433d03b-fae8-4ece-b967-a8af91bc3ab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6809","nonce":3043419818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6811","nonce":3043419818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6815","nonce":3043419818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6813","nonce":3043419818}]},"public_addr":"172.21.15.162:6809/3043419818","cluster_addr":"172.21.15.162:6811/3043419818","heartbeat_back_addr":"172.21.15.162:6815/3043419818","heartbeat_front_addr":"172.21.15.162:6813/3043419818","state":["exists","up"]},{"osd":6,"uuid":"e6b5ce54-69aa-4811-9ca3-cab50525a175","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6819","nonce":1615361645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6821","nonce":1615361645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6825","nonce":1615361645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6823","nonce":1615361645}]},"public_addr":"172.21.15.46:6819/1615361645","cluster_addr":"172.21.15.46:6821/1615361645","heartbeat_back_addr":"172.21.15.46:6825/1615361645","heartbeat_front_addr":"172.21.15.46:6823/1615361645","state":["exists","up"]},{"osd":7,"uuid":"a6e89d5d-ce31-4e0c-9019-5eb13b134feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6817","nonce":1015687379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6819","nonce":1015687379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6823","nonce":1015687379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6821","nonce":1015687379}]},"public_addr":"172.21.15.105:6817/1015687379","cluster_addr":"172.21.15.105:6819/1015687379","heartbeat_back_addr":"172.21.15.105:6823/1015687379","heartbeat_front_addr":"172.21.15.105:6821/1015687379","state":["exists","up"]},{"osd":8,"uuid":"27b2ccec-65be-47b3-a924-c5939ba1cb5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6817","nonce":3441747512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6819","nonce":3441747512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6823","nonce":3441747512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6821","nonce":3441747512}]},"public_addr":"172.21.15.162:6817/3441747512","cluster_addr":"172.21.15.162:6819/3441747512","heartbeat_back_addr":"172.21.15.162:6823/3441747512","heartbeat_front_addr":"172.21.15.162:6821/3441747512","state":["exists","up"]},{"osd":9,"uuid":"3f7cb70c-73c7-48e8-a32b-7445eda2126d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6827","nonce":382230768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6829","nonce":382230768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6833","nonce":382230768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6831","nonce":382230768}]},"public_addr":"172.21.15.46:6827/382230768","cluster_addr":"172.21.15.46:6829/382230768","heartbeat_back_addr":"172.21.15.46:6833/382230768","heartbeat_front_addr":"172.21.15.46:6831/382230768","state":["exists","up"]},{"osd":10,"uuid":"76c3da87-f3c5-4985-87fd-647717b6af85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6825","nonce":1664619099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6827","nonce":1664619099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6831","nonce":1664619099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6829","nonce":1664619099}]},"public_addr":"172.21.15.105:6825/1664619099","cluster_addr":"172.21.15.105:6827/1664619099","heartbeat_back_addr":"172.21.15.105:6831/1664619099","heartbeat_front_addr":"172.21.15.105:6829/1664619099","state":["exists","up"]},{"osd":11,"uuid":"13269da8-5f05-4ce2-9c7a-6dd9c1041cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6825","nonce":1014820476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6827","nonce":1014820476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6831","nonce":1014820476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6829","nonce":1014820476}]},"public_addr":"172.21.15.162:6825/1014820476","cluster_addr":"172.21.15.162:6827/1014820476","heartbeat_back_addr":"172.21.15.162:6831/1014820476","heartbeat_front_addr":"172.21.15.162:6829/1014820476","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:47:38.630436+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:03.441596+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:28.647341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:54.270316+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:49:19.783873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:49:45.344485+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:50:12.165326+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:50:38.095996+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:03.814612+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:29.469718+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:55.407340+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:52:20.360243+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:6801/878116252":"2024-09-22T03:46:31.942086+0000","172.21.15.46:6800/878116252":"2024-09-22T03:46:31.942086+0000","172.21.15.46:0/3574041742":"2024-09-22T03:45:05.097136+0000","172.21.15.46:6801/1185001582":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/2839831446":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/3423884605":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/2761976928":"2024-09-22T03:46:31.942086+0000","172.21.15.46:0/1149961133":"2024-09-22T03:45:05.097136+0000","172.21.15.46:6800/1185001582":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/641493295":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/4033661287":"2024-09-22T03:45:31.101657+0000","172.21.15.46:6800/2733048710":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/3972416280":"2024-09-22T03:46:31.942086+0000","172.21.15.46:6801/2733048710":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/1662975018":"2024-09-22T03:46:31.942086+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":4,"length":1},{"begin":13,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T04:05:27.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.926+0000 7f8274aec640 1 -- 172.21.15.46:0/3326630385 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f82580b66b0 msgr2=0x7f82580b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:27.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.926+0000 7f8274aec640 1 --2- 172.21.15.46:0/3326630385 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f82580b66b0 0x7f82580b8bc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8270108e40 tx=0x7f8264005f90 comp rx=0 tx=0).stop 2024-09-21T04:05:27.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.926+0000 7f8274aec640 1 -- 172.21.15.46:0/3326630385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8270103ae0 msgr2=0x7f8270075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:27.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.926+0000 7f8274aec640 1 --2- 172.21.15.46:0/3326630385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8270103ae0 0x7f8270075710 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f826000e9f0 tx=0x7f826000eeb0 comp rx=0 tx=0).stop 2024-09-21T04:05:27.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.927+0000 7f8274aec640 1 -- 172.21.15.46:0/3326630385 shutdown_connections 2024-09-21T04:05:27.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.927+0000 7f8274aec640 1 --2- 172.21.15.46:0/3326630385 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f82580b66b0 0x7f82580b8bc0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:27.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.927+0000 7f8274aec640 1 --2- 172.21.15.46:0/3326630385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8270109d60 0x7f8270076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:27.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.927+0000 7f8274aec640 1 --2- 172.21.15.46:0/3326630385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8270109410 0x7f8270075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:27.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.927+0000 7f8274aec640 1 --2- 172.21.15.46:0/3326630385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8270103ae0 0x7f8270075710 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:27.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.927+0000 7f8274aec640 1 -- 172.21.15.46:0/3326630385 >> 172.21.15.46:0/3326630385 conn(0x7f82700ff500 msgr2=0x7f8270101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:27.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.927+0000 7f8274aec640 1 -- 172.21.15.46:0/3326630385 shutdown_connections 2024-09-21T04:05:27.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:27.927+0000 7f8274aec640 1 -- 172.21.15.46:0/3326630385 wait complete. 2024-09-21T04:05:27.941 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T03:48:30.407205+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T03:53:09.943833+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T03:53:12.521980+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 13, 'snap_epoch': 82, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T04:05:27.941 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T04:05:28.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.057+0000 7f8a27e64640 1 -- 172.21.15.46:0/1465892139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a201029a0 msgr2=0x7f8a20102db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:28.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.057+0000 7f8a27e64640 1 --2- 172.21.15.46:0/1465892139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a201029a0 0x7f8a20102db0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c009900 tx=0x7f8a1c02a410 comp rx=0 tx=0).stop 2024-09-21T04:05:28.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.057+0000 7f8a27e64640 1 -- 172.21.15.46:0/1465892139 shutdown_connections 2024-09-21T04:05:28.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.057+0000 7f8a27e64640 1 --2- 172.21.15.46:0/1465892139 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a20108c20 0x7f8a2010f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:28.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.057+0000 7f8a27e64640 1 --2- 172.21.15.46:0/1465892139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a201082d0 0x7f8a201086e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:28.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.057+0000 7f8a27e64640 1 --2- 172.21.15.46:0/1465892139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a201029a0 0x7f8a20102db0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:28.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.057+0000 7f8a27e64640 1 -- 172.21.15.46:0/1465892139 >> 172.21.15.46:0/1465892139 conn(0x7f8a200fe3c0 msgr2=0x7f8a20100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:28.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.057+0000 7f8a27e64640 1 -- 172.21.15.46:0/1465892139 shutdown_connections 2024-09-21T04:05:28.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.057+0000 7f8a27e64640 1 -- 172.21.15.46:0/1465892139 wait complete. 2024-09-21T04:05:28.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.058+0000 7f8a27e64640 1 Processor -- start 2024-09-21T04:05:28.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.058+0000 7f8a27e64640 1 -- start start 2024-09-21T04:05:28.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.058+0000 7f8a27e64640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a201029a0 0x7f8a2019c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:28.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.058+0000 7f8a27e64640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a201082d0 0x7f8a2019cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:28.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.058+0000 7f8a27e64640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a20108c20 0x7f8a201a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:28.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.058+0000 7f8a27e64640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8a201128e0 con 0x7f8a201029a0 2024-09-21T04:05:28.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.058+0000 7f8a27e64640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8a20112760 con 0x7f8a20108c20 2024-09-21T04:05:28.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.058+0000 7f8a27e64640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8a20112a60 con 0x7f8a201082d0 2024-09-21T04:05:28.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.058+0000 7f8a25c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a201029a0 0x7f8a2019c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:28.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.058+0000 7f8a25c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a201029a0 0x7f8a2019c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51086/0 (socket says 172.21.15.46:51086) 2024-09-21T04:05:28.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.058+0000 7f8a25c00640 1 -- 172.21.15.46:0/3560917884 learned_addr learned my addr 172.21.15.46:0/3560917884 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:05:28.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.059+0000 7f8a253ff640 1 --2- 172.21.15.46:0/3560917884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a201082d0 0x7f8a2019cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:28.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.059+0000 7f8a26401640 1 --2- 172.21.15.46:0/3560917884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a20108c20 0x7f8a201a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:28.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.059+0000 7f8a25c00640 1 -- 172.21.15.46:0/3560917884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a201082d0 msgr2=0x7f8a2019cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:28.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.059+0000 7f8a25c00640 1 --2- 172.21.15.46:0/3560917884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a201082d0 0x7f8a2019cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:28.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.059+0000 7f8a25c00640 1 -- 172.21.15.46:0/3560917884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a20108c20 msgr2=0x7f8a201a1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:28.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.059+0000 7f8a25c00640 1 --2- 172.21.15.46:0/3560917884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a20108c20 0x7f8a201a1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:28.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.059+0000 7f8a25c00640 1 -- 172.21.15.46:0/3560917884 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a201a25b0 con 0x7f8a201029a0 2024-09-21T04:05:28.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.059+0000 7f8a25c00640 1 --2- 172.21.15.46:0/3560917884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a201029a0 0x7f8a2019c680 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c005940 tx=0x7f8a1c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:28.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.059+0000 7f8a16ffd640 1 -- 172.21.15.46:0/3560917884 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c03f030 con 0x7f8a201029a0 2024-09-21T04:05:28.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.059+0000 7f8a27e64640 1 -- 172.21.15.46:0/3560917884 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a201a2840 con 0x7f8a201029a0 2024-09-21T04:05:28.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.059+0000 7f8a16ffd640 1 -- 172.21.15.46:0/3560917884 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a1c0044c0 con 0x7f8a201029a0 2024-09-21T04:05:28.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.059+0000 7f8a16ffd640 1 -- 172.21.15.46:0/3560917884 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c035070 con 0x7f8a201029a0 2024-09-21T04:05:28.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.059+0000 7f8a27e64640 1 -- 172.21.15.46:0/3560917884 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a201a9030 con 0x7f8a201029a0 2024-09-21T04:05:28.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.061+0000 7f8a27e64640 1 -- 172.21.15.46:0/3560917884 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a20103c10 con 0x7f8a201029a0 2024-09-21T04:05:28.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.062+0000 7f8a16ffd640 1 -- 172.21.15.46:0/3560917884 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f8a1c042030 con 0x7f8a201029a0 2024-09-21T04:05:28.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.063+0000 7f8a16ffd640 1 --2- 172.21.15.46:0/3560917884 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f8a0c0b6680 0x7f8a0c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:28.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.063+0000 7f8a253ff640 1 --2- 172.21.15.46:0/3560917884 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f8a0c0b6680 0x7f8a0c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:28.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.063+0000 7f8a16ffd640 1 -- 172.21.15.46:0/3560917884 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7f8a1c107be0 con 0x7f8a201029a0 2024-09-21T04:05:28.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.064+0000 7f8a253ff640 1 --2- 172.21.15.46:0/3560917884 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f8a0c0b6680 0x7f8a0c0b8b90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8a100095f0 tx=0x7f8a10005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:28.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.068+0000 7f8a16ffd640 1 -- 172.21.15.46:0/3560917884 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8a1c0ce1a0 con 0x7f8a201029a0 2024-09-21T04:05:28.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.269+0000 7f8a27e64640 1 -- 172.21.15.46:0/3560917884 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8a2019d7a0 con 0x7f8a201029a0 2024-09-21T04:05:28.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.269+0000 7f8a16ffd640 1 -- 172.21.15.46:0/3560917884 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) ==== 93+0+10 (secure 0 0 0) 0x7f8a1c0d2580 con 0x7f8a201029a0 2024-09-21T04:05:28.272 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-09-21T04:05:28.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.271+0000 7f8a27e64640 1 -- 172.21.15.46:0/3560917884 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f8a0c0b6680 msgr2=0x7f8a0c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:28.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.271+0000 7f8a27e64640 1 --2- 172.21.15.46:0/3560917884 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f8a0c0b6680 0x7f8a0c0b8b90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8a100095f0 tx=0x7f8a10005f90 comp rx=0 tx=0).stop 2024-09-21T04:05:28.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.271+0000 7f8a27e64640 1 -- 172.21.15.46:0/3560917884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a201029a0 msgr2=0x7f8a2019c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:28.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.271+0000 7f8a27e64640 1 --2- 172.21.15.46:0/3560917884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a201029a0 0x7f8a2019c680 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c005940 tx=0x7f8a1c0040c0 comp rx=0 tx=0).stop 2024-09-21T04:05:28.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.271+0000 7f8a27e64640 1 -- 172.21.15.46:0/3560917884 shutdown_connections 2024-09-21T04:05:28.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.271+0000 7f8a27e64640 1 --2- 172.21.15.46:0/3560917884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a20108c20 0x7f8a201a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:28.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.271+0000 7f8a27e64640 1 --2- 172.21.15.46:0/3560917884 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f8a0c0b6680 0x7f8a0c0b8b90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:28.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.271+0000 7f8a27e64640 1 --2- 172.21.15.46:0/3560917884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a201082d0 0x7f8a2019cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:28.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.271+0000 7f8a27e64640 1 --2- 172.21.15.46:0/3560917884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a201029a0 0x7f8a2019c680 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:28.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.271+0000 7f8a27e64640 1 -- 172.21.15.46:0/3560917884 >> 172.21.15.46:0/3560917884 conn(0x7f8a200fe3c0 msgr2=0x7f8a2006b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:28.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.272+0000 7f8a27e64640 1 -- 172.21.15.46:0/3560917884 shutdown_connections 2024-09-21T04:05:28.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.272+0000 7f8a27e64640 1 -- 172.21.15.46:0/3560917884 wait complete. 2024-09-21T04:05:28.285 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T04:05:28.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.401+0000 7f0050a4d640 1 -- 172.21.15.46:0/4231889581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f004c102730 msgr2=0x7f004c102b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:28.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.401+0000 7f0050a4d640 1 --2- 172.21.15.46:0/4231889581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f004c102730 0x7f004c102b40 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f003c009900 tx=0x7f003c02a410 comp rx=0 tx=0).stop 2024-09-21T04:05:28.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.401+0000 7f0050a4d640 1 -- 172.21.15.46:0/4231889581 shutdown_connections 2024-09-21T04:05:28.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.401+0000 7f0050a4d640 1 --2- 172.21.15.46:0/4231889581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f004c107bf0 0x7f004c108060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:28.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.401+0000 7f0050a4d640 1 --2- 172.21.15.46:0/4231889581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f004c103080 0x7f004c1075a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:28.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.401+0000 7f0050a4d640 1 --2- 172.21.15.46:0/4231889581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f004c102730 0x7f004c102b40 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:28.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.401+0000 7f0050a4d640 1 -- 172.21.15.46:0/4231889581 >> 172.21.15.46:0/4231889581 conn(0x7f004c0fe3f0 msgr2=0x7f004c100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:28.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.401+0000 7f0050a4d640 1 -- 172.21.15.46:0/4231889581 shutdown_connections 2024-09-21T04:05:28.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.401+0000 7f0050a4d640 1 -- 172.21.15.46:0/4231889581 wait complete. 2024-09-21T04:05:28.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.402+0000 7f0050a4d640 1 Processor -- start 2024-09-21T04:05:28.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.402+0000 7f0050a4d640 1 -- start start 2024-09-21T04:05:28.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.403+0000 7f0050a4d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f004c102730 0x7f004c1a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:28.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.403+0000 7f0050a4d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f004c103080 0x7f004c1a1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:28.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.403+0000 7f0050a4d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f004c107bf0 0x7f004c1a62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:28.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.403+0000 7f0050a4d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f004c11a0b0 con 0x7f004c103080 2024-09-21T04:05:28.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.403+0000 7f0050a4d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f004c119f30 con 0x7f004c102730 2024-09-21T04:05:28.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.403+0000 7f0050a4d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f004c11a230 con 0x7f004c107bf0 2024-09-21T04:05:28.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.403+0000 7f0049d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f004c103080 0x7f004c1a1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:28.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.403+0000 7f0049d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f004c103080 0x7f004c1a1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51116/0 (socket says 172.21.15.46:51116) 2024-09-21T04:05:28.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.403+0000 7f0049d9b640 1 -- 172.21.15.46:0/961028233 learned_addr learned my addr 172.21.15.46:0/961028233 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:05:28.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.403+0000 7f004ad9d640 1 --2- 172.21.15.46:0/961028233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f004c107bf0 0x7f004c1a62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:28.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.403+0000 7f004a59c640 1 --2- 172.21.15.46:0/961028233 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f004c102730 0x7f004c1a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:28.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.403+0000 7f0049d9b640 1 -- 172.21.15.46:0/961028233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f004c107bf0 msgr2=0x7f004c1a62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:28.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.403+0000 7f0049d9b640 1 --2- 172.21.15.46:0/961028233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f004c107bf0 0x7f004c1a62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:28.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.403+0000 7f0049d9b640 1 -- 172.21.15.46:0/961028233 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f004c102730 msgr2=0x7f004c1a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:28.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.403+0000 7f0049d9b640 1 --2- 172.21.15.46:0/961028233 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f004c102730 0x7f004c1a0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:28.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.403+0000 7f0049d9b640 1 -- 172.21.15.46:0/961028233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f004c1a69a0 con 0x7f004c103080 2024-09-21T04:05:28.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.403+0000 7f004ad9d640 1 --2- 172.21.15.46:0/961028233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f004c107bf0 0x7f004c1a62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:05:28.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.403+0000 7f0049d9b640 1 --2- 172.21.15.46:0/961028233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f004c103080 0x7f004c1a1010 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f004400db20 tx=0x7f004400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:28.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.403+0000 7f003b7fe640 1 -- 172.21.15.46:0/961028233 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0044017070 con 0x7f004c103080 2024-09-21T04:05:28.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.404+0000 7f003b7fe640 1 -- 172.21.15.46:0/961028233 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0044003e20 con 0x7f004c103080 2024-09-21T04:05:28.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.404+0000 7f0050a4d640 1 -- 172.21.15.46:0/961028233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f004c1a6c90 con 0x7f004c103080 2024-09-21T04:05:28.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.404+0000 7f003b7fe640 1 -- 172.21.15.46:0/961028233 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00440106c0 con 0x7f004c103080 2024-09-21T04:05:28.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.404+0000 7f0050a4d640 1 -- 172.21.15.46:0/961028233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f004c1ad420 con 0x7f004c103080 2024-09-21T04:05:28.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.405+0000 7f0050a4d640 1 -- 172.21.15.46:0/961028233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f004c1075a0 con 0x7f004c103080 2024-09-21T04:05:28.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.407+0000 7f003b7fe640 1 -- 172.21.15.46:0/961028233 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f0044004140 con 0x7f004c103080 2024-09-21T04:05:28.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.408+0000 7f003b7fe640 1 --2- 172.21.15.46:0/961028233 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f00340b6680 0x7f00340b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:28.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.408+0000 7f003b7fe640 1 -- 172.21.15.46:0/961028233 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7f00440e7440 con 0x7f004c103080 2024-09-21T04:05:28.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.408+0000 7f004a59c640 1 --2- 172.21.15.46:0/961028233 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f00340b6680 0x7f00340b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:28.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.409+0000 7f004a59c640 1 --2- 172.21.15.46:0/961028233 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f00340b6680 0x7f00340b8b90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f003c005ab0 tx=0x7f003c005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:28.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.410+0000 7f003b7fe640 1 -- 172.21.15.46:0/961028233 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f00440b1d80 con 0x7f004c103080 2024-09-21T04:05:28.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.639+0000 7f0050a4d640 1 -- 172.21.15.46:0/961028233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f004c1ad700 con 0x7f004c103080 2024-09-21T04:05:28.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.640+0000 7f003b7fe640 1 -- 172.21.15.46:0/961028233 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) ==== 104+0+11 (secure 0 0 0) 0x7f00440b6cc0 con 0x7f004c103080 2024-09-21T04:05:28.643 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-09-21T04:05:28.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.643+0000 7f0050a4d640 1 -- 172.21.15.46:0/961028233 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f00340b6680 msgr2=0x7f00340b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:28.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.643+0000 7f0050a4d640 1 --2- 172.21.15.46:0/961028233 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f00340b6680 0x7f00340b8b90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f003c005ab0 tx=0x7f003c005a20 comp rx=0 tx=0).stop 2024-09-21T04:05:28.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.643+0000 7f0050a4d640 1 -- 172.21.15.46:0/961028233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f004c103080 msgr2=0x7f004c1a1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:28.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.643+0000 7f0050a4d640 1 --2- 172.21.15.46:0/961028233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f004c103080 0x7f004c1a1010 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f004400db20 tx=0x7f004400b260 comp rx=0 tx=0).stop 2024-09-21T04:05:28.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.643+0000 7f0050a4d640 1 -- 172.21.15.46:0/961028233 shutdown_connections 2024-09-21T04:05:28.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.643+0000 7f0050a4d640 1 --2- 172.21.15.46:0/961028233 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f00340b6680 0x7f00340b8b90 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:28.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.643+0000 7f0050a4d640 1 --2- 172.21.15.46:0/961028233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f004c107bf0 0x7f004c1a62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:28.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.643+0000 7f0050a4d640 1 --2- 172.21.15.46:0/961028233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f004c103080 0x7f004c1a1010 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:28.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.643+0000 7f0050a4d640 1 --2- 172.21.15.46:0/961028233 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f004c102730 0x7f004c1a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:28.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.643+0000 7f0050a4d640 1 -- 172.21.15.46:0/961028233 >> 172.21.15.46:0/961028233 conn(0x7f004c0fe3f0 msgr2=0x7f004c105570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:28.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.643+0000 7f0050a4d640 1 -- 172.21.15.46:0/961028233 shutdown_connections 2024-09-21T04:05:28.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.643+0000 7f0050a4d640 1 -- 172.21.15.46:0/961028233 wait complete. 2024-09-21T04:05:28.656 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:28 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3326630385' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:05:28.656 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:28 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3560917884' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T04:05:28.657 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T04:05:28.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.791+0000 7faed8790640 1 -- 172.21.15.46:0/2602105510 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faed0105290 msgr2=0x7faed010d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:28.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.791+0000 7faed8790640 1 --2- 172.21.15.46:0/2602105510 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faed0105290 0x7faed010d7d0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7faec0009900 tx=0x7faec002a410 comp rx=0 tx=0).stop 2024-09-21T04:05:28.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.791+0000 7faed8790640 1 -- 172.21.15.46:0/2602105510 shutdown_connections 2024-09-21T04:05:28.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.791+0000 7faed8790640 1 --2- 172.21.15.46:0/2602105510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faed010dd60 0x7faed0110240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:28.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.791+0000 7faed8790640 1 --2- 172.21.15.46:0/2602105510 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faed0105290 0x7faed010d7d0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:28.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.791+0000 7faed8790640 1 --2- 172.21.15.46:0/2602105510 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faed0104940 0x7faed0104d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:28.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.791+0000 7faed8790640 1 -- 172.21.15.46:0/2602105510 >> 172.21.15.46:0/2602105510 conn(0x7faed00fe3b0 msgr2=0x7faed0100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:28.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.791+0000 7faed8790640 1 -- 172.21.15.46:0/2602105510 shutdown_connections 2024-09-21T04:05:28.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.791+0000 7faed8790640 1 -- 172.21.15.46:0/2602105510 wait complete. 2024-09-21T04:05:28.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.792+0000 7faed8790640 1 Processor -- start 2024-09-21T04:05:28.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.792+0000 7faed8790640 1 -- start start 2024-09-21T04:05:28.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.792+0000 7faed8790640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faed0104940 0x7faed0102670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:28.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.792+0000 7faed8790640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faed0105290 0x7faed0102bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:28.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.792+0000 7faed8790640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faed010dd60 0x7faed01030f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:28.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.792+0000 7faed8790640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7faed0113a00 con 0x7faed0104940 2024-09-21T04:05:28.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.792+0000 7faed8790640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7faed0113880 con 0x7faed0105290 2024-09-21T04:05:28.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.792+0000 7faed8790640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faed0113b80 con 0x7faed010dd60 2024-09-21T04:05:28.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.793+0000 7faed652c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faed0104940 0x7faed0102670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:28.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.793+0000 7faed652c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faed0104940 0x7faed0102670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51142/0 (socket says 172.21.15.46:51142) 2024-09-21T04:05:28.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.793+0000 7faed652c640 1 -- 172.21.15.46:0/2007771430 learned_addr learned my addr 172.21.15.46:0/2007771430 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:05:28.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.793+0000 7faed5d2b640 1 --2- 172.21.15.46:0/2007771430 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faed0105290 0x7faed0102bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:28.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.793+0000 7faed6d2d640 1 --2- 172.21.15.46:0/2007771430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faed010dd60 0x7faed01030f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:28.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.793+0000 7faed652c640 1 -- 172.21.15.46:0/2007771430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faed010dd60 msgr2=0x7faed01030f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:28.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.793+0000 7faed652c640 1 --2- 172.21.15.46:0/2007771430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faed010dd60 0x7faed01030f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:28.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.793+0000 7faed652c640 1 -- 172.21.15.46:0/2007771430 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faed0105290 msgr2=0x7faed0102bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:28.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.793+0000 7faed652c640 1 --2- 172.21.15.46:0/2007771430 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faed0105290 0x7faed0102bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:28.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.793+0000 7faed652c640 1 -- 172.21.15.46:0/2007771430 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faed01a8670 con 0x7faed0104940 2024-09-21T04:05:28.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.793+0000 7faed652c640 1 --2- 172.21.15.46:0/2007771430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faed0104940 0x7faed0102670 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7faecc00e9f0 tx=0x7faecc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:28.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.793+0000 7faec77fe640 1 -- 172.21.15.46:0/2007771430 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faecc00cd80 con 0x7faed0104940 2024-09-21T04:05:28.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.793+0000 7faec77fe640 1 -- 172.21.15.46:0/2007771430 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faecc0108e0 con 0x7faed0104940 2024-09-21T04:05:28.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.793+0000 7faed8790640 1 -- 172.21.15.46:0/2007771430 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faed01a8960 con 0x7faed0104940 2024-09-21T04:05:28.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.793+0000 7faec77fe640 1 -- 172.21.15.46:0/2007771430 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faecc018980 con 0x7faed0104940 2024-09-21T04:05:28.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.793+0000 7faed8790640 1 -- 172.21.15.46:0/2007771430 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faed01a8ed0 con 0x7faed0104940 2024-09-21T04:05:28.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.794+0000 7faed8790640 1 -- 172.21.15.46:0/2007771430 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faed0104d50 con 0x7faed0104940 2024-09-21T04:05:28.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.796+0000 7faec77fe640 1 -- 172.21.15.46:0/2007771430 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7faecc010430 con 0x7faed0104940 2024-09-21T04:05:28.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.797+0000 7faec77fe640 1 --2- 172.21.15.46:0/2007771430 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7faebc0b6730 0x7faebc0b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:28.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.797+0000 7faec77fe640 1 -- 172.21.15.46:0/2007771430 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7faecc0e7d80 con 0x7faed0104940 2024-09-21T04:05:28.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.797+0000 7faed5d2b640 1 --2- 172.21.15.46:0/2007771430 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7faebc0b6730 0x7faebc0b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:28.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.798+0000 7faed5d2b640 1 --2- 172.21.15.46:0/2007771430 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7faebc0b6730 0x7faebc0b8c40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7faec002aa00 tx=0x7faec0005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:28.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.803+0000 7faec77fe640 1 -- 172.21.15.46:0/2007771430 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faecc0b2720 con 0x7faed0104940 2024-09-21T04:05:28.817 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:28 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3326630385' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:05:28.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:28 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3560917884' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T04:05:28.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:28 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3326630385' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:05:28.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:28 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3560917884' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T04:05:29.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.998+0000 7faed8790640 1 -- 172.21.15.46:0/2007771430 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7faed01a92a0 con 0x7faed0104940 2024-09-21T04:05:29.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:28.998+0000 7faec77fe640 1 -- 172.21.15.46:0/2007771430 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) ==== 100+0+11 (secure 0 0 0) 0x7faecc0b7660 con 0x7faed0104940 2024-09-21T04:05:29.001 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-09-21T04:05:29.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.001+0000 7faed8790640 1 -- 172.21.15.46:0/2007771430 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7faebc0b6730 msgr2=0x7faebc0b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:29.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.001+0000 7faed8790640 1 --2- 172.21.15.46:0/2007771430 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7faebc0b6730 0x7faebc0b8c40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7faec002aa00 tx=0x7faec0005a20 comp rx=0 tx=0).stop 2024-09-21T04:05:29.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.001+0000 7faed8790640 1 -- 172.21.15.46:0/2007771430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faed0104940 msgr2=0x7faed0102670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:29.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.001+0000 7faed8790640 1 --2- 172.21.15.46:0/2007771430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faed0104940 0x7faed0102670 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7faecc00e9f0 tx=0x7faecc00eeb0 comp rx=0 tx=0).stop 2024-09-21T04:05:29.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.001+0000 7faed8790640 1 -- 172.21.15.46:0/2007771430 shutdown_connections 2024-09-21T04:05:29.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.001+0000 7faed8790640 1 --2- 172.21.15.46:0/2007771430 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7faebc0b6730 0x7faebc0b8c40 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:29.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.001+0000 7faed8790640 1 --2- 172.21.15.46:0/2007771430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faed010dd60 0x7faed01030f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:29.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.001+0000 7faed8790640 1 --2- 172.21.15.46:0/2007771430 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faed0105290 0x7faed0102bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:29.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.001+0000 7faed8790640 1 --2- 172.21.15.46:0/2007771430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faed0104940 0x7faed0102670 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:29.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.001+0000 7faed8790640 1 -- 172.21.15.46:0/2007771430 >> 172.21.15.46:0/2007771430 conn(0x7faed00fe3b0 msgr2=0x7faed0107820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:29.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.001+0000 7faed8790640 1 -- 172.21.15.46:0/2007771430 shutdown_connections 2024-09-21T04:05:29.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.001+0000 7faed8790640 1 -- 172.21.15.46:0/2007771430 wait complete. 2024-09-21T04:05:29.015 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-21T04:05:29.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.130+0000 7f737309d640 1 -- 172.21.15.46:0/3850913627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f736c102980 msgr2=0x7f736c102d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:29.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.130+0000 7f737309d640 1 --2- 172.21.15.46:0/3850913627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f736c102980 0x7f736c102d90 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f7360009900 tx=0x7f736002a410 comp rx=0 tx=0).stop 2024-09-21T04:05:29.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.130+0000 7f737309d640 1 -- 172.21.15.46:0/3850913627 shutdown_connections 2024-09-21T04:05:29.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.130+0000 7f737309d640 1 --2- 172.21.15.46:0/3850913627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f736c108c00 0x7f736c10f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:29.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.131+0000 7f737309d640 1 --2- 172.21.15.46:0/3850913627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f736c1082b0 0x7f736c1086c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:29.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.131+0000 7f737309d640 1 --2- 172.21.15.46:0/3850913627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f736c102980 0x7f736c102d90 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:29.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.131+0000 7f737309d640 1 -- 172.21.15.46:0/3850913627 >> 172.21.15.46:0/3850913627 conn(0x7f736c0fe380 msgr2=0x7f736c1007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:29.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.131+0000 7f737309d640 1 -- 172.21.15.46:0/3850913627 shutdown_connections 2024-09-21T04:05:29.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.131+0000 7f737309d640 1 -- 172.21.15.46:0/3850913627 wait complete. 2024-09-21T04:05:29.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.131+0000 7f737309d640 1 Processor -- start 2024-09-21T04:05:29.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.131+0000 7f737309d640 1 -- start start 2024-09-21T04:05:29.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.132+0000 7f737309d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f736c102980 0x7f736c19a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:29.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.132+0000 7f737309d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f736c1082b0 0x7f736c19a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:29.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.132+0000 7f737309d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f736c108c00 0x7f736c19fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:29.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.132+0000 7f737309d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f736c1128c0 con 0x7f736c108c00 2024-09-21T04:05:29.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.132+0000 7f737309d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f736c112740 con 0x7f736c1082b0 2024-09-21T04:05:29.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.132+0000 7f737309d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f736c112a40 con 0x7f736c102980 2024-09-21T04:05:29.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.132+0000 7f737163a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f736c108c00 0x7f736c19fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:29.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.132+0000 7f7370e39640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f736c102980 0x7f736c19a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:29.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.132+0000 7f737163a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f736c108c00 0x7f736c19fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51168/0 (socket says 172.21.15.46:51168) 2024-09-21T04:05:29.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.132+0000 7f737163a640 1 -- 172.21.15.46:0/3929329070 learned_addr learned my addr 172.21.15.46:0/3929329070 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:05:29.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.132+0000 7f736bfff640 1 --2- 172.21.15.46:0/3929329070 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f736c1082b0 0x7f736c19a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:29.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.132+0000 7f737163a640 1 -- 172.21.15.46:0/3929329070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f736c102980 msgr2=0x7f736c19a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:29.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.132+0000 7f737163a640 1 --2- 172.21.15.46:0/3929329070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f736c102980 0x7f736c19a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:29.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.132+0000 7f737163a640 1 -- 172.21.15.46:0/3929329070 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f736c1082b0 msgr2=0x7f736c19a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:29.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.132+0000 7f737163a640 1 --2- 172.21.15.46:0/3929329070 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f736c1082b0 0x7f736c19a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:29.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.132+0000 7f737163a640 1 -- 172.21.15.46:0/3929329070 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f736c1a0300 con 0x7f736c108c00 2024-09-21T04:05:29.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.132+0000 7f736bfff640 1 --2- 172.21.15.46:0/3929329070 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f736c1082b0 0x7f736c19a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:05:29.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.132+0000 7f7370e39640 1 --2- 172.21.15.46:0/3929329070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f736c102980 0x7f736c19a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:05:29.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.132+0000 7f737163a640 1 --2- 172.21.15.46:0/3929329070 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f736c108c00 0x7f736c19fc00 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f736400eb10 tx=0x7f736400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:29.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.133+0000 7f7369ffb640 1 -- 172.21.15.46:0/3929329070 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7364004b20 con 0x7f736c108c00 2024-09-21T04:05:29.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.133+0000 7f7369ffb640 1 -- 172.21.15.46:0/3929329070 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7364004cc0 con 0x7f736c108c00 2024-09-21T04:05:29.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.133+0000 7f737309d640 1 -- 172.21.15.46:0/3929329070 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f736c1a05f0 con 0x7f736c108c00 2024-09-21T04:05:29.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.133+0000 7f7369ffb640 1 -- 172.21.15.46:0/3929329070 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7364010670 con 0x7f736c108c00 2024-09-21T04:05:29.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.133+0000 7f737309d640 1 -- 172.21.15.46:0/3929329070 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f736c1a6d80 con 0x7f736c108c00 2024-09-21T04:05:29.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.134+0000 7f737309d640 1 -- 172.21.15.46:0/3929329070 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f736c103bf0 con 0x7f736c108c00 2024-09-21T04:05:29.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.135+0000 7f7369ffb640 1 -- 172.21.15.46:0/3929329070 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f7364005020 con 0x7f736c108c00 2024-09-21T04:05:29.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.136+0000 7f7369ffb640 1 --2- 172.21.15.46:0/3929329070 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f735c0b6680 0x7f735c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:29.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.136+0000 7f7370e39640 1 --2- 172.21.15.46:0/3929329070 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f735c0b6680 0x7f735c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:29.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.136+0000 7f7369ffb640 1 -- 172.21.15.46:0/3929329070 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7f73640e7cd0 con 0x7f736c108c00 2024-09-21T04:05:29.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.137+0000 7f7370e39640 1 --2- 172.21.15.46:0/3929329070 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f735c0b6680 0x7f735c0b8b90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7360031440 tx=0x7f7360032ed0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:29.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.140+0000 7f7369ffb640 1 -- 172.21.15.46:0/3929329070 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f73640ae230 con 0x7f736c108c00 2024-09-21T04:05:29.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.383+0000 7f737309d640 1 -- 172.21.15.46:0/3929329070 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f736c10b450 con 0x7f736c108c00 2024-09-21T04:05:29.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.391+0000 7f7369ffb640 1 -- 172.21.15.46:0/3929329070 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v23) ==== 81+0+834050 (secure 0 0 0) 0x7f73640b2610 con 0x7f736c108c00 2024-09-21T04:05:29.403 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T04:05:29.403 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T04:05:29.403 INFO:teuthology.orchestra.run.smithi046.stdout: "epoch": 23, 2024-09-21T04:05:29.404 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.404 INFO:teuthology.orchestra.run.smithi046.stdout: "active_gid": 14223, 2024-09-21T04:05:29.404 INFO:teuthology.orchestra.run.smithi046.stdout: "active_name": "x", 2024-09-21T04:05:29.404 INFO:teuthology.orchestra.run.smithi046.stdout: "active_addrs": { 2024-09-21T04:05:29.404 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-09-21T04:05:29.404 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.404 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-09-21T04:05:29.404 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.46:6800", 2024-09-21T04:05:29.404 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1928997883 2024-09-21T04:05:29.404 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.404 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.404 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-09-21T04:05:29.404 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.46:6801", 2024-09-21T04:05:29.404 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1928997883 2024-09-21T04:05:29.405 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.405 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-09-21T04:05:29.405 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.405 INFO:teuthology.orchestra.run.smithi046.stdout: "active_addr": "172.21.15.46:6801/1928997883", 2024-09-21T04:05:29.405 INFO:teuthology.orchestra.run.smithi046.stdout: "active_change": "2024-09-21T03:46:31.942258+0000", 2024-09-21T04:05:29.405 INFO:teuthology.orchestra.run.smithi046.stdout: "active_mgr_features": 4540719139924082687, 2024-09-21T04:05:29.405 INFO:teuthology.orchestra.run.smithi046.stdout: "available": true, 2024-09-21T04:05:29.405 INFO:teuthology.orchestra.run.smithi046.stdout: "standbys": [ 2024-09-21T04:05:29.405 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.405 INFO:teuthology.orchestra.run.smithi046.stdout: "gid": 24164, 2024-09-21T04:05:29.405 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "y", 2024-09-21T04:05:29.405 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_features": 4540719139924082687, 2024-09-21T04:05:29.405 INFO:teuthology.orchestra.run.smithi046.stdout: "available_modules": [ 2024-09-21T04:05:29.405 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.405 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "alerts", 2024-09-21T04:05:29.406 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.406 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.406 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.406 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2024-09-21T04:05:29.406 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2024-09-21T04:05:29.406 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:29.406 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.406 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.406 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2024-09-21T04:05:29.406 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.406 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.406 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.407 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T04:05:29.407 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.407 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.407 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.407 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.407 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.407 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.407 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.407 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.407 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.407 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.407 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.407 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.407 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.407 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.408 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.408 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.408 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.408 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.408 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.408 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.408 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.408 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.408 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.408 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.408 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.408 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.408 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.408 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.409 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.409 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.409 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.409 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.409 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.409 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.409 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.409 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.409 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.409 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.409 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.409 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.409 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.409 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.409 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.410 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.410 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.410 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.410 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.410 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.410 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.410 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.410 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.410 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.410 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.410 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.410 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.411 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.411 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.411 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.411 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.411 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.411 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.411 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.411 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.411 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.411 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.411 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.411 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.411 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.411 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.412 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.412 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.412 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.412 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.412 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.412 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_destination": { 2024-09-21T04:05:29.412 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_destination", 2024-09-21T04:05:29.412 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.412 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.412 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.412 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.412 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.412 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.412 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.413 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T04:05:29.413 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.413 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.413 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.413 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.413 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_from_name": { 2024-09-21T04:05:29.413 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_from_name", 2024-09-21T04:05:29.413 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.413 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.413 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.413 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "Ceph", 2024-09-21T04:05:29.413 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.413 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.413 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.414 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Email From: name", 2024-09-21T04:05:29.414 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.414 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.414 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.414 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.414 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_host": { 2024-09-21T04:05:29.414 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_host", 2024-09-21T04:05:29.414 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.414 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.414 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.414 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.414 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.414 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.415 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.415 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SMTP server", 2024-09-21T04:05:29.415 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.415 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.415 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.415 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.415 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_password": { 2024-09-21T04:05:29.415 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_password", 2024-09-21T04:05:29.415 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.415 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.415 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.415 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.415 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.415 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.415 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.416 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Password to authenticate with", 2024-09-21T04:05:29.416 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.416 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.416 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.416 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.416 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_port": { 2024-09-21T04:05:29.416 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_port", 2024-09-21T04:05:29.416 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.416 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.416 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.416 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "465", 2024-09-21T04:05:29.416 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.416 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.417 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.417 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SMTP port", 2024-09-21T04:05:29.417 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.417 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.417 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.417 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.417 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_sender": { 2024-09-21T04:05:29.417 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_sender", 2024-09-21T04:05:29.417 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.417 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.417 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.417 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.417 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.417 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.417 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.418 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SMTP envelope sender", 2024-09-21T04:05:29.418 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.418 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.418 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.418 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.418 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_ssl": { 2024-09-21T04:05:29.418 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_ssl", 2024-09-21T04:05:29.418 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.418 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.418 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.418 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.418 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.418 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.419 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.419 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T04:05:29.419 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.419 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.419 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.419 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.419 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_user": { 2024-09-21T04:05:29.419 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_user", 2024-09-21T04:05:29.419 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.419 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.419 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.419 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.419 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.419 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.419 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.420 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "User to authenticate as", 2024-09-21T04:05:29.420 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.420 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.420 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.420 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.420 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.420 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.420 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.420 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.420 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.420 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.420 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.420 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.420 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.421 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.421 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.421 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.421 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.421 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.421 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.421 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.421 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.421 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "balancer", 2024-09-21T04:05:29.421 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.421 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.421 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.421 INFO:teuthology.orchestra.run.smithi046.stdout: "active": { 2024-09-21T04:05:29.421 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "active", 2024-09-21T04:05:29.422 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.422 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.422 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.422 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.422 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.422 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.422 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.422 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T04:05:29.422 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.422 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.422 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.422 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.422 INFO:teuthology.orchestra.run.smithi046.stdout: "begin_time": { 2024-09-21T04:05:29.422 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "begin_time", 2024-09-21T04:05:29.423 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.423 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.423 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.423 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0000", 2024-09-21T04:05:29.423 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.423 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.423 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.423 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T04:05:29.423 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T04:05:29.423 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.423 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.423 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.423 INFO:teuthology.orchestra.run.smithi046.stdout: "begin_weekday": { 2024-09-21T04:05:29.423 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "begin_weekday", 2024-09-21T04:05:29.424 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2024-09-21T04:05:29.424 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.424 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.424 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.424 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "0", 2024-09-21T04:05:29.424 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "6", 2024-09-21T04:05:29.424 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.424 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T04:05:29.424 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T04:05:29.424 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.424 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.424 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.424 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_compat_max_iterations": { 2024-09-21T04:05:29.424 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crush_compat_max_iterations", 2024-09-21T04:05:29.425 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2024-09-21T04:05:29.425 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.425 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.425 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "25", 2024-09-21T04:05:29.425 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2024-09-21T04:05:29.425 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "250", 2024-09-21T04:05:29.425 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.425 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T04:05:29.425 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.425 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.425 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.426 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.426 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_compat_metrics": { 2024-09-21T04:05:29.426 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crush_compat_metrics", 2024-09-21T04:05:29.426 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.426 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.426 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.426 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T04:05:29.426 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.426 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.426 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.426 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T04:05:29.426 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T04:05:29.426 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.427 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.427 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.427 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_compat_step": { 2024-09-21T04:05:29.427 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crush_compat_step", 2024-09-21T04:05:29.427 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-21T04:05:29.427 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.427 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.427 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0.5", 2024-09-21T04:05:29.427 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "0.001", 2024-09-21T04:05:29.427 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "0.999", 2024-09-21T04:05:29.427 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.427 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "aggressiveness of optimization", 2024-09-21T04:05:29.427 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T04:05:29.427 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.427 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.428 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.428 INFO:teuthology.orchestra.run.smithi046.stdout: "end_time": { 2024-09-21T04:05:29.428 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "end_time", 2024-09-21T04:05:29.428 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.428 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.428 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.428 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "2359", 2024-09-21T04:05:29.428 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.428 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.428 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.428 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T04:05:29.428 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T04:05:29.428 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.428 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.429 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.429 INFO:teuthology.orchestra.run.smithi046.stdout: "end_weekday": { 2024-09-21T04:05:29.429 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "end_weekday", 2024-09-21T04:05:29.429 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2024-09-21T04:05:29.429 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.429 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.429 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.429 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "0", 2024-09-21T04:05:29.429 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "6", 2024-09-21T04:05:29.429 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.429 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T04:05:29.429 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T04:05:29.429 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.429 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.430 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.430 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.430 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.430 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.430 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.430 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.430 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.430 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.430 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.430 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.430 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.430 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.430 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.430 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.431 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.431 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.431 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.431 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.431 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.431 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.431 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.431 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.431 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.431 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.431 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.431 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.431 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.431 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.432 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.432 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.432 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.432 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.432 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.432 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.432 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.432 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.432 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.432 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.432 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.432 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.432 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.433 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.433 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.433 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.433 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.433 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.433 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.433 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.433 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.433 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.433 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.433 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.433 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.433 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.433 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.433 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.433 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.434 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.434 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.434 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.434 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.434 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.434 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.434 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.434 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.434 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.434 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.434 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.434 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.434 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.435 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.435 INFO:teuthology.orchestra.run.smithi046.stdout: "min_score": { 2024-09-21T04:05:29.435 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "min_score", 2024-09-21T04:05:29.435 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-21T04:05:29.435 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.435 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.435 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.435 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.435 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.435 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.435 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T04:05:29.435 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.435 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.435 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.436 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.436 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": { 2024-09-21T04:05:29.436 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mode", 2024-09-21T04:05:29.436 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.436 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.436 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.436 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "upmap", 2024-09-21T04:05:29.436 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.436 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.436 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.436 INFO:teuthology.orchestra.run.smithi046.stdout: "crush-compat", 2024-09-21T04:05:29.436 INFO:teuthology.orchestra.run.smithi046.stdout: "none", 2024-09-21T04:05:29.436 INFO:teuthology.orchestra.run.smithi046.stdout: "read", 2024-09-21T04:05:29.437 INFO:teuthology.orchestra.run.smithi046.stdout: "upmap", 2024-09-21T04:05:29.437 INFO:teuthology.orchestra.run.smithi046.stdout: "upmap-read" 2024-09-21T04:05:29.437 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.437 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Balancer mode", 2024-09-21T04:05:29.437 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.437 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.437 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.437 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.437 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_ids": { 2024-09-21T04:05:29.437 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pool_ids", 2024-09-21T04:05:29.437 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.437 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.437 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.438 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.438 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.438 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.438 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.438 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T04:05:29.438 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.438 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.438 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.438 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.438 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2024-09-21T04:05:29.438 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2024-09-21T04:05:29.438 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:29.438 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.438 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.439 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2024-09-21T04:05:29.439 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.439 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.439 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.439 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T04:05:29.439 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.439 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.439 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.439 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.439 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.439 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.439 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.439 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.439 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.439 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.440 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.440 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.440 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.440 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.440 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.440 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.440 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.440 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.440 INFO:teuthology.orchestra.run.smithi046.stdout: "upmap_max_deviation": { 2024-09-21T04:05:29.440 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "upmap_max_deviation", 2024-09-21T04:05:29.440 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.440 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.440 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.440 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2024-09-21T04:05:29.441 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2024-09-21T04:05:29.441 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.441 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.441 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T04:05:29.441 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T04:05:29.441 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.441 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.441 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.441 INFO:teuthology.orchestra.run.smithi046.stdout: "upmap_max_optimizations": { 2024-09-21T04:05:29.441 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "upmap_max_optimizations", 2024-09-21T04:05:29.441 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2024-09-21T04:05:29.441 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.441 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.441 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-21T04:05:29.442 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.442 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.442 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.442 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T04:05:29.442 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.442 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.442 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.442 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.442 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.443 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.443 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.443 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephadm", 2024-09-21T04:05:29.443 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.443 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.443 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.443 INFO:teuthology.orchestra.run.smithi046.stdout: "agent_down_multiplier": { 2024-09-21T04:05:29.443 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "agent_down_multiplier", 2024-09-21T04:05:29.443 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-21T04:05:29.443 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.443 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.443 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "3.0", 2024-09-21T04:05:29.443 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.443 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.444 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.444 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T04:05:29.444 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.444 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.444 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.444 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.444 INFO:teuthology.orchestra.run.smithi046.stdout: "agent_refresh_rate": { 2024-09-21T04:05:29.444 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "agent_refresh_rate", 2024-09-21T04:05:29.444 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:29.444 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.444 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.444 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "20", 2024-09-21T04:05:29.444 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.444 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.445 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.445 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T04:05:29.445 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.445 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.445 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.445 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.445 INFO:teuthology.orchestra.run.smithi046.stdout: "agent_starting_port": { 2024-09-21T04:05:29.445 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "agent_starting_port", 2024-09-21T04:05:29.445 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.445 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.445 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.445 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "4721", 2024-09-21T04:05:29.445 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.445 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.446 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.446 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T04:05:29.446 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.446 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.446 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.446 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.446 INFO:teuthology.orchestra.run.smithi046.stdout: "allow_ptrace": { 2024-09-21T04:05:29.446 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "allow_ptrace", 2024-09-21T04:05:29.446 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.446 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.446 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.446 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.447 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.447 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.447 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.447 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T04:05:29.447 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T04:05:29.447 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.447 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.447 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.447 INFO:teuthology.orchestra.run.smithi046.stdout: "autotune_interval": { 2024-09-21T04:05:29.447 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "autotune_interval", 2024-09-21T04:05:29.448 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:29.448 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.448 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.448 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2024-09-21T04:05:29.448 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.448 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.448 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.448 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T04:05:29.448 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.448 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.448 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.448 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.448 INFO:teuthology.orchestra.run.smithi046.stdout: "autotune_memory_target_ratio": { 2024-09-21T04:05:29.449 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T04:05:29.449 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-21T04:05:29.449 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.449 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.449 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0.7", 2024-09-21T04:05:29.449 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.449 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.449 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.449 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T04:05:29.450 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.450 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.450 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.450 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.450 INFO:teuthology.orchestra.run.smithi046.stdout: "cephadm_log_destination": { 2024-09-21T04:05:29.450 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephadm_log_destination", 2024-09-21T04:05:29.450 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.450 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.450 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.450 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.450 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.450 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.450 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.451 INFO:teuthology.orchestra.run.smithi046.stdout: "file", 2024-09-21T04:05:29.451 INFO:teuthology.orchestra.run.smithi046.stdout: "file,syslog", 2024-09-21T04:05:29.451 INFO:teuthology.orchestra.run.smithi046.stdout: "syslog" 2024-09-21T04:05:29.451 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.451 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T04:05:29.451 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.451 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.451 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.451 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.451 INFO:teuthology.orchestra.run.smithi046.stdout: "cgroups_split": { 2024-09-21T04:05:29.452 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cgroups_split", 2024-09-21T04:05:29.452 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.452 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.452 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.452 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.452 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.452 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.452 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.452 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T04:05:29.452 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.452 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.452 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.452 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.453 INFO:teuthology.orchestra.run.smithi046.stdout: "config_checks_enabled": { 2024-09-21T04:05:29.453 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "config_checks_enabled", 2024-09-21T04:05:29.453 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.453 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.453 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.453 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.453 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.453 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.453 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.453 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T04:05:29.454 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.454 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.454 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.454 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.454 INFO:teuthology.orchestra.run.smithi046.stdout: "config_dashboard": { 2024-09-21T04:05:29.454 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "config_dashboard", 2024-09-21T04:05:29.454 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.454 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.454 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.454 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.455 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.455 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.455 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.455 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T04:05:29.455 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.455 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.455 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.455 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.455 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_alertmanager": { 2024-09-21T04:05:29.455 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_alertmanager", 2024-09-21T04:05:29.455 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.455 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.456 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.456 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T04:05:29.456 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.456 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.456 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.456 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2024-09-21T04:05:29.456 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.456 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.456 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.456 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.456 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_base": { 2024-09-21T04:05:29.457 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_base", 2024-09-21T04:05:29.457 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.457 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.457 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.457 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T04:05:29.457 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.457 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.457 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.457 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Container image name, without the tag", 2024-09-21T04:05:29.457 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.457 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.457 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.458 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.458 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_elasticsearch": { 2024-09-21T04:05:29.458 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_elasticsearch", 2024-09-21T04:05:29.458 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.458 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.458 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.458 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T04:05:29.458 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.458 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.458 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.459 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "elasticsearch container image", 2024-09-21T04:05:29.459 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.459 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.459 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.459 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.459 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_grafana": { 2024-09-21T04:05:29.459 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_grafana", 2024-09-21T04:05:29.459 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.459 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.459 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.459 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T04:05:29.459 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.460 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.460 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.460 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2024-09-21T04:05:29.460 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.460 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.460 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.460 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.460 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_haproxy": { 2024-09-21T04:05:29.460 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_haproxy", 2024-09-21T04:05:29.460 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.460 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.460 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.460 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T04:05:29.460 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.461 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.461 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.461 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "HAproxy container image", 2024-09-21T04:05:29.461 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.461 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.461 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.461 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.461 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_jaeger_agent": { 2024-09-21T04:05:29.461 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_jaeger_agent", 2024-09-21T04:05:29.461 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.461 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.461 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.461 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T04:05:29.462 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.462 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.462 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.462 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Jaeger agent container image", 2024-09-21T04:05:29.462 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.462 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.462 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.462 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.462 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_jaeger_collector": { 2024-09-21T04:05:29.462 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_jaeger_collector", 2024-09-21T04:05:29.462 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.462 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.462 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.463 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T04:05:29.463 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.463 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.463 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.463 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Jaeger collector container image", 2024-09-21T04:05:29.463 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.463 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.463 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.463 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.463 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_jaeger_query": { 2024-09-21T04:05:29.463 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_jaeger_query", 2024-09-21T04:05:29.463 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.463 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.463 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.464 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T04:05:29.464 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.464 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.464 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.464 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Jaeger query container image", 2024-09-21T04:05:29.464 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.464 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.464 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.464 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.464 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_keepalived": { 2024-09-21T04:05:29.464 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_keepalived", 2024-09-21T04:05:29.464 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.464 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.464 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.465 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T04:05:29.465 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.465 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.465 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.465 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Keepalived container image", 2024-09-21T04:05:29.465 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.465 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.465 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.465 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.465 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_loki": { 2024-09-21T04:05:29.465 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_loki", 2024-09-21T04:05:29.465 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.465 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.465 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.466 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T04:05:29.466 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.466 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.466 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.466 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Loki container image", 2024-09-21T04:05:29.466 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.466 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.466 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.466 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.466 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_nginx": { 2024-09-21T04:05:29.466 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_nginx", 2024-09-21T04:05:29.466 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.466 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.466 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.467 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T04:05:29.467 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.467 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.467 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.467 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Nginx container image", 2024-09-21T04:05:29.467 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.467 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.467 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.467 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.467 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_node_exporter": { 2024-09-21T04:05:29.467 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_node_exporter", 2024-09-21T04:05:29.467 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.467 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.467 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.468 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T04:05:29.468 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.468 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.468 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.468 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2024-09-21T04:05:29.468 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.468 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.468 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.468 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.468 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_nvmeof": { 2024-09-21T04:05:29.468 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_nvmeof", 2024-09-21T04:05:29.468 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.468 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.468 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.469 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T04:05:29.469 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.469 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.469 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.469 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Nvme-of container image", 2024-09-21T04:05:29.469 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.469 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.469 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.469 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.469 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_oauth2_proxy": { 2024-09-21T04:05:29.469 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T04:05:29.469 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.469 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.469 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.470 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T04:05:29.470 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.470 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.470 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.470 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "oauth2-proxy container image", 2024-09-21T04:05:29.470 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.470 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.470 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.470 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.470 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_prometheus": { 2024-09-21T04:05:29.470 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_prometheus", 2024-09-21T04:05:29.470 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.470 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.470 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.471 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T04:05:29.471 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.471 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.471 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.471 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2024-09-21T04:05:29.471 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.471 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.471 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.471 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.471 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_promtail": { 2024-09-21T04:05:29.471 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_promtail", 2024-09-21T04:05:29.471 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.471 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.472 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.472 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T04:05:29.472 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.472 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.472 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.472 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Promtail container image", 2024-09-21T04:05:29.472 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.472 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.472 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.472 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.472 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_samba": { 2024-09-21T04:05:29.472 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_samba", 2024-09-21T04:05:29.472 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.472 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.473 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.473 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T04:05:29.473 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.473 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.473 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.473 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Samba/SMB container image", 2024-09-21T04:05:29.473 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.473 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.473 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.473 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.473 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_samba_metrics": { 2024-09-21T04:05:29.473 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_samba_metrics", 2024-09-21T04:05:29.473 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.474 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.474 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.474 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T04:05:29.474 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.474 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.474 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.474 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T04:05:29.474 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.474 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.474 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.474 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.474 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_snmp_gateway": { 2024-09-21T04:05:29.474 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_snmp_gateway", 2024-09-21T04:05:29.474 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.475 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.475 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.475 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T04:05:29.475 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.475 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.475 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.475 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SNMP Gateway container image", 2024-09-21T04:05:29.475 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.475 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.475 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.475 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.475 INFO:teuthology.orchestra.run.smithi046.stdout: "container_init": { 2024-09-21T04:05:29.475 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_init", 2024-09-21T04:05:29.476 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.476 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.476 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.476 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.476 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.476 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.476 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.476 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T04:05:29.476 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.476 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.476 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.476 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.476 INFO:teuthology.orchestra.run.smithi046.stdout: "daemon_cache_timeout": { 2024-09-21T04:05:29.476 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "daemon_cache_timeout", 2024-09-21T04:05:29.477 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:29.477 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.477 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.477 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2024-09-21T04:05:29.477 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.477 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.477 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.477 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T04:05:29.477 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.477 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.477 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.477 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.477 INFO:teuthology.orchestra.run.smithi046.stdout: "default_cephadm_command_timeout": { 2024-09-21T04:05:29.477 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T04:05:29.477 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.478 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.478 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.478 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "900", 2024-09-21T04:05:29.478 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.478 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.478 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.478 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T04:05:29.478 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.478 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.478 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.478 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.478 INFO:teuthology.orchestra.run.smithi046.stdout: "default_registry": { 2024-09-21T04:05:29.478 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "default_registry", 2024-09-21T04:05:29.479 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.479 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.479 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.479 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io", 2024-09-21T04:05:29.479 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.479 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.479 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.479 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T04:05:29.479 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.479 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.479 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.479 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.479 INFO:teuthology.orchestra.run.smithi046.stdout: "device_cache_timeout": { 2024-09-21T04:05:29.479 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "device_cache_timeout", 2024-09-21T04:05:29.479 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:29.480 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.480 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.480 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "1800", 2024-09-21T04:05:29.480 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.480 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.480 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.480 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "seconds to cache device inventory", 2024-09-21T04:05:29.480 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.480 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.480 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.480 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.480 INFO:teuthology.orchestra.run.smithi046.stdout: "device_enhanced_scan": { 2024-09-21T04:05:29.480 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "device_enhanced_scan", 2024-09-21T04:05:29.480 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.481 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.481 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.481 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.481 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.481 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.481 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.481 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T04:05:29.481 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.482 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.482 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.482 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.482 INFO:teuthology.orchestra.run.smithi046.stdout: "facts_cache_timeout": { 2024-09-21T04:05:29.482 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "facts_cache_timeout", 2024-09-21T04:05:29.482 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:29.482 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.482 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.482 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2024-09-21T04:05:29.482 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.482 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.482 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.482 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "seconds to cache host facts data", 2024-09-21T04:05:29.482 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.483 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.483 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.483 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.483 INFO:teuthology.orchestra.run.smithi046.stdout: "grafana_dashboards_path": { 2024-09-21T04:05:29.483 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "grafana_dashboards_path", 2024-09-21T04:05:29.483 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.483 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.483 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.483 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T04:05:29.483 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.483 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.484 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.484 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T04:05:29.484 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.484 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.484 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.484 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.484 INFO:teuthology.orchestra.run.smithi046.stdout: "host_check_interval": { 2024-09-21T04:05:29.484 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "host_check_interval", 2024-09-21T04:05:29.484 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:29.484 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.485 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.485 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2024-09-21T04:05:29.485 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.485 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.485 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.485 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to perform a host check", 2024-09-21T04:05:29.485 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.485 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.485 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.485 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.485 INFO:teuthology.orchestra.run.smithi046.stdout: "hw_monitoring": { 2024-09-21T04:05:29.486 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "hw_monitoring", 2024-09-21T04:05:29.486 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.486 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.486 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.486 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.486 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.486 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.486 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.486 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T04:05:29.486 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.486 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.487 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.487 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.487 INFO:teuthology.orchestra.run.smithi046.stdout: "inventory_list_all": { 2024-09-21T04:05:29.487 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "inventory_list_all", 2024-09-21T04:05:29.487 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.487 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.487 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.487 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.487 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.487 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.487 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.487 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T04:05:29.488 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.488 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.488 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.488 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.488 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.488 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.488 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.488 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.488 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.488 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.488 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.488 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.489 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.489 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.489 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.489 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.489 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.489 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.489 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.489 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.489 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.489 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.489 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.489 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.489 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.489 INFO:teuthology.orchestra.run.smithi046.stdout: "log_refresh_metadata": { 2024-09-21T04:05:29.489 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_refresh_metadata", 2024-09-21T04:05:29.489 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.490 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.490 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.490 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.490 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.490 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.490 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.490 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T04:05:29.490 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.490 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.490 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.490 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.490 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.490 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.490 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.491 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.491 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.491 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.491 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.491 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.491 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.491 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T04:05:29.491 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.491 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.491 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.491 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.491 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.491 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.491 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.492 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.492 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.492 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.492 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.492 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.492 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.492 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.492 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.492 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.492 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.492 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.492 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.492 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.493 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.493 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.493 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.493 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.493 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.493 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.493 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.493 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.493 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.493 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.493 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.493 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.493 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.493 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.494 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.494 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.494 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.494 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.494 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.494 INFO:teuthology.orchestra.run.smithi046.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T04:05:29.494 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T04:05:29.494 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.494 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.494 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.494 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.494 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.494 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.495 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.495 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T04:05:29.495 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.495 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.495 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.495 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.495 INFO:teuthology.orchestra.run.smithi046.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T04:05:29.495 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T04:05:29.495 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.495 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.495 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.495 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "*", 2024-09-21T04:05:29.495 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.495 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.496 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.496 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T04:05:29.496 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.496 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.496 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.496 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.496 INFO:teuthology.orchestra.run.smithi046.stdout: "max_count_per_host": { 2024-09-21T04:05:29.496 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_count_per_host", 2024-09-21T04:05:29.496 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.496 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.496 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.496 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-21T04:05:29.496 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.497 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.497 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.497 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "max number of daemons per service per host", 2024-09-21T04:05:29.497 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.497 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.497 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.497 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.497 INFO:teuthology.orchestra.run.smithi046.stdout: "max_osd_draining_count": { 2024-09-21T04:05:29.497 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_osd_draining_count", 2024-09-21T04:05:29.497 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.497 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.497 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.497 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-21T04:05:29.497 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.498 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.498 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.498 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T04:05:29.498 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.498 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.498 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.498 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.498 INFO:teuthology.orchestra.run.smithi046.stdout: "migration_current": { 2024-09-21T04:05:29.498 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "migration_current", 2024-09-21T04:05:29.498 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.498 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.498 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.498 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.499 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.499 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.499 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.499 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "internal - do not modify", 2024-09-21T04:05:29.499 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.499 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.499 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.499 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.499 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": { 2024-09-21T04:05:29.499 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mode", 2024-09-21T04:05:29.499 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.499 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.499 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.499 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "root", 2024-09-21T04:05:29.500 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.500 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.500 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.500 INFO:teuthology.orchestra.run.smithi046.stdout: "cephadm-package", 2024-09-21T04:05:29.500 INFO:teuthology.orchestra.run.smithi046.stdout: "root" 2024-09-21T04:05:29.500 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.500 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T04:05:29.500 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.500 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.500 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.500 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.500 INFO:teuthology.orchestra.run.smithi046.stdout: "oob_default_addr": { 2024-09-21T04:05:29.500 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "oob_default_addr", 2024-09-21T04:05:29.500 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.501 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.501 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.501 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "169.254.1.1", 2024-09-21T04:05:29.501 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.501 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.501 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.501 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T04:05:29.501 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.501 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.501 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.501 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.501 INFO:teuthology.orchestra.run.smithi046.stdout: "prometheus_alerts_path": { 2024-09-21T04:05:29.501 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "prometheus_alerts_path", 2024-09-21T04:05:29.501 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.502 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.502 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.502 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T04:05:29.502 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.502 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.502 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.502 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T04:05:29.502 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.502 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.502 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.502 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.502 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_insecure": { 2024-09-21T04:05:29.502 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_insecure", 2024-09-21T04:05:29.502 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.503 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.503 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.503 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.503 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.503 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.503 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.503 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T04:05:29.503 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.503 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.503 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.503 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.503 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_password": { 2024-09-21T04:05:29.503 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_password", 2024-09-21T04:05:29.503 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.504 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.504 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.504 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.504 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.504 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.504 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.504 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T04:05:29.504 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.504 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.504 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.504 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.504 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_url": { 2024-09-21T04:05:29.504 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_url", 2024-09-21T04:05:29.504 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.504 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.505 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.505 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.505 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.505 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.505 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.505 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T04:05:29.505 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.505 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.505 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.505 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.505 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_username": { 2024-09-21T04:05:29.505 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_username", 2024-09-21T04:05:29.505 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.505 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.506 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.506 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.506 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.506 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.506 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.506 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T04:05:29.506 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.506 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.506 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.506 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.506 INFO:teuthology.orchestra.run.smithi046.stdout: "secure_monitoring_stack": { 2024-09-21T04:05:29.506 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "secure_monitoring_stack", 2024-09-21T04:05:29.506 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.506 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.507 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.507 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.507 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.507 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.507 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.507 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T04:05:29.507 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.507 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.507 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.507 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.507 INFO:teuthology.orchestra.run.smithi046.stdout: "service_discovery_port": { 2024-09-21T04:05:29.507 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "service_discovery_port", 2024-09-21T04:05:29.507 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.507 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.508 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.508 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8765", 2024-09-21T04:05:29.508 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.508 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.508 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.508 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "cephadm service discovery port", 2024-09-21T04:05:29.508 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.508 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.508 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.508 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.508 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.508 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.508 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.508 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.509 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.509 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.509 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.509 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.509 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.509 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.509 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.509 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.509 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.509 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.509 INFO:teuthology.orchestra.run.smithi046.stdout: "ssh_config_file": { 2024-09-21T04:05:29.509 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssh_config_file", 2024-09-21T04:05:29.509 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.509 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.509 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.510 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.510 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.510 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.510 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.510 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T04:05:29.510 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.510 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.510 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.510 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.510 INFO:teuthology.orchestra.run.smithi046.stdout: "ssh_keepalive_count_max": { 2024-09-21T04:05:29.510 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T04:05:29.510 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.511 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.511 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.511 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "3", 2024-09-21T04:05:29.511 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.511 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.511 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.511 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T04:05:29.511 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.511 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.511 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.511 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.511 INFO:teuthology.orchestra.run.smithi046.stdout: "ssh_keepalive_interval": { 2024-09-21T04:05:29.511 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssh_keepalive_interval", 2024-09-21T04:05:29.511 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.512 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.512 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.512 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "7", 2024-09-21T04:05:29.512 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.512 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.512 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.512 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T04:05:29.512 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.512 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.512 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.512 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.512 INFO:teuthology.orchestra.run.smithi046.stdout: "use_agent": { 2024-09-21T04:05:29.512 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "use_agent", 2024-09-21T04:05:29.512 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.513 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.513 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.513 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.513 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.513 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.513 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.513 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T04:05:29.513 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.513 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.513 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.513 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.513 INFO:teuthology.orchestra.run.smithi046.stdout: "use_repo_digest": { 2024-09-21T04:05:29.513 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "use_repo_digest", 2024-09-21T04:05:29.513 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.514 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.514 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.514 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.514 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.514 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.514 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.514 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T04:05:29.514 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.514 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.514 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.514 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.514 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_on_failed_host_check": { 2024-09-21T04:05:29.514 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_on_failed_host_check", 2024-09-21T04:05:29.515 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.515 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.515 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.515 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.515 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.515 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.515 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.515 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T04:05:29.515 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.515 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.515 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.515 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.515 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_on_stray_daemons": { 2024-09-21T04:05:29.515 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_on_stray_daemons", 2024-09-21T04:05:29.516 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.516 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.516 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.516 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.516 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.516 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.516 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.516 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T04:05:29.516 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.516 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.516 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.516 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.516 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_on_stray_hosts": { 2024-09-21T04:05:29.516 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_on_stray_hosts", 2024-09-21T04:05:29.516 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.517 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.517 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.517 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.517 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.517 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.517 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.517 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T04:05:29.517 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.517 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.517 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.517 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.517 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.517 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.517 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.518 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crash", 2024-09-21T04:05:29.518 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.518 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.518 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.518 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.518 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.518 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.518 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.518 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.518 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.518 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.518 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.518 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.518 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.519 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.519 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.519 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.519 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.519 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.519 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.519 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.519 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.519 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.519 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.519 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.519 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.519 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.519 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.520 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.520 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.520 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.520 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.520 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.520 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.520 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.520 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.520 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.520 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.520 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.520 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.520 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.520 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.520 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.521 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.521 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.521 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.521 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.521 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.521 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.521 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.521 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.521 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.521 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.521 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.521 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.521 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.521 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.522 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.522 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.522 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.522 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.522 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.522 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.522 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.522 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.522 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.522 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.522 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.522 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.522 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.523 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.523 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.523 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.523 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.523 INFO:teuthology.orchestra.run.smithi046.stdout: "retain_interval": { 2024-09-21T04:05:29.523 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "retain_interval", 2024-09-21T04:05:29.523 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:29.523 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.523 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.523 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "31536000", 2024-09-21T04:05:29.523 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.523 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.523 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.524 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T04:05:29.524 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.524 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.524 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.524 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.524 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.524 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.524 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.524 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.524 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.524 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.524 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.524 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.524 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.525 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.525 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.525 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.525 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.525 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.525 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_recent_interval": { 2024-09-21T04:05:29.525 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_recent_interval", 2024-09-21T04:05:29.525 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:29.525 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.525 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.525 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "1209600", 2024-09-21T04:05:29.525 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.525 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.526 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.526 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T04:05:29.526 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.526 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.526 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.526 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.526 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.526 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.526 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.526 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "dashboard", 2024-09-21T04:05:29.526 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.526 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.526 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.527 INFO:teuthology.orchestra.run.smithi046.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T04:05:29.527 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T04:05:29.527 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.527 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.527 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.527 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-21T04:05:29.527 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.527 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.527 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.527 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.527 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.527 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.527 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.527 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.528 INFO:teuthology.orchestra.run.smithi046.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T04:05:29.528 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T04:05:29.528 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.528 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.528 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.528 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.528 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.528 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.528 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.528 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.528 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.528 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.528 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.528 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.529 INFO:teuthology.orchestra.run.smithi046.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T04:05:29.529 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T04:05:29.529 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.529 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.529 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.529 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.529 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.529 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.529 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.529 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.529 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.529 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.529 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.529 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.530 INFO:teuthology.orchestra.run.smithi046.stdout: "AUDIT_API_ENABLED": { 2024-09-21T04:05:29.530 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T04:05:29.530 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.530 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.530 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.530 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.530 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.530 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.530 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.530 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.530 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.530 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.530 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.531 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.531 INFO:teuthology.orchestra.run.smithi046.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T04:05:29.531 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T04:05:29.531 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.531 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.531 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.531 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.531 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.531 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.531 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.531 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.531 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.531 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.531 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.532 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.532 INFO:teuthology.orchestra.run.smithi046.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T04:05:29.532 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T04:05:29.532 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.532 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.532 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.532 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.532 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.532 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.532 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.532 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.532 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.532 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.532 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.532 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.533 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T04:05:29.533 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T04:05:29.533 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.533 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.533 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.533 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.533 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.533 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.533 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.533 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.533 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.533 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.533 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.533 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.533 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T04:05:29.534 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T04:05:29.534 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.534 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.534 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.534 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.534 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.534 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.534 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.534 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.534 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.534 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.534 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.534 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.535 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T04:05:29.535 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T04:05:29.535 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.535 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.535 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.535 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.535 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.535 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.535 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.535 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.535 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.535 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.535 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.535 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.535 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T04:05:29.536 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T04:05:29.536 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.536 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.536 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.536 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.536 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.536 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.536 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.536 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.536 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.536 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.536 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.536 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.537 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T04:05:29.537 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T04:05:29.537 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.537 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.537 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.537 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.537 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.537 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.537 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.537 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.537 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.537 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.537 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.537 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.538 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T04:05:29.538 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T04:05:29.538 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.538 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.538 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.538 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.538 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.538 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.538 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.538 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.538 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.538 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.538 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.539 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.539 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T04:05:29.539 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T04:05:29.539 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.539 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.539 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.539 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.539 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.539 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.539 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.539 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.539 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.539 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.539 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.540 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.540 INFO:teuthology.orchestra.run.smithi046.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T04:05:29.540 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T04:05:29.540 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.540 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.540 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.540 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.540 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.540 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.540 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.540 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.540 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.540 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.540 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.541 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.541 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T04:05:29.541 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T04:05:29.541 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.541 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.541 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.541 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "admin", 2024-09-21T04:05:29.541 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.541 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.541 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.541 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.541 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.541 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.542 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.542 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.542 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T04:05:29.542 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T04:05:29.542 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.542 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.542 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.542 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.542 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.542 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.542 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.542 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.542 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.543 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.543 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.543 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.543 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_URL": { 2024-09-21T04:05:29.543 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_URL", 2024-09-21T04:05:29.543 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.543 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.543 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.543 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.543 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.543 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.543 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.543 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.543 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.543 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.544 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.544 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.544 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T04:05:29.544 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T04:05:29.544 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.544 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.544 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.544 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "admin", 2024-09-21T04:05:29.544 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.544 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.544 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.544 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.544 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.544 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.545 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.545 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.545 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T04:05:29.545 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T04:05:29.545 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.545 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.545 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.545 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.545 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.545 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.545 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.545 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.545 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.545 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.546 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.546 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.546 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T04:05:29.546 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T04:05:29.546 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.546 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.546 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.546 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.546 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.546 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.546 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.546 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.546 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.546 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.547 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.547 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.547 INFO:teuthology.orchestra.run.smithi046.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T04:05:29.547 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T04:05:29.547 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.547 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.547 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.547 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.547 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.547 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.547 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.547 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.547 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.547 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.548 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.548 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.548 INFO:teuthology.orchestra.run.smithi046.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T04:05:29.548 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T04:05:29.548 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.548 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.548 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.548 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.548 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.548 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.548 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.548 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.548 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.548 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.549 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.549 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.549 INFO:teuthology.orchestra.run.smithi046.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T04:05:29.549 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T04:05:29.549 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.549 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.549 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.549 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "[]", 2024-09-21T04:05:29.549 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.549 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.549 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.549 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.549 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.549 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.549 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.550 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.550 INFO:teuthology.orchestra.run.smithi046.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T04:05:29.550 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T04:05:29.550 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.550 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.550 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.550 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "{}", 2024-09-21T04:05:29.550 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.550 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.550 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.550 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.550 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.550 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.550 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.551 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.551 INFO:teuthology.orchestra.run.smithi046.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T04:05:29.551 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T04:05:29.551 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.551 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.551 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.551 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.551 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.551 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.551 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.551 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.551 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.551 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.551 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.552 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.552 INFO:teuthology.orchestra.run.smithi046.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T04:05:29.552 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T04:05:29.552 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.552 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.552 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.552 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.552 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.552 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.552 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.552 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.552 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.552 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.552 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.552 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.553 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T04:05:29.553 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T04:05:29.553 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.553 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.553 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.553 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.553 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.553 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.553 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.553 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.553 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.553 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.553 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.554 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.554 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T04:05:29.554 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T04:05:29.554 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.554 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.554 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.554 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.554 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.554 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.554 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.554 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.554 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.554 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.555 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.555 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.555 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T04:05:29.555 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T04:05:29.555 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.555 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.555 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.555 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.555 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.555 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.555 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.555 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.555 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.555 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.555 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.556 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.556 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T04:05:29.556 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T04:05:29.556 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.556 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.556 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.556 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.556 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.556 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.556 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.556 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.556 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.556 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.556 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.557 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.557 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T04:05:29.557 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T04:05:29.557 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.557 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.557 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.557 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.557 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.557 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.557 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.557 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.557 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.557 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.557 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.558 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.558 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T04:05:29.558 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T04:05:29.558 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.558 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.558 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.558 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.558 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.558 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.558 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.558 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.558 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.558 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.558 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.559 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.559 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T04:05:29.559 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T04:05:29.559 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.559 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.559 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.559 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.559 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.559 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.559 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.559 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.559 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.559 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.559 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.560 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.560 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T04:05:29.560 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T04:05:29.560 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.560 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.560 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.560 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.560 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.560 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.560 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.560 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.560 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.560 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.560 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.561 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.561 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T04:05:29.561 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T04:05:29.561 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.561 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.561 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.561 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T04:05:29.561 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.561 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.561 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.561 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.561 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.561 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.561 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.562 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.562 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T04:05:29.562 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T04:05:29.562 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.562 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.562 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.562 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-21T04:05:29.562 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.562 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.562 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.562 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.562 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.563 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.563 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.563 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.563 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T04:05:29.563 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T04:05:29.563 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.563 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.563 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.563 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8", 2024-09-21T04:05:29.563 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.563 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.563 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.563 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.563 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.564 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.564 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.564 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.564 INFO:teuthology.orchestra.run.smithi046.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T04:05:29.564 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T04:05:29.564 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.564 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.564 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.564 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "45", 2024-09-21T04:05:29.564 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.564 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.564 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.564 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.564 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.565 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.565 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.565 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.565 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T04:05:29.565 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T04:05:29.565 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.565 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.565 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.565 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.565 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.565 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.565 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.565 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.566 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.566 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.566 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.566 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.566 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T04:05:29.566 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T04:05:29.566 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.566 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.566 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.566 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "admin", 2024-09-21T04:05:29.566 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.566 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.566 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.566 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T04:05:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T04:05:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.568 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.568 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.568 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.568 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.568 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.568 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T04:05:29.568 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T04:05:29.568 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.568 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.568 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.568 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.568 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.568 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.568 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.569 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.569 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.569 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.569 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.569 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.569 INFO:teuthology.orchestra.run.smithi046.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T04:05:29.569 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T04:05:29.569 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.569 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.569 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.569 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.569 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.569 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.569 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.569 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.570 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.570 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.570 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.570 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.570 INFO:teuthology.orchestra.run.smithi046.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T04:05:29.570 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T04:05:29.570 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.570 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.570 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.570 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.570 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.570 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.570 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.571 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.571 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.571 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.571 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.571 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.571 INFO:teuthology.orchestra.run.smithi046.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T04:05:29.571 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T04:05:29.571 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.571 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.571 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.571 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-21T04:05:29.571 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.571 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.571 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.571 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.572 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.572 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.572 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.572 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.572 INFO:teuthology.orchestra.run.smithi046.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T04:05:29.572 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T04:05:29.572 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.572 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.572 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.572 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2024-09-21T04:05:29.572 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.572 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.572 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.573 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.573 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.573 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.573 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.573 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.573 INFO:teuthology.orchestra.run.smithi046.stdout: "cross_origin_url": { 2024-09-21T04:05:29.573 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cross_origin_url", 2024-09-21T04:05:29.573 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.573 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.573 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.573 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.573 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.573 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.573 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.573 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.574 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.574 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.574 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.574 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.574 INFO:teuthology.orchestra.run.smithi046.stdout: "crt_file": { 2024-09-21T04:05:29.574 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crt_file", 2024-09-21T04:05:29.574 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.574 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.574 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.574 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.574 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.574 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.574 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.574 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.575 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.575 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.575 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.575 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.575 INFO:teuthology.orchestra.run.smithi046.stdout: "debug": { 2024-09-21T04:05:29.575 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "debug", 2024-09-21T04:05:29.575 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.575 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.575 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.575 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.575 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.575 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.575 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.575 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Enable/disable debug options", 2024-09-21T04:05:29.576 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.576 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.576 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.576 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.576 INFO:teuthology.orchestra.run.smithi046.stdout: "jwt_token_ttl": { 2024-09-21T04:05:29.576 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "jwt_token_ttl", 2024-09-21T04:05:29.576 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.576 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.576 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.576 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "28800", 2024-09-21T04:05:29.576 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.576 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.576 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.577 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.577 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.577 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.577 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.577 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.577 INFO:teuthology.orchestra.run.smithi046.stdout: "key_file": { 2024-09-21T04:05:29.577 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "key_file", 2024-09-21T04:05:29.577 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.577 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.577 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.577 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.577 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.577 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.577 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.578 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.578 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.578 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.578 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.578 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.578 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.578 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.578 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.578 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.578 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.578 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.578 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.578 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.578 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.579 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.579 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.579 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.579 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.579 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.579 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.579 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.579 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.579 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.579 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.579 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.579 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.579 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.579 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.580 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.580 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.580 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.580 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.580 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.580 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.580 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.580 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.580 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.580 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.580 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.580 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.580 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.580 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.581 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.581 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.581 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.581 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.581 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.581 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.581 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.581 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.581 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.581 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.581 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.581 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.581 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.581 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.582 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.582 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.582 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.582 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.582 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.582 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.582 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.582 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.582 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.582 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.582 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.582 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.582 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.582 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.583 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.583 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.583 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.583 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.583 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.583 INFO:teuthology.orchestra.run.smithi046.stdout: "motd": { 2024-09-21T04:05:29.583 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "motd", 2024-09-21T04:05:29.583 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.583 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.583 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.583 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.583 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.583 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.583 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.584 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "The message of the day", 2024-09-21T04:05:29.584 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.584 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.584 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.584 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.584 INFO:teuthology.orchestra.run.smithi046.stdout: "redirect_resolve_ip_addr": { 2024-09-21T04:05:29.584 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T04:05:29.584 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.584 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.584 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.584 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.584 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.584 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.584 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.584 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.585 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.585 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.585 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.585 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.585 INFO:teuthology.orchestra.run.smithi046.stdout: "server_addr": { 2024-09-21T04:05:29.585 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_addr", 2024-09-21T04:05:29.585 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.585 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.585 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.585 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "::", 2024-09-21T04:05:29.585 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.585 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.585 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.585 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.586 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.586 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.586 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.586 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.586 INFO:teuthology.orchestra.run.smithi046.stdout: "server_port": { 2024-09-21T04:05:29.586 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_port", 2024-09-21T04:05:29.586 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.586 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.586 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.586 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8080", 2024-09-21T04:05:29.586 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.586 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.586 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.586 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.587 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.587 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.587 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.587 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.587 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.587 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.587 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.587 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.587 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.587 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.587 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.587 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.587 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.587 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.587 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.588 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.588 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.588 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.588 INFO:teuthology.orchestra.run.smithi046.stdout: "ssl": { 2024-09-21T04:05:29.588 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssl", 2024-09-21T04:05:29.588 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.588 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.588 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.588 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.588 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.588 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.588 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.588 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.588 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.589 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.589 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.589 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.589 INFO:teuthology.orchestra.run.smithi046.stdout: "ssl_server_port": { 2024-09-21T04:05:29.589 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssl_server_port", 2024-09-21T04:05:29.589 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.589 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.589 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.589 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8443", 2024-09-21T04:05:29.589 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.589 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.589 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.589 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.590 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.590 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.590 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.590 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.590 INFO:teuthology.orchestra.run.smithi046.stdout: "sso_oauth2": { 2024-09-21T04:05:29.590 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sso_oauth2", 2024-09-21T04:05:29.590 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.590 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.590 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.590 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.590 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.590 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.590 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.590 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.591 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.591 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.591 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.591 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.591 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_behaviour": { 2024-09-21T04:05:29.591 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_behaviour", 2024-09-21T04:05:29.591 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.591 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.591 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.591 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "redirect", 2024-09-21T04:05:29.591 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.591 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.591 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.591 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.591 INFO:teuthology.orchestra.run.smithi046.stdout: "redirect" 2024-09-21T04:05:29.592 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.592 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.592 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.592 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.592 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.592 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.592 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_error_status_code": { 2024-09-21T04:05:29.592 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_error_status_code", 2024-09-21T04:05:29.592 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.592 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.592 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.592 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "500", 2024-09-21T04:05:29.592 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "400", 2024-09-21T04:05:29.592 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "599", 2024-09-21T04:05:29.593 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.593 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.593 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.593 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.593 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.593 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.593 INFO:teuthology.orchestra.run.smithi046.stdout: "url_prefix": { 2024-09-21T04:05:29.593 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "url_prefix", 2024-09-21T04:05:29.593 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.593 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.593 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.593 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.593 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.593 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.593 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.594 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.594 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.594 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.594 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.594 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.594 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.594 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.594 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.594 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "devicehealth", 2024-09-21T04:05:29.594 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.594 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.594 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.594 INFO:teuthology.orchestra.run.smithi046.stdout: "enable_monitoring": { 2024-09-21T04:05:29.595 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enable_monitoring", 2024-09-21T04:05:29.595 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.595 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.595 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.595 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.595 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.595 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.595 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.595 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "monitor device health metrics", 2024-09-21T04:05:29.595 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.595 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.595 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.595 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.595 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.595 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.596 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.596 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.596 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.596 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.596 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.596 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.596 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.596 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.596 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.596 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.596 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.596 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.596 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.596 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.597 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.597 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.597 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.597 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.597 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.597 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.597 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.597 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.597 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.597 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.597 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.597 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.597 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.597 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.597 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.598 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.598 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.598 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.598 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.598 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.598 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.598 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.598 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.598 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.598 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.598 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.598 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.598 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.598 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.599 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.599 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.599 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.599 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.599 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.599 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.599 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.599 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.599 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.599 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.599 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.599 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.599 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.599 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.600 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.600 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.600 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.600 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.600 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.600 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.600 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.600 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.600 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.600 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.600 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.600 INFO:teuthology.orchestra.run.smithi046.stdout: "mark_out_threshold": { 2024-09-21T04:05:29.600 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mark_out_threshold", 2024-09-21T04:05:29.600 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:29.601 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.601 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.601 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "2419200", 2024-09-21T04:05:29.601 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.601 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.601 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.601 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T04:05:29.601 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.601 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.601 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.601 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.601 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_name": { 2024-09-21T04:05:29.601 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pool_name", 2024-09-21T04:05:29.601 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.601 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.602 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.602 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "device_health_metrics", 2024-09-21T04:05:29.602 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.602 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.602 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.602 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T04:05:29.602 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.602 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.602 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.602 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.602 INFO:teuthology.orchestra.run.smithi046.stdout: "retention_period": { 2024-09-21T04:05:29.602 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "retention_period", 2024-09-21T04:05:29.602 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:29.602 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.603 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.603 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "15552000", 2024-09-21T04:05:29.603 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.603 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.603 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.603 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how long to retain device health metrics", 2024-09-21T04:05:29.603 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.603 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.603 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.603 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.603 INFO:teuthology.orchestra.run.smithi046.stdout: "scrape_frequency": { 2024-09-21T04:05:29.603 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "scrape_frequency", 2024-09-21T04:05:29.603 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:29.604 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.604 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.604 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "86400", 2024-09-21T04:05:29.604 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.604 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.604 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.604 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T04:05:29.604 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.604 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.604 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.604 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.604 INFO:teuthology.orchestra.run.smithi046.stdout: "self_heal": { 2024-09-21T04:05:29.604 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "self_heal", 2024-09-21T04:05:29.604 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.604 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.605 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.605 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.605 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.605 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.605 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.605 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T04:05:29.605 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.605 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.605 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.605 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.605 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2024-09-21T04:05:29.605 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2024-09-21T04:05:29.605 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:29.605 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.606 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.606 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2024-09-21T04:05:29.606 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.606 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.606 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.606 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T04:05:29.606 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.606 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.606 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.606 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.606 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.606 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.606 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.606 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.607 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.607 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.607 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.607 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.607 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.607 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.607 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.607 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.607 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.607 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.607 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_threshold": { 2024-09-21T04:05:29.607 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_threshold", 2024-09-21T04:05:29.607 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:29.607 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.607 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.608 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "7257600", 2024-09-21T04:05:29.608 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.608 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.608 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.608 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T04:05:29.608 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.608 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.608 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.608 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.608 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.608 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.608 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.608 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "diskprediction_local", 2024-09-21T04:05:29.608 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.609 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.609 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.609 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.609 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.609 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.609 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.609 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.609 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.609 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.609 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.609 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.609 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.609 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.609 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.609 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.610 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.610 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.610 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.610 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.610 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.610 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.610 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.610 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.610 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.610 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.610 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.610 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.610 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.610 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.611 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.611 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.611 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.611 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.611 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.611 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.611 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.611 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.611 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.611 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.611 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.611 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.611 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.611 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.612 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.612 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.612 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.612 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.612 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.612 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.612 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.612 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.612 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.612 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.612 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.612 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.612 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.612 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.612 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.613 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.613 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.613 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.613 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.613 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.613 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.613 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.613 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.613 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.613 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.613 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.613 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.613 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.613 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.614 INFO:teuthology.orchestra.run.smithi046.stdout: "predict_interval": { 2024-09-21T04:05:29.614 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "predict_interval", 2024-09-21T04:05:29.614 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.614 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.614 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.614 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "86400", 2024-09-21T04:05:29.614 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.614 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.614 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.614 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.614 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.614 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.614 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.614 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.615 INFO:teuthology.orchestra.run.smithi046.stdout: "predictor_model": { 2024-09-21T04:05:29.615 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "predictor_model", 2024-09-21T04:05:29.615 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.615 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.615 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.615 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "prophetstor", 2024-09-21T04:05:29.615 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.615 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.615 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.615 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.615 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.615 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.615 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.615 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.615 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2024-09-21T04:05:29.616 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2024-09-21T04:05:29.616 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.616 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.616 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.616 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2024-09-21T04:05:29.616 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.616 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.616 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.616 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.616 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.616 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.616 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.616 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.617 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.617 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.617 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.617 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.617 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.617 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.617 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.617 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.617 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.617 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.617 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.617 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.617 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.617 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.618 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.618 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.618 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.618 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "influx", 2024-09-21T04:05:29.618 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": false, 2024-09-21T04:05:29.618 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "influxdb python module not found", 2024-09-21T04:05:29.618 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.618 INFO:teuthology.orchestra.run.smithi046.stdout: "batch_size": { 2024-09-21T04:05:29.618 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "batch_size", 2024-09-21T04:05:29.618 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.618 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.618 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.618 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5000", 2024-09-21T04:05:29.618 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.619 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.619 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.619 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T04:05:29.619 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.619 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.619 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.619 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.619 INFO:teuthology.orchestra.run.smithi046.stdout: "database": { 2024-09-21T04:05:29.619 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "database", 2024-09-21T04:05:29.619 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.619 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.619 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.619 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "ceph", 2024-09-21T04:05:29.619 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.620 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.620 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.620 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T04:05:29.620 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.620 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.620 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.620 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.620 INFO:teuthology.orchestra.run.smithi046.stdout: "hostname": { 2024-09-21T04:05:29.620 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "hostname", 2024-09-21T04:05:29.620 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.620 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.620 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.620 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.620 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.621 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.621 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.621 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "InfluxDB server hostname", 2024-09-21T04:05:29.621 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.621 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.621 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.621 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.621 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2024-09-21T04:05:29.621 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2024-09-21T04:05:29.621 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:29.621 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.621 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.621 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "30", 2024-09-21T04:05:29.621 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "5", 2024-09-21T04:05:29.622 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.622 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.622 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T04:05:29.622 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.622 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.622 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.622 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.622 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.622 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.622 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.622 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.622 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.622 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.623 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.623 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.623 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.623 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.623 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.623 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.623 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.623 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.623 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.623 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.623 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.623 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.623 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.623 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.624 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.624 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.624 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.624 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.624 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.624 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.624 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.624 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.624 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.624 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.624 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.624 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.624 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.624 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.624 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.625 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.625 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.625 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.625 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.625 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.625 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.625 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.625 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.625 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.625 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.625 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.625 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.625 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.625 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.626 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.626 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.626 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.626 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.626 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.626 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.626 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.626 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.626 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.626 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.626 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.626 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.626 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.626 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.627 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.627 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.627 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.627 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.627 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.627 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.627 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.627 INFO:teuthology.orchestra.run.smithi046.stdout: "password": { 2024-09-21T04:05:29.627 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "password", 2024-09-21T04:05:29.627 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.627 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.627 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.627 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.627 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.627 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.628 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.628 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "password of InfluxDB server user", 2024-09-21T04:05:29.628 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.628 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.628 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.628 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.628 INFO:teuthology.orchestra.run.smithi046.stdout: "port": { 2024-09-21T04:05:29.628 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "port", 2024-09-21T04:05:29.628 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.628 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.628 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.628 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8086", 2024-09-21T04:05:29.628 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.628 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.629 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.629 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "InfluxDB server port", 2024-09-21T04:05:29.629 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.629 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.629 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.629 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.629 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.629 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.629 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.629 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.629 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.629 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.629 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.629 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.630 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.630 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.630 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.630 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.630 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.630 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.630 INFO:teuthology.orchestra.run.smithi046.stdout: "ssl": { 2024-09-21T04:05:29.630 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssl", 2024-09-21T04:05:29.630 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.630 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.630 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.630 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "false", 2024-09-21T04:05:29.630 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.630 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.631 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.631 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T04:05:29.631 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.631 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.631 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.631 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.631 INFO:teuthology.orchestra.run.smithi046.stdout: "threads": { 2024-09-21T04:05:29.631 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "threads", 2024-09-21T04:05:29.631 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.631 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.631 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.631 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2024-09-21T04:05:29.631 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2024-09-21T04:05:29.631 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "32", 2024-09-21T04:05:29.632 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.632 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T04:05:29.632 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.632 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.632 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.632 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.632 INFO:teuthology.orchestra.run.smithi046.stdout: "username": { 2024-09-21T04:05:29.632 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "username", 2024-09-21T04:05:29.632 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.632 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.632 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.632 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.632 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.632 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.633 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.633 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "username of InfluxDB server user", 2024-09-21T04:05:29.633 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.633 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.633 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.633 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.633 INFO:teuthology.orchestra.run.smithi046.stdout: "verify_ssl": { 2024-09-21T04:05:29.633 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "verify_ssl", 2024-09-21T04:05:29.633 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.633 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.633 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.633 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "true", 2024-09-21T04:05:29.633 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.633 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.634 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.634 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T04:05:29.634 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.634 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.634 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.634 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.634 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.634 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.634 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.634 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "insights", 2024-09-21T04:05:29.634 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.634 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.634 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.634 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.635 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.635 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.635 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.635 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.635 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.635 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.635 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.635 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.635 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.635 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.635 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.635 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.635 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.635 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.635 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.636 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.636 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.636 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.636 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.636 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.636 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.636 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.636 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.636 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.636 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.636 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.636 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.636 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.636 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.637 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.637 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.637 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.637 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.637 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.637 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.637 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.637 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.637 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.637 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.637 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.637 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.637 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.637 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.638 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.638 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.638 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.638 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.638 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.638 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.638 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.638 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.638 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.638 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.638 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.638 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.638 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.638 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.639 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.639 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.639 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.639 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.639 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.639 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.639 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.639 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.639 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.639 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.639 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.639 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.639 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.640 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.640 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.640 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.640 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.640 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.640 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.640 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.640 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.640 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.640 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.640 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.640 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.640 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.640 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.641 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.641 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.641 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "iostat", 2024-09-21T04:05:29.641 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.641 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.641 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.641 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.641 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.641 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.641 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.641 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.641 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.641 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.641 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.641 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.642 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.642 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.642 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.642 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.642 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.642 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.642 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.642 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.642 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.642 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.642 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.642 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.642 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.642 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.642 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.643 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.643 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.643 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.643 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.643 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.643 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.643 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.643 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.643 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.643 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.643 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.643 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.643 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.644 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.644 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.644 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.644 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.644 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.644 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.644 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.644 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.644 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.644 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.644 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.644 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.644 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.644 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.645 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.645 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.645 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.645 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.645 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.645 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.645 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.645 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.645 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.645 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.645 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.645 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.645 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.645 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.646 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.646 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.646 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.646 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.646 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.646 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.646 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.646 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.646 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.646 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.646 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.646 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.646 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.647 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.647 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.647 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.647 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.647 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.647 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.647 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.647 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.647 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.647 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "k8sevents", 2024-09-21T04:05:29.647 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.647 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.647 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.647 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_event_retention_days": { 2024-09-21T04:05:29.648 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ceph_event_retention_days", 2024-09-21T04:05:29.648 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.648 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.648 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.648 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "7", 2024-09-21T04:05:29.648 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.648 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.648 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.648 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T04:05:29.648 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.648 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.648 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.648 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.648 INFO:teuthology.orchestra.run.smithi046.stdout: "config_check_secs": { 2024-09-21T04:05:29.649 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "config_check_secs", 2024-09-21T04:05:29.649 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.649 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.649 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.649 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-21T04:05:29.649 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "10", 2024-09-21T04:05:29.649 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.649 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.649 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T04:05:29.649 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.649 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.649 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.649 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.649 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.650 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.650 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.650 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.650 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.650 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.650 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.650 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.650 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.650 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.650 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.650 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.650 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.650 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.650 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.651 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.651 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.651 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.651 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.651 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.651 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.651 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.651 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.651 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.651 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.651 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.651 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.651 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.651 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.651 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.652 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.652 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.652 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.652 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.652 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.652 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.652 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.652 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.652 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.652 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.652 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.652 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.652 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.652 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.652 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.653 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.653 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.653 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.653 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.653 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.653 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.653 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.653 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.653 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.653 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.653 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.653 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.653 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.653 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.654 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.654 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.654 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.654 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.654 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.654 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.654 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.654 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.654 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.654 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.654 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.654 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.654 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.654 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.655 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.655 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.655 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.655 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.655 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.655 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.655 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.655 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.655 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.655 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.655 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.655 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.655 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.655 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.656 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "localpool", 2024-09-21T04:05:29.656 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.656 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.656 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.656 INFO:teuthology.orchestra.run.smithi046.stdout: "failure_domain": { 2024-09-21T04:05:29.656 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "failure_domain", 2024-09-21T04:05:29.656 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.656 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.656 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.656 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "host", 2024-09-21T04:05:29.656 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.656 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.656 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.656 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "failure domain for any created local pool", 2024-09-21T04:05:29.657 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T04:05:29.657 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.657 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.657 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.657 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.657 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.657 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.657 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.657 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.657 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.657 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.657 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.657 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.657 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.657 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.658 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.658 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.658 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.658 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.658 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.658 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.658 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.658 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.658 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.658 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.658 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.658 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.658 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.659 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.659 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.659 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.659 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.659 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.659 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.659 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.659 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.659 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.659 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.659 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.659 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.659 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.659 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.659 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.660 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.660 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.660 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.660 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.660 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.660 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.660 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.660 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.660 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.660 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.660 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.660 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.660 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.661 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.661 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.661 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.661 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.661 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.661 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.661 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.661 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.661 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.661 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.661 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.661 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.661 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.661 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.662 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.662 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.662 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.662 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.662 INFO:teuthology.orchestra.run.smithi046.stdout: "min_size": { 2024-09-21T04:05:29.662 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "min_size", 2024-09-21T04:05:29.662 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.662 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.662 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.662 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.662 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.662 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.662 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.662 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "default min_size for any created local pool", 2024-09-21T04:05:29.663 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T04:05:29.663 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.663 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.663 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.663 INFO:teuthology.orchestra.run.smithi046.stdout: "num_rep": { 2024-09-21T04:05:29.663 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "num_rep", 2024-09-21T04:05:29.663 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.663 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.663 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.663 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "3", 2024-09-21T04:05:29.663 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.663 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.663 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.663 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "default replica count for any created local pool", 2024-09-21T04:05:29.664 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.664 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.664 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.664 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.664 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num": { 2024-09-21T04:05:29.664 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pg_num", 2024-09-21T04:05:29.664 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.664 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.664 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.664 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "128", 2024-09-21T04:05:29.664 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.664 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.664 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.664 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T04:05:29.664 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.665 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.665 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.665 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.665 INFO:teuthology.orchestra.run.smithi046.stdout: "prefix": { 2024-09-21T04:05:29.665 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "prefix", 2024-09-21T04:05:29.665 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.665 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.665 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.665 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.665 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.665 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.665 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.665 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "name prefix for any created local pool", 2024-09-21T04:05:29.665 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.666 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.666 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.666 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.666 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.666 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.666 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.666 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.666 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.666 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.666 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.666 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.666 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.666 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.666 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.667 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.667 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.667 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.667 INFO:teuthology.orchestra.run.smithi046.stdout: "subtree": { 2024-09-21T04:05:29.667 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "subtree", 2024-09-21T04:05:29.667 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.667 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.667 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.667 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "rack", 2024-09-21T04:05:29.667 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.667 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.667 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.667 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T04:05:29.667 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T04:05:29.667 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.668 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.668 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.668 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.668 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.668 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.668 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mds_autoscaler", 2024-09-21T04:05:29.668 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.668 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.668 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.668 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.668 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.668 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.668 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.668 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.669 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.669 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.669 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.669 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.669 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.669 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.669 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.669 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.669 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.669 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.669 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.669 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.669 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.669 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.670 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.670 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.670 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.670 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.670 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.670 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.670 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.670 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.670 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.670 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.670 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.670 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.670 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.670 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.671 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.671 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.671 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.671 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.671 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.671 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.671 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.671 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.671 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.671 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.671 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.671 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.671 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.671 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.672 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.672 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.672 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.672 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.672 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.672 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.672 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.672 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.672 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.672 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.672 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.672 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.672 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.672 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.672 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.673 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.673 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.673 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.673 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.673 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.673 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.673 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.673 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.673 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.673 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.673 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.673 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.673 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.673 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.674 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.674 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.674 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.674 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.674 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.674 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.674 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.674 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.674 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.674 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.674 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.674 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mirroring", 2024-09-21T04:05:29.674 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.674 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.675 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.675 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.675 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.675 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.675 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.675 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.675 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.675 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.675 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.675 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.675 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.675 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.675 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.675 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.676 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.676 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.676 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.676 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.676 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.676 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.676 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.676 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.676 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.676 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.676 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.676 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.676 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.676 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.676 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.677 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.677 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.677 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.677 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.677 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.677 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.677 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.677 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.677 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.677 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.677 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.677 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.677 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.677 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.678 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.678 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.678 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.678 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.678 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.678 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.678 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.678 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.678 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.678 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.678 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.678 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.678 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.678 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.679 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.679 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.679 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.679 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.679 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.679 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.679 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.679 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.679 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.679 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.679 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.679 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.679 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.679 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.680 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.680 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.680 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.680 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.680 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.680 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.680 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.680 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.680 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.680 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.680 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.680 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.680 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.680 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.681 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.681 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.681 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.681 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "nfs", 2024-09-21T04:05:29.681 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.681 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.681 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.681 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.681 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.681 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.681 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.681 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.681 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.681 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.681 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.682 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.682 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.682 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.682 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.682 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.682 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.682 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.682 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.682 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.682 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.682 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.682 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.682 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.683 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.683 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.683 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.683 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.683 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.683 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.683 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.683 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.683 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.683 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.683 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.683 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.683 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.684 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.684 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.684 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.684 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.684 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.684 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.684 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.684 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.684 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.684 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.684 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.684 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.684 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.684 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.684 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.685 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.685 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.685 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.685 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.685 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.685 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.685 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.685 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.685 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.685 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.685 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.685 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.685 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.685 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.686 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.686 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.686 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.686 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.686 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.686 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.686 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.686 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.686 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.686 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.686 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.686 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.686 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.686 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.687 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.687 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.687 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.687 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.687 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.687 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.687 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.687 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.687 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.687 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.687 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "orchestrator", 2024-09-21T04:05:29.687 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.687 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.687 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.687 INFO:teuthology.orchestra.run.smithi046.stdout: "fail_fs": { 2024-09-21T04:05:29.688 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "fail_fs", 2024-09-21T04:05:29.688 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.688 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.688 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.688 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.688 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.688 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.688 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.688 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T04:05:29.688 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.688 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.688 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.688 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.688 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.689 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.689 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.689 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.689 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.689 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.689 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.689 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.689 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.689 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.689 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.689 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.689 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.689 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.689 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.690 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.690 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.690 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.690 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.690 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.690 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.690 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.690 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.690 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.690 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.690 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.690 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.690 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.690 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.691 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.691 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.691 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.691 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.691 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.691 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.691 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.691 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.691 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.691 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.691 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.691 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.691 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.691 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.691 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.692 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.692 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.692 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.692 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.692 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.692 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.692 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.692 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.692 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.692 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.692 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.692 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.692 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.692 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.692 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.693 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.693 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.693 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.693 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.693 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.693 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.693 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.693 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.693 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.693 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.693 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.693 INFO:teuthology.orchestra.run.smithi046.stdout: "orchestrator": { 2024-09-21T04:05:29.693 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "orchestrator", 2024-09-21T04:05:29.693 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.694 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.694 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.694 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.694 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.694 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.694 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.694 INFO:teuthology.orchestra.run.smithi046.stdout: "cephadm", 2024-09-21T04:05:29.694 INFO:teuthology.orchestra.run.smithi046.stdout: "rook", 2024-09-21T04:05:29.694 INFO:teuthology.orchestra.run.smithi046.stdout: "test_orchestrator" 2024-09-21T04:05:29.694 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.694 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Orchestrator backend", 2024-09-21T04:05:29.694 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.694 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.694 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.695 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.695 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.695 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.695 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.695 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.695 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.695 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.695 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.695 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.695 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.695 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.695 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.695 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.695 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.696 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.696 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.696 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.696 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.696 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "osd_perf_query", 2024-09-21T04:05:29.696 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.696 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.696 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.696 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.696 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.696 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.696 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.696 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.696 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.696 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.697 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.697 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.697 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.697 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.697 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.697 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.697 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.697 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.697 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.697 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.697 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.697 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.697 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.697 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.698 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.698 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.698 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.698 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.698 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.698 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.698 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.698 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.698 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.698 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.698 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.698 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.698 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.699 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.699 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.699 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.699 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.699 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.699 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.699 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.699 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.699 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.699 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.699 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.699 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.699 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.699 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.700 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.700 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.700 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.700 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.700 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.700 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.700 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.700 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.700 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.700 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.700 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.700 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.700 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.700 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.700 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.701 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.701 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.701 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.701 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.701 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.701 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.701 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.701 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.701 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.701 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.701 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.701 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.701 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.701 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.702 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.702 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.702 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.702 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.702 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.702 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.702 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.702 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.702 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.702 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.702 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "osd_support", 2024-09-21T04:05:29.702 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.702 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.702 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.703 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.703 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.703 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.703 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.703 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.703 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.703 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.703 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.703 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.703 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.703 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.703 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.703 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.703 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.704 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.704 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.704 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.704 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.704 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.704 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.704 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.704 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.704 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.704 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.704 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.704 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.704 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.704 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.704 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.705 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.705 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.705 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.705 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.705 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.705 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.705 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.705 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.705 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.705 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.705 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.705 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.705 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.705 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.706 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.706 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.706 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.706 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.706 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.706 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.706 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.706 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.706 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.706 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.706 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.706 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.706 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.706 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.706 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.707 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.707 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.707 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.707 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.707 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.707 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.707 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.707 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.707 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.707 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.707 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.707 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.707 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.707 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.708 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.708 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.708 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.708 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.708 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.708 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.708 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.708 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.708 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.708 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.708 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.708 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.708 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.708 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.708 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.709 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pg_autoscaler", 2024-09-21T04:05:29.709 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.709 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.709 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.709 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.709 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.709 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.709 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.709 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.709 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.709 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.709 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.709 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.709 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.710 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.710 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.710 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.710 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.710 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.710 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.710 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.710 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.710 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.710 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.710 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.710 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.710 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.710 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.711 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.711 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.711 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.711 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.711 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.711 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.711 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.711 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.711 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.711 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.711 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.711 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.711 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.712 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.712 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.712 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.712 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.712 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.712 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.712 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.712 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.712 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.712 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.712 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.712 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.712 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.712 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.713 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.713 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.713 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.713 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.713 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.713 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.713 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.713 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.713 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.713 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.713 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.713 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.713 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.714 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.714 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.714 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.714 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.714 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.714 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.714 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2024-09-21T04:05:29.714 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2024-09-21T04:05:29.714 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:29.714 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.714 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.714 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2024-09-21T04:05:29.714 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.714 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.715 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.715 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.715 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.715 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.715 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.715 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.715 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.715 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.715 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.715 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.715 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.715 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.715 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.715 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.716 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.716 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.716 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.716 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.716 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.716 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.716 INFO:teuthology.orchestra.run.smithi046.stdout: "threshold": { 2024-09-21T04:05:29.716 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "threshold", 2024-09-21T04:05:29.716 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-21T04:05:29.716 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.716 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.716 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "3.0", 2024-09-21T04:05:29.716 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1.0", 2024-09-21T04:05:29.716 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.717 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.717 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "scaling threshold", 2024-09-21T04:05:29.717 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T04:05:29.717 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.717 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.717 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.717 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.717 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.717 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.717 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "progress", 2024-09-21T04:05:29.717 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.717 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.717 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.717 INFO:teuthology.orchestra.run.smithi046.stdout: "allow_pg_recovery_event": { 2024-09-21T04:05:29.718 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "allow_pg_recovery_event", 2024-09-21T04:05:29.718 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.718 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.718 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.718 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.718 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.718 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.718 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.718 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T04:05:29.718 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.718 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.718 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.718 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.718 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": { 2024-09-21T04:05:29.719 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enabled", 2024-09-21T04:05:29.719 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.719 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.719 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.719 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.719 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.719 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.719 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.719 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.719 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.719 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.719 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.719 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.719 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.720 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.720 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.720 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.720 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.720 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.720 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.720 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.720 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.720 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.720 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.720 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.720 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.720 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.720 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.721 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.721 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.721 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.721 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.721 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.721 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.721 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.721 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.721 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.721 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.721 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.721 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.721 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.721 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.721 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.722 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.722 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.722 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.722 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.722 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.722 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.722 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.722 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.722 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.722 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.722 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.722 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.722 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.722 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.722 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.723 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.723 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.723 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.723 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.723 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.723 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.723 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.723 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.723 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.723 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.723 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.723 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.723 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.723 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.724 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.724 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.724 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.724 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.724 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.724 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.724 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.724 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.724 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.724 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.724 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.724 INFO:teuthology.orchestra.run.smithi046.stdout: "max_completed_events": { 2024-09-21T04:05:29.724 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_completed_events", 2024-09-21T04:05:29.725 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.725 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.725 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.725 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "50", 2024-09-21T04:05:29.725 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.725 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.725 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.725 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "number of past completed events to remember", 2024-09-21T04:05:29.725 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.725 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.725 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.725 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.726 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2024-09-21T04:05:29.726 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2024-09-21T04:05:29.726 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:29.726 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.726 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.726 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2024-09-21T04:05:29.726 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.726 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.726 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.726 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how long the module is going to sleep", 2024-09-21T04:05:29.726 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.726 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.727 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.727 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.727 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.727 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.727 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.727 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.727 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.727 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.727 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.727 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.727 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.727 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.727 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.727 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.728 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.728 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.728 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.728 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.728 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.728 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "prometheus", 2024-09-21T04:05:29.728 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.728 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.728 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.728 INFO:teuthology.orchestra.run.smithi046.stdout: "cache": { 2024-09-21T04:05:29.728 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cache", 2024-09-21T04:05:29.728 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.728 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.728 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.729 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.729 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.729 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.729 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.729 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.729 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.729 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.729 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.729 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.729 INFO:teuthology.orchestra.run.smithi046.stdout: "exclude_perf_counters": { 2024-09-21T04:05:29.729 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "exclude_perf_counters", 2024-09-21T04:05:29.729 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.729 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.729 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.730 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.730 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.730 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.730 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.730 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T04:05:29.730 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T04:05:29.730 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.730 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.730 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.730 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.730 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.730 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.730 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.730 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.731 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.731 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.731 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.731 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.731 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.731 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.731 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.731 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.731 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.731 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.731 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.731 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.731 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.731 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.732 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.732 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.732 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.732 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.732 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.732 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.732 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.732 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.732 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.732 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.732 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.732 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.732 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.732 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.732 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.733 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.733 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.733 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.733 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.733 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.733 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.733 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.733 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.733 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.733 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.733 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.733 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.733 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.733 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.733 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.734 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.734 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.734 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.734 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.734 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.734 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.734 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.734 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.734 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.734 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.734 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.734 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.734 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.734 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.735 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.735 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.735 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.735 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.735 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.735 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.735 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.735 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_stats_pools": { 2024-09-21T04:05:29.735 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rbd_stats_pools", 2024-09-21T04:05:29.735 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.735 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.735 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.735 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.736 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.736 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.736 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.736 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.736 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.736 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.736 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.736 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.736 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T04:05:29.736 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T04:05:29.736 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.736 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.736 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.736 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "300", 2024-09-21T04:05:29.736 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.737 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.737 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.737 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.737 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.737 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.737 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.737 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.737 INFO:teuthology.orchestra.run.smithi046.stdout: "scrape_interval": { 2024-09-21T04:05:29.737 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "scrape_interval", 2024-09-21T04:05:29.737 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-21T04:05:29.737 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.737 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.737 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "15.0", 2024-09-21T04:05:29.737 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.737 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.738 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.738 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.738 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.738 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.738 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.738 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.738 INFO:teuthology.orchestra.run.smithi046.stdout: "server_addr": { 2024-09-21T04:05:29.738 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_addr", 2024-09-21T04:05:29.738 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.738 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.738 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.738 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "::", 2024-09-21T04:05:29.738 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.739 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.739 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.739 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T04:05:29.739 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.739 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.739 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.739 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.739 INFO:teuthology.orchestra.run.smithi046.stdout: "server_port": { 2024-09-21T04:05:29.739 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_port", 2024-09-21T04:05:29.739 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.739 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.739 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.739 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "9283", 2024-09-21T04:05:29.739 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.740 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.740 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.740 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T04:05:29.740 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.740 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.740 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.740 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.740 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.740 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.740 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.740 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.740 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.740 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.740 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.741 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.741 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.741 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.741 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.741 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.741 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.741 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.741 INFO:teuthology.orchestra.run.smithi046.stdout: "stale_cache_strategy": { 2024-09-21T04:05:29.741 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "stale_cache_strategy", 2024-09-21T04:05:29.741 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.741 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.741 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.741 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "log", 2024-09-21T04:05:29.741 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.742 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.742 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.742 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.742 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.742 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.742 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.742 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.742 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_behaviour": { 2024-09-21T04:05:29.742 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_behaviour", 2024-09-21T04:05:29.742 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.742 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.742 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.742 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "default", 2024-09-21T04:05:29.742 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.743 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.743 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.743 INFO:teuthology.orchestra.run.smithi046.stdout: "default", 2024-09-21T04:05:29.743 INFO:teuthology.orchestra.run.smithi046.stdout: "error" 2024-09-21T04:05:29.743 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.743 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.743 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.743 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.743 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.743 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.743 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_error_status_code": { 2024-09-21T04:05:29.743 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_error_status_code", 2024-09-21T04:05:29.743 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.743 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.744 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.744 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "500", 2024-09-21T04:05:29.744 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "400", 2024-09-21T04:05:29.744 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "599", 2024-09-21T04:05:29.744 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.744 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.744 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.744 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.744 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.744 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.744 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.744 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.744 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.744 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rbd_support", 2024-09-21T04:05:29.744 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.745 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.745 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.745 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.745 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.745 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.745 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.745 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.745 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.745 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.745 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.745 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.745 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.745 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.745 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.746 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.746 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.746 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.746 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.746 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.746 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.746 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.746 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.746 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.746 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.746 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.746 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.746 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.746 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.747 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.747 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.747 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.747 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.747 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.747 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.747 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.747 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.747 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.747 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.747 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.747 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.747 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.747 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.747 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.748 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.748 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.748 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.748 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.748 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.748 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.748 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.748 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.748 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.748 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.748 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.748 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.748 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.748 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.748 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.749 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.749 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.749 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.749 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.749 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.749 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.749 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.749 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.749 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.749 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.749 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.749 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.749 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.749 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.749 INFO:teuthology.orchestra.run.smithi046.stdout: "max_concurrent_snap_create": { 2024-09-21T04:05:29.750 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_concurrent_snap_create", 2024-09-21T04:05:29.750 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.750 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.750 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.750 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-21T04:05:29.750 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.750 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.750 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.750 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.750 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.750 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.750 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.750 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.751 INFO:teuthology.orchestra.run.smithi046.stdout: "mirror_snapshot_schedule": { 2024-09-21T04:05:29.751 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T04:05:29.751 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.751 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.751 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.751 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.751 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.751 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.751 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.751 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.751 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.751 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.751 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.751 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.752 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.752 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.752 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.752 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.752 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.752 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.752 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.752 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.752 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.752 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.752 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.752 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.752 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.752 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.753 INFO:teuthology.orchestra.run.smithi046.stdout: "trash_purge_schedule": { 2024-09-21T04:05:29.753 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "trash_purge_schedule", 2024-09-21T04:05:29.753 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.753 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.753 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.753 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.753 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.753 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.753 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.753 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.753 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.753 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.753 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.753 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.753 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.754 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.754 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.754 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "restful", 2024-09-21T04:05:29.754 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.754 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.754 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.754 INFO:teuthology.orchestra.run.smithi046.stdout: "enable_auth": { 2024-09-21T04:05:29.754 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enable_auth", 2024-09-21T04:05:29.754 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.754 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.754 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.754 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.754 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.754 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.755 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.755 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.755 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.755 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.755 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.755 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.755 INFO:teuthology.orchestra.run.smithi046.stdout: "key_file": { 2024-09-21T04:05:29.755 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "key_file", 2024-09-21T04:05:29.755 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.755 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.755 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.755 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.755 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.755 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.756 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.756 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.756 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.756 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.756 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.756 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.756 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.756 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.756 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.756 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.756 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.756 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.756 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.757 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.757 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.757 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.757 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.757 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.757 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.757 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.757 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.757 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.757 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.757 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.757 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.757 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.757 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.757 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.758 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.758 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.758 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.758 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.758 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.758 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.758 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.758 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.758 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.758 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.758 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.758 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.758 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.758 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.759 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.759 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.759 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.759 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.759 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.759 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.759 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.759 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.759 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.759 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.759 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.759 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.759 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.759 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.760 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.760 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.760 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.760 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.760 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.760 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.760 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.760 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.760 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.760 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.760 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.760 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.760 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.760 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.761 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.761 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.761 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.761 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.761 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.761 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.761 INFO:teuthology.orchestra.run.smithi046.stdout: "max_requests": { 2024-09-21T04:05:29.761 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_requests", 2024-09-21T04:05:29.761 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.761 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.761 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.761 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "500", 2024-09-21T04:05:29.761 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.761 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.761 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.762 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T04:05:29.762 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.762 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.762 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.762 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.762 INFO:teuthology.orchestra.run.smithi046.stdout: "server_addr": { 2024-09-21T04:05:29.762 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_addr", 2024-09-21T04:05:29.762 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.762 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.762 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.762 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.762 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.762 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.762 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.763 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.763 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.763 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.763 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.763 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.763 INFO:teuthology.orchestra.run.smithi046.stdout: "server_port": { 2024-09-21T04:05:29.763 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_port", 2024-09-21T04:05:29.763 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.763 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.763 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.763 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.763 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.763 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.763 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.764 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.764 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.764 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.764 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.764 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.764 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.764 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.764 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.764 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.764 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.764 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.764 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.764 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.765 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.765 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.765 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.765 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.765 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.765 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.765 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.765 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.765 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.765 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rgw", 2024-09-21T04:05:29.765 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.765 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.765 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.765 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.766 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.766 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.766 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.766 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.766 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.766 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.766 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.766 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.766 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.766 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.766 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.766 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.766 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.766 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.767 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.767 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.767 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.767 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.767 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.767 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.767 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.767 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.767 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.767 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.767 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.767 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.767 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.767 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.767 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.768 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.768 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.768 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.768 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.768 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.768 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.768 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.768 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.768 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.768 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.768 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.768 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.768 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.769 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.769 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.769 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.769 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.769 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.769 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.769 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.769 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.769 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.769 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.769 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.769 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.769 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.769 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.769 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.770 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.770 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.770 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.770 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.770 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.770 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.770 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.770 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.770 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.770 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.770 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.770 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.770 INFO:teuthology.orchestra.run.smithi046.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T04:05:29.770 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T04:05:29.771 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.771 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.771 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.771 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2024-09-21T04:05:29.771 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.771 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.771 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.771 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T04:05:29.771 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.771 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.771 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.771 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.771 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.771 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.772 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.772 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.772 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.772 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.772 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.772 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.772 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.772 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.772 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.772 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.772 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.772 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.772 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.772 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.772 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.773 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rook", 2024-09-21T04:05:29.773 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.773 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.773 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.773 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.773 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.773 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.773 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.773 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.773 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.773 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.773 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.773 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.773 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.774 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.774 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.774 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.774 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.774 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.774 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.774 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.774 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.774 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.774 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.774 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.774 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.774 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.774 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.775 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.775 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.775 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.775 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.775 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.775 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.775 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.775 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.775 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.775 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.775 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.775 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.775 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.775 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.776 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.776 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.776 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.776 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.776 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.776 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.776 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.776 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.776 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.776 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.776 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.776 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.776 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.776 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.777 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.777 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.777 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.777 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.777 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.777 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.777 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.777 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.777 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.777 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.777 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.777 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.777 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.777 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.777 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.778 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.778 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.778 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.778 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.778 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.778 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.778 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.778 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.778 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.778 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.778 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.778 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.778 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.779 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.779 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.779 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.779 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.779 INFO:teuthology.orchestra.run.smithi046.stdout: "storage_class": { 2024-09-21T04:05:29.779 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "storage_class", 2024-09-21T04:05:29.779 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.779 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.779 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.779 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "local", 2024-09-21T04:05:29.779 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.779 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.779 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.780 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T04:05:29.780 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.780 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.780 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.780 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.780 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.780 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.780 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.780 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "selftest", 2024-09-21T04:05:29.780 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.780 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.780 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.780 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.780 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.781 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.781 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.781 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.781 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.781 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.781 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.781 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.781 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.781 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.781 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.781 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.781 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.781 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.781 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.782 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.782 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.782 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.782 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.782 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.782 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.782 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.782 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.782 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.782 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.782 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.782 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.782 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.783 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.783 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.783 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.783 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.783 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.783 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.783 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.783 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.783 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.783 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.783 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.783 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.783 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.783 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.784 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.784 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.784 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.784 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.784 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.784 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.784 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.784 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.784 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.784 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.784 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.784 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.784 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.784 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.785 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.785 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.785 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.785 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.785 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.785 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.785 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.785 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.785 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.785 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.785 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.785 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.785 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.785 INFO:teuthology.orchestra.run.smithi046.stdout: "roption1": { 2024-09-21T04:05:29.785 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "roption1", 2024-09-21T04:05:29.786 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.786 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.786 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.786 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.786 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.786 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.786 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.786 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.786 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.786 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.786 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.786 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.786 INFO:teuthology.orchestra.run.smithi046.stdout: "roption2": { 2024-09-21T04:05:29.787 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "roption2", 2024-09-21T04:05:29.787 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.787 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.787 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.787 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "xyz", 2024-09-21T04:05:29.787 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.787 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.787 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.787 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.787 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.787 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.787 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.787 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.787 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption1": { 2024-09-21T04:05:29.788 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption1", 2024-09-21T04:05:29.788 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.788 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.788 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.788 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.788 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.788 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.788 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.788 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.788 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.788 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.788 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.788 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.788 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption2": { 2024-09-21T04:05:29.788 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption2", 2024-09-21T04:05:29.789 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.789 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.789 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.789 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.789 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.789 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.789 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.789 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.789 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.789 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.789 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.789 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.789 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption3": { 2024-09-21T04:05:29.789 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption3", 2024-09-21T04:05:29.789 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-21T04:05:29.790 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.790 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.790 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.790 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.790 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.790 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.790 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.790 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.790 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.790 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.790 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.790 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption4": { 2024-09-21T04:05:29.790 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption4", 2024-09-21T04:05:29.790 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.791 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.791 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.791 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.791 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.791 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.791 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.791 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.791 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.791 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.791 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.791 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.791 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption5": { 2024-09-21T04:05:29.791 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption5", 2024-09-21T04:05:29.791 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.791 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.792 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.792 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.792 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.792 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.792 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.792 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.792 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.792 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.792 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.792 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.792 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption6": { 2024-09-21T04:05:29.792 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption6", 2024-09-21T04:05:29.792 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.793 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.793 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.793 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.793 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.793 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.793 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.793 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.793 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.793 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.793 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.793 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.793 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption7": { 2024-09-21T04:05:29.793 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption7", 2024-09-21T04:05:29.793 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.793 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.794 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.794 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.794 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2024-09-21T04:05:29.794 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "42", 2024-09-21T04:05:29.794 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.794 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.794 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.794 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.794 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.794 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.794 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.794 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.794 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.794 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.795 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.795 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.795 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.795 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.795 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.795 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.795 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.795 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.795 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.795 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.795 INFO:teuthology.orchestra.run.smithi046.stdout: "testkey": { 2024-09-21T04:05:29.795 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "testkey", 2024-09-21T04:05:29.795 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.795 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.796 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.796 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.796 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.796 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.796 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.796 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.796 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.796 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.796 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.796 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.796 INFO:teuthology.orchestra.run.smithi046.stdout: "testlkey": { 2024-09-21T04:05:29.796 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "testlkey", 2024-09-21T04:05:29.796 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.796 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.797 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.797 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.797 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.797 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.797 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.797 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.797 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.797 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.797 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.797 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.797 INFO:teuthology.orchestra.run.smithi046.stdout: "testnewline": { 2024-09-21T04:05:29.797 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "testnewline", 2024-09-21T04:05:29.797 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.797 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.798 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.798 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.798 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.798 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.798 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.798 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.798 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.798 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.798 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.798 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.798 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.798 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.798 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.799 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smb", 2024-09-21T04:05:29.799 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.799 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.799 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.799 INFO:teuthology.orchestra.run.smithi046.stdout: "internal_store_backend": { 2024-09-21T04:05:29.799 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "internal_store_backend", 2024-09-21T04:05:29.799 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.799 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.799 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.799 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.799 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.799 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.799 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.799 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T04:05:29.799 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.800 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.800 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.800 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.800 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.800 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.800 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.800 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.800 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.800 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.800 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.800 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.800 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.800 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.800 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.800 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.801 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.801 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.801 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.801 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.801 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.801 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.801 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.801 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.801 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.801 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.801 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.801 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.801 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.801 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.802 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.802 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.802 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.802 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.802 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.802 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.802 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.802 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.802 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.802 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.802 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.802 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.802 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.803 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.803 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.803 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.803 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.803 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.803 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.803 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.803 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.803 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.803 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.803 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.803 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.803 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.803 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.803 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.804 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.804 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.804 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.804 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.804 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.804 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.804 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.804 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.804 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.804 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.804 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.804 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.804 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.804 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.804 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.805 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.805 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.805 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.805 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.805 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.805 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.805 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.805 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.805 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.805 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.805 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.805 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.805 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.805 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.806 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.806 INFO:teuthology.orchestra.run.smithi046.stdout: "update_orchestration": { 2024-09-21T04:05:29.806 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "update_orchestration", 2024-09-21T04:05:29.806 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.806 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.806 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.806 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.806 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.806 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.806 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.806 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T04:05:29.806 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.806 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.807 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.807 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.807 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.807 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.807 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.807 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "snap_schedule", 2024-09-21T04:05:29.807 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.807 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.807 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.807 INFO:teuthology.orchestra.run.smithi046.stdout: "allow_m_granularity": { 2024-09-21T04:05:29.807 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "allow_m_granularity", 2024-09-21T04:05:29.807 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.807 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.807 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.808 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.808 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.808 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.808 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.808 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T04:05:29.808 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.808 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.808 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.808 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.808 INFO:teuthology.orchestra.run.smithi046.stdout: "dump_on_update": { 2024-09-21T04:05:29.808 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "dump_on_update", 2024-09-21T04:05:29.808 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.808 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.808 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.809 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.809 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.809 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.809 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.809 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "dump database to debug log on update", 2024-09-21T04:05:29.809 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.809 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.809 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.809 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.809 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.809 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.809 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.809 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.809 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.810 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.810 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.810 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.810 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.810 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.810 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.810 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.810 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.810 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.810 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.810 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.810 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.810 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.810 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.811 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.811 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.811 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.811 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.811 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.811 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.811 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.811 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.811 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.811 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.811 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.811 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.811 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.811 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.812 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.812 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.812 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.812 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.812 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.812 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.812 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.812 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.812 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.812 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.812 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.812 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.812 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.812 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.812 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.813 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.813 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.813 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.813 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.813 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.813 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.813 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.813 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.813 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.813 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.813 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.813 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.813 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.813 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.814 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.814 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.814 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.814 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.814 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.814 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.814 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.814 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.814 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.814 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.814 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.814 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.814 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.814 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.815 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.815 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.815 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.815 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.815 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.815 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.815 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.815 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.815 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.815 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.815 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.815 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "stats", 2024-09-21T04:05:29.815 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.815 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.815 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.816 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.816 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.816 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.816 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.816 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.816 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.816 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.816 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.816 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.816 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.816 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.816 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.816 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.816 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.817 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.817 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.817 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.817 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.817 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.817 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.817 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.817 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.817 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.817 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.817 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.817 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.817 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.817 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.817 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.818 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.818 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.818 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.818 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.818 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.818 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.818 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.818 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.818 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.818 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.818 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.818 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.818 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.818 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.819 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.819 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.819 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.819 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.819 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.819 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.819 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.819 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.819 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.819 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.819 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.819 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.819 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.819 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.819 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.820 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.820 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.820 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.820 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.820 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.820 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.820 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.820 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.820 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.820 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.820 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.820 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.820 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.820 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.821 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.821 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.821 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.821 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.821 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.821 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.821 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.821 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.821 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.821 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.821 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.821 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.821 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.821 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.822 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.822 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "status", 2024-09-21T04:05:29.822 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.822 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.822 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.822 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.822 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.822 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.822 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.822 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.822 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.822 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.822 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.822 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.823 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.823 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.823 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.823 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.823 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.823 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.823 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.823 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.823 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.823 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.823 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.823 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.823 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.823 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.824 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.824 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.824 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.824 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.824 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.824 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.824 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.824 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.824 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.824 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.824 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.824 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.824 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.824 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.825 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.825 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.825 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.825 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.825 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.825 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.825 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.825 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.825 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.825 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.825 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.825 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.825 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.825 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.826 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.826 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.826 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.826 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.826 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.826 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.826 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.826 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.826 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.826 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.826 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.826 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.826 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.826 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.827 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.827 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.827 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.827 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.827 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.827 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.827 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.827 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.827 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.827 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.827 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.827 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.827 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.827 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.828 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.828 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.828 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.828 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.828 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.828 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.828 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.828 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.828 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "telegraf", 2024-09-21T04:05:29.828 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.828 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.828 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.828 INFO:teuthology.orchestra.run.smithi046.stdout: "address": { 2024-09-21T04:05:29.828 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "address", 2024-09-21T04:05:29.829 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.829 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.829 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.829 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T04:05:29.829 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.829 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.829 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.829 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.829 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.829 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.829 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.829 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.829 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2024-09-21T04:05:29.829 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2024-09-21T04:05:29.829 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:29.830 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.830 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.830 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "15", 2024-09-21T04:05:29.830 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.830 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.830 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.830 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.830 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.830 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.830 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.830 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.830 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.830 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.830 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.831 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.831 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.831 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.831 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.831 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.831 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.831 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.831 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.831 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.831 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.831 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.831 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.831 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.831 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.832 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.832 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.832 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.832 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.832 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.832 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.832 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.832 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.832 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.832 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.832 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.832 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.832 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.832 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.832 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.833 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.833 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.833 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.833 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.833 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.833 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.833 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.833 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.833 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.833 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.833 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.833 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.833 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.833 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.833 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.834 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.834 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.834 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.834 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.834 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.834 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.834 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.834 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.834 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.834 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.834 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.834 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.834 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.835 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.835 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.835 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.835 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.835 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.835 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.835 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.835 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.835 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.835 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.835 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.835 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.835 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.835 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.836 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.836 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.836 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.836 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.836 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.836 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.836 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.836 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.836 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.836 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.836 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.836 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.836 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.836 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "telemetry", 2024-09-21T04:05:29.837 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.837 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.837 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.837 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_basic": { 2024-09-21T04:05:29.837 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_basic", 2024-09-21T04:05:29.837 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.837 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.837 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.837 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.837 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.837 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.837 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.837 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T04:05:29.837 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.837 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.838 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.838 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.838 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_crash": { 2024-09-21T04:05:29.838 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_crash", 2024-09-21T04:05:29.838 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.838 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.838 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.838 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.838 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.838 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.838 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.838 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T04:05:29.838 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.839 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.839 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.839 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.839 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_device": { 2024-09-21T04:05:29.839 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_device", 2024-09-21T04:05:29.839 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.839 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.839 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.839 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.839 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.839 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.839 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.839 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T04:05:29.839 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.840 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.840 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.840 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.840 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_ident": { 2024-09-21T04:05:29.840 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_ident", 2024-09-21T04:05:29.840 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.840 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.840 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.840 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.840 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.840 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.840 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.840 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T04:05:29.840 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.840 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.841 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.841 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.841 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_perf": { 2024-09-21T04:05:29.841 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_perf", 2024-09-21T04:05:29.841 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.841 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.841 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.841 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.841 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.841 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.841 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.841 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T04:05:29.841 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.841 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.842 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.842 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.842 INFO:teuthology.orchestra.run.smithi046.stdout: "contact": { 2024-09-21T04:05:29.842 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "contact", 2024-09-21T04:05:29.842 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.842 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.842 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.842 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.842 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.842 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.842 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.842 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.842 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.842 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.843 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.843 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.843 INFO:teuthology.orchestra.run.smithi046.stdout: "description": { 2024-09-21T04:05:29.843 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "description", 2024-09-21T04:05:29.843 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.843 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.843 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.843 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.843 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.843 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.843 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.843 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.843 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.843 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.844 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.844 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.844 INFO:teuthology.orchestra.run.smithi046.stdout: "device_url": { 2024-09-21T04:05:29.844 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "device_url", 2024-09-21T04:05:29.844 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.844 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.844 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.844 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T04:05:29.844 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.844 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.844 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.844 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.844 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.844 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.845 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.845 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.845 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": { 2024-09-21T04:05:29.845 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enabled", 2024-09-21T04:05:29.845 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.845 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.845 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.845 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.845 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.845 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.845 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.845 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.845 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.845 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.845 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.846 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.846 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2024-09-21T04:05:29.846 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2024-09-21T04:05:29.846 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.846 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.846 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.846 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "24", 2024-09-21T04:05:29.846 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "8", 2024-09-21T04:05:29.846 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.846 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.846 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.846 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.846 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.847 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.847 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.847 INFO:teuthology.orchestra.run.smithi046.stdout: "last_opt_revision": { 2024-09-21T04:05:29.847 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "last_opt_revision", 2024-09-21T04:05:29.847 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.847 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.847 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.847 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "1", 2024-09-21T04:05:29.847 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.847 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.847 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.847 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.847 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.847 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.848 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.848 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.848 INFO:teuthology.orchestra.run.smithi046.stdout: "leaderboard": { 2024-09-21T04:05:29.848 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "leaderboard", 2024-09-21T04:05:29.848 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.848 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.848 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.848 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.848 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.848 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.848 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.848 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.848 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.848 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.849 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.849 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.849 INFO:teuthology.orchestra.run.smithi046.stdout: "leaderboard_description": { 2024-09-21T04:05:29.849 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "leaderboard_description", 2024-09-21T04:05:29.849 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.849 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.849 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.849 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.849 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.849 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.849 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.849 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.849 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.849 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.850 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.850 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.850 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.850 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.850 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.850 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.850 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.850 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.850 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.850 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.850 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.850 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.850 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.850 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.851 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.851 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.851 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.851 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.851 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.851 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.851 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.851 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.851 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.851 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.851 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.851 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.851 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.851 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.851 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.852 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.852 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.852 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.852 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.852 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.852 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.852 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.852 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.852 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.852 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.852 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.852 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.852 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.852 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.853 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.853 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.853 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.853 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.853 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.853 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.853 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.853 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.853 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.853 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.853 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.853 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.853 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.853 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.854 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.854 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.854 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.854 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.854 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.854 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.854 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.854 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.854 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.854 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.854 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.854 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.854 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.854 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.854 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.855 INFO:teuthology.orchestra.run.smithi046.stdout: "organization": { 2024-09-21T04:05:29.855 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "organization", 2024-09-21T04:05:29.855 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.855 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.855 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.855 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.855 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.855 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.855 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.855 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.855 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.855 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.855 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.855 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.856 INFO:teuthology.orchestra.run.smithi046.stdout: "proxy": { 2024-09-21T04:05:29.856 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "proxy", 2024-09-21T04:05:29.856 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.856 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.856 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.856 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.856 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.856 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.856 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.856 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.856 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.856 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.856 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.856 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.857 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.857 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.857 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.857 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.857 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.857 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.857 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.857 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.857 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.857 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.857 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.857 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.857 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.857 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.858 INFO:teuthology.orchestra.run.smithi046.stdout: "url": { 2024-09-21T04:05:29.858 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "url", 2024-09-21T04:05:29.858 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.858 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.858 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.858 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T04:05:29.858 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.858 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.858 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.858 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.858 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.858 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.858 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.858 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.859 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.859 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.859 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.859 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "test_orchestrator", 2024-09-21T04:05:29.859 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.859 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.859 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.859 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.859 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.859 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.859 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.859 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.859 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.859 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.860 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.860 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.860 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.860 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.860 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.860 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.860 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.860 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.860 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.860 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.860 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.860 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.860 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.860 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.861 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.861 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.861 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.861 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.861 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.861 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.861 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.861 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.861 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.861 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.861 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.861 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.861 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.861 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.861 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.862 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.862 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.862 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.862 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.862 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.862 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.862 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.862 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.862 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.862 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.862 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.862 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.862 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.862 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.863 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.863 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.863 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.863 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.863 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.863 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.863 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.863 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.863 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.863 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.863 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.863 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.863 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.863 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.864 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.864 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.864 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.864 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.864 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.864 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.864 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.864 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.864 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.864 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.864 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.864 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.864 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.864 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.864 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.865 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.865 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.865 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.865 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.865 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.865 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.865 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.865 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.865 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "volumes", 2024-09-21T04:05:29.865 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.865 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.865 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.865 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.865 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.866 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.866 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.866 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.866 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.866 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.866 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.866 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.866 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.866 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.866 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.866 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.866 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.866 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.867 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.867 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.867 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.867 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.867 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.867 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.867 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.867 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.867 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.867 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.867 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.867 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.867 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.867 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.868 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.868 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.868 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.868 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.868 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.868 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.868 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.868 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.868 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.868 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.868 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.868 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.868 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.868 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.869 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.869 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.869 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.869 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.869 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.869 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.869 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.869 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.869 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.869 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.869 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.869 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.869 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.869 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.869 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.870 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.870 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.870 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.870 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.870 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.870 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.870 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.870 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.870 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.870 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.870 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.870 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.870 INFO:teuthology.orchestra.run.smithi046.stdout: "max_concurrent_clones": { 2024-09-21T04:05:29.871 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_concurrent_clones", 2024-09-21T04:05:29.871 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.871 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.871 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.871 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "4", 2024-09-21T04:05:29.871 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.871 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.871 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.871 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T04:05:29.871 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.871 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.871 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.871 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.871 INFO:teuthology.orchestra.run.smithi046.stdout: "periodic_async_work": { 2024-09-21T04:05:29.872 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "periodic_async_work", 2024-09-21T04:05:29.872 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.872 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.872 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.872 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.872 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.872 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.872 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.872 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Periodically check for async work", 2024-09-21T04:05:29.872 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.872 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.872 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.872 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.872 INFO:teuthology.orchestra.run.smithi046.stdout: "snapshot_clone_delay": { 2024-09-21T04:05:29.873 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "snapshot_clone_delay", 2024-09-21T04:05:29.873 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.873 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.873 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.873 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.873 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.873 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.873 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.873 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T04:05:29.873 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.873 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.873 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.873 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.873 INFO:teuthology.orchestra.run.smithi046.stdout: "snapshot_clone_no_wait": { 2024-09-21T04:05:29.873 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T04:05:29.874 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.874 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.874 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.874 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.874 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.874 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.874 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.874 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T04:05:29.874 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.874 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.874 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.874 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.874 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.874 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.875 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.875 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.875 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.875 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.875 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.875 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.875 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.875 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.875 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.875 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.875 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.875 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.875 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.876 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.876 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.876 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix", 2024-09-21T04:05:29.876 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.876 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.876 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.876 INFO:teuthology.orchestra.run.smithi046.stdout: "discovery_interval": { 2024-09-21T04:05:29.876 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "discovery_interval", 2024-09-21T04:05:29.876 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2024-09-21T04:05:29.876 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.876 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.876 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "100", 2024-09-21T04:05:29.876 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.876 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.876 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.877 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.877 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.877 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.877 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.877 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.877 INFO:teuthology.orchestra.run.smithi046.stdout: "identifier": { 2024-09-21T04:05:29.877 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "identifier", 2024-09-21T04:05:29.877 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.877 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.877 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.877 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.877 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.877 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.877 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.878 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.878 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.878 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.878 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.878 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.878 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2024-09-21T04:05:29.878 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2024-09-21T04:05:29.878 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:29.878 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.878 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.878 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2024-09-21T04:05:29.878 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.878 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.879 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.879 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.879 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.879 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.879 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.879 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.879 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.879 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.879 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.879 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.879 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.879 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.879 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.879 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.880 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.880 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.880 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.880 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.880 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.880 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.880 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.880 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.880 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.880 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.880 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.880 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.880 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.881 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.881 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.881 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.881 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.881 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.881 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.881 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.881 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.881 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.881 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.881 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.881 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.881 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.881 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.881 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.882 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.882 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.882 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.882 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.882 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.882 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.882 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.882 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.882 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.882 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.882 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.882 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.882 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.883 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.883 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.883 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.883 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.883 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.883 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.883 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.883 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.883 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.883 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.883 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.883 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.883 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.883 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.883 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.884 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.884 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.884 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.884 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.884 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.884 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.884 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.884 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.884 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.884 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.884 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.884 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.884 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.884 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.885 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.885 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.885 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.885 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.885 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.885 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.885 INFO:teuthology.orchestra.run.smithi046.stdout: "zabbix_host": { 2024-09-21T04:05:29.885 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix_host", 2024-09-21T04:05:29.885 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.885 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.885 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.885 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.885 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.885 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.886 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.886 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.886 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.886 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.886 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.886 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.886 INFO:teuthology.orchestra.run.smithi046.stdout: "zabbix_port": { 2024-09-21T04:05:29.886 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix_port", 2024-09-21T04:05:29.886 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.886 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.886 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.886 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10051", 2024-09-21T04:05:29.886 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.886 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.887 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.887 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.887 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.887 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.887 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.887 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.887 INFO:teuthology.orchestra.run.smithi046.stdout: "zabbix_sender": { 2024-09-21T04:05:29.887 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix_sender", 2024-09-21T04:05:29.887 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.887 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.887 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.887 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T04:05:29.887 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.887 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.888 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.888 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.888 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.888 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.888 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.888 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.888 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.888 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.888 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-09-21T04:05:29.888 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.888 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.888 INFO:teuthology.orchestra.run.smithi046.stdout: "gid": 24166, 2024-09-21T04:05:29.888 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "z", 2024-09-21T04:05:29.888 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_features": 4540719139924082687, 2024-09-21T04:05:29.888 INFO:teuthology.orchestra.run.smithi046.stdout: "available_modules": [ 2024-09-21T04:05:29.889 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.889 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "alerts", 2024-09-21T04:05:29.889 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.889 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.889 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.889 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2024-09-21T04:05:29.889 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2024-09-21T04:05:29.889 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:29.889 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.889 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.889 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2024-09-21T04:05:29.889 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.889 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.889 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.890 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T04:05:29.890 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.890 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.890 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.890 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.890 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.890 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.890 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.890 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.890 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.890 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.890 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.890 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.890 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.891 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.891 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.891 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.891 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.891 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.891 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.891 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.891 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.891 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.891 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.891 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.891 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.891 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.891 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.892 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.892 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.892 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.892 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.892 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.892 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.892 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.892 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.892 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.892 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.892 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.892 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.892 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.892 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.893 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.893 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.893 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.893 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.893 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.893 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.893 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.893 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.893 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.893 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.893 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.893 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.893 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.893 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.894 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.894 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.894 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.894 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.894 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.894 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.894 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.894 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.894 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.894 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.894 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.894 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.894 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.894 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.895 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.895 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.895 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.895 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.895 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.895 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_destination": { 2024-09-21T04:05:29.895 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_destination", 2024-09-21T04:05:29.895 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.895 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.895 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.895 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.895 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.895 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.896 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.896 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T04:05:29.896 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.896 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.896 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.896 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.896 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_from_name": { 2024-09-21T04:05:29.896 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_from_name", 2024-09-21T04:05:29.896 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.896 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.896 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.896 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "Ceph", 2024-09-21T04:05:29.896 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.897 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.897 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.897 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Email From: name", 2024-09-21T04:05:29.897 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.897 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.897 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.897 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.897 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_host": { 2024-09-21T04:05:29.897 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_host", 2024-09-21T04:05:29.897 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.897 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.897 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.897 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.897 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.898 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.898 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.898 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SMTP server", 2024-09-21T04:05:29.898 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.898 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.898 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.898 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.898 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_password": { 2024-09-21T04:05:29.898 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_password", 2024-09-21T04:05:29.898 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.898 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.898 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.898 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.898 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.899 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.899 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.899 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Password to authenticate with", 2024-09-21T04:05:29.899 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.899 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.899 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.899 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.899 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_port": { 2024-09-21T04:05:29.899 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_port", 2024-09-21T04:05:29.899 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.899 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.899 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.899 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "465", 2024-09-21T04:05:29.899 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.900 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.900 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.900 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SMTP port", 2024-09-21T04:05:29.900 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.900 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.900 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.900 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.900 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_sender": { 2024-09-21T04:05:29.900 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_sender", 2024-09-21T04:05:29.900 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.900 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.900 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.900 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.900 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.901 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.901 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.901 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SMTP envelope sender", 2024-09-21T04:05:29.901 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.901 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.901 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.901 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.901 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_ssl": { 2024-09-21T04:05:29.901 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_ssl", 2024-09-21T04:05:29.901 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.901 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.901 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.901 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.901 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.902 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.902 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.902 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T04:05:29.902 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.902 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.902 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.902 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.902 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_user": { 2024-09-21T04:05:29.902 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_user", 2024-09-21T04:05:29.902 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.902 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.902 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.902 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.902 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.903 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.903 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.903 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "User to authenticate as", 2024-09-21T04:05:29.903 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.903 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.903 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.903 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.903 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.903 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.903 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.903 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.903 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.903 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.903 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.904 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.904 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.904 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.904 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.904 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.904 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.904 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.904 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.904 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.904 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.904 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "balancer", 2024-09-21T04:05:29.904 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.904 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.904 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.905 INFO:teuthology.orchestra.run.smithi046.stdout: "active": { 2024-09-21T04:05:29.905 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "active", 2024-09-21T04:05:29.905 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.905 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.905 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.905 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.905 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.905 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.905 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.905 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T04:05:29.905 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.905 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.905 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.905 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.905 INFO:teuthology.orchestra.run.smithi046.stdout: "begin_time": { 2024-09-21T04:05:29.906 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "begin_time", 2024-09-21T04:05:29.906 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.906 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.906 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.906 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0000", 2024-09-21T04:05:29.906 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.906 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.906 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.906 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T04:05:29.906 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T04:05:29.906 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.906 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.906 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.907 INFO:teuthology.orchestra.run.smithi046.stdout: "begin_weekday": { 2024-09-21T04:05:29.907 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "begin_weekday", 2024-09-21T04:05:29.907 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2024-09-21T04:05:29.907 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.907 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.907 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.907 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "0", 2024-09-21T04:05:29.907 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "6", 2024-09-21T04:05:29.907 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.907 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T04:05:29.907 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T04:05:29.907 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.907 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.907 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.908 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_compat_max_iterations": { 2024-09-21T04:05:29.908 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crush_compat_max_iterations", 2024-09-21T04:05:29.908 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2024-09-21T04:05:29.908 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.908 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.908 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "25", 2024-09-21T04:05:29.908 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2024-09-21T04:05:29.908 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "250", 2024-09-21T04:05:29.908 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.908 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T04:05:29.908 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.908 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.908 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.908 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.909 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_compat_metrics": { 2024-09-21T04:05:29.909 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crush_compat_metrics", 2024-09-21T04:05:29.909 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.909 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.909 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.909 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T04:05:29.909 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.909 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.909 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.909 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T04:05:29.909 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T04:05:29.909 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.909 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.909 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.909 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_compat_step": { 2024-09-21T04:05:29.910 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crush_compat_step", 2024-09-21T04:05:29.910 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-21T04:05:29.910 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.910 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.910 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0.5", 2024-09-21T04:05:29.910 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "0.001", 2024-09-21T04:05:29.910 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "0.999", 2024-09-21T04:05:29.910 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.910 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "aggressiveness of optimization", 2024-09-21T04:05:29.910 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T04:05:29.910 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.910 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.910 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.910 INFO:teuthology.orchestra.run.smithi046.stdout: "end_time": { 2024-09-21T04:05:29.911 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "end_time", 2024-09-21T04:05:29.911 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.911 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.911 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.911 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "2359", 2024-09-21T04:05:29.911 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.911 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.911 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.911 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T04:05:29.911 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T04:05:29.911 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.911 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.911 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.911 INFO:teuthology.orchestra.run.smithi046.stdout: "end_weekday": { 2024-09-21T04:05:29.912 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "end_weekday", 2024-09-21T04:05:29.912 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2024-09-21T04:05:29.912 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.912 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.912 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.912 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "0", 2024-09-21T04:05:29.912 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "6", 2024-09-21T04:05:29.912 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.912 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T04:05:29.912 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T04:05:29.912 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.912 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.912 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.912 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.912 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.913 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.913 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.913 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.913 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.913 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.913 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.913 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.913 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.913 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.913 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.913 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.913 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.913 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.913 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.914 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.914 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.914 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.914 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.914 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.914 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.914 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.914 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.914 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.914 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.914 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.914 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.914 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.915 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.915 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.915 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.915 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.915 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.915 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.915 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.915 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.915 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.915 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.915 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.915 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.915 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.915 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.916 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.916 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.916 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.916 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.916 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.916 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.916 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.916 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.916 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.916 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.916 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.916 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.916 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.917 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.917 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.917 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.917 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.917 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.917 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.917 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.917 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.917 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.917 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.917 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.917 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.917 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.917 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.917 INFO:teuthology.orchestra.run.smithi046.stdout: "min_score": { 2024-09-21T04:05:29.918 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "min_score", 2024-09-21T04:05:29.918 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-21T04:05:29.918 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.918 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.918 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.918 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.918 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.918 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.918 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T04:05:29.918 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.918 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.918 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.918 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.919 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": { 2024-09-21T04:05:29.919 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mode", 2024-09-21T04:05:29.919 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.919 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.919 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.919 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "upmap", 2024-09-21T04:05:29.919 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.919 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.919 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.919 INFO:teuthology.orchestra.run.smithi046.stdout: "crush-compat", 2024-09-21T04:05:29.919 INFO:teuthology.orchestra.run.smithi046.stdout: "none", 2024-09-21T04:05:29.919 INFO:teuthology.orchestra.run.smithi046.stdout: "read", 2024-09-21T04:05:29.919 INFO:teuthology.orchestra.run.smithi046.stdout: "upmap", 2024-09-21T04:05:29.920 INFO:teuthology.orchestra.run.smithi046.stdout: "upmap-read" 2024-09-21T04:05:29.920 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.920 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Balancer mode", 2024-09-21T04:05:29.920 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.920 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.920 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.920 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.920 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_ids": { 2024-09-21T04:05:29.920 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pool_ids", 2024-09-21T04:05:29.920 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.920 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.920 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.920 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.920 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.920 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.921 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.921 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T04:05:29.921 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.921 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.921 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.921 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.921 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2024-09-21T04:05:29.921 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2024-09-21T04:05:29.921 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:29.921 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.921 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.921 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2024-09-21T04:05:29.921 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.921 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.922 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.922 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T04:05:29.922 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.922 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.922 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.922 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.922 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.922 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.922 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.922 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.922 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.922 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.922 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.922 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.923 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.923 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.923 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.923 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.923 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.923 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.923 INFO:teuthology.orchestra.run.smithi046.stdout: "upmap_max_deviation": { 2024-09-21T04:05:29.923 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "upmap_max_deviation", 2024-09-21T04:05:29.923 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.923 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.923 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.923 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2024-09-21T04:05:29.923 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2024-09-21T04:05:29.923 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.924 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.924 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T04:05:29.924 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T04:05:29.924 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.924 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.924 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.924 INFO:teuthology.orchestra.run.smithi046.stdout: "upmap_max_optimizations": { 2024-09-21T04:05:29.924 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "upmap_max_optimizations", 2024-09-21T04:05:29.924 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2024-09-21T04:05:29.924 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.924 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.924 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-21T04:05:29.924 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.924 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.924 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.925 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T04:05:29.925 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.925 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.925 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.925 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.925 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.925 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.925 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.925 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephadm", 2024-09-21T04:05:29.925 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.925 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.925 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.925 INFO:teuthology.orchestra.run.smithi046.stdout: "agent_down_multiplier": { 2024-09-21T04:05:29.925 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "agent_down_multiplier", 2024-09-21T04:05:29.925 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-21T04:05:29.926 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.926 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.926 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "3.0", 2024-09-21T04:05:29.926 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.926 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.926 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.926 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T04:05:29.926 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.926 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.926 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.926 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.926 INFO:teuthology.orchestra.run.smithi046.stdout: "agent_refresh_rate": { 2024-09-21T04:05:29.926 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "agent_refresh_rate", 2024-09-21T04:05:29.927 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:29.927 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.927 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.927 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "20", 2024-09-21T04:05:29.927 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.927 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.927 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.927 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T04:05:29.927 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.927 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.927 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.927 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.927 INFO:teuthology.orchestra.run.smithi046.stdout: "agent_starting_port": { 2024-09-21T04:05:29.928 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "agent_starting_port", 2024-09-21T04:05:29.928 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.928 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.928 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.928 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "4721", 2024-09-21T04:05:29.928 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.928 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.928 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.928 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T04:05:29.928 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.928 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.928 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.928 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.928 INFO:teuthology.orchestra.run.smithi046.stdout: "allow_ptrace": { 2024-09-21T04:05:29.929 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "allow_ptrace", 2024-09-21T04:05:29.929 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.929 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.929 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.929 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.929 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.929 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.929 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.929 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T04:05:29.929 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T04:05:29.929 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.929 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.929 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.929 INFO:teuthology.orchestra.run.smithi046.stdout: "autotune_interval": { 2024-09-21T04:05:29.929 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "autotune_interval", 2024-09-21T04:05:29.930 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:29.930 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.930 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.930 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2024-09-21T04:05:29.930 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.930 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.930 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.930 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T04:05:29.930 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.930 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.930 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.930 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.930 INFO:teuthology.orchestra.run.smithi046.stdout: "autotune_memory_target_ratio": { 2024-09-21T04:05:29.930 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T04:05:29.931 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-21T04:05:29.931 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.931 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.931 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0.7", 2024-09-21T04:05:29.931 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.931 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.931 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.931 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T04:05:29.931 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.931 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.931 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.931 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.931 INFO:teuthology.orchestra.run.smithi046.stdout: "cephadm_log_destination": { 2024-09-21T04:05:29.931 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephadm_log_destination", 2024-09-21T04:05:29.932 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.932 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.932 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.932 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.932 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.932 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.932 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.932 INFO:teuthology.orchestra.run.smithi046.stdout: "file", 2024-09-21T04:05:29.932 INFO:teuthology.orchestra.run.smithi046.stdout: "file,syslog", 2024-09-21T04:05:29.932 INFO:teuthology.orchestra.run.smithi046.stdout: "syslog" 2024-09-21T04:05:29.932 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.932 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T04:05:29.932 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.932 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.933 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.933 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.933 INFO:teuthology.orchestra.run.smithi046.stdout: "cgroups_split": { 2024-09-21T04:05:29.933 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cgroups_split", 2024-09-21T04:05:29.933 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.933 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.933 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.933 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.933 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.933 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.933 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.933 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T04:05:29.933 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.933 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.934 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.934 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.934 INFO:teuthology.orchestra.run.smithi046.stdout: "config_checks_enabled": { 2024-09-21T04:05:29.934 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "config_checks_enabled", 2024-09-21T04:05:29.934 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.934 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.934 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.934 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.934 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.934 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.934 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.934 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T04:05:29.934 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.934 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.935 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.935 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.935 INFO:teuthology.orchestra.run.smithi046.stdout: "config_dashboard": { 2024-09-21T04:05:29.935 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "config_dashboard", 2024-09-21T04:05:29.935 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.935 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.935 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.935 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.935 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.935 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.935 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.935 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T04:05:29.935 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.935 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.935 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.936 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.936 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_alertmanager": { 2024-09-21T04:05:29.936 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_alertmanager", 2024-09-21T04:05:29.936 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.936 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.936 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.936 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T04:05:29.936 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.936 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.936 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.936 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2024-09-21T04:05:29.936 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.936 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.936 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.937 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.937 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_base": { 2024-09-21T04:05:29.937 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_base", 2024-09-21T04:05:29.937 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.937 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.937 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.937 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T04:05:29.937 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.937 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.937 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.937 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Container image name, without the tag", 2024-09-21T04:05:29.937 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.937 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.937 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.937 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.938 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_elasticsearch": { 2024-09-21T04:05:29.938 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_elasticsearch", 2024-09-21T04:05:29.938 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.938 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.938 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.938 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T04:05:29.938 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.938 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.938 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.938 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "elasticsearch container image", 2024-09-21T04:05:29.938 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.938 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.938 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.939 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.939 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_grafana": { 2024-09-21T04:05:29.939 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_grafana", 2024-09-21T04:05:29.939 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.939 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.939 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.939 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T04:05:29.939 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.939 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.939 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.939 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2024-09-21T04:05:29.939 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.939 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.939 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.940 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.940 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_haproxy": { 2024-09-21T04:05:29.940 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_haproxy", 2024-09-21T04:05:29.940 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.940 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.940 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.940 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T04:05:29.940 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.940 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.940 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.940 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "HAproxy container image", 2024-09-21T04:05:29.940 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.940 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.940 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.941 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.941 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_jaeger_agent": { 2024-09-21T04:05:29.941 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_jaeger_agent", 2024-09-21T04:05:29.941 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.941 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.941 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.941 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T04:05:29.941 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.941 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.941 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.941 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Jaeger agent container image", 2024-09-21T04:05:29.941 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.941 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.941 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.942 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.942 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_jaeger_collector": { 2024-09-21T04:05:29.942 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_jaeger_collector", 2024-09-21T04:05:29.942 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.942 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.942 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.942 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T04:05:29.942 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.942 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.942 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.942 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Jaeger collector container image", 2024-09-21T04:05:29.942 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.942 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.942 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.943 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.943 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_jaeger_query": { 2024-09-21T04:05:29.943 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_jaeger_query", 2024-09-21T04:05:29.943 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.943 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.943 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.943 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T04:05:29.943 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.943 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.943 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.943 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Jaeger query container image", 2024-09-21T04:05:29.943 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.943 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.943 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.944 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.944 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_keepalived": { 2024-09-21T04:05:29.944 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_keepalived", 2024-09-21T04:05:29.944 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.944 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.944 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.944 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T04:05:29.944 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.944 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.944 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.944 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Keepalived container image", 2024-09-21T04:05:29.944 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.944 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.944 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.945 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.945 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_loki": { 2024-09-21T04:05:29.945 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_loki", 2024-09-21T04:05:29.945 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.945 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.945 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.945 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T04:05:29.945 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.945 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.945 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.945 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Loki container image", 2024-09-21T04:05:29.945 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.945 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.945 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.946 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.946 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_nginx": { 2024-09-21T04:05:29.946 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_nginx", 2024-09-21T04:05:29.946 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.946 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.946 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.946 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T04:05:29.946 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.946 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.946 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.946 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Nginx container image", 2024-09-21T04:05:29.946 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.946 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.946 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.947 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.947 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_node_exporter": { 2024-09-21T04:05:29.947 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_node_exporter", 2024-09-21T04:05:29.947 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.947 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.947 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.947 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T04:05:29.947 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.947 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.947 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.947 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2024-09-21T04:05:29.947 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.947 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.947 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.948 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.948 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_nvmeof": { 2024-09-21T04:05:29.948 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_nvmeof", 2024-09-21T04:05:29.948 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.948 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.948 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.948 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T04:05:29.948 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.948 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.948 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.948 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Nvme-of container image", 2024-09-21T04:05:29.948 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.948 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.948 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.949 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.949 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_oauth2_proxy": { 2024-09-21T04:05:29.949 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T04:05:29.949 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.949 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.949 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.949 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T04:05:29.949 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.949 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.949 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.949 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "oauth2-proxy container image", 2024-09-21T04:05:29.949 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.949 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.949 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.949 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.950 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_prometheus": { 2024-09-21T04:05:29.950 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_prometheus", 2024-09-21T04:05:29.950 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.950 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.950 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.950 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T04:05:29.950 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.950 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.950 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.950 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2024-09-21T04:05:29.950 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.950 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.950 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.950 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.951 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_promtail": { 2024-09-21T04:05:29.951 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_promtail", 2024-09-21T04:05:29.951 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.951 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.951 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.951 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T04:05:29.951 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.951 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.951 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.951 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Promtail container image", 2024-09-21T04:05:29.951 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.951 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.951 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.951 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.952 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_samba": { 2024-09-21T04:05:29.952 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_samba", 2024-09-21T04:05:29.952 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.952 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.952 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.952 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T04:05:29.952 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.952 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.952 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.952 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Samba/SMB container image", 2024-09-21T04:05:29.952 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.952 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.952 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.952 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.953 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_samba_metrics": { 2024-09-21T04:05:29.953 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_samba_metrics", 2024-09-21T04:05:29.953 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.953 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.953 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.953 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T04:05:29.953 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.953 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.953 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.953 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T04:05:29.953 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.953 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.953 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.953 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.954 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_snmp_gateway": { 2024-09-21T04:05:29.954 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_snmp_gateway", 2024-09-21T04:05:29.954 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.954 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.954 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.954 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T04:05:29.954 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.954 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.954 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.954 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SNMP Gateway container image", 2024-09-21T04:05:29.954 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.955 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.955 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.955 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.955 INFO:teuthology.orchestra.run.smithi046.stdout: "container_init": { 2024-09-21T04:05:29.955 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_init", 2024-09-21T04:05:29.955 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.955 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.955 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.955 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.955 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.955 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.955 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.955 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T04:05:29.956 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.956 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.956 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.956 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.956 INFO:teuthology.orchestra.run.smithi046.stdout: "daemon_cache_timeout": { 2024-09-21T04:05:29.956 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "daemon_cache_timeout", 2024-09-21T04:05:29.956 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:29.956 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.956 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.956 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2024-09-21T04:05:29.956 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.956 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.957 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.957 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T04:05:29.957 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.957 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.957 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.957 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.957 INFO:teuthology.orchestra.run.smithi046.stdout: "default_cephadm_command_timeout": { 2024-09-21T04:05:29.957 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T04:05:29.957 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.957 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.957 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.957 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "900", 2024-09-21T04:05:29.957 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.958 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.958 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.958 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T04:05:29.958 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.958 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.958 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.958 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.958 INFO:teuthology.orchestra.run.smithi046.stdout: "default_registry": { 2024-09-21T04:05:29.958 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "default_registry", 2024-09-21T04:05:29.958 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.958 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.958 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.958 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io", 2024-09-21T04:05:29.958 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.959 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.959 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.959 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T04:05:29.959 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.959 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.959 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.959 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.959 INFO:teuthology.orchestra.run.smithi046.stdout: "device_cache_timeout": { 2024-09-21T04:05:29.959 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "device_cache_timeout", 2024-09-21T04:05:29.959 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:29.959 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.959 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.960 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "1800", 2024-09-21T04:05:29.960 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.960 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.960 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.960 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "seconds to cache device inventory", 2024-09-21T04:05:29.960 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.960 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.960 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.960 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.960 INFO:teuthology.orchestra.run.smithi046.stdout: "device_enhanced_scan": { 2024-09-21T04:05:29.960 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "device_enhanced_scan", 2024-09-21T04:05:29.960 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.960 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.961 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.961 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.961 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.961 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.961 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.961 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T04:05:29.961 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.961 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.961 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.961 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.961 INFO:teuthology.orchestra.run.smithi046.stdout: "facts_cache_timeout": { 2024-09-21T04:05:29.961 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "facts_cache_timeout", 2024-09-21T04:05:29.961 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:29.961 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.962 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.962 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2024-09-21T04:05:29.962 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.962 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.962 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.962 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "seconds to cache host facts data", 2024-09-21T04:05:29.962 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.962 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.962 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.962 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.962 INFO:teuthology.orchestra.run.smithi046.stdout: "grafana_dashboards_path": { 2024-09-21T04:05:29.962 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "grafana_dashboards_path", 2024-09-21T04:05:29.962 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.962 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.963 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.963 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T04:05:29.963 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.963 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.963 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.963 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T04:05:29.963 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.963 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.963 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.963 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.963 INFO:teuthology.orchestra.run.smithi046.stdout: "host_check_interval": { 2024-09-21T04:05:29.963 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "host_check_interval", 2024-09-21T04:05:29.963 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:29.964 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.964 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.964 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2024-09-21T04:05:29.964 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.964 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.964 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.964 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to perform a host check", 2024-09-21T04:05:29.964 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.964 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.964 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.964 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.964 INFO:teuthology.orchestra.run.smithi046.stdout: "hw_monitoring": { 2024-09-21T04:05:29.964 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "hw_monitoring", 2024-09-21T04:05:29.964 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.965 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.965 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.965 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.965 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.965 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.965 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.965 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T04:05:29.965 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.965 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.965 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.965 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.965 INFO:teuthology.orchestra.run.smithi046.stdout: "inventory_list_all": { 2024-09-21T04:05:29.965 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "inventory_list_all", 2024-09-21T04:05:29.965 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.966 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.966 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.966 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.966 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.966 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.966 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.966 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T04:05:29.966 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.966 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.966 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.966 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.966 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.966 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.966 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.967 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.967 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.967 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.967 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.967 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.967 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.967 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.967 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.967 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.967 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.967 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.967 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.967 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.967 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.968 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.968 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.968 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.968 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.968 INFO:teuthology.orchestra.run.smithi046.stdout: "log_refresh_metadata": { 2024-09-21T04:05:29.968 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_refresh_metadata", 2024-09-21T04:05:29.968 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.968 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.968 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.968 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.968 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.968 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.968 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.968 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T04:05:29.968 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.969 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.969 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.969 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.969 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.969 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.969 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.969 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.969 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.969 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.969 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.969 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.969 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.969 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T04:05:29.969 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.970 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.970 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.970 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.970 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.970 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.970 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.970 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.970 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.970 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.970 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.970 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.970 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.970 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.970 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.970 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.971 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.971 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.971 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.971 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.971 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.971 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.971 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.971 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.971 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.971 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.971 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:29.971 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.971 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.971 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.972 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.972 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.972 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.972 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.972 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.972 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.972 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.972 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.972 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.972 INFO:teuthology.orchestra.run.smithi046.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T04:05:29.972 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T04:05:29.972 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.972 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.972 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.972 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.973 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.973 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.973 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.973 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T04:05:29.973 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.973 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.973 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.973 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.973 INFO:teuthology.orchestra.run.smithi046.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T04:05:29.973 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T04:05:29.973 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.973 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.973 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.973 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "*", 2024-09-21T04:05:29.973 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.974 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.974 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.974 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T04:05:29.974 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.974 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.974 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.974 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.974 INFO:teuthology.orchestra.run.smithi046.stdout: "max_count_per_host": { 2024-09-21T04:05:29.974 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_count_per_host", 2024-09-21T04:05:29.974 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.974 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.974 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.974 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-21T04:05:29.974 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.975 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.975 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.975 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "max number of daemons per service per host", 2024-09-21T04:05:29.975 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.975 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.975 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.975 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.975 INFO:teuthology.orchestra.run.smithi046.stdout: "max_osd_draining_count": { 2024-09-21T04:05:29.975 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_osd_draining_count", 2024-09-21T04:05:29.975 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.975 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.975 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.975 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-21T04:05:29.975 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.975 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.976 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.976 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T04:05:29.976 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.976 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.976 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.976 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.976 INFO:teuthology.orchestra.run.smithi046.stdout: "migration_current": { 2024-09-21T04:05:29.976 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "migration_current", 2024-09-21T04:05:29.976 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.976 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.976 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.976 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.976 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.977 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.977 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.977 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "internal - do not modify", 2024-09-21T04:05:29.977 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.977 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.977 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.977 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.977 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": { 2024-09-21T04:05:29.977 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mode", 2024-09-21T04:05:29.977 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.977 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.977 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.977 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "root", 2024-09-21T04:05:29.977 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.978 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.978 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.978 INFO:teuthology.orchestra.run.smithi046.stdout: "cephadm-package", 2024-09-21T04:05:29.978 INFO:teuthology.orchestra.run.smithi046.stdout: "root" 2024-09-21T04:05:29.978 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.978 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T04:05:29.978 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.978 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.978 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.978 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.978 INFO:teuthology.orchestra.run.smithi046.stdout: "oob_default_addr": { 2024-09-21T04:05:29.978 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "oob_default_addr", 2024-09-21T04:05:29.978 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.978 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.979 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.979 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "169.254.1.1", 2024-09-21T04:05:29.979 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.979 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.979 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.979 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T04:05:29.979 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.979 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.979 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.979 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.979 INFO:teuthology.orchestra.run.smithi046.stdout: "prometheus_alerts_path": { 2024-09-21T04:05:29.979 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "prometheus_alerts_path", 2024-09-21T04:05:29.979 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.979 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.980 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.980 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T04:05:29.980 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.980 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.980 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.980 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T04:05:29.980 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.980 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.980 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.980 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.980 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_insecure": { 2024-09-21T04:05:29.980 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_insecure", 2024-09-21T04:05:29.980 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.980 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.981 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.981 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.981 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.981 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.981 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.981 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T04:05:29.981 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.981 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.981 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.981 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.981 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_password": { 2024-09-21T04:05:29.981 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_password", 2024-09-21T04:05:29.981 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.981 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.982 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.982 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.982 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.982 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.982 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.982 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T04:05:29.982 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.982 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.982 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.982 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.982 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_url": { 2024-09-21T04:05:29.982 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_url", 2024-09-21T04:05:29.982 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.982 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.983 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.983 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.983 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.983 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.983 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.983 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T04:05:29.983 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.983 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.983 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.983 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.983 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_username": { 2024-09-21T04:05:29.983 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_username", 2024-09-21T04:05:29.983 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.983 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.984 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.984 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.984 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.984 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.984 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.984 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T04:05:29.984 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.984 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.984 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.984 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.984 INFO:teuthology.orchestra.run.smithi046.stdout: "secure_monitoring_stack": { 2024-09-21T04:05:29.984 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "secure_monitoring_stack", 2024-09-21T04:05:29.984 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.984 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.985 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.985 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.985 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.985 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.985 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.985 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T04:05:29.985 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.985 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.985 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.985 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.985 INFO:teuthology.orchestra.run.smithi046.stdout: "service_discovery_port": { 2024-09-21T04:05:29.985 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "service_discovery_port", 2024-09-21T04:05:29.985 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.985 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.985 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.986 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8765", 2024-09-21T04:05:29.986 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.986 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.986 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.986 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "cephadm service discovery port", 2024-09-21T04:05:29.986 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.986 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.986 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.986 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.986 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:29.986 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:29.986 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.986 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:29.987 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.987 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:29.987 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.987 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.987 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.987 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.987 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.987 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.987 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.987 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.987 INFO:teuthology.orchestra.run.smithi046.stdout: "ssh_config_file": { 2024-09-21T04:05:29.987 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssh_config_file", 2024-09-21T04:05:29.987 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.987 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.987 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.988 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.988 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.988 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.988 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.988 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T04:05:29.988 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.988 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.988 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.988 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.988 INFO:teuthology.orchestra.run.smithi046.stdout: "ssh_keepalive_count_max": { 2024-09-21T04:05:29.988 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T04:05:29.988 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.988 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.989 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.989 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "3", 2024-09-21T04:05:29.989 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.989 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.989 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.989 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T04:05:29.989 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.989 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.989 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.989 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.989 INFO:teuthology.orchestra.run.smithi046.stdout: "ssh_keepalive_interval": { 2024-09-21T04:05:29.989 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssh_keepalive_interval", 2024-09-21T04:05:29.989 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:29.989 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.989 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.990 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "7", 2024-09-21T04:05:29.990 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.990 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.990 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.990 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T04:05:29.990 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.990 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.990 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.990 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.990 INFO:teuthology.orchestra.run.smithi046.stdout: "use_agent": { 2024-09-21T04:05:29.990 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "use_agent", 2024-09-21T04:05:29.990 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.990 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.990 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.990 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.991 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.991 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.991 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.991 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T04:05:29.991 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.991 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.991 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.991 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.991 INFO:teuthology.orchestra.run.smithi046.stdout: "use_repo_digest": { 2024-09-21T04:05:29.991 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "use_repo_digest", 2024-09-21T04:05:29.991 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.991 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.991 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.991 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.992 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.992 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.992 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.992 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T04:05:29.992 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.992 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.992 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.992 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.992 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_on_failed_host_check": { 2024-09-21T04:05:29.992 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_on_failed_host_check", 2024-09-21T04:05:29.992 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.992 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.992 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.992 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.993 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.993 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.993 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.993 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T04:05:29.993 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.993 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.993 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.993 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.993 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_on_stray_daemons": { 2024-09-21T04:05:29.993 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_on_stray_daemons", 2024-09-21T04:05:29.993 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.993 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.993 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.993 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.993 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.994 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.994 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.994 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T04:05:29.994 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.994 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.994 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.994 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.994 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_on_stray_hosts": { 2024-09-21T04:05:29.994 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_on_stray_hosts", 2024-09-21T04:05:29.994 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.994 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.994 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:29.994 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:29.994 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.994 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.995 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.995 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T04:05:29.995 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.995 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.995 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.995 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.995 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:29.995 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.995 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:29.995 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crash", 2024-09-21T04:05:29.995 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:29.995 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:29.995 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:29.995 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:29.996 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:29.996 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.996 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.996 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.996 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:29.996 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.996 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.996 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.996 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.996 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.996 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.996 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.996 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.996 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.997 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.997 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.997 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.997 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.997 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.997 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.997 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:29.997 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:29.997 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:29.997 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.997 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.997 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:29.997 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.997 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.997 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:29.998 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.998 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.998 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.998 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.998 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.998 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:29.998 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:29.998 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:29.998 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:29.998 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:29.998 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:29.998 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:29.998 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:29.998 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:29.999 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:29.999 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:29.999 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:29.999 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:29.999 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:29.999 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:29.999 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:29.999 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:29.999 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:29.999 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:29.999 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:29.999 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:29.999 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:29.999 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.000 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.000 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.000 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.000 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.000 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.000 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.000 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.000 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.000 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.000 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.000 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.000 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.000 INFO:teuthology.orchestra.run.smithi046.stdout: "retain_interval": { 2024-09-21T04:05:30.000 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "retain_interval", 2024-09-21T04:05:30.001 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:30.001 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.001 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.001 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "31536000", 2024-09-21T04:05:30.001 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.001 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.001 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.001 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T04:05:30.001 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.001 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.001 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.001 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.001 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.001 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.002 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.002 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.002 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.002 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.002 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.002 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.002 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.002 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.002 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.002 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.002 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.002 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.002 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_recent_interval": { 2024-09-21T04:05:30.003 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_recent_interval", 2024-09-21T04:05:30.003 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:30.003 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.003 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.003 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "1209600", 2024-09-21T04:05:30.003 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.003 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.003 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.003 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T04:05:30.003 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.003 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.003 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.003 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.003 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.003 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.004 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.004 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "dashboard", 2024-09-21T04:05:30.004 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.004 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.004 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.004 INFO:teuthology.orchestra.run.smithi046.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T04:05:30.004 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T04:05:30.004 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.004 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.004 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.004 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-21T04:05:30.004 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.004 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.004 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.005 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.005 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.005 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.005 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.005 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.005 INFO:teuthology.orchestra.run.smithi046.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T04:05:30.005 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T04:05:30.005 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.005 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.005 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.005 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.005 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.005 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.006 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.006 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.006 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.006 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.006 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.006 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.006 INFO:teuthology.orchestra.run.smithi046.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T04:05:30.006 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T04:05:30.006 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.006 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.006 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.006 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.006 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.007 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.007 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.007 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.007 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.007 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.007 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.007 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.007 INFO:teuthology.orchestra.run.smithi046.stdout: "AUDIT_API_ENABLED": { 2024-09-21T04:05:30.007 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T04:05:30.007 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.007 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.007 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.007 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.008 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.008 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.008 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.008 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.008 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.008 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.008 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.008 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.008 INFO:teuthology.orchestra.run.smithi046.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T04:05:30.008 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T04:05:30.008 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.008 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.008 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.008 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.008 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.009 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.009 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.009 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.009 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.009 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.009 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.009 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.009 INFO:teuthology.orchestra.run.smithi046.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T04:05:30.009 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T04:05:30.009 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.009 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.009 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.009 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.009 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.009 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.010 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.010 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.010 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.010 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.010 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.010 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.010 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T04:05:30.010 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T04:05:30.010 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.010 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.010 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.010 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.010 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.010 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.011 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.011 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.011 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.011 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.011 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.011 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.011 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T04:05:30.011 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T04:05:30.011 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.011 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.011 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.011 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.011 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.011 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.012 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.012 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.012 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.012 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.012 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.012 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.012 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T04:05:30.012 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T04:05:30.012 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.012 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.012 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.012 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.012 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.012 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.013 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.013 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.013 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.013 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.013 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.013 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.013 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T04:05:30.013 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T04:05:30.013 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.013 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.013 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.013 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.013 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.013 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.014 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.014 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.014 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.014 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.014 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.014 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.014 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T04:05:30.014 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T04:05:30.014 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.014 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.014 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.014 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.014 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.015 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.015 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.015 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.015 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.015 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.015 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.015 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.015 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T04:05:30.015 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T04:05:30.015 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.015 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.015 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.015 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.016 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.016 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.016 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.016 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.016 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.016 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.016 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.016 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.016 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T04:05:30.016 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T04:05:30.016 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.016 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.016 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.016 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.017 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.017 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.017 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.017 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.017 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.017 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.017 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.017 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.017 INFO:teuthology.orchestra.run.smithi046.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T04:05:30.017 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T04:05:30.017 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.017 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.017 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.017 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.017 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.018 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.018 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.018 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.018 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.018 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.018 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.018 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.018 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T04:05:30.018 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T04:05:30.018 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.018 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.018 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.018 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "admin", 2024-09-21T04:05:30.018 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.019 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.019 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.019 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.019 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.019 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.019 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.019 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.019 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T04:05:30.019 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T04:05:30.019 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.019 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.019 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.019 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.020 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.020 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.020 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.020 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.020 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.020 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.020 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.020 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.020 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_URL": { 2024-09-21T04:05:30.020 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_URL", 2024-09-21T04:05:30.020 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.020 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.020 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.020 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.021 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.021 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.021 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.021 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.021 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.021 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.021 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.021 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.021 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T04:05:30.021 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T04:05:30.021 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.021 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.021 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.021 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "admin", 2024-09-21T04:05:30.021 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.022 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.022 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.022 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.022 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.022 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.022 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.022 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.022 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T04:05:30.022 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T04:05:30.022 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.022 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.022 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.022 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.022 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.023 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.023 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.023 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.023 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.023 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.023 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.023 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.023 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T04:05:30.023 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T04:05:30.023 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.023 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.023 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.023 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.023 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.024 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.024 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.024 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.024 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.024 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.024 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.024 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.024 INFO:teuthology.orchestra.run.smithi046.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T04:05:30.024 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T04:05:30.024 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.024 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.024 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.024 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.024 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.024 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.025 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.025 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.025 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.025 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.025 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.025 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.025 INFO:teuthology.orchestra.run.smithi046.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T04:05:30.025 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T04:05:30.025 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.025 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.025 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.025 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.025 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.025 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.026 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.026 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.026 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.026 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.026 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.026 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.026 INFO:teuthology.orchestra.run.smithi046.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T04:05:30.026 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T04:05:30.026 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.026 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.026 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.026 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "[]", 2024-09-21T04:05:30.026 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.026 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.026 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.027 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.027 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.027 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.027 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.027 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.027 INFO:teuthology.orchestra.run.smithi046.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T04:05:30.027 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T04:05:30.027 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.027 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.027 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.027 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "{}", 2024-09-21T04:05:30.027 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.027 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.028 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.028 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.028 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.028 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.028 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.028 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.028 INFO:teuthology.orchestra.run.smithi046.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T04:05:30.028 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T04:05:30.028 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.028 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.028 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.028 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.028 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.028 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.028 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.029 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.029 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.029 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.029 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.029 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.029 INFO:teuthology.orchestra.run.smithi046.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T04:05:30.029 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T04:05:30.029 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.029 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.029 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.029 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.029 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.029 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.029 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.030 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.030 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.030 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.030 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.030 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.030 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T04:05:30.030 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T04:05:30.030 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.030 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.030 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.030 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.030 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.030 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.030 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.031 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.031 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.031 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.031 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.031 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.031 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T04:05:30.031 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T04:05:30.031 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.031 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.031 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.031 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.031 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.031 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.031 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.032 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.032 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.032 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.032 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.032 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.032 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T04:05:30.032 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T04:05:30.032 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.032 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.032 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.032 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.032 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.032 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.032 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.033 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.033 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.033 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.033 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.033 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.033 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T04:05:30.033 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T04:05:30.033 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.033 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.033 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.033 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.033 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.033 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.033 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.034 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.034 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.034 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.034 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.034 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.034 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T04:05:30.034 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T04:05:30.034 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.034 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.034 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.034 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.034 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.034 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.034 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.035 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.035 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.035 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.035 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.035 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.035 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T04:05:30.035 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T04:05:30.035 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.035 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.035 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.035 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.035 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.035 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.036 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.036 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.036 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.036 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.036 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.036 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.036 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T04:05:30.036 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T04:05:30.036 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.036 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.036 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.036 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.036 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.036 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.037 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.037 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.037 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.037 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.037 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.037 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.037 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T04:05:30.037 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T04:05:30.037 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.037 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.037 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.037 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.037 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.037 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.037 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.038 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.038 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.038 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.038 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.038 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.038 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T04:05:30.038 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T04:05:30.038 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.038 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.038 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.038 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T04:05:30.038 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.038 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.039 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.039 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.039 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.039 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.039 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.039 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.039 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T04:05:30.039 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T04:05:30.039 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.039 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.039 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.039 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-21T04:05:30.039 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.039 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.039 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.040 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.040 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.040 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.040 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.040 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.040 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T04:05:30.040 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T04:05:30.040 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.040 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.040 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.040 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8", 2024-09-21T04:05:30.040 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.040 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.041 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.041 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.041 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.041 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.041 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.041 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.041 INFO:teuthology.orchestra.run.smithi046.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T04:05:30.041 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T04:05:30.041 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.041 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.041 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.041 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "45", 2024-09-21T04:05:30.041 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.041 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.042 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.042 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.042 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.042 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.042 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.042 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.042 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T04:05:30.042 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T04:05:30.042 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.042 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.042 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.042 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.042 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.043 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.043 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.043 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.043 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.043 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.043 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.043 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.043 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T04:05:30.043 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T04:05:30.043 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.043 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.043 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.043 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "admin", 2024-09-21T04:05:30.043 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.044 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.044 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.044 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.044 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.044 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.044 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.044 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.044 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T04:05:30.044 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T04:05:30.044 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.044 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.044 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.044 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.045 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.045 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.045 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.045 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.045 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.045 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.045 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.045 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.045 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T04:05:30.045 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T04:05:30.045 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.045 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.045 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.045 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.046 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.046 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.046 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.046 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.046 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.046 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.046 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.046 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.046 INFO:teuthology.orchestra.run.smithi046.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T04:05:30.046 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T04:05:30.046 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.046 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.046 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.046 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.047 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.047 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.047 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.047 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.047 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.047 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.047 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.047 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.047 INFO:teuthology.orchestra.run.smithi046.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T04:05:30.047 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T04:05:30.047 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.047 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.047 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.047 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.048 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.048 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.048 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.048 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.048 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.048 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.048 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.048 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.048 INFO:teuthology.orchestra.run.smithi046.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T04:05:30.048 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T04:05:30.048 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.048 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.048 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.049 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-21T04:05:30.049 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.049 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.049 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.049 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.049 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.049 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.049 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.049 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.049 INFO:teuthology.orchestra.run.smithi046.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T04:05:30.049 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T04:05:30.049 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.049 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.050 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.050 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2024-09-21T04:05:30.050 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.050 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.050 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.050 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.050 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.050 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.050 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.050 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.050 INFO:teuthology.orchestra.run.smithi046.stdout: "cross_origin_url": { 2024-09-21T04:05:30.050 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cross_origin_url", 2024-09-21T04:05:30.050 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.050 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.051 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.051 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.051 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.051 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.051 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.051 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.051 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.051 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.051 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.051 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.051 INFO:teuthology.orchestra.run.smithi046.stdout: "crt_file": { 2024-09-21T04:05:30.051 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crt_file", 2024-09-21T04:05:30.051 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.051 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.051 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.052 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.052 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.052 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.052 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.052 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.052 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.052 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.052 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.052 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.052 INFO:teuthology.orchestra.run.smithi046.stdout: "debug": { 2024-09-21T04:05:30.052 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "debug", 2024-09-21T04:05:30.052 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.052 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.052 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.053 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.053 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.053 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.053 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.053 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Enable/disable debug options", 2024-09-21T04:05:30.053 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.053 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.053 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.053 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.053 INFO:teuthology.orchestra.run.smithi046.stdout: "jwt_token_ttl": { 2024-09-21T04:05:30.053 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "jwt_token_ttl", 2024-09-21T04:05:30.053 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.053 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.054 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.054 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "28800", 2024-09-21T04:05:30.054 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.054 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.054 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.054 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.054 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.054 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.054 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.054 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.054 INFO:teuthology.orchestra.run.smithi046.stdout: "key_file": { 2024-09-21T04:05:30.054 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "key_file", 2024-09-21T04:05:30.054 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.054 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.055 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.055 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.055 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.055 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.055 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.055 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.055 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.055 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.055 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.055 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.055 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.055 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.055 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.055 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.056 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.056 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.056 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.056 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.056 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.056 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.056 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.056 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.056 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.056 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.056 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.056 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.056 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.056 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.057 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.057 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.057 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.057 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.057 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.057 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.057 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.057 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.057 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.057 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.057 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.057 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.057 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.057 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.058 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.058 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.058 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.058 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.058 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.058 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.058 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.058 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.058 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.058 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.058 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.058 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.058 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.058 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.059 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.059 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.059 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.059 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.059 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.059 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.059 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.059 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.059 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.059 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.059 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.059 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.059 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.060 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.060 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.060 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.060 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.060 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.060 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.060 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.060 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.060 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.060 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.060 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.060 INFO:teuthology.orchestra.run.smithi046.stdout: "motd": { 2024-09-21T04:05:30.060 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "motd", 2024-09-21T04:05:30.060 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.060 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.061 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.061 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.061 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.061 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.061 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.061 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "The message of the day", 2024-09-21T04:05:30.061 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.061 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.061 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.061 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.061 INFO:teuthology.orchestra.run.smithi046.stdout: "redirect_resolve_ip_addr": { 2024-09-21T04:05:30.061 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T04:05:30.061 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.061 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.062 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.062 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.062 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.062 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.062 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.062 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.062 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.062 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.062 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.062 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.062 INFO:teuthology.orchestra.run.smithi046.stdout: "server_addr": { 2024-09-21T04:05:30.062 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_addr", 2024-09-21T04:05:30.062 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.062 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.063 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.063 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "::", 2024-09-21T04:05:30.063 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.063 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.063 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.063 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.063 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.063 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.063 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.063 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.063 INFO:teuthology.orchestra.run.smithi046.stdout: "server_port": { 2024-09-21T04:05:30.063 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_port", 2024-09-21T04:05:30.063 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.063 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.064 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.064 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8080", 2024-09-21T04:05:30.064 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.064 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.064 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.064 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.064 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.064 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.064 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.064 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.064 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.064 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.064 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.064 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.064 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.065 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.065 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.065 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.065 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.065 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.065 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.065 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.065 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.065 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.065 INFO:teuthology.orchestra.run.smithi046.stdout: "ssl": { 2024-09-21T04:05:30.065 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssl", 2024-09-21T04:05:30.065 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.065 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.065 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.065 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.066 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.066 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.066 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.066 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.066 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.066 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.066 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.066 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.066 INFO:teuthology.orchestra.run.smithi046.stdout: "ssl_server_port": { 2024-09-21T04:05:30.066 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssl_server_port", 2024-09-21T04:05:30.066 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.066 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.066 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.067 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8443", 2024-09-21T04:05:30.067 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.067 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.067 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.067 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.067 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.067 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.067 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.067 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.067 INFO:teuthology.orchestra.run.smithi046.stdout: "sso_oauth2": { 2024-09-21T04:05:30.067 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sso_oauth2", 2024-09-21T04:05:30.068 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.068 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.068 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.068 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.068 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.068 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.068 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.068 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.068 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.068 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.068 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.068 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.068 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_behaviour": { 2024-09-21T04:05:30.068 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_behaviour", 2024-09-21T04:05:30.068 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.069 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.069 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.069 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "redirect", 2024-09-21T04:05:30.069 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.069 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.069 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.069 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.069 INFO:teuthology.orchestra.run.smithi046.stdout: "redirect" 2024-09-21T04:05:30.069 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.069 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.069 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.069 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.069 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.069 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.070 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_error_status_code": { 2024-09-21T04:05:30.070 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_error_status_code", 2024-09-21T04:05:30.070 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.070 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.070 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.070 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "500", 2024-09-21T04:05:30.070 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "400", 2024-09-21T04:05:30.070 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "599", 2024-09-21T04:05:30.070 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.070 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.070 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.070 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.070 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.071 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.071 INFO:teuthology.orchestra.run.smithi046.stdout: "url_prefix": { 2024-09-21T04:05:30.071 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "url_prefix", 2024-09-21T04:05:30.071 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.071 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.071 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.071 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.071 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.071 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.071 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.071 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.071 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.071 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.071 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.072 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.072 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.072 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.072 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.072 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "devicehealth", 2024-09-21T04:05:30.072 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.072 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.072 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.072 INFO:teuthology.orchestra.run.smithi046.stdout: "enable_monitoring": { 2024-09-21T04:05:30.072 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enable_monitoring", 2024-09-21T04:05:30.072 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.072 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.072 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.072 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.073 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.073 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.073 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.073 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "monitor device health metrics", 2024-09-21T04:05:30.073 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.073 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.073 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.073 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.073 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.073 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.073 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.073 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.073 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.073 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.074 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.074 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.074 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.074 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.074 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.074 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.074 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.074 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.074 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.074 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.074 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.074 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.074 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.074 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.075 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.075 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.075 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.075 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.075 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.075 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.075 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.075 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.075 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.075 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.075 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.075 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.075 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.075 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.075 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.076 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.076 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.076 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.076 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.076 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.076 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.076 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.076 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.076 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.076 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.076 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.076 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.076 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.076 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.077 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.077 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.077 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.077 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.077 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.077 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.077 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.077 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.077 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.077 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.077 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.077 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.077 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.077 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.078 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.078 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.078 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.078 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.078 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.078 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.078 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.078 INFO:teuthology.orchestra.run.smithi046.stdout: "mark_out_threshold": { 2024-09-21T04:05:30.078 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mark_out_threshold", 2024-09-21T04:05:30.078 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:30.078 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.078 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.078 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "2419200", 2024-09-21T04:05:30.078 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.079 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.079 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.079 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T04:05:30.079 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.079 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.079 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.079 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.079 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_name": { 2024-09-21T04:05:30.079 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pool_name", 2024-09-21T04:05:30.079 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.079 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.079 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.079 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "device_health_metrics", 2024-09-21T04:05:30.079 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.080 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.080 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.080 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T04:05:30.080 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.080 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.080 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.080 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.080 INFO:teuthology.orchestra.run.smithi046.stdout: "retention_period": { 2024-09-21T04:05:30.080 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "retention_period", 2024-09-21T04:05:30.080 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:30.080 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.080 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.080 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "15552000", 2024-09-21T04:05:30.080 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.081 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.081 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.081 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how long to retain device health metrics", 2024-09-21T04:05:30.081 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.081 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.081 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.081 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.081 INFO:teuthology.orchestra.run.smithi046.stdout: "scrape_frequency": { 2024-09-21T04:05:30.081 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "scrape_frequency", 2024-09-21T04:05:30.081 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:30.081 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.081 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.081 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "86400", 2024-09-21T04:05:30.081 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.082 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.082 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.082 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T04:05:30.082 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.082 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.082 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.082 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.082 INFO:teuthology.orchestra.run.smithi046.stdout: "self_heal": { 2024-09-21T04:05:30.082 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "self_heal", 2024-09-21T04:05:30.082 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.082 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.082 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.083 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.083 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.083 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.083 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.083 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T04:05:30.083 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.083 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.083 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.083 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.083 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2024-09-21T04:05:30.083 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2024-09-21T04:05:30.083 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:30.083 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.083 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.084 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2024-09-21T04:05:30.084 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.084 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.084 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.084 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T04:05:30.084 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.084 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.084 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.084 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.084 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.084 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.084 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.084 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.084 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.085 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.085 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.085 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.085 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.085 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.085 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.085 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.085 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.085 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.085 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_threshold": { 2024-09-21T04:05:30.085 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_threshold", 2024-09-21T04:05:30.085 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:30.085 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.085 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.086 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "7257600", 2024-09-21T04:05:30.086 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.086 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.086 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.086 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T04:05:30.086 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.086 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.086 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.086 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.086 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.086 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.086 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.086 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "diskprediction_local", 2024-09-21T04:05:30.086 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.087 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.087 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.087 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.087 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.087 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.087 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.087 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.087 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.087 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.087 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.087 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.087 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.087 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.087 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.087 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.088 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.088 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.088 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.088 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.088 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.088 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.088 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.088 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.088 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.088 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.088 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.088 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.088 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.088 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.089 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.089 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.089 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.089 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.089 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.089 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.089 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.089 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.089 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.089 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.089 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.089 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.089 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.089 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.090 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.090 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.090 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.090 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.090 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.090 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.090 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.090 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.090 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.090 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.090 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.090 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.090 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.090 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.090 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.091 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.091 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.091 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.091 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.091 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.091 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.091 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.091 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.091 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.091 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.091 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.091 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.091 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.091 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.092 INFO:teuthology.orchestra.run.smithi046.stdout: "predict_interval": { 2024-09-21T04:05:30.092 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "predict_interval", 2024-09-21T04:05:30.092 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.092 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.092 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.092 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "86400", 2024-09-21T04:05:30.092 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.092 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.092 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.092 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.092 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.092 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.092 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.092 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.093 INFO:teuthology.orchestra.run.smithi046.stdout: "predictor_model": { 2024-09-21T04:05:30.093 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "predictor_model", 2024-09-21T04:05:30.093 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.093 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.093 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.093 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "prophetstor", 2024-09-21T04:05:30.093 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.093 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.093 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.093 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.093 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.093 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.093 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.093 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.093 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2024-09-21T04:05:30.094 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2024-09-21T04:05:30.094 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.094 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.094 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.094 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2024-09-21T04:05:30.094 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.094 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.094 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.094 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.094 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.094 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.094 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.094 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.095 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.095 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.095 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.095 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.095 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.095 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.095 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.095 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.095 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.095 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.095 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.095 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.095 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.095 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.096 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.096 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.096 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.096 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "influx", 2024-09-21T04:05:30.096 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": false, 2024-09-21T04:05:30.096 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "influxdb python module not found", 2024-09-21T04:05:30.096 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.096 INFO:teuthology.orchestra.run.smithi046.stdout: "batch_size": { 2024-09-21T04:05:30.096 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "batch_size", 2024-09-21T04:05:30.096 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.096 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.096 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.096 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5000", 2024-09-21T04:05:30.096 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.096 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.097 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.097 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T04:05:30.097 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.097 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.097 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.097 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.097 INFO:teuthology.orchestra.run.smithi046.stdout: "database": { 2024-09-21T04:05:30.097 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "database", 2024-09-21T04:05:30.097 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.097 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.097 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.097 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "ceph", 2024-09-21T04:05:30.097 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.097 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.098 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.098 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T04:05:30.098 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.098 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.098 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.098 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.098 INFO:teuthology.orchestra.run.smithi046.stdout: "hostname": { 2024-09-21T04:05:30.098 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "hostname", 2024-09-21T04:05:30.098 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.098 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.098 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.098 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.098 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.098 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.099 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.099 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "InfluxDB server hostname", 2024-09-21T04:05:30.099 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.099 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.099 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.099 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.099 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2024-09-21T04:05:30.099 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2024-09-21T04:05:30.099 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:30.099 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.099 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.099 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "30", 2024-09-21T04:05:30.099 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "5", 2024-09-21T04:05:30.099 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.100 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.100 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T04:05:30.100 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.100 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.100 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.100 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.100 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.100 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.100 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.100 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.100 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.100 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.100 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.100 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.100 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.101 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.101 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.101 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.101 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.101 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.101 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.101 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.101 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.101 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.101 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.101 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.101 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.101 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.101 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.102 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.102 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.102 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.102 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.102 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.102 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.102 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.102 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.102 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.102 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.102 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.102 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.102 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.102 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.103 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.103 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.103 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.103 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.103 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.103 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.103 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.103 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.103 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.103 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.103 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.103 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.103 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.103 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.103 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.104 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.104 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.104 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.104 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.104 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.104 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.104 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.104 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.104 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.104 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.104 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.104 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.104 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.104 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.105 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.105 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.105 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.105 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.105 INFO:teuthology.orchestra.run.smithi046.stdout: "password": { 2024-09-21T04:05:30.105 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "password", 2024-09-21T04:05:30.105 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.105 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.105 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.105 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.105 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.105 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.105 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.105 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "password of InfluxDB server user", 2024-09-21T04:05:30.105 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.106 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.106 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.106 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.106 INFO:teuthology.orchestra.run.smithi046.stdout: "port": { 2024-09-21T04:05:30.106 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "port", 2024-09-21T04:05:30.106 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.106 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.106 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.106 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8086", 2024-09-21T04:05:30.106 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.106 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.106 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.106 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "InfluxDB server port", 2024-09-21T04:05:30.106 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.107 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.107 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.107 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.107 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.107 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.107 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.107 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.107 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.107 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.107 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.107 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.107 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.107 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.108 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.108 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.108 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.108 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.108 INFO:teuthology.orchestra.run.smithi046.stdout: "ssl": { 2024-09-21T04:05:30.108 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssl", 2024-09-21T04:05:30.108 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.108 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.108 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.108 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "false", 2024-09-21T04:05:30.108 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.108 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.108 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.108 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T04:05:30.108 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.109 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.109 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.109 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.109 INFO:teuthology.orchestra.run.smithi046.stdout: "threads": { 2024-09-21T04:05:30.109 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "threads", 2024-09-21T04:05:30.109 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.109 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.109 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.109 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2024-09-21T04:05:30.109 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2024-09-21T04:05:30.109 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "32", 2024-09-21T04:05:30.109 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.109 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T04:05:30.110 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.110 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.110 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.110 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.110 INFO:teuthology.orchestra.run.smithi046.stdout: "username": { 2024-09-21T04:05:30.110 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "username", 2024-09-21T04:05:30.110 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.110 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.110 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.110 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.110 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.110 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.110 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.110 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "username of InfluxDB server user", 2024-09-21T04:05:30.111 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.111 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.111 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.111 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.111 INFO:teuthology.orchestra.run.smithi046.stdout: "verify_ssl": { 2024-09-21T04:05:30.111 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "verify_ssl", 2024-09-21T04:05:30.111 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.111 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.111 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.111 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "true", 2024-09-21T04:05:30.111 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.111 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.111 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.111 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T04:05:30.112 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.112 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.112 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.112 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.112 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.112 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.112 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.112 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "insights", 2024-09-21T04:05:30.112 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.112 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.112 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.112 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.112 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.113 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.113 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.113 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.113 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.113 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.113 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.113 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.113 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.113 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.113 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.113 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.113 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.113 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.113 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.113 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.114 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.114 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.114 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.114 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.114 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.114 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.114 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.114 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.114 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.114 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.114 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.114 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.114 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.114 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.115 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.115 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.115 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.115 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.115 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.115 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.115 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.115 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.115 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.115 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.115 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.115 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.115 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.115 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.116 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.116 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.116 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.116 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.116 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.116 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.116 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.116 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.116 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.116 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.116 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.116 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.116 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.116 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.116 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.117 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.117 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.117 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.117 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.117 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.117 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.117 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.117 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.117 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.117 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.117 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.117 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.117 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.117 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.118 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.118 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.118 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.118 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.118 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.118 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.118 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.118 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.118 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.118 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.118 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.118 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.118 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.118 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "iostat", 2024-09-21T04:05:30.119 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.119 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.119 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.119 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.119 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.119 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.119 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.119 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.119 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.119 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.119 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.119 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.119 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.119 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.119 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.120 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.120 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.120 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.120 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.120 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.120 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.120 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.120 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.120 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.120 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.120 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.120 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.120 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.120 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.121 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.121 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.121 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.121 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.121 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.121 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.121 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.121 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.121 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.121 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.121 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.121 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.121 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.122 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.122 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.122 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.122 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.122 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.122 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.122 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.122 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.122 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.122 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.122 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.122 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.122 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.122 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.123 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.123 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.123 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.123 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.123 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.123 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.123 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.123 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.123 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.123 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.123 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.123 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.123 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.123 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.123 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.124 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.124 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.124 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.124 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.124 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.124 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.124 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.124 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.124 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.124 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.124 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.124 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.124 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.124 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.125 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.125 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.125 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.125 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.125 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.125 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "k8sevents", 2024-09-21T04:05:30.125 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.125 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.125 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.125 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_event_retention_days": { 2024-09-21T04:05:30.125 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ceph_event_retention_days", 2024-09-21T04:05:30.125 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.125 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.125 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.125 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "7", 2024-09-21T04:05:30.126 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.126 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.126 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.126 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T04:05:30.126 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.126 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.126 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.126 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.126 INFO:teuthology.orchestra.run.smithi046.stdout: "config_check_secs": { 2024-09-21T04:05:30.126 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "config_check_secs", 2024-09-21T04:05:30.126 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.126 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.126 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.127 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-21T04:05:30.127 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "10", 2024-09-21T04:05:30.127 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.127 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.127 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T04:05:30.127 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.127 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.127 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.127 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.127 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.127 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.127 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.127 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.127 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.127 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.128 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.128 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.128 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.128 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.128 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.128 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.128 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.128 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.128 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.128 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.128 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.128 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.128 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.128 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.128 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.129 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.129 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.129 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.129 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.129 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.129 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.129 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.129 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.129 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.129 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.129 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.129 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.129 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.129 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.130 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.130 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.130 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.130 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.130 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.130 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.130 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.130 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.130 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.130 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.130 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.130 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.130 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.130 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.131 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.131 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.131 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.131 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.131 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.131 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.131 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.131 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.131 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.131 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.131 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.131 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.131 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.131 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.131 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.132 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.132 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.132 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.132 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.132 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.132 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.132 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.132 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.132 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.132 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.132 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.132 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.132 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.132 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.133 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.133 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.133 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.133 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.133 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.133 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.133 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.133 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.133 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.133 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "localpool", 2024-09-21T04:05:30.133 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.133 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.133 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.133 INFO:teuthology.orchestra.run.smithi046.stdout: "failure_domain": { 2024-09-21T04:05:30.134 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "failure_domain", 2024-09-21T04:05:30.134 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.134 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.134 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.134 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "host", 2024-09-21T04:05:30.134 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.134 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.134 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.134 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "failure domain for any created local pool", 2024-09-21T04:05:30.134 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T04:05:30.134 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.134 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.134 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.134 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.135 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.135 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.135 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.135 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.135 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.135 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.135 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.135 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.135 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.135 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.135 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.135 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.135 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.135 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.136 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.136 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.136 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.136 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.136 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.136 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.136 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.136 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.136 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.136 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.136 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.136 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.136 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.136 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.137 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.137 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.137 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.137 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.137 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.137 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.137 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.137 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.137 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.137 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.137 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.137 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.137 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.137 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.138 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.138 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.138 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.138 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.138 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.138 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.138 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.138 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.138 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.138 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.138 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.138 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.138 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.138 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.139 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.139 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.139 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.139 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.139 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.139 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.139 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.139 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.139 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.139 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.139 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.139 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.139 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.139 INFO:teuthology.orchestra.run.smithi046.stdout: "min_size": { 2024-09-21T04:05:30.139 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "min_size", 2024-09-21T04:05:30.140 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.140 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.140 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.140 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.140 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.140 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.140 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.140 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "default min_size for any created local pool", 2024-09-21T04:05:30.140 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T04:05:30.140 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.140 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.140 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.140 INFO:teuthology.orchestra.run.smithi046.stdout: "num_rep": { 2024-09-21T04:05:30.140 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "num_rep", 2024-09-21T04:05:30.141 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.141 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.141 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.141 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "3", 2024-09-21T04:05:30.141 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.141 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.141 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.141 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "default replica count for any created local pool", 2024-09-21T04:05:30.141 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.141 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.141 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.141 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.141 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num": { 2024-09-21T04:05:30.141 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pg_num", 2024-09-21T04:05:30.141 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.142 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.142 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.142 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "128", 2024-09-21T04:05:30.142 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.142 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.142 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.142 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T04:05:30.142 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.142 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.142 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.142 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.142 INFO:teuthology.orchestra.run.smithi046.stdout: "prefix": { 2024-09-21T04:05:30.142 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "prefix", 2024-09-21T04:05:30.142 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.143 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.143 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.143 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.143 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.143 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.143 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.143 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "name prefix for any created local pool", 2024-09-21T04:05:30.143 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.143 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.143 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.143 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.143 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.143 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.143 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.144 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.144 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.144 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.144 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.144 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.144 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.144 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.144 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.144 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.144 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.144 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.144 INFO:teuthology.orchestra.run.smithi046.stdout: "subtree": { 2024-09-21T04:05:30.144 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "subtree", 2024-09-21T04:05:30.144 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.144 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.145 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.145 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "rack", 2024-09-21T04:05:30.145 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.145 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.145 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.145 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T04:05:30.145 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T04:05:30.145 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.145 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.145 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.145 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.145 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.145 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.145 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mds_autoscaler", 2024-09-21T04:05:30.146 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.146 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.146 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.146 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.146 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.146 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.146 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.146 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.146 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.146 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.146 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.146 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.146 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.146 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.146 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.147 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.147 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.147 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.147 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.147 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.147 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.147 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.147 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.147 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.147 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.147 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.147 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.147 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.148 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.148 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.148 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.148 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.148 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.148 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.148 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.148 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.148 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.148 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.148 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.148 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.148 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.148 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.148 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.149 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.149 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.149 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.149 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.149 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.149 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.149 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.149 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.149 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.149 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.149 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.149 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.149 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.150 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.150 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.150 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.150 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.150 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.150 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.150 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.150 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.150 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.150 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.150 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.150 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.150 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.150 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.151 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.151 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.151 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.151 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.151 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.151 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.151 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.151 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.151 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.151 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.151 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.151 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.151 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.151 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.152 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.152 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.152 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.152 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.152 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.152 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.152 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mirroring", 2024-09-21T04:05:30.152 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.152 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.152 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.152 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.152 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.152 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.152 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.152 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.153 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.153 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.153 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.153 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.153 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.153 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.153 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.153 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.153 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.153 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.153 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.153 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.153 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.153 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.154 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.154 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.154 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.154 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.154 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.154 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.154 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.154 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.154 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.154 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.154 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.154 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.154 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.154 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.155 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.155 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.155 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.155 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.155 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.155 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.155 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.155 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.155 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.155 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.155 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.155 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.155 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.155 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.156 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.156 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.156 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.156 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.156 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.156 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.156 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.156 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.156 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.156 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.156 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.156 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.156 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.156 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.156 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.157 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.157 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.157 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.157 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.157 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.157 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.157 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.157 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.157 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.157 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.157 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.157 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.157 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.157 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.158 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.158 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.158 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.158 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.158 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.158 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.158 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.158 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.158 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.158 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.158 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.158 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "nfs", 2024-09-21T04:05:30.158 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.158 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.159 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.159 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.159 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.159 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.159 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.159 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.159 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.159 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.159 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.159 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.159 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.159 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.159 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.159 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.159 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.160 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.160 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.160 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.160 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.160 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.160 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.160 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.160 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.160 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.160 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.160 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.160 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.160 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.160 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.161 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.161 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.161 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.161 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.161 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.161 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.161 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.161 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.161 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.161 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.161 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.161 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.161 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.161 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.162 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.162 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.162 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.162 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.162 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.162 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.162 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.162 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.162 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.162 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.162 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.162 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.162 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.162 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.162 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.163 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.163 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.163 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.163 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.163 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.163 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.163 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.163 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.163 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.163 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.163 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.163 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.163 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.163 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.164 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.164 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.164 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.164 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.164 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.164 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.164 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.164 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.164 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.164 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.164 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.164 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.164 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.164 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.165 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.165 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.165 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "orchestrator", 2024-09-21T04:05:30.165 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.165 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.165 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.165 INFO:teuthology.orchestra.run.smithi046.stdout: "fail_fs": { 2024-09-21T04:05:30.165 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "fail_fs", 2024-09-21T04:05:30.165 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.165 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.165 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.165 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.165 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.165 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.166 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.166 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T04:05:30.166 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.166 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.166 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.166 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.166 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.166 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.166 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.166 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.166 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.166 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.166 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.166 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.167 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.167 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.167 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.167 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.167 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.167 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.167 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.167 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.167 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.167 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.167 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.167 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.167 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.167 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.168 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.168 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.168 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.168 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.168 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.168 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.168 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.168 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.168 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.168 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.168 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.168 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.168 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.168 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.168 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.169 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.169 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.169 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.169 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.169 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.169 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.169 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.169 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.169 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.169 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.169 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.169 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.169 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.169 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.170 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.170 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.170 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.170 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.170 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.170 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.170 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.170 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.170 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.170 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.170 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.170 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.170 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.170 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.171 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.171 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.171 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.171 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.171 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.171 INFO:teuthology.orchestra.run.smithi046.stdout: "orchestrator": { 2024-09-21T04:05:30.171 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "orchestrator", 2024-09-21T04:05:30.171 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.171 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.171 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.171 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.171 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.171 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.171 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.171 INFO:teuthology.orchestra.run.smithi046.stdout: "cephadm", 2024-09-21T04:05:30.172 INFO:teuthology.orchestra.run.smithi046.stdout: "rook", 2024-09-21T04:05:30.172 INFO:teuthology.orchestra.run.smithi046.stdout: "test_orchestrator" 2024-09-21T04:05:30.172 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.172 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Orchestrator backend", 2024-09-21T04:05:30.172 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.172 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.172 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.172 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.172 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.172 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.172 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.172 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.172 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.172 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.173 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.173 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.173 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.173 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.173 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.173 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.173 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.173 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.173 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.173 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.173 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.173 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "osd_perf_query", 2024-09-21T04:05:30.173 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.173 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.173 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.174 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.174 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.174 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.174 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.174 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.174 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.174 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.174 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.174 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.174 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.174 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.174 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.174 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.174 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.175 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.175 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.175 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.175 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.175 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.175 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.175 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.175 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.175 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.175 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.175 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.175 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.175 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.175 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.176 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.176 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.176 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.176 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.176 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.176 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.176 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.176 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.176 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.176 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.176 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.176 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.176 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.176 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.177 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.177 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.177 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.177 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.177 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.177 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.177 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.177 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.177 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.177 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.177 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.177 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.177 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.177 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.178 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.178 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.178 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.178 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.178 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.178 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.178 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.178 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.178 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.178 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.178 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.178 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.178 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.178 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.179 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.179 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.179 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.179 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.179 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.179 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.179 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.179 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.179 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.179 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.179 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.179 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.179 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.179 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.180 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.180 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.180 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.180 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "osd_support", 2024-09-21T04:05:30.180 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.180 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.180 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.180 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.180 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.180 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.180 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.180 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.180 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.180 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.181 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.181 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.181 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.181 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.181 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.181 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.181 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.181 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.181 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.181 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.181 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.181 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.181 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.181 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.182 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.182 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.182 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.182 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.182 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.182 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.182 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.182 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.182 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.182 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.182 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.182 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.182 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.182 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.183 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.183 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.183 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.183 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.183 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.183 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.183 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.183 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.183 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.183 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.183 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.183 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.183 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.183 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.183 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.184 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.184 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.184 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.184 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.184 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.184 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.184 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.184 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.184 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.184 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.184 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.184 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.184 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.184 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.185 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.185 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.185 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.185 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.185 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.185 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.185 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.185 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.185 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.185 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.185 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.185 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.185 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.185 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.186 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.186 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.186 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.186 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.186 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.186 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.186 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.186 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.186 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.186 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pg_autoscaler", 2024-09-21T04:05:30.186 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.186 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.186 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.186 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.187 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.187 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.187 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.187 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.187 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.187 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.187 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.187 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.187 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.187 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.187 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.187 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.187 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.187 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.188 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.188 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.188 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.188 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.188 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.188 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.188 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.188 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.188 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.188 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.188 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.188 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.188 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.189 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.189 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.189 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.189 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.189 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.189 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.189 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.189 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.189 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.189 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.189 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.189 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.189 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.190 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.190 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.190 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.190 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.190 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.190 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.190 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.190 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.190 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.190 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.190 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.190 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.190 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.190 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.190 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.191 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.191 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.191 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.191 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.191 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.191 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.191 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.191 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.191 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.191 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.191 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.191 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.191 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.191 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.192 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2024-09-21T04:05:30.192 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2024-09-21T04:05:30.192 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:30.192 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.192 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.192 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2024-09-21T04:05:30.192 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.192 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.192 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.192 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.192 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.192 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.192 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.192 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.193 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.193 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.193 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.193 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.193 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.193 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.193 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.193 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.193 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.193 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.193 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.193 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.193 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.193 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.194 INFO:teuthology.orchestra.run.smithi046.stdout: "threshold": { 2024-09-21T04:05:30.194 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "threshold", 2024-09-21T04:05:30.194 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-21T04:05:30.194 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.194 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.194 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "3.0", 2024-09-21T04:05:30.194 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1.0", 2024-09-21T04:05:30.194 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.194 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.194 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "scaling threshold", 2024-09-21T04:05:30.194 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T04:05:30.194 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.194 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.194 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.195 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.195 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.195 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.195 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "progress", 2024-09-21T04:05:30.195 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.195 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.195 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.195 INFO:teuthology.orchestra.run.smithi046.stdout: "allow_pg_recovery_event": { 2024-09-21T04:05:30.195 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "allow_pg_recovery_event", 2024-09-21T04:05:30.195 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.195 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.195 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.195 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.195 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.196 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.196 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.196 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T04:05:30.196 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.196 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.196 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.196 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.196 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": { 2024-09-21T04:05:30.196 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enabled", 2024-09-21T04:05:30.196 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.196 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.196 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.196 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.196 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.197 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.197 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.197 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.197 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.197 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.197 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.197 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.197 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.197 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.197 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.197 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.197 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.197 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.197 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.197 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.198 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.198 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.198 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.198 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.198 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.198 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.198 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.198 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.198 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.198 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.198 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.198 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.198 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.198 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.199 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.199 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.199 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.199 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.199 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.199 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.199 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.199 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.199 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.199 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.199 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.199 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.199 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.199 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.200 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.200 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.200 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.200 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.200 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.200 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.200 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.200 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.200 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.200 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.200 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.200 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.200 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.200 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.201 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.201 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.201 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.201 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.201 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.201 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.201 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.201 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.201 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.201 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.201 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.201 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.201 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.201 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.202 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.202 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.202 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.202 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.202 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.202 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.202 INFO:teuthology.orchestra.run.smithi046.stdout: "max_completed_events": { 2024-09-21T04:05:30.202 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_completed_events", 2024-09-21T04:05:30.202 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.202 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.202 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.202 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "50", 2024-09-21T04:05:30.202 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.202 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.203 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.203 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "number of past completed events to remember", 2024-09-21T04:05:30.203 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.203 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.203 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.203 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.203 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2024-09-21T04:05:30.203 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2024-09-21T04:05:30.203 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:30.203 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.203 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.203 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2024-09-21T04:05:30.203 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.203 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.204 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.204 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how long the module is going to sleep", 2024-09-21T04:05:30.204 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.204 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.204 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.204 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.204 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.204 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.204 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.204 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.204 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.204 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.204 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.204 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.204 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.205 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.205 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.205 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.205 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.205 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.205 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.205 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.205 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.205 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "prometheus", 2024-09-21T04:05:30.205 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.205 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.205 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.205 INFO:teuthology.orchestra.run.smithi046.stdout: "cache": { 2024-09-21T04:05:30.205 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cache", 2024-09-21T04:05:30.206 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.206 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.206 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.206 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.206 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.206 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.206 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.206 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.206 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.206 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.206 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.206 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.206 INFO:teuthology.orchestra.run.smithi046.stdout: "exclude_perf_counters": { 2024-09-21T04:05:30.206 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "exclude_perf_counters", 2024-09-21T04:05:30.207 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.207 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.207 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.207 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.207 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.207 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.207 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.207 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T04:05:30.207 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T04:05:30.207 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.207 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.207 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.207 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.207 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.208 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.208 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.208 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.208 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.208 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.208 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.208 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.208 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.208 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.208 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.208 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.208 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.208 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.208 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.208 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.209 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.209 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.209 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.209 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.209 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.209 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.209 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.209 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.209 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.209 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.209 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.209 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.209 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.209 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.210 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.210 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.210 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.210 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.210 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.210 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.210 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.210 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.210 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.210 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.210 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.210 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.210 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.210 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.211 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.211 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.211 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.211 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.211 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.211 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.211 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.211 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.211 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.211 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.211 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.211 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.211 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.211 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.212 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.212 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.212 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.212 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.212 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.212 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.212 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.212 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.212 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.212 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.212 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.212 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_stats_pools": { 2024-09-21T04:05:30.212 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rbd_stats_pools", 2024-09-21T04:05:30.212 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.213 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.213 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.213 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.213 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.213 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.213 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.213 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.213 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.213 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.213 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.213 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.213 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T04:05:30.213 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T04:05:30.213 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.213 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.214 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.214 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "300", 2024-09-21T04:05:30.214 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.214 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.214 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.214 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.214 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.214 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.214 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.214 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.214 INFO:teuthology.orchestra.run.smithi046.stdout: "scrape_interval": { 2024-09-21T04:05:30.214 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "scrape_interval", 2024-09-21T04:05:30.214 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-21T04:05:30.215 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.215 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.215 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "15.0", 2024-09-21T04:05:30.215 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.215 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.215 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.215 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.215 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.215 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.215 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.215 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.215 INFO:teuthology.orchestra.run.smithi046.stdout: "server_addr": { 2024-09-21T04:05:30.215 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_addr", 2024-09-21T04:05:30.215 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.216 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.216 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.216 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "::", 2024-09-21T04:05:30.216 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.216 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.216 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.216 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T04:05:30.216 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.216 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.216 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.216 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.216 INFO:teuthology.orchestra.run.smithi046.stdout: "server_port": { 2024-09-21T04:05:30.216 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_port", 2024-09-21T04:05:30.216 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.217 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.217 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.217 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "9283", 2024-09-21T04:05:30.217 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.217 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.217 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.217 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T04:05:30.217 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.217 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.217 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.217 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.218 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.218 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.218 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.218 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.218 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.218 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.218 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.218 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.218 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.218 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.218 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.218 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.219 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.219 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.219 INFO:teuthology.orchestra.run.smithi046.stdout: "stale_cache_strategy": { 2024-09-21T04:05:30.219 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "stale_cache_strategy", 2024-09-21T04:05:30.219 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.219 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.219 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.219 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "log", 2024-09-21T04:05:30.219 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.219 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.220 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.220 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.220 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.220 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.220 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.220 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.220 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_behaviour": { 2024-09-21T04:05:30.220 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_behaviour", 2024-09-21T04:05:30.220 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.221 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.221 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.221 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "default", 2024-09-21T04:05:30.221 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.221 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.221 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.221 INFO:teuthology.orchestra.run.smithi046.stdout: "default", 2024-09-21T04:05:30.221 INFO:teuthology.orchestra.run.smithi046.stdout: "error" 2024-09-21T04:05:30.221 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.221 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.222 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.222 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.222 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.222 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.222 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_error_status_code": { 2024-09-21T04:05:30.222 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_error_status_code", 2024-09-21T04:05:30.222 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.222 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.222 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.222 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "500", 2024-09-21T04:05:30.223 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "400", 2024-09-21T04:05:30.223 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "599", 2024-09-21T04:05:30.223 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.223 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.223 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.223 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.223 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.223 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.223 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.223 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.223 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.223 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rbd_support", 2024-09-21T04:05:30.223 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.223 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.224 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.224 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.224 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.224 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.224 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.224 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.224 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.224 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.224 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.224 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.224 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.224 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.224 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.224 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.224 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.225 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.225 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.225 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.225 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.225 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.225 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.225 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.225 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.225 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.225 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.225 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.225 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.225 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.225 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.226 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.226 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.226 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.226 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.226 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.226 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.226 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.226 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.226 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.226 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.226 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.226 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.226 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.226 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.227 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.227 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.227 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.227 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.227 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.227 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.227 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.227 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.227 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.227 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.227 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.227 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.227 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.227 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.228 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.228 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.228 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.228 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.228 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.228 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.228 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.228 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.228 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.228 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.228 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.228 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.228 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.228 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.229 INFO:teuthology.orchestra.run.smithi046.stdout: "max_concurrent_snap_create": { 2024-09-21T04:05:30.229 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_concurrent_snap_create", 2024-09-21T04:05:30.229 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.229 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.229 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.229 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-21T04:05:30.229 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.229 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.229 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.229 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.229 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.229 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.229 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.229 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.229 INFO:teuthology.orchestra.run.smithi046.stdout: "mirror_snapshot_schedule": { 2024-09-21T04:05:30.230 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T04:05:30.230 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.230 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.230 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.230 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.230 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.230 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.230 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.230 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.230 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.230 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.230 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.230 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.230 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.231 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.231 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.231 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.231 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.231 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.231 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.231 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.231 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.231 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.231 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.231 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.231 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.231 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.231 INFO:teuthology.orchestra.run.smithi046.stdout: "trash_purge_schedule": { 2024-09-21T04:05:30.232 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "trash_purge_schedule", 2024-09-21T04:05:30.232 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.232 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.232 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.232 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.232 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.232 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.232 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.232 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.232 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.232 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.232 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.232 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.232 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.233 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.233 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.233 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "restful", 2024-09-21T04:05:30.233 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.233 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.233 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.233 INFO:teuthology.orchestra.run.smithi046.stdout: "enable_auth": { 2024-09-21T04:05:30.233 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enable_auth", 2024-09-21T04:05:30.233 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.233 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.233 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.233 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.233 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.233 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.234 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.234 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.234 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.234 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.234 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.234 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.234 INFO:teuthology.orchestra.run.smithi046.stdout: "key_file": { 2024-09-21T04:05:30.234 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "key_file", 2024-09-21T04:05:30.234 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.234 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.234 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.234 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.234 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.234 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.235 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.235 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.235 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.235 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.235 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.235 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.235 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.235 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.235 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.235 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.235 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.235 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.235 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.235 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.235 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.236 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.236 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.236 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.236 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.236 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.236 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.236 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.236 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.236 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.236 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.236 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.236 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.236 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.236 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.237 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.237 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.237 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.237 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.237 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.237 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.237 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.237 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.237 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.237 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.237 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.237 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.237 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.237 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.237 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.238 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.238 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.238 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.238 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.238 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.238 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.238 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.238 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.238 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.238 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.238 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.238 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.238 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.238 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.239 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.239 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.239 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.239 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.239 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.239 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.239 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.239 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.239 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.239 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.239 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.239 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.239 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.239 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.240 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.240 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.240 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.240 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.240 INFO:teuthology.orchestra.run.smithi046.stdout: "max_requests": { 2024-09-21T04:05:30.240 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_requests", 2024-09-21T04:05:30.240 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.240 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.240 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.240 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "500", 2024-09-21T04:05:30.240 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.240 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.240 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.240 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T04:05:30.240 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.241 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.241 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.241 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.241 INFO:teuthology.orchestra.run.smithi046.stdout: "server_addr": { 2024-09-21T04:05:30.241 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_addr", 2024-09-21T04:05:30.241 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.241 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.241 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.241 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.241 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.241 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.241 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.241 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.241 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.242 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.242 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.242 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.242 INFO:teuthology.orchestra.run.smithi046.stdout: "server_port": { 2024-09-21T04:05:30.242 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_port", 2024-09-21T04:05:30.242 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.242 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.242 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.242 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.242 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.242 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.242 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.242 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.243 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.243 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.243 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.243 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.243 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.243 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.243 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.243 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.243 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.243 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.243 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.243 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.244 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.244 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.244 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.244 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.244 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.244 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.244 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.244 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.244 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.244 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rgw", 2024-09-21T04:05:30.244 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.244 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.244 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.245 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.245 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.245 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.245 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.245 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.245 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.245 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.245 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.245 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.245 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.245 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.246 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.246 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.246 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.246 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.246 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.246 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.246 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.246 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.246 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.246 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.246 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.246 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.246 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.246 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.247 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.247 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.247 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.247 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.247 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.247 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.247 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.247 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.247 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.247 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.248 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.248 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.248 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.248 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.248 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.248 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.248 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.248 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.248 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.248 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.248 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.248 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.248 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.249 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.249 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.249 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.249 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.249 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.249 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.249 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.249 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.249 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.249 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.250 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.250 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.250 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.250 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.250 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.250 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.250 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.250 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.250 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.250 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.250 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.250 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.251 INFO:teuthology.orchestra.run.smithi046.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T04:05:30.251 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T04:05:30.251 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.251 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.251 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.251 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2024-09-21T04:05:30.251 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.251 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.251 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.251 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T04:05:30.251 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.251 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.252 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.252 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.252 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.252 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.252 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.252 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.252 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.252 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.252 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.252 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.252 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.252 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.252 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.252 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.253 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.253 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.253 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.253 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.253 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.253 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rook", 2024-09-21T04:05:30.253 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.253 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.253 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.253 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.253 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.253 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.253 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.253 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.253 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.254 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.254 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.254 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.254 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.254 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.254 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.254 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.254 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.254 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.254 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.254 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.254 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.254 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.254 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.255 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.255 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.255 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.255 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.255 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.255 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.255 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.255 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.255 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.255 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.255 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.255 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.255 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.255 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.255 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.256 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.256 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.256 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.256 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.256 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.256 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.256 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.256 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.256 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.256 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.258 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.258 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.258 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.258 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.259 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.259 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.259 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.259 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.259 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.259 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.259 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.259 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.259 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.259 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.259 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.259 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.259 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.260 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.260 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.260 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.260 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.260 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.260 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.260 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.260 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.260 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.260 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.260 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.260 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.260 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.260 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.261 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.261 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.261 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.261 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.261 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.261 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.261 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.261 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.261 INFO:teuthology.orchestra.run.smithi046.stdout: "storage_class": { 2024-09-21T04:05:30.261 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "storage_class", 2024-09-21T04:05:30.261 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.261 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.261 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.261 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "local", 2024-09-21T04:05:30.262 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.262 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.262 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.262 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T04:05:30.262 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.262 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.262 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.262 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.262 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.262 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.262 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.262 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "selftest", 2024-09-21T04:05:30.262 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.263 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.263 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.263 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.263 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.263 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.263 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.263 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.263 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.263 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.263 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.263 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.263 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.263 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.263 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.264 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.264 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.264 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.264 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.264 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.264 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.264 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.264 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.264 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.264 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.264 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.264 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.264 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.264 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.264 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.265 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.265 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.265 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.265 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.265 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.265 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.265 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.265 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.265 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.265 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.265 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.265 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.265 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.265 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.266 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.266 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.266 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.266 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.266 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.266 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.266 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.266 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.266 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.266 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.267 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.267 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.267 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.267 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.267 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.267 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.267 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.267 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.267 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.267 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.267 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.267 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.267 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.268 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.268 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.268 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.268 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.268 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.268 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.268 INFO:teuthology.orchestra.run.smithi046.stdout: "roption1": { 2024-09-21T04:05:30.268 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "roption1", 2024-09-21T04:05:30.268 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.268 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.268 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.268 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.268 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.269 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.269 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.269 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.269 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.269 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.269 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.269 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.269 INFO:teuthology.orchestra.run.smithi046.stdout: "roption2": { 2024-09-21T04:05:30.269 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "roption2", 2024-09-21T04:05:30.269 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.269 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.269 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.269 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "xyz", 2024-09-21T04:05:30.269 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.270 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.270 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.270 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.270 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.270 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.270 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.270 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.270 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption1": { 2024-09-21T04:05:30.270 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption1", 2024-09-21T04:05:30.270 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.270 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.270 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.270 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.271 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.271 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.271 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.271 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.271 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.271 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.271 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.271 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.271 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption2": { 2024-09-21T04:05:30.271 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption2", 2024-09-21T04:05:30.271 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.272 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.272 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.272 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.272 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.272 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.272 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.272 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.272 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.272 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.272 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.272 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.272 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption3": { 2024-09-21T04:05:30.273 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption3", 2024-09-21T04:05:30.273 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-21T04:05:30.273 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.273 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.273 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.273 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.273 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.273 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.273 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.273 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.273 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.273 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.273 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.273 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption4": { 2024-09-21T04:05:30.274 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption4", 2024-09-21T04:05:30.274 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.274 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.274 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.274 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.274 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.274 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.274 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.274 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.274 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.274 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.274 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.275 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.275 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption5": { 2024-09-21T04:05:30.275 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption5", 2024-09-21T04:05:30.275 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.275 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.275 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.275 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.275 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.275 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.275 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.275 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.275 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.275 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.275 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.276 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.276 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption6": { 2024-09-21T04:05:30.276 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption6", 2024-09-21T04:05:30.276 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.276 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.276 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.276 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.276 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.276 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.276 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.276 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.276 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.276 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.277 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.277 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.277 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption7": { 2024-09-21T04:05:30.277 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption7", 2024-09-21T04:05:30.277 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.277 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.277 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.277 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.277 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2024-09-21T04:05:30.278 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "42", 2024-09-21T04:05:30.278 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.278 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.278 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.278 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.278 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.279 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.279 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.279 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.279 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.279 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.279 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.279 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.279 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.279 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.279 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.279 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.279 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.280 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.280 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.280 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.280 INFO:teuthology.orchestra.run.smithi046.stdout: "testkey": { 2024-09-21T04:05:30.280 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "testkey", 2024-09-21T04:05:30.280 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.280 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.280 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.280 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.280 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.280 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.280 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.280 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.280 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.281 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.281 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.281 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.281 INFO:teuthology.orchestra.run.smithi046.stdout: "testlkey": { 2024-09-21T04:05:30.281 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "testlkey", 2024-09-21T04:05:30.281 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.281 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.281 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.281 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.281 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.282 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.282 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.282 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.282 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.282 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.282 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.282 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.282 INFO:teuthology.orchestra.run.smithi046.stdout: "testnewline": { 2024-09-21T04:05:30.282 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "testnewline", 2024-09-21T04:05:30.282 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.282 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.282 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.282 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.283 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.283 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.283 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.283 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.283 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.283 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.283 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.283 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.283 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.283 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.284 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.284 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smb", 2024-09-21T04:05:30.284 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.284 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.284 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.284 INFO:teuthology.orchestra.run.smithi046.stdout: "internal_store_backend": { 2024-09-21T04:05:30.284 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "internal_store_backend", 2024-09-21T04:05:30.284 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.284 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.284 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.285 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.285 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.285 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.285 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.285 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T04:05:30.285 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.286 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.286 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.286 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.286 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.286 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.286 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.286 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.287 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.287 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.287 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.287 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.287 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.287 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.287 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.288 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.288 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.288 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.288 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.288 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.288 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.288 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.288 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.289 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.289 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.289 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.289 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.289 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.289 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.289 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.289 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.290 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.290 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.290 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.290 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.290 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.290 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.291 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.291 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.291 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.291 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.291 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.291 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.291 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.292 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.292 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.292 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.292 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.292 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.292 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.292 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.292 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.293 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.293 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.293 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.293 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.293 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.293 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.293 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.293 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.293 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.294 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.294 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.294 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.294 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.294 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.294 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.294 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.294 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.295 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.295 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.295 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.295 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.295 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.295 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.295 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.295 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.296 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.296 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.296 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.296 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.296 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.296 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.296 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.296 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.296 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.297 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.297 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.297 INFO:teuthology.orchestra.run.smithi046.stdout: "update_orchestration": { 2024-09-21T04:05:30.297 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "update_orchestration", 2024-09-21T04:05:30.297 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.297 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.297 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.297 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.298 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.298 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.298 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.298 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T04:05:30.298 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.298 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.298 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.299 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.299 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.299 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.299 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.299 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "snap_schedule", 2024-09-21T04:05:30.299 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.299 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.299 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.299 INFO:teuthology.orchestra.run.smithi046.stdout: "allow_m_granularity": { 2024-09-21T04:05:30.300 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "allow_m_granularity", 2024-09-21T04:05:30.300 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.300 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.300 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.300 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.300 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.300 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.300 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.300 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T04:05:30.301 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.301 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.301 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.301 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.301 INFO:teuthology.orchestra.run.smithi046.stdout: "dump_on_update": { 2024-09-21T04:05:30.301 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "dump_on_update", 2024-09-21T04:05:30.301 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.301 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.302 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.302 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.302 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.302 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.302 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.302 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "dump database to debug log on update", 2024-09-21T04:05:30.302 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.302 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.303 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.303 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.303 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.303 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.303 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.303 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.303 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.303 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.304 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.304 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.304 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.304 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.304 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.304 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.304 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.304 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.305 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.305 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.305 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.305 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.305 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.305 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.305 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.305 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.305 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.306 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.306 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.306 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.306 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.306 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.306 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.306 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.306 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.307 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.307 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.307 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.307 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.307 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.307 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.307 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.307 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.307 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.307 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.307 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.307 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.307 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.307 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.308 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.308 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.308 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.308 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.308 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.308 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.308 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.308 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.308 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.308 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.308 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.308 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.308 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.309 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.309 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.309 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.309 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.309 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.309 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.309 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.309 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.309 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.309 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.309 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.309 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.310 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.310 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.310 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.310 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.310 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.310 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.310 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.310 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.310 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.310 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.310 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.310 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.310 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.311 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.311 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.311 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.311 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.311 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "stats", 2024-09-21T04:05:30.311 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.311 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.311 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.311 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.311 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.311 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.311 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.311 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.312 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.312 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.312 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.312 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.312 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.312 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.312 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.312 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.312 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.312 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.312 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.312 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.312 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.312 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.312 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.313 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.313 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.313 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.313 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.313 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.313 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.313 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.314 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.314 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.314 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.314 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.314 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.314 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.314 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.314 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.314 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.314 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.314 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.315 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.315 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.315 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.315 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.315 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.315 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.315 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.315 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.315 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.315 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.316 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.316 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.316 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.316 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.316 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.316 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.316 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.316 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.316 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.316 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.316 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.317 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.317 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.317 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.317 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.317 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.317 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.317 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.317 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.317 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.317 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.317 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.317 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.317 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.318 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.318 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.318 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.318 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.318 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.318 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.318 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.318 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.318 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.318 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.318 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.318 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.318 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.319 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.319 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.319 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "status", 2024-09-21T04:05:30.319 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.319 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.319 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.319 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.319 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.319 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.319 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.319 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.320 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.320 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.320 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.320 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.320 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.320 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.320 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.320 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.320 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.320 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.321 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.321 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.321 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.321 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.321 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.321 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.321 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.321 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.321 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.321 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.321 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.321 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.321 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.322 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.322 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.322 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.322 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.322 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.322 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.322 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.322 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.322 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.322 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.322 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.322 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.322 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.323 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.323 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.323 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.323 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.323 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.323 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.323 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.323 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.323 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.323 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.323 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.323 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.323 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.324 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.324 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.324 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.324 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.324 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.324 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.324 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.324 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.324 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.324 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.324 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.324 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.324 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.324 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.325 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.325 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.325 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.325 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.325 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.325 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.325 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.325 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.325 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.325 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.326 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.326 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.326 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.326 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.326 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.326 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.326 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.326 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.326 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.326 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "telegraf", 2024-09-21T04:05:30.326 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.326 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.326 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.327 INFO:teuthology.orchestra.run.smithi046.stdout: "address": { 2024-09-21T04:05:30.327 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "address", 2024-09-21T04:05:30.327 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.327 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.327 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.327 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T04:05:30.327 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.327 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.327 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.327 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.327 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.327 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.327 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.328 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.328 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2024-09-21T04:05:30.328 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2024-09-21T04:05:30.328 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:30.328 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.328 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.328 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "15", 2024-09-21T04:05:30.328 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.328 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.328 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.328 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.329 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.329 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.329 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.329 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.329 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.329 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.329 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.329 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.329 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.329 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.329 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.329 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.329 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.330 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.330 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.330 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.330 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.330 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.330 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.330 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.330 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.330 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.330 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.330 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.330 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.330 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.331 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.331 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.331 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.331 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.331 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.331 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.331 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.331 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.331 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.331 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.331 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.332 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.332 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.332 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.332 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.332 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.332 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.332 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.332 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.332 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.332 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.332 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.332 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.332 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.332 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.333 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.333 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.333 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.333 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.333 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.333 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.333 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.333 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.333 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.333 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.333 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.333 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.333 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.334 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.334 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.334 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.334 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.334 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.334 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.334 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.334 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.334 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.334 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.334 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.334 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.334 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.335 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.335 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.335 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.335 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.335 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.335 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.335 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.335 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.335 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.335 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.335 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.335 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.335 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.335 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.336 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "telemetry", 2024-09-21T04:05:30.336 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.336 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.336 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.336 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_basic": { 2024-09-21T04:05:30.336 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_basic", 2024-09-21T04:05:30.336 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.336 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.336 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.336 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.336 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.336 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.336 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.336 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T04:05:30.336 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.336 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.337 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.337 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.337 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_crash": { 2024-09-21T04:05:30.337 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_crash", 2024-09-21T04:05:30.337 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.337 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.337 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.337 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.337 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.337 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.337 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.337 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T04:05:30.337 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.337 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.338 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.338 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.338 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_device": { 2024-09-21T04:05:30.338 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_device", 2024-09-21T04:05:30.338 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.338 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.338 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.338 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.338 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.338 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.338 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.338 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T04:05:30.338 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.338 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.339 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.339 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.339 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_ident": { 2024-09-21T04:05:30.339 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_ident", 2024-09-21T04:05:30.339 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.339 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.339 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.339 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.339 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.339 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.339 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.339 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T04:05:30.339 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.339 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.340 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.340 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.340 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_perf": { 2024-09-21T04:05:30.340 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_perf", 2024-09-21T04:05:30.340 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.340 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.340 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.340 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.340 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.340 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.340 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.340 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T04:05:30.340 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.340 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.340 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.341 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.341 INFO:teuthology.orchestra.run.smithi046.stdout: "contact": { 2024-09-21T04:05:30.341 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "contact", 2024-09-21T04:05:30.341 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.341 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.341 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.341 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.341 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.341 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.341 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.341 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.341 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.341 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.342 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.342 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.342 INFO:teuthology.orchestra.run.smithi046.stdout: "description": { 2024-09-21T04:05:30.342 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "description", 2024-09-21T04:05:30.342 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.342 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.342 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.342 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.342 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.342 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.342 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.342 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.342 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.342 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.343 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.343 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.343 INFO:teuthology.orchestra.run.smithi046.stdout: "device_url": { 2024-09-21T04:05:30.343 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "device_url", 2024-09-21T04:05:30.343 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.343 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.343 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.343 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T04:05:30.343 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.343 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.343 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.343 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.343 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.343 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.343 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.344 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.344 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": { 2024-09-21T04:05:30.344 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enabled", 2024-09-21T04:05:30.344 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.344 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.344 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.344 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.344 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.344 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.344 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.344 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.344 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.344 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.344 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.345 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.345 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2024-09-21T04:05:30.345 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2024-09-21T04:05:30.345 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.345 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.345 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.345 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "24", 2024-09-21T04:05:30.345 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "8", 2024-09-21T04:05:30.345 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.345 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.345 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.345 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.345 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.345 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.346 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.346 INFO:teuthology.orchestra.run.smithi046.stdout: "last_opt_revision": { 2024-09-21T04:05:30.346 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "last_opt_revision", 2024-09-21T04:05:30.346 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.346 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.346 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.346 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "1", 2024-09-21T04:05:30.346 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.346 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.346 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.346 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.346 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.346 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.347 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.347 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.347 INFO:teuthology.orchestra.run.smithi046.stdout: "leaderboard": { 2024-09-21T04:05:30.347 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "leaderboard", 2024-09-21T04:05:30.347 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.347 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.347 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.347 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.347 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.347 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.347 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.347 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.348 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.348 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.348 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.348 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.348 INFO:teuthology.orchestra.run.smithi046.stdout: "leaderboard_description": { 2024-09-21T04:05:30.348 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "leaderboard_description", 2024-09-21T04:05:30.348 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.348 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.348 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.348 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.348 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.349 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.349 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.349 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.349 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.349 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.349 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.349 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.349 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.349 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.349 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.349 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.349 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.349 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.349 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.350 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.350 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.350 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.350 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.350 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.350 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.350 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.350 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.350 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.350 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.350 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.350 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.351 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.351 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.351 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.351 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.351 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.351 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.351 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.351 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.351 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.351 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.351 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.351 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.351 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.351 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.352 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.352 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.352 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.352 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.352 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.352 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.352 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.352 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.352 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.352 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.352 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.352 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.352 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.352 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.353 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.353 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.353 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.353 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.353 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.353 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.353 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.353 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.353 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.353 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.353 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.353 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.353 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.354 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.354 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.354 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.354 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.354 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.354 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.354 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.354 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.354 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.354 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.354 INFO:teuthology.orchestra.run.smithi046.stdout: "organization": { 2024-09-21T04:05:30.354 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "organization", 2024-09-21T04:05:30.354 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.355 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.355 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.355 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.355 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.355 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.355 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.355 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.355 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.355 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.355 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.355 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.355 INFO:teuthology.orchestra.run.smithi046.stdout: "proxy": { 2024-09-21T04:05:30.356 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "proxy", 2024-09-21T04:05:30.356 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.356 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.356 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.356 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.356 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.356 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.356 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.356 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.356 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.356 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.356 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.356 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.356 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.357 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.357 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.357 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.357 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.357 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.357 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.357 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.357 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.357 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.357 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.357 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.357 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.357 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.357 INFO:teuthology.orchestra.run.smithi046.stdout: "url": { 2024-09-21T04:05:30.357 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "url", 2024-09-21T04:05:30.358 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.358 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.358 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.358 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T04:05:30.358 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.358 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.358 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.358 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.358 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.358 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.358 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.359 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.359 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.359 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.359 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.359 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "test_orchestrator", 2024-09-21T04:05:30.359 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.359 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.359 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.359 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.359 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.359 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.359 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.360 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.360 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.360 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.360 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.360 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.360 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.360 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.360 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.360 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.360 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.360 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.360 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.360 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.360 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.360 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.361 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.361 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.361 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.361 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.361 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.361 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.361 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.361 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.361 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.361 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.361 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.361 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.361 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.361 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.362 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.362 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.362 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.362 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.362 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.362 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.362 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.362 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.362 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.362 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.362 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.362 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.363 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.363 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.363 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.363 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.363 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.363 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.363 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.363 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.363 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.363 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.363 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.363 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.363 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.363 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.364 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.364 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.364 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.364 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.364 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.364 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.364 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.364 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.364 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.364 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.364 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.364 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.364 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.364 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.364 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.365 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.365 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.365 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.365 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.365 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.365 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.365 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.365 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.365 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.365 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.365 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.365 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.365 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.365 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "volumes", 2024-09-21T04:05:30.366 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.366 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.366 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.366 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.366 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.366 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.366 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.366 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.366 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.366 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.366 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.366 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.367 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.367 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.367 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.367 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.367 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.367 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.367 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.367 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.367 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.367 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.367 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.367 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.367 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.368 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.368 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.368 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.368 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.368 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.368 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.368 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.368 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.368 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.368 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.368 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.368 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.369 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.369 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.369 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.369 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.369 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.369 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.369 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.369 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.369 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.369 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.369 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.369 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.369 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.369 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.370 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.370 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.370 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.370 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.370 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.370 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.370 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.370 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.370 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.370 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.370 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.370 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.370 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.370 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.371 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.371 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.371 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.371 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.371 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.371 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.371 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.371 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.371 INFO:teuthology.orchestra.run.smithi046.stdout: "max_concurrent_clones": { 2024-09-21T04:05:30.371 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_concurrent_clones", 2024-09-21T04:05:30.371 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.371 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.371 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.371 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "4", 2024-09-21T04:05:30.372 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.372 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.372 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.372 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T04:05:30.372 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.372 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.372 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.372 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.372 INFO:teuthology.orchestra.run.smithi046.stdout: "periodic_async_work": { 2024-09-21T04:05:30.372 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "periodic_async_work", 2024-09-21T04:05:30.372 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.373 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.373 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.373 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.373 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.373 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.373 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.373 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Periodically check for async work", 2024-09-21T04:05:30.373 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.373 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.373 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.373 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.373 INFO:teuthology.orchestra.run.smithi046.stdout: "snapshot_clone_delay": { 2024-09-21T04:05:30.374 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "snapshot_clone_delay", 2024-09-21T04:05:30.374 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.374 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.374 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.374 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.374 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.374 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.374 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.374 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T04:05:30.374 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.374 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.374 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.374 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.374 INFO:teuthology.orchestra.run.smithi046.stdout: "snapshot_clone_no_wait": { 2024-09-21T04:05:30.375 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T04:05:30.375 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.375 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.375 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.375 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.375 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.375 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.375 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.375 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T04:05:30.375 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.375 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.375 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.375 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.376 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.376 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.376 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.376 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.376 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.376 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.376 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.376 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.376 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.376 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.376 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.376 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.376 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.377 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.377 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.377 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.377 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.377 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix", 2024-09-21T04:05:30.377 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.377 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.377 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.377 INFO:teuthology.orchestra.run.smithi046.stdout: "discovery_interval": { 2024-09-21T04:05:30.377 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "discovery_interval", 2024-09-21T04:05:30.377 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2024-09-21T04:05:30.377 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.377 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.377 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "100", 2024-09-21T04:05:30.378 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.378 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.378 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.378 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.378 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.378 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.378 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.378 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.378 INFO:teuthology.orchestra.run.smithi046.stdout: "identifier": { 2024-09-21T04:05:30.378 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "identifier", 2024-09-21T04:05:30.378 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.378 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.378 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.379 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.379 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.379 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.379 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.379 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.379 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.379 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.379 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.379 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.379 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2024-09-21T04:05:30.379 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2024-09-21T04:05:30.379 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:30.379 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.380 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.380 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2024-09-21T04:05:30.380 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.380 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.380 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.380 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.380 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.380 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.380 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.380 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.380 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.380 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.380 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.381 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.381 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.381 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.381 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.381 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.381 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.381 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.381 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.381 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.381 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.381 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.381 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.381 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.381 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.382 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.382 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.382 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.382 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.382 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.382 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.382 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.382 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.382 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.382 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.382 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.383 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.383 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.383 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.383 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.383 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.383 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.383 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.383 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.383 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.383 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.383 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.383 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.384 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.384 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.384 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.384 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.384 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.384 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.384 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.384 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.384 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.384 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.384 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.384 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.385 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.385 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.385 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.385 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.385 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.385 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.385 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.385 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.385 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.385 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.385 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.385 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.385 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.385 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.386 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.386 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.386 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.386 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.386 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.386 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.386 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.386 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.386 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.386 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.386 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.386 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.386 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.387 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.387 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.387 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.387 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.387 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.387 INFO:teuthology.orchestra.run.smithi046.stdout: "zabbix_host": { 2024-09-21T04:05:30.387 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix_host", 2024-09-21T04:05:30.387 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.387 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.387 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.387 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.387 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.387 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.387 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.388 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.388 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.388 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.388 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.388 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.388 INFO:teuthology.orchestra.run.smithi046.stdout: "zabbix_port": { 2024-09-21T04:05:30.388 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix_port", 2024-09-21T04:05:30.388 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.388 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.388 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.388 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10051", 2024-09-21T04:05:30.388 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.388 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.388 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.389 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.389 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.389 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.389 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.389 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.389 INFO:teuthology.orchestra.run.smithi046.stdout: "zabbix_sender": { 2024-09-21T04:05:30.389 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix_sender", 2024-09-21T04:05:30.389 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.389 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.389 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.389 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T04:05:30.389 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.389 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.390 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.390 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.390 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.390 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.390 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.390 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.390 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.390 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.390 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-09-21T04:05:30.390 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.390 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.390 INFO:teuthology.orchestra.run.smithi046.stdout: "modules": [ 2024-09-21T04:05:30.390 INFO:teuthology.orchestra.run.smithi046.stdout: "cephadm", 2024-09-21T04:05:30.391 INFO:teuthology.orchestra.run.smithi046.stdout: "dashboard", 2024-09-21T04:05:30.391 INFO:teuthology.orchestra.run.smithi046.stdout: "iostat", 2024-09-21T04:05:30.391 INFO:teuthology.orchestra.run.smithi046.stdout: "nfs", 2024-09-21T04:05:30.391 INFO:teuthology.orchestra.run.smithi046.stdout: "restful", 2024-09-21T04:05:30.391 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_schedule" 2024-09-21T04:05:30.391 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.391 INFO:teuthology.orchestra.run.smithi046.stdout: "available_modules": [ 2024-09-21T04:05:30.391 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.391 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "alerts", 2024-09-21T04:05:30.391 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.391 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.391 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.391 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2024-09-21T04:05:30.391 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2024-09-21T04:05:30.391 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:30.392 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.392 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.392 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2024-09-21T04:05:30.392 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.392 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.392 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.392 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T04:05:30.392 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.392 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.392 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.392 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.392 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.392 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.393 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.393 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.393 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.393 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.393 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.393 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.393 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.393 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.393 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.393 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.393 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.393 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.393 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.394 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.394 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.394 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.394 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.394 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.394 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.394 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.394 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.394 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.394 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.394 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.394 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.394 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.394 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.395 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.395 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.395 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.395 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.395 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.395 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.395 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.395 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.395 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.395 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.395 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.395 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.395 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.395 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.395 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.396 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.396 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.396 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.396 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.396 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.396 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.396 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.396 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.396 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.396 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.396 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.396 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.396 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.396 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.397 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.397 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.397 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.397 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.397 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.397 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.397 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.397 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.397 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.397 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.397 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.397 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.397 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_destination": { 2024-09-21T04:05:30.397 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_destination", 2024-09-21T04:05:30.398 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.398 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.398 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.398 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.398 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.398 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.398 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.398 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T04:05:30.398 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.398 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.398 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.398 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.398 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_from_name": { 2024-09-21T04:05:30.398 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_from_name", 2024-09-21T04:05:30.399 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.399 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.399 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.399 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "Ceph", 2024-09-21T04:05:30.399 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.399 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.399 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.399 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Email From: name", 2024-09-21T04:05:30.399 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.399 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.399 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.399 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.399 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_host": { 2024-09-21T04:05:30.400 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_host", 2024-09-21T04:05:30.400 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.400 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.400 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.400 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.400 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.400 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.400 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.400 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SMTP server", 2024-09-21T04:05:30.400 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.400 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.400 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.400 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.400 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_password": { 2024-09-21T04:05:30.401 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_password", 2024-09-21T04:05:30.401 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.401 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.401 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.401 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.401 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.401 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.401 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.401 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Password to authenticate with", 2024-09-21T04:05:30.401 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.401 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.401 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.401 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.401 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_port": { 2024-09-21T04:05:30.401 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_port", 2024-09-21T04:05:30.402 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.402 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.402 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.402 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "465", 2024-09-21T04:05:30.402 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.402 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.402 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.402 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SMTP port", 2024-09-21T04:05:30.402 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.402 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.402 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.402 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.402 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_sender": { 2024-09-21T04:05:30.402 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_sender", 2024-09-21T04:05:30.403 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.403 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.403 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.403 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.403 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.403 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.403 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.403 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SMTP envelope sender", 2024-09-21T04:05:30.403 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.403 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.403 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.403 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.404 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_ssl": { 2024-09-21T04:05:30.404 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_ssl", 2024-09-21T04:05:30.404 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.404 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.404 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.404 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.404 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.404 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.404 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.404 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T04:05:30.404 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.404 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.404 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.404 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.405 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_user": { 2024-09-21T04:05:30.405 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_user", 2024-09-21T04:05:30.405 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.405 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.405 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.405 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.405 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.405 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.405 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.405 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "User to authenticate as", 2024-09-21T04:05:30.405 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.405 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.405 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.405 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.405 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.406 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.406 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.406 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.406 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.406 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.406 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.406 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.406 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.406 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.406 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.406 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.406 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.407 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.407 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.407 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.407 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.407 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "balancer", 2024-09-21T04:05:30.407 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.407 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.407 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.407 INFO:teuthology.orchestra.run.smithi046.stdout: "active": { 2024-09-21T04:05:30.407 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "active", 2024-09-21T04:05:30.407 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.407 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.407 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.407 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.408 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.408 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.408 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.408 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T04:05:30.408 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.408 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.408 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.408 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.408 INFO:teuthology.orchestra.run.smithi046.stdout: "begin_time": { 2024-09-21T04:05:30.408 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "begin_time", 2024-09-21T04:05:30.408 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.408 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.408 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.408 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0000", 2024-09-21T04:05:30.409 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.409 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.409 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.409 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T04:05:30.409 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T04:05:30.409 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.409 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.409 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.409 INFO:teuthology.orchestra.run.smithi046.stdout: "begin_weekday": { 2024-09-21T04:05:30.409 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "begin_weekday", 2024-09-21T04:05:30.409 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2024-09-21T04:05:30.409 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.410 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.410 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.410 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "0", 2024-09-21T04:05:30.410 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "6", 2024-09-21T04:05:30.410 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.410 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T04:05:30.410 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T04:05:30.410 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.410 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.410 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.410 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_compat_max_iterations": { 2024-09-21T04:05:30.410 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crush_compat_max_iterations", 2024-09-21T04:05:30.411 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2024-09-21T04:05:30.411 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.411 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.411 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "25", 2024-09-21T04:05:30.411 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2024-09-21T04:05:30.411 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "250", 2024-09-21T04:05:30.411 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.411 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T04:05:30.411 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.411 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.411 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.411 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.411 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_compat_metrics": { 2024-09-21T04:05:30.412 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crush_compat_metrics", 2024-09-21T04:05:30.412 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.412 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.412 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.412 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T04:05:30.412 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.412 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.412 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.412 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T04:05:30.412 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T04:05:30.412 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.412 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.412 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.412 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_compat_step": { 2024-09-21T04:05:30.413 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crush_compat_step", 2024-09-21T04:05:30.413 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-21T04:05:30.413 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.413 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.413 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0.5", 2024-09-21T04:05:30.413 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "0.001", 2024-09-21T04:05:30.413 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "0.999", 2024-09-21T04:05:30.413 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.413 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "aggressiveness of optimization", 2024-09-21T04:05:30.413 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T04:05:30.413 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.413 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.413 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.414 INFO:teuthology.orchestra.run.smithi046.stdout: "end_time": { 2024-09-21T04:05:30.414 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "end_time", 2024-09-21T04:05:30.414 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.414 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.414 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.414 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "2359", 2024-09-21T04:05:30.414 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.414 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.414 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.414 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T04:05:30.414 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T04:05:30.415 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.415 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.415 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.415 INFO:teuthology.orchestra.run.smithi046.stdout: "end_weekday": { 2024-09-21T04:05:30.415 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "end_weekday", 2024-09-21T04:05:30.415 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2024-09-21T04:05:30.415 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.415 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.415 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.415 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "0", 2024-09-21T04:05:30.415 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "6", 2024-09-21T04:05:30.416 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.416 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T04:05:30.416 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T04:05:30.416 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.416 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.416 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.416 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.416 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.416 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.416 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.416 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.417 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.417 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.417 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.417 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.417 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.417 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.417 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.417 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.417 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.417 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.417 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.417 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.417 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.417 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.418 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.418 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.418 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.418 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.418 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.418 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.418 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.418 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.418 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.418 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.418 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.418 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.419 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.419 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.419 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.419 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.419 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.419 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.419 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.419 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.419 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.419 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.419 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.420 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.420 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.420 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.420 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.420 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.420 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.420 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.420 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.420 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.420 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.420 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.420 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.420 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.420 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.421 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.421 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.421 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.421 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.421 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.421 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.421 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.421 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.421 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.421 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.421 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.421 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.421 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.421 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.422 INFO:teuthology.orchestra.run.smithi046.stdout: "min_score": { 2024-09-21T04:05:30.422 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "min_score", 2024-09-21T04:05:30.422 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-21T04:05:30.422 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.422 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.422 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.422 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.422 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.422 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.422 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T04:05:30.422 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.422 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.422 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.423 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.423 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": { 2024-09-21T04:05:30.423 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mode", 2024-09-21T04:05:30.423 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.423 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.423 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.423 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "upmap", 2024-09-21T04:05:30.423 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.423 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.423 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.423 INFO:teuthology.orchestra.run.smithi046.stdout: "crush-compat", 2024-09-21T04:05:30.423 INFO:teuthology.orchestra.run.smithi046.stdout: "none", 2024-09-21T04:05:30.424 INFO:teuthology.orchestra.run.smithi046.stdout: "read", 2024-09-21T04:05:30.424 INFO:teuthology.orchestra.run.smithi046.stdout: "upmap", 2024-09-21T04:05:30.424 INFO:teuthology.orchestra.run.smithi046.stdout: "upmap-read" 2024-09-21T04:05:30.424 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.424 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Balancer mode", 2024-09-21T04:05:30.424 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.424 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.425 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.425 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.425 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_ids": { 2024-09-21T04:05:30.425 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pool_ids", 2024-09-21T04:05:30.425 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.425 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.425 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.425 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.425 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.425 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.425 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.426 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T04:05:30.426 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.426 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.426 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.426 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.426 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2024-09-21T04:05:30.426 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2024-09-21T04:05:30.426 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:30.426 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.426 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.426 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2024-09-21T04:05:30.427 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.427 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.427 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.427 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T04:05:30.427 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.427 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.427 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.427 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.428 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.428 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.428 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.428 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.428 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.428 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.428 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.428 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.428 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.428 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.428 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.428 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.429 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.429 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.429 INFO:teuthology.orchestra.run.smithi046.stdout: "upmap_max_deviation": { 2024-09-21T04:05:30.429 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "upmap_max_deviation", 2024-09-21T04:05:30.429 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.429 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.429 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.429 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2024-09-21T04:05:30.429 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2024-09-21T04:05:30.429 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.429 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.429 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T04:05:30.429 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T04:05:30.430 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.430 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.430 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.430 INFO:teuthology.orchestra.run.smithi046.stdout: "upmap_max_optimizations": { 2024-09-21T04:05:30.430 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "upmap_max_optimizations", 2024-09-21T04:05:30.430 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2024-09-21T04:05:30.430 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.430 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.430 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-21T04:05:30.430 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.430 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.430 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.430 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T04:05:30.431 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.431 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.431 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.431 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.431 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.431 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.431 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.431 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephadm", 2024-09-21T04:05:30.431 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.431 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.431 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.431 INFO:teuthology.orchestra.run.smithi046.stdout: "agent_down_multiplier": { 2024-09-21T04:05:30.431 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "agent_down_multiplier", 2024-09-21T04:05:30.432 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-21T04:05:30.432 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.432 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.432 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "3.0", 2024-09-21T04:05:30.432 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.432 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.432 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.432 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T04:05:30.432 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.432 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.432 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.432 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.432 INFO:teuthology.orchestra.run.smithi046.stdout: "agent_refresh_rate": { 2024-09-21T04:05:30.432 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "agent_refresh_rate", 2024-09-21T04:05:30.432 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:30.433 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.433 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.433 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "20", 2024-09-21T04:05:30.433 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.433 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.433 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.433 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T04:05:30.433 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.433 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.433 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.433 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.433 INFO:teuthology.orchestra.run.smithi046.stdout: "agent_starting_port": { 2024-09-21T04:05:30.433 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "agent_starting_port", 2024-09-21T04:05:30.434 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.434 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.434 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.434 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "4721", 2024-09-21T04:05:30.434 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.434 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.434 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.434 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T04:05:30.434 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.434 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.434 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.434 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.434 INFO:teuthology.orchestra.run.smithi046.stdout: "allow_ptrace": { 2024-09-21T04:05:30.434 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "allow_ptrace", 2024-09-21T04:05:30.435 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.435 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.435 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.435 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.435 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.435 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.435 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.435 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T04:05:30.435 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T04:05:30.435 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.435 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.435 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.435 INFO:teuthology.orchestra.run.smithi046.stdout: "autotune_interval": { 2024-09-21T04:05:30.436 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "autotune_interval", 2024-09-21T04:05:30.436 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:30.436 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.436 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.436 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2024-09-21T04:05:30.436 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.436 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.436 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.436 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T04:05:30.436 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.436 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.436 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.436 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.436 INFO:teuthology.orchestra.run.smithi046.stdout: "autotune_memory_target_ratio": { 2024-09-21T04:05:30.437 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T04:05:30.437 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-21T04:05:30.437 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.437 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.437 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0.7", 2024-09-21T04:05:30.437 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.437 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.437 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.437 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T04:05:30.437 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.437 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.437 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.437 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.437 INFO:teuthology.orchestra.run.smithi046.stdout: "cephadm_log_destination": { 2024-09-21T04:05:30.437 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephadm_log_destination", 2024-09-21T04:05:30.438 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.438 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.438 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.438 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.438 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.438 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.438 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.438 INFO:teuthology.orchestra.run.smithi046.stdout: "file", 2024-09-21T04:05:30.438 INFO:teuthology.orchestra.run.smithi046.stdout: "file,syslog", 2024-09-21T04:05:30.438 INFO:teuthology.orchestra.run.smithi046.stdout: "syslog" 2024-09-21T04:05:30.438 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.438 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T04:05:30.438 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.438 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.439 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.439 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.439 INFO:teuthology.orchestra.run.smithi046.stdout: "cgroups_split": { 2024-09-21T04:05:30.439 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cgroups_split", 2024-09-21T04:05:30.439 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.439 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.439 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.439 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.439 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.439 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.439 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.439 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T04:05:30.439 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.440 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.440 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.440 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.440 INFO:teuthology.orchestra.run.smithi046.stdout: "config_checks_enabled": { 2024-09-21T04:05:30.440 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "config_checks_enabled", 2024-09-21T04:05:30.440 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.440 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.440 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.440 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.440 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.440 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.440 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.440 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T04:05:30.440 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.441 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.441 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.441 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.441 INFO:teuthology.orchestra.run.smithi046.stdout: "config_dashboard": { 2024-09-21T04:05:30.441 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "config_dashboard", 2024-09-21T04:05:30.441 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.441 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.441 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.441 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.441 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.441 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.441 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.441 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T04:05:30.442 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.442 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.442 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.442 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.442 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_alertmanager": { 2024-09-21T04:05:30.442 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_alertmanager", 2024-09-21T04:05:30.442 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.442 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.442 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.442 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T04:05:30.442 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.442 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.442 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.443 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2024-09-21T04:05:30.443 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.443 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.443 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.443 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.443 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_base": { 2024-09-21T04:05:30.443 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_base", 2024-09-21T04:05:30.443 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.443 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.443 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.443 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T04:05:30.443 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.443 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.443 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.444 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Container image name, without the tag", 2024-09-21T04:05:30.444 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.444 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.444 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.444 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.444 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_elasticsearch": { 2024-09-21T04:05:30.444 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_elasticsearch", 2024-09-21T04:05:30.444 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.444 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.444 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.444 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T04:05:30.444 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.444 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.445 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.445 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "elasticsearch container image", 2024-09-21T04:05:30.445 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.445 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.445 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.445 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.445 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_grafana": { 2024-09-21T04:05:30.445 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_grafana", 2024-09-21T04:05:30.445 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.445 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.445 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.445 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T04:05:30.445 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.445 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.445 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.446 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2024-09-21T04:05:30.446 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.446 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.446 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.446 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.446 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_haproxy": { 2024-09-21T04:05:30.446 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_haproxy", 2024-09-21T04:05:30.446 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.446 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.446 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.446 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T04:05:30.446 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.446 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.447 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.447 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "HAproxy container image", 2024-09-21T04:05:30.447 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.447 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.447 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.447 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.447 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_jaeger_agent": { 2024-09-21T04:05:30.447 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_jaeger_agent", 2024-09-21T04:05:30.447 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.447 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.447 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.447 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T04:05:30.447 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.447 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.448 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.448 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Jaeger agent container image", 2024-09-21T04:05:30.448 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.448 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.448 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.448 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.448 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_jaeger_collector": { 2024-09-21T04:05:30.448 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_jaeger_collector", 2024-09-21T04:05:30.448 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.448 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.448 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.448 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T04:05:30.448 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.448 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.449 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.449 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Jaeger collector container image", 2024-09-21T04:05:30.449 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.449 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.449 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.449 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.449 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_jaeger_query": { 2024-09-21T04:05:30.449 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_jaeger_query", 2024-09-21T04:05:30.449 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.449 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.449 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.449 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T04:05:30.449 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.449 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.450 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.450 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Jaeger query container image", 2024-09-21T04:05:30.450 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.450 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.450 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.450 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.450 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_keepalived": { 2024-09-21T04:05:30.450 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_keepalived", 2024-09-21T04:05:30.450 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.450 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.450 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.450 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T04:05:30.450 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.450 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.451 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.451 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Keepalived container image", 2024-09-21T04:05:30.451 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.451 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.451 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.451 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.451 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_loki": { 2024-09-21T04:05:30.451 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_loki", 2024-09-21T04:05:30.451 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.451 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.451 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.451 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T04:05:30.451 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.451 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.452 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.452 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Loki container image", 2024-09-21T04:05:30.452 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.452 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.452 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.452 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.452 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_nginx": { 2024-09-21T04:05:30.452 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_nginx", 2024-09-21T04:05:30.452 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.452 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.452 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.452 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T04:05:30.452 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.452 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.453 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.453 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Nginx container image", 2024-09-21T04:05:30.453 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.453 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.453 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.453 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.453 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_node_exporter": { 2024-09-21T04:05:30.453 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_node_exporter", 2024-09-21T04:05:30.453 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.453 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.453 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.453 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T04:05:30.453 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.453 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.454 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.454 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2024-09-21T04:05:30.454 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.454 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.454 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.454 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.454 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_nvmeof": { 2024-09-21T04:05:30.454 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_nvmeof", 2024-09-21T04:05:30.454 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.454 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.454 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.454 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T04:05:30.454 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.454 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.455 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.455 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Nvme-of container image", 2024-09-21T04:05:30.455 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.455 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.455 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.455 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.455 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_oauth2_proxy": { 2024-09-21T04:05:30.455 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T04:05:30.455 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.455 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.455 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.456 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T04:05:30.456 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.456 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.456 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.456 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "oauth2-proxy container image", 2024-09-21T04:05:30.456 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.456 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.456 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.456 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.456 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_prometheus": { 2024-09-21T04:05:30.456 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_prometheus", 2024-09-21T04:05:30.456 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.456 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.457 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.457 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T04:05:30.457 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.457 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.457 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.457 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2024-09-21T04:05:30.457 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.457 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.457 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.457 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.457 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_promtail": { 2024-09-21T04:05:30.457 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_promtail", 2024-09-21T04:05:30.457 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.458 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.458 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.458 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T04:05:30.458 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.458 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.458 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.458 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Promtail container image", 2024-09-21T04:05:30.458 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.458 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.458 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.458 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.458 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_samba": { 2024-09-21T04:05:30.458 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_samba", 2024-09-21T04:05:30.458 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.459 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.459 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.459 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T04:05:30.459 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.459 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.459 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.459 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Samba/SMB container image", 2024-09-21T04:05:30.459 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.459 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.459 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.459 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.459 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_samba_metrics": { 2024-09-21T04:05:30.459 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_samba_metrics", 2024-09-21T04:05:30.459 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.460 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.460 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.462 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T04:05:30.462 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.462 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.462 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.462 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T04:05:30.462 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.462 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.462 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.462 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.462 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_snmp_gateway": { 2024-09-21T04:05:30.462 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_snmp_gateway", 2024-09-21T04:05:30.462 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.463 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.463 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.463 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T04:05:30.463 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.463 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.463 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.463 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SNMP Gateway container image", 2024-09-21T04:05:30.463 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.463 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.463 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.463 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.463 INFO:teuthology.orchestra.run.smithi046.stdout: "container_init": { 2024-09-21T04:05:30.463 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_init", 2024-09-21T04:05:30.464 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.464 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.464 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.464 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.464 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.464 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.464 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.464 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T04:05:30.464 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.464 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.464 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.464 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.464 INFO:teuthology.orchestra.run.smithi046.stdout: "daemon_cache_timeout": { 2024-09-21T04:05:30.465 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "daemon_cache_timeout", 2024-09-21T04:05:30.465 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:30.465 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.465 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.465 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2024-09-21T04:05:30.465 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.465 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.465 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.465 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T04:05:30.465 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.465 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.465 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.465 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.465 INFO:teuthology.orchestra.run.smithi046.stdout: "default_cephadm_command_timeout": { 2024-09-21T04:05:30.466 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T04:05:30.466 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.466 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.466 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.466 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "900", 2024-09-21T04:05:30.466 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.466 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.466 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.466 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T04:05:30.466 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.466 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.466 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.466 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.466 INFO:teuthology.orchestra.run.smithi046.stdout: "default_registry": { 2024-09-21T04:05:30.467 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "default_registry", 2024-09-21T04:05:30.467 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.467 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.467 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.467 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io", 2024-09-21T04:05:30.467 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.467 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.467 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.467 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T04:05:30.467 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.467 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.467 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.467 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.468 INFO:teuthology.orchestra.run.smithi046.stdout: "device_cache_timeout": { 2024-09-21T04:05:30.468 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "device_cache_timeout", 2024-09-21T04:05:30.468 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:30.468 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.468 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.468 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "1800", 2024-09-21T04:05:30.468 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.468 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.468 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.468 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "seconds to cache device inventory", 2024-09-21T04:05:30.468 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.468 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.468 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.468 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.469 INFO:teuthology.orchestra.run.smithi046.stdout: "device_enhanced_scan": { 2024-09-21T04:05:30.469 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "device_enhanced_scan", 2024-09-21T04:05:30.469 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.469 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.469 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.469 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.469 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.469 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.469 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.469 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T04:05:30.469 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.469 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.469 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.470 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.470 INFO:teuthology.orchestra.run.smithi046.stdout: "facts_cache_timeout": { 2024-09-21T04:05:30.470 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "facts_cache_timeout", 2024-09-21T04:05:30.470 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:30.470 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.470 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.470 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2024-09-21T04:05:30.470 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.470 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.470 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.470 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "seconds to cache host facts data", 2024-09-21T04:05:30.470 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.470 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.470 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.471 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.471 INFO:teuthology.orchestra.run.smithi046.stdout: "grafana_dashboards_path": { 2024-09-21T04:05:30.471 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "grafana_dashboards_path", 2024-09-21T04:05:30.471 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.471 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.471 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.471 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T04:05:30.471 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.471 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.471 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.471 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T04:05:30.471 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.471 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.471 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.472 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.472 INFO:teuthology.orchestra.run.smithi046.stdout: "host_check_interval": { 2024-09-21T04:05:30.472 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "host_check_interval", 2024-09-21T04:05:30.472 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:30.472 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.472 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.472 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2024-09-21T04:05:30.472 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.472 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.472 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.472 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to perform a host check", 2024-09-21T04:05:30.472 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.472 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.472 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.473 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.473 INFO:teuthology.orchestra.run.smithi046.stdout: "hw_monitoring": { 2024-09-21T04:05:30.473 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "hw_monitoring", 2024-09-21T04:05:30.473 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.473 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.473 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.473 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.473 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.473 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.473 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.473 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T04:05:30.473 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.473 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.473 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.474 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.474 INFO:teuthology.orchestra.run.smithi046.stdout: "inventory_list_all": { 2024-09-21T04:05:30.474 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "inventory_list_all", 2024-09-21T04:05:30.474 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.474 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.474 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.474 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.474 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.474 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.474 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.474 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T04:05:30.474 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.474 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.475 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.475 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.475 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.475 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.475 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.475 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.475 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.475 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.475 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.475 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.475 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.475 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.475 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.475 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.476 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.476 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.476 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.476 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.476 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.476 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.476 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.476 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.476 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.476 INFO:teuthology.orchestra.run.smithi046.stdout: "log_refresh_metadata": { 2024-09-21T04:05:30.476 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_refresh_metadata", 2024-09-21T04:05:30.476 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.476 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.476 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.476 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.477 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.477 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.477 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.477 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T04:05:30.477 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.477 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.477 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.477 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.477 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.477 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.477 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.477 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.477 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.477 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.478 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.478 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.478 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.478 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T04:05:30.478 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.478 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.478 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.478 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.478 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.478 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.478 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.478 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.478 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.479 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.479 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.479 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.479 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.479 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.479 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.479 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.479 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.479 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.479 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.479 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.479 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.479 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.479 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.479 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.480 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.480 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.480 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.480 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.480 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.480 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.480 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.480 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.480 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.480 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.480 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.480 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.480 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.480 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.481 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.481 INFO:teuthology.orchestra.run.smithi046.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T04:05:30.481 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T04:05:30.481 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.481 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.481 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.481 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.481 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.481 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.481 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.481 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T04:05:30.481 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.481 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.482 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.482 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.482 INFO:teuthology.orchestra.run.smithi046.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T04:05:30.482 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T04:05:30.482 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.482 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.482 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.482 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "*", 2024-09-21T04:05:30.482 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.482 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.482 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.482 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T04:05:30.482 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.482 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.483 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.483 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.483 INFO:teuthology.orchestra.run.smithi046.stdout: "max_count_per_host": { 2024-09-21T04:05:30.483 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_count_per_host", 2024-09-21T04:05:30.483 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.483 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.483 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.483 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-21T04:05:30.483 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.483 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.483 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.483 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "max number of daemons per service per host", 2024-09-21T04:05:30.483 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.483 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.484 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.484 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.484 INFO:teuthology.orchestra.run.smithi046.stdout: "max_osd_draining_count": { 2024-09-21T04:05:30.484 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_osd_draining_count", 2024-09-21T04:05:30.484 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.484 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.484 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.484 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-21T04:05:30.484 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.484 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.484 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.484 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T04:05:30.484 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.484 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.485 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.485 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.485 INFO:teuthology.orchestra.run.smithi046.stdout: "migration_current": { 2024-09-21T04:05:30.485 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "migration_current", 2024-09-21T04:05:30.485 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.485 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.485 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.485 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.485 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.485 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.485 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.485 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "internal - do not modify", 2024-09-21T04:05:30.485 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.485 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.485 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.486 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.486 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": { 2024-09-21T04:05:30.486 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mode", 2024-09-21T04:05:30.486 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.486 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.486 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.486 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "root", 2024-09-21T04:05:30.486 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.486 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.486 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.486 INFO:teuthology.orchestra.run.smithi046.stdout: "cephadm-package", 2024-09-21T04:05:30.486 INFO:teuthology.orchestra.run.smithi046.stdout: "root" 2024-09-21T04:05:30.486 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.487 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T04:05:30.487 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.487 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.487 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.487 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.487 INFO:teuthology.orchestra.run.smithi046.stdout: "oob_default_addr": { 2024-09-21T04:05:30.487 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "oob_default_addr", 2024-09-21T04:05:30.487 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.487 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.487 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.487 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "169.254.1.1", 2024-09-21T04:05:30.487 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.487 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.488 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.488 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T04:05:30.488 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.488 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.488 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.488 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.488 INFO:teuthology.orchestra.run.smithi046.stdout: "prometheus_alerts_path": { 2024-09-21T04:05:30.488 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "prometheus_alerts_path", 2024-09-21T04:05:30.488 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.488 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.488 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.488 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T04:05:30.488 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.489 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.489 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.489 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T04:05:30.489 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.489 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.489 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.489 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.489 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_insecure": { 2024-09-21T04:05:30.489 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_insecure", 2024-09-21T04:05:30.489 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.489 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.489 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.489 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.489 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.490 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.490 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.490 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T04:05:30.490 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.490 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.490 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.490 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.490 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_password": { 2024-09-21T04:05:30.490 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_password", 2024-09-21T04:05:30.490 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.490 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.490 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.490 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.490 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.491 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.491 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.491 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T04:05:30.491 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.491 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.491 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.491 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.491 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_url": { 2024-09-21T04:05:30.491 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_url", 2024-09-21T04:05:30.491 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.491 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.491 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.491 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.492 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.492 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.492 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.492 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T04:05:30.492 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.492 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.492 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.492 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.492 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_username": { 2024-09-21T04:05:30.492 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_username", 2024-09-21T04:05:30.492 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.492 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.492 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.493 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.493 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.493 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.493 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.493 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T04:05:30.493 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.493 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.493 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.493 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.493 INFO:teuthology.orchestra.run.smithi046.stdout: "secure_monitoring_stack": { 2024-09-21T04:05:30.493 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "secure_monitoring_stack", 2024-09-21T04:05:30.493 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.493 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.493 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.494 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.494 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.494 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.494 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.494 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T04:05:30.494 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.494 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.494 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.494 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.494 INFO:teuthology.orchestra.run.smithi046.stdout: "service_discovery_port": { 2024-09-21T04:05:30.494 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "service_discovery_port", 2024-09-21T04:05:30.494 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.494 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.494 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.495 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8765", 2024-09-21T04:05:30.495 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.495 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.495 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.495 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "cephadm service discovery port", 2024-09-21T04:05:30.495 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.495 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.495 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.495 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.495 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.495 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.495 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.495 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.496 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.496 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.496 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.496 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.496 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.496 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.496 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.496 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.496 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.496 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.496 INFO:teuthology.orchestra.run.smithi046.stdout: "ssh_config_file": { 2024-09-21T04:05:30.496 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssh_config_file", 2024-09-21T04:05:30.496 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.496 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.496 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.497 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.497 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.497 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.497 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.497 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T04:05:30.497 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.497 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.497 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.497 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.497 INFO:teuthology.orchestra.run.smithi046.stdout: "ssh_keepalive_count_max": { 2024-09-21T04:05:30.497 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T04:05:30.497 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.497 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.498 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.498 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "3", 2024-09-21T04:05:30.498 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.498 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.498 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.498 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T04:05:30.498 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.498 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.498 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.498 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.498 INFO:teuthology.orchestra.run.smithi046.stdout: "ssh_keepalive_interval": { 2024-09-21T04:05:30.498 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssh_keepalive_interval", 2024-09-21T04:05:30.498 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.499 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.499 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.499 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "7", 2024-09-21T04:05:30.499 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.499 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.499 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.499 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T04:05:30.499 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.499 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.499 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.499 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.499 INFO:teuthology.orchestra.run.smithi046.stdout: "use_agent": { 2024-09-21T04:05:30.499 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "use_agent", 2024-09-21T04:05:30.499 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.500 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.500 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.500 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.500 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.500 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.500 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.500 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T04:05:30.500 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.500 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.500 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.500 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.500 INFO:teuthology.orchestra.run.smithi046.stdout: "use_repo_digest": { 2024-09-21T04:05:30.500 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "use_repo_digest", 2024-09-21T04:05:30.500 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.501 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.501 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.501 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.501 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.501 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.501 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.501 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T04:05:30.501 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.501 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.501 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.501 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.501 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_on_failed_host_check": { 2024-09-21T04:05:30.501 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_on_failed_host_check", 2024-09-21T04:05:30.502 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.502 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.502 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.502 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.502 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.502 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.502 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.502 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T04:05:30.502 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.502 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.502 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.502 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.502 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_on_stray_daemons": { 2024-09-21T04:05:30.502 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_on_stray_daemons", 2024-09-21T04:05:30.503 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.503 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.503 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.503 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.503 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.503 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.503 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.503 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T04:05:30.503 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.503 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.503 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.503 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.503 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_on_stray_hosts": { 2024-09-21T04:05:30.504 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_on_stray_hosts", 2024-09-21T04:05:30.504 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.504 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.504 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.504 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.504 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.504 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.504 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.504 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T04:05:30.504 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.504 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.504 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.504 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.505 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.505 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.505 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.505 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crash", 2024-09-21T04:05:30.505 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.505 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.505 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.505 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.505 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.505 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.505 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.505 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.505 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.505 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.506 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.506 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.506 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.506 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.506 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.506 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.506 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.506 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.506 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.506 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.506 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.506 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.506 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.507 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.507 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.507 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.507 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.507 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.507 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.507 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.507 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.507 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.507 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.507 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.507 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.507 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.507 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.508 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.508 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.508 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.508 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.508 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.508 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.508 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.508 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.508 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.508 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.508 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.508 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.508 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.509 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.509 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.509 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.509 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.509 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.509 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.509 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.509 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.509 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.509 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.509 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.509 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.509 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.510 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.510 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.510 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.510 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.510 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.510 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.510 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.510 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.510 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.510 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.510 INFO:teuthology.orchestra.run.smithi046.stdout: "retain_interval": { 2024-09-21T04:05:30.510 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "retain_interval", 2024-09-21T04:05:30.510 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:30.510 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.511 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.511 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "31536000", 2024-09-21T04:05:30.511 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.511 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.511 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.511 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T04:05:30.511 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.511 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.511 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.511 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.511 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.511 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.511 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.512 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.512 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.512 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.512 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.512 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.512 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.512 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.512 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.512 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.512 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.512 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.512 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_recent_interval": { 2024-09-21T04:05:30.512 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_recent_interval", 2024-09-21T04:05:30.512 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:30.513 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.513 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.513 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "1209600", 2024-09-21T04:05:30.513 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.513 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.513 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.513 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T04:05:30.513 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.513 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.513 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.513 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.513 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.513 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.513 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.514 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "dashboard", 2024-09-21T04:05:30.514 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.514 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.514 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.514 INFO:teuthology.orchestra.run.smithi046.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T04:05:30.514 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T04:05:30.514 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.514 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.514 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.514 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-21T04:05:30.514 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.514 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.514 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.514 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.515 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.515 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.515 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.515 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.515 INFO:teuthology.orchestra.run.smithi046.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T04:05:30.515 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T04:05:30.515 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.515 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.515 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.515 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.515 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.515 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.515 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.515 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.516 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.516 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.516 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.516 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.516 INFO:teuthology.orchestra.run.smithi046.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T04:05:30.516 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T04:05:30.516 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.516 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.516 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.516 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.516 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.516 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.516 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.516 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.517 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.517 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.517 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.517 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.517 INFO:teuthology.orchestra.run.smithi046.stdout: "AUDIT_API_ENABLED": { 2024-09-21T04:05:30.517 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T04:05:30.517 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.517 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.517 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.517 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.517 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.517 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.517 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.518 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.518 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.518 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.518 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.518 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.518 INFO:teuthology.orchestra.run.smithi046.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T04:05:30.518 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T04:05:30.518 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.518 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.518 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.518 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.518 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.518 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.518 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.518 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.519 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.519 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.519 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.519 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.519 INFO:teuthology.orchestra.run.smithi046.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T04:05:30.519 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T04:05:30.519 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.519 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.519 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.519 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.519 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.519 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.519 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.519 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.520 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.520 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.520 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.520 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.520 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T04:05:30.520 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T04:05:30.520 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.520 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.520 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.520 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.520 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.520 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.520 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.521 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.521 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.521 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.521 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.521 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.521 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T04:05:30.521 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T04:05:30.521 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.521 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.521 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.521 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.521 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.521 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.521 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.521 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.522 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.522 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.522 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.522 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.522 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T04:05:30.522 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T04:05:30.522 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.522 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.522 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.522 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.522 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.522 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.522 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.522 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.523 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.523 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.523 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.523 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.523 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T04:05:30.523 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T04:05:30.523 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.523 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.523 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.523 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.523 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.523 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.523 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.523 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.524 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.524 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.524 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.524 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.524 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T04:05:30.524 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T04:05:30.524 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.524 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.524 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.524 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.524 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.524 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.524 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.524 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.525 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.525 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.525 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.525 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.525 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T04:05:30.525 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T04:05:30.525 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.525 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.525 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.525 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.525 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.525 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.525 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.525 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.526 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.526 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.526 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.526 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.526 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T04:05:30.526 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T04:05:30.526 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.526 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.526 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.526 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.526 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.526 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.526 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.526 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.527 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.527 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.527 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.527 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.527 INFO:teuthology.orchestra.run.smithi046.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T04:05:30.527 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T04:05:30.527 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.527 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.527 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.527 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.527 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.527 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.527 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.527 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.528 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.528 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.528 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.528 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.528 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T04:05:30.528 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T04:05:30.528 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.528 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.528 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.528 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "admin", 2024-09-21T04:05:30.528 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.528 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.528 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.528 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.529 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.529 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.529 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.529 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.529 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T04:05:30.529 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T04:05:30.529 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.529 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.529 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.529 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.529 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.529 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.529 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.529 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.530 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.530 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.530 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.530 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.530 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_URL": { 2024-09-21T04:05:30.530 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_URL", 2024-09-21T04:05:30.530 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.530 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.530 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.530 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.530 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.530 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.530 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.530 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.531 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.531 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.531 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.531 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.531 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T04:05:30.531 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T04:05:30.531 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.531 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.531 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.531 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "admin", 2024-09-21T04:05:30.531 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.531 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.531 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.532 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.532 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.532 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.532 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.532 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.532 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T04:05:30.532 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T04:05:30.532 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.532 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.532 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.532 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.532 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.532 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.532 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.533 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.533 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.533 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.533 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.533 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.533 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T04:05:30.533 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T04:05:30.533 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.533 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.533 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.533 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.533 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.533 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.533 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.534 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.534 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.534 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.534 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.534 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.534 INFO:teuthology.orchestra.run.smithi046.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T04:05:30.534 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T04:05:30.534 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.534 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.534 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.534 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.534 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.534 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.535 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.535 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.535 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.535 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.535 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.535 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.535 INFO:teuthology.orchestra.run.smithi046.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T04:05:30.535 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T04:05:30.535 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.535 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.535 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.535 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.535 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.535 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.536 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.536 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.536 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.536 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.536 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.536 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.536 INFO:teuthology.orchestra.run.smithi046.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T04:05:30.536 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T04:05:30.536 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.536 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.536 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.536 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "[]", 2024-09-21T04:05:30.536 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.537 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.537 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.537 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.537 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.537 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.537 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.537 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.537 INFO:teuthology.orchestra.run.smithi046.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T04:05:30.537 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T04:05:30.537 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.537 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.537 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.537 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "{}", 2024-09-21T04:05:30.537 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.538 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.538 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.538 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.538 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.538 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.538 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.538 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.538 INFO:teuthology.orchestra.run.smithi046.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T04:05:30.538 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T04:05:30.538 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.538 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.538 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.538 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.539 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.539 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.539 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.539 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.539 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.539 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.539 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.539 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.539 INFO:teuthology.orchestra.run.smithi046.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T04:05:30.539 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T04:05:30.539 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.539 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.539 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.539 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.539 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.540 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.540 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.540 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.540 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.540 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.540 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.540 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.540 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T04:05:30.540 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T04:05:30.540 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.540 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.540 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.540 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.540 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.540 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.541 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.541 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.541 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.541 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.541 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.541 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.541 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T04:05:30.541 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T04:05:30.541 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.541 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.541 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.541 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.541 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.541 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.541 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.542 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.542 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.542 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.542 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.542 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.542 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T04:05:30.542 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T04:05:30.542 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.542 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.542 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.542 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.542 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.542 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.542 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.543 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.543 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.543 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.543 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.543 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.543 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T04:05:30.543 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T04:05:30.543 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.543 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.543 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.543 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.543 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.543 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.543 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.543 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.544 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.544 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.544 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.544 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.544 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T04:05:30.544 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T04:05:30.544 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.544 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.544 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.544 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.544 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.544 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.544 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.545 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.545 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.545 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.545 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.545 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.545 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T04:05:30.545 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T04:05:30.545 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.545 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.545 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.545 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.545 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.545 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.545 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.545 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.546 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.546 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.546 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.546 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.546 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T04:05:30.546 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T04:05:30.546 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.546 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.546 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.546 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.546 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.546 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.546 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.546 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.547 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.547 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.547 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.547 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.547 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T04:05:30.547 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T04:05:30.547 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.547 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.547 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.547 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.547 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.547 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.547 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.548 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.548 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.548 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.548 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.548 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.548 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T04:05:30.548 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T04:05:30.548 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.548 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.548 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.548 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T04:05:30.548 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.548 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.548 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.549 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.549 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.549 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.549 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.549 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.549 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T04:05:30.549 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T04:05:30.549 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.549 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.549 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.549 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-21T04:05:30.549 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.549 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.549 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.549 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.550 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.550 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.550 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.550 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.550 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T04:05:30.550 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T04:05:30.550 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.550 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.550 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.550 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8", 2024-09-21T04:05:30.550 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.550 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.550 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.550 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.551 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.551 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.551 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.551 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.551 INFO:teuthology.orchestra.run.smithi046.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T04:05:30.551 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T04:05:30.551 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.551 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.551 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.551 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "45", 2024-09-21T04:05:30.551 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.551 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.551 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.551 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.551 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.552 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.552 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.552 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.552 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T04:05:30.552 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T04:05:30.552 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.552 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.552 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.552 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.552 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.552 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.552 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.552 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.552 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.553 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.553 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.553 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.553 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T04:05:30.553 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T04:05:30.553 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.553 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.553 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.553 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "admin", 2024-09-21T04:05:30.553 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.553 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.553 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.553 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.553 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.553 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.554 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.554 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.554 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T04:05:30.554 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T04:05:30.554 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.554 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.554 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.554 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.554 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.554 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.554 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.554 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.554 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.554 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.555 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.555 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.555 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T04:05:30.555 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T04:05:30.555 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.555 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.555 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.555 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.555 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.555 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.555 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.555 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.555 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.556 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.556 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.556 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.556 INFO:teuthology.orchestra.run.smithi046.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T04:05:30.556 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T04:05:30.556 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.556 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.556 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.556 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.556 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.556 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.556 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.556 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.556 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.557 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.557 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.557 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.557 INFO:teuthology.orchestra.run.smithi046.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T04:05:30.557 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T04:05:30.557 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.557 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.557 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.557 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.557 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.557 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.557 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.557 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.557 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.558 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.558 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.558 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.558 INFO:teuthology.orchestra.run.smithi046.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T04:05:30.558 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T04:05:30.558 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.558 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.558 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.558 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-21T04:05:30.558 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.558 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.558 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.558 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.558 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.559 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.559 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.559 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.559 INFO:teuthology.orchestra.run.smithi046.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T04:05:30.559 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T04:05:30.559 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.559 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.559 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.559 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2024-09-21T04:05:30.559 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.559 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.559 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.559 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.559 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.560 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.560 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.560 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.560 INFO:teuthology.orchestra.run.smithi046.stdout: "cross_origin_url": { 2024-09-21T04:05:30.560 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cross_origin_url", 2024-09-21T04:05:30.560 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.560 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.560 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.560 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.560 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.560 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.560 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.560 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.560 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.561 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.561 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.561 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.561 INFO:teuthology.orchestra.run.smithi046.stdout: "crt_file": { 2024-09-21T04:05:30.561 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crt_file", 2024-09-21T04:05:30.561 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.561 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.561 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.561 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.561 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.561 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.561 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.561 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.561 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.561 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.562 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.562 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.562 INFO:teuthology.orchestra.run.smithi046.stdout: "debug": { 2024-09-21T04:05:30.562 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "debug", 2024-09-21T04:05:30.562 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.562 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.562 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.562 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.562 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.562 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.562 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.562 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Enable/disable debug options", 2024-09-21T04:05:30.562 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.563 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.563 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.563 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.563 INFO:teuthology.orchestra.run.smithi046.stdout: "jwt_token_ttl": { 2024-09-21T04:05:30.563 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "jwt_token_ttl", 2024-09-21T04:05:30.563 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.563 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.563 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.563 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "28800", 2024-09-21T04:05:30.563 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.563 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.563 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.563 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.563 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.564 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.564 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.564 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.564 INFO:teuthology.orchestra.run.smithi046.stdout: "key_file": { 2024-09-21T04:05:30.564 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "key_file", 2024-09-21T04:05:30.564 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.564 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.564 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.564 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.564 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.564 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.564 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.564 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.564 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.565 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.565 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.565 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.565 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.565 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.565 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.565 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.565 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.565 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.565 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.565 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.565 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.565 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.565 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.565 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.566 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.566 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.566 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.566 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.566 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.566 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.566 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.566 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.566 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.566 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.566 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.566 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.566 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.567 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.567 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.567 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.567 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.567 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.567 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.567 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.567 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.567 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.567 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.567 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.567 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.567 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.567 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.568 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.568 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.568 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.568 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.568 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.568 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.568 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.568 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.568 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.568 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.568 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.568 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.568 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.569 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.569 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.569 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.569 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.569 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.569 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.569 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.569 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.569 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.569 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.569 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.569 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.569 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.569 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.570 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.570 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.570 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.570 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.570 INFO:teuthology.orchestra.run.smithi046.stdout: "motd": { 2024-09-21T04:05:30.570 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "motd", 2024-09-21T04:05:30.570 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.570 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.570 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.570 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.570 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.570 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.570 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.570 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "The message of the day", 2024-09-21T04:05:30.571 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.571 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.571 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.571 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.571 INFO:teuthology.orchestra.run.smithi046.stdout: "redirect_resolve_ip_addr": { 2024-09-21T04:05:30.571 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T04:05:30.571 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.571 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.571 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.571 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.571 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.571 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.571 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.572 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.572 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.572 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.572 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.572 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.572 INFO:teuthology.orchestra.run.smithi046.stdout: "server_addr": { 2024-09-21T04:05:30.572 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_addr", 2024-09-21T04:05:30.572 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.572 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.572 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.572 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "::", 2024-09-21T04:05:30.572 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.572 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.572 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.573 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.573 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.573 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.573 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.573 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.573 INFO:teuthology.orchestra.run.smithi046.stdout: "server_port": { 2024-09-21T04:05:30.573 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_port", 2024-09-21T04:05:30.573 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.573 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.573 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.573 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8080", 2024-09-21T04:05:30.573 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.573 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.573 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.574 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.574 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.574 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.574 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.574 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.574 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.574 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.574 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.574 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.574 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.574 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.574 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.574 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.575 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.575 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.575 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.575 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.575 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.575 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.575 INFO:teuthology.orchestra.run.smithi046.stdout: "ssl": { 2024-09-21T04:05:30.575 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssl", 2024-09-21T04:05:30.575 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.575 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.575 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.575 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.575 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.575 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.576 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.576 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.576 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.576 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.576 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.576 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.576 INFO:teuthology.orchestra.run.smithi046.stdout: "ssl_server_port": { 2024-09-21T04:05:30.576 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssl_server_port", 2024-09-21T04:05:30.576 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.576 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.576 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.576 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8443", 2024-09-21T04:05:30.576 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.576 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.577 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.577 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.577 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.577 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.577 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.577 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.577 INFO:teuthology.orchestra.run.smithi046.stdout: "sso_oauth2": { 2024-09-21T04:05:30.577 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sso_oauth2", 2024-09-21T04:05:30.577 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.577 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.577 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.577 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.577 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.577 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.578 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.578 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.578 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.578 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.578 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.578 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.578 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_behaviour": { 2024-09-21T04:05:30.578 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_behaviour", 2024-09-21T04:05:30.578 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.578 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.578 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.578 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "redirect", 2024-09-21T04:05:30.578 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.578 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.579 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.579 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.579 INFO:teuthology.orchestra.run.smithi046.stdout: "redirect" 2024-09-21T04:05:30.579 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.579 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.579 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.579 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.579 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.579 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.579 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_error_status_code": { 2024-09-21T04:05:30.579 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_error_status_code", 2024-09-21T04:05:30.579 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.579 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.579 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.580 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "500", 2024-09-21T04:05:30.580 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "400", 2024-09-21T04:05:30.580 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "599", 2024-09-21T04:05:30.580 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.580 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.580 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.580 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.580 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.580 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.580 INFO:teuthology.orchestra.run.smithi046.stdout: "url_prefix": { 2024-09-21T04:05:30.580 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "url_prefix", 2024-09-21T04:05:30.580 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.580 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.580 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.581 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.581 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.581 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.581 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.581 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.581 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.581 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.581 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.581 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.581 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.581 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.581 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.581 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "devicehealth", 2024-09-21T04:05:30.581 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.582 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.582 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.582 INFO:teuthology.orchestra.run.smithi046.stdout: "enable_monitoring": { 2024-09-21T04:05:30.582 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enable_monitoring", 2024-09-21T04:05:30.582 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.582 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.582 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.582 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.582 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.582 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.582 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.582 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "monitor device health metrics", 2024-09-21T04:05:30.582 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.582 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.583 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.583 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.583 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.583 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.583 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.583 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.583 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.583 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.583 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.583 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.583 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.583 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.583 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.583 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.583 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.584 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.584 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.584 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.584 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.584 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.584 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.584 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.584 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.584 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.584 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.584 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.584 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.584 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.584 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.584 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.585 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.585 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.585 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.585 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.585 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.585 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.585 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.585 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.585 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.585 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.585 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.585 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.585 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.586 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.586 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.586 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.586 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.586 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.586 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.586 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.586 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.586 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.586 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.586 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.586 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.586 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.586 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.586 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.587 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.587 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.587 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.587 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.587 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.587 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.587 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.587 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.587 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.587 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.587 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.587 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.587 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.587 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.587 INFO:teuthology.orchestra.run.smithi046.stdout: "mark_out_threshold": { 2024-09-21T04:05:30.588 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mark_out_threshold", 2024-09-21T04:05:30.588 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:30.588 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.588 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.588 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "2419200", 2024-09-21T04:05:30.588 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.588 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.588 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.588 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T04:05:30.588 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.588 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.588 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.588 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.588 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_name": { 2024-09-21T04:05:30.589 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pool_name", 2024-09-21T04:05:30.589 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.589 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.589 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.589 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "device_health_metrics", 2024-09-21T04:05:30.589 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.589 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.589 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.589 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T04:05:30.589 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.589 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.589 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.589 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.589 INFO:teuthology.orchestra.run.smithi046.stdout: "retention_period": { 2024-09-21T04:05:30.590 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "retention_period", 2024-09-21T04:05:30.590 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:30.590 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.590 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.590 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "15552000", 2024-09-21T04:05:30.590 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.590 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.590 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.590 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how long to retain device health metrics", 2024-09-21T04:05:30.590 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.590 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.590 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.590 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.591 INFO:teuthology.orchestra.run.smithi046.stdout: "scrape_frequency": { 2024-09-21T04:05:30.591 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "scrape_frequency", 2024-09-21T04:05:30.591 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:30.591 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.591 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.591 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "86400", 2024-09-21T04:05:30.591 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.591 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.591 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.591 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T04:05:30.591 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.591 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.591 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.591 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.591 INFO:teuthology.orchestra.run.smithi046.stdout: "self_heal": { 2024-09-21T04:05:30.592 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "self_heal", 2024-09-21T04:05:30.592 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.592 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.592 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.592 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.592 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.592 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.592 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.592 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T04:05:30.592 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.592 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.592 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.592 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.592 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2024-09-21T04:05:30.592 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2024-09-21T04:05:30.593 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:30.593 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.593 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.593 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2024-09-21T04:05:30.593 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.593 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.593 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.593 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T04:05:30.593 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.593 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.593 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.593 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.593 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.594 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.594 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.594 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.594 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.594 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.594 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.594 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.594 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.594 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.594 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.594 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.594 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.594 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.594 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_threshold": { 2024-09-21T04:05:30.595 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_threshold", 2024-09-21T04:05:30.595 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:30.595 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.595 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.595 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "7257600", 2024-09-21T04:05:30.595 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.595 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.595 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.595 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T04:05:30.595 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.595 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.595 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.595 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.595 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.595 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.596 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.596 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "diskprediction_local", 2024-09-21T04:05:30.596 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.596 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.596 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.596 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.596 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.596 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.596 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.596 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.596 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.596 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.596 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.596 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.597 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.597 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.597 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.597 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.597 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.597 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.597 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.597 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.597 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.597 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.597 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.597 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.597 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.597 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.597 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.598 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.598 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.598 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.598 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.598 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.598 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.598 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.598 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.598 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.598 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.598 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.598 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.598 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.599 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.599 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.599 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.599 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.599 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.599 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.599 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.599 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.599 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.599 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.599 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.599 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.599 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.599 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.600 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.600 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.600 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.600 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.600 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.600 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.600 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.600 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.600 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.600 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.600 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.600 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.600 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.600 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.601 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.601 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.601 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.601 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.601 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.601 INFO:teuthology.orchestra.run.smithi046.stdout: "predict_interval": { 2024-09-21T04:05:30.601 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "predict_interval", 2024-09-21T04:05:30.601 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.601 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.601 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.601 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "86400", 2024-09-21T04:05:30.601 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.602 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.602 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.602 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.602 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.602 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.602 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.602 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.602 INFO:teuthology.orchestra.run.smithi046.stdout: "predictor_model": { 2024-09-21T04:05:30.602 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "predictor_model", 2024-09-21T04:05:30.602 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.602 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.602 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.602 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "prophetstor", 2024-09-21T04:05:30.603 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.603 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.603 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.603 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.603 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.603 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.603 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.603 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.603 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2024-09-21T04:05:30.603 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2024-09-21T04:05:30.603 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.603 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.603 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.603 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2024-09-21T04:05:30.604 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.604 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.604 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.604 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.604 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.604 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.604 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.604 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.604 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.604 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.604 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.604 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.604 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.605 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.605 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.605 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.605 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.605 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.605 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.605 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.605 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.605 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.605 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.605 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.605 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.605 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "influx", 2024-09-21T04:05:30.605 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": false, 2024-09-21T04:05:30.606 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "influxdb python module not found", 2024-09-21T04:05:30.606 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.606 INFO:teuthology.orchestra.run.smithi046.stdout: "batch_size": { 2024-09-21T04:05:30.606 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "batch_size", 2024-09-21T04:05:30.606 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.606 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.606 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.606 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5000", 2024-09-21T04:05:30.606 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.606 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.606 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.606 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T04:05:30.606 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.606 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.607 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.607 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.607 INFO:teuthology.orchestra.run.smithi046.stdout: "database": { 2024-09-21T04:05:30.607 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "database", 2024-09-21T04:05:30.607 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.607 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.607 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.607 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "ceph", 2024-09-21T04:05:30.607 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.607 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.607 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.607 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T04:05:30.607 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.607 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.608 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.608 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.608 INFO:teuthology.orchestra.run.smithi046.stdout: "hostname": { 2024-09-21T04:05:30.608 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "hostname", 2024-09-21T04:05:30.608 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.608 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.608 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.608 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.608 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.608 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.608 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.608 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "InfluxDB server hostname", 2024-09-21T04:05:30.608 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.608 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.609 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.609 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.609 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2024-09-21T04:05:30.609 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2024-09-21T04:05:30.609 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:30.609 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.609 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.609 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "30", 2024-09-21T04:05:30.609 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "5", 2024-09-21T04:05:30.609 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.609 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.609 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T04:05:30.609 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.609 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.610 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.610 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.610 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.610 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.610 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.610 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.610 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.610 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.610 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.610 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.610 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.610 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.610 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.610 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.611 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.611 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.611 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.611 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.611 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.611 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.611 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.611 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.611 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.611 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.611 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.611 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.611 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.611 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.611 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.612 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.612 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.612 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.612 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.612 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.612 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.612 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.612 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.612 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.612 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.612 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.612 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.612 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.612 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.613 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.613 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.613 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.613 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.613 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.613 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.613 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.613 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.613 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.613 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.613 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.613 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.613 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.613 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.613 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.614 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.614 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.614 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.614 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.614 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.614 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.614 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.614 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.614 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.614 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.614 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.614 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.614 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.614 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.615 INFO:teuthology.orchestra.run.smithi046.stdout: "password": { 2024-09-21T04:05:30.615 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "password", 2024-09-21T04:05:30.615 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.615 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.615 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.615 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.615 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.615 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.615 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.615 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "password of InfluxDB server user", 2024-09-21T04:05:30.615 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.615 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.615 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.615 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.615 INFO:teuthology.orchestra.run.smithi046.stdout: "port": { 2024-09-21T04:05:30.616 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "port", 2024-09-21T04:05:30.616 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.616 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.616 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.616 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8086", 2024-09-21T04:05:30.616 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.616 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.616 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.616 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "InfluxDB server port", 2024-09-21T04:05:30.616 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.616 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.616 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.616 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.616 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.617 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.617 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.617 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.617 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.617 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.617 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.617 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.617 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.617 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.617 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.617 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.617 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.617 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.617 INFO:teuthology.orchestra.run.smithi046.stdout: "ssl": { 2024-09-21T04:05:30.618 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssl", 2024-09-21T04:05:30.618 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.618 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.618 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.618 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "false", 2024-09-21T04:05:30.618 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.618 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.618 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.618 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T04:05:30.618 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.618 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.618 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.618 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.619 INFO:teuthology.orchestra.run.smithi046.stdout: "threads": { 2024-09-21T04:05:30.619 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "threads", 2024-09-21T04:05:30.619 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.619 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.619 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.619 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2024-09-21T04:05:30.619 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2024-09-21T04:05:30.619 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "32", 2024-09-21T04:05:30.619 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.619 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T04:05:30.619 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.619 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.619 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.620 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.620 INFO:teuthology.orchestra.run.smithi046.stdout: "username": { 2024-09-21T04:05:30.620 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "username", 2024-09-21T04:05:30.620 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.620 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.620 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.620 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.620 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.620 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.620 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.620 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "username of InfluxDB server user", 2024-09-21T04:05:30.620 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.620 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.621 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.621 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.621 INFO:teuthology.orchestra.run.smithi046.stdout: "verify_ssl": { 2024-09-21T04:05:30.621 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "verify_ssl", 2024-09-21T04:05:30.621 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.621 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.621 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.621 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "true", 2024-09-21T04:05:30.621 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.621 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.621 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.621 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T04:05:30.621 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.621 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.621 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.622 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.622 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.622 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.622 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.622 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "insights", 2024-09-21T04:05:30.622 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.622 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.622 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.622 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.622 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.622 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.622 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.622 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.622 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.623 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.623 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.623 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.623 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.623 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.623 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.623 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.623 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.623 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.623 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.623 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.623 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.623 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.623 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.624 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.624 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.624 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.624 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.624 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.624 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.624 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.624 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.624 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.624 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.624 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.624 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.624 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.625 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.625 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.625 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.625 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.625 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.625 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.625 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.625 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.625 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.625 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.625 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.625 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.625 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.625 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.625 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.626 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.626 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.626 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.626 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.626 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.626 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.626 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.626 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.626 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.626 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.626 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.626 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.626 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.627 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.627 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.627 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.627 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.627 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.627 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.627 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.627 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.627 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.627 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.627 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.627 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.627 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.628 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.628 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.628 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.628 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.628 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.628 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.628 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.628 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.628 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.628 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.628 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.628 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.628 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.628 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "iostat", 2024-09-21T04:05:30.629 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.629 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.629 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.629 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.629 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.629 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.629 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.629 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.629 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.629 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.629 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.629 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.629 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.629 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.630 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.630 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.630 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.630 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.630 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.630 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.630 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.630 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.630 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.630 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.630 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.630 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.630 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.630 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.631 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.631 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.631 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.631 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.631 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.631 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.631 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.631 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.631 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.631 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.631 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.631 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.631 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.631 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.632 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.632 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.632 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.632 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.632 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.632 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.632 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.632 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.632 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.632 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.632 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.632 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.632 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.632 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.633 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.633 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.633 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.633 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.633 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.633 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.633 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.633 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.633 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.633 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.633 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.633 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.633 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.634 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.634 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.634 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.634 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.634 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.634 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.634 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.634 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.634 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.634 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.634 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.634 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.634 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.635 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.635 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.635 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.635 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.635 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.635 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.635 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.635 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.635 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "k8sevents", 2024-09-21T04:05:30.635 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.635 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.635 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.635 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_event_retention_days": { 2024-09-21T04:05:30.635 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ceph_event_retention_days", 2024-09-21T04:05:30.636 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.636 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.636 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.636 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "7", 2024-09-21T04:05:30.636 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.636 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.636 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.636 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T04:05:30.636 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.636 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.636 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.636 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.636 INFO:teuthology.orchestra.run.smithi046.stdout: "config_check_secs": { 2024-09-21T04:05:30.637 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "config_check_secs", 2024-09-21T04:05:30.637 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.637 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.637 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.637 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-21T04:05:30.637 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "10", 2024-09-21T04:05:30.637 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.637 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.637 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T04:05:30.637 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.637 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.637 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.637 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.637 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.638 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.638 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.638 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.638 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.638 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.638 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.638 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.638 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.638 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.638 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.638 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.638 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.638 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.638 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.639 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.639 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.639 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.639 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.639 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.639 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.639 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.639 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.639 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.639 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.639 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.639 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.639 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.639 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.640 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.640 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.640 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.640 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.640 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.640 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.640 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.640 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.640 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.640 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.640 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.640 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.640 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.640 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.641 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.641 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.641 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.641 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.641 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.641 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.641 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.641 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.641 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.641 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.641 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.641 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.641 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.642 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.642 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.642 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.642 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.642 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.642 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.642 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.642 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.642 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.642 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.642 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.642 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.642 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.642 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.643 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.643 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.643 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.643 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.643 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.643 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.643 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.643 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.643 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.643 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.643 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.643 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.643 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.643 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.644 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.644 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.644 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.644 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "localpool", 2024-09-21T04:05:30.644 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.644 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.644 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.644 INFO:teuthology.orchestra.run.smithi046.stdout: "failure_domain": { 2024-09-21T04:05:30.644 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "failure_domain", 2024-09-21T04:05:30.644 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.644 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.644 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.644 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "host", 2024-09-21T04:05:30.645 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.645 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.645 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.645 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "failure domain for any created local pool", 2024-09-21T04:05:30.645 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T04:05:30.645 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.645 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.645 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.645 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.645 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.645 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.645 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.645 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.645 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.645 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.645 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.646 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.646 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.646 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.646 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.646 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.646 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.646 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.646 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.646 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.646 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.646 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.646 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.646 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.646 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.647 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.647 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.647 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.647 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.647 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.647 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.647 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.647 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.647 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.647 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.647 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.647 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.647 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.647 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.648 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.648 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.648 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.648 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.648 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.648 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.648 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.648 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.648 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.648 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.648 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.648 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.648 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.648 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.648 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.649 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.649 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.649 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.649 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.649 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.649 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.649 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.649 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.649 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.649 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.649 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.649 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.649 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.649 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.649 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.650 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.650 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.650 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.650 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.650 INFO:teuthology.orchestra.run.smithi046.stdout: "min_size": { 2024-09-21T04:05:30.650 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "min_size", 2024-09-21T04:05:30.650 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.650 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.650 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.650 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.650 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.650 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.650 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.651 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "default min_size for any created local pool", 2024-09-21T04:05:30.651 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T04:05:30.651 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.651 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.651 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.651 INFO:teuthology.orchestra.run.smithi046.stdout: "num_rep": { 2024-09-21T04:05:30.651 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "num_rep", 2024-09-21T04:05:30.651 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.651 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.651 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.651 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "3", 2024-09-21T04:05:30.651 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.651 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.651 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.652 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "default replica count for any created local pool", 2024-09-21T04:05:30.652 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.652 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.652 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.652 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.652 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num": { 2024-09-21T04:05:30.652 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pg_num", 2024-09-21T04:05:30.652 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.652 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.652 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.652 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "128", 2024-09-21T04:05:30.652 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.652 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.652 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.652 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T04:05:30.653 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.653 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.653 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.653 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.653 INFO:teuthology.orchestra.run.smithi046.stdout: "prefix": { 2024-09-21T04:05:30.653 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "prefix", 2024-09-21T04:05:30.653 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.653 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.653 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.653 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.653 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.653 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.653 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.653 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "name prefix for any created local pool", 2024-09-21T04:05:30.654 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.654 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.654 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.654 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.654 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.654 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.654 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.654 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.654 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.654 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.654 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.654 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.654 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.654 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.655 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.655 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.655 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.655 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.655 INFO:teuthology.orchestra.run.smithi046.stdout: "subtree": { 2024-09-21T04:05:30.655 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "subtree", 2024-09-21T04:05:30.655 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.655 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.655 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.655 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "rack", 2024-09-21T04:05:30.655 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.655 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.655 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.656 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T04:05:30.656 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T04:05:30.656 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.656 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.656 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.656 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.656 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.656 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.656 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mds_autoscaler", 2024-09-21T04:05:30.656 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.656 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.656 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.656 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.656 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.657 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.657 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.657 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.657 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.657 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.657 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.657 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.657 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.657 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.657 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.657 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.657 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.657 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.658 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.658 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.658 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.658 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.658 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.658 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.658 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.658 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.658 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.658 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.658 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.658 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.658 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.658 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.658 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.659 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.659 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.659 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.659 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.659 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.659 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.659 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.659 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.659 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.659 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.659 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.659 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.659 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.659 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.660 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.660 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.660 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.660 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.660 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.660 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.660 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.660 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.660 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.660 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.660 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.660 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.660 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.660 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.661 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.661 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.661 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.661 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.661 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.661 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.661 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.661 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.661 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.661 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.661 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.661 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.661 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.661 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.662 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.662 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.662 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.662 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.662 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.662 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.662 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.662 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.662 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.662 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.662 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.662 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.662 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.662 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.663 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.663 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mirroring", 2024-09-21T04:05:30.663 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.663 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.663 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.663 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.663 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.663 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.663 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.663 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.663 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.663 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.663 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.663 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.664 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.664 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.664 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.664 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.664 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.664 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.664 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.664 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.664 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.664 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.664 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.664 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.664 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.664 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.665 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.665 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.665 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.665 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.665 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.665 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.665 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.665 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.665 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.665 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.665 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.665 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.665 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.665 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.665 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.666 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.666 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.666 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.666 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.666 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.666 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.666 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.666 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.666 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.666 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.666 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.666 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.666 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.666 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.667 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.667 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.667 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.667 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.667 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.667 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.667 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.667 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.667 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.667 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.667 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.667 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.667 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.667 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.668 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.668 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.668 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.668 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.670 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.670 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.670 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.670 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.670 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.670 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.670 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.671 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.671 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.671 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.671 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.671 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.671 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.671 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.671 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.671 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.671 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.671 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "nfs", 2024-09-21T04:05:30.671 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.671 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.671 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.672 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.672 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.672 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.672 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.672 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.672 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.672 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.672 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.672 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.672 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.672 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.672 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.672 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.672 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.673 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.673 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.673 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.673 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.673 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.673 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.673 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.673 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.673 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.673 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.673 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.673 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.673 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.673 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.674 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.674 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.674 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.674 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.674 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.674 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.674 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.674 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.674 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.674 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.674 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.674 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.674 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.675 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.675 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.675 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.675 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.675 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.675 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.675 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.675 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.675 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.675 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.675 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.675 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.675 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.675 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.675 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.676 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.676 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.676 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.676 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.676 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.676 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.676 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.676 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.676 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.676 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.676 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.676 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.676 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.676 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.677 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.677 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.677 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.677 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.677 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.677 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.677 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.677 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.677 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.677 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.677 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.677 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.677 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.677 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.678 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.678 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.678 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.678 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "orchestrator", 2024-09-21T04:05:30.678 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.678 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.678 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.678 INFO:teuthology.orchestra.run.smithi046.stdout: "fail_fs": { 2024-09-21T04:05:30.678 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "fail_fs", 2024-09-21T04:05:30.678 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.678 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.678 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.678 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.678 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.679 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.679 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.679 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T04:05:30.679 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.679 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.679 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.679 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.679 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.679 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.679 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.679 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.679 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.679 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.679 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.680 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.680 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.680 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.680 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.680 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.680 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.680 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.680 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.680 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.680 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.680 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.680 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.680 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.680 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.681 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.681 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.681 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.681 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.681 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.681 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.681 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.681 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.681 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.681 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.681 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.681 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.681 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.682 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.682 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.682 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.682 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.682 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.682 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.682 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.682 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.682 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.682 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.682 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.682 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.682 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.682 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.683 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.683 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.683 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.683 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.683 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.683 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.683 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.683 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.683 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.683 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.683 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.683 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.683 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.683 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.684 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.684 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.684 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.684 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.684 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.684 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.684 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.684 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.684 INFO:teuthology.orchestra.run.smithi046.stdout: "orchestrator": { 2024-09-21T04:05:30.684 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "orchestrator", 2024-09-21T04:05:30.684 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.684 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.684 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.684 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.685 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.685 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.685 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.685 INFO:teuthology.orchestra.run.smithi046.stdout: "cephadm", 2024-09-21T04:05:30.685 INFO:teuthology.orchestra.run.smithi046.stdout: "rook", 2024-09-21T04:05:30.685 INFO:teuthology.orchestra.run.smithi046.stdout: "test_orchestrator" 2024-09-21T04:05:30.685 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.685 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Orchestrator backend", 2024-09-21T04:05:30.685 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.685 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.685 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.685 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.685 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.685 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.685 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.686 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.686 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.686 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.686 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.686 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.686 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.686 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.686 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.686 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.686 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.686 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.686 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.686 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.686 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.687 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "osd_perf_query", 2024-09-21T04:05:30.687 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.687 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.687 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.687 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.687 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.687 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.687 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.687 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.687 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.687 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.687 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.687 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.687 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.688 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.688 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.688 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.688 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.688 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.688 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.688 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.688 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.688 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.688 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.688 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.688 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.688 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.688 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.689 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.689 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.689 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.689 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.689 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.689 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.689 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.689 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.689 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.689 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.689 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.689 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.689 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.689 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.689 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.690 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.690 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.690 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.690 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.690 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.690 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.690 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.690 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.690 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.690 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.690 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.690 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.690 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.690 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.691 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.691 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.691 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.691 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.691 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.691 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.691 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.691 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.691 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.691 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.691 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.691 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.691 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.692 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.692 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.692 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.692 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.692 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.692 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.692 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.692 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.692 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.692 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.692 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.692 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.692 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.692 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.693 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.693 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.693 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.693 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.693 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.693 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.693 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.693 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "osd_support", 2024-09-21T04:05:30.693 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.693 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.693 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.693 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.693 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.693 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.694 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.694 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.694 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.694 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.694 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.694 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.694 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.694 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.694 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.694 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.694 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.694 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.694 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.694 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.695 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.695 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.695 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.695 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.695 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.695 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.695 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.695 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.695 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.695 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.695 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.695 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.695 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.695 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.696 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.696 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.696 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.696 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.696 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.696 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.696 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.696 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.696 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.696 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.696 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.696 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.696 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.696 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.697 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.697 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.697 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.697 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.697 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.697 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.697 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.697 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.697 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.697 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.697 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.697 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.697 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.697 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.698 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.698 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.698 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.698 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.698 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.698 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.698 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.698 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.698 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.698 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.698 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.698 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.698 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.698 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.699 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.699 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.699 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.699 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.699 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.699 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.699 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.699 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.699 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.699 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.699 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.699 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.699 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.699 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.700 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pg_autoscaler", 2024-09-21T04:05:30.700 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.700 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.700 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.700 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.700 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.700 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.700 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.700 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.700 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.700 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.700 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.700 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.700 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.701 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.701 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.701 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.701 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.701 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.701 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.701 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.701 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.701 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.701 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.701 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.701 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.701 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.701 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.701 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.702 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.702 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.702 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.702 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.702 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.702 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.702 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.702 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.702 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.702 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.702 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.702 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.702 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.702 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.703 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.703 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.703 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.703 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.703 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.703 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.703 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.703 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.703 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.703 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.703 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.703 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.703 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.703 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.704 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.704 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.704 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.704 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.704 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.704 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.704 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.704 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.704 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.704 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.704 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.704 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.704 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.704 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.705 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.705 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.705 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.705 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2024-09-21T04:05:30.705 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2024-09-21T04:05:30.705 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:30.705 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.705 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.705 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2024-09-21T04:05:30.705 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.705 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.705 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.705 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.705 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.706 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.706 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.706 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.706 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.706 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.706 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.706 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.706 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.706 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.706 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.706 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.706 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.706 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.706 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.707 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.707 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.707 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.707 INFO:teuthology.orchestra.run.smithi046.stdout: "threshold": { 2024-09-21T04:05:30.707 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "threshold", 2024-09-21T04:05:30.707 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-21T04:05:30.707 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.707 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.707 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "3.0", 2024-09-21T04:05:30.707 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1.0", 2024-09-21T04:05:30.707 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.707 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.707 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "scaling threshold", 2024-09-21T04:05:30.707 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T04:05:30.708 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.708 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.708 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.708 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.708 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.708 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.708 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "progress", 2024-09-21T04:05:30.708 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.708 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.708 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.708 INFO:teuthology.orchestra.run.smithi046.stdout: "allow_pg_recovery_event": { 2024-09-21T04:05:30.708 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "allow_pg_recovery_event", 2024-09-21T04:05:30.708 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.708 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.709 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.709 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.709 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.709 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.709 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.709 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T04:05:30.709 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.709 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.709 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.709 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.709 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": { 2024-09-21T04:05:30.709 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enabled", 2024-09-21T04:05:30.709 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.709 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.709 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.710 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.710 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.710 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.710 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.710 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.710 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.710 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.710 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.710 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.710 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.710 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.710 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.710 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.711 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.711 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.711 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.711 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.711 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.711 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.711 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.711 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.711 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.711 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.711 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.711 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.711 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.711 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.711 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.712 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.712 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.712 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.712 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.712 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.712 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.712 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.712 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.712 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.712 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.712 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.712 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.712 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.712 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.713 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.713 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.713 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.713 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.713 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.713 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.713 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.713 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.713 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.713 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.713 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.713 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.713 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.714 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.714 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.714 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.714 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.714 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.714 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.714 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.714 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.714 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.714 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.714 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.714 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.714 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.714 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.715 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.715 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.715 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.715 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.715 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.715 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.715 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.715 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.715 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.715 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.715 INFO:teuthology.orchestra.run.smithi046.stdout: "max_completed_events": { 2024-09-21T04:05:30.715 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_completed_events", 2024-09-21T04:05:30.715 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.715 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.716 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.716 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "50", 2024-09-21T04:05:30.716 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.716 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.716 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.716 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "number of past completed events to remember", 2024-09-21T04:05:30.716 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.716 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.716 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.716 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.716 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2024-09-21T04:05:30.716 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2024-09-21T04:05:30.716 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:30.716 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.717 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.717 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2024-09-21T04:05:30.717 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.717 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.717 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.717 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how long the module is going to sleep", 2024-09-21T04:05:30.717 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.717 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.717 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.717 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.717 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.717 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.717 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.717 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.718 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.718 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.718 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.718 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.718 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.718 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.718 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.718 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.718 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.718 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.718 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.718 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.718 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.718 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "prometheus", 2024-09-21T04:05:30.719 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.719 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.719 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.719 INFO:teuthology.orchestra.run.smithi046.stdout: "cache": { 2024-09-21T04:05:30.719 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cache", 2024-09-21T04:05:30.719 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.719 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.719 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.719 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.719 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.719 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.719 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.719 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.719 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.720 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.720 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.720 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.720 INFO:teuthology.orchestra.run.smithi046.stdout: "exclude_perf_counters": { 2024-09-21T04:05:30.720 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "exclude_perf_counters", 2024-09-21T04:05:30.720 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.720 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.720 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.720 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.720 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.720 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.720 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.720 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T04:05:30.720 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T04:05:30.721 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.721 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.721 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.721 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.721 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.721 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.721 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.721 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.721 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.721 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.721 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.721 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.721 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.721 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.721 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.722 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.722 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.722 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.722 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.722 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.722 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.722 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.722 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.722 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.722 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.722 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.722 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.722 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.723 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.723 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.723 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.723 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.723 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.723 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.723 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.723 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.723 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.723 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.723 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.723 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.723 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.724 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.724 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.724 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.724 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.724 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.724 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.724 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.724 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.724 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.724 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.724 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.724 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.724 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.724 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.725 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.725 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.725 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.725 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.725 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.725 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.725 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.725 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.725 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.725 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.725 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.725 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.725 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.725 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.726 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.726 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.726 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.726 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.726 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_stats_pools": { 2024-09-21T04:05:30.726 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rbd_stats_pools", 2024-09-21T04:05:30.726 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.726 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.726 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.726 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.726 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.726 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.726 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.727 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.727 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.727 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.727 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.727 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.727 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T04:05:30.727 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T04:05:30.727 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.727 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.727 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.727 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "300", 2024-09-21T04:05:30.727 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.727 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.727 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.728 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.728 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.728 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.728 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.728 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.728 INFO:teuthology.orchestra.run.smithi046.stdout: "scrape_interval": { 2024-09-21T04:05:30.728 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "scrape_interval", 2024-09-21T04:05:30.728 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-21T04:05:30.728 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.728 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.728 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "15.0", 2024-09-21T04:05:30.728 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.728 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.728 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.729 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.729 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.729 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.729 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.729 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.729 INFO:teuthology.orchestra.run.smithi046.stdout: "server_addr": { 2024-09-21T04:05:30.729 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_addr", 2024-09-21T04:05:30.729 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.729 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.729 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.729 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "::", 2024-09-21T04:05:30.729 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.729 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.729 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.730 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T04:05:30.730 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.730 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.730 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.730 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.730 INFO:teuthology.orchestra.run.smithi046.stdout: "server_port": { 2024-09-21T04:05:30.730 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_port", 2024-09-21T04:05:30.730 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.730 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.730 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.730 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "9283", 2024-09-21T04:05:30.730 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.730 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.730 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.731 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T04:05:30.731 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.731 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.731 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.731 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.731 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.731 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.731 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.731 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.731 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.731 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.731 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.731 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.731 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.732 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.732 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.732 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.732 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.732 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.732 INFO:teuthology.orchestra.run.smithi046.stdout: "stale_cache_strategy": { 2024-09-21T04:05:30.732 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "stale_cache_strategy", 2024-09-21T04:05:30.732 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.732 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.732 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.732 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "log", 2024-09-21T04:05:30.732 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.732 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.732 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.733 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.733 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.733 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.733 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.733 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.733 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_behaviour": { 2024-09-21T04:05:30.733 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_behaviour", 2024-09-21T04:05:30.733 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.733 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.733 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.733 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "default", 2024-09-21T04:05:30.733 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.733 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.733 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.734 INFO:teuthology.orchestra.run.smithi046.stdout: "default", 2024-09-21T04:05:30.734 INFO:teuthology.orchestra.run.smithi046.stdout: "error" 2024-09-21T04:05:30.734 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.734 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.734 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.734 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.734 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.734 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.734 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_error_status_code": { 2024-09-21T04:05:30.734 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_error_status_code", 2024-09-21T04:05:30.734 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.734 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.734 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.735 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "500", 2024-09-21T04:05:30.735 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "400", 2024-09-21T04:05:30.735 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "599", 2024-09-21T04:05:30.735 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.735 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.735 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.735 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.735 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.735 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.735 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.735 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.735 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.735 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rbd_support", 2024-09-21T04:05:30.735 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.736 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.736 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.736 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.736 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.736 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.736 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.736 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.736 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.736 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.736 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.736 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.736 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.736 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.736 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.736 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.737 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.737 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.737 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.737 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.737 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.737 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.737 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.737 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.737 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.737 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.737 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.737 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.737 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.737 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.738 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.738 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.738 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.738 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.738 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.738 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.738 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.738 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.738 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.738 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.738 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.738 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.738 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.739 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.739 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.739 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.739 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.739 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.739 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.739 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.739 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.739 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.739 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.739 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.739 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.739 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.739 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.740 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.740 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.740 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.740 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.740 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.740 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.740 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.740 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.740 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.740 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.740 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.740 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.740 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.740 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.741 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.741 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.741 INFO:teuthology.orchestra.run.smithi046.stdout: "max_concurrent_snap_create": { 2024-09-21T04:05:30.741 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_concurrent_snap_create", 2024-09-21T04:05:30.741 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.741 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.741 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.741 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-21T04:05:30.741 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.741 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.741 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.741 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.741 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.741 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.742 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.742 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.742 INFO:teuthology.orchestra.run.smithi046.stdout: "mirror_snapshot_schedule": { 2024-09-21T04:05:30.742 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T04:05:30.742 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.742 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.742 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.742 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.742 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.742 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.742 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.742 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.742 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.742 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.743 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.743 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.743 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.743 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.743 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.743 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.743 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.743 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.743 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.743 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.743 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.743 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.743 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.744 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.744 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.744 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.744 INFO:teuthology.orchestra.run.smithi046.stdout: "trash_purge_schedule": { 2024-09-21T04:05:30.744 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "trash_purge_schedule", 2024-09-21T04:05:30.744 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.744 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.744 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.744 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.744 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.744 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.744 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.744 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.744 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.745 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.745 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.745 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.745 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.745 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.745 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.745 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "restful", 2024-09-21T04:05:30.745 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.745 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.745 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.745 INFO:teuthology.orchestra.run.smithi046.stdout: "enable_auth": { 2024-09-21T04:05:30.745 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enable_auth", 2024-09-21T04:05:30.745 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.746 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.746 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.746 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.746 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.746 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.746 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.746 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.746 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.746 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.746 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.746 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.746 INFO:teuthology.orchestra.run.smithi046.stdout: "key_file": { 2024-09-21T04:05:30.746 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "key_file", 2024-09-21T04:05:30.747 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.747 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.747 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.747 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.747 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.747 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.747 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.747 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.747 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.747 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.747 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.747 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.747 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.747 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.748 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.748 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.748 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.748 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.748 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.748 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.748 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.748 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.748 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.748 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.748 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.748 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.748 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.748 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.749 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.749 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.749 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.749 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.749 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.749 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.749 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.749 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.749 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.749 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.749 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.749 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.749 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.749 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.750 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.750 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.750 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.750 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.750 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.750 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.750 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.750 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.750 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.750 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.750 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.750 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.750 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.750 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.751 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.751 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.751 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.751 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.751 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.751 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.751 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.751 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.751 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.751 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.751 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.751 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.751 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.751 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.752 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.752 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.752 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.752 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.752 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.752 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.752 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.752 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.752 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.752 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.752 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.752 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.752 INFO:teuthology.orchestra.run.smithi046.stdout: "max_requests": { 2024-09-21T04:05:30.752 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_requests", 2024-09-21T04:05:30.753 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.753 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.753 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.753 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "500", 2024-09-21T04:05:30.753 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.753 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.753 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.753 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T04:05:30.753 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.753 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.753 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.753 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.753 INFO:teuthology.orchestra.run.smithi046.stdout: "server_addr": { 2024-09-21T04:05:30.753 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_addr", 2024-09-21T04:05:30.754 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.754 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.754 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.754 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.754 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.754 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.754 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.754 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.754 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.754 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.754 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.754 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.754 INFO:teuthology.orchestra.run.smithi046.stdout: "server_port": { 2024-09-21T04:05:30.755 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_port", 2024-09-21T04:05:30.755 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.755 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.755 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.755 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.755 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.755 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.755 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.755 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.755 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.755 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.755 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.755 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.756 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.756 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.756 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.756 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.756 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.756 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.756 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.756 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.756 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.756 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.756 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.756 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.756 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.756 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.757 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.757 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.757 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.757 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rgw", 2024-09-21T04:05:30.757 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.757 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.757 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.757 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.757 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.757 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.757 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.757 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.757 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.757 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.758 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.758 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.758 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.758 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.758 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.758 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.758 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.758 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.758 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.758 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.758 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.758 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.758 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.759 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.759 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.759 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.759 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.759 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.759 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.759 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.759 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.759 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.759 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.759 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.759 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.759 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.759 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.760 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.760 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.760 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.760 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.760 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.760 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.760 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.760 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.760 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.760 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.760 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.760 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.760 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.760 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.761 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.761 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.761 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.761 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.761 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.761 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.761 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.761 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.761 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.761 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.761 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.761 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.761 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.761 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.761 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.762 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.762 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.762 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.762 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.762 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.762 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.762 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.762 INFO:teuthology.orchestra.run.smithi046.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T04:05:30.762 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T04:05:30.762 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.762 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.762 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.762 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2024-09-21T04:05:30.762 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.763 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.763 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.763 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T04:05:30.763 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.763 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.763 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.763 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.763 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.763 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.763 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.763 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.763 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.763 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.764 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.764 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.764 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.764 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.764 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.764 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.764 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.764 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.764 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.764 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.764 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.764 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rook", 2024-09-21T04:05:30.764 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.764 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.765 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.765 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.765 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.765 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.765 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.765 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.765 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.765 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.765 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.765 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.765 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.765 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.765 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.765 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.766 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.766 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.766 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.766 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.766 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.766 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.766 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.766 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.766 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.766 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.766 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.766 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.766 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.766 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.767 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.767 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.767 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.767 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.767 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.767 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.767 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.767 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.767 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.767 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.767 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.767 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.767 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.767 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.768 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.768 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.768 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.768 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.768 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.768 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.768 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.768 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.768 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.768 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.768 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.768 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.768 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.768 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.769 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.769 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.769 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.769 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.769 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.769 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.769 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.769 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.769 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.769 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.769 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.769 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.769 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.769 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.770 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.770 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.770 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.770 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.770 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.770 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.770 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.770 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.770 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.770 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.770 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.770 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.770 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.770 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.771 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.771 INFO:teuthology.orchestra.run.smithi046.stdout: "storage_class": { 2024-09-21T04:05:30.771 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "storage_class", 2024-09-21T04:05:30.771 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.771 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.771 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.771 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "local", 2024-09-21T04:05:30.771 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.771 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.771 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.771 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T04:05:30.771 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.771 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.771 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.772 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.772 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.772 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.772 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.772 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "selftest", 2024-09-21T04:05:30.772 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.772 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.772 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.772 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.772 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.772 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.772 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.772 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.772 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.773 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.773 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.773 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.773 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.773 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.773 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.773 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.773 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.773 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.773 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.773 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.773 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.773 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.774 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.774 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.774 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.774 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.774 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.774 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.774 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.774 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.774 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.774 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.774 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.774 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.774 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.775 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.775 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.775 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.775 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.775 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.775 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.775 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.775 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.775 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.775 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.775 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.775 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.775 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.775 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.776 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.776 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.776 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.776 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.776 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.776 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.776 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.776 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.776 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.776 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.776 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.776 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.776 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.776 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.777 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.777 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.777 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.777 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.777 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.777 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.777 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.777 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.777 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.777 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.777 INFO:teuthology.orchestra.run.smithi046.stdout: "roption1": { 2024-09-21T04:05:30.777 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "roption1", 2024-09-21T04:05:30.777 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.778 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.778 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.778 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.778 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.778 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.778 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.778 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.778 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.778 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.778 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.778 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.778 INFO:teuthology.orchestra.run.smithi046.stdout: "roption2": { 2024-09-21T04:05:30.778 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "roption2", 2024-09-21T04:05:30.779 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.779 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.779 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.779 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "xyz", 2024-09-21T04:05:30.779 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.779 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.779 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.779 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.779 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.779 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.779 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.779 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.779 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption1": { 2024-09-21T04:05:30.779 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption1", 2024-09-21T04:05:30.780 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.780 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.780 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.780 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.780 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.780 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.780 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.780 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.780 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.780 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.780 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.780 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.780 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption2": { 2024-09-21T04:05:30.780 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption2", 2024-09-21T04:05:30.781 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.781 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.781 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.781 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.781 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.781 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.781 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.781 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.781 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.781 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.781 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.781 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.781 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption3": { 2024-09-21T04:05:30.781 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption3", 2024-09-21T04:05:30.782 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-21T04:05:30.782 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.782 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.782 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.782 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.782 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.782 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.782 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.782 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.782 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.782 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.782 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.782 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption4": { 2024-09-21T04:05:30.783 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption4", 2024-09-21T04:05:30.783 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.783 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.783 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.783 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.783 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.783 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.783 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.783 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.783 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.783 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.783 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.783 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.783 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption5": { 2024-09-21T04:05:30.783 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption5", 2024-09-21T04:05:30.784 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.784 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.784 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.784 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.784 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.784 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.784 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.784 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.784 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.784 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.784 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.784 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.784 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption6": { 2024-09-21T04:05:30.784 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption6", 2024-09-21T04:05:30.785 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.785 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.785 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.785 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.785 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.785 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.785 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.785 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.785 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.785 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.785 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.785 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.785 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption7": { 2024-09-21T04:05:30.785 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption7", 2024-09-21T04:05:30.786 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.786 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.786 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.786 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.786 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2024-09-21T04:05:30.786 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "42", 2024-09-21T04:05:30.786 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.786 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.786 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.786 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.786 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.786 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.786 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.786 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.787 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.787 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.787 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.787 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.787 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.787 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.787 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.787 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.787 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.787 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.787 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.787 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.787 INFO:teuthology.orchestra.run.smithi046.stdout: "testkey": { 2024-09-21T04:05:30.787 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "testkey", 2024-09-21T04:05:30.788 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.788 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.788 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.788 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.788 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.788 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.788 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.788 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.788 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.788 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.788 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.788 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.788 INFO:teuthology.orchestra.run.smithi046.stdout: "testlkey": { 2024-09-21T04:05:30.788 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "testlkey", 2024-09-21T04:05:30.789 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.789 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.789 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.789 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.789 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.789 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.789 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.789 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.789 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.789 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.789 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.789 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.789 INFO:teuthology.orchestra.run.smithi046.stdout: "testnewline": { 2024-09-21T04:05:30.789 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "testnewline", 2024-09-21T04:05:30.790 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.790 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.790 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.790 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.790 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.790 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.790 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.790 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.790 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.790 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.790 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.790 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.790 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.791 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.791 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.791 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smb", 2024-09-21T04:05:30.791 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.791 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.791 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.791 INFO:teuthology.orchestra.run.smithi046.stdout: "internal_store_backend": { 2024-09-21T04:05:30.791 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "internal_store_backend", 2024-09-21T04:05:30.791 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.791 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.791 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.791 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.791 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.791 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.792 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.792 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T04:05:30.792 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.792 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.792 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.792 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.792 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.792 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.792 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.792 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.792 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.792 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.792 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.792 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.793 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.793 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.793 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.793 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.793 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.793 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.793 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.793 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.793 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.793 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.793 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.793 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.793 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.793 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.794 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.794 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.794 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.794 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.794 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.794 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.794 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.794 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.794 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.794 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.794 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.794 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.794 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.794 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.795 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.795 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.795 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.795 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.795 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.795 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.795 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.795 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.795 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.795 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.795 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.795 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.795 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.796 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.796 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.796 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.796 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.796 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.796 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.796 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.796 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.796 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.796 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.796 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.796 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.796 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.796 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.796 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.797 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.797 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.797 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.797 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.797 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.797 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.797 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.797 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.797 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.797 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.797 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.797 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.797 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.797 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.798 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.798 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.798 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.798 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.798 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.798 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.798 INFO:teuthology.orchestra.run.smithi046.stdout: "update_orchestration": { 2024-09-21T04:05:30.798 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "update_orchestration", 2024-09-21T04:05:30.798 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.798 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.798 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.798 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.798 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.798 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.799 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.799 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T04:05:30.799 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.799 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.799 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.799 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.799 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.799 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.799 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.799 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "snap_schedule", 2024-09-21T04:05:30.799 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.799 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.799 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.800 INFO:teuthology.orchestra.run.smithi046.stdout: "allow_m_granularity": { 2024-09-21T04:05:30.800 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "allow_m_granularity", 2024-09-21T04:05:30.800 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.800 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.800 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.800 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.800 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.800 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.800 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.800 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T04:05:30.800 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.800 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.800 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.800 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.800 INFO:teuthology.orchestra.run.smithi046.stdout: "dump_on_update": { 2024-09-21T04:05:30.801 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "dump_on_update", 2024-09-21T04:05:30.801 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.801 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.801 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.801 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.801 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.801 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.801 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.801 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "dump database to debug log on update", 2024-09-21T04:05:30.801 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.801 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.801 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.801 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.801 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.802 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.802 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.802 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.802 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.802 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.802 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.802 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.802 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.802 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.802 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.802 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.802 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.802 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.802 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.803 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.803 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.803 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.803 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.803 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.803 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.803 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.803 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.803 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.803 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.803 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.803 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.803 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.803 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.804 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.804 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.804 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.804 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.804 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.804 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.804 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.804 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.804 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.804 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.804 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.804 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.804 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.804 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.805 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.805 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.805 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.805 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.805 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.805 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.805 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.805 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.805 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.805 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.805 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.805 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.805 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.805 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.806 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.806 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.806 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.806 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.806 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.806 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.806 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.806 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.806 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.806 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.806 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.806 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.806 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.807 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.807 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.807 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.807 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.807 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.807 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.807 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.807 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.807 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.807 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.807 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.807 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.807 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.807 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.807 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.808 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.808 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.808 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "stats", 2024-09-21T04:05:30.808 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.808 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.808 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.808 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.808 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.808 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.808 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.808 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.808 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.808 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.809 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.809 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.809 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.809 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.809 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.809 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.809 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.809 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.809 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.809 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.809 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.809 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.809 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.809 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.810 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.810 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.810 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.810 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.810 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.810 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.810 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.810 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.810 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.810 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.810 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.810 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.810 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.811 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.811 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.811 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.811 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.811 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.811 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.811 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.811 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.811 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.811 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.811 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.811 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.811 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.811 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.812 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.812 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.812 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.812 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.812 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.812 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.812 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.812 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.812 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.812 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.812 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.812 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.812 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.812 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.813 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.813 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.813 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.813 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.813 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.813 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.813 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.813 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.813 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.813 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.813 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.813 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.813 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.814 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.814 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.814 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.814 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.814 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.814 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.814 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.814 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.814 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.814 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.814 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.814 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.814 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "status", 2024-09-21T04:05:30.814 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.815 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.815 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.815 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.815 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.815 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.815 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.815 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.815 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.815 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.815 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.815 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.815 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.815 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.815 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.816 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.816 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.816 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.816 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.816 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.816 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.816 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.816 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.816 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.816 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.816 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.816 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.816 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.817 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.817 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.817 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.817 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.817 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.817 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.817 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.817 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.817 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.817 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.817 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.817 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.817 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.817 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.817 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.818 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.818 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.818 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.818 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.818 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.818 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.818 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.818 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.818 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.818 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.818 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.818 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.818 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.819 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.819 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.819 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.819 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.819 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.819 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.819 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.819 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.819 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.819 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.819 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.819 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.819 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.819 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.820 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.820 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.820 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.820 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.820 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.820 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.820 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.820 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.820 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.820 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.820 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.820 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.820 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.820 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.821 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.821 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.821 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.821 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.821 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.821 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.821 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "telegraf", 2024-09-21T04:05:30.821 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.821 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.821 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.821 INFO:teuthology.orchestra.run.smithi046.stdout: "address": { 2024-09-21T04:05:30.821 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "address", 2024-09-21T04:05:30.821 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.821 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.822 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.822 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T04:05:30.822 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.822 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.822 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.822 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.822 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.822 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.822 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.822 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.822 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2024-09-21T04:05:30.822 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2024-09-21T04:05:30.822 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:30.822 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.823 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.823 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "15", 2024-09-21T04:05:30.823 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.823 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.823 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.823 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.823 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.823 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.823 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.823 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.823 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.823 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.823 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.823 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.824 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.824 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.824 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.824 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.824 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.824 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.824 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.824 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.824 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.824 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.824 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.824 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.824 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.824 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.825 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.825 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.825 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.825 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.825 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.825 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.825 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.825 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.825 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.825 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.825 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.825 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.825 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.826 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.826 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.826 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.826 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.826 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.826 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.826 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.826 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.826 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.826 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.826 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.826 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.826 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.827 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.827 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.827 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.827 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.827 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.827 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.827 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.827 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.827 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.827 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.827 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.827 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.827 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.827 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.828 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.828 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.828 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.828 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.828 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.828 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.828 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.828 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.828 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.828 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.828 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.828 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.828 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.829 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.829 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.829 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.829 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.829 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.829 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.829 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.829 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.829 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.829 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.829 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.829 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.829 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.829 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.830 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.830 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.830 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "telemetry", 2024-09-21T04:05:30.830 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.830 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.830 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.830 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_basic": { 2024-09-21T04:05:30.830 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_basic", 2024-09-21T04:05:30.830 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.830 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.830 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.830 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.830 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.831 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.831 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.831 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T04:05:30.831 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.831 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.831 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.831 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.831 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_crash": { 2024-09-21T04:05:30.831 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_crash", 2024-09-21T04:05:30.831 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.831 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.831 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.831 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.831 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.832 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.832 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.832 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T04:05:30.832 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.832 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.832 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.832 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.832 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_device": { 2024-09-21T04:05:30.832 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_device", 2024-09-21T04:05:30.832 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.832 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.832 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.832 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.832 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.833 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.833 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.833 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T04:05:30.833 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.833 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.833 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.833 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.833 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_ident": { 2024-09-21T04:05:30.833 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_ident", 2024-09-21T04:05:30.833 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.833 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.833 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.833 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.833 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.834 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.834 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.834 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T04:05:30.834 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.834 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.834 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.834 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.834 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_perf": { 2024-09-21T04:05:30.834 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_perf", 2024-09-21T04:05:30.834 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.834 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.834 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.834 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.834 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.835 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.835 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.835 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T04:05:30.835 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.835 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.835 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.835 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.835 INFO:teuthology.orchestra.run.smithi046.stdout: "contact": { 2024-09-21T04:05:30.835 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "contact", 2024-09-21T04:05:30.835 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.835 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.835 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.835 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.835 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.836 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.836 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.836 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.836 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.836 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.836 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.836 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.836 INFO:teuthology.orchestra.run.smithi046.stdout: "description": { 2024-09-21T04:05:30.836 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "description", 2024-09-21T04:05:30.836 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.836 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.836 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.836 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.837 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.837 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.837 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.837 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.837 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.837 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.837 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.837 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.837 INFO:teuthology.orchestra.run.smithi046.stdout: "device_url": { 2024-09-21T04:05:30.837 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "device_url", 2024-09-21T04:05:30.837 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.837 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.837 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.837 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T04:05:30.838 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.838 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.838 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.838 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.838 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.838 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.838 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.838 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.838 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": { 2024-09-21T04:05:30.838 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enabled", 2024-09-21T04:05:30.838 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.838 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.838 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.838 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.839 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.839 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.839 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.839 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.839 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.839 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.839 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.839 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.839 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2024-09-21T04:05:30.839 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2024-09-21T04:05:30.839 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.839 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.839 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.839 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "24", 2024-09-21T04:05:30.840 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "8", 2024-09-21T04:05:30.840 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.840 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.840 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.840 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.840 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.840 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.840 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.840 INFO:teuthology.orchestra.run.smithi046.stdout: "last_opt_revision": { 2024-09-21T04:05:30.840 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "last_opt_revision", 2024-09-21T04:05:30.840 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.840 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.840 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.840 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "1", 2024-09-21T04:05:30.841 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.841 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.841 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.841 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.841 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.841 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.841 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.841 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.841 INFO:teuthology.orchestra.run.smithi046.stdout: "leaderboard": { 2024-09-21T04:05:30.841 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "leaderboard", 2024-09-21T04:05:30.841 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.841 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.841 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.841 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.842 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.842 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.842 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.842 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.842 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.842 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.842 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.842 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.842 INFO:teuthology.orchestra.run.smithi046.stdout: "leaderboard_description": { 2024-09-21T04:05:30.842 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "leaderboard_description", 2024-09-21T04:05:30.842 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.842 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.842 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.842 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.843 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.843 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.843 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.843 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.843 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.843 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.843 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.843 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.843 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.843 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.843 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.843 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.843 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.843 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.844 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.844 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.844 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.844 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.844 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.844 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.844 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.844 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.844 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.844 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.844 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.844 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.844 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.845 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.845 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.845 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.845 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.845 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.845 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.845 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.845 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.845 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.845 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.845 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.845 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.845 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.845 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.846 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.846 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.846 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.846 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.846 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.846 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.846 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.846 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.846 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.846 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.846 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.846 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.846 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.846 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.847 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.847 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.847 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.847 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.847 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.847 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.847 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.847 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.847 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.847 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.847 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.847 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.847 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.848 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.848 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.848 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.848 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.848 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.848 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.848 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.848 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.848 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.848 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.848 INFO:teuthology.orchestra.run.smithi046.stdout: "organization": { 2024-09-21T04:05:30.848 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "organization", 2024-09-21T04:05:30.848 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.848 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.848 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.849 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.849 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.849 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.849 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.849 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.849 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.849 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.849 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.849 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.849 INFO:teuthology.orchestra.run.smithi046.stdout: "proxy": { 2024-09-21T04:05:30.849 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "proxy", 2024-09-21T04:05:30.849 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.849 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.849 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.850 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.850 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.850 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.850 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.850 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.850 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.850 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.850 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.850 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.850 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.850 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.850 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.850 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.850 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.851 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.851 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.851 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.851 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.851 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.851 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.851 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.851 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.851 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.851 INFO:teuthology.orchestra.run.smithi046.stdout: "url": { 2024-09-21T04:05:30.851 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "url", 2024-09-21T04:05:30.851 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.851 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.852 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.852 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T04:05:30.852 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.852 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.852 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.852 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.852 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.852 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.852 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.852 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.852 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.852 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.852 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.852 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "test_orchestrator", 2024-09-21T04:05:30.852 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.853 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.853 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.853 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.853 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.853 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.853 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.853 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.853 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.853 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.853 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.853 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.853 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.853 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.853 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.854 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.854 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.854 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.854 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.854 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.854 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.854 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.854 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.854 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.854 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.854 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.854 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.854 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.854 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.855 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.855 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.855 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.855 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.855 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.855 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.855 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.855 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.855 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.855 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.855 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.855 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.855 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.855 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.856 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.856 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.856 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.856 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.856 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.856 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.856 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.856 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.856 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.856 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.856 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.856 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.856 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.856 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.856 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.857 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.857 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.857 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.857 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.857 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.857 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.857 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.857 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.857 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.857 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.857 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.857 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.857 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.857 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.858 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.858 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.858 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.858 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.858 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.858 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.858 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.858 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.858 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.858 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.858 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.858 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.858 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.859 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.859 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.859 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.859 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.859 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.859 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "volumes", 2024-09-21T04:05:30.859 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.859 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.859 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.859 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.859 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.859 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.859 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.859 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.859 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.860 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.860 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.860 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.860 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.860 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.860 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.860 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.860 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.860 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.860 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.860 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.860 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.860 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.860 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.861 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.861 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.861 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.861 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.861 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.861 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.861 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.861 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.861 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.861 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.861 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.861 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.861 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.861 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.862 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.862 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.862 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.862 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.862 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.862 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.862 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.862 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.862 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.862 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.862 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.862 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.862 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.862 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.863 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.863 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.863 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.863 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.863 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.863 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.863 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.863 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.863 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.863 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.863 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.863 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.863 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.863 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.864 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.864 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.864 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.864 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.864 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.864 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.864 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.864 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.864 INFO:teuthology.orchestra.run.smithi046.stdout: "max_concurrent_clones": { 2024-09-21T04:05:30.864 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_concurrent_clones", 2024-09-21T04:05:30.864 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.864 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.864 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.864 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "4", 2024-09-21T04:05:30.865 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.865 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.865 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.865 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T04:05:30.865 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.865 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.865 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.865 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.865 INFO:teuthology.orchestra.run.smithi046.stdout: "periodic_async_work": { 2024-09-21T04:05:30.865 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "periodic_async_work", 2024-09-21T04:05:30.865 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.865 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.865 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.865 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.866 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.866 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.866 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.866 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Periodically check for async work", 2024-09-21T04:05:30.866 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.866 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.866 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.866 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.866 INFO:teuthology.orchestra.run.smithi046.stdout: "snapshot_clone_delay": { 2024-09-21T04:05:30.866 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "snapshot_clone_delay", 2024-09-21T04:05:30.866 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.866 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.866 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.866 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.867 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.867 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.867 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.867 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T04:05:30.867 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.867 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.867 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.867 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.867 INFO:teuthology.orchestra.run.smithi046.stdout: "snapshot_clone_no_wait": { 2024-09-21T04:05:30.867 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T04:05:30.867 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.867 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.867 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.868 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-21T04:05:30.868 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.868 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.868 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.868 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T04:05:30.868 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.868 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.868 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.868 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.868 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.868 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.868 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.868 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.868 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.868 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.869 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.869 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.869 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.869 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.869 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.869 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.869 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.869 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.869 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.869 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.869 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.869 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix", 2024-09-21T04:05:30.869 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-21T04:05:30.869 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-21T04:05:30.870 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-21T04:05:30.870 INFO:teuthology.orchestra.run.smithi046.stdout: "discovery_interval": { 2024-09-21T04:05:30.870 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "discovery_interval", 2024-09-21T04:05:30.870 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2024-09-21T04:05:30.870 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.870 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.870 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "100", 2024-09-21T04:05:30.870 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.870 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.870 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.870 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.870 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.870 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.871 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.871 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.871 INFO:teuthology.orchestra.run.smithi046.stdout: "identifier": { 2024-09-21T04:05:30.871 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "identifier", 2024-09-21T04:05:30.871 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.871 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.871 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.871 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.871 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.871 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.871 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.871 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.871 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.871 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.871 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.872 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.872 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2024-09-21T04:05:30.872 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2024-09-21T04:05:30.872 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-21T04:05:30.872 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.872 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.872 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2024-09-21T04:05:30.872 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.874 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.874 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.874 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.874 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.875 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.875 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.875 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.875 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-21T04:05:30.875 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-21T04:05:30.875 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.875 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.875 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.875 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.875 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.875 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.875 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.875 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.875 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.876 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.876 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.876 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.876 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.876 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.876 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.876 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.876 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.876 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.876 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.876 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-21T04:05:30.876 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-21T04:05:30.876 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.876 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.877 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.877 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.877 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.877 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.877 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.877 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.877 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.877 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.877 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.877 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.877 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-21T04:05:30.877 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-21T04:05:30.877 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.877 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.878 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.878 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-21T04:05:30.878 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.878 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.878 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-21T04:05:30.878 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-21T04:05:30.878 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-21T04:05:30.878 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-21T04:05:30.878 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-21T04:05:30.878 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-21T04:05:30.878 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-21T04:05:30.878 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.878 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.879 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.879 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.879 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.879 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.879 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-21T04:05:30.879 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-21T04:05:30.879 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-21T04:05:30.879 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.879 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.879 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-21T04:05:30.879 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.879 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.879 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.879 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.880 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.880 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.880 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.880 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.880 INFO:teuthology.orchestra.run.smithi046.stdout: "sqlite3_killpoint": { 2024-09-21T04:05:30.880 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:05:30.880 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.880 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "dev", 2024-09-21T04:05:30.880 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-21T04:05:30.880 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-21T04:05:30.880 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.880 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.880 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.881 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.881 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.881 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.881 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.881 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.881 INFO:teuthology.orchestra.run.smithi046.stdout: "zabbix_host": { 2024-09-21T04:05:30.881 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix_host", 2024-09-21T04:05:30.881 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.881 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.881 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.881 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-21T04:05:30.881 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.881 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.881 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.881 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.882 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.882 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.882 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.882 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.882 INFO:teuthology.orchestra.run.smithi046.stdout: "zabbix_port": { 2024-09-21T04:05:30.882 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix_port", 2024-09-21T04:05:30.882 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-21T04:05:30.882 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.882 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.882 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10051", 2024-09-21T04:05:30.882 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.882 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.882 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.882 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.883 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.883 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.883 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.883 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.883 INFO:teuthology.orchestra.run.smithi046.stdout: "zabbix_sender": { 2024-09-21T04:05:30.883 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix_sender", 2024-09-21T04:05:30.883 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-21T04:05:30.883 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-21T04:05:30.883 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-21T04:05:30.883 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T04:05:30.883 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-21T04:05:30.883 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-21T04:05:30.883 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-21T04:05:30.883 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-21T04:05:30.884 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-21T04:05:30.884 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-21T04:05:30.884 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-21T04:05:30.884 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.884 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.884 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.884 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.884 INFO:teuthology.orchestra.run.smithi046.stdout: "services": { 2024-09-21T04:05:30.884 INFO:teuthology.orchestra.run.smithi046.stdout: "dashboard": "https://172.21.15.46:8443/" 2024-09-21T04:05:30.884 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.884 INFO:teuthology.orchestra.run.smithi046.stdout: "always_on_modules": { 2024-09-21T04:05:30.884 INFO:teuthology.orchestra.run.smithi046.stdout: "octopus": [ 2024-09-21T04:05:30.884 INFO:teuthology.orchestra.run.smithi046.stdout: "balancer", 2024-09-21T04:05:30.884 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T04:05:30.885 INFO:teuthology.orchestra.run.smithi046.stdout: "devicehealth", 2024-09-21T04:05:30.885 INFO:teuthology.orchestra.run.smithi046.stdout: "orchestrator", 2024-09-21T04:05:30.885 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_autoscaler", 2024-09-21T04:05:30.885 INFO:teuthology.orchestra.run.smithi046.stdout: "progress", 2024-09-21T04:05:30.885 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_support", 2024-09-21T04:05:30.885 INFO:teuthology.orchestra.run.smithi046.stdout: "status", 2024-09-21T04:05:30.885 INFO:teuthology.orchestra.run.smithi046.stdout: "telemetry", 2024-09-21T04:05:30.885 INFO:teuthology.orchestra.run.smithi046.stdout: "volumes" 2024-09-21T04:05:30.885 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.885 INFO:teuthology.orchestra.run.smithi046.stdout: "pacific": [ 2024-09-21T04:05:30.885 INFO:teuthology.orchestra.run.smithi046.stdout: "balancer", 2024-09-21T04:05:30.885 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T04:05:30.885 INFO:teuthology.orchestra.run.smithi046.stdout: "devicehealth", 2024-09-21T04:05:30.885 INFO:teuthology.orchestra.run.smithi046.stdout: "orchestrator", 2024-09-21T04:05:30.886 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_autoscaler", 2024-09-21T04:05:30.886 INFO:teuthology.orchestra.run.smithi046.stdout: "progress", 2024-09-21T04:05:30.886 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_support", 2024-09-21T04:05:30.886 INFO:teuthology.orchestra.run.smithi046.stdout: "status", 2024-09-21T04:05:30.886 INFO:teuthology.orchestra.run.smithi046.stdout: "telemetry", 2024-09-21T04:05:30.886 INFO:teuthology.orchestra.run.smithi046.stdout: "volumes" 2024-09-21T04:05:30.886 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.886 INFO:teuthology.orchestra.run.smithi046.stdout: "quincy": [ 2024-09-21T04:05:30.886 INFO:teuthology.orchestra.run.smithi046.stdout: "balancer", 2024-09-21T04:05:30.886 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T04:05:30.886 INFO:teuthology.orchestra.run.smithi046.stdout: "devicehealth", 2024-09-21T04:05:30.886 INFO:teuthology.orchestra.run.smithi046.stdout: "orchestrator", 2024-09-21T04:05:30.886 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_autoscaler", 2024-09-21T04:05:30.887 INFO:teuthology.orchestra.run.smithi046.stdout: "progress", 2024-09-21T04:05:30.887 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_support", 2024-09-21T04:05:30.887 INFO:teuthology.orchestra.run.smithi046.stdout: "status", 2024-09-21T04:05:30.887 INFO:teuthology.orchestra.run.smithi046.stdout: "telemetry", 2024-09-21T04:05:30.887 INFO:teuthology.orchestra.run.smithi046.stdout: "volumes" 2024-09-21T04:05:30.887 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.887 INFO:teuthology.orchestra.run.smithi046.stdout: "reef": [ 2024-09-21T04:05:30.887 INFO:teuthology.orchestra.run.smithi046.stdout: "balancer", 2024-09-21T04:05:30.887 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T04:05:30.887 INFO:teuthology.orchestra.run.smithi046.stdout: "devicehealth", 2024-09-21T04:05:30.887 INFO:teuthology.orchestra.run.smithi046.stdout: "orchestrator", 2024-09-21T04:05:30.887 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_autoscaler", 2024-09-21T04:05:30.887 INFO:teuthology.orchestra.run.smithi046.stdout: "progress", 2024-09-21T04:05:30.887 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_support", 2024-09-21T04:05:30.887 INFO:teuthology.orchestra.run.smithi046.stdout: "status", 2024-09-21T04:05:30.888 INFO:teuthology.orchestra.run.smithi046.stdout: "telemetry", 2024-09-21T04:05:30.888 INFO:teuthology.orchestra.run.smithi046.stdout: "volumes" 2024-09-21T04:05:30.888 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T04:05:30.888 INFO:teuthology.orchestra.run.smithi046.stdout: "squid": [ 2024-09-21T04:05:30.888 INFO:teuthology.orchestra.run.smithi046.stdout: "balancer", 2024-09-21T04:05:30.888 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T04:05:30.888 INFO:teuthology.orchestra.run.smithi046.stdout: "devicehealth", 2024-09-21T04:05:30.888 INFO:teuthology.orchestra.run.smithi046.stdout: "orchestrator", 2024-09-21T04:05:30.888 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_autoscaler", 2024-09-21T04:05:30.888 INFO:teuthology.orchestra.run.smithi046.stdout: "progress", 2024-09-21T04:05:30.888 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_support", 2024-09-21T04:05:30.888 INFO:teuthology.orchestra.run.smithi046.stdout: "status", 2024-09-21T04:05:30.888 INFO:teuthology.orchestra.run.smithi046.stdout: "telemetry", 2024-09-21T04:05:30.889 INFO:teuthology.orchestra.run.smithi046.stdout: "volumes" 2024-09-21T04:05:30.889 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-09-21T04:05:30.889 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.889 INFO:teuthology.orchestra.run.smithi046.stdout: "last_failure_osd_epoch": 5, 2024-09-21T04:05:30.889 INFO:teuthology.orchestra.run.smithi046.stdout: "active_clients": [ 2024-09-21T04:05:30.889 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.889 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "devicehealth", 2024-09-21T04:05:30.889 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-09-21T04:05:30.889 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.889 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-09-21T04:05:30.889 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.46:0", 2024-09-21T04:05:30.889 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 2196922549 2024-09-21T04:05:30.889 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.889 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-09-21T04:05:30.889 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.890 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.890 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "libcephsqlite", 2024-09-21T04:05:30.890 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-09-21T04:05:30.890 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.890 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-09-21T04:05:30.890 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.46:0", 2024-09-21T04:05:30.890 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 2529879242 2024-09-21T04:05:30.890 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.890 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-09-21T04:05:30.890 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.890 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.890 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rbd_support", 2024-09-21T04:05:30.890 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-09-21T04:05:30.890 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.891 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-09-21T04:05:30.891 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.46:0", 2024-09-21T04:05:30.891 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 582434867 2024-09-21T04:05:30.891 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.891 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-09-21T04:05:30.891 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.891 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.891 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "snap_schedule", 2024-09-21T04:05:30.891 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-09-21T04:05:30.891 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.891 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-09-21T04:05:30.891 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.46:0", 2024-09-21T04:05:30.891 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1613155118 2024-09-21T04:05:30.892 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.892 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-09-21T04:05:30.892 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.892 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.892 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "snap_schedule", 2024-09-21T04:05:30.892 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-09-21T04:05:30.892 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.892 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-09-21T04:05:30.892 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.46:0", 2024-09-21T04:05:30.892 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 91281581 2024-09-21T04:05:30.892 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.892 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-09-21T04:05:30.892 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:30.892 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.892 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "volumes", 2024-09-21T04:05:30.893 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-09-21T04:05:30.893 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-21T04:05:30.893 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-09-21T04:05:30.893 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.46:0", 2024-09-21T04:05:30.893 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 811400203 2024-09-21T04:05:30.893 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.893 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-09-21T04:05:30.893 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:30.893 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-09-21T04:05:30.893 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T04:05:30.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.397+0000 7f737309d640 1 -- 172.21.15.46:0/3929329070 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f735c0b6680 msgr2=0x7f735c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:30.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.397+0000 7f737309d640 1 --2- 172.21.15.46:0/3929329070 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f735c0b6680 0x7f735c0b8b90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7360031440 tx=0x7f7360032ed0 comp rx=0 tx=0).stop 2024-09-21T04:05:30.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.397+0000 7f737309d640 1 -- 172.21.15.46:0/3929329070 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f736c108c00 msgr2=0x7f736c19fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:30.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.397+0000 7f737309d640 1 --2- 172.21.15.46:0/3929329070 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f736c108c00 0x7f736c19fc00 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f736400eb10 tx=0x7f736400c2d0 comp rx=0 tx=0).stop 2024-09-21T04:05:30.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.397+0000 7f737309d640 1 -- 172.21.15.46:0/3929329070 shutdown_connections 2024-09-21T04:05:30.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.397+0000 7f737309d640 1 --2- 172.21.15.46:0/3929329070 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f736c108c00 0x7f736c19fc00 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:30.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.397+0000 7f737309d640 1 --2- 172.21.15.46:0/3929329070 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f736c1082b0 0x7f736c19a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:30.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.397+0000 7f737309d640 1 --2- 172.21.15.46:0/3929329070 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f735c0b6680 0x7f735c0b8b90 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:30.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.397+0000 7f737309d640 1 --2- 172.21.15.46:0/3929329070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f736c102980 0x7f736c19a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:30.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.397+0000 7f737309d640 1 -- 172.21.15.46:0/3929329070 >> 172.21.15.46:0/3929329070 conn(0x7f736c0fe380 msgr2=0x7f736c06ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:30.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.397+0000 7f737309d640 1 -- 172.21.15.46:0/3929329070 shutdown_connections 2024-09-21T04:05:30.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:29.397+0000 7f737309d640 1 -- 172.21.15.46:0/3929329070 wait complete. 2024-09-21T04:05:30.939 DEBUG:tasks.check_counter:Getting stats from a 2024-09-21T04:05:30.939 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph daemon mds.a perf dump 2024-09-21T04:05:30.940 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:29 smithi046 ceph-mon[30954]: pgmap v639: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:05:30.940 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:29 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:05:30.940 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:29 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:05:30.940 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:29 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:05:30.940 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:29 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:05:30.940 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:29 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/961028233' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T04:05:30.940 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:29 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:05:30.940 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:29 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:05:30.940 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:29 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/2007771430' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T04:05:30.940 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:29 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:05:30.940 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:29 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:05:30.941 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:29 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:05:30.941 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:29 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3929329070' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T04:05:30.941 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:29 smithi162 ceph-mon[35071]: pgmap v639: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:05:30.941 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:29 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:05:30.941 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:29 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:05:30.942 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:29 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:05:30.942 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:29 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:05:30.942 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:29 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/961028233' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T04:05:30.942 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:29 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:05:30.942 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:29 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:05:30.942 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:29 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/2007771430' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T04:05:30.942 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:29 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:05:30.942 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:29 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:05:30.942 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:29 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:05:30.942 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:29 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3929329070' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T04:05:30.942 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:29 smithi105 ceph-mon[34773]: pgmap v639: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:05:30.942 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:29 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:05:30.942 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:29 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:05:30.943 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:29 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:05:30.943 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:29 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:05:30.943 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:29 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/961028233' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T04:05:30.943 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:29 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:05:30.943 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:29 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:05:30.943 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:29 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/2007771430' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T04:05:30.943 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:29 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:05:30.943 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:29 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:05:30.943 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:29 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' 2024-09-21T04:05:30.943 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:29 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3929329070' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T04:05:31.210 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:05:31.621 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:31 smithi046 ceph-mon[30954]: pgmap v640: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:05:31.747 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T04:05:31.747 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T04:05:31.747 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 206, 2024-09-21T04:05:31.747 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 202, 2024-09-21T04:05:31.747 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 679264, 2024-09-21T04:05:31.748 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 124064, 2024-09-21T04:05:31.748 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 4, 2024-09-21T04:05:31.748 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 0, 2024-09-21T04:05:31.748 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.038089416, 2024-09-21T04:05:31.748 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.018375618, 2024-09-21T04:05:31.748 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.024337120, 2024-09-21T04:05:31.748 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:05:31.748 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:31.748 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 201, 2024-09-21T04:05:31.748 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.010740551, 2024-09-21T04:05:31.748 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000053435 2024-09-21T04:05:31.748 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:31.748 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:31.748 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-21T04:05:31.749 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-21T04:05:31.749 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-21T04:05:31.749 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:31.749 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 679264, 2024-09-21T04:05:31.749 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 124064 2024-09-21T04:05:31.749 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:31.749 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T04:05:31.749 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 5, 2024-09-21T04:05:31.749 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 156, 2024-09-21T04:05:31.749 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 3104, 2024-09-21T04:05:31.749 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 107744, 2024-09-21T04:05:31.749 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 3, 2024-09-21T04:05:31.749 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 2, 2024-09-21T04:05:31.749 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.018450728, 2024-09-21T04:05:31.749 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.012907952, 2024-09-21T04:05:31.750 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.003899859, 2024-09-21T04:05:31.750 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:05:31.750 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:31.750 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 155, 2024-09-21T04:05:31.750 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.012696306, 2024-09-21T04:05:31.750 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000081911 2024-09-21T04:05:31.750 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:31.750 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:31.750 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-21T04:05:31.750 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-21T04:05:31.750 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-21T04:05:31.750 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:31.750 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-21T04:05:31.751 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 107744 2024-09-21T04:05:31.751 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:31.751 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T04:05:31.751 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 0, 2024-09-21T04:05:31.751 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 2, 2024-09-21T04:05:31.751 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 0, 2024-09-21T04:05:31.751 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 0, 2024-09-21T04:05:31.751 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 2, 2024-09-21T04:05:31.751 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 1, 2024-09-21T04:05:31.751 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.000367347, 2024-09-21T04:05:31.751 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T04:05:31.751 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.000288692, 2024-09-21T04:05:31.751 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:05:31.751 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:31.752 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-21T04:05:31.752 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-21T04:05:31.752 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-21T04:05:31.752 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:31.752 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:31.752 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-21T04:05:31.752 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-21T04:05:31.752 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-21T04:05:31.752 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:31.752 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T04:05:31.752 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T04:05:31.752 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:31.752 INFO:teuthology.orchestra.run.smithi046.stdout: "cct": { 2024-09-21T04:05:31.752 INFO:teuthology.orchestra.run.smithi046.stdout: "total_workers": 0, 2024-09-21T04:05:31.752 INFO:teuthology.orchestra.run.smithi046.stdout: "unhealthy_workers": 0 2024-09-21T04:05:31.752 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:31.753 INFO:teuthology.orchestra.run.smithi046.stdout: "mempool": { 2024-09-21T04:05:31.753 INFO:teuthology.orchestra.run.smithi046.stdout: "bloom_filter_bytes": 0, 2024-09-21T04:05:31.753 INFO:teuthology.orchestra.run.smithi046.stdout: "bloom_filter_items": 0, 2024-09-21T04:05:31.753 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T04:05:31.753 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_alloc_items": 0, 2024-09-21T04:05:31.753 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T04:05:31.753 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_data_items": 0, 2024-09-21T04:05:31.753 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T04:05:31.753 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T04:05:31.753 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T04:05:31.753 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T04:05:31.753 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T04:05:31.753 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_other_items": 0, 2024-09-21T04:05:31.754 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T04:05:31.754 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T04:05:31.754 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_extent_bytes": 0, 2024-09-21T04:05:31.754 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_extent_items": 0, 2024-09-21T04:05:31.754 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_blob_bytes": 0, 2024-09-21T04:05:31.754 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_blob_items": 0, 2024-09-21T04:05:31.754 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T04:05:31.754 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T04:05:31.754 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T04:05:31.754 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T04:05:31.754 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T04:05:31.754 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_items": 0, 2024-09-21T04:05:31.754 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_txc_bytes": 0, 2024-09-21T04:05:31.754 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_txc_items": 0, 2024-09-21T04:05:31.755 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T04:05:31.755 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T04:05:31.755 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_bytes": 0, 2024-09-21T04:05:31.755 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_items": 0, 2024-09-21T04:05:31.755 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_bytes": 0, 2024-09-21T04:05:31.755 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_items": 0, 2024-09-21T04:05:31.755 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T04:05:31.755 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_reader_items": 0, 2024-09-21T04:05:31.755 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T04:05:31.755 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_writer_items": 0, 2024-09-21T04:05:31.755 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_anon_bytes": 148984, 2024-09-21T04:05:31.755 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_anon_items": 30, 2024-09-21T04:05:31.755 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_meta_bytes": 0, 2024-09-21T04:05:31.755 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_meta_items": 0, 2024-09-21T04:05:31.755 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_bytes": 0, 2024-09-21T04:05:31.756 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_items": 0, 2024-09-21T04:05:31.756 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mapbl_bytes": 0, 2024-09-21T04:05:31.756 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mapbl_items": 0, 2024-09-21T04:05:31.756 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pglog_bytes": 0, 2024-09-21T04:05:31.756 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pglog_items": 0, 2024-09-21T04:05:31.756 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_bytes": 0, 2024-09-21T04:05:31.756 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_items": 0, 2024-09-21T04:05:31.756 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T04:05:31.756 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_mapping_items": 0, 2024-09-21T04:05:31.756 INFO:teuthology.orchestra.run.smithi046.stdout: "pgmap_bytes": 0, 2024-09-21T04:05:31.756 INFO:teuthology.orchestra.run.smithi046.stdout: "pgmap_items": 0, 2024-09-21T04:05:31.756 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_co_bytes": 968, 2024-09-21T04:05:31.756 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_co_items": 2, 2024-09-21T04:05:31.756 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_1_bytes": 0, 2024-09-21T04:05:31.757 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_1_items": 0, 2024-09-21T04:05:31.757 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_2_bytes": 0, 2024-09-21T04:05:31.757 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_2_items": 0 2024-09-21T04:05:31.757 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:31.757 INFO:teuthology.orchestra.run.smithi046.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T04:05:31.757 INFO:teuthology.orchestra.run.smithi046.stdout: "val": 0, 2024-09-21T04:05:31.757 INFO:teuthology.orchestra.run.smithi046.stdout: "max": 104857600, 2024-09-21T04:05:31.757 INFO:teuthology.orchestra.run.smithi046.stdout: "get_started": 0, 2024-09-21T04:05:31.757 INFO:teuthology.orchestra.run.smithi046.stdout: "get": 207, 2024-09-21T04:05:31.757 INFO:teuthology.orchestra.run.smithi046.stdout: "get_sum": 650153, 2024-09-21T04:05:31.757 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_fail": 0, 2024-09-21T04:05:31.757 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_success": 207, 2024-09-21T04:05:31.757 INFO:teuthology.orchestra.run.smithi046.stdout: "take": 0, 2024-09-21T04:05:31.757 INFO:teuthology.orchestra.run.smithi046.stdout: "take_sum": 0, 2024-09-21T04:05:31.758 INFO:teuthology.orchestra.run.smithi046.stdout: "put": 207, 2024-09-21T04:05:31.758 INFO:teuthology.orchestra.run.smithi046.stdout: "put_sum": 650153, 2024-09-21T04:05:31.758 INFO:teuthology.orchestra.run.smithi046.stdout: "wait": { 2024-09-21T04:05:31.758 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-21T04:05:31.758 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-21T04:05:31.758 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-21T04:05:31.758 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:31.758 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:31.758 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T04:05:31.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:31 smithi105 ceph-mon[34773]: pgmap v640: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:05:31.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:31 smithi162 ceph-mon[35071]: pgmap v640: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:05:32.670 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-09-21T04:05:32.670 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-09-21T04:05:32.670 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-09-21T04:05:32.670 DEBUG:tasks.check_counter:Getting stats from d 2024-09-21T04:05:32.670 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph daemon mds.d perf dump 2024-09-21T04:05:32.934 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:05:33.497 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T04:05:33.497 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T04:05:33.497 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 0, 2024-09-21T04:05:33.497 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 2, 2024-09-21T04:05:33.498 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 0, 2024-09-21T04:05:33.498 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 0, 2024-09-21T04:05:33.498 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 4, 2024-09-21T04:05:33.498 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 0, 2024-09-21T04:05:33.498 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.001268770, 2024-09-21T04:05:33.498 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T04:05:33.498 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.000193886, 2024-09-21T04:05:33.498 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:05:33.498 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:33.498 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-21T04:05:33.498 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-21T04:05:33.498 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-21T04:05:33.499 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:33.499 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:33.499 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-21T04:05:33.499 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-21T04:05:33.499 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-21T04:05:33.499 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:33.499 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T04:05:33.499 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T04:05:33.499 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:33.499 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T04:05:33.499 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 5, 2024-09-21T04:05:33.499 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 160, 2024-09-21T04:05:33.499 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 3104, 2024-09-21T04:05:33.500 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 108448, 2024-09-21T04:05:33.500 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 3, 2024-09-21T04:05:33.500 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 2, 2024-09-21T04:05:33.500 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.018867980, 2024-09-21T04:05:33.500 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.013654525, 2024-09-21T04:05:33.500 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.003415425, 2024-09-21T04:05:33.500 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:05:33.500 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:33.500 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 159, 2024-09-21T04:05:33.500 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.013034082, 2024-09-21T04:05:33.500 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000081975 2024-09-21T04:05:33.500 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:33.500 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:33.500 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-21T04:05:33.500 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-21T04:05:33.501 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-21T04:05:33.501 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:33.501 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-21T04:05:33.501 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 108448 2024-09-21T04:05:33.501 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:33.501 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T04:05:33.501 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 211, 2024-09-21T04:05:33.501 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 207, 2024-09-21T04:05:33.501 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 680624, 2024-09-21T04:05:33.501 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 127264, 2024-09-21T04:05:33.501 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 2, 2024-09-21T04:05:33.501 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 1, 2024-09-21T04:05:33.501 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.037825058, 2024-09-21T04:05:33.502 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.018853676, 2024-09-21T04:05:33.502 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.024585656, 2024-09-21T04:05:33.502 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:05:33.502 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:33.502 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 206, 2024-09-21T04:05:33.502 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.012080628, 2024-09-21T04:05:33.502 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000058643 2024-09-21T04:05:33.502 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:33.502 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:33.502 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-21T04:05:33.502 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-21T04:05:33.502 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-21T04:05:33.502 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:33.502 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 680624, 2024-09-21T04:05:33.503 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 127264 2024-09-21T04:05:33.503 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:33.503 INFO:teuthology.orchestra.run.smithi046.stdout: "cct": { 2024-09-21T04:05:33.503 INFO:teuthology.orchestra.run.smithi046.stdout: "total_workers": 0, 2024-09-21T04:05:33.503 INFO:teuthology.orchestra.run.smithi046.stdout: "unhealthy_workers": 0 2024-09-21T04:05:33.503 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:33.503 INFO:teuthology.orchestra.run.smithi046.stdout: "mempool": { 2024-09-21T04:05:33.503 INFO:teuthology.orchestra.run.smithi046.stdout: "bloom_filter_bytes": 0, 2024-09-21T04:05:33.503 INFO:teuthology.orchestra.run.smithi046.stdout: "bloom_filter_items": 0, 2024-09-21T04:05:33.503 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T04:05:33.503 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_alloc_items": 0, 2024-09-21T04:05:33.503 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T04:05:33.503 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_data_items": 0, 2024-09-21T04:05:33.504 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T04:05:33.504 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T04:05:33.504 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T04:05:33.504 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T04:05:33.504 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T04:05:33.504 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_other_items": 0, 2024-09-21T04:05:33.504 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T04:05:33.504 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T04:05:33.504 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_extent_bytes": 0, 2024-09-21T04:05:33.504 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_extent_items": 0, 2024-09-21T04:05:33.504 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_blob_bytes": 0, 2024-09-21T04:05:33.504 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_blob_items": 0, 2024-09-21T04:05:33.504 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T04:05:33.504 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T04:05:33.505 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T04:05:33.505 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T04:05:33.505 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T04:05:33.505 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_items": 0, 2024-09-21T04:05:33.505 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_txc_bytes": 0, 2024-09-21T04:05:33.505 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_txc_items": 0, 2024-09-21T04:05:33.505 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T04:05:33.505 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T04:05:33.505 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_bytes": 0, 2024-09-21T04:05:33.505 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_items": 0, 2024-09-21T04:05:33.505 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_bytes": 0, 2024-09-21T04:05:33.505 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_items": 0, 2024-09-21T04:05:33.505 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T04:05:33.505 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_reader_items": 0, 2024-09-21T04:05:33.506 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T04:05:33.506 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_writer_items": 0, 2024-09-21T04:05:33.506 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_anon_bytes": 148967, 2024-09-21T04:05:33.506 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_anon_items": 29, 2024-09-21T04:05:33.506 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_meta_bytes": 0, 2024-09-21T04:05:33.506 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_meta_items": 0, 2024-09-21T04:05:33.506 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_bytes": 0, 2024-09-21T04:05:33.506 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_items": 0, 2024-09-21T04:05:33.506 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mapbl_bytes": 0, 2024-09-21T04:05:33.506 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mapbl_items": 0, 2024-09-21T04:05:33.506 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pglog_bytes": 0, 2024-09-21T04:05:33.506 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pglog_items": 0, 2024-09-21T04:05:33.506 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_bytes": 0, 2024-09-21T04:05:33.506 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_items": 0, 2024-09-21T04:05:33.507 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T04:05:33.507 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_mapping_items": 0, 2024-09-21T04:05:33.507 INFO:teuthology.orchestra.run.smithi046.stdout: "pgmap_bytes": 0, 2024-09-21T04:05:33.507 INFO:teuthology.orchestra.run.smithi046.stdout: "pgmap_items": 0, 2024-09-21T04:05:33.507 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_co_bytes": 968, 2024-09-21T04:05:33.507 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_co_items": 2, 2024-09-21T04:05:33.507 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_1_bytes": 0, 2024-09-21T04:05:33.507 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_1_items": 0, 2024-09-21T04:05:33.507 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_2_bytes": 0, 2024-09-21T04:05:33.507 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_2_items": 0 2024-09-21T04:05:33.507 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:33.507 INFO:teuthology.orchestra.run.smithi046.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T04:05:33.507 INFO:teuthology.orchestra.run.smithi046.stdout: "val": 0, 2024-09-21T04:05:33.508 INFO:teuthology.orchestra.run.smithi046.stdout: "max": 104857600, 2024-09-21T04:05:33.508 INFO:teuthology.orchestra.run.smithi046.stdout: "get_started": 0, 2024-09-21T04:05:33.508 INFO:teuthology.orchestra.run.smithi046.stdout: "get": 212, 2024-09-21T04:05:33.508 INFO:teuthology.orchestra.run.smithi046.stdout: "get_sum": 650803, 2024-09-21T04:05:33.508 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_fail": 0, 2024-09-21T04:05:33.508 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_success": 212, 2024-09-21T04:05:33.508 INFO:teuthology.orchestra.run.smithi046.stdout: "take": 0, 2024-09-21T04:05:33.508 INFO:teuthology.orchestra.run.smithi046.stdout: "take_sum": 0, 2024-09-21T04:05:33.508 INFO:teuthology.orchestra.run.smithi046.stdout: "put": 212, 2024-09-21T04:05:33.508 INFO:teuthology.orchestra.run.smithi046.stdout: "put_sum": 650803, 2024-09-21T04:05:33.508 INFO:teuthology.orchestra.run.smithi046.stdout: "wait": { 2024-09-21T04:05:33.508 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-21T04:05:33.508 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-21T04:05:33.508 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-21T04:05:33.509 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:33.509 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:33.509 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T04:05:33.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:33 smithi046 ceph-mon[30954]: pgmap v641: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T04:05:33.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:33 smithi105 ceph-mon[34773]: pgmap v641: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T04:05:33.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:33 smithi162 ceph-mon[35071]: pgmap v641: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T04:05:34.284 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-21T04:05:34.284 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-21T04:05:34.284 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-21T04:05:34.284 DEBUG:tasks.check_counter:Getting stats from g 2024-09-21T04:05:34.285 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph daemon mds.g perf dump 2024-09-21T04:05:34.547 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:05:35.031 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T04:05:35.031 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T04:05:35.031 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 212, 2024-09-21T04:05:35.031 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 206, 2024-09-21T04:05:35.031 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 682752, 2024-09-21T04:05:35.031 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 125792, 2024-09-21T04:05:35.031 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 4, 2024-09-21T04:05:35.031 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 0, 2024-09-21T04:05:35.031 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.041205332, 2024-09-21T04:05:35.032 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.018571052, 2024-09-21T04:05:35.032 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.027922624, 2024-09-21T04:05:35.032 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:05:35.032 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:35.032 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 206, 2024-09-21T04:05:35.032 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.015939683, 2024-09-21T04:05:35.032 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000077377 2024-09-21T04:05:35.032 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:35.032 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:35.032 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-21T04:05:35.032 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-21T04:05:35.032 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-21T04:05:35.032 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:35.033 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 682752, 2024-09-21T04:05:35.033 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 125792 2024-09-21T04:05:35.033 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:35.033 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T04:05:35.033 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 1, 2024-09-21T04:05:35.033 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 155, 2024-09-21T04:05:35.033 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 160, 2024-09-21T04:05:35.033 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 107472, 2024-09-21T04:05:35.033 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 3, 2024-09-21T04:05:35.033 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 2, 2024-09-21T04:05:35.033 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.016520562, 2024-09-21T04:05:35.033 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.013133088, 2024-09-21T04:05:35.033 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.001654403, 2024-09-21T04:05:35.033 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:05:35.033 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:35.034 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 153, 2024-09-21T04:05:35.034 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.007807471, 2024-09-21T04:05:35.034 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000051029 2024-09-21T04:05:35.034 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:35.034 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:35.034 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-21T04:05:35.034 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-21T04:05:35.034 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-21T04:05:35.034 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:35.034 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T04:05:35.034 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 107472 2024-09-21T04:05:35.034 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:35.034 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T04:05:35.035 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 0, 2024-09-21T04:05:35.035 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 2, 2024-09-21T04:05:35.035 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 0, 2024-09-21T04:05:35.035 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 0, 2024-09-21T04:05:35.035 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 2, 2024-09-21T04:05:35.035 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 1, 2024-09-21T04:05:35.035 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.000348140, 2024-09-21T04:05:35.035 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T04:05:35.035 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.000270222, 2024-09-21T04:05:35.035 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:05:35.035 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:35.035 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-21T04:05:35.035 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-21T04:05:35.035 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-21T04:05:35.036 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:35.036 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:35.036 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-21T04:05:35.036 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-21T04:05:35.036 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-21T04:05:35.036 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:35.036 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T04:05:35.036 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T04:05:35.036 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:35.036 INFO:teuthology.orchestra.run.smithi046.stdout: "cct": { 2024-09-21T04:05:35.036 INFO:teuthology.orchestra.run.smithi046.stdout: "total_workers": 0, 2024-09-21T04:05:35.036 INFO:teuthology.orchestra.run.smithi046.stdout: "unhealthy_workers": 0 2024-09-21T04:05:35.037 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:35.037 INFO:teuthology.orchestra.run.smithi046.stdout: "mempool": { 2024-09-21T04:05:35.037 INFO:teuthology.orchestra.run.smithi046.stdout: "bloom_filter_bytes": 0, 2024-09-21T04:05:35.037 INFO:teuthology.orchestra.run.smithi046.stdout: "bloom_filter_items": 0, 2024-09-21T04:05:35.037 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T04:05:35.037 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_alloc_items": 0, 2024-09-21T04:05:35.037 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T04:05:35.037 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_data_items": 0, 2024-09-21T04:05:35.037 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T04:05:35.037 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T04:05:35.037 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T04:05:35.037 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T04:05:35.037 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T04:05:35.037 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_other_items": 0, 2024-09-21T04:05:35.038 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T04:05:35.038 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T04:05:35.038 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_extent_bytes": 0, 2024-09-21T04:05:35.038 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_extent_items": 0, 2024-09-21T04:05:35.038 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_blob_bytes": 0, 2024-09-21T04:05:35.038 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_blob_items": 0, 2024-09-21T04:05:35.038 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T04:05:35.038 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T04:05:35.038 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T04:05:35.038 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T04:05:35.038 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T04:05:35.038 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_items": 0, 2024-09-21T04:05:35.038 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_txc_bytes": 0, 2024-09-21T04:05:35.039 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_txc_items": 0, 2024-09-21T04:05:35.039 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T04:05:35.039 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T04:05:35.039 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_bytes": 0, 2024-09-21T04:05:35.039 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_items": 0, 2024-09-21T04:05:35.039 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_bytes": 0, 2024-09-21T04:05:35.039 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_items": 0, 2024-09-21T04:05:35.039 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T04:05:35.039 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_reader_items": 0, 2024-09-21T04:05:35.039 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T04:05:35.039 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_writer_items": 0, 2024-09-21T04:05:35.039 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_anon_bytes": 148984, 2024-09-21T04:05:35.039 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_anon_items": 30, 2024-09-21T04:05:35.040 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_meta_bytes": 0, 2024-09-21T04:05:35.040 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_meta_items": 0, 2024-09-21T04:05:35.040 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_bytes": 0, 2024-09-21T04:05:35.040 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_items": 0, 2024-09-21T04:05:35.040 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mapbl_bytes": 0, 2024-09-21T04:05:35.040 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mapbl_items": 0, 2024-09-21T04:05:35.040 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pglog_bytes": 0, 2024-09-21T04:05:35.040 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pglog_items": 0, 2024-09-21T04:05:35.040 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_bytes": 0, 2024-09-21T04:05:35.040 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_items": 0, 2024-09-21T04:05:35.040 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T04:05:35.040 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_mapping_items": 0, 2024-09-21T04:05:35.040 INFO:teuthology.orchestra.run.smithi046.stdout: "pgmap_bytes": 0, 2024-09-21T04:05:35.040 INFO:teuthology.orchestra.run.smithi046.stdout: "pgmap_items": 0, 2024-09-21T04:05:35.040 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_co_bytes": 968, 2024-09-21T04:05:35.041 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_co_items": 2, 2024-09-21T04:05:35.041 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_1_bytes": 0, 2024-09-21T04:05:35.041 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_1_items": 0, 2024-09-21T04:05:35.041 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_2_bytes": 0, 2024-09-21T04:05:35.041 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_2_items": 0 2024-09-21T04:05:35.041 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:35.041 INFO:teuthology.orchestra.run.smithi046.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T04:05:35.041 INFO:teuthology.orchestra.run.smithi046.stdout: "val": 0, 2024-09-21T04:05:35.041 INFO:teuthology.orchestra.run.smithi046.stdout: "max": 104857600, 2024-09-21T04:05:35.041 INFO:teuthology.orchestra.run.smithi046.stdout: "get_started": 0, 2024-09-21T04:05:35.041 INFO:teuthology.orchestra.run.smithi046.stdout: "get": 209, 2024-09-21T04:05:35.041 INFO:teuthology.orchestra.run.smithi046.stdout: "get_sum": 650413, 2024-09-21T04:05:35.041 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_fail": 0, 2024-09-21T04:05:35.041 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_success": 209, 2024-09-21T04:05:35.042 INFO:teuthology.orchestra.run.smithi046.stdout: "take": 0, 2024-09-21T04:05:35.042 INFO:teuthology.orchestra.run.smithi046.stdout: "take_sum": 0, 2024-09-21T04:05:35.042 INFO:teuthology.orchestra.run.smithi046.stdout: "put": 209, 2024-09-21T04:05:35.042 INFO:teuthology.orchestra.run.smithi046.stdout: "put_sum": 650413, 2024-09-21T04:05:35.042 INFO:teuthology.orchestra.run.smithi046.stdout: "wait": { 2024-09-21T04:05:35.042 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-21T04:05:35.042 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-21T04:05:35.042 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-21T04:05:35.042 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:35.042 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:35.042 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T04:05:35.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:35 smithi046 ceph-mon[30954]: pgmap v642: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:05:35.797 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-21T04:05:35.797 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-21T04:05:35.797 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-21T04:05:35.797 DEBUG:tasks.check_counter:Getting stats from j 2024-09-21T04:05:35.797 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph daemon mds.j perf dump 2024-09-21T04:05:35.817 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:35 smithi105 ceph-mon[34773]: pgmap v642: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:05:35.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:35 smithi162 ceph-mon[35071]: pgmap v642: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:05:36.059 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:05:36.583 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T04:05:36.584 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T04:05:36.584 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 217, 2024-09-21T04:05:36.584 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 211, 2024-09-21T04:05:36.584 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 684112, 2024-09-21T04:05:36.584 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 128992, 2024-09-21T04:05:36.584 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 4, 2024-09-21T04:05:36.584 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 0, 2024-09-21T04:05:36.584 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.038979354, 2024-09-21T04:05:36.584 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.016504331, 2024-09-21T04:05:36.584 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.028583556, 2024-09-21T04:05:36.584 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:05:36.585 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:36.585 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 211, 2024-09-21T04:05:36.585 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.016171561, 2024-09-21T04:05:36.585 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000076642 2024-09-21T04:05:36.585 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:36.585 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:36.585 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-21T04:05:36.585 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-21T04:05:36.585 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-21T04:05:36.585 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:36.585 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 684112, 2024-09-21T04:05:36.585 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 128992 2024-09-21T04:05:36.585 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:36.585 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T04:05:36.586 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 1, 2024-09-21T04:05:36.586 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 159, 2024-09-21T04:05:36.586 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 160, 2024-09-21T04:05:36.586 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 108176, 2024-09-21T04:05:36.586 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 3, 2024-09-21T04:05:36.586 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 2, 2024-09-21T04:05:36.586 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.016881308, 2024-09-21T04:05:36.586 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.013457715, 2024-09-21T04:05:36.586 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.001673552, 2024-09-21T04:05:36.586 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:05:36.586 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:36.587 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 157, 2024-09-21T04:05:36.587 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.008704503, 2024-09-21T04:05:36.587 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000055442 2024-09-21T04:05:36.587 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:36.587 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:36.587 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-21T04:05:36.587 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-21T04:05:36.587 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-21T04:05:36.587 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:36.587 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T04:05:36.587 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 108176 2024-09-21T04:05:36.587 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:36.587 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T04:05:36.587 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 0, 2024-09-21T04:05:36.588 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 2, 2024-09-21T04:05:36.588 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 0, 2024-09-21T04:05:36.588 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 0, 2024-09-21T04:05:36.588 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 2, 2024-09-21T04:05:36.588 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 1, 2024-09-21T04:05:36.588 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.000832070, 2024-09-21T04:05:36.588 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T04:05:36.588 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.000718693, 2024-09-21T04:05:36.588 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:05:36.588 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:36.588 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-21T04:05:36.588 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-21T04:05:36.588 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-21T04:05:36.588 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:36.589 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:36.589 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-21T04:05:36.589 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-21T04:05:36.589 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-21T04:05:36.589 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:36.589 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T04:05:36.589 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T04:05:36.589 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:36.589 INFO:teuthology.orchestra.run.smithi046.stdout: "cct": { 2024-09-21T04:05:36.589 INFO:teuthology.orchestra.run.smithi046.stdout: "total_workers": 0, 2024-09-21T04:05:36.589 INFO:teuthology.orchestra.run.smithi046.stdout: "unhealthy_workers": 0 2024-09-21T04:05:36.589 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:36.589 INFO:teuthology.orchestra.run.smithi046.stdout: "mempool": { 2024-09-21T04:05:36.589 INFO:teuthology.orchestra.run.smithi046.stdout: "bloom_filter_bytes": 0, 2024-09-21T04:05:36.590 INFO:teuthology.orchestra.run.smithi046.stdout: "bloom_filter_items": 0, 2024-09-21T04:05:36.590 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T04:05:36.590 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_alloc_items": 0, 2024-09-21T04:05:36.590 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T04:05:36.590 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_data_items": 0, 2024-09-21T04:05:36.590 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T04:05:36.590 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T04:05:36.590 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T04:05:36.590 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T04:05:36.590 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T04:05:36.590 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_other_items": 0, 2024-09-21T04:05:36.590 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T04:05:36.590 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T04:05:36.590 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_extent_bytes": 0, 2024-09-21T04:05:36.591 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_extent_items": 0, 2024-09-21T04:05:36.591 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_blob_bytes": 0, 2024-09-21T04:05:36.591 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_blob_items": 0, 2024-09-21T04:05:36.591 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T04:05:36.591 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T04:05:36.591 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T04:05:36.591 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T04:05:36.591 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T04:05:36.591 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_items": 0, 2024-09-21T04:05:36.591 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_txc_bytes": 0, 2024-09-21T04:05:36.591 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_txc_items": 0, 2024-09-21T04:05:36.591 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T04:05:36.591 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T04:05:36.592 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_bytes": 0, 2024-09-21T04:05:36.592 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_items": 0, 2024-09-21T04:05:36.592 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_bytes": 0, 2024-09-21T04:05:36.592 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_items": 0, 2024-09-21T04:05:36.592 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T04:05:36.592 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_reader_items": 0, 2024-09-21T04:05:36.592 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T04:05:36.592 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_writer_items": 0, 2024-09-21T04:05:36.592 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_anon_bytes": 149998, 2024-09-21T04:05:36.592 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_anon_items": 30, 2024-09-21T04:05:36.592 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_meta_bytes": 0, 2024-09-21T04:05:36.592 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_meta_items": 0, 2024-09-21T04:05:36.592 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_bytes": 0, 2024-09-21T04:05:36.592 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_items": 0, 2024-09-21T04:05:36.592 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mapbl_bytes": 0, 2024-09-21T04:05:36.593 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mapbl_items": 0, 2024-09-21T04:05:36.593 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pglog_bytes": 0, 2024-09-21T04:05:36.593 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pglog_items": 0, 2024-09-21T04:05:36.593 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_bytes": 0, 2024-09-21T04:05:36.593 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_items": 0, 2024-09-21T04:05:36.593 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T04:05:36.593 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_mapping_items": 0, 2024-09-21T04:05:36.593 INFO:teuthology.orchestra.run.smithi046.stdout: "pgmap_bytes": 0, 2024-09-21T04:05:36.593 INFO:teuthology.orchestra.run.smithi046.stdout: "pgmap_items": 0, 2024-09-21T04:05:36.593 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_co_bytes": 968, 2024-09-21T04:05:36.593 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_co_items": 2, 2024-09-21T04:05:36.593 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_1_bytes": 0, 2024-09-21T04:05:36.593 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_1_items": 0, 2024-09-21T04:05:36.593 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_2_bytes": 0, 2024-09-21T04:05:36.594 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_2_items": 0 2024-09-21T04:05:36.594 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T04:05:36.594 INFO:teuthology.orchestra.run.smithi046.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T04:05:36.594 INFO:teuthology.orchestra.run.smithi046.stdout: "val": 0, 2024-09-21T04:05:36.594 INFO:teuthology.orchestra.run.smithi046.stdout: "max": 104857600, 2024-09-21T04:05:36.594 INFO:teuthology.orchestra.run.smithi046.stdout: "get_started": 0, 2024-09-21T04:05:36.594 INFO:teuthology.orchestra.run.smithi046.stdout: "get": 214, 2024-09-21T04:05:36.594 INFO:teuthology.orchestra.run.smithi046.stdout: "get_sum": 651063, 2024-09-21T04:05:36.594 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_fail": 0, 2024-09-21T04:05:36.594 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_success": 214, 2024-09-21T04:05:36.595 INFO:teuthology.orchestra.run.smithi046.stdout: "take": 0, 2024-09-21T04:05:36.595 INFO:teuthology.orchestra.run.smithi046.stdout: "take_sum": 0, 2024-09-21T04:05:36.595 INFO:teuthology.orchestra.run.smithi046.stdout: "put": 214, 2024-09-21T04:05:36.595 INFO:teuthology.orchestra.run.smithi046.stdout: "put_sum": 651063, 2024-09-21T04:05:36.595 INFO:teuthology.orchestra.run.smithi046.stdout: "wait": { 2024-09-21T04:05:36.595 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-21T04:05:36.595 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-21T04:05:36.595 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-21T04:05:36.595 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:36.595 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T04:05:36.595 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T04:05:37.395 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-21T04:05:37.395 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-21T04:05:37.395 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-21T04:05:37.395 DEBUG:tasks.check_counter:Getting stats from b 2024-09-21T04:05:37.396 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph daemon mds.b perf dump 2024-09-21T04:05:37.657 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T04:05:37.778 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:37 smithi105 ceph-mon[34773]: pgmap v643: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:05:37.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:37 smithi162 ceph-mon[35071]: pgmap v643: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:05:38.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:37 smithi046 ceph-mon[30954]: pgmap v643: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:05:38.291 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-21T04:05:38.291 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T04:05:38.291 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 8677, 2024-09-21T04:05:38.291 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 12904, 2024-09-21T04:05:38.291 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 2773398, 2024-09-21T04:05:38.291 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 13444633, 2024-09-21T04:05:38.291 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 13, 2024-09-21T04:05:38.291 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 4, 2024-09-21T04:05:38.292 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 0.821576539, 2024-09-21T04:05:38.292 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.404747348, 2024-09-21T04:05:38.292 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.320412666, 2024-09-21T04:05:38.292 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.125045677, 2024-09-21T04:05:38.292 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:38.292 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 12902, 2024-09-21T04:05:38.292 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.922995346, 2024-09-21T04:05:38.292 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000071538 2024-09-21T04:05:38.292 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.292 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:38.292 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 13591, 2024-09-21T04:05:38.292 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.002357259, 2024-09-21T04:05:38.292 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000173 2024-09-21T04:05:38.293 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.293 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T04:05:38.293 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T04:05:38.293 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.293 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T04:05:38.293 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 3100, 2024-09-21T04:05:38.293 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 3092, 2024-09-21T04:05:38.293 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 1549347, 2024-09-21T04:05:38.293 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 5433869, 2024-09-21T04:05:38.293 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 7, 2024-09-21T04:05:38.293 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 6, 2024-09-21T04:05:38.293 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 0.291577594, 2024-09-21T04:05:38.293 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.131004924, 2024-09-21T04:05:38.293 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.087663609, 2024-09-21T04:05:38.294 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.075442869, 2024-09-21T04:05:38.294 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:38.294 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 3092, 2024-09-21T04:05:38.294 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.536956852, 2024-09-21T04:05:38.294 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000173660 2024-09-21T04:05:38.294 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.294 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:38.294 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:38.294 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:38.294 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:38.294 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.294 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 717456, 2024-09-21T04:05:38.294 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 156224 2024-09-21T04:05:38.295 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.295 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T04:05:38.295 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 2195, 2024-09-21T04:05:38.295 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 1715, 2024-09-21T04:05:38.295 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 705472, 2024-09-21T04:05:38.295 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 4203773, 2024-09-21T04:05:38.295 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 170, 2024-09-21T04:05:38.295 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 9, 2024-09-21T04:05:38.295 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 0.334475555, 2024-09-21T04:05:38.295 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.115638763, 2024-09-21T04:05:38.295 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.122633540, 2024-09-21T04:05:38.296 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.077381094, 2024-09-21T04:05:38.296 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:38.296 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 1713, 2024-09-21T04:05:38.296 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.248543220, 2024-09-21T04:05:38.296 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000145092 2024-09-21T04:05:38.296 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.296 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:38.296 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 1207, 2024-09-21T04:05:38.296 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000235989, 2024-09-21T04:05:38.296 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000195 2024-09-21T04:05:38.296 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.296 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 367536, 2024-09-21T04:05:38.296 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 483760 2024-09-21T04:05:38.297 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.297 INFO:teuthology.orchestra.run.smithi105.stdout: "cct": { 2024-09-21T04:05:38.297 INFO:teuthology.orchestra.run.smithi105.stdout: "total_workers": 1, 2024-09-21T04:05:38.297 INFO:teuthology.orchestra.run.smithi105.stdout: "unhealthy_workers": 0 2024-09-21T04:05:38.297 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.297 INFO:teuthology.orchestra.run.smithi105.stdout: "finisher-MDSRank": { 2024-09-21T04:05:38.297 INFO:teuthology.orchestra.run.smithi105.stdout: "queue_len": 0, 2024-09-21T04:05:38.297 INFO:teuthology.orchestra.run.smithi105.stdout: "complete_latency": { 2024-09-21T04:05:38.297 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 4636, 2024-09-21T04:05:38.297 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 2.273701255, 2024-09-21T04:05:38.297 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000490444 2024-09-21T04:05:38.297 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T04:05:38.297 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.298 INFO:teuthology.orchestra.run.smithi105.stdout: "finisher-PurgeQueue": { 2024-09-21T04:05:38.298 INFO:teuthology.orchestra.run.smithi105.stdout: "queue_len": 0, 2024-09-21T04:05:38.298 INFO:teuthology.orchestra.run.smithi105.stdout: "complete_latency": { 2024-09-21T04:05:38.298 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 3819, 2024-09-21T04:05:38.298 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.242476450, 2024-09-21T04:05:38.298 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000063492 2024-09-21T04:05:38.298 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T04:05:38.298 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.298 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": { 2024-09-21T04:05:38.298 INFO:teuthology.orchestra.run.smithi105.stdout: "request": 2650, 2024-09-21T04:05:38.298 INFO:teuthology.orchestra.run.smithi105.stdout: "reply": 2650, 2024-09-21T04:05:38.298 INFO:teuthology.orchestra.run.smithi105.stdout: "reply_latency": { 2024-09-21T04:05:38.298 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 2650, 2024-09-21T04:05:38.299 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 2.854109720, 2024-09-21T04:05:38.299 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.001077022 2024-09-21T04:05:38.299 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.299 INFO:teuthology.orchestra.run.smithi105.stdout: "slow_reply": 0, 2024-09-21T04:05:38.299 INFO:teuthology.orchestra.run.smithi105.stdout: "forward": 0, 2024-09-21T04:05:38.299 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_fetch_complete": 0, 2024-09-21T04:05:38.299 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_fetch_keys": 0, 2024-09-21T04:05:38.299 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_commit": 45, 2024-09-21T04:05:38.299 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_split": 0, 2024-09-21T04:05:38.299 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_merge": 0, 2024-09-21T04:05:38.299 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes": 77, 2024-09-21T04:05:38.299 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_top": 5, 2024-09-21T04:05:38.299 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_bottom": 72, 2024-09-21T04:05:38.299 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_pin_tail": 0, 2024-09-21T04:05:38.299 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_pinned": 69, 2024-09-21T04:05:38.300 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_expired": 0, 2024-09-21T04:05:38.300 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_with_caps": 3, 2024-09-21T04:05:38.300 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": 4, 2024-09-21T04:05:38.300 INFO:teuthology.orchestra.run.smithi105.stdout: "subtrees": 2, 2024-09-21T04:05:38.300 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse": 2856, 2024-09-21T04:05:38.300 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_hit": 2852, 2024-09-21T04:05:38.300 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_forward": 0, 2024-09-21T04:05:38.300 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_discover": 0, 2024-09-21T04:05:38.300 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_dir_fetch": 0, 2024-09-21T04:05:38.300 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_remote_ino": 0, 2024-09-21T04:05:38.300 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_lock": 0, 2024-09-21T04:05:38.300 INFO:teuthology.orchestra.run.smithi105.stdout: "load_cent": 0, 2024-09-21T04:05:38.300 INFO:teuthology.orchestra.run.smithi105.stdout: "q": 0, 2024-09-21T04:05:38.300 INFO:teuthology.orchestra.run.smithi105.stdout: "exported": 0, 2024-09-21T04:05:38.301 INFO:teuthology.orchestra.run.smithi105.stdout: "exported_inodes": 0, 2024-09-21T04:05:38.301 INFO:teuthology.orchestra.run.smithi105.stdout: "imported": 0, 2024-09-21T04:05:38.301 INFO:teuthology.orchestra.run.smithi105.stdout: "imported_inodes": 0, 2024-09-21T04:05:38.301 INFO:teuthology.orchestra.run.smithi105.stdout: "openino_dir_fetch": 0, 2024-09-21T04:05:38.301 INFO:teuthology.orchestra.run.smithi105.stdout: "openino_backtrace_fetch": 225, 2024-09-21T04:05:38.301 INFO:teuthology.orchestra.run.smithi105.stdout: "openino_peer_discover": 0, 2024-09-21T04:05:38.301 INFO:teuthology.orchestra.run.smithi105.stdout: "root_rfiles": 4, 2024-09-21T04:05:38.301 INFO:teuthology.orchestra.run.smithi105.stdout: "root_rbytes": 234, 2024-09-21T04:05:38.301 INFO:teuthology.orchestra.run.smithi105.stdout: "root_rsnaps": 7, 2024-09-21T04:05:38.301 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_backtrace_fetch": 225, 2024-09-21T04:05:38.301 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_set_tag": 0, 2024-09-21T04:05:38.301 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T04:05:38.301 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_inotable_repaired": 0, 2024-09-21T04:05:38.301 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_dir_inodes": 144, 2024-09-21T04:05:38.302 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_dir_base_inodes": 20, 2024-09-21T04:05:38.302 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_dirfrag_rstats": 124, 2024-09-21T04:05:38.302 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_file_inodes": 81, 2024-09-21T04:05:38.302 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_inode_file_caps": 0, 2024-09-21T04:05:38.302 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_revoke": 32, 2024-09-21T04:05:38.302 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_grant": 3640, 2024-09-21T04:05:38.302 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T04:05:38.302 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T04:05:38.302 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T04:05:38.302 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_caps": 2451, 2024-09-21T04:05:38.302 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_caps_dirty": 1212, 2024-09-21T04:05:38.302 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_cap_release": 11, 2024-09-21T04:05:38.302 INFO:teuthology.orchestra.run.smithi105.stdout: "process_request_cap_release": 1241 2024-09-21T04:05:38.302 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.303 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_cache": { 2024-09-21T04:05:38.303 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_update": 0, 2024-09-21T04:05:38.303 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_update_receipt": 0, 2024-09-21T04:05:38.303 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_try_discover": 0, 2024-09-21T04:05:38.303 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_send_discover": 0, 2024-09-21T04:05:38.303 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_handle_discover": 0, 2024-09-21T04:05:38.303 INFO:teuthology.orchestra.run.smithi105.stdout: "num_strays": 1, 2024-09-21T04:05:38.303 INFO:teuthology.orchestra.run.smithi105.stdout: "num_strays_delayed": 0, 2024-09-21T04:05:38.303 INFO:teuthology.orchestra.run.smithi105.stdout: "num_strays_enqueuing": 0, 2024-09-21T04:05:38.303 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_created": 1212, 2024-09-21T04:05:38.303 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_enqueued": 1211, 2024-09-21T04:05:38.303 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_reintegrated": 0, 2024-09-21T04:05:38.303 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_migrated": 0, 2024-09-21T04:05:38.303 INFO:teuthology.orchestra.run.smithi105.stdout: "num_recovering_processing": 0, 2024-09-21T04:05:38.303 INFO:teuthology.orchestra.run.smithi105.stdout: "num_recovering_enqueued": 0, 2024-09-21T04:05:38.304 INFO:teuthology.orchestra.run.smithi105.stdout: "num_recovering_prioritized": 0, 2024-09-21T04:05:38.304 INFO:teuthology.orchestra.run.smithi105.stdout: "recovery_started": 0, 2024-09-21T04:05:38.304 INFO:teuthology.orchestra.run.smithi105.stdout: "recovery_completed": 0, 2024-09-21T04:05:38.304 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_quiesce_path": 0, 2024-09-21T04:05:38.304 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_quiesce_inode": 0, 2024-09-21T04:05:38.304 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_enqueue_scrub": 20, 2024-09-21T04:05:38.304 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_exportdir": 0, 2024-09-21T04:05:38.304 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_flush": 0, 2024-09-21T04:05:38.304 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_fragmentdir": 0, 2024-09-21T04:05:38.304 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_fragstats": 0, 2024-09-21T04:05:38.304 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_inodestats": 0, 2024-09-21T04:05:38.304 INFO:teuthology.orchestra.run.smithi105.stdout: "uninline_started": 0, 2024-09-21T04:05:38.304 INFO:teuthology.orchestra.run.smithi105.stdout: "uninline_succeeded": 0, 2024-09-21T04:05:38.304 INFO:teuthology.orchestra.run.smithi105.stdout: "uninline_write_failed": 0 2024-09-21T04:05:38.305 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.305 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_log": { 2024-09-21T04:05:38.305 INFO:teuthology.orchestra.run.smithi105.stdout: "evlrg": 0, 2024-09-21T04:05:38.305 INFO:teuthology.orchestra.run.smithi105.stdout: "evadd": 6181, 2024-09-21T04:05:38.305 INFO:teuthology.orchestra.run.smithi105.stdout: "evex": 1143, 2024-09-21T04:05:38.305 INFO:teuthology.orchestra.run.smithi105.stdout: "evtrm": 1143, 2024-09-21T04:05:38.305 INFO:teuthology.orchestra.run.smithi105.stdout: "ev": 5038, 2024-09-21T04:05:38.305 INFO:teuthology.orchestra.run.smithi105.stdout: "evexg": 0, 2024-09-21T04:05:38.305 INFO:teuthology.orchestra.run.smithi105.stdout: "evexd": 1087, 2024-09-21T04:05:38.305 INFO:teuthology.orchestra.run.smithi105.stdout: "segadd": 14, 2024-09-21T04:05:38.305 INFO:teuthology.orchestra.run.smithi105.stdout: "segex": 8, 2024-09-21T04:05:38.305 INFO:teuthology.orchestra.run.smithi105.stdout: "segtrm": 8, 2024-09-21T04:05:38.305 INFO:teuthology.orchestra.run.smithi105.stdout: "seg": 6, 2024-09-21T04:05:38.305 INFO:teuthology.orchestra.run.smithi105.stdout: "segmjr": 1, 2024-09-21T04:05:38.306 INFO:teuthology.orchestra.run.smithi105.stdout: "segexg": 0, 2024-09-21T04:05:38.306 INFO:teuthology.orchestra.run.smithi105.stdout: "segexd": 2, 2024-09-21T04:05:38.306 INFO:teuthology.orchestra.run.smithi105.stdout: "expos": 6844418, 2024-09-21T04:05:38.306 INFO:teuthology.orchestra.run.smithi105.stdout: "wrpos": 17876495, 2024-09-21T04:05:38.306 INFO:teuthology.orchestra.run.smithi105.stdout: "rdpos": 0, 2024-09-21T04:05:38.306 INFO:teuthology.orchestra.run.smithi105.stdout: "jlat": { 2024-09-21T04:05:38.306 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 2503, 2024-09-21T04:05:38.306 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 4.283822858, 2024-09-21T04:05:38.306 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.001711475 2024-09-21T04:05:38.306 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.306 INFO:teuthology.orchestra.run.smithi105.stdout: "replayed": 0 2024-09-21T04:05:38.306 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.306 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_mem": { 2024-09-21T04:05:38.306 INFO:teuthology.orchestra.run.smithi105.stdout: "ino": 24, 2024-09-21T04:05:38.307 INFO:teuthology.orchestra.run.smithi105.stdout: "ino+": 1255, 2024-09-21T04:05:38.307 INFO:teuthology.orchestra.run.smithi105.stdout: "ino-": 1231, 2024-09-21T04:05:38.307 INFO:teuthology.orchestra.run.smithi105.stdout: "dir": 19, 2024-09-21T04:05:38.307 INFO:teuthology.orchestra.run.smithi105.stdout: "dir+": 24, 2024-09-21T04:05:38.307 INFO:teuthology.orchestra.run.smithi105.stdout: "dir-": 5, 2024-09-21T04:05:38.307 INFO:teuthology.orchestra.run.smithi105.stdout: "dn": 77, 2024-09-21T04:05:38.307 INFO:teuthology.orchestra.run.smithi105.stdout: "dn+": 1244, 2024-09-21T04:05:38.307 INFO:teuthology.orchestra.run.smithi105.stdout: "dn-": 1167, 2024-09-21T04:05:38.307 INFO:teuthology.orchestra.run.smithi105.stdout: "cap": 4, 2024-09-21T04:05:38.307 INFO:teuthology.orchestra.run.smithi105.stdout: "cap+": 1227, 2024-09-21T04:05:38.307 INFO:teuthology.orchestra.run.smithi105.stdout: "cap-": 1223, 2024-09-21T04:05:38.307 INFO:teuthology.orchestra.run.smithi105.stdout: "rss": 130392, 2024-09-21T04:05:38.307 INFO:teuthology.orchestra.run.smithi105.stdout: "heap": 342769664 2024-09-21T04:05:38.307 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.308 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_server": { 2024-09-21T04:05:38.308 INFO:teuthology.orchestra.run.smithi105.stdout: "dispatch_client_request": 2697, 2024-09-21T04:05:38.308 INFO:teuthology.orchestra.run.smithi105.stdout: "dispatch_server_request": 0, 2024-09-21T04:05:38.308 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_request": 2650, 2024-09-21T04:05:38.308 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_session": 24, 2024-09-21T04:05:38.308 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_peer_request": 0, 2024-09-21T04:05:38.308 INFO:teuthology.orchestra.run.smithi105.stdout: "req_create_latency": { 2024-09-21T04:05:38.308 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 1210, 2024-09-21T04:05:38.308 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 1.137931656, 2024-09-21T04:05:38.308 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000940439 2024-09-21T04:05:38.308 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.308 INFO:teuthology.orchestra.run.smithi105.stdout: "req_getattr_latency": { 2024-09-21T04:05:38.308 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 172, 2024-09-21T04:05:38.308 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.038126100, 2024-09-21T04:05:38.309 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000221663 2024-09-21T04:05:38.309 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.309 INFO:teuthology.orchestra.run.smithi105.stdout: "req_getfilelock_latency": { 2024-09-21T04:05:38.309 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:38.309 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:38.309 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:38.309 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.309 INFO:teuthology.orchestra.run.smithi105.stdout: "req_link_latency": { 2024-09-21T04:05:38.309 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:38.309 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:38.309 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:38.310 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.310 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookup_latency": { 2024-09-21T04:05:38.310 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:38.310 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:38.310 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:38.310 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.310 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookuphash_latency": { 2024-09-21T04:05:38.310 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:38.310 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:38.310 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:38.310 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.310 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupino_latency": { 2024-09-21T04:05:38.311 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 2, 2024-09-21T04:05:38.311 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000280522, 2024-09-21T04:05:38.311 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000140261 2024-09-21T04:05:38.311 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.311 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupname_latency": { 2024-09-21T04:05:38.311 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:38.311 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:38.311 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:38.311 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.311 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupparent_latency": { 2024-09-21T04:05:38.311 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:38.311 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:38.311 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:38.311 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.312 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupsnap_latency": { 2024-09-21T04:05:38.312 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:38.312 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:38.312 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:38.312 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.312 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lssnap_latency": { 2024-09-21T04:05:38.313 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 10, 2024-09-21T04:05:38.313 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.001459152, 2024-09-21T04:05:38.313 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000145915 2024-09-21T04:05:38.313 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.313 INFO:teuthology.orchestra.run.smithi105.stdout: "req_mkdir_latency": { 2024-09-21T04:05:38.313 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 12, 2024-09-21T04:05:38.313 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.015494300, 2024-09-21T04:05:38.313 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.001291191 2024-09-21T04:05:38.313 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.313 INFO:teuthology.orchestra.run.smithi105.stdout: "req_mknod_latency": { 2024-09-21T04:05:38.313 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:38.313 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:38.313 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:38.314 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.314 INFO:teuthology.orchestra.run.smithi105.stdout: "req_mksnap_latency": { 2024-09-21T04:05:38.314 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 10, 2024-09-21T04:05:38.314 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.045359244, 2024-09-21T04:05:38.314 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.004535924 2024-09-21T04:05:38.314 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.314 INFO:teuthology.orchestra.run.smithi105.stdout: "req_open_latency": { 2024-09-21T04:05:38.314 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 1, 2024-09-21T04:05:38.314 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000202925, 2024-09-21T04:05:38.314 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000202925 2024-09-21T04:05:38.314 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.314 INFO:teuthology.orchestra.run.smithi105.stdout: "req_readdir_latency": { 2024-09-21T04:05:38.315 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 6, 2024-09-21T04:05:38.315 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.005203018, 2024-09-21T04:05:38.315 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000867169 2024-09-21T04:05:38.315 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.315 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rename_latency": { 2024-09-21T04:05:38.315 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 2, 2024-09-21T04:05:38.315 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.002114387, 2024-09-21T04:05:38.315 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.001057193 2024-09-21T04:05:38.315 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.315 INFO:teuthology.orchestra.run.smithi105.stdout: "req_renamesnap_latency": { 2024-09-21T04:05:38.316 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:38.316 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:38.316 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:38.316 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.316 INFO:teuthology.orchestra.run.smithi105.stdout: "req_snapdiff_latency": { 2024-09-21T04:05:38.316 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:38.316 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:38.316 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:38.316 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.316 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rmdir_latency": { 2024-09-21T04:05:38.316 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 6, 2024-09-21T04:05:38.316 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.021656620, 2024-09-21T04:05:38.316 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.003609436 2024-09-21T04:05:38.316 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.317 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rmsnap_latency": { 2024-09-21T04:05:38.317 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 3, 2024-09-21T04:05:38.317 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.012157721, 2024-09-21T04:05:38.317 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.004052573 2024-09-21T04:05:38.317 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.317 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rmxattr_latency": { 2024-09-21T04:05:38.317 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:38.317 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:38.317 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:38.317 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.317 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setattr_latency": { 2024-09-21T04:05:38.317 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 1, 2024-09-21T04:05:38.317 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.001205407, 2024-09-21T04:05:38.317 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.001205407 2024-09-21T04:05:38.318 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.318 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setdirlayout_latency": { 2024-09-21T04:05:38.318 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:38.318 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:38.318 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:38.318 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.318 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setfilelock_latency": { 2024-09-21T04:05:38.318 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:38.318 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:38.318 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:38.318 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.318 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setlayout_latency": { 2024-09-21T04:05:38.318 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:38.319 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:38.319 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:38.319 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.319 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setxattr_latency": { 2024-09-21T04:05:38.319 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 9, 2024-09-21T04:05:38.319 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.021626409, 2024-09-21T04:05:38.319 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.002402934 2024-09-21T04:05:38.319 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.319 INFO:teuthology.orchestra.run.smithi105.stdout: "req_symlink_latency": { 2024-09-21T04:05:38.319 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:38.319 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:38.319 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:38.319 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.320 INFO:teuthology.orchestra.run.smithi105.stdout: "req_unlink_latency": { 2024-09-21T04:05:38.320 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 1206, 2024-09-21T04:05:38.320 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 1.551292259, 2024-09-21T04:05:38.320 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.001286311 2024-09-21T04:05:38.320 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.320 INFO:teuthology.orchestra.run.smithi105.stdout: "cap_revoke_eviction": 0, 2024-09-21T04:05:38.320 INFO:teuthology.orchestra.run.smithi105.stdout: "cap_acquisition_throttle": 0, 2024-09-21T04:05:38.320 INFO:teuthology.orchestra.run.smithi105.stdout: "req_getvxattr_latency": { 2024-09-21T04:05:38.320 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:38.320 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:38.320 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:38.320 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T04:05:38.320 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.320 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_sessions": { 2024-09-21T04:05:38.320 INFO:teuthology.orchestra.run.smithi105.stdout: "session_count": 2, 2024-09-21T04:05:38.321 INFO:teuthology.orchestra.run.smithi105.stdout: "session_add": 3, 2024-09-21T04:05:38.321 INFO:teuthology.orchestra.run.smithi105.stdout: "session_remove": 1, 2024-09-21T04:05:38.321 INFO:teuthology.orchestra.run.smithi105.stdout: "sessions_open": 2, 2024-09-21T04:05:38.321 INFO:teuthology.orchestra.run.smithi105.stdout: "sessions_stale": 0, 2024-09-21T04:05:38.321 INFO:teuthology.orchestra.run.smithi105.stdout: "total_load": 31, 2024-09-21T04:05:38.321 INFO:teuthology.orchestra.run.smithi105.stdout: "average_load": 15, 2024-09-21T04:05:38.321 INFO:teuthology.orchestra.run.smithi105.stdout: "avg_session_uptime": 606, 2024-09-21T04:05:38.321 INFO:teuthology.orchestra.run.smithi105.stdout: "mdthresh_evicted": 0 2024-09-21T04:05:38.321 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.321 INFO:teuthology.orchestra.run.smithi105.stdout: "mempool": { 2024-09-21T04:05:38.321 INFO:teuthology.orchestra.run.smithi105.stdout: "bloom_filter_bytes": 0, 2024-09-21T04:05:38.322 INFO:teuthology.orchestra.run.smithi105.stdout: "bloom_filter_items": 0, 2024-09-21T04:05:38.322 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T04:05:38.322 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_alloc_items": 0, 2024-09-21T04:05:38.322 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T04:05:38.322 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_data_items": 0, 2024-09-21T04:05:38.322 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T04:05:38.322 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T04:05:38.322 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T04:05:38.322 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T04:05:38.322 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T04:05:38.322 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_other_items": 0, 2024-09-21T04:05:38.323 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T04:05:38.323 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T04:05:38.323 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_extent_bytes": 0, 2024-09-21T04:05:38.323 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_extent_items": 0, 2024-09-21T04:05:38.323 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_blob_bytes": 0, 2024-09-21T04:05:38.323 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_blob_items": 0, 2024-09-21T04:05:38.323 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T04:05:38.323 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T04:05:38.323 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T04:05:38.323 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T04:05:38.323 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T04:05:38.323 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_fsck_items": 0, 2024-09-21T04:05:38.323 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_txc_bytes": 0, 2024-09-21T04:05:38.323 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_txc_items": 0, 2024-09-21T04:05:38.324 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T04:05:38.324 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T04:05:38.324 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_bytes": 0, 2024-09-21T04:05:38.324 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_items": 0, 2024-09-21T04:05:38.324 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_bytes": 0, 2024-09-21T04:05:38.324 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_items": 0, 2024-09-21T04:05:38.324 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T04:05:38.324 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_reader_items": 0, 2024-09-21T04:05:38.324 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T04:05:38.324 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_writer_items": 0, 2024-09-21T04:05:38.324 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_anon_bytes": 319171, 2024-09-21T04:05:38.324 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_anon_items": 136, 2024-09-21T04:05:38.324 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_meta_bytes": 704, 2024-09-21T04:05:38.324 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_meta_items": 8, 2024-09-21T04:05:38.325 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_bytes": 0, 2024-09-21T04:05:38.325 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_items": 0, 2024-09-21T04:05:38.325 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_mapbl_bytes": 0, 2024-09-21T04:05:38.325 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_mapbl_items": 0, 2024-09-21T04:05:38.325 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_pglog_bytes": 0, 2024-09-21T04:05:38.325 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_pglog_items": 0, 2024-09-21T04:05:38.325 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_bytes": 7872, 2024-09-21T04:05:38.325 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_items": 174, 2024-09-21T04:05:38.325 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T04:05:38.325 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_mapping_items": 0, 2024-09-21T04:05:38.325 INFO:teuthology.orchestra.run.smithi105.stdout: "pgmap_bytes": 0, 2024-09-21T04:05:38.325 INFO:teuthology.orchestra.run.smithi105.stdout: "pgmap_items": 0, 2024-09-21T04:05:38.325 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_co_bytes": 147311, 2024-09-21T04:05:38.325 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_co_items": 1284, 2024-09-21T04:05:38.326 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_1_bytes": 0, 2024-09-21T04:05:38.326 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_1_items": 0, 2024-09-21T04:05:38.326 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_2_bytes": 0, 2024-09-21T04:05:38.326 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_2_items": 0 2024-09-21T04:05:38.326 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.326 INFO:teuthology.orchestra.run.smithi105.stdout: "objecter": { 2024-09-21T04:05:38.326 INFO:teuthology.orchestra.run.smithi105.stdout: "op_active": 0, 2024-09-21T04:05:38.326 INFO:teuthology.orchestra.run.smithi105.stdout: "op_laggy": 0, 2024-09-21T04:05:38.326 INFO:teuthology.orchestra.run.smithi105.stdout: "op_send": 7049, 2024-09-21T04:05:38.326 INFO:teuthology.orchestra.run.smithi105.stdout: "op_send_bytes": 14010063, 2024-09-21T04:05:38.326 INFO:teuthology.orchestra.run.smithi105.stdout: "op_resend": 37, 2024-09-21T04:05:38.326 INFO:teuthology.orchestra.run.smithi105.stdout: "op_reply": 7049, 2024-09-21T04:05:38.326 INFO:teuthology.orchestra.run.smithi105.stdout: "op_latency": { 2024-09-21T04:05:38.327 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 7049, 2024-09-21T04:05:38.327 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 43.103133818, 2024-09-21T04:05:38.327 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.006114787 2024-09-21T04:05:38.327 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.327 INFO:teuthology.orchestra.run.smithi105.stdout: "op_inflight": 0, 2024-09-21T04:05:38.327 INFO:teuthology.orchestra.run.smithi105.stdout: "oplen_avg": { 2024-09-21T04:05:38.327 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 7049, 2024-09-21T04:05:38.327 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 7325 2024-09-21T04:05:38.327 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.327 INFO:teuthology.orchestra.run.smithi105.stdout: "op": 7049, 2024-09-21T04:05:38.327 INFO:teuthology.orchestra.run.smithi105.stdout: "op_r": 290, 2024-09-21T04:05:38.327 INFO:teuthology.orchestra.run.smithi105.stdout: "op_w": 6759, 2024-09-21T04:05:38.327 INFO:teuthology.orchestra.run.smithi105.stdout: "op_rmw": 0, 2024-09-21T04:05:38.328 INFO:teuthology.orchestra.run.smithi105.stdout: "op_pg": 0, 2024-09-21T04:05:38.328 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_stat": 24, 2024-09-21T04:05:38.328 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_create": 83, 2024-09-21T04:05:38.328 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_read": 45, 2024-09-21T04:05:38.328 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_write": 2528, 2024-09-21T04:05:38.328 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_writefull": 46, 2024-09-21T04:05:38.328 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_writesame": 0, 2024-09-21T04:05:38.328 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_append": 0, 2024-09-21T04:05:38.328 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_zero": 0, 2024-09-21T04:05:38.328 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_truncate": 0, 2024-09-21T04:05:38.328 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_delete": 4012, 2024-09-21T04:05:38.328 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_mapext": 0, 2024-09-21T04:05:38.328 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_sparse_read": 0, 2024-09-21T04:05:38.328 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_clonerange": 0, 2024-09-21T04:05:38.329 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_getxattr": 245, 2024-09-21T04:05:38.329 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_setxattr": 166, 2024-09-21T04:05:38.329 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_cmpxattr": 0, 2024-09-21T04:05:38.329 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_rmxattr": 0, 2024-09-21T04:05:38.329 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_resetxattrs": 0, 2024-09-21T04:05:38.329 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_call": 0, 2024-09-21T04:05:38.329 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_watch": 0, 2024-09-21T04:05:38.329 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_notify": 0, 2024-09-21T04:05:38.329 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T04:05:38.329 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_pgls": 0, 2024-09-21T04:05:38.329 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_pgls_filter": 0, 2024-09-21T04:05:38.329 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_other": 0, 2024-09-21T04:05:38.329 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_active": 0, 2024-09-21T04:05:38.329 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_send": 0, 2024-09-21T04:05:38.329 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_resend": 0, 2024-09-21T04:05:38.330 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_ping": 0, 2024-09-21T04:05:38.330 INFO:teuthology.orchestra.run.smithi105.stdout: "poolop_active": 0, 2024-09-21T04:05:38.330 INFO:teuthology.orchestra.run.smithi105.stdout: "poolop_send": 0, 2024-09-21T04:05:38.330 INFO:teuthology.orchestra.run.smithi105.stdout: "poolop_resend": 0, 2024-09-21T04:05:38.330 INFO:teuthology.orchestra.run.smithi105.stdout: "poolstat_active": 0, 2024-09-21T04:05:38.330 INFO:teuthology.orchestra.run.smithi105.stdout: "poolstat_send": 0, 2024-09-21T04:05:38.330 INFO:teuthology.orchestra.run.smithi105.stdout: "poolstat_resend": 0, 2024-09-21T04:05:38.330 INFO:teuthology.orchestra.run.smithi105.stdout: "statfs_active": 0, 2024-09-21T04:05:38.330 INFO:teuthology.orchestra.run.smithi105.stdout: "statfs_send": 0, 2024-09-21T04:05:38.330 INFO:teuthology.orchestra.run.smithi105.stdout: "statfs_resend": 0, 2024-09-21T04:05:38.330 INFO:teuthology.orchestra.run.smithi105.stdout: "command_active": 0, 2024-09-21T04:05:38.330 INFO:teuthology.orchestra.run.smithi105.stdout: "command_send": 0, 2024-09-21T04:05:38.330 INFO:teuthology.orchestra.run.smithi105.stdout: "command_resend": 0, 2024-09-21T04:05:38.330 INFO:teuthology.orchestra.run.smithi105.stdout: "map_epoch": 83, 2024-09-21T04:05:38.331 INFO:teuthology.orchestra.run.smithi105.stdout: "map_full": 0, 2024-09-21T04:05:38.331 INFO:teuthology.orchestra.run.smithi105.stdout: "map_inc": 8, 2024-09-21T04:05:38.331 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_sessions": 12, 2024-09-21T04:05:38.331 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_session_open": 12, 2024-09-21T04:05:38.331 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_session_close": 0, 2024-09-21T04:05:38.331 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_laggy": 0, 2024-09-21T04:05:38.331 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_wr": 153, 2024-09-21T04:05:38.331 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_rd": 0, 2024-09-21T04:05:38.331 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_del": 23 2024-09-21T04:05:38.331 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.331 INFO:teuthology.orchestra.run.smithi105.stdout: "oft": { 2024-09-21T04:05:38.331 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_objs": 1, 2024-09-21T04:05:38.331 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_kv_pairs": 0, 2024-09-21T04:05:38.331 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_updates": 0, 2024-09-21T04:05:38.331 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_removes": 0 2024-09-21T04:05:38.332 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.332 INFO:teuthology.orchestra.run.smithi105.stdout: "purge_queue": { 2024-09-21T04:05:38.332 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing_ops": 0, 2024-09-21T04:05:38.332 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing_ops_high_water": 34, 2024-09-21T04:05:38.332 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing": 0, 2024-09-21T04:05:38.332 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing_high_water": 13, 2024-09-21T04:05:38.332 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executed_ops": 3497, 2024-09-21T04:05:38.332 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executed": 1211, 2024-09-21T04:05:38.332 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_item_in_journal": 0 2024-09-21T04:05:38.332 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.332 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T04:05:38.332 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2024-09-21T04:05:38.332 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 104857600, 2024-09-21T04:05:38.333 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2024-09-21T04:05:38.333 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 13968, 2024-09-21T04:05:38.333 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 3714629, 2024-09-21T04:05:38.333 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2024-09-21T04:05:38.333 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 13968, 2024-09-21T04:05:38.333 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 0, 2024-09-21T04:05:38.333 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 0, 2024-09-21T04:05:38.333 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 13968, 2024-09-21T04:05:38.333 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 3714629, 2024-09-21T04:05:38.333 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2024-09-21T04:05:38.333 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:38.333 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:38.333 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:38.333 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T04:05:38.334 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.334 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-objecter_bytes": { 2024-09-21T04:05:38.334 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2024-09-21T04:05:38.334 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 104857600, 2024-09-21T04:05:38.334 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2024-09-21T04:05:38.334 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 0, 2024-09-21T04:05:38.334 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 0, 2024-09-21T04:05:38.334 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2024-09-21T04:05:38.334 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 0, 2024-09-21T04:05:38.334 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 7049, 2024-09-21T04:05:38.334 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 14132374, 2024-09-21T04:05:38.334 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 7049, 2024-09-21T04:05:38.335 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 14132374, 2024-09-21T04:05:38.335 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2024-09-21T04:05:38.335 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:38.335 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:38.335 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:38.335 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T04:05:38.335 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.335 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-objecter_ops": { 2024-09-21T04:05:38.335 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2024-09-21T04:05:38.335 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 1024, 2024-09-21T04:05:38.336 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2024-09-21T04:05:38.336 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 0, 2024-09-21T04:05:38.336 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 0, 2024-09-21T04:05:38.336 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2024-09-21T04:05:38.336 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 0, 2024-09-21T04:05:38.336 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 7049, 2024-09-21T04:05:38.336 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 7049, 2024-09-21T04:05:38.336 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 7049, 2024-09-21T04:05:38.336 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 7049, 2024-09-21T04:05:38.336 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2024-09-21T04:05:38.336 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:38.336 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:38.336 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:38.336 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T04:05:38.337 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.337 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-write_buf_throttle": { 2024-09-21T04:05:38.337 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2024-09-21T04:05:38.337 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 3758096384, 2024-09-21T04:05:38.337 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2024-09-21T04:05:38.337 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 1211, 2024-09-21T04:05:38.337 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 122311, 2024-09-21T04:05:38.337 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2024-09-21T04:05:38.337 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 1211, 2024-09-21T04:05:38.337 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 0, 2024-09-21T04:05:38.337 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 0, 2024-09-21T04:05:38.337 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 25, 2024-09-21T04:05:38.337 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 122311, 2024-09-21T04:05:38.337 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2024-09-21T04:05:38.338 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:38.338 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:38.338 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:38.338 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T04:05:38.338 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.338 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-write_buf_throttle-0x55f10e36b1e0": { 2024-09-21T04:05:38.338 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2024-09-21T04:05:38.338 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 3758096384, 2024-09-21T04:05:38.338 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2024-09-21T04:05:38.338 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 6181, 2024-09-21T04:05:38.338 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 13682191, 2024-09-21T04:05:38.338 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2024-09-21T04:05:38.338 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 6181, 2024-09-21T04:05:38.339 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 0, 2024-09-21T04:05:38.339 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 0, 2024-09-21T04:05:38.339 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 2503, 2024-09-21T04:05:38.339 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 13682191, 2024-09-21T04:05:38.339 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2024-09-21T04:05:38.339 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:38.339 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:38.339 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:38.339 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T04:05:38.339 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:38.339 INFO:teuthology.orchestra.run.smithi105.stdout: "trackedop": { 2024-09-21T04:05:38.339 INFO:teuthology.orchestra.run.smithi105.stdout: "slow_ops_count": 0 2024-09-21T04:05:38.339 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T04:05:38.339 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-21T04:05:39.193 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=7 2024-09-21T04:05:39.193 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=10 2024-09-21T04:05:39.193 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=3 2024-09-21T04:05:39.193 DEBUG:tasks.check_counter:Getting stats from e 2024-09-21T04:05:39.193 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph daemon mds.e perf dump 2024-09-21T04:05:39.445 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T04:05:39.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:39 smithi105 ceph-mon[34773]: pgmap v644: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:05:39.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:39 smithi162 ceph-mon[35071]: pgmap v644: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:05:40.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:39 smithi046 ceph-mon[30954]: pgmap v644: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:05:40.007 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-21T04:05:40.008 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T04:05:40.008 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 0, 2024-09-21T04:05:40.008 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 2, 2024-09-21T04:05:40.008 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 0, 2024-09-21T04:05:40.008 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 0, 2024-09-21T04:05:40.008 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 4, 2024-09-21T04:05:40.008 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 0, 2024-09-21T04:05:40.008 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 0.001177708, 2024-09-21T04:05:40.008 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T04:05:40.008 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.000293548, 2024-09-21T04:05:40.008 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:05:40.008 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:40.008 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:40.009 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:40.009 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:40.009 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:40.009 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:40.009 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:40.009 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:40.009 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:40.009 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:40.009 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T04:05:40.009 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T04:05:40.009 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:40.009 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T04:05:40.009 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 212, 2024-09-21T04:05:40.010 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 208, 2024-09-21T04:05:40.010 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 680896, 2024-09-21T04:05:40.010 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 127904, 2024-09-21T04:05:40.010 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 2, 2024-09-21T04:05:40.010 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 1, 2024-09-21T04:05:40.010 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 0.039276984, 2024-09-21T04:05:40.010 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.018784679, 2024-09-21T04:05:40.010 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.028693788, 2024-09-21T04:05:40.010 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:05:40.010 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:40.010 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 207, 2024-09-21T04:05:40.010 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.013106373, 2024-09-21T04:05:40.010 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000063315 2024-09-21T04:05:40.011 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:40.011 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:40.011 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:40.011 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:40.011 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:40.011 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:40.011 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 680896, 2024-09-21T04:05:40.011 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 127904 2024-09-21T04:05:40.011 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:40.011 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T04:05:40.011 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 5, 2024-09-21T04:05:40.011 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 161, 2024-09-21T04:05:40.011 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 3104, 2024-09-21T04:05:40.011 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 108624, 2024-09-21T04:05:40.012 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 3, 2024-09-21T04:05:40.012 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 2, 2024-09-21T04:05:40.012 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 0.015794226, 2024-09-21T04:05:40.012 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.011040576, 2024-09-21T04:05:40.012 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.002757105, 2024-09-21T04:05:40.012 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:05:40.012 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:40.012 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 160, 2024-09-21T04:05:40.012 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.015529811, 2024-09-21T04:05:40.012 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000097061 2024-09-21T04:05:40.012 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:40.012 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:40.012 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:40.012 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:40.013 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:40.013 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:40.013 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-21T04:05:40.013 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 108624 2024-09-21T04:05:40.013 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:40.013 INFO:teuthology.orchestra.run.smithi105.stdout: "cct": { 2024-09-21T04:05:40.013 INFO:teuthology.orchestra.run.smithi105.stdout: "total_workers": 0, 2024-09-21T04:05:40.013 INFO:teuthology.orchestra.run.smithi105.stdout: "unhealthy_workers": 0 2024-09-21T04:05:40.013 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:40.013 INFO:teuthology.orchestra.run.smithi105.stdout: "mempool": { 2024-09-21T04:05:40.013 INFO:teuthology.orchestra.run.smithi105.stdout: "bloom_filter_bytes": 0, 2024-09-21T04:05:40.013 INFO:teuthology.orchestra.run.smithi105.stdout: "bloom_filter_items": 0, 2024-09-21T04:05:40.013 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T04:05:40.014 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_alloc_items": 0, 2024-09-21T04:05:40.014 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T04:05:40.014 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_data_items": 0, 2024-09-21T04:05:40.014 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T04:05:40.014 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T04:05:40.014 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T04:05:40.014 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T04:05:40.014 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T04:05:40.014 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_other_items": 0, 2024-09-21T04:05:40.014 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T04:05:40.014 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T04:05:40.014 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_extent_bytes": 0, 2024-09-21T04:05:40.014 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_extent_items": 0, 2024-09-21T04:05:40.015 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_blob_bytes": 0, 2024-09-21T04:05:40.015 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_blob_items": 0, 2024-09-21T04:05:40.015 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T04:05:40.015 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T04:05:40.015 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T04:05:40.015 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T04:05:40.015 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T04:05:40.015 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_fsck_items": 0, 2024-09-21T04:05:40.015 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_txc_bytes": 0, 2024-09-21T04:05:40.015 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_txc_items": 0, 2024-09-21T04:05:40.015 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T04:05:40.015 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T04:05:40.015 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_bytes": 0, 2024-09-21T04:05:40.015 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_items": 0, 2024-09-21T04:05:40.016 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_bytes": 0, 2024-09-21T04:05:40.016 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_items": 0, 2024-09-21T04:05:40.016 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T04:05:40.016 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_reader_items": 0, 2024-09-21T04:05:40.016 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T04:05:40.016 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_writer_items": 0, 2024-09-21T04:05:40.016 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_anon_bytes": 148967, 2024-09-21T04:05:40.016 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_anon_items": 29, 2024-09-21T04:05:40.016 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_meta_bytes": 0, 2024-09-21T04:05:40.016 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_meta_items": 0, 2024-09-21T04:05:40.016 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_bytes": 0, 2024-09-21T04:05:40.016 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_items": 0, 2024-09-21T04:05:40.016 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_mapbl_bytes": 0, 2024-09-21T04:05:40.017 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_mapbl_items": 0, 2024-09-21T04:05:40.017 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_pglog_bytes": 0, 2024-09-21T04:05:40.017 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_pglog_items": 0, 2024-09-21T04:05:40.017 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_bytes": 0, 2024-09-21T04:05:40.017 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_items": 0, 2024-09-21T04:05:40.017 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T04:05:40.017 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_mapping_items": 0, 2024-09-21T04:05:40.017 INFO:teuthology.orchestra.run.smithi105.stdout: "pgmap_bytes": 0, 2024-09-21T04:05:40.017 INFO:teuthology.orchestra.run.smithi105.stdout: "pgmap_items": 0, 2024-09-21T04:05:40.017 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_co_bytes": 968, 2024-09-21T04:05:40.017 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_co_items": 2, 2024-09-21T04:05:40.017 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_1_bytes": 0, 2024-09-21T04:05:40.017 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_1_items": 0, 2024-09-21T04:05:40.018 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_2_bytes": 0, 2024-09-21T04:05:40.018 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_2_items": 0 2024-09-21T04:05:40.018 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:40.018 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T04:05:40.018 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2024-09-21T04:05:40.018 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 104857600, 2024-09-21T04:05:40.018 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2024-09-21T04:05:40.018 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 213, 2024-09-21T04:05:40.018 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 650933, 2024-09-21T04:05:40.018 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2024-09-21T04:05:40.018 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 213, 2024-09-21T04:05:40.018 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 0, 2024-09-21T04:05:40.018 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 0, 2024-09-21T04:05:40.018 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 213, 2024-09-21T04:05:40.019 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 650933, 2024-09-21T04:05:40.019 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2024-09-21T04:05:40.019 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:40.019 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:40.019 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:40.019 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T04:05:40.019 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T04:05:40.019 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-21T04:05:40.702 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.e 2024-09-21T04:05:40.702 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.e 2024-09-21T04:05:40.702 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.e 2024-09-21T04:05:40.702 DEBUG:tasks.check_counter:Getting stats from h 2024-09-21T04:05:40.702 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph daemon mds.h perf dump 2024-09-21T04:05:40.949 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T04:05:41.489 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-21T04:05:41.489 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T04:05:41.489 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 0, 2024-09-21T04:05:41.490 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 2, 2024-09-21T04:05:41.490 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 0, 2024-09-21T04:05:41.490 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 0, 2024-09-21T04:05:41.490 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 4, 2024-09-21T04:05:41.490 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 0, 2024-09-21T04:05:41.490 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 0.001253627, 2024-09-21T04:05:41.490 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T04:05:41.490 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.000360334, 2024-09-21T04:05:41.490 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:05:41.490 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:41.490 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:41.490 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:41.491 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:41.491 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:41.491 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:41.491 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:41.491 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:41.491 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:41.491 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:41.491 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T04:05:41.491 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T04:05:41.491 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:41.491 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T04:05:41.491 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 5, 2024-09-21T04:05:41.491 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 159, 2024-09-21T04:05:41.491 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 3104, 2024-09-21T04:05:41.492 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 108272, 2024-09-21T04:05:41.492 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 3, 2024-09-21T04:05:41.492 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 2, 2024-09-21T04:05:41.492 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 0.015456855, 2024-09-21T04:05:41.492 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.010889754, 2024-09-21T04:05:41.492 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.002588764, 2024-09-21T04:05:41.492 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:05:41.492 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:41.492 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 158, 2024-09-21T04:05:41.492 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.015345278, 2024-09-21T04:05:41.492 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000097122 2024-09-21T04:05:41.492 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:41.492 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:41.493 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:41.493 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:41.493 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:41.493 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:41.493 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-21T04:05:41.493 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 108272 2024-09-21T04:05:41.493 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:41.493 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T04:05:41.493 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 211, 2024-09-21T04:05:41.493 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 207, 2024-09-21T04:05:41.493 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 680624, 2024-09-21T04:05:41.493 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 127264, 2024-09-21T04:05:41.493 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 2, 2024-09-21T04:05:41.494 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 1, 2024-09-21T04:05:41.494 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 0.038524151, 2024-09-21T04:05:41.494 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.019408954, 2024-09-21T04:05:41.494 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.024479618, 2024-09-21T04:05:41.494 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:05:41.494 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:41.494 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 206, 2024-09-21T04:05:41.494 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.011957515, 2024-09-21T04:05:41.494 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000058046 2024-09-21T04:05:41.494 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:41.494 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:41.494 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:41.495 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:41.495 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:41.495 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:41.495 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 680624, 2024-09-21T04:05:41.495 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 127264 2024-09-21T04:05:41.495 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:41.495 INFO:teuthology.orchestra.run.smithi105.stdout: "cct": { 2024-09-21T04:05:41.495 INFO:teuthology.orchestra.run.smithi105.stdout: "total_workers": 0, 2024-09-21T04:05:41.495 INFO:teuthology.orchestra.run.smithi105.stdout: "unhealthy_workers": 0 2024-09-21T04:05:41.495 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:41.495 INFO:teuthology.orchestra.run.smithi105.stdout: "mempool": { 2024-09-21T04:05:41.495 INFO:teuthology.orchestra.run.smithi105.stdout: "bloom_filter_bytes": 0, 2024-09-21T04:05:41.495 INFO:teuthology.orchestra.run.smithi105.stdout: "bloom_filter_items": 0, 2024-09-21T04:05:41.496 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T04:05:41.496 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_alloc_items": 0, 2024-09-21T04:05:41.496 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T04:05:41.496 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_data_items": 0, 2024-09-21T04:05:41.496 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T04:05:41.496 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T04:05:41.496 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T04:05:41.496 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T04:05:41.496 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T04:05:41.496 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_other_items": 0, 2024-09-21T04:05:41.496 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T04:05:41.496 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T04:05:41.496 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_extent_bytes": 0, 2024-09-21T04:05:41.496 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_extent_items": 0, 2024-09-21T04:05:41.497 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_blob_bytes": 0, 2024-09-21T04:05:41.497 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_blob_items": 0, 2024-09-21T04:05:41.497 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T04:05:41.497 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T04:05:41.497 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T04:05:41.497 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T04:05:41.497 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T04:05:41.497 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_fsck_items": 0, 2024-09-21T04:05:41.497 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_txc_bytes": 0, 2024-09-21T04:05:41.497 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_txc_items": 0, 2024-09-21T04:05:41.497 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T04:05:41.497 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T04:05:41.497 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_bytes": 0, 2024-09-21T04:05:41.497 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_items": 0, 2024-09-21T04:05:41.498 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_bytes": 0, 2024-09-21T04:05:41.498 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_items": 0, 2024-09-21T04:05:41.498 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T04:05:41.498 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_reader_items": 0, 2024-09-21T04:05:41.498 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T04:05:41.498 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_writer_items": 0, 2024-09-21T04:05:41.498 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_anon_bytes": 149007, 2024-09-21T04:05:41.498 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_anon_items": 30, 2024-09-21T04:05:41.498 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_meta_bytes": 0, 2024-09-21T04:05:41.498 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_meta_items": 0, 2024-09-21T04:05:41.498 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_bytes": 0, 2024-09-21T04:05:41.498 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_items": 0, 2024-09-21T04:05:41.498 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_mapbl_bytes": 0, 2024-09-21T04:05:41.499 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_mapbl_items": 0, 2024-09-21T04:05:41.499 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_pglog_bytes": 0, 2024-09-21T04:05:41.499 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_pglog_items": 0, 2024-09-21T04:05:41.499 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_bytes": 0, 2024-09-21T04:05:41.499 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_items": 0, 2024-09-21T04:05:41.499 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T04:05:41.499 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_mapping_items": 0, 2024-09-21T04:05:41.499 INFO:teuthology.orchestra.run.smithi105.stdout: "pgmap_bytes": 0, 2024-09-21T04:05:41.499 INFO:teuthology.orchestra.run.smithi105.stdout: "pgmap_items": 0, 2024-09-21T04:05:41.499 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_co_bytes": 968, 2024-09-21T04:05:41.499 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_co_items": 2, 2024-09-21T04:05:41.499 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_1_bytes": 0, 2024-09-21T04:05:41.499 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_1_items": 0, 2024-09-21T04:05:41.500 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_2_bytes": 0, 2024-09-21T04:05:41.500 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_2_items": 0 2024-09-21T04:05:41.500 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:41.500 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T04:05:41.500 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2024-09-21T04:05:41.500 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 104857600, 2024-09-21T04:05:41.500 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2024-09-21T04:05:41.500 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 212, 2024-09-21T04:05:41.500 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 650803, 2024-09-21T04:05:41.500 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2024-09-21T04:05:41.500 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 212, 2024-09-21T04:05:41.500 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 0, 2024-09-21T04:05:41.500 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 0, 2024-09-21T04:05:41.500 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 212, 2024-09-21T04:05:41.501 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 650803, 2024-09-21T04:05:41.501 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2024-09-21T04:05:41.501 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:41.501 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:41.501 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:41.501 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T04:05:41.501 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T04:05:41.501 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-21T04:05:41.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:41 smithi105 ceph-mon[34773]: pgmap v645: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-21T04:05:41.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:41 smithi162 ceph-mon[35071]: pgmap v645: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-21T04:05:42.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:41 smithi046 ceph-mon[30954]: pgmap v645: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-21T04:05:42.212 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.h 2024-09-21T04:05:42.212 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.h 2024-09-21T04:05:42.212 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.h 2024-09-21T04:05:42.212 DEBUG:tasks.check_counter:Getting stats from k 2024-09-21T04:05:42.212 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph daemon mds.k perf dump 2024-09-21T04:05:42.457 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T04:05:43.024 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-21T04:05:43.024 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T04:05:43.024 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 4, 2024-09-21T04:05:43.024 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 4, 2024-09-21T04:05:43.025 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 2944, 2024-09-21T04:05:43.025 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 448, 2024-09-21T04:05:43.025 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 4, 2024-09-21T04:05:43.025 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 0, 2024-09-21T04:05:43.025 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 0.002917823, 2024-09-21T04:05:43.025 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.000038267, 2024-09-21T04:05:43.025 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.002122713, 2024-09-21T04:05:43.025 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:05:43.025 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:43.025 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 3, 2024-09-21T04:05:43.025 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.003815331, 2024-09-21T04:05:43.025 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.001271777 2024-09-21T04:05:43.025 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:43.025 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:43.026 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:43.026 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:43.026 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:43.026 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:43.026 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-21T04:05:43.026 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T04:05:43.026 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:43.026 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T04:05:43.026 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 216, 2024-09-21T04:05:43.026 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 212, 2024-09-21T04:05:43.026 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 681984, 2024-09-21T04:05:43.026 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 130464, 2024-09-21T04:05:43.026 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 2, 2024-09-21T04:05:43.026 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 1, 2024-09-21T04:05:43.027 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 0.039147819, 2024-09-21T04:05:43.027 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.019314527, 2024-09-21T04:05:43.027 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.025892767, 2024-09-21T04:05:43.027 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:05:43.027 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:43.027 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 211, 2024-09-21T04:05:43.027 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.012983923, 2024-09-21T04:05:43.027 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000061535 2024-09-21T04:05:43.027 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:43.027 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:43.027 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:43.027 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:43.027 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:43.027 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:43.028 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 681984, 2024-09-21T04:05:43.028 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 130464 2024-09-21T04:05:43.028 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:43.028 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T04:05:43.028 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 1, 2024-09-21T04:05:43.028 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 161, 2024-09-21T04:05:43.028 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 160, 2024-09-21T04:05:43.028 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 108528, 2024-09-21T04:05:43.028 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 3, 2024-09-21T04:05:43.028 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 2, 2024-09-21T04:05:43.028 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 0.014869615, 2024-09-21T04:05:43.028 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.011962500, 2024-09-21T04:05:43.028 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.000869955, 2024-09-21T04:05:43.028 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:05:43.028 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:43.029 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 159, 2024-09-21T04:05:43.029 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.010187953, 2024-09-21T04:05:43.029 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000064075 2024-09-21T04:05:43.029 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:43.029 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:43.029 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:43.029 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:43.029 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:43.029 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:43.029 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T04:05:43.029 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 108528 2024-09-21T04:05:43.029 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:43.029 INFO:teuthology.orchestra.run.smithi105.stdout: "cct": { 2024-09-21T04:05:43.030 INFO:teuthology.orchestra.run.smithi105.stdout: "total_workers": 0, 2024-09-21T04:05:43.030 INFO:teuthology.orchestra.run.smithi105.stdout: "unhealthy_workers": 0 2024-09-21T04:05:43.030 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:43.030 INFO:teuthology.orchestra.run.smithi105.stdout: "mempool": { 2024-09-21T04:05:43.030 INFO:teuthology.orchestra.run.smithi105.stdout: "bloom_filter_bytes": 0, 2024-09-21T04:05:43.030 INFO:teuthology.orchestra.run.smithi105.stdout: "bloom_filter_items": 0, 2024-09-21T04:05:43.030 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T04:05:43.030 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_alloc_items": 0, 2024-09-21T04:05:43.030 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T04:05:43.030 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_data_items": 0, 2024-09-21T04:05:43.030 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T04:05:43.030 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T04:05:43.030 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T04:05:43.031 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T04:05:43.031 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T04:05:43.031 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_other_items": 0, 2024-09-21T04:05:43.031 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T04:05:43.031 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T04:05:43.031 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_extent_bytes": 0, 2024-09-21T04:05:43.031 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_extent_items": 0, 2024-09-21T04:05:43.031 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_blob_bytes": 0, 2024-09-21T04:05:43.031 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_blob_items": 0, 2024-09-21T04:05:43.031 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T04:05:43.031 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T04:05:43.031 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T04:05:43.031 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T04:05:43.031 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T04:05:43.032 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_fsck_items": 0, 2024-09-21T04:05:43.032 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_txc_bytes": 0, 2024-09-21T04:05:43.032 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_txc_items": 0, 2024-09-21T04:05:43.032 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T04:05:43.032 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T04:05:43.032 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_bytes": 0, 2024-09-21T04:05:43.032 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_items": 0, 2024-09-21T04:05:43.032 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_bytes": 0, 2024-09-21T04:05:43.032 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_items": 0, 2024-09-21T04:05:43.032 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T04:05:43.032 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_reader_items": 0, 2024-09-21T04:05:43.032 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T04:05:43.032 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_writer_items": 0, 2024-09-21T04:05:43.033 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_anon_bytes": 148967, 2024-09-21T04:05:43.033 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_anon_items": 29, 2024-09-21T04:05:43.033 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_meta_bytes": 0, 2024-09-21T04:05:43.033 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_meta_items": 0, 2024-09-21T04:05:43.033 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_bytes": 0, 2024-09-21T04:05:43.033 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_items": 0, 2024-09-21T04:05:43.033 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_mapbl_bytes": 0, 2024-09-21T04:05:43.033 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_mapbl_items": 0, 2024-09-21T04:05:43.033 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_pglog_bytes": 0, 2024-09-21T04:05:43.033 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_pglog_items": 0, 2024-09-21T04:05:43.033 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_bytes": 0, 2024-09-21T04:05:43.033 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_items": 0, 2024-09-21T04:05:43.033 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T04:05:43.033 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_mapping_items": 0, 2024-09-21T04:05:43.033 INFO:teuthology.orchestra.run.smithi105.stdout: "pgmap_bytes": 0, 2024-09-21T04:05:43.034 INFO:teuthology.orchestra.run.smithi105.stdout: "pgmap_items": 0, 2024-09-21T04:05:43.034 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_co_bytes": 968, 2024-09-21T04:05:43.034 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_co_items": 2, 2024-09-21T04:05:43.034 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_1_bytes": 0, 2024-09-21T04:05:43.034 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_1_items": 0, 2024-09-21T04:05:43.034 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_2_bytes": 0, 2024-09-21T04:05:43.034 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_2_items": 0 2024-09-21T04:05:43.034 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T04:05:43.034 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T04:05:43.034 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2024-09-21T04:05:43.034 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 104857600, 2024-09-21T04:05:43.034 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2024-09-21T04:05:43.034 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 217, 2024-09-21T04:05:43.034 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 651453, 2024-09-21T04:05:43.034 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2024-09-21T04:05:43.035 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 217, 2024-09-21T04:05:43.035 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 0, 2024-09-21T04:05:43.035 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 0, 2024-09-21T04:05:43.035 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 217, 2024-09-21T04:05:43.035 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 651453, 2024-09-21T04:05:43.035 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2024-09-21T04:05:43.035 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-21T04:05:43.035 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-21T04:05:43.035 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-21T04:05:43.035 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T04:05:43.035 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T04:05:43.035 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-21T04:05:43.694 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:43 smithi105 ceph-mon[34773]: pgmap v646: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-21T04:05:43.720 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-09-21T04:05:43.720 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-09-21T04:05:43.721 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-09-21T04:05:43.721 DEBUG:tasks.check_counter:Getting stats from c 2024-09-21T04:05:43.721 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph daemon mds.c perf dump 2024-09-21T04:05:43.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:43 smithi162 ceph-mon[35071]: pgmap v646: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-21T04:05:43.983 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T04:05:44.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:43 smithi046 ceph-mon[30954]: pgmap v646: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-21T04:05:44.529 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-21T04:05:44.530 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T04:05:44.530 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 0, 2024-09-21T04:05:44.530 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 2, 2024-09-21T04:05:44.530 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 0, 2024-09-21T04:05:44.530 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 0, 2024-09-21T04:05:44.530 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 4, 2024-09-21T04:05:44.530 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 0, 2024-09-21T04:05:44.530 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.001226716, 2024-09-21T04:05:44.531 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T04:05:44.531 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.000278554, 2024-09-21T04:05:44.531 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:05:44.531 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:44.531 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:44.531 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:44.531 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:44.531 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:44.531 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:44.531 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:44.531 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:44.531 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:44.531 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:44.532 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T04:05:44.532 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T04:05:44.532 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:44.532 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T04:05:44.532 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 215, 2024-09-21T04:05:44.532 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 210, 2024-09-21T04:05:44.532 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 683504, 2024-09-21T04:05:44.532 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 128352, 2024-09-21T04:05:44.532 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 2, 2024-09-21T04:05:44.532 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 1, 2024-09-21T04:05:44.532 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.041366548, 2024-09-21T04:05:44.532 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.019279243, 2024-09-21T04:05:44.532 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.028635819, 2024-09-21T04:05:44.533 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:05:44.533 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:44.533 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 210, 2024-09-21T04:05:44.533 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.018986463, 2024-09-21T04:05:44.533 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000090411 2024-09-21T04:05:44.533 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:44.533 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:44.533 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:44.533 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:44.533 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:44.533 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:44.533 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 683504, 2024-09-21T04:05:44.533 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 128352 2024-09-21T04:05:44.534 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:44.534 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T04:05:44.534 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 1, 2024-09-21T04:05:44.534 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 158, 2024-09-21T04:05:44.534 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 160, 2024-09-21T04:05:44.534 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 108000, 2024-09-21T04:05:44.534 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 3, 2024-09-21T04:05:44.534 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 2, 2024-09-21T04:05:44.534 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.013664555, 2024-09-21T04:05:44.534 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.010684191, 2024-09-21T04:05:44.534 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.001183535, 2024-09-21T04:05:44.534 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:05:44.534 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:44.535 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 156, 2024-09-21T04:05:44.535 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.009317612, 2024-09-21T04:05:44.535 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000059728 2024-09-21T04:05:44.535 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:44.535 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:44.535 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:44.535 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:44.535 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:44.535 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:44.535 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T04:05:44.535 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 108000 2024-09-21T04:05:44.536 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:44.536 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-09-21T04:05:44.536 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 0, 2024-09-21T04:05:44.536 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-09-21T04:05:44.536 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:44.536 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-09-21T04:05:44.536 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-09-21T04:05:44.536 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-09-21T04:05:44.536 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T04:05:44.536 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-09-21T04:05:44.536 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T04:05:44.537 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-09-21T04:05:44.537 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T04:05:44.537 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T04:05:44.537 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T04:05:44.537 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T04:05:44.537 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T04:05:44.537 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-09-21T04:05:44.537 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T04:05:44.537 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T04:05:44.537 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-09-21T04:05:44.537 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-09-21T04:05:44.537 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-09-21T04:05:44.538 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-09-21T04:05:44.538 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T04:05:44.538 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T04:05:44.538 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T04:05:44.538 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T04:05:44.538 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T04:05:44.538 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-09-21T04:05:44.538 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-09-21T04:05:44.538 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-09-21T04:05:44.539 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T04:05:44.539 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T04:05:44.539 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-09-21T04:05:44.539 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-09-21T04:05:44.539 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-09-21T04:05:44.539 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-09-21T04:05:44.539 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T04:05:44.539 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-09-21T04:05:44.539 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T04:05:44.539 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-09-21T04:05:44.539 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 148967, 2024-09-21T04:05:44.540 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 29, 2024-09-21T04:05:44.540 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-09-21T04:05:44.540 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-09-21T04:05:44.540 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-09-21T04:05:44.540 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-09-21T04:05:44.540 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-09-21T04:05:44.540 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-09-21T04:05:44.540 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-09-21T04:05:44.540 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-09-21T04:05:44.540 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 0, 2024-09-21T04:05:44.540 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 0, 2024-09-21T04:05:44.541 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T04:05:44.541 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-09-21T04:05:44.541 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-09-21T04:05:44.541 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-09-21T04:05:44.541 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 968, 2024-09-21T04:05:44.541 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 2, 2024-09-21T04:05:44.541 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-09-21T04:05:44.541 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-09-21T04:05:44.541 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-09-21T04:05:44.541 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-09-21T04:05:44.542 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:44.542 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T04:05:44.542 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-21T04:05:44.542 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-21T04:05:44.542 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-21T04:05:44.542 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 213, 2024-09-21T04:05:44.542 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 650933, 2024-09-21T04:05:44.542 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-21T04:05:44.542 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 213, 2024-09-21T04:05:44.542 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-21T04:05:44.542 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-21T04:05:44.543 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 213, 2024-09-21T04:05:44.543 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 650933, 2024-09-21T04:05:44.543 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-21T04:05:44.543 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:44.543 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:44.543 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:44.543 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T04:05:44.543 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T04:05:44.543 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-21T04:05:45.336 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.c 2024-09-21T04:05:45.336 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.c 2024-09-21T04:05:45.337 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.c 2024-09-21T04:05:45.337 DEBUG:tasks.check_counter:Getting stats from f 2024-09-21T04:05:45.337 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph daemon mds.f perf dump 2024-09-21T04:05:45.595 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T04:05:45.804 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:45 smithi046 ceph-mon[30954]: pgmap v647: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:05:45.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:45 smithi105 ceph-mon[34773]: pgmap v647: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:05:45.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:45 smithi162 ceph-mon[35071]: pgmap v647: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T04:05:46.154 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-21T04:05:46.154 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T04:05:46.154 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 213, 2024-09-21T04:05:46.154 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 209, 2024-09-21T04:05:46.154 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 681168, 2024-09-21T04:05:46.155 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 128544, 2024-09-21T04:05:46.155 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 4, 2024-09-21T04:05:46.155 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 0, 2024-09-21T04:05:46.155 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.040821847, 2024-09-21T04:05:46.155 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.019377806, 2024-09-21T04:05:46.155 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.027490497, 2024-09-21T04:05:46.155 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:05:46.155 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:46.156 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 208, 2024-09-21T04:05:46.156 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.013517622, 2024-09-21T04:05:46.156 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000064988 2024-09-21T04:05:46.156 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:46.156 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:46.156 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:46.156 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:46.156 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:46.156 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:46.156 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 681168, 2024-09-21T04:05:46.156 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 128544 2024-09-21T04:05:46.156 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:46.157 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T04:05:46.157 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 1, 2024-09-21T04:05:46.157 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 159, 2024-09-21T04:05:46.157 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 160, 2024-09-21T04:05:46.157 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 108176, 2024-09-21T04:05:46.157 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 3, 2024-09-21T04:05:46.157 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 2, 2024-09-21T04:05:46.157 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.014509698, 2024-09-21T04:05:46.157 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.011494732, 2024-09-21T04:05:46.157 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.001120402, 2024-09-21T04:05:46.157 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:05:46.158 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:46.158 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 157, 2024-09-21T04:05:46.158 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.010529505, 2024-09-21T04:05:46.158 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000067066 2024-09-21T04:05:46.158 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:46.158 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:46.158 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:46.158 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:46.158 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:46.158 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:46.158 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T04:05:46.158 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 108176 2024-09-21T04:05:46.159 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:46.159 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T04:05:46.159 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 4, 2024-09-21T04:05:46.159 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 4, 2024-09-21T04:05:46.159 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 2944, 2024-09-21T04:05:46.159 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 448, 2024-09-21T04:05:46.159 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 2, 2024-09-21T04:05:46.159 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 1, 2024-09-21T04:05:46.159 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.002192485, 2024-09-21T04:05:46.159 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.000041811, 2024-09-21T04:05:46.159 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.002137560, 2024-09-21T04:05:46.160 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:05:46.160 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:46.160 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 3, 2024-09-21T04:05:46.160 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.003805518, 2024-09-21T04:05:46.160 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.001268506 2024-09-21T04:05:46.160 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:46.160 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:46.160 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:46.160 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:46.160 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:46.160 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:46.160 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-21T04:05:46.160 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T04:05:46.161 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:46.161 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-09-21T04:05:46.161 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 0, 2024-09-21T04:05:46.161 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-09-21T04:05:46.161 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:46.161 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-09-21T04:05:46.161 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-09-21T04:05:46.161 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-09-21T04:05:46.161 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T04:05:46.161 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-09-21T04:05:46.162 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T04:05:46.162 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-09-21T04:05:46.162 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T04:05:46.162 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T04:05:46.162 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T04:05:46.162 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T04:05:46.162 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T04:05:46.162 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-09-21T04:05:46.162 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T04:05:46.163 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T04:05:46.163 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-09-21T04:05:46.163 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-09-21T04:05:46.163 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-09-21T04:05:46.163 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-09-21T04:05:46.163 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T04:05:46.163 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T04:05:46.163 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T04:05:46.163 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T04:05:46.163 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T04:05:46.164 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-09-21T04:05:46.164 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-09-21T04:05:46.164 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-09-21T04:05:46.164 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T04:05:46.164 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T04:05:46.164 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-09-21T04:05:46.164 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-09-21T04:05:46.164 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-09-21T04:05:46.164 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-09-21T04:05:46.165 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T04:05:46.165 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-09-21T04:05:46.165 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T04:05:46.165 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-09-21T04:05:46.165 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 148984, 2024-09-21T04:05:46.165 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 30, 2024-09-21T04:05:46.165 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-09-21T04:05:46.165 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-09-21T04:05:46.165 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-09-21T04:05:46.165 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-09-21T04:05:46.165 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-09-21T04:05:46.165 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-09-21T04:05:46.166 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-09-21T04:05:46.166 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-09-21T04:05:46.166 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 0, 2024-09-21T04:05:46.166 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 0, 2024-09-21T04:05:46.166 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T04:05:46.166 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-09-21T04:05:46.166 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-09-21T04:05:46.167 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-09-21T04:05:46.167 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 968, 2024-09-21T04:05:46.167 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 2, 2024-09-21T04:05:46.167 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-09-21T04:05:46.167 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-09-21T04:05:46.167 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-09-21T04:05:46.167 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-09-21T04:05:46.167 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:46.167 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T04:05:46.168 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-21T04:05:46.168 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-21T04:05:46.168 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-21T04:05:46.168 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 214, 2024-09-21T04:05:46.168 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 651063, 2024-09-21T04:05:46.168 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-21T04:05:46.168 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 214, 2024-09-21T04:05:46.168 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-21T04:05:46.169 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-21T04:05:46.169 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 214, 2024-09-21T04:05:46.169 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 651063, 2024-09-21T04:05:46.169 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-21T04:05:46.169 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:46.169 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:46.169 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:46.169 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T04:05:46.169 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T04:05:46.169 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-21T04:05:46.854 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.f 2024-09-21T04:05:46.854 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.f 2024-09-21T04:05:46.854 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.f 2024-09-21T04:05:46.854 DEBUG:tasks.check_counter:Getting stats from i 2024-09-21T04:05:46.855 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph daemon mds.i perf dump 2024-09-21T04:05:47.102 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T04:05:47.636 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:47 smithi162 ceph-mon[35071]: pgmap v648: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-21T04:05:47.637 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-21T04:05:47.637 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T04:05:47.637 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 1521, 2024-09-21T04:05:47.637 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 1523, 2024-09-21T04:05:47.637 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 4639187, 2024-09-21T04:05:47.637 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 483688, 2024-09-21T04:05:47.637 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 6, 2024-09-21T04:05:47.637 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 2, 2024-09-21T04:05:47.638 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.208113907, 2024-09-21T04:05:47.638 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.084360876, 2024-09-21T04:05:47.638 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.047627072, 2024-09-21T04:05:47.638 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.060347616, 2024-09-21T04:05:47.638 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:47.638 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1521, 2024-09-21T04:05:47.638 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.066973906, 2024-09-21T04:05:47.638 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000044032 2024-09-21T04:05:47.638 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.638 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:47.638 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.638 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.638 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.639 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.639 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T04:05:47.639 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T04:05:47.639 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.639 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T04:05:47.639 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 610, 2024-09-21T04:05:47.639 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 765, 2024-09-21T04:05:47.639 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 5455181, 2024-09-21T04:05:47.639 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 556104, 2024-09-21T04:05:47.639 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 5, 2024-09-21T04:05:47.639 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 4, 2024-09-21T04:05:47.639 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.089029808, 2024-09-21T04:05:47.639 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.040422124, 2024-09-21T04:05:47.639 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.022592756, 2024-09-21T04:05:47.640 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.018817834, 2024-09-21T04:05:47.640 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:47.640 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 764, 2024-09-21T04:05:47.640 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.042431542, 2024-09-21T04:05:47.640 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000055538 2024-09-21T04:05:47.640 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.640 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:47.640 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.640 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.640 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.640 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.640 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-21T04:05:47.640 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 363648 2024-09-21T04:05:47.640 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.641 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T04:05:47.641 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 420, 2024-09-21T04:05:47.641 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 415, 2024-09-21T04:05:47.641 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 4940877, 2024-09-21T04:05:47.641 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 191679, 2024-09-21T04:05:47.641 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 3, 2024-09-21T04:05:47.641 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 2, 2024-09-21T04:05:47.641 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.064745253, 2024-09-21T04:05:47.641 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.030937952, 2024-09-21T04:05:47.641 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.032108962, 2024-09-21T04:05:47.641 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.006206089, 2024-09-21T04:05:47.641 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:47.641 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 414, 2024-09-21T04:05:47.641 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.022610928, 2024-09-21T04:05:47.641 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000054615 2024-09-21T04:05:47.642 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.642 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:47.642 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.642 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.642 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.642 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.642 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 698816, 2024-09-21T04:05:47.642 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 130304 2024-09-21T04:05:47.642 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.642 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-09-21T04:05:47.642 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 1, 2024-09-21T04:05:47.642 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-09-21T04:05:47.642 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.643 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-MDSRank": { 2024-09-21T04:05:47.643 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-21T04:05:47.643 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-21T04:05:47.643 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 3837, 2024-09-21T04:05:47.643 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.132443417, 2024-09-21T04:05:47.643 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000034517 2024-09-21T04:05:47.643 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T04:05:47.643 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.643 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-PurgeQueue": { 2024-09-21T04:05:47.643 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-21T04:05:47.643 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-21T04:05:47.643 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.643 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.643 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.644 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T04:05:47.644 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.644 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": { 2024-09-21T04:05:47.644 INFO:teuthology.orchestra.run.smithi162.stdout: "request": 0, 2024-09-21T04:05:47.644 INFO:teuthology.orchestra.run.smithi162.stdout: "reply": 0, 2024-09-21T04:05:47.644 INFO:teuthology.orchestra.run.smithi162.stdout: "reply_latency": { 2024-09-21T04:05:47.644 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.644 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.644 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.644 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.644 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_reply": 0, 2024-09-21T04:05:47.644 INFO:teuthology.orchestra.run.smithi162.stdout: "forward": 0, 2024-09-21T04:05:47.644 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_complete": 0, 2024-09-21T04:05:47.644 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_keys": 0, 2024-09-21T04:05:47.644 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_commit": 0, 2024-09-21T04:05:47.645 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_split": 0, 2024-09-21T04:05:47.645 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_merge": 0, 2024-09-21T04:05:47.645 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes": 1236, 2024-09-21T04:05:47.645 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_top": 130, 2024-09-21T04:05:47.645 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_bottom": 1106, 2024-09-21T04:05:47.645 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pin_tail": 0, 2024-09-21T04:05:47.645 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pinned": 1050, 2024-09-21T04:05:47.645 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_expired": 0, 2024-09-21T04:05:47.645 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_with_caps": 0, 2024-09-21T04:05:47.645 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": 0, 2024-09-21T04:05:47.645 INFO:teuthology.orchestra.run.smithi162.stdout: "subtrees": 2, 2024-09-21T04:05:47.645 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse": 0, 2024-09-21T04:05:47.645 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_hit": 0, 2024-09-21T04:05:47.646 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_forward": 0, 2024-09-21T04:05:47.646 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_discover": 0, 2024-09-21T04:05:47.646 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_dir_fetch": 0, 2024-09-21T04:05:47.646 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_remote_ino": 0, 2024-09-21T04:05:47.646 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_lock": 0, 2024-09-21T04:05:47.646 INFO:teuthology.orchestra.run.smithi162.stdout: "load_cent": 0, 2024-09-21T04:05:47.646 INFO:teuthology.orchestra.run.smithi162.stdout: "q": 0, 2024-09-21T04:05:47.646 INFO:teuthology.orchestra.run.smithi162.stdout: "exported": 0, 2024-09-21T04:05:47.646 INFO:teuthology.orchestra.run.smithi162.stdout: "exported_inodes": 0, 2024-09-21T04:05:47.646 INFO:teuthology.orchestra.run.smithi162.stdout: "imported": 0, 2024-09-21T04:05:47.646 INFO:teuthology.orchestra.run.smithi162.stdout: "imported_inodes": 0, 2024-09-21T04:05:47.646 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_dir_fetch": 0, 2024-09-21T04:05:47.646 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_backtrace_fetch": 0, 2024-09-21T04:05:47.646 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_peer_discover": 0, 2024-09-21T04:05:47.647 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rfiles": 4, 2024-09-21T04:05:47.647 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rbytes": 234, 2024-09-21T04:05:47.647 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rsnaps": 7, 2024-09-21T04:05:47.647 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T04:05:47.647 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_set_tag": 0, 2024-09-21T04:05:47.647 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T04:05:47.647 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_inotable_repaired": 0, 2024-09-21T04:05:47.647 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_inodes": 0, 2024-09-21T04:05:47.647 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T04:05:47.647 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T04:05:47.647 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_file_inodes": 0, 2024-09-21T04:05:47.647 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_inode_file_caps": 0, 2024-09-21T04:05:47.647 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T04:05:47.647 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_grant": 0, 2024-09-21T04:05:47.648 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T04:05:47.648 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T04:05:47.648 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T04:05:47.648 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps": 0, 2024-09-21T04:05:47.648 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps_dirty": 0, 2024-09-21T04:05:47.648 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_cap_release": 0, 2024-09-21T04:05:47.648 INFO:teuthology.orchestra.run.smithi162.stdout: "process_request_cap_release": 0 2024-09-21T04:05:47.648 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.648 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_cache": { 2024-09-21T04:05:47.648 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update": 0, 2024-09-21T04:05:47.648 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update_receipt": 0, 2024-09-21T04:05:47.648 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_try_discover": 0, 2024-09-21T04:05:47.648 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_send_discover": 0, 2024-09-21T04:05:47.648 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_handle_discover": 0, 2024-09-21T04:05:47.648 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays": 0, 2024-09-21T04:05:47.649 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_delayed": 0, 2024-09-21T04:05:47.649 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_enqueuing": 0, 2024-09-21T04:05:47.649 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_created": 0, 2024-09-21T04:05:47.649 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_enqueued": 0, 2024-09-21T04:05:47.649 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_reintegrated": 0, 2024-09-21T04:05:47.650 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_migrated": 0, 2024-09-21T04:05:47.650 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_processing": 0, 2024-09-21T04:05:47.650 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_enqueued": 0, 2024-09-21T04:05:47.650 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_prioritized": 0, 2024-09-21T04:05:47.650 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_started": 0, 2024-09-21T04:05:47.650 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_completed": 0, 2024-09-21T04:05:47.650 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_path": 0, 2024-09-21T04:05:47.650 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_inode": 0, 2024-09-21T04:05:47.650 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T04:05:47.650 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_exportdir": 0, 2024-09-21T04:05:47.650 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_flush": 0, 2024-09-21T04:05:47.650 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragmentdir": 0, 2024-09-21T04:05:47.650 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragstats": 0, 2024-09-21T04:05:47.651 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_inodestats": 0, 2024-09-21T04:05:47.651 INFO:teuthology.orchestra.run.smithi162.stdout: "uninline_started": 0, 2024-09-21T04:05:47.651 INFO:teuthology.orchestra.run.smithi162.stdout: "uninline_succeeded": 0, 2024-09-21T04:05:47.651 INFO:teuthology.orchestra.run.smithi162.stdout: "uninline_write_failed": 0 2024-09-21T04:05:47.651 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.651 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_log": { 2024-09-21T04:05:47.651 INFO:teuthology.orchestra.run.smithi162.stdout: "evlrg": 0, 2024-09-21T04:05:47.651 INFO:teuthology.orchestra.run.smithi162.stdout: "evadd": 0, 2024-09-21T04:05:47.651 INFO:teuthology.orchestra.run.smithi162.stdout: "evex": 0, 2024-09-21T04:05:47.651 INFO:teuthology.orchestra.run.smithi162.stdout: "evtrm": 0, 2024-09-21T04:05:47.651 INFO:teuthology.orchestra.run.smithi162.stdout: "ev": 6181, 2024-09-21T04:05:47.651 INFO:teuthology.orchestra.run.smithi162.stdout: "evexg": 0, 2024-09-21T04:05:47.651 INFO:teuthology.orchestra.run.smithi162.stdout: "evexd": 0, 2024-09-21T04:05:47.651 INFO:teuthology.orchestra.run.smithi162.stdout: "segadd": 0, 2024-09-21T04:05:47.652 INFO:teuthology.orchestra.run.smithi162.stdout: "segex": 0, 2024-09-21T04:05:47.652 INFO:teuthology.orchestra.run.smithi162.stdout: "segtrm": 0, 2024-09-21T04:05:47.652 INFO:teuthology.orchestra.run.smithi162.stdout: "seg": 6, 2024-09-21T04:05:47.652 INFO:teuthology.orchestra.run.smithi162.stdout: "segmjr": 8, 2024-09-21T04:05:47.652 INFO:teuthology.orchestra.run.smithi162.stdout: "segexg": 0, 2024-09-21T04:05:47.652 INFO:teuthology.orchestra.run.smithi162.stdout: "segexd": 0, 2024-09-21T04:05:47.652 INFO:teuthology.orchestra.run.smithi162.stdout: "expos": 6844418, 2024-09-21T04:05:47.652 INFO:teuthology.orchestra.run.smithi162.stdout: "wrpos": 17876495, 2024-09-21T04:05:47.652 INFO:teuthology.orchestra.run.smithi162.stdout: "rdpos": 17876435, 2024-09-21T04:05:47.652 INFO:teuthology.orchestra.run.smithi162.stdout: "jlat": { 2024-09-21T04:05:47.652 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.652 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.652 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.652 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.653 INFO:teuthology.orchestra.run.smithi162.stdout: "replayed": 6181 2024-09-21T04:05:47.653 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.653 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_mem": { 2024-09-21T04:05:47.653 INFO:teuthology.orchestra.run.smithi162.stdout: "ino": 23, 2024-09-21T04:05:47.653 INFO:teuthology.orchestra.run.smithi162.stdout: "ino+": 1234, 2024-09-21T04:05:47.653 INFO:teuthology.orchestra.run.smithi162.stdout: "ino-": 1211, 2024-09-21T04:05:47.653 INFO:teuthology.orchestra.run.smithi162.stdout: "dir": 18, 2024-09-21T04:05:47.653 INFO:teuthology.orchestra.run.smithi162.stdout: "dir+": 23, 2024-09-21T04:05:47.653 INFO:teuthology.orchestra.run.smithi162.stdout: "dir-": 5, 2024-09-21T04:05:47.653 INFO:teuthology.orchestra.run.smithi162.stdout: "dn": 1236, 2024-09-21T04:05:47.653 INFO:teuthology.orchestra.run.smithi162.stdout: "dn+": 1242, 2024-09-21T04:05:47.653 INFO:teuthology.orchestra.run.smithi162.stdout: "dn-": 6, 2024-09-21T04:05:47.653 INFO:teuthology.orchestra.run.smithi162.stdout: "cap": 0, 2024-09-21T04:05:47.654 INFO:teuthology.orchestra.run.smithi162.stdout: "cap+": 0, 2024-09-21T04:05:47.654 INFO:teuthology.orchestra.run.smithi162.stdout: "cap-": 0, 2024-09-21T04:05:47.654 INFO:teuthology.orchestra.run.smithi162.stdout: "rss": 119156, 2024-09-21T04:05:47.654 INFO:teuthology.orchestra.run.smithi162.stdout: "heap": 320901120 2024-09-21T04:05:47.654 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.654 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_server": { 2024-09-21T04:05:47.654 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_client_request": 0, 2024-09-21T04:05:47.654 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_server_request": 0, 2024-09-21T04:05:47.654 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_request": 0, 2024-09-21T04:05:47.654 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_session": 0, 2024-09-21T04:05:47.654 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_peer_request": 0, 2024-09-21T04:05:47.654 INFO:teuthology.orchestra.run.smithi162.stdout: "req_create_latency": { 2024-09-21T04:05:47.654 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.654 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.655 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.655 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.655 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getattr_latency": { 2024-09-21T04:05:47.655 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.655 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.655 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.655 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.655 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getfilelock_latency": { 2024-09-21T04:05:47.655 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.655 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.655 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.655 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.655 INFO:teuthology.orchestra.run.smithi162.stdout: "req_link_latency": { 2024-09-21T04:05:47.655 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.656 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.656 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.656 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.656 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookup_latency": { 2024-09-21T04:05:47.656 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.656 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.657 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.658 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.658 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookuphash_latency": { 2024-09-21T04:05:47.658 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.658 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.658 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.658 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.658 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupino_latency": { 2024-09-21T04:05:47.658 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.658 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.658 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.658 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.658 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupname_latency": { 2024-09-21T04:05:47.658 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.658 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.659 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.659 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.659 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupparent_latency": { 2024-09-21T04:05:47.659 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.659 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.659 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.659 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.659 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupsnap_latency": { 2024-09-21T04:05:47.659 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.659 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.659 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.660 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.660 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lssnap_latency": { 2024-09-21T04:05:47.660 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.660 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.660 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.661 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.661 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mkdir_latency": { 2024-09-21T04:05:47.661 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.661 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.661 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.661 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.661 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mknod_latency": { 2024-09-21T04:05:47.661 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.661 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.661 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.661 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.661 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mksnap_latency": { 2024-09-21T04:05:47.661 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.661 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.662 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.662 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.662 INFO:teuthology.orchestra.run.smithi162.stdout: "req_open_latency": { 2024-09-21T04:05:47.662 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.662 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.662 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.662 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.662 INFO:teuthology.orchestra.run.smithi162.stdout: "req_readdir_latency": { 2024-09-21T04:05:47.662 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.662 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.662 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.662 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.663 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rename_latency": { 2024-09-21T04:05:47.663 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.663 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.663 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.663 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.663 INFO:teuthology.orchestra.run.smithi162.stdout: "req_renamesnap_latency": { 2024-09-21T04:05:47.663 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.663 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.663 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.663 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.663 INFO:teuthology.orchestra.run.smithi162.stdout: "req_snapdiff_latency": { 2024-09-21T04:05:47.663 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.664 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.664 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.664 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.664 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmdir_latency": { 2024-09-21T04:05:47.664 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.664 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.664 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.664 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.664 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmsnap_latency": { 2024-09-21T04:05:47.664 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.664 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.664 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.665 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.665 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmxattr_latency": { 2024-09-21T04:05:47.665 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.665 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.665 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.665 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.665 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setattr_latency": { 2024-09-21T04:05:47.665 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.665 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.665 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.665 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.665 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setdirlayout_latency": { 2024-09-21T04:05:47.665 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.665 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.666 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.666 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.666 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setfilelock_latency": { 2024-09-21T04:05:47.666 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.666 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.666 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.666 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.666 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setlayout_latency": { 2024-09-21T04:05:47.666 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.666 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.666 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.666 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.666 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setxattr_latency": { 2024-09-21T04:05:47.667 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.667 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.667 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.667 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.667 INFO:teuthology.orchestra.run.smithi162.stdout: "req_symlink_latency": { 2024-09-21T04:05:47.667 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.667 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.667 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.667 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.667 INFO:teuthology.orchestra.run.smithi162.stdout: "req_unlink_latency": { 2024-09-21T04:05:47.667 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.667 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.667 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.668 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.668 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_revoke_eviction": 0, 2024-09-21T04:05:47.668 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_acquisition_throttle": 0, 2024-09-21T04:05:47.668 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getvxattr_latency": { 2024-09-21T04:05:47.668 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.668 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.668 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.668 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T04:05:47.668 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.668 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_sessions": { 2024-09-21T04:05:47.668 INFO:teuthology.orchestra.run.smithi162.stdout: "session_count": 2, 2024-09-21T04:05:47.668 INFO:teuthology.orchestra.run.smithi162.stdout: "session_add": 3, 2024-09-21T04:05:47.668 INFO:teuthology.orchestra.run.smithi162.stdout: "session_remove": 1, 2024-09-21T04:05:47.668 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_open": 2, 2024-09-21T04:05:47.669 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_stale": 0, 2024-09-21T04:05:47.669 INFO:teuthology.orchestra.run.smithi162.stdout: "total_load": 0, 2024-09-21T04:05:47.669 INFO:teuthology.orchestra.run.smithi162.stdout: "average_load": 0, 2024-09-21T04:05:47.669 INFO:teuthology.orchestra.run.smithi162.stdout: "avg_session_uptime": 3163, 2024-09-21T04:05:47.669 INFO:teuthology.orchestra.run.smithi162.stdout: "mdthresh_evicted": 0 2024-09-21T04:05:47.669 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.669 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-09-21T04:05:47.669 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-09-21T04:05:47.669 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-09-21T04:05:47.669 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T04:05:47.669 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-09-21T04:05:47.669 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T04:05:47.669 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-09-21T04:05:47.669 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T04:05:47.670 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T04:05:47.670 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T04:05:47.670 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T04:05:47.670 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T04:05:47.670 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-09-21T04:05:47.670 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T04:05:47.670 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T04:05:47.670 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-09-21T04:05:47.670 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-09-21T04:05:47.670 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-09-21T04:05:47.670 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-09-21T04:05:47.670 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T04:05:47.671 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T04:05:47.671 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T04:05:47.671 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T04:05:47.671 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T04:05:47.671 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-09-21T04:05:47.671 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-09-21T04:05:47.671 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-09-21T04:05:47.671 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T04:05:47.671 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T04:05:47.671 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-09-21T04:05:47.671 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-09-21T04:05:47.671 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-09-21T04:05:47.671 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-09-21T04:05:47.671 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T04:05:47.672 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-09-21T04:05:47.672 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T04:05:47.672 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-09-21T04:05:47.672 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 189457, 2024-09-21T04:05:47.672 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 52, 2024-09-21T04:05:47.672 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-09-21T04:05:47.672 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-09-21T04:05:47.672 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-09-21T04:05:47.672 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-09-21T04:05:47.672 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-09-21T04:05:47.672 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-09-21T04:05:47.672 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-09-21T04:05:47.672 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-09-21T04:05:47.672 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 7872, 2024-09-21T04:05:47.673 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 174, 2024-09-21T04:05:47.673 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T04:05:47.673 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-09-21T04:05:47.673 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-09-21T04:05:47.673 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-09-21T04:05:47.673 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 926455, 2024-09-21T04:05:47.673 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 5443, 2024-09-21T04:05:47.673 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-09-21T04:05:47.673 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-09-21T04:05:47.673 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-09-21T04:05:47.673 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-09-21T04:05:47.673 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.673 INFO:teuthology.orchestra.run.smithi162.stdout: "objecter": { 2024-09-21T04:05:47.673 INFO:teuthology.orchestra.run.smithi162.stdout: "op_active": 0, 2024-09-21T04:05:47.674 INFO:teuthology.orchestra.run.smithi162.stdout: "op_laggy": 0, 2024-09-21T04:05:47.674 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send": 2319, 2024-09-21T04:05:47.674 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send_bytes": 26, 2024-09-21T04:05:47.674 INFO:teuthology.orchestra.run.smithi162.stdout: "op_resend": 4, 2024-09-21T04:05:47.674 INFO:teuthology.orchestra.run.smithi162.stdout: "op_reply": 2319, 2024-09-21T04:05:47.674 INFO:teuthology.orchestra.run.smithi162.stdout: "op_latency": { 2024-09-21T04:05:47.674 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2319, 2024-09-21T04:05:47.674 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 1.331972959, 2024-09-21T04:05:47.674 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000574373 2024-09-21T04:05:47.674 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.674 INFO:teuthology.orchestra.run.smithi162.stdout: "op_inflight": 0, 2024-09-21T04:05:47.674 INFO:teuthology.orchestra.run.smithi162.stdout: "oplen_avg": { 2024-09-21T04:05:47.674 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2319, 2024-09-21T04:05:47.674 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 2320 2024-09-21T04:05:47.675 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.675 INFO:teuthology.orchestra.run.smithi162.stdout: "op": 2319, 2024-09-21T04:05:47.675 INFO:teuthology.orchestra.run.smithi162.stdout: "op_r": 2319, 2024-09-21T04:05:47.675 INFO:teuthology.orchestra.run.smithi162.stdout: "op_w": 0, 2024-09-21T04:05:47.675 INFO:teuthology.orchestra.run.smithi162.stdout: "op_rmw": 0, 2024-09-21T04:05:47.675 INFO:teuthology.orchestra.run.smithi162.stdout: "op_pg": 0, 2024-09-21T04:05:47.675 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_stat": 1493, 2024-09-21T04:05:47.675 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_create": 0, 2024-09-21T04:05:47.675 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_read": 823, 2024-09-21T04:05:47.675 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_write": 0, 2024-09-21T04:05:47.675 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writefull": 0, 2024-09-21T04:05:47.675 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writesame": 0, 2024-09-21T04:05:47.675 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_append": 0, 2024-09-21T04:05:47.675 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_zero": 0, 2024-09-21T04:05:47.676 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_truncate": 0, 2024-09-21T04:05:47.676 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_delete": 0, 2024-09-21T04:05:47.676 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_mapext": 0, 2024-09-21T04:05:47.676 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_sparse_read": 0, 2024-09-21T04:05:47.676 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_clonerange": 0, 2024-09-21T04:05:47.676 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_getxattr": 2, 2024-09-21T04:05:47.676 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_setxattr": 0, 2024-09-21T04:05:47.676 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_cmpxattr": 0, 2024-09-21T04:05:47.676 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_rmxattr": 0, 2024-09-21T04:05:47.676 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_resetxattrs": 0, 2024-09-21T04:05:47.676 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_call": 0, 2024-09-21T04:05:47.676 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_watch": 0, 2024-09-21T04:05:47.676 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_notify": 0, 2024-09-21T04:05:47.677 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T04:05:47.677 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls": 0, 2024-09-21T04:05:47.677 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls_filter": 0, 2024-09-21T04:05:47.677 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_other": 0, 2024-09-21T04:05:47.677 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_active": 0, 2024-09-21T04:05:47.677 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_send": 0, 2024-09-21T04:05:47.677 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_resend": 0, 2024-09-21T04:05:47.677 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_ping": 0, 2024-09-21T04:05:47.677 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_active": 0, 2024-09-21T04:05:47.677 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_send": 0, 2024-09-21T04:05:47.677 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_resend": 0, 2024-09-21T04:05:47.677 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_active": 0, 2024-09-21T04:05:47.677 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_send": 0, 2024-09-21T04:05:47.677 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_resend": 0, 2024-09-21T04:05:47.677 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_active": 0, 2024-09-21T04:05:47.678 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_send": 0, 2024-09-21T04:05:47.678 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_resend": 0, 2024-09-21T04:05:47.678 INFO:teuthology.orchestra.run.smithi162.stdout: "command_active": 0, 2024-09-21T04:05:47.678 INFO:teuthology.orchestra.run.smithi162.stdout: "command_send": 0, 2024-09-21T04:05:47.678 INFO:teuthology.orchestra.run.smithi162.stdout: "command_resend": 0, 2024-09-21T04:05:47.678 INFO:teuthology.orchestra.run.smithi162.stdout: "map_epoch": 83, 2024-09-21T04:05:47.678 INFO:teuthology.orchestra.run.smithi162.stdout: "map_full": 0, 2024-09-21T04:05:47.678 INFO:teuthology.orchestra.run.smithi162.stdout: "map_inc": 8, 2024-09-21T04:05:47.678 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_sessions": 5, 2024-09-21T04:05:47.678 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_open": 5, 2024-09-21T04:05:47.678 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_close": 0, 2024-09-21T04:05:47.678 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_laggy": 0, 2024-09-21T04:05:47.678 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_wr": 0, 2024-09-21T04:05:47.679 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_rd": 2, 2024-09-21T04:05:47.679 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_del": 0 2024-09-21T04:05:47.679 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.679 INFO:teuthology.orchestra.run.smithi162.stdout: "oft": { 2024-09-21T04:05:47.679 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_objs": 0, 2024-09-21T04:05:47.679 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_kv_pairs": 0, 2024-09-21T04:05:47.679 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_updates": 0, 2024-09-21T04:05:47.679 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_removes": 0 2024-09-21T04:05:47.679 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.679 INFO:teuthology.orchestra.run.smithi162.stdout: "purge_queue": { 2024-09-21T04:05:47.679 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops": 0, 2024-09-21T04:05:47.679 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T04:05:47.679 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing": 0, 2024-09-21T04:05:47.679 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_high_water": 0, 2024-09-21T04:05:47.680 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed_ops": 0, 2024-09-21T04:05:47.680 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed": 0, 2024-09-21T04:05:47.680 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_item_in_journal": 0 2024-09-21T04:05:47.680 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.680 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T04:05:47.680 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-21T04:05:47.680 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-21T04:05:47.680 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-21T04:05:47.680 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 2547, 2024-09-21T04:05:47.680 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 14791435, 2024-09-21T04:05:47.680 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-21T04:05:47.680 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 2547, 2024-09-21T04:05:47.680 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-21T04:05:47.680 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-21T04:05:47.681 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 2547, 2024-09-21T04:05:47.681 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 14791435, 2024-09-21T04:05:47.681 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-21T04:05:47.681 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.681 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.681 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.681 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T04:05:47.681 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.681 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_bytes": { 2024-09-21T04:05:47.681 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-21T04:05:47.681 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-21T04:05:47.681 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-21T04:05:47.681 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-21T04:05:47.681 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-21T04:05:47.681 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-21T04:05:47.682 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-21T04:05:47.682 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 2319, 2024-09-21T04:05:47.682 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 13682201, 2024-09-21T04:05:47.682 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 2319, 2024-09-21T04:05:47.682 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 13682201, 2024-09-21T04:05:47.682 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-21T04:05:47.682 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.682 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.682 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.682 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T04:05:47.682 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.682 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_ops": { 2024-09-21T04:05:47.682 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-21T04:05:47.683 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 1024, 2024-09-21T04:05:47.683 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-21T04:05:47.683 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-21T04:05:47.683 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-21T04:05:47.683 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-21T04:05:47.683 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-21T04:05:47.683 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 2319, 2024-09-21T04:05:47.683 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 2319, 2024-09-21T04:05:47.683 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 2319, 2024-09-21T04:05:47.683 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 2319, 2024-09-21T04:05:47.683 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-21T04:05:47.683 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.683 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.683 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.683 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T04:05:47.684 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.684 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle": { 2024-09-21T04:05:47.684 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-21T04:05:47.684 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-21T04:05:47.684 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-21T04:05:47.684 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-21T04:05:47.684 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-21T04:05:47.684 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-21T04:05:47.684 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-21T04:05:47.684 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-21T04:05:47.684 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-21T04:05:47.684 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 0, 2024-09-21T04:05:47.684 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 0, 2024-09-21T04:05:47.684 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-21T04:05:47.685 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.685 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.685 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.685 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T04:05:47.685 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.685 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle-0x555e31c976c0": { 2024-09-21T04:05:47.685 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-21T04:05:47.685 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-21T04:05:47.685 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-21T04:05:47.685 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-21T04:05:47.685 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-21T04:05:47.685 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-21T04:05:47.685 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-21T04:05:47.685 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-21T04:05:47.685 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-21T04:05:47.686 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 0, 2024-09-21T04:05:47.686 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 0, 2024-09-21T04:05:47.686 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-21T04:05:47.686 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:47.686 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:47.686 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:47.686 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T04:05:47.686 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:47.686 INFO:teuthology.orchestra.run.smithi162.stdout: "trackedop": { 2024-09-21T04:05:47.686 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_ops_count": 0 2024-09-21T04:05:47.686 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T04:05:47.686 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-21T04:05:47.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:47 smithi105 ceph-mon[34773]: pgmap v648: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-21T04:05:48.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:47 smithi046 ceph-mon[30954]: pgmap v648: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-21T04:05:48.473 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=7 2024-09-21T04:05:48.473 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-09-21T04:05:48.473 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T04:05:48.473 DEBUG:tasks.check_counter:Getting stats from l 2024-09-21T04:05:48.473 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph daemon mds.l perf dump 2024-09-21T04:05:48.720 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T04:05:49.245 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-21T04:05:49.245 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T04:05:49.245 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 0, 2024-09-21T04:05:49.245 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 2, 2024-09-21T04:05:49.245 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 0, 2024-09-21T04:05:49.245 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 0, 2024-09-21T04:05:49.245 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 4, 2024-09-21T04:05:49.246 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 0, 2024-09-21T04:05:49.246 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.001094463, 2024-09-21T04:05:49.246 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T04:05:49.246 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.000218313, 2024-09-21T04:05:49.246 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:05:49.246 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:49.246 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:49.246 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:49.246 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:49.246 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:49.246 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:49.246 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:49.246 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:49.247 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:49.247 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:49.247 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T04:05:49.247 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T04:05:49.247 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:49.247 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T04:05:49.247 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 1, 2024-09-21T04:05:49.247 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 163, 2024-09-21T04:05:49.247 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 160, 2024-09-21T04:05:49.247 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 108880, 2024-09-21T04:05:49.247 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 3, 2024-09-21T04:05:49.247 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 2, 2024-09-21T04:05:49.247 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.014856869, 2024-09-21T04:05:49.248 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.011708282, 2024-09-21T04:05:49.248 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.001156643, 2024-09-21T04:05:49.248 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:05:49.248 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:49.248 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 161, 2024-09-21T04:05:49.248 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.010574435, 2024-09-21T04:05:49.248 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000065679 2024-09-21T04:05:49.248 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:49.248 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:49.248 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:49.248 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:49.248 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:49.248 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:49.249 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T04:05:49.249 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 108880 2024-09-21T04:05:49.249 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:49.249 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T04:05:49.249 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 223, 2024-09-21T04:05:49.249 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 217, 2024-09-21T04:05:49.249 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 685808, 2024-09-21T04:05:49.249 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 132352, 2024-09-21T04:05:49.250 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 2, 2024-09-21T04:05:49.250 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 1, 2024-09-21T04:05:49.250 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.044214307, 2024-09-21T04:05:49.250 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.020827793, 2024-09-21T04:05:49.250 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.031814478, 2024-09-21T04:05:49.250 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:05:49.250 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:05:49.250 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 217, 2024-09-21T04:05:49.250 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.018204473, 2024-09-21T04:05:49.250 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000083891 2024-09-21T04:05:49.250 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:49.250 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:05:49.251 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:49.251 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:49.251 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:49.251 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:49.251 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 685808, 2024-09-21T04:05:49.251 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 132352 2024-09-21T04:05:49.251 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:49.251 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-09-21T04:05:49.251 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 0, 2024-09-21T04:05:49.251 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-09-21T04:05:49.251 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:49.252 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-09-21T04:05:49.252 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-09-21T04:05:49.252 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-09-21T04:05:49.252 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T04:05:49.252 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-09-21T04:05:49.252 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T04:05:49.252 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-09-21T04:05:49.253 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T04:05:49.253 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T04:05:49.253 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T04:05:49.253 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T04:05:49.253 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T04:05:49.253 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-09-21T04:05:49.253 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T04:05:49.253 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T04:05:49.253 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-09-21T04:05:49.253 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-09-21T04:05:49.253 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-09-21T04:05:49.253 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-09-21T04:05:49.254 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T04:05:49.254 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T04:05:49.254 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T04:05:49.254 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T04:05:49.254 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T04:05:49.254 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-09-21T04:05:49.254 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-09-21T04:05:49.254 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-09-21T04:05:49.254 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T04:05:49.254 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T04:05:49.255 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-09-21T04:05:49.255 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-09-21T04:05:49.255 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-09-21T04:05:49.255 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-09-21T04:05:49.255 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T04:05:49.255 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-09-21T04:05:49.255 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T04:05:49.255 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-09-21T04:05:49.255 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 148967, 2024-09-21T04:05:49.255 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 29, 2024-09-21T04:05:49.255 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-09-21T04:05:49.255 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-09-21T04:05:49.255 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-09-21T04:05:49.256 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-09-21T04:05:49.256 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-09-21T04:05:49.256 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-09-21T04:05:49.256 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-09-21T04:05:49.256 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-09-21T04:05:49.256 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 0, 2024-09-21T04:05:49.256 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 0, 2024-09-21T04:05:49.256 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T04:05:49.256 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-09-21T04:05:49.256 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-09-21T04:05:49.256 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-09-21T04:05:49.257 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 968, 2024-09-21T04:05:49.257 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 2, 2024-09-21T04:05:49.257 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-09-21T04:05:49.257 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-09-21T04:05:49.257 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-09-21T04:05:49.257 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-09-21T04:05:49.257 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-21T04:05:49.257 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T04:05:49.257 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-21T04:05:49.257 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-21T04:05:49.257 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-21T04:05:49.258 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 220, 2024-09-21T04:05:49.258 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 651907, 2024-09-21T04:05:49.258 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-21T04:05:49.258 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 220, 2024-09-21T04:05:49.258 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-21T04:05:49.258 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-21T04:05:49.258 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 220, 2024-09-21T04:05:49.258 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 651907, 2024-09-21T04:05:49.258 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-21T04:05:49.258 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-21T04:05:49.258 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-21T04:05:49.259 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-21T04:05:49.259 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T04:05:49.259 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-21T04:05:49.259 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-21T04:05:49.820 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:49 smithi105 ceph-mon[34773]: pgmap v649: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:05:49.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:49 smithi162 ceph-mon[35071]: pgmap v649: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:05:50.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:49 smithi046 ceph-mon[30954]: pgmap v649: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T04:05:50.084 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-09-21T04:05:50.084 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-09-21T04:05:50.084 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-09-21T04:05:50.084 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-21T04:05:50.094 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-21T04:05:50.094 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T04:05:50.094 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T04:05:50.116 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T04:05:50.117 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T04:05:50.176 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T04:05:50.491 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:05:51.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.985+0000 7fec94fef640 1 -- 172.21.15.46:0/2320681848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec901094a0 msgr2=0x7fec901098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:51.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.985+0000 7fec94fef640 1 --2- 172.21.15.46:0/2320681848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec901094a0 0x7fec901098b0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fec84009ca0 tx=0x7fec8402a8c0 comp rx=0 tx=0).stop 2024-09-21T04:05:51.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.986+0000 7fec94fef640 1 -- 172.21.15.46:0/2320681848 shutdown_connections 2024-09-21T04:05:51.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.986+0000 7fec94fef640 1 --2- 172.21.15.46:0/2320681848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec90109df0 0x7fec90110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:51.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.986+0000 7fec94fef640 1 --2- 172.21.15.46:0/2320681848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec901094a0 0x7fec901098b0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:51.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.986+0000 7fec94fef640 1 --2- 172.21.15.46:0/2320681848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec90103b60 0x7fec90103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:51.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.986+0000 7fec94fef640 1 -- 172.21.15.46:0/2320681848 >> 172.21.15.46:0/2320681848 conn(0x7fec9007b850 msgr2=0x7fec9007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:51.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.986+0000 7fec94fef640 1 -- 172.21.15.46:0/2320681848 shutdown_connections 2024-09-21T04:05:51.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.986+0000 7fec94fef640 1 -- 172.21.15.46:0/2320681848 wait complete. 2024-09-21T04:05:51.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.986+0000 7fec94fef640 1 Processor -- start 2024-09-21T04:05:51.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.987+0000 7fec94fef640 1 -- start start 2024-09-21T04:05:51.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.987+0000 7fec94fef640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec90103b60 0x7fec9019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:51.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.987+0000 7fec94fef640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec901094a0 0x7fec9019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:51.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.987+0000 7fec94fef640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec90109df0 0x7fec9019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:51.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.987+0000 7fec94fef640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fec90113ab0 con 0x7fec90109df0 2024-09-21T04:05:51.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.987+0000 7fec94fef640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fec90113930 con 0x7fec901094a0 2024-09-21T04:05:51.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.987+0000 7fec94fef640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fec90113c30 con 0x7fec90103b60 2024-09-21T04:05:51.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.987+0000 7fec8ed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec90109df0 0x7fec9019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:51.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.987+0000 7fec8ed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec90109df0 0x7fec9019fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50636/0 (socket says 172.21.15.46:50636) 2024-09-21T04:05:51.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.987+0000 7fec8ed9d640 1 -- 172.21.15.46:0/1878885380 learned_addr learned my addr 172.21.15.46:0/1878885380 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:05:51.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.987+0000 7fec8e59c640 1 --2- 172.21.15.46:0/1878885380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec90103b60 0x7fec9019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:51.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.987+0000 7fec8dd9b640 1 --2- 172.21.15.46:0/1878885380 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec901094a0 0x7fec9019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:51.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.987+0000 7fec8ed9d640 1 -- 172.21.15.46:0/1878885380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec90103b60 msgr2=0x7fec9019a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:51.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.987+0000 7fec8ed9d640 1 --2- 172.21.15.46:0/1878885380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec90103b60 0x7fec9019a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:51.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.987+0000 7fec8ed9d640 1 -- 172.21.15.46:0/1878885380 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec901094a0 msgr2=0x7fec9019aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:51.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.987+0000 7fec8ed9d640 1 --2- 172.21.15.46:0/1878885380 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec901094a0 0x7fec9019aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:51.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.987+0000 7fec8ed9d640 1 -- 172.21.15.46:0/1878885380 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec901a0450 con 0x7fec90109df0 2024-09-21T04:05:51.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.988+0000 7fec8ed9d640 1 --2- 172.21.15.46:0/1878885380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec90109df0 0x7fec9019fd20 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fec8800d950 tx=0x7fec8800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:51.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.988+0000 7fec7f7fe640 1 -- 172.21.15.46:0/1878885380 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec88017030 con 0x7fec90109df0 2024-09-21T04:05:51.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.988+0000 7fec94fef640 1 -- 172.21.15.46:0/1878885380 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec901a0740 con 0x7fec90109df0 2024-09-21T04:05:51.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.988+0000 7fec7f7fe640 1 -- 172.21.15.46:0/1878885380 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec88004020 con 0x7fec90109df0 2024-09-21T04:05:51.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.988+0000 7fec7f7fe640 1 -- 172.21.15.46:0/1878885380 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec88003b50 con 0x7fec90109df0 2024-09-21T04:05:51.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.988+0000 7fec94fef640 1 -- 172.21.15.46:0/1878885380 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec901a6ea0 con 0x7fec90109df0 2024-09-21T04:05:51.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.989+0000 7fec94fef640 1 -- 172.21.15.46:0/1878885380 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec90103f70 con 0x7fec90109df0 2024-09-21T04:05:51.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.991+0000 7fec7f7fe640 1 -- 172.21.15.46:0/1878885380 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7fec8801a070 con 0x7fec90109df0 2024-09-21T04:05:51.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.992+0000 7fec7f7fe640 1 --2- 172.21.15.46:0/1878885380 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fec780b6680 0x7fec780b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:51.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.992+0000 7fec8e59c640 1 --2- 172.21.15.46:0/1878885380 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fec780b6680 0x7fec780b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:51.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.992+0000 7fec7f7fe640 1 -- 172.21.15.46:0/1878885380 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fec880e71c0 con 0x7fec90109df0 2024-09-21T04:05:51.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.992+0000 7fec8e59c640 1 --2- 172.21.15.46:0/1878885380 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fec780b6680 0x7fec780b8b90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fec80005fd0 tx=0x7fec8000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:51.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:50.995+0000 7fec7f7fe640 1 -- 172.21.15.46:0/1878885380 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fec88021070 con 0x7fec90109df0 2024-09-21T04:05:51.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:51.195+0000 7fec94fef640 1 -- 172.21.15.46:0/1878885380 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fec9019b610 con 0x7fec90109df0 2024-09-21T04:05:51.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:51.196+0000 7fec7f7fe640 1 -- 172.21.15.46:0/1878885380 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v83) ==== 81+0+885 (secure 0 0 0) 0x7fec9019b610 con 0x7fec90109df0 2024-09-21T04:05:51.199 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/878116252 2024-09-22T03:46:31.942086+0000 2024-09-21T04:05:51.199 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/878116252 2024-09-22T03:46:31.942086+0000 2024-09-21T04:05:51.199 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3574041742 2024-09-22T03:45:05.097136+0000 2024-09-21T04:05:51.199 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/1185001582 2024-09-22T03:45:05.097136+0000 2024-09-21T04:05:51.199 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2839831446 2024-09-22T03:45:05.097136+0000 2024-09-21T04:05:51.199 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3423884605 2024-09-22T03:45:31.101657+0000 2024-09-21T04:05:51.199 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2761976928 2024-09-22T03:46:31.942086+0000 2024-09-21T04:05:51.199 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/1149961133 2024-09-22T03:45:05.097136+0000 2024-09-21T04:05:51.199 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/1185001582 2024-09-22T03:45:05.097136+0000 2024-09-21T04:05:51.199 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/641493295 2024-09-22T03:45:31.101657+0000 2024-09-21T04:05:51.200 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/4033661287 2024-09-22T03:45:31.101657+0000 2024-09-21T04:05:51.200 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/2733048710 2024-09-22T03:45:31.101657+0000 2024-09-21T04:05:51.200 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3972416280 2024-09-22T03:46:31.942086+0000 2024-09-21T04:05:51.200 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/2733048710 2024-09-22T03:45:31.101657+0000 2024-09-21T04:05:51.200 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/1662975018 2024-09-22T03:46:31.942086+0000 2024-09-21T04:05:51.200 INFO:teuthology.orchestra.run.smithi046.stderr:listed 15 entries 2024-09-21T04:05:51.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:51.198+0000 7fec94fef640 1 -- 172.21.15.46:0/1878885380 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fec780b6680 msgr2=0x7fec780b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:51.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:51.198+0000 7fec94fef640 1 --2- 172.21.15.46:0/1878885380 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fec780b6680 0x7fec780b8b90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fec80005fd0 tx=0x7fec8000b390 comp rx=0 tx=0).stop 2024-09-21T04:05:51.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:51.198+0000 7fec94fef640 1 -- 172.21.15.46:0/1878885380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec90109df0 msgr2=0x7fec9019fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:51.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:51.198+0000 7fec94fef640 1 --2- 172.21.15.46:0/1878885380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec90109df0 0x7fec9019fd20 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fec8800d950 tx=0x7fec8800de10 comp rx=0 tx=0).stop 2024-09-21T04:05:51.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:51.199+0000 7fec94fef640 1 -- 172.21.15.46:0/1878885380 shutdown_connections 2024-09-21T04:05:51.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:51.199+0000 7fec94fef640 1 --2- 172.21.15.46:0/1878885380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec90109df0 0x7fec9019fd20 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:51.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:51.199+0000 7fec94fef640 1 --2- 172.21.15.46:0/1878885380 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec901094a0 0x7fec9019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:51.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:51.199+0000 7fec94fef640 1 --2- 172.21.15.46:0/1878885380 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fec780b6680 0x7fec780b8b90 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:51.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:51.199+0000 7fec94fef640 1 --2- 172.21.15.46:0/1878885380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec90103b60 0x7fec9019a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:51.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:51.199+0000 7fec94fef640 1 -- 172.21.15.46:0/1878885380 >> 172.21.15.46:0/1878885380 conn(0x7fec9007b850 msgr2=0x7fec90105560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:51.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:51.199+0000 7fec94fef640 1 -- 172.21.15.46:0/1878885380 shutdown_connections 2024-09-21T04:05:51.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:51.199+0000 7fec94fef640 1 -- 172.21.15.46:0/1878885380 wait complete. 2024-09-21T04:05:51.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:51 smithi105 ceph-mon[34773]: pgmap v650: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:05:51.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:51 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/1878885380' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T04:05:51.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:51 smithi162 ceph-mon[35071]: pgmap v650: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:05:51.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:51 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/1878885380' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T04:05:52.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:51 smithi046 ceph-mon[30954]: pgmap v650: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T04:05:52.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:51 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/1878885380' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T04:05:52.099 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T04:05:52.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:05:52.099 DEBUG:teuthology.orchestra.run.smithi046:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T04:05:52.158 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2024-09-21T04:05:52.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:05:52.159 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T04:05:52.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:05:52.197 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-09-21T04:05:52.254 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T04:05:52.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:05:52.254 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T04:05:52.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:05:52.322 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2024-09-21T04:05:52.422 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T04:05:52.434 INFO:tasks.cephadm:Teardown begin 2024-09-21T04:05:52.434 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T04:05:52.435 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:05:52.695 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:05:53.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.153+0000 7f664d9a6640 1 -- 172.21.15.46:0/3979445087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66481083e0 msgr2=0x7f66481087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:53.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.153+0000 7f664d9a6640 1 --2- 172.21.15.46:0/3979445087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66481083e0 0x7f66481087f0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f6630009900 tx=0x7f663002a410 comp rx=0 tx=0).stop 2024-09-21T04:05:53.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.153+0000 7f664d9a6640 1 -- 172.21.15.46:0/3979445087 shutdown_connections 2024-09-21T04:05:53.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.153+0000 7f664d9a6640 1 --2- 172.21.15.46:0/3979445087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6648108d30 0x7f664810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:53.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.153+0000 7f664d9a6640 1 --2- 172.21.15.46:0/3979445087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66481083e0 0x7f66481087f0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:53.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.153+0000 7f664d9a6640 1 --2- 172.21.15.46:0/3979445087 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6648102aa0 0x7f6648102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:53.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.153+0000 7f664d9a6640 1 -- 172.21.15.46:0/3979445087 >> 172.21.15.46:0/3979445087 conn(0x7f6648079750 msgr2=0x7f6648079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:53.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.153+0000 7f664d9a6640 1 -- 172.21.15.46:0/3979445087 shutdown_connections 2024-09-21T04:05:53.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.154+0000 7f664d9a6640 1 -- 172.21.15.46:0/3979445087 wait complete. 2024-09-21T04:05:53.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.154+0000 7f664d9a6640 1 Processor -- start 2024-09-21T04:05:53.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.155+0000 7f664d9a6640 1 -- start start 2024-09-21T04:05:53.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.155+0000 7f664d9a6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6648102aa0 0x7f664819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:53.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.155+0000 7f664d9a6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66481083e0 0x7f664819aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:53.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.155+0000 7f664d9a6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6648108d30 0x7f664819fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:53.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.155+0000 7f664d9a6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6648113b10 con 0x7f6648108d30 2024-09-21T04:05:53.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.155+0000 7f664d9a6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6648113990 con 0x7f66481083e0 2024-09-21T04:05:53.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.155+0000 7f664d9a6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6648113c90 con 0x7f6648102aa0 2024-09-21T04:05:53.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.155+0000 7f66477fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6648108d30 0x7f664819fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:53.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.155+0000 7f66477fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6648108d30 0x7f664819fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34632/0 (socket says 172.21.15.46:34632) 2024-09-21T04:05:53.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.155+0000 7f66477fe640 1 -- 172.21.15.46:0/2357197768 learned_addr learned my addr 172.21.15.46:0/2357197768 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:05:53.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.155+0000 7f66467fc640 1 --2- 172.21.15.46:0/2357197768 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66481083e0 0x7f664819aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:53.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.155+0000 7f6646ffd640 1 --2- 172.21.15.46:0/2357197768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6648102aa0 0x7f664819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:53.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.155+0000 7f66477fe640 1 -- 172.21.15.46:0/2357197768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6648102aa0 msgr2=0x7f664819a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:53.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.155+0000 7f66477fe640 1 --2- 172.21.15.46:0/2357197768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6648102aa0 0x7f664819a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:53.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.155+0000 7f66477fe640 1 -- 172.21.15.46:0/2357197768 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66481083e0 msgr2=0x7f664819aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:53.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.155+0000 7f66477fe640 1 --2- 172.21.15.46:0/2357197768 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66481083e0 0x7f664819aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:53.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.155+0000 7f66477fe640 1 -- 172.21.15.46:0/2357197768 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66481a0430 con 0x7f6648108d30 2024-09-21T04:05:53.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.156+0000 7f66477fe640 1 --2- 172.21.15.46:0/2357197768 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6648108d30 0x7f664819fd00 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f664000d950 tx=0x7f664000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:53.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.156+0000 7f664c9a4640 1 -- 172.21.15.46:0/2357197768 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6640017030 con 0x7f6648108d30 2024-09-21T04:05:53.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.156+0000 7f664c9a4640 1 -- 172.21.15.46:0/2357197768 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6640004020 con 0x7f6648108d30 2024-09-21T04:05:53.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.156+0000 7f664d9a6640 1 -- 172.21.15.46:0/2357197768 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66481a0720 con 0x7f6648108d30 2024-09-21T04:05:53.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.156+0000 7f664c9a4640 1 -- 172.21.15.46:0/2357197768 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6640003b50 con 0x7f6648108d30 2024-09-21T04:05:53.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.156+0000 7f664d9a6640 1 -- 172.21.15.46:0/2357197768 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66481a6e80 con 0x7f6648108d30 2024-09-21T04:05:53.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.157+0000 7f664d9a6640 1 -- 172.21.15.46:0/2357197768 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6648102eb0 con 0x7f6648108d30 2024-09-21T04:05:53.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.158+0000 7f664c9a4640 1 -- 172.21.15.46:0/2357197768 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f664001a070 con 0x7f6648108d30 2024-09-21T04:05:53.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.159+0000 7f664c9a4640 1 --2- 172.21.15.46:0/2357197768 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f66340b6700 0x7f66340b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:53.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.159+0000 7f6646ffd640 1 --2- 172.21.15.46:0/2357197768 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f66340b6700 0x7f66340b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:53.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.159+0000 7f664c9a4640 1 -- 172.21.15.46:0/2357197768 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7f66400e7230 con 0x7f6648108d30 2024-09-21T04:05:53.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.160+0000 7f6646ffd640 1 --2- 172.21.15.46:0/2357197768 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f66340b6700 0x7f66340b8c10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6638005c40 tx=0x7f663800a780 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:53.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.163+0000 7f664c9a4640 1 -- 172.21.15.46:0/2357197768 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6640021070 con 0x7f6648108d30 2024-09-21T04:05:53.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.387+0000 7f664d9a6640 1 -- 172.21.15.46:0/2357197768 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f664819b5f0 con 0x7f6648108d30 2024-09-21T04:05:53.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.388+0000 7f664c9a4640 1 -- 172.21.15.46:0/2357197768 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f664819b5f0 con 0x7f6648108d30 2024-09-21T04:05:53.390 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T04:05:53.391 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"btime":"2024-09-21T03:53:23:865820+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1766354184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1766354184},{"type":"v1","addr":"172.21.15.46:6839","nonce":1766354184}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/1901774207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":1901774207},{"type":"v1","addr":"172.21.15.46:6841","nonce":1901774207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3548633196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":3548633196},{"type":"v1","addr":"172.21.15.105:6837","nonce":3548633196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24652,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3551934241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3551934241},{"type":"v1","addr":"172.21.15.162:6835","nonce":3551934241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/48949822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":48949822},{"type":"v1","addr":"172.21.15.162:6837","nonce":48949822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:53:14.452819+0000","modified":"2024-09-21T03:53:23.593278+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24680},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/2196053213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2196053213},{"type":"v1","addr":"172.21.15.162:6839","nonce":2196053213}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.105:6839/3911438406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":3911438406},{"type":"v1","addr":"172.21.15.105:6839","nonce":3911438406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24680,"qdb_cluster":[24680]},"id":1}]} 2024-09-21T04:05:53.391 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T04:05:53.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.391+0000 7f664d9a6640 1 -- 172.21.15.46:0/2357197768 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f66340b6700 msgr2=0x7f66340b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:53.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.391+0000 7f664d9a6640 1 --2- 172.21.15.46:0/2357197768 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f66340b6700 0x7f66340b8c10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6638005c40 tx=0x7f663800a780 comp rx=0 tx=0).stop 2024-09-21T04:05:53.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.391+0000 7f664d9a6640 1 -- 172.21.15.46:0/2357197768 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6648108d30 msgr2=0x7f664819fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:53.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.391+0000 7f664d9a6640 1 --2- 172.21.15.46:0/2357197768 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6648108d30 0x7f664819fd00 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f664000d950 tx=0x7f664000de10 comp rx=0 tx=0).stop 2024-09-21T04:05:53.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.391+0000 7f664d9a6640 1 -- 172.21.15.46:0/2357197768 shutdown_connections 2024-09-21T04:05:53.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.391+0000 7f664d9a6640 1 --2- 172.21.15.46:0/2357197768 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6648108d30 0x7f664819fd00 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:53.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.391+0000 7f664d9a6640 1 --2- 172.21.15.46:0/2357197768 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66481083e0 0x7f664819aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:53.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.391+0000 7f664d9a6640 1 --2- 172.21.15.46:0/2357197768 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f66340b6700 0x7f66340b8c10 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:53.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.391+0000 7f664d9a6640 1 --2- 172.21.15.46:0/2357197768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6648102aa0 0x7f664819a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:53.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.391+0000 7f664d9a6640 1 -- 172.21.15.46:0/2357197768 >> 172.21.15.46:0/2357197768 conn(0x7f6648079750 msgr2=0x7f6648104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:53.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.391+0000 7f664d9a6640 1 -- 172.21.15.46:0/2357197768 shutdown_connections 2024-09-21T04:05:53.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:53.391+0000 7f664d9a6640 1 -- 172.21.15.46:0/2357197768 wait complete. 2024-09-21T04:05:53.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:53 smithi046 ceph-mon[30954]: pgmap v651: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T04:05:53.752 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:53 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/2357197768' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:05:53.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:53 smithi105 ceph-mon[34773]: pgmap v651: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T04:05:53.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:53 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/2357197768' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:05:53.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:53 smithi162 ceph-mon[35071]: pgmap v651: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-21T04:05:53.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:53 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/2357197768' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:05:54.041 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:05:54.302 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:05:54.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.745+0000 7fef7cc1f640 1 -- 172.21.15.46:0/3555642539 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef781094a0 msgr2=0x7fef781098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:54.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.745+0000 7fef7cc1f640 1 --2- 172.21.15.46:0/3555642539 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef781094a0 0x7fef781098b0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fef6c009900 tx=0x7fef6c02a410 comp rx=0 tx=0).stop 2024-09-21T04:05:54.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.745+0000 7fef7cc1f640 1 -- 172.21.15.46:0/3555642539 shutdown_connections 2024-09-21T04:05:54.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.745+0000 7fef7cc1f640 1 --2- 172.21.15.46:0/3555642539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef78109df0 0x7fef78110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:54.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.745+0000 7fef7cc1f640 1 --2- 172.21.15.46:0/3555642539 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef781094a0 0x7fef781098b0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:54.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.745+0000 7fef7cc1f640 1 --2- 172.21.15.46:0/3555642539 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef78103b60 0x7fef78103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:54.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.745+0000 7fef7cc1f640 1 -- 172.21.15.46:0/3555642539 >> 172.21.15.46:0/3555642539 conn(0x7fef7807b850 msgr2=0x7fef7807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:54.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.746+0000 7fef7cc1f640 1 -- 172.21.15.46:0/3555642539 shutdown_connections 2024-09-21T04:05:54.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.746+0000 7fef7cc1f640 1 -- 172.21.15.46:0/3555642539 wait complete. 2024-09-21T04:05:54.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.747+0000 7fef7cc1f640 1 Processor -- start 2024-09-21T04:05:54.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.747+0000 7fef7cc1f640 1 -- start start 2024-09-21T04:05:54.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.747+0000 7fef7cc1f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef78103b60 0x7fef7819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:54.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.747+0000 7fef7cc1f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef781094a0 0x7fef7819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:54.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.747+0000 7fef7cc1f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef78109df0 0x7fef7819fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:54.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.747+0000 7fef7cc1f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fef78113ab0 con 0x7fef78103b60 2024-09-21T04:05:54.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.747+0000 7fef7cc1f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fef78113930 con 0x7fef78109df0 2024-09-21T04:05:54.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.747+0000 7fef7cc1f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fef78113c30 con 0x7fef781094a0 2024-09-21T04:05:54.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.747+0000 7fef7659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef78103b60 0x7fef7819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:54.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.747+0000 7fef7659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef78103b60 0x7fef7819a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34656/0 (socket says 172.21.15.46:34656) 2024-09-21T04:05:54.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.747+0000 7fef7659c640 1 -- 172.21.15.46:0/52924809 learned_addr learned my addr 172.21.15.46:0/52924809 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:05:54.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.747+0000 7fef76d9d640 1 --2- 172.21.15.46:0/52924809 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef78109df0 0x7fef7819fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:54.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.747+0000 7fef75d9b640 1 --2- 172.21.15.46:0/52924809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef781094a0 0x7fef7819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:54.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.747+0000 7fef7659c640 1 -- 172.21.15.46:0/52924809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef781094a0 msgr2=0x7fef7819aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:54.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.747+0000 7fef7659c640 1 --2- 172.21.15.46:0/52924809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef781094a0 0x7fef7819aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:54.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.747+0000 7fef7659c640 1 -- 172.21.15.46:0/52924809 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef78109df0 msgr2=0x7fef7819fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:54.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.748+0000 7fef7659c640 1 --2- 172.21.15.46:0/52924809 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef78109df0 0x7fef7819fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:54.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.748+0000 7fef7659c640 1 -- 172.21.15.46:0/52924809 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef781a03f0 con 0x7fef78103b60 2024-09-21T04:05:54.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.748+0000 7fef76d9d640 1 --2- 172.21.15.46:0/52924809 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef78109df0 0x7fef7819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:05:54.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.748+0000 7fef7659c640 1 --2- 172.21.15.46:0/52924809 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef78103b60 0x7fef7819a480 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fef6800cce0 tx=0x7fef6800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:54.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.748+0000 7fef677fe640 1 -- 172.21.15.46:0/52924809 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef68004b20 con 0x7fef78103b60 2024-09-21T04:05:54.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.748+0000 7fef677fe640 1 -- 172.21.15.46:0/52924809 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef68004cc0 con 0x7fef78103b60 2024-09-21T04:05:54.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.748+0000 7fef7cc1f640 1 -- 172.21.15.46:0/52924809 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef781a06e0 con 0x7fef78103b60 2024-09-21T04:05:54.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.748+0000 7fef677fe640 1 -- 172.21.15.46:0/52924809 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6800f6b0 con 0x7fef78103b60 2024-09-21T04:05:54.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.748+0000 7fef7cc1f640 1 -- 172.21.15.46:0/52924809 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef781a6e40 con 0x7fef78103b60 2024-09-21T04:05:54.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.749+0000 7fef7cc1f640 1 -- 172.21.15.46:0/52924809 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef78103f70 con 0x7fef78103b60 2024-09-21T04:05:54.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.751+0000 7fef677fe640 1 -- 172.21.15.46:0/52924809 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7fef6800f850 con 0x7fef78103b60 2024-09-21T04:05:54.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.751+0000 7fef677fe640 1 --2- 172.21.15.46:0/52924809 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fef600b6700 0x7fef600b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:54.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.751+0000 7fef75d9b640 1 --2- 172.21.15.46:0/52924809 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fef600b6700 0x7fef600b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:54.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.751+0000 7fef677fe640 1 -- 172.21.15.46:0/52924809 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fef680e7b70 con 0x7fef78103b60 2024-09-21T04:05:54.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.752+0000 7fef75d9b640 1 --2- 172.21.15.46:0/52924809 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fef600b6700 0x7fef600b8c10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fef6c009230 tx=0x7fef6c031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:54.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.754+0000 7fef677fe640 1 -- 172.21.15.46:0/52924809 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fef68014030 con 0x7fef78103b60 2024-09-21T04:05:54.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.978+0000 7fef7cc1f640 1 -- 172.21.15.46:0/52924809 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef7819b5b0 con 0x7fef78103b60 2024-09-21T04:05:54.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.979+0000 7fef677fe640 1 -- 172.21.15.46:0/52924809 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7fef680a9030 con 0x7fef78103b60 2024-09-21T04:05:54.981 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T04:05:54.982 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"btime":"2024-09-21T03:53:23:865820+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1276108734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1276108734},{"type":"v1","addr":"172.21.15.46:6837","nonce":1276108734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1766354184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1766354184},{"type":"v1","addr":"172.21.15.46:6839","nonce":1766354184}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/1901774207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":1901774207},{"type":"v1","addr":"172.21.15.46:6841","nonce":1901774207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3633636261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3633636261},{"type":"v1","addr":"172.21.15.105:6833","nonce":3633636261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24602,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3565344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3565344000},{"type":"v1","addr":"172.21.15.46:6835","nonce":3565344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1270522354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1270522354},{"type":"v1","addr":"172.21.15.162:6833","nonce":1270522354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24617,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1564869545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1564869545},{"type":"v1","addr":"172.21.15.105:6835","nonce":1564869545}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24641,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3548633196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":3548633196},{"type":"v1","addr":"172.21.15.105:6837","nonce":3548633196}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24652,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3551934241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3551934241},{"type":"v1","addr":"172.21.15.162:6835","nonce":3551934241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/48949822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":48949822},{"type":"v1","addr":"172.21.15.162:6837","nonce":48949822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:53:14.452819+0000","modified":"2024-09-21T03:53:23.593278+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24680},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24673":{"gid":24673,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6839/2196053213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2196053213},{"type":"v1","addr":"172.21.15.162:6839","nonce":2196053213}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24680":{"gid":24680,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.105:6839/3911438406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":3911438406},{"type":"v1","addr":"172.21.15.105:6839","nonce":3911438406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24680,"qdb_cluster":[24680]},"id":1}]} 2024-09-21T04:05:54.982 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T04:05:54.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.981+0000 7fef7cc1f640 1 -- 172.21.15.46:0/52924809 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fef600b6700 msgr2=0x7fef600b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:54.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.981+0000 7fef7cc1f640 1 --2- 172.21.15.46:0/52924809 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fef600b6700 0x7fef600b8c10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fef6c009230 tx=0x7fef6c031400 comp rx=0 tx=0).stop 2024-09-21T04:05:54.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.981+0000 7fef7cc1f640 1 -- 172.21.15.46:0/52924809 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef78103b60 msgr2=0x7fef7819a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:54.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.981+0000 7fef7cc1f640 1 --2- 172.21.15.46:0/52924809 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef78103b60 0x7fef7819a480 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fef6800cce0 tx=0x7fef6800a620 comp rx=0 tx=0).stop 2024-09-21T04:05:54.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.981+0000 7fef7cc1f640 1 -- 172.21.15.46:0/52924809 shutdown_connections 2024-09-21T04:05:54.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.981+0000 7fef7cc1f640 1 --2- 172.21.15.46:0/52924809 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef78109df0 0x7fef7819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:54.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.981+0000 7fef7cc1f640 1 --2- 172.21.15.46:0/52924809 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fef600b6700 0x7fef600b8c10 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:54.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.981+0000 7fef7cc1f640 1 --2- 172.21.15.46:0/52924809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef781094a0 0x7fef7819aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:54.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.981+0000 7fef7cc1f640 1 --2- 172.21.15.46:0/52924809 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef78103b60 0x7fef7819a480 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:54.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.981+0000 7fef7cc1f640 1 -- 172.21.15.46:0/52924809 >> 172.21.15.46:0/52924809 conn(0x7fef7807b850 msgr2=0x7fef78105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:54.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.981+0000 7fef7cc1f640 1 -- 172.21.15.46:0/52924809 shutdown_connections 2024-09-21T04:05:54.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:54.981+0000 7fef7cc1f640 1 -- 172.21.15.46:0/52924809 wait complete. 2024-09-21T04:05:55.658 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T04:05:55.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:55 smithi105 ceph-mon[34773]: pgmap v652: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-21T04:05:55.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:55 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/52924809' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:05:55.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:55 smithi162 ceph-mon[35071]: pgmap v652: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-21T04:05:55.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:55 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/52924809' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:05:55.919 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:05:56.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:55 smithi046 ceph-mon[30954]: pgmap v652: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-21T04:05:56.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:55 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/52924809' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:05:56.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.444+0000 7fa4b5d78640 1 -- 172.21.15.46:0/3543370077 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4b0103b60 msgr2=0x7fa4b0103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:56.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.444+0000 7fa4b5d78640 1 --2- 172.21.15.46:0/3543370077 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4b0103b60 0x7fa4b0103f70 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0009900 tx=0x7fa4a002a410 comp rx=0 tx=0).stop 2024-09-21T04:05:56.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.444+0000 7fa4b5d78640 1 -- 172.21.15.46:0/3543370077 shutdown_connections 2024-09-21T04:05:56.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.444+0000 7fa4b5d78640 1 --2- 172.21.15.46:0/3543370077 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4b0109df0 0x7fa4b0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:56.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.444+0000 7fa4b5d78640 1 --2- 172.21.15.46:0/3543370077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4b01094a0 0x7fa4b01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:56.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.444+0000 7fa4b5d78640 1 --2- 172.21.15.46:0/3543370077 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4b0103b60 0x7fa4b0103f70 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:56.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.444+0000 7fa4b5d78640 1 -- 172.21.15.46:0/3543370077 >> 172.21.15.46:0/3543370077 conn(0x7fa4b007b850 msgr2=0x7fa4b007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:56.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.444+0000 7fa4b5d78640 1 -- 172.21.15.46:0/3543370077 shutdown_connections 2024-09-21T04:05:56.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.444+0000 7fa4b5d78640 1 -- 172.21.15.46:0/3543370077 wait complete. 2024-09-21T04:05:56.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.445+0000 7fa4b5d78640 1 Processor -- start 2024-09-21T04:05:56.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.445+0000 7fa4b5d78640 1 -- start start 2024-09-21T04:05:56.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.445+0000 7fa4b5d78640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4b0103b60 0x7fa4b0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:56.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.445+0000 7fa4b5d78640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4b01094a0 0x7fa4b0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:56.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.445+0000 7fa4b5d78640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4b0109df0 0x7fa4b0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:56.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.445+0000 7fa4b5d78640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b0113ab0 con 0x7fa4b0103b60 2024-09-21T04:05:56.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.445+0000 7fa4b5d78640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b0113930 con 0x7fa4b0109df0 2024-09-21T04:05:56.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.445+0000 7fa4b5d78640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b0113c30 con 0x7fa4b01094a0 2024-09-21T04:05:56.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.445+0000 7fa4af7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4b0103b60 0x7fa4b0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:56.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.446+0000 7fa4af7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4b0103b60 0x7fa4b0075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34682/0 (socket says 172.21.15.46:34682) 2024-09-21T04:05:56.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.446+0000 7fa4af7fe640 1 -- 172.21.15.46:0/3480127894 learned_addr learned my addr 172.21.15.46:0/3480127894 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:05:56.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.446+0000 7fa4aeffd640 1 --2- 172.21.15.46:0/3480127894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4b01094a0 0x7fa4b0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:56.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.446+0000 7fa4affff640 1 --2- 172.21.15.46:0/3480127894 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4b0109df0 0x7fa4b0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:56.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.446+0000 7fa4af7fe640 1 -- 172.21.15.46:0/3480127894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4b01094a0 msgr2=0x7fa4b0075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:56.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.446+0000 7fa4af7fe640 1 --2- 172.21.15.46:0/3480127894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4b01094a0 0x7fa4b0075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:56.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.446+0000 7fa4af7fe640 1 -- 172.21.15.46:0/3480127894 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4b0109df0 msgr2=0x7fa4b0076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:56.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.446+0000 7fa4af7fe640 1 --2- 172.21.15.46:0/3480127894 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4b0109df0 0x7fa4b0076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:56.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.446+0000 7fa4af7fe640 1 -- 172.21.15.46:0/3480127894 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b01a8720 con 0x7fa4b0103b60 2024-09-21T04:05:56.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.446+0000 7fa4affff640 1 --2- 172.21.15.46:0/3480127894 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4b0109df0 0x7fa4b0076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:05:56.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.446+0000 7fa4af7fe640 1 --2- 172.21.15.46:0/3480127894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4b0103b60 0x7fa4b0075710 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0005940 tx=0x7fa4a00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:56.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.446+0000 7fa4acff9640 1 -- 172.21.15.46:0/3480127894 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a003f030 con 0x7fa4b0103b60 2024-09-21T04:05:56.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.446+0000 7fa4acff9640 1 -- 172.21.15.46:0/3480127894 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4a0003cb0 con 0x7fa4b0103b60 2024-09-21T04:05:56.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.446+0000 7fa4b5d78640 1 -- 172.21.15.46:0/3480127894 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4b01a89b0 con 0x7fa4b0103b60 2024-09-21T04:05:56.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.446+0000 7fa4acff9640 1 -- 172.21.15.46:0/3480127894 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a0035070 con 0x7fa4b0103b60 2024-09-21T04:05:56.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.447+0000 7fa4b5d78640 1 -- 172.21.15.46:0/3480127894 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4b01a8ee0 con 0x7fa4b0103b60 2024-09-21T04:05:56.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.447+0000 7fa4b5d78640 1 -- 172.21.15.46:0/3480127894 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4b0103f70 con 0x7fa4b0103b60 2024-09-21T04:05:56.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.449+0000 7fa4acff9640 1 -- 172.21.15.46:0/3480127894 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7fa4a0042030 con 0x7fa4b0103b60 2024-09-21T04:05:56.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.450+0000 7fa4acff9640 1 --2- 172.21.15.46:0/3480127894 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa4980b6700 0x7fa4980b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:56.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.450+0000 7fa4aeffd640 1 --2- 172.21.15.46:0/3480127894 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa4980b6700 0x7fa4980b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:56.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.450+0000 7fa4acff9640 1 -- 172.21.15.46:0/3480127894 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fa4a0108190 con 0x7fa4b0103b60 2024-09-21T04:05:56.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.450+0000 7fa4aeffd640 1 --2- 172.21.15.46:0/3480127894 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa4980b6700 0x7fa4980b8c10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa4b01064c0 tx=0x7fa4a400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:56.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.453+0000 7fa4acff9640 1 -- 172.21.15.46:0/3480127894 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa4a00ce6f0 con 0x7fa4b0103b60 2024-09-21T04:05:56.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.642+0000 7fa4b5d78640 1 -- 172.21.15.46:0/3480127894 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa4b010bc20 con 0x7fa4b0103b60 2024-09-21T04:05:56.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.644+0000 7fa4acff9640 1 -- 172.21.15.46:0/3480127894 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22966 (secure 0 0 0) 0x7fa4a00d2ad0 con 0x7fa4b0103b60 2024-09-21T04:05:56.646 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T04:05:56.647 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":83,"fsid":"a82de5ec-77cb-11ef-baf5-efdc52797490","created":"2024-09-21T03:44:31.512271+0000","modified":"2024-09-21T04:04:17.837036+0000","last_up_change":"2024-09-21T03:52:22.609789+0000","last_in_change":"2024-09-21T03:51:58.812316+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:48:30.407205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:53:09.943833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:53:12.521980+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":13,"snap_epoch":82,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ff9e1a8-fec7-422c-b594-880efe4684f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6803","nonce":791989880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6805","nonce":791989880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6809","nonce":791989880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":791989880},{"type":"v1","addr":"172.21.15.46:6807","nonce":791989880}]},"public_addr":"172.21.15.46:6803/791989880","cluster_addr":"172.21.15.46:6805/791989880","heartbeat_back_addr":"172.21.15.46:6809/791989880","heartbeat_front_addr":"172.21.15.46:6807/791989880","state":["exists","up"]},{"osd":1,"uuid":"3df1bee7-615e-44d0-bd43-2370db6cd06d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6801","nonce":1123652172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6803","nonce":1123652172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6807","nonce":1123652172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":1123652172},{"type":"v1","addr":"172.21.15.105:6805","nonce":1123652172}]},"public_addr":"172.21.15.105:6801/1123652172","cluster_addr":"172.21.15.105:6803/1123652172","heartbeat_back_addr":"172.21.15.105:6807/1123652172","heartbeat_front_addr":"172.21.15.105:6805/1123652172","state":["exists","up"]},{"osd":2,"uuid":"52d0e57f-cfca-447a-8a57-b1d5364cb4d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6801","nonce":34930776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6803","nonce":34930776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6807","nonce":34930776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":34930776},{"type":"v1","addr":"172.21.15.162:6805","nonce":34930776}]},"public_addr":"172.21.15.162:6801/34930776","cluster_addr":"172.21.15.162:6803/34930776","heartbeat_back_addr":"172.21.15.162:6807/34930776","heartbeat_front_addr":"172.21.15.162:6805/34930776","state":["exists","up"]},{"osd":3,"uuid":"6f25f721-fc50-4b80-944b-d3df28e7a2a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6811","nonce":1355580104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6813","nonce":1355580104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6817","nonce":1355580104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1355580104},{"type":"v1","addr":"172.21.15.46:6815","nonce":1355580104}]},"public_addr":"172.21.15.46:6811/1355580104","cluster_addr":"172.21.15.46:6813/1355580104","heartbeat_back_addr":"172.21.15.46:6817/1355580104","heartbeat_front_addr":"172.21.15.46:6815/1355580104","state":["exists","up"]},{"osd":4,"uuid":"c2f41084-e5a1-4b5f-b799-a84b38da63a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6809","nonce":3566174660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6811","nonce":3566174660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6815","nonce":3566174660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3566174660},{"type":"v1","addr":"172.21.15.105:6813","nonce":3566174660}]},"public_addr":"172.21.15.105:6809/3566174660","cluster_addr":"172.21.15.105:6811/3566174660","heartbeat_back_addr":"172.21.15.105:6815/3566174660","heartbeat_front_addr":"172.21.15.105:6813/3566174660","state":["exists","up"]},{"osd":5,"uuid":"b433d03b-fae8-4ece-b967-a8af91bc3ab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6809","nonce":3043419818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6811","nonce":3043419818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6815","nonce":3043419818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3043419818},{"type":"v1","addr":"172.21.15.162:6813","nonce":3043419818}]},"public_addr":"172.21.15.162:6809/3043419818","cluster_addr":"172.21.15.162:6811/3043419818","heartbeat_back_addr":"172.21.15.162:6815/3043419818","heartbeat_front_addr":"172.21.15.162:6813/3043419818","state":["exists","up"]},{"osd":6,"uuid":"e6b5ce54-69aa-4811-9ca3-cab50525a175","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6819","nonce":1615361645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6821","nonce":1615361645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6825","nonce":1615361645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":1615361645},{"type":"v1","addr":"172.21.15.46:6823","nonce":1615361645}]},"public_addr":"172.21.15.46:6819/1615361645","cluster_addr":"172.21.15.46:6821/1615361645","heartbeat_back_addr":"172.21.15.46:6825/1615361645","heartbeat_front_addr":"172.21.15.46:6823/1615361645","state":["exists","up"]},{"osd":7,"uuid":"a6e89d5d-ce31-4e0c-9019-5eb13b134feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6817","nonce":1015687379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6819","nonce":1015687379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6823","nonce":1015687379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":1015687379},{"type":"v1","addr":"172.21.15.105:6821","nonce":1015687379}]},"public_addr":"172.21.15.105:6817/1015687379","cluster_addr":"172.21.15.105:6819/1015687379","heartbeat_back_addr":"172.21.15.105:6823/1015687379","heartbeat_front_addr":"172.21.15.105:6821/1015687379","state":["exists","up"]},{"osd":8,"uuid":"27b2ccec-65be-47b3-a924-c5939ba1cb5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6817","nonce":3441747512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6819","nonce":3441747512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6823","nonce":3441747512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3441747512},{"type":"v1","addr":"172.21.15.162:6821","nonce":3441747512}]},"public_addr":"172.21.15.162:6817/3441747512","cluster_addr":"172.21.15.162:6819/3441747512","heartbeat_back_addr":"172.21.15.162:6823/3441747512","heartbeat_front_addr":"172.21.15.162:6821/3441747512","state":["exists","up"]},{"osd":9,"uuid":"3f7cb70c-73c7-48e8-a32b-7445eda2126d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6827","nonce":382230768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6829","nonce":382230768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6833","nonce":382230768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":382230768},{"type":"v1","addr":"172.21.15.46:6831","nonce":382230768}]},"public_addr":"172.21.15.46:6827/382230768","cluster_addr":"172.21.15.46:6829/382230768","heartbeat_back_addr":"172.21.15.46:6833/382230768","heartbeat_front_addr":"172.21.15.46:6831/382230768","state":["exists","up"]},{"osd":10,"uuid":"76c3da87-f3c5-4985-87fd-647717b6af85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6825","nonce":1664619099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6827","nonce":1664619099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6831","nonce":1664619099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1664619099},{"type":"v1","addr":"172.21.15.105:6829","nonce":1664619099}]},"public_addr":"172.21.15.105:6825/1664619099","cluster_addr":"172.21.15.105:6827/1664619099","heartbeat_back_addr":"172.21.15.105:6831/1664619099","heartbeat_front_addr":"172.21.15.105:6829/1664619099","state":["exists","up"]},{"osd":11,"uuid":"13269da8-5f05-4ce2-9c7a-6dd9c1041cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6825","nonce":1014820476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6827","nonce":1014820476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6831","nonce":1014820476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":1014820476},{"type":"v1","addr":"172.21.15.162:6829","nonce":1014820476}]},"public_addr":"172.21.15.162:6825/1014820476","cluster_addr":"172.21.15.162:6827/1014820476","heartbeat_back_addr":"172.21.15.162:6831/1014820476","heartbeat_front_addr":"172.21.15.162:6829/1014820476","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:47:38.630436+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:03.441596+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:28.647341+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:48:54.270316+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:49:19.783873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:49:45.344485+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:50:12.165326+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:50:38.095996+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:03.814612+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:29.469718+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:51:55.407340+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:52:20.360243+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:6801/878116252":"2024-09-22T03:46:31.942086+0000","172.21.15.46:6800/878116252":"2024-09-22T03:46:31.942086+0000","172.21.15.46:0/3574041742":"2024-09-22T03:45:05.097136+0000","172.21.15.46:6801/1185001582":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/2839831446":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/3423884605":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/2761976928":"2024-09-22T03:46:31.942086+0000","172.21.15.46:0/1149961133":"2024-09-22T03:45:05.097136+0000","172.21.15.46:6800/1185001582":"2024-09-22T03:45:05.097136+0000","172.21.15.46:0/641493295":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/4033661287":"2024-09-22T03:45:31.101657+0000","172.21.15.46:6800/2733048710":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/3972416280":"2024-09-22T03:46:31.942086+0000","172.21.15.46:6801/2733048710":"2024-09-22T03:45:31.101657+0000","172.21.15.46:0/1662975018":"2024-09-22T03:46:31.942086+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":4,"length":1},{"begin":13,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T04:05:56.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.646+0000 7fa4b5d78640 1 -- 172.21.15.46:0/3480127894 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa4980b6700 msgr2=0x7fa4980b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:56.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.646+0000 7fa4b5d78640 1 --2- 172.21.15.46:0/3480127894 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa4980b6700 0x7fa4980b8c10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa4b01064c0 tx=0x7fa4a400b410 comp rx=0 tx=0).stop 2024-09-21T04:05:56.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.646+0000 7fa4b5d78640 1 -- 172.21.15.46:0/3480127894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4b0103b60 msgr2=0x7fa4b0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:56.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.646+0000 7fa4b5d78640 1 --2- 172.21.15.46:0/3480127894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4b0103b60 0x7fa4b0075710 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0005940 tx=0x7fa4a00042f0 comp rx=0 tx=0).stop 2024-09-21T04:05:56.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.646+0000 7fa4b5d78640 1 -- 172.21.15.46:0/3480127894 shutdown_connections 2024-09-21T04:05:56.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.646+0000 7fa4b5d78640 1 --2- 172.21.15.46:0/3480127894 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4b0109df0 0x7fa4b0076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:56.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.646+0000 7fa4b5d78640 1 --2- 172.21.15.46:0/3480127894 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fa4980b6700 0x7fa4980b8c10 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:56.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.646+0000 7fa4b5d78640 1 --2- 172.21.15.46:0/3480127894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4b01094a0 0x7fa4b0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:56.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.646+0000 7fa4b5d78640 1 --2- 172.21.15.46:0/3480127894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4b0103b60 0x7fa4b0075710 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:56.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.646+0000 7fa4b5d78640 1 -- 172.21.15.46:0/3480127894 >> 172.21.15.46:0/3480127894 conn(0x7fa4b007b850 msgr2=0x7fa4b0107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:56.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.646+0000 7fa4b5d78640 1 -- 172.21.15.46:0/3480127894 shutdown_connections 2024-09-21T04:05:56.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:56.647+0000 7fa4b5d78640 1 -- 172.21.15.46:0/3480127894 wait complete. 2024-09-21T04:05:57.359 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs fail cephfs 2024-09-21T04:05:57.587 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:57 smithi046 ceph-mon[30954]: pgmap v653: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T04:05:57.587 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:57 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3480127894' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:05:57.631 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:05:57.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:57 smithi162 ceph-mon[35071]: pgmap v653: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T04:05:57.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:57 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3480127894' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:05:58.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:57 smithi105 ceph-mon[34773]: pgmap v653: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T04:05:58.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:57 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3480127894' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:05:58.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.113+0000 7ff5f3e41640 1 -- 172.21.15.46:0/2563571539 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5ec108d00 msgr2=0x7ff5ec10f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:58.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.113+0000 7ff5f3e41640 1 --2- 172.21.15.46:0/2563571539 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5ec108d00 0x7ff5ec10f530 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4009ca0 tx=0x7ff5e402a8c0 comp rx=0 tx=0).stop 2024-09-21T04:05:58.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.113+0000 7ff5f3e41640 1 -- 172.21.15.46:0/2563571539 shutdown_connections 2024-09-21T04:05:58.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.113+0000 7ff5f3e41640 1 --2- 172.21.15.46:0/2563571539 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5ec108d00 0x7ff5ec10f530 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:58.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.113+0000 7ff5f3e41640 1 --2- 172.21.15.46:0/2563571539 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5ec1083b0 0x7ff5ec1087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:58.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.113+0000 7ff5f3e41640 1 --2- 172.21.15.46:0/2563571539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5ec103140 0x7ff5ec103550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:58.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.113+0000 7ff5f3e41640 1 -- 172.21.15.46:0/2563571539 >> 172.21.15.46:0/2563571539 conn(0x7ff5ec077c60 msgr2=0x7ff5ec0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:58.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.113+0000 7ff5f3e41640 1 -- 172.21.15.46:0/2563571539 shutdown_connections 2024-09-21T04:05:58.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.113+0000 7ff5f3e41640 1 -- 172.21.15.46:0/2563571539 wait complete. 2024-09-21T04:05:58.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.114+0000 7ff5f3e41640 1 Processor -- start 2024-09-21T04:05:58.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.114+0000 7ff5f3e41640 1 -- start start 2024-09-21T04:05:58.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.114+0000 7ff5f3e41640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5ec103140 0x7ff5ec19b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:58.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.114+0000 7ff5f3e41640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5ec1083b0 0x7ff5ec19b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:58.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.114+0000 7ff5f3e41640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5ec108d00 0x7ff5ec19bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:58.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.114+0000 7ff5f3e41640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff5ec1129c0 con 0x7ff5ec103140 2024-09-21T04:05:58.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.114+0000 7ff5f3e41640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff5ec112840 con 0x7ff5ec1083b0 2024-09-21T04:05:58.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.114+0000 7ff5f3e41640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff5ec112b40 con 0x7ff5ec108d00 2024-09-21T04:05:58.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.114+0000 7ff5f1bdd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5ec103140 0x7ff5ec19b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:58.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.114+0000 7ff5f1bdd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5ec103140 0x7ff5ec19b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34712/0 (socket says 172.21.15.46:34712) 2024-09-21T04:05:58.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.114+0000 7ff5f1bdd640 1 -- 172.21.15.46:0/2973091565 learned_addr learned my addr 172.21.15.46:0/2973091565 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:05:58.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.114+0000 7ff5f23de640 1 --2- 172.21.15.46:0/2973091565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5ec108d00 0x7ff5ec19bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:58.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.114+0000 7ff5f13dc640 1 --2- 172.21.15.46:0/2973091565 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5ec1083b0 0x7ff5ec19b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:58.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.114+0000 7ff5f1bdd640 1 -- 172.21.15.46:0/2973091565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5ec108d00 msgr2=0x7ff5ec19bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:58.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.114+0000 7ff5f1bdd640 1 --2- 172.21.15.46:0/2973091565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5ec108d00 0x7ff5ec19bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:58.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.115+0000 7ff5f1bdd640 1 -- 172.21.15.46:0/2973091565 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5ec1083b0 msgr2=0x7ff5ec19b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:58.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.115+0000 7ff5f1bdd640 1 --2- 172.21.15.46:0/2973091565 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5ec1083b0 0x7ff5ec19b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:58.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.115+0000 7ff5f1bdd640 1 -- 172.21.15.46:0/2973091565 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5ec1a64a0 con 0x7ff5ec103140 2024-09-21T04:05:58.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.115+0000 7ff5f23de640 1 --2- 172.21.15.46:0/2973091565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5ec108d00 0x7ff5ec19bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:05:58.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.115+0000 7ff5f13dc640 1 --2- 172.21.15.46:0/2973091565 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5ec1083b0 0x7ff5ec19b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:05:58.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.115+0000 7ff5f1bdd640 1 --2- 172.21.15.46:0/2973091565 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5ec103140 0x7ff5ec19b210 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7ff5e800d770 tx=0x7ff5e800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:58.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.115+0000 7ff5e2ffd640 1 -- 172.21.15.46:0/2973091565 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e8017070 con 0x7ff5ec103140 2024-09-21T04:05:58.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.115+0000 7ff5f3e41640 1 -- 172.21.15.46:0/2973091565 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5ec1a6790 con 0x7ff5ec103140 2024-09-21T04:05:58.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.115+0000 7ff5e2ffd640 1 -- 172.21.15.46:0/2973091565 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5e80054d0 con 0x7ff5ec103140 2024-09-21T04:05:58.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.115+0000 7ff5e2ffd640 1 -- 172.21.15.46:0/2973091565 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e8004c30 con 0x7ff5ec103140 2024-09-21T04:05:58.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.115+0000 7ff5f3e41640 1 -- 172.21.15.46:0/2973091565 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5ec1a6c80 con 0x7ff5ec103140 2024-09-21T04:05:58.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.116+0000 7ff5f3e41640 1 -- 172.21.15.46:0/2973091565 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5ec103550 con 0x7ff5ec103140 2024-09-21T04:05:58.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.118+0000 7ff5e2ffd640 1 -- 172.21.15.46:0/2973091565 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7ff5e8004dd0 con 0x7ff5ec103140 2024-09-21T04:05:58.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.119+0000 7ff5e2ffd640 1 --2- 172.21.15.46:0/2973091565 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff5d80b66b0 0x7ff5d80b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:58.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.119+0000 7ff5e2ffd640 1 -- 172.21.15.46:0/2973091565 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7ff5e80e75e0 con 0x7ff5ec103140 2024-09-21T04:05:58.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.119+0000 7ff5f13dc640 1 --2- 172.21.15.46:0/2973091565 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff5d80b66b0 0x7ff5d80b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:58.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.120+0000 7ff5f13dc640 1 --2- 172.21.15.46:0/2973091565 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff5d80b66b0 0x7ff5d80b8bc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc0058c0 tx=0x7ff5dc005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:58.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.122+0000 7ff5e2ffd640 1 -- 172.21.15.46:0/2973091565 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff5e80adba0 con 0x7ff5ec103140 2024-09-21T04:05:58.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.351+0000 7ff5f3e41640 1 -- 172.21.15.46:0/2973091565 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff5ec02e640 con 0x7ff5ec103140 2024-09-21T04:05:58.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.353+0000 7ff5e2ffd640 1 -- 172.21.15.46:0/2973091565 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) ==== 161+0+0 (secure 0 0 0) 0x7ff5e80b1f80 con 0x7ff5ec103140 2024-09-21T04:05:58.356 INFO:teuthology.orchestra.run.smithi046.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T04:05:58.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.356+0000 7ff5f3e41640 1 -- 172.21.15.46:0/2973091565 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff5d80b66b0 msgr2=0x7ff5d80b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:58.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.356+0000 7ff5f3e41640 1 --2- 172.21.15.46:0/2973091565 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff5d80b66b0 0x7ff5d80b8bc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc0058c0 tx=0x7ff5dc005850 comp rx=0 tx=0).stop 2024-09-21T04:05:58.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.356+0000 7ff5f3e41640 1 -- 172.21.15.46:0/2973091565 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5ec103140 msgr2=0x7ff5ec19b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:58.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.356+0000 7ff5f3e41640 1 --2- 172.21.15.46:0/2973091565 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5ec103140 0x7ff5ec19b210 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7ff5e800d770 tx=0x7ff5e800dc30 comp rx=0 tx=0).stop 2024-09-21T04:05:58.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.356+0000 7ff5f3e41640 1 -- 172.21.15.46:0/2973091565 shutdown_connections 2024-09-21T04:05:58.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.356+0000 7ff5f3e41640 1 --2- 172.21.15.46:0/2973091565 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7ff5d80b66b0 0x7ff5d80b8bc0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:58.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.356+0000 7ff5f3e41640 1 --2- 172.21.15.46:0/2973091565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5ec108d00 0x7ff5ec19bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:58.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.356+0000 7ff5f3e41640 1 --2- 172.21.15.46:0/2973091565 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5ec1083b0 0x7ff5ec19b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:58.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.356+0000 7ff5f3e41640 1 --2- 172.21.15.46:0/2973091565 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5ec103140 0x7ff5ec19b210 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:58.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.356+0000 7ff5f3e41640 1 -- 172.21.15.46:0/2973091565 >> 172.21.15.46:0/2973091565 conn(0x7ff5ec077c60 msgr2=0x7ff5ec106360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:58.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.357+0000 7ff5f3e41640 1 -- 172.21.15.46:0/2973091565 shutdown_connections 2024-09-21T04:05:58.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:58.357+0000 7ff5f3e41640 1 -- 172.21.15.46:0/2973091565 wait complete. 2024-09-21T04:05:58.501 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:58 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mon-a[30950]: 2024-09-21T04:05:58.352+0000 7f7702669640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T04:05:58.818 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 21 04:05:58 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-b[63738]: ignoring --setuser ceph since I am not root 2024-09-21T04:05:58.818 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 21 04:05:58 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-b[63738]: ignoring --setgroup ceph since I am not root 2024-09-21T04:05:58.818 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 21 04:05:58 smithi105 ceph-mds[63742]: -- 172.21.15.105:0/3551095752 <== mon.2 v2:172.21.15.105:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fe046e5860 con 0x55fe0888d180 2024-09-21T04:05:58.818 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 21 04:05:58 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-b[63738]: starting mds.b at 2024-09-21T04:05:58.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:58 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/2973091565' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T04:05:58.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:58 smithi105 ceph-mon[34773]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T04:05:58.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:58 smithi105 ceph-mon[34773]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T04:05:58.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:58 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/2973091565' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T04:05:58.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:58 smithi105 ceph-mon[34773]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T04:05:58.819 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:58 smithi105 ceph-mon[34773]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-21T04:05:58.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:58 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/2973091565' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T04:05:58.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:58 smithi162 ceph-mon[35071]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T04:05:58.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:58 smithi162 ceph-mon[35071]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T04:05:58.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:58 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/2973091565' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T04:05:58.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:58 smithi162 ceph-mon[35071]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T04:05:58.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:58 smithi162 ceph-mon[35071]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-21T04:05:58.876 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 21 04:05:58 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-i[64334]: ignoring --setuser ceph since I am not root 2024-09-21T04:05:58.877 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 21 04:05:58 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-i[64334]: ignoring --setgroup ceph since I am not root 2024-09-21T04:05:58.877 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 21 04:05:58 smithi162 ceph-mds[64338]: -- 172.21.15.162:0/3610989326 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d15be4b860 con 0x55d15fff3a80 2024-09-21T04:05:58.877 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 21 04:05:58 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-i[64334]: starting mds.i at 2024-09-21T04:05:59.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:58 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/2973091565' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T04:05:59.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:58 smithi046 ceph-mon[30954]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T04:05:59.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:58 smithi046 ceph-mon[30954]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T04:05:59.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:58 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/2973091565' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T04:05:59.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:58 smithi046 ceph-mon[30954]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T04:05:59.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:58 smithi046 ceph-mon[30954]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-21T04:05:59.071 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T04:05:59.334 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:05:59.749 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:59 smithi046 ceph-mon[30954]: pgmap v654: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T04:05:59.749 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:59 smithi046 ceph-mon[30954]: mds.? [v2:172.21.15.162:6838/1152299716,v1:172.21.15.162:6839/1152299716] up:boot 2024-09-21T04:05:59.749 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:59 smithi046 ceph-mon[30954]: mds.? [v2:172.21.15.105:6838/1102937125,v1:172.21.15.105:6839/1102937125] up:boot 2024-09-21T04:05:59.749 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:59 smithi046 ceph-mon[30954]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-21T04:05:59.749 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:59 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T04:05:59.749 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:05:59 smithi046 ceph-mon[30954]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T04:05:59.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:59 smithi105 ceph-mon[34773]: pgmap v654: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T04:05:59.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:59 smithi105 ceph-mon[34773]: mds.? [v2:172.21.15.162:6838/1152299716,v1:172.21.15.162:6839/1152299716] up:boot 2024-09-21T04:05:59.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:59 smithi105 ceph-mon[34773]: mds.? [v2:172.21.15.105:6838/1102937125,v1:172.21.15.105:6839/1102937125] up:boot 2024-09-21T04:05:59.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:59 smithi105 ceph-mon[34773]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-21T04:05:59.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:59 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T04:05:59.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:05:59 smithi105 ceph-mon[34773]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T04:05:59.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.842+0000 7f24b87a0640 1 -- 172.21.15.46:0/317131980 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24b0102a60 msgr2=0x7f24b0102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:59.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.842+0000 7f24b87a0640 1 --2- 172.21.15.46:0/317131980 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24b0102a60 0x7f24b0102e70 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f24ac009900 tx=0x7f24ac02a3f0 comp rx=0 tx=0).stop 2024-09-21T04:05:59.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.842+0000 7f24b87a0640 1 -- 172.21.15.46:0/317131980 shutdown_connections 2024-09-21T04:05:59.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.842+0000 7f24b87a0640 1 --2- 172.21.15.46:0/317131980 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24b0108cf0 0x7f24b010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:59.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.842+0000 7f24b87a0640 1 --2- 172.21.15.46:0/317131980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24b01083a0 0x7f24b01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:59.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.842+0000 7f24b87a0640 1 --2- 172.21.15.46:0/317131980 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24b0102a60 0x7f24b0102e70 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:59.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.842+0000 7f24b87a0640 1 -- 172.21.15.46:0/317131980 >> 172.21.15.46:0/317131980 conn(0x7f24b0079730 msgr2=0x7f24b0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:59.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.842+0000 7f24b87a0640 1 -- 172.21.15.46:0/317131980 shutdown_connections 2024-09-21T04:05:59.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.842+0000 7f24b87a0640 1 -- 172.21.15.46:0/317131980 wait complete. 2024-09-21T04:05:59.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.843+0000 7f24b87a0640 1 Processor -- start 2024-09-21T04:05:59.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.843+0000 7f24b87a0640 1 -- start start 2024-09-21T04:05:59.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.843+0000 7f24b87a0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24b0102a60 0x7f24b01992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:59.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.843+0000 7f24b87a0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24b01083a0 0x7f24b0199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:59.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.843+0000 7f24b87a0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24b0108cf0 0x7f24b019eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:59.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.843+0000 7f24b87a0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f24b01129b0 con 0x7f24b0108cf0 2024-09-21T04:05:59.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.843+0000 7f24b87a0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f24b0112830 con 0x7f24b0102a60 2024-09-21T04:05:59.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.843+0000 7f24b87a0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f24b0112b30 con 0x7f24b01083a0 2024-09-21T04:05:59.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.843+0000 7f24b6d3d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24b0108cf0 0x7f24b019eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:59.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.843+0000 7f24b6d3d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24b0108cf0 0x7f24b019eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34730/0 (socket says 172.21.15.46:34730) 2024-09-21T04:05:59.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.843+0000 7f24b6d3d640 1 -- 172.21.15.46:0/3563604947 learned_addr learned my addr 172.21.15.46:0/3563604947 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:05:59.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.843+0000 7f24b653c640 1 --2- 172.21.15.46:0/3563604947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24b0102a60 0x7f24b01992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:59.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.844+0000 7f24b5d3b640 1 --2- 172.21.15.46:0/3563604947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24b01083a0 0x7f24b0199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:59.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.844+0000 7f24b6d3d640 1 -- 172.21.15.46:0/3563604947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24b01083a0 msgr2=0x7f24b0199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:59.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.844+0000 7f24b6d3d640 1 --2- 172.21.15.46:0/3563604947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24b01083a0 0x7f24b0199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:59.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.844+0000 7f24b6d3d640 1 -- 172.21.15.46:0/3563604947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24b0102a60 msgr2=0x7f24b01992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:59.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.844+0000 7f24b6d3d640 1 --2- 172.21.15.46:0/3563604947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24b0102a60 0x7f24b01992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:59.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.844+0000 7f24b6d3d640 1 -- 172.21.15.46:0/3563604947 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24b019f170 con 0x7f24b0108cf0 2024-09-21T04:05:59.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.844+0000 7f24b653c640 1 --2- 172.21.15.46:0/3563604947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24b0102a60 0x7f24b01992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:05:59.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.844+0000 7f24b5d3b640 1 --2- 172.21.15.46:0/3563604947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24b01083a0 0x7f24b0199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:05:59.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.844+0000 7f24b6d3d640 1 --2- 172.21.15.46:0/3563604947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24b0108cf0 0x7f24b019eb00 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f24a800cce0 tx=0x7f24a800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:59.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.844+0000 7f24a77fe640 1 -- 172.21.15.46:0/3563604947 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a800f450 con 0x7f24b0108cf0 2024-09-21T04:05:59.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.844+0000 7f24b87a0640 1 -- 172.21.15.46:0/3563604947 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24b019f460 con 0x7f24b0108cf0 2024-09-21T04:05:59.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.844+0000 7f24a77fe640 1 -- 172.21.15.46:0/3563604947 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24a800faa0 con 0x7f24b0108cf0 2024-09-21T04:05:59.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.844+0000 7f24a77fe640 1 -- 172.21.15.46:0/3563604947 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a8018b70 con 0x7f24b0108cf0 2024-09-21T04:05:59.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.844+0000 7f24b87a0640 1 -- 172.21.15.46:0/3563604947 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24b01a5c80 con 0x7f24b0108cf0 2024-09-21T04:05:59.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.845+0000 7f24b87a0640 1 -- 172.21.15.46:0/3563604947 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24b0102e70 con 0x7f24b0108cf0 2024-09-21T04:05:59.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.847+0000 7f24a77fe640 1 -- 172.21.15.46:0/3563604947 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7f24a8018d10 con 0x7f24b0108cf0 2024-09-21T04:05:59.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.847+0000 7f24a77fe640 1 --2- 172.21.15.46:0/3563604947 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f249c0b66b0 0x7f249c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:59.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.848+0000 7f24a77fe640 1 -- 172.21.15.46:0/3563604947 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8454+0+0 (secure 0 0 0) 0x7f24a80e7c30 con 0x7f24b0108cf0 2024-09-21T04:05:59.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.848+0000 7f24b653c640 1 --2- 172.21.15.46:0/3563604947 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f249c0b66b0 0x7f249c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:59.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.848+0000 7f24b653c640 1 --2- 172.21.15.46:0/3563604947 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f249c0b66b0 0x7f249c0b8bc0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f24ac000c00 tx=0x7f24ac031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:59.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:05:59.851+0000 7f24a77fe640 1 -- 172.21.15.46:0/3563604947 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f24a8014030 con 0x7f24b0108cf0 2024-09-21T04:05:59.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:59 smithi162 ceph-mon[35071]: pgmap v654: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T04:05:59.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:59 smithi162 ceph-mon[35071]: mds.? [v2:172.21.15.162:6838/1152299716,v1:172.21.15.162:6839/1152299716] up:boot 2024-09-21T04:05:59.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:59 smithi162 ceph-mon[35071]: mds.? [v2:172.21.15.105:6838/1102937125,v1:172.21.15.105:6839/1102937125] up:boot 2024-09-21T04:05:59.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:59 smithi162 ceph-mon[35071]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-21T04:05:59.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:59 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T04:05:59.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:05:59 smithi162 ceph-mon[35071]: from='mgr.14223 172.21.15.46:0/160992085' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T04:06:00.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:00.077+0000 7f24b87a0640 1 -- 172.21.15.46:0/3563604947 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f24b002e640 con 0x7f24b0108cf0 2024-09-21T04:06:00.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:00.581+0000 7f24a77fe640 1 -- 172.21.15.46:0/3563604947 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v23) ==== 104+0+0 (secure 0 0 0) 0x7f24a80ae250 con 0x7f24b0108cf0 2024-09-21T04:06:00.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:00.584+0000 7f24b87a0640 1 -- 172.21.15.46:0/3563604947 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f249c0b66b0 msgr2=0x7f249c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:06:00.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:00.584+0000 7f24b87a0640 1 --2- 172.21.15.46:0/3563604947 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f249c0b66b0 0x7f249c0b8bc0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f24ac000c00 tx=0x7f24ac031400 comp rx=0 tx=0).stop 2024-09-21T04:06:00.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:00.584+0000 7f24b87a0640 1 -- 172.21.15.46:0/3563604947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24b0108cf0 msgr2=0x7f24b019eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:06:00.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:00.584+0000 7f24b87a0640 1 --2- 172.21.15.46:0/3563604947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24b0108cf0 0x7f24b019eb00 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f24a800cce0 tx=0x7f24a800a620 comp rx=0 tx=0).stop 2024-09-21T04:06:00.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:00.584+0000 7f24b87a0640 1 -- 172.21.15.46:0/3563604947 shutdown_connections 2024-09-21T04:06:00.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:00.584+0000 7f24b87a0640 1 --2- 172.21.15.46:0/3563604947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24b0108cf0 0x7f24b019eb00 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:06:00.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:00.584+0000 7f24b87a0640 1 --2- 172.21.15.46:0/3563604947 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7f249c0b66b0 0x7f249c0b8bc0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:06:00.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:00.584+0000 7f24b87a0640 1 --2- 172.21.15.46:0/3563604947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24b01083a0 0x7f24b0199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:06:00.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:00.584+0000 7f24b87a0640 1 --2- 172.21.15.46:0/3563604947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24b0102a60 0x7f24b01992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:06:00.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:00.584+0000 7f24b87a0640 1 -- 172.21.15.46:0/3563604947 >> 172.21.15.46:0/3563604947 conn(0x7f24b0079730 msgr2=0x7f24b01012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:06:00.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:00.584+0000 7f24b87a0640 1 -- 172.21.15.46:0/3563604947 shutdown_connections 2024-09-21T04:06:00.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:00.584+0000 7f24b87a0640 1 -- 172.21.15.46:0/3563604947 wait complete. 2024-09-21T04:06:00.869 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:06:00 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3563604947' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T04:06:00.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:06:00 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3563604947' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T04:06:01.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:06:00 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3563604947' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T04:06:01.199 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T04:06:01.471 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:06:01.866 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:06:01 smithi046 ceph-mon[30954]: pgmap v656: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-21T04:06:01.866 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:06:01 smithi046 ceph-mon[30954]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T04:06:01.866 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:06:01 smithi046 ceph-mon[30954]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T04:06:01.866 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:06:01 smithi046 ceph-mon[30954]: Cluster is now healthy 2024-09-21T04:06:01.866 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:06:01 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3563604947' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T04:06:01.867 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:06:01 smithi046 ceph-mon[30954]: fsmap 12 up:standby 2024-09-21T04:06:01.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:06:01 smithi162 ceph-mon[35071]: pgmap v656: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-21T04:06:01.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:06:01 smithi162 ceph-mon[35071]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T04:06:01.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:06:01 smithi162 ceph-mon[35071]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T04:06:01.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:06:01 smithi162 ceph-mon[35071]: Cluster is now healthy 2024-09-21T04:06:01.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:06:01 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3563604947' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T04:06:01.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:06:01 smithi162 ceph-mon[35071]: fsmap 12 up:standby 2024-09-21T04:06:01.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.959+0000 7fbfbacac640 1 -- 172.21.15.46:0/2868129668 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbfb4102aa0 msgr2=0x7fbfb4102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:06:01.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.959+0000 7fbfbacac640 1 --2- 172.21.15.46:0/2868129668 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbfb4102aa0 0x7fbfb4102eb0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4009900 tx=0x7fbfa402a410 comp rx=0 tx=0).stop 2024-09-21T04:06:01.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.959+0000 7fbfbacac640 1 -- 172.21.15.46:0/2868129668 shutdown_connections 2024-09-21T04:06:01.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.959+0000 7fbfbacac640 1 --2- 172.21.15.46:0/2868129668 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfb4108d30 0x7fbfb410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:06:01.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.959+0000 7fbfbacac640 1 --2- 172.21.15.46:0/2868129668 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfb41083e0 0x7fbfb41087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:06:01.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.959+0000 7fbfbacac640 1 --2- 172.21.15.46:0/2868129668 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbfb4102aa0 0x7fbfb4102eb0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:06:01.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.959+0000 7fbfbacac640 1 -- 172.21.15.46:0/2868129668 >> 172.21.15.46:0/2868129668 conn(0x7fbfb4079750 msgr2=0x7fbfb4079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:06:01.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.959+0000 7fbfbacac640 1 -- 172.21.15.46:0/2868129668 shutdown_connections 2024-09-21T04:06:01.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.959+0000 7fbfbacac640 1 -- 172.21.15.46:0/2868129668 wait complete. 2024-09-21T04:06:01.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.960+0000 7fbfbacac640 1 Processor -- start 2024-09-21T04:06:01.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.960+0000 7fbfbacac640 1 -- start start 2024-09-21T04:06:01.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.960+0000 7fbfbacac640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfb4102aa0 0x7fbfb40ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:06:01.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.960+0000 7fbfbacac640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbfb41083e0 0x7fbfb40ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:06:01.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.960+0000 7fbfbacac640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfb4108d30 0x7fbfb41000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:06:01.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.961+0000 7fbfbacac640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb41129f0 con 0x7fbfb41083e0 2024-09-21T04:06:01.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.961+0000 7fbfbacac640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb4112870 con 0x7fbfb4108d30 2024-09-21T04:06:01.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.961+0000 7fbfbacac640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb4112b70 con 0x7fbfb4102aa0 2024-09-21T04:06:01.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.961+0000 7fbfb3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbfb41083e0 0x7fbfb40ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:06:01.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.961+0000 7fbfb3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbfb41083e0 0x7fbfb40ffbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34760/0 (socket says 172.21.15.46:34760) 2024-09-21T04:06:01.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.961+0000 7fbfb3fff640 1 -- 172.21.15.46:0/3429609622 learned_addr learned my addr 172.21.15.46:0/3429609622 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:06:01.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.961+0000 7fbfb8a48640 1 --2- 172.21.15.46:0/3429609622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfb4102aa0 0x7fbfb40ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:06:01.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.961+0000 7fbfb9249640 1 --2- 172.21.15.46:0/3429609622 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfb4108d30 0x7fbfb41000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:06:01.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.961+0000 7fbfb3fff640 1 -- 172.21.15.46:0/3429609622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfb4102aa0 msgr2=0x7fbfb40ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:06:01.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.961+0000 7fbfb3fff640 1 --2- 172.21.15.46:0/3429609622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfb4102aa0 0x7fbfb40ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:06:01.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.961+0000 7fbfb3fff640 1 -- 172.21.15.46:0/3429609622 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfb4108d30 msgr2=0x7fbfb41000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:06:01.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.961+0000 7fbfb3fff640 1 --2- 172.21.15.46:0/3429609622 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfb4108d30 0x7fbfb41000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:06:01.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.961+0000 7fbfb3fff640 1 -- 172.21.15.46:0/3429609622 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb41a8790 con 0x7fbfb41083e0 2024-09-21T04:06:01.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.961+0000 7fbfb3fff640 1 --2- 172.21.15.46:0/3429609622 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbfb41083e0 0x7fbfb40ffbb0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c00c970 tx=0x7fbf9c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:06:01.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.961+0000 7fbfb1ffb640 1 -- 172.21.15.46:0/3429609622 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c004220 con 0x7fbfb41083e0 2024-09-21T04:06:01.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.961+0000 7fbfbacac640 1 -- 172.21.15.46:0/3429609622 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfb41a8a80 con 0x7fbfb41083e0 2024-09-21T04:06:01.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.961+0000 7fbfb1ffb640 1 -- 172.21.15.46:0/3429609622 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf9c0043c0 con 0x7fbfb41083e0 2024-09-21T04:06:01.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.961+0000 7fbfb1ffb640 1 -- 172.21.15.46:0/3429609622 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c004a00 con 0x7fbfb41083e0 2024-09-21T04:06:01.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.962+0000 7fbfbacac640 1 -- 172.21.15.46:0/3429609622 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfb41a8fc0 con 0x7fbfb41083e0 2024-09-21T04:06:01.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.963+0000 7fbfbacac640 1 -- 172.21.15.46:0/3429609622 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfb4102eb0 con 0x7fbfb41083e0 2024-09-21T04:06:01.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.964+0000 7fbfb1ffb640 1 -- 172.21.15.46:0/3429609622 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7fbf9c0079b0 con 0x7fbfb41083e0 2024-09-21T04:06:01.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.965+0000 7fbfb1ffb640 1 --2- 172.21.15.46:0/3429609622 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fbfa00b6680 0x7fbfa00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:06:01.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.965+0000 7fbfb8a48640 1 --2- 172.21.15.46:0/3429609622 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fbfa00b6680 0x7fbfa00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:06:01.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.965+0000 7fbfb1ffb640 1 -- 172.21.15.46:0/3429609622 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8454+0+0 (secure 0 0 0) 0x7fbf9c0e7440 con 0x7fbfb41083e0 2024-09-21T04:06:01.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.966+0000 7fbfb8a48640 1 --2- 172.21.15.46:0/3429609622 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fbfa00b6680 0x7fbfa00b8b90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4000c00 tx=0x7fbfa4031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:06:01.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:01.970+0000 7fbfb1ffb640 1 -- 172.21.15.46:0/3429609622 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbf9c014030 con 0x7fbfb41083e0 2024-09-21T04:06:02.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:06:01 smithi105 ceph-mon[34773]: pgmap v656: 97 pgs: 97 active+clean; 14 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-21T04:06:02.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:06:01 smithi105 ceph-mon[34773]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T04:06:02.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:06:01 smithi105 ceph-mon[34773]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T04:06:02.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:06:01 smithi105 ceph-mon[34773]: Cluster is now healthy 2024-09-21T04:06:02.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:06:01 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3563604947' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T04:06:02.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:06:01 smithi105 ceph-mon[34773]: fsmap 12 up:standby 2024-09-21T04:06:02.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:02.159+0000 7fbfbacac640 1 -- 172.21.15.46:0/3429609622 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbfb410b580 con 0x7fbfb41083e0 2024-09-21T04:06:02.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:02.588+0000 7fbfb1ffb640 1 -- 172.21.15.46:0/3429609622 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v85) ==== 181+0+0 (secure 0 0 0) 0x7fbf9c0b1d50 con 0x7fbfb41083e0 2024-09-21T04:06:02.591 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' removed 2024-09-21T04:06:02.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:02.592+0000 7fbfbacac640 1 -- 172.21.15.46:0/3429609622 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fbfa00b6680 msgr2=0x7fbfa00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:06:02.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:02.592+0000 7fbfbacac640 1 --2- 172.21.15.46:0/3429609622 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fbfa00b6680 0x7fbfa00b8b90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4000c00 tx=0x7fbfa4031400 comp rx=0 tx=0).stop 2024-09-21T04:06:02.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:02.592+0000 7fbfbacac640 1 -- 172.21.15.46:0/3429609622 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbfb41083e0 msgr2=0x7fbfb40ffbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:06:02.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:02.592+0000 7fbfbacac640 1 --2- 172.21.15.46:0/3429609622 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbfb41083e0 0x7fbfb40ffbb0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c00c970 tx=0x7fbf9c00ce30 comp rx=0 tx=0).stop 2024-09-21T04:06:02.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:02.592+0000 7fbfbacac640 1 -- 172.21.15.46:0/3429609622 shutdown_connections 2024-09-21T04:06:02.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:02.592+0000 7fbfbacac640 1 --2- 172.21.15.46:0/3429609622 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfb4108d30 0x7fbfb41000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:06:02.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:02.592+0000 7fbfbacac640 1 --2- 172.21.15.46:0/3429609622 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbfb41083e0 0x7fbfb40ffbb0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:06:02.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:02.592+0000 7fbfbacac640 1 --2- 172.21.15.46:0/3429609622 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fbfa00b6680 0x7fbfa00b8b90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:06:02.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:02.592+0000 7fbfbacac640 1 --2- 172.21.15.46:0/3429609622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfb4102aa0 0x7fbfb40ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:06:02.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:02.592+0000 7fbfbacac640 1 -- 172.21.15.46:0/3429609622 >> 172.21.15.46:0/3429609622 conn(0x7fbfb4079750 msgr2=0x7fbfb4101aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:06:02.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:02.592+0000 7fbfbacac640 1 -- 172.21.15.46:0/3429609622 shutdown_connections 2024-09-21T04:06:02.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:02.593+0000 7fbfbacac640 1 -- 172.21.15.46:0/3429609622 wait complete. 2024-09-21T04:06:02.751 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:06:02 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3429609622' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T04:06:02.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:06:02 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3429609622' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T04:06:03.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:06:02 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3429609622' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T04:06:03.257 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T04:06:03.523 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:06:03.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:06:03 smithi162 ceph-mon[35071]: pgmap v657: 97 pgs: 97 active+clean; 14 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 307 B/s wr, 16 op/s 2024-09-21T04:06:03.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:06:03 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/3429609622' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T04:06:03.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:06:03 smithi162 ceph-mon[35071]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T04:06:03.908 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:06:03 smithi046 ceph-mon[30954]: pgmap v657: 97 pgs: 97 active+clean; 14 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 307 B/s wr, 16 op/s 2024-09-21T04:06:03.909 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:06:03 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/3429609622' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T04:06:03.909 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:06:03 smithi046 ceph-mon[30954]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T04:06:04.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.002+0000 7faba1149640 1 -- 172.21.15.46:0/3259848306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab9c105300 msgr2=0x7fab9c10d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:06:04.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.002+0000 7faba1149640 1 --2- 172.21.15.46:0/3259848306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab9c105300 0x7fab9c10d850 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fab90009900 tx=0x7fab9002a410 comp rx=0 tx=0).stop 2024-09-21T04:06:04.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.002+0000 7faba1149640 1 -- 172.21.15.46:0/3259848306 shutdown_connections 2024-09-21T04:06:04.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.002+0000 7faba1149640 1 --2- 172.21.15.46:0/3259848306 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab9c10de10 0x7fab9c110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:06:04.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.002+0000 7faba1149640 1 --2- 172.21.15.46:0/3259848306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab9c105300 0x7fab9c10d850 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:06:04.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.002+0000 7faba1149640 1 --2- 172.21.15.46:0/3259848306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab9c1049b0 0x7fab9c104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:06:04.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.002+0000 7faba1149640 1 -- 172.21.15.46:0/3259848306 >> 172.21.15.46:0/3259848306 conn(0x7fab9c079730 msgr2=0x7fab9c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:06:04.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.002+0000 7faba1149640 1 -- 172.21.15.46:0/3259848306 shutdown_connections 2024-09-21T04:06:04.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.002+0000 7faba1149640 1 -- 172.21.15.46:0/3259848306 wait complete. 2024-09-21T04:06:04.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.003+0000 7faba1149640 1 Processor -- start 2024-09-21T04:06:04.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.003+0000 7faba1149640 1 -- start start 2024-09-21T04:06:04.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.003+0000 7faba1149640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab9c1049b0 0x7fab9c19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:06:04.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.003+0000 7faba1149640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab9c105300 0x7fab9c19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:06:04.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.003+0000 7faba1149640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab9c10de10 0x7fab9c19fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:06:04.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.003+0000 7faba1149640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fab9c113a70 con 0x7fab9c10de10 2024-09-21T04:06:04.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.003+0000 7faba1149640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fab9c1138f0 con 0x7fab9c105300 2024-09-21T04:06:04.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.003+0000 7faba1149640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fab9c113bf0 con 0x7fab9c1049b0 2024-09-21T04:06:04.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.004+0000 7fab9b59e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab9c10de10 0x7fab9c19fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:06:04.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.004+0000 7fab9a59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab9c105300 0x7fab9c19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:06:04.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.004+0000 7fab9b59e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab9c10de10 0x7fab9c19fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36192/0 (socket says 172.21.15.46:36192) 2024-09-21T04:06:04.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.004+0000 7fab9b59e640 1 -- 172.21.15.46:0/2256688829 learned_addr learned my addr 172.21.15.46:0/2256688829 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T04:06:04.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.004+0000 7fab9a59c640 1 --2- 172.21.15.46:0/2256688829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab9c105300 0x7fab9c19aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.46:35198/0 (socket says 172.21.15.46:35198) 2024-09-21T04:06:04.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.004+0000 7fab9ad9d640 1 --2- 172.21.15.46:0/2256688829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab9c1049b0 0x7fab9c19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:06:04.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.004+0000 7fab9b59e640 1 -- 172.21.15.46:0/2256688829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab9c1049b0 msgr2=0x7fab9c19a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:06:04.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.004+0000 7fab9b59e640 1 --2- 172.21.15.46:0/2256688829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab9c1049b0 0x7fab9c19a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:06:04.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.004+0000 7fab9b59e640 1 -- 172.21.15.46:0/2256688829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab9c105300 msgr2=0x7fab9c19aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:06:04.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.004+0000 7fab9b59e640 1 --2- 172.21.15.46:0/2256688829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab9c105300 0x7fab9c19aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:06:04.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.004+0000 7fab9b59e640 1 -- 172.21.15.46:0/2256688829 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab9c1a0410 con 0x7fab9c10de10 2024-09-21T04:06:04.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.004+0000 7fab9a59c640 1 --2- 172.21.15.46:0/2256688829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab9c105300 0x7fab9c19aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:06:04.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.004+0000 7fab9b59e640 1 --2- 172.21.15.46:0/2256688829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab9c10de10 0x7fab9c19fce0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fab9400eb10 tx=0x7fab9400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:06:04.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.004+0000 7fab83fff640 1 -- 172.21.15.46:0/2256688829 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab94004b20 con 0x7fab9c10de10 2024-09-21T04:06:04.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.004+0000 7faba1149640 1 -- 172.21.15.46:0/2256688829 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab9c1a0700 con 0x7fab9c10de10 2024-09-21T04:06:04.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.004+0000 7fab83fff640 1 -- 172.21.15.46:0/2256688829 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab94004cc0 con 0x7fab9c10de10 2024-09-21T04:06:04.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.004+0000 7fab83fff640 1 -- 172.21.15.46:0/2256688829 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab94010670 con 0x7fab9c10de10 2024-09-21T04:06:04.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.005+0000 7faba1149640 1 -- 172.21.15.46:0/2256688829 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab9c1a6e60 con 0x7fab9c10de10 2024-09-21T04:06:04.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.006+0000 7faba1149640 1 -- 172.21.15.46:0/2256688829 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab9c104dc0 con 0x7fab9c10de10 2024-09-21T04:06:04.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.007+0000 7fab83fff640 1 -- 172.21.15.46:0/2256688829 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 23) ==== 154643+0+0 (secure 0 0 0) 0x7fab94005000 con 0x7fab9c10de10 2024-09-21T04:06:04.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.008+0000 7fab83fff640 1 --2- 172.21.15.46:0/2256688829 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fab840b6680 0x7fab840b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:06:04.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.008+0000 7fab9ad9d640 1 --2- 172.21.15.46:0/2256688829 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fab840b6680 0x7fab840b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:06:04.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.008+0000 7fab83fff640 1 -- 172.21.15.46:0/2256688829 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7958+0+0 (secure 0 0 0) 0x7fab940e7c90 con 0x7fab9c10de10 2024-09-21T04:06:04.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.009+0000 7fab9ad9d640 1 --2- 172.21.15.46:0/2256688829 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fab840b6680 0x7fab840b8b90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fab9c06bc60 tx=0x7fab8c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:06:04.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.011+0000 7fab83fff640 1 -- 172.21.15.46:0/2256688829 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fab94056710 con 0x7fab9c10de10 2024-09-21T04:06:04.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:06:03 smithi105 ceph-mon[34773]: pgmap v657: 97 pgs: 97 active+clean; 14 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 307 B/s wr, 16 op/s 2024-09-21T04:06:04.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:06:03 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/3429609622' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T04:06:04.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:06:03 smithi105 ceph-mon[34773]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T04:06:04.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.200+0000 7faba1149640 1 -- 172.21.15.46:0/2256688829 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fab9c19b5d0 con 0x7fab9c10de10 2024-09-21T04:06:04.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.595+0000 7fab83fff640 1 -- 172.21.15.46:0/2256688829 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v86) ==== 169+0+0 (secure 0 0 0) 0x7fab940ae3c0 con 0x7fab9c10de10 2024-09-21T04:06:04.598 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' removed 2024-09-21T04:06:04.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.599+0000 7faba1149640 1 -- 172.21.15.46:0/2256688829 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fab840b6680 msgr2=0x7fab840b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:06:04.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.599+0000 7faba1149640 1 --2- 172.21.15.46:0/2256688829 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fab840b6680 0x7fab840b8b90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fab9c06bc60 tx=0x7fab8c005f90 comp rx=0 tx=0).stop 2024-09-21T04:06:04.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.599+0000 7faba1149640 1 -- 172.21.15.46:0/2256688829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab9c10de10 msgr2=0x7fab9c19fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:06:04.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.599+0000 7faba1149640 1 --2- 172.21.15.46:0/2256688829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab9c10de10 0x7fab9c19fce0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fab9400eb10 tx=0x7fab9400c2d0 comp rx=0 tx=0).stop 2024-09-21T04:06:04.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.599+0000 7faba1149640 1 -- 172.21.15.46:0/2256688829 shutdown_connections 2024-09-21T04:06:04.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.599+0000 7faba1149640 1 --2- 172.21.15.46:0/2256688829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab9c10de10 0x7fab9c19fce0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:06:04.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.599+0000 7faba1149640 1 --2- 172.21.15.46:0/2256688829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab9c105300 0x7fab9c19aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:06:04.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.599+0000 7faba1149640 1 --2- 172.21.15.46:0/2256688829 >> [v2:172.21.15.46:6800/1928997883,v1:172.21.15.46:6801/1928997883] conn(0x7fab840b6680 0x7fab840b8b90 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:06:04.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.599+0000 7faba1149640 1 --2- 172.21.15.46:0/2256688829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab9c1049b0 0x7fab9c19a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:06:04.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.599+0000 7faba1149640 1 -- 172.21.15.46:0/2256688829 >> 172.21.15.46:0/2256688829 conn(0x7fab9c079730 msgr2=0x7fab9c0ff730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:06:04.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.600+0000 7faba1149640 1 -- 172.21.15.46:0/2256688829 shutdown_connections 2024-09-21T04:06:04.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T04:06:04.600+0000 7faba1149640 1 -- 172.21.15.46:0/2256688829 wait complete. 2024-09-21T04:06:04.875 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:06:04 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/2256688829' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T04:06:04.971 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:06:04 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/2256688829' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T04:06:05.068 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:06:04 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/2256688829' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T04:06:05.285 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T04:06:05.317 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T04:06:05.358 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T04:06:05.392 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T04:06:05.392 DEBUG:teuthology.orchestra.run.smithi046:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T04:06:05.414 DEBUG:teuthology.orchestra.run.smithi105:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T04:06:05.436 DEBUG:teuthology.orchestra.run.smithi162:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T04:06:05.456 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T04:06:05.456 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-21T04:06:05.456 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mon.a 2024-09-21T04:06:05.768 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:06:05 smithi046 systemd[1]: Stopping Ceph mon.a for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T04:06:05.768 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:06:05 smithi046 ceph-mon[30954]: pgmap v659: 65 pgs: 65 active+clean; 577 KiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:06:05.768 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:06:05 smithi046 ceph-mon[30954]: from='client.? 172.21.15.46:0/2256688829' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T04:06:05.769 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:06:05 smithi046 ceph-mon[30954]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T04:06:05.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:06:05 smithi105 ceph-mon[34773]: pgmap v659: 65 pgs: 65 active+clean; 577 KiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:06:05.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:06:05 smithi105 ceph-mon[34773]: from='client.? 172.21.15.46:0/2256688829' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T04:06:05.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:06:05 smithi105 ceph-mon[34773]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T04:06:05.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:06:05 smithi162 ceph-mon[35071]: pgmap v659: 65 pgs: 65 active+clean; 577 KiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:06:05.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:06:05 smithi162 ceph-mon[35071]: from='client.? 172.21.15.46:0/2256688829' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T04:06:05.876 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:06:05 smithi162 ceph-mon[35071]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T04:06:06.135 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:06:05 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mon-a[30950]: 2024-09-21T04:06:05.765+0000 7f7707e74640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:06:06.135 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:06:05 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mon-a[30950]: 2024-09-21T04:06:05.765+0000 7f7707e74640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-21T04:06:06.135 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:06:05 smithi046 podman[101126]: 2024-09-21 04:06:05.837484437 +0000 UTC m=+0.183497121 container died 2da122372490c3567152fd5393c05a2ac84f9adc25f3c2737c803a74d4df320a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T04:06:06.469 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:06:06 smithi046 podman[101126]: 2024-09-21 04:06:06.23260017 +0000 UTC m=+0.578612844 container cleanup 2da122372490c3567152fd5393c05a2ac84f9adc25f3c2737c803a74d4df320a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T04:06:06.469 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 21 04:06:06 smithi046 bash[101126]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mon-a 2024-09-21T04:06:06.619 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mon.a.service' 2024-09-21T04:06:06.668 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:06:06.668 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-21T04:06:06.668 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-21T04:06:06.668 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mon.b 2024-09-21T04:06:06.999 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:06:06 smithi105 systemd[1]: Stopping Ceph mon.b for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T04:06:07.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:06:06 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mon-b[34769]: 2024-09-21T04:06:06.996+0000 7f84163c8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:06:07.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:06:06 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mon-b[34769]: 2024-09-21T04:06:06.996+0000 7f84163c8640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-21T04:06:07.318 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:06:07 smithi105 podman[66931]: 2024-09-21 04:06:07.221231632 +0000 UTC m=+0.355146038 container died ddde3b0c49f415457c427b0eee97f3b62ae9dd45b5017b8a622b03922f9f8c7b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mon-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-21T04:06:07.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:06:07 smithi105 podman[66931]: 2024-09-21 04:06:07.60479909 +0000 UTC m=+0.738713482 container cleanup ddde3b0c49f415457c427b0eee97f3b62ae9dd45b5017b8a622b03922f9f8c7b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mon-b, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-21T04:06:07.818 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 21 04:06:07 smithi105 bash[66931]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mon-b 2024-09-21T04:06:08.039 DEBUG:teuthology.orchestra.run.smithi105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mon.b.service' 2024-09-21T04:06:08.082 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:06:08.082 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-21T04:06:08.082 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-21T04:06:08.082 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mon.c 2024-09-21T04:06:08.376 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:06:08 smithi162 systemd[1]: Stopping Ceph mon.c for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T04:06:08.816 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:06:08 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mon-c[35067]: 2024-09-21T04:06:08.413+0000 7f13e2dfe640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:06:08.816 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:06:08 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mon-c[35067]: 2024-09-21T04:06:08.413+0000 7f13e2dfe640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-21T04:06:08.817 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:06:08 smithi162 podman[67577]: 2024-09-21 04:06:08.526272469 +0000 UTC m=+0.240977146 container died 04f27d3f22a20fe22b228560b811934dcc4ef4100150a27cb4e02fdbd716d79c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mon-c, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-21T04:06:09.125 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:06:08 smithi162 podman[67577]: 2024-09-21 04:06:08.922543067 +0000 UTC m=+0.637247747 container cleanup 04f27d3f22a20fe22b228560b811934dcc4ef4100150a27cb4e02fdbd716d79c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mon-c, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T04:06:09.126 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 21 04:06:08 smithi162 bash[67577]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mon-c 2024-09-21T04:06:09.360 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mon.c.service' 2024-09-21T04:06:09.408 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:06:09.408 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-21T04:06:09.408 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-21T04:06:09.408 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mgr.x 2024-09-21T04:06:09.706 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 04:06:09 smithi046 systemd[1]: Stopping Ceph mgr.x for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T04:06:10.002 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 04:06:09 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: 2024-09-21T04:06:09.703+0000 7f50a8901640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:06:10.002 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 04:06:09 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x[31182]: 2024-09-21T04:06:09.703+0000 7f50a8901640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-21T04:06:10.002 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 04:06:09 smithi046 podman[101246]: 2024-09-21 04:06:09.736076502 +0000 UTC m=+0.130840913 container died b1ecd01064dea992b24db4559f088c72ff1f93f83f58e67ac2d4c1f7978564c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.vendor=CentOS) 2024-09-21T04:06:10.383 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 04:06:10 smithi046 podman[101246]: 2024-09-21 04:06:10.09645309 +0000 UTC m=+0.491217476 container cleanup b1ecd01064dea992b24db4559f088c72ff1f93f83f58e67ac2d4c1f7978564c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T04:06:10.383 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 21 04:06:10 smithi046 bash[101246]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-x 2024-09-21T04:06:10.536 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mgr.x.service' 2024-09-21T04:06:10.586 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:06:10.586 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-21T04:06:10.587 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-21T04:06:10.587 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mgr.y 2024-09-21T04:06:10.915 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 21 04:06:10 smithi105 systemd[1]: Stopping Ceph mgr.y for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T04:06:11.212 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 21 04:06:10 smithi105 podman[67053]: 2024-09-21 04:06:10.914161367 +0000 UTC m=+0.138984464 container died cd1ebcbf48aa29ec623d550838d39529a1d92c43108647c24ad091cfa7e95dc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-y, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-21T04:06:11.563 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 21 04:06:11 smithi105 podman[67053]: 2024-09-21 04:06:11.310451757 +0000 UTC m=+0.535274841 container cleanup cd1ebcbf48aa29ec623d550838d39529a1d92c43108647c24ad091cfa7e95dc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD) 2024-09-21T04:06:11.563 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 21 04:06:11 smithi105 bash[67053]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-y 2024-09-21T04:06:11.731 DEBUG:teuthology.orchestra.run.smithi105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mgr.y.service' 2024-09-21T04:06:11.765 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:06:11.765 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-21T04:06:11.766 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-21T04:06:11.766 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mgr.z 2024-09-21T04:06:12.108 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 21 04:06:11 smithi162 systemd[1]: Stopping Ceph mgr.z for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T04:06:12.376 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 21 04:06:12 smithi162 podman[67700]: 2024-09-21 04:06:12.106575476 +0000 UTC m=+0.144055855 container died 974d68a7ecd530cc59edada5895c92fea59eb7efb1c06b658db692a2ab1c1e86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-z, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-21T04:06:12.790 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 21 04:06:12 smithi162 podman[67700]: 2024-09-21 04:06:12.520103293 +0000 UTC m=+0.557583671 container cleanup 974d68a7ecd530cc59edada5895c92fea59eb7efb1c06b658db692a2ab1c1e86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-z, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T04:06:12.790 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 21 04:06:12 smithi162 bash[67700]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-z 2024-09-21T04:06:13.082 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 21 04:06:12 smithi162 podman[67713]: 2024-09-21 04:06:12.78861602 +0000 UTC m=+0.677028326 container remove 974d68a7ecd530cc59edada5895c92fea59eb7efb1c06b658db692a2ab1c1e86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mgr-z, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T04:06:13.082 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 21 04:06:12 smithi162 systemd[1]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-09-21T04:06:13.098 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mgr.z.service' 2024-09-21T04:06:13.132 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:06:13.132 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-21T04:06:13.132 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T04:06:13.132 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.0 2024-09-21T04:06:13.444 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 04:06:13 smithi046 systemd[1]: Stopping Ceph osd.0 for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T04:06:13.751 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 04:06:13 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-0[47599]: 2024-09-21T04:06:13.442+0000 7eff5ae7d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:06:13.751 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 04:06:13 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-0[47599]: 2024-09-21T04:06:13.442+0000 7eff5ae7d640 -1 osd.0 86 *** Got signal Terminated *** 2024-09-21T04:06:13.751 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 04:06:13 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-0[47599]: 2024-09-21T04:06:13.442+0000 7eff5ae7d640 -1 osd.0 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T04:06:19.204 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 04:06:18 smithi046 podman[101368]: 2024-09-21 04:06:18.913729283 +0000 UTC m=+5.580452122 container died 919e9030ece572c1193183bfb1af88625deb73536aa137062721b717e9e926ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T04:06:19.501 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 04:06:19 smithi046 podman[101368]: 2024-09-21 04:06:19.368249572 +0000 UTC m=+6.034972409 container cleanup 919e9030ece572c1193183bfb1af88625deb73536aa137062721b717e9e926ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T04:06:19.501 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 04:06:19 smithi046 bash[101368]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-0 2024-09-21T04:06:20.002 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 04:06:19 smithi046 podman[101383]: 2024-09-21 04:06:19.653514986 +0000 UTC m=+0.736651069 container remove 919e9030ece572c1193183bfb1af88625deb73536aa137062721b717e9e926ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T04:06:20.284 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 04:06:20 smithi046 podman[101478]: 2024-09-21 04:06:19.911160875 +0000 UTC m=+0.016481002 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T04:06:20.284 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 04:06:20 smithi046 podman[101478]: 2024-09-21 04:06:20.025390485 +0000 UTC m=+0.130710591 container create 4b0f03b732ad60235dbc1638a28cc9f0d338db04167478dd898543b75600e98b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-21T04:06:20.752 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 04:06:20 smithi046 podman[101478]: 2024-09-21 04:06:20.282671241 +0000 UTC m=+0.387991369 container init 4b0f03b732ad60235dbc1638a28cc9f0d338db04167478dd898543b75600e98b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T04:06:20.752 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 04:06:20 smithi046 podman[101478]: 2024-09-21 04:06:20.286183706 +0000 UTC m=+0.391503813 container start 4b0f03b732ad60235dbc1638a28cc9f0d338db04167478dd898543b75600e98b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-21T04:06:20.752 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 04:06:20 smithi046 podman[101478]: 2024-09-21 04:06:20.36601228 +0000 UTC m=+0.471332387 container attach 4b0f03b732ad60235dbc1638a28cc9f0d338db04167478dd898543b75600e98b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T04:06:20.752 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 04:06:20 smithi046 podman[101478]: 2024-09-21 04:06:20.476400566 +0000 UTC m=+0.581720682 container died 4b0f03b732ad60235dbc1638a28cc9f0d338db04167478dd898543b75600e98b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-21T04:06:21.275 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.0.service' 2024-09-21T04:06:21.325 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:06:21.325 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T04:06:21.325 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T04:06:21.325 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.1 2024-09-21T04:06:21.568 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 21 04:06:21 smithi105 systemd[1]: Stopping Ceph osd.1 for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T04:06:22.068 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 21 04:06:21 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-1[39410]: 2024-09-21T04:06:21.630+0000 7fc94b92e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:06:22.068 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 21 04:06:21 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-1[39410]: 2024-09-21T04:06:21.630+0000 7fc94b92e640 -1 osd.1 86 *** Got signal Terminated *** 2024-09-21T04:06:22.068 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 21 04:06:21 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-1[39410]: 2024-09-21T04:06:21.630+0000 7fc94b92e640 -1 osd.1 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T04:06:27.235 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 21 04:06:26 smithi105 podman[67190]: 2024-09-21 04:06:26.952182725 +0000 UTC m=+5.441620368 container died 4265c72e96e819f15de2cbfb8fa84703bfb06960d9d1d1cc230f3bec8c4e7b3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-1, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T04:06:27.568 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 21 04:06:27 smithi105 podman[67190]: 2024-09-21 04:06:27.332085109 +0000 UTC m=+5.821522751 container cleanup 4265c72e96e819f15de2cbfb8fa84703bfb06960d9d1d1cc230f3bec8c4e7b3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-1, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-21T04:06:27.568 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 21 04:06:27 smithi105 bash[67190]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-1 2024-09-21T04:06:27.950 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 21 04:06:27 smithi105 podman[67206]: 2024-09-21 04:06:27.608883408 +0000 UTC m=+0.654889248 container remove 4265c72e96e819f15de2cbfb8fa84703bfb06960d9d1d1cc230f3bec8c4e7b3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-1, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T04:06:28.255 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 21 04:06:27 smithi105 podman[67292]: 2024-09-21 04:06:27.851452175 +0000 UTC m=+0.015833206 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T04:06:28.255 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 21 04:06:27 smithi105 podman[67292]: 2024-09-21 04:06:27.996709747 +0000 UTC m=+0.161090807 container create 6d7de84b42bb9cf55647695066d01728a4a1ad847126cfe479e431378af08e6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T04:06:28.256 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 21 04:06:28 smithi105 podman[67292]: 2024-09-21 04:06:28.254150626 +0000 UTC m=+0.418531646 container init 6d7de84b42bb9cf55647695066d01728a4a1ad847126cfe479e431378af08e6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T04:06:28.568 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 21 04:06:28 smithi105 podman[67292]: 2024-09-21 04:06:28.257601493 +0000 UTC m=+0.421982509 container start 6d7de84b42bb9cf55647695066d01728a4a1ad847126cfe479e431378af08e6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-21T04:06:28.569 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 21 04:06:28 smithi105 podman[67292]: 2024-09-21 04:06:28.346305524 +0000 UTC m=+0.510686548 container attach 6d7de84b42bb9cf55647695066d01728a4a1ad847126cfe479e431378af08e6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-21T04:06:28.569 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 21 04:06:28 smithi105 podman[67292]: 2024-09-21 04:06:28.446749522 +0000 UTC m=+0.611130537 container died 6d7de84b42bb9cf55647695066d01728a4a1ad847126cfe479e431378af08e6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-1-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-21T04:06:29.274 DEBUG:teuthology.orchestra.run.smithi105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.1.service' 2024-09-21T04:06:29.316 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:06:29.316 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T04:06:29.316 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T04:06:29.317 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.2 2024-09-21T04:06:29.625 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 21 04:06:29 smithi162 systemd[1]: Stopping Ceph osd.2 for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T04:06:30.125 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 21 04:06:29 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-2[40211]: 2024-09-21T04:06:29.631+0000 7f09a5aa4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:06:30.126 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 21 04:06:29 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-2[40211]: 2024-09-21T04:06:29.631+0000 7f09a5aa4640 -1 osd.2 86 *** Got signal Terminated *** 2024-09-21T04:06:30.126 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 21 04:06:29 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-2[40211]: 2024-09-21T04:06:29.631+0000 7f09a5aa4640 -1 osd.2 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T04:06:35.359 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 21 04:06:35 smithi162 podman[67838]: 2024-09-21 04:06:35.055297704 +0000 UTC m=+5.544729206 container died 77f96c7013d6aff287d6811a35755199fab05ee210ead2a0bc134e95768118c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T04:06:35.625 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 21 04:06:35 smithi162 podman[67838]: 2024-09-21 04:06:35.448186315 +0000 UTC m=+5.937617813 container cleanup 77f96c7013d6aff287d6811a35755199fab05ee210ead2a0bc134e95768118c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T04:06:35.626 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 21 04:06:35 smithi162 bash[67838]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-2 2024-09-21T04:06:36.065 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 21 04:06:35 smithi162 podman[67854]: 2024-09-21 04:06:35.733533238 +0000 UTC m=+0.674874161 container remove 77f96c7013d6aff287d6811a35755199fab05ee210ead2a0bc134e95768118c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T04:06:36.355 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 21 04:06:36 smithi162 podman[67945]: 2024-09-21 04:06:35.966888307 +0000 UTC m=+0.015792015 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T04:06:36.355 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 21 04:06:36 smithi162 podman[67945]: 2024-09-21 04:06:36.092701788 +0000 UTC m=+0.141605486 container create 36478c782059b17f06886c14f0f33d56a7805d503c713072f604b6d5c3fd7d46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-21T04:06:36.626 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 21 04:06:36 smithi162 podman[67945]: 2024-09-21 04:06:36.353644334 +0000 UTC m=+0.402548026 container init 36478c782059b17f06886c14f0f33d56a7805d503c713072f604b6d5c3fd7d46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True) 2024-09-21T04:06:36.626 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 21 04:06:36 smithi162 podman[67945]: 2024-09-21 04:06:36.357001111 +0000 UTC m=+0.405904813 container start 36478c782059b17f06886c14f0f33d56a7805d503c713072f604b6d5c3fd7d46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T04:06:36.626 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 21 04:06:36 smithi162 podman[67945]: 2024-09-21 04:06:36.445408123 +0000 UTC m=+0.494311845 container attach 36478c782059b17f06886c14f0f33d56a7805d503c713072f604b6d5c3fd7d46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T04:06:36.626 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 21 04:06:36 smithi162 podman[67945]: 2024-09-21 04:06:36.54216654 +0000 UTC m=+0.591070244 container died 36478c782059b17f06886c14f0f33d56a7805d503c713072f604b6d5c3fd7d46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T04:06:37.175 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.2.service' 2024-09-21T04:06:37.217 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:06:37.217 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T04:06:37.218 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T04:06:37.218 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.3 2024-09-21T04:06:37.502 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 21 04:06:37 smithi046 systemd[1]: Stopping Ceph osd.3 for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T04:06:38.001 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 21 04:06:37 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-3[54007]: 2024-09-21T04:06:37.531+0000 7f76b4155640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:06:38.002 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 21 04:06:37 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-3[54007]: 2024-09-21T04:06:37.531+0000 7f76b4155640 -1 osd.3 86 *** Got signal Terminated *** 2024-09-21T04:06:38.002 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 21 04:06:37 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-3[54007]: 2024-09-21T04:06:37.531+0000 7f76b4155640 -1 osd.3 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T04:06:40.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:06:39 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:06:39.715+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:06:40.375 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:06:39 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:06:39.970+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:06:41.001 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:40 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:40.696+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:16.804161+0000 front 2024-09-21T04:06:16.804301+0000 (oldest deadline 2024-09-21T04:06:40.204749+0000) 2024-09-21T04:06:41.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:06:40 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:06:40.701+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:06:41.375 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:06:40 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:06:40.925+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:06:41.501 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 21 04:06:41 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-3[54007]: 2024-09-21T04:06:41.175+0000 7f76ac738640 -1 osd.3 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:16.469194+0000 front 2024-09-21T04:06:16.469632+0000 (oldest deadline 2024-09-21T04:06:40.569408+0000) 2024-09-21T04:06:42.001 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:41 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:41.729+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:16.804161+0000 front 2024-09-21T04:06:16.804301+0000 (oldest deadline 2024-09-21T04:06:40.204749+0000) 2024-09-21T04:06:42.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:06:41 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:06:41.718+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:06:42.375 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:06:41 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:06:41.965+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:06:42.502 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 21 04:06:42 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-3[54007]: 2024-09-21T04:06:42.149+0000 7f76ac738640 -1 osd.3 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:16.469194+0000 front 2024-09-21T04:06:16.469632+0000 (oldest deadline 2024-09-21T04:06:40.569408+0000) 2024-09-21T04:06:43.001 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:42 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:42.710+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:16.804161+0000 front 2024-09-21T04:06:16.804301+0000 (oldest deadline 2024-09-21T04:06:40.204749+0000) 2024-09-21T04:06:43.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:06:42 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:06:42.760+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:06:43.368 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 21 04:06:43 smithi046 podman[101580]: 2024-09-21 04:06:43.078165891 +0000 UTC m=+5.661140607 container died 585fedfa3c73520d284d2e412f4fee3d475c85e6e1aa3d3366889c43c3196b9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-21T04:06:43.375 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:06:42 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:06:42.962+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:06:43.702 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 21 04:06:43 smithi046 podman[101580]: 2024-09-21 04:06:43.456561053 +0000 UTC m=+6.039535768 container cleanup 585fedfa3c73520d284d2e412f4fee3d475c85e6e1aa3d3366889c43c3196b9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-3, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=) 2024-09-21T04:06:43.702 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 21 04:06:43 smithi046 bash[101580]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-3 2024-09-21T04:06:44.001 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 21 04:06:43 smithi046 podman[101595]: 2024-09-21 04:06:43.75803681 +0000 UTC m=+0.679726543 container remove 585fedfa3c73520d284d2e412f4fee3d475c85e6e1aa3d3366889c43c3196b9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-21T04:06:44.002 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:43 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:43.698+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:16.804161+0000 front 2024-09-21T04:06:16.804301+0000 (oldest deadline 2024-09-21T04:06:40.204749+0000) 2024-09-21T04:06:44.002 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:06:43 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:06:43.903+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:06:44.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:06:43 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:06:43.730+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:06:44.375 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:43 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5[46374]: 2024-09-21T04:06:43.880+0000 7ff1cff98640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.980196+0000 front 2024-09-21T04:06:17.980118+0000 (oldest deadline 2024-09-21T04:06:43.780578+0000) 2024-09-21T04:06:44.376 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:06:43 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:06:43.925+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:06:44.380 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 21 04:06:44 smithi046 podman[101687]: 2024-09-21 04:06:43.984265391 +0000 UTC m=+0.016376005 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T04:06:44.380 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 21 04:06:44 smithi046 podman[101687]: 2024-09-21 04:06:44.117615164 +0000 UTC m=+0.149725759 container create 94aac203b79dbe145c8dd8ec49d9fa2ec0311cf6b9437807b45d847e23e52c47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-3-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T04:06:44.380 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 21 04:06:44 smithi046 podman[101687]: 2024-09-21 04:06:44.378539189 +0000 UTC m=+0.410649796 container init 94aac203b79dbe145c8dd8ec49d9fa2ec0311cf6b9437807b45d847e23e52c47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-3-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T04:06:44.711 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 21 04:06:44 smithi046 podman[101687]: 2024-09-21 04:06:44.382471171 +0000 UTC m=+0.414581768 container start 94aac203b79dbe145c8dd8ec49d9fa2ec0311cf6b9437807b45d847e23e52c47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-3-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T04:06:44.711 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 21 04:06:44 smithi046 podman[101687]: 2024-09-21 04:06:44.470262849 +0000 UTC m=+0.502373444 container attach 94aac203b79dbe145c8dd8ec49d9fa2ec0311cf6b9437807b45d847e23e52c47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0) 2024-09-21T04:06:44.711 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 21 04:06:44 smithi046 podman[101687]: 2024-09-21 04:06:44.572484294 +0000 UTC m=+0.604594896 container died 94aac203b79dbe145c8dd8ec49d9fa2ec0311cf6b9437807b45d847e23e52c47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T04:06:45.001 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:44 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:44.708+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:16.804161+0000 front 2024-09-21T04:06:16.804301+0000 (oldest deadline 2024-09-21T04:06:40.204749+0000) 2024-09-21T04:06:45.002 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:06:44 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:06:44.950+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:06:45.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:06:44 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:06:44.688+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:06:45.126 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:44 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5[46374]: 2024-09-21T04:06:44.848+0000 7ff1cff98640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.980196+0000 front 2024-09-21T04:06:17.980118+0000 (oldest deadline 2024-09-21T04:06:43.780578+0000) 2024-09-21T04:06:45.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:06:44 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:06:44.942+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:06:45.203 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.3.service' 2024-09-21T04:06:45.250 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:06:45.250 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T04:06:45.251 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T04:06:45.251 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.4 2024-09-21T04:06:45.563 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 21 04:06:45 smithi105 systemd[1]: Stopping Ceph osd.4 for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T04:06:45.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:06:45 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:06:45.697+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:06:45.818 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 21 04:06:45 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-4[46008]: 2024-09-21T04:06:45.561+0000 7f071e4ec640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:06:45.818 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 21 04:06:45 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-4[46008]: 2024-09-21T04:06:45.561+0000 7f071e4ec640 -1 osd.4 86 *** Got signal Terminated *** 2024-09-21T04:06:45.818 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 21 04:06:45 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-4[46008]: 2024-09-21T04:06:45.561+0000 7f071e4ec640 -1 osd.4 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T04:06:46.001 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:45 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:45.678+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:16.804161+0000 front 2024-09-21T04:06:16.804301+0000 (oldest deadline 2024-09-21T04:06:40.204749+0000) 2024-09-21T04:06:46.002 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:06:45 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:06:45.907+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:06:46.126 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:45 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5[46374]: 2024-09-21T04:06:45.832+0000 7ff1cff98640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.980196+0000 front 2024-09-21T04:06:17.980118+0000 (oldest deadline 2024-09-21T04:06:43.780578+0000) 2024-09-21T04:06:46.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:06:45 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:06:45.935+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:06:47.001 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:46 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:46.712+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:16.804161+0000 front 2024-09-21T04:06:16.804301+0000 (oldest deadline 2024-09-21T04:06:40.204749+0000) 2024-09-21T04:06:47.002 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:06:46 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:06:46.879+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:06:47.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:06:46 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:06:46.670+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:06:47.126 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:46 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5[46374]: 2024-09-21T04:06:46.830+0000 7ff1cff98640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.980196+0000 front 2024-09-21T04:06:17.980118+0000 (oldest deadline 2024-09-21T04:06:43.780578+0000) 2024-09-21T04:06:47.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:06:46 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:06:46.973+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:06:48.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:06:47 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:06:47.642+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:06:48.125 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:06:47 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:06:47.924+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:06:48.126 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:47 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5[46374]: 2024-09-21T04:06:47.869+0000 7ff1cff98640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.980196+0000 front 2024-09-21T04:06:17.980118+0000 (oldest deadline 2024-09-21T04:06:43.780578+0000) 2024-09-21T04:06:48.126 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:47 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5[46374]: 2024-09-21T04:06:47.869+0000 7ff1cff98640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.481705+0000 front 2024-09-21T04:06:25.481806+0000 (oldest deadline 2024-09-21T04:06:47.181729+0000) 2024-09-21T04:06:48.251 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:47 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:47.755+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:16.804161+0000 front 2024-09-21T04:06:16.804301+0000 (oldest deadline 2024-09-21T04:06:40.204749+0000) 2024-09-21T04:06:48.252 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:06:47 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:06:47.918+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:06:48.252 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:06:47 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:06:47.918+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:06:49.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:06:48 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:06:48.639+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:06:49.251 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:48 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:48.750+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:16.804161+0000 front 2024-09-21T04:06:16.804301+0000 (oldest deadline 2024-09-21T04:06:40.204749+0000) 2024-09-21T04:06:49.252 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:48 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:48.750+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.105571+0000 front 2024-09-21T04:06:23.105625+0000 (oldest deadline 2024-09-21T04:06:48.405767+0000) 2024-09-21T04:06:49.252 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:06:48 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:06:48.904+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:06:49.252 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:06:48 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:06:48.904+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:06:49.376 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:06:49 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:06:49.048+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.156631+0000 front 2024-09-21T04:06:23.156561+0000 (oldest deadline 2024-09-21T04:06:48.456687+0000) 2024-09-21T04:06:49.376 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:06:48 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:06:48.928+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:06:49.376 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:48 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5[46374]: 2024-09-21T04:06:48.876+0000 7ff1cff98640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.980196+0000 front 2024-09-21T04:06:17.980118+0000 (oldest deadline 2024-09-21T04:06:43.780578+0000) 2024-09-21T04:06:49.376 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:48 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5[46374]: 2024-09-21T04:06:48.876+0000 7ff1cff98640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.481705+0000 front 2024-09-21T04:06:25.481806+0000 (oldest deadline 2024-09-21T04:06:47.181729+0000) 2024-09-21T04:06:49.969 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:06:49 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:06:49.643+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:06:50.001 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:49 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:49.730+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:16.804161+0000 front 2024-09-21T04:06:16.804301+0000 (oldest deadline 2024-09-21T04:06:40.204749+0000) 2024-09-21T04:06:50.002 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:49 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:49.730+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.105571+0000 front 2024-09-21T04:06:23.105625+0000 (oldest deadline 2024-09-21T04:06:48.405767+0000) 2024-09-21T04:06:50.002 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:06:49 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:06:49.948+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:06:50.002 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:06:49 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:06:49.948+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:06:50.277 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:06:49 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:06:49.919+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:06:50.278 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:06:50 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:06:50.071+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.156631+0000 front 2024-09-21T04:06:23.156561+0000 (oldest deadline 2024-09-21T04:06:48.456687+0000) 2024-09-21T04:06:50.278 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:49 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5[46374]: 2024-09-21T04:06:49.919+0000 7ff1cff98640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.980196+0000 front 2024-09-21T04:06:17.980118+0000 (oldest deadline 2024-09-21T04:06:43.780578+0000) 2024-09-21T04:06:50.278 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:49 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5[46374]: 2024-09-21T04:06:49.919+0000 7ff1cff98640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.481705+0000 front 2024-09-21T04:06:25.481806+0000 (oldest deadline 2024-09-21T04:06:47.181729+0000) 2024-09-21T04:06:50.992 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:06:50 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:06:50.677+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:06:50.992 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:06:50 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:06:50.677+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:06:51.251 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:50 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:50.779+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:16.804161+0000 front 2024-09-21T04:06:16.804301+0000 (oldest deadline 2024-09-21T04:06:40.204749+0000) 2024-09-21T04:06:51.252 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:50 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:50.779+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.105571+0000 front 2024-09-21T04:06:23.105625+0000 (oldest deadline 2024-09-21T04:06:48.405767+0000) 2024-09-21T04:06:51.252 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:06:50 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:06:50.976+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:06:51.252 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:06:50 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:06:50.976+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:06:51.298 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 21 04:06:50 smithi105 podman[67395]: 2024-09-21 04:06:50.990675993 +0000 UTC m=+5.546263370 container died 065efe691382e8e3cc156be61b8957057d00ef9d971f74d59a143c2020838922 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-4, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T04:06:51.299 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:06:51 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:06:51.050+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.624874+0000 front 2024-09-21T04:06:25.624992+0000 (oldest deadline 2024-09-21T04:06:50.924970+0000) 2024-09-21T04:06:51.375 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:06:51 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:06:51.072+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.156631+0000 front 2024-09-21T04:06:23.156561+0000 (oldest deadline 2024-09-21T04:06:48.456687+0000) 2024-09-21T04:06:51.376 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:50 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5[46374]: 2024-09-21T04:06:50.902+0000 7ff1cff98640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.980196+0000 front 2024-09-21T04:06:17.980118+0000 (oldest deadline 2024-09-21T04:06:43.780578+0000) 2024-09-21T04:06:51.376 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:50 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5[46374]: 2024-09-21T04:06:50.902+0000 7ff1cff98640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.481705+0000 front 2024-09-21T04:06:25.481806+0000 (oldest deadline 2024-09-21T04:06:47.181729+0000) 2024-09-21T04:06:51.376 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:06:50 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:06:50.953+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:06:51.568 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 21 04:06:51 smithi105 podman[67395]: 2024-09-21 04:06:51.395318994 +0000 UTC m=+5.950906362 container cleanup 065efe691382e8e3cc156be61b8957057d00ef9d971f74d59a143c2020838922 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-4, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T04:06:51.568 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 21 04:06:51 smithi105 bash[67395]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-4 2024-09-21T04:06:51.975 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 21 04:06:51 smithi105 podman[67410]: 2024-09-21 04:06:51.663475605 +0000 UTC m=+0.667941727 container remove 065efe691382e8e3cc156be61b8957057d00ef9d971f74d59a143c2020838922 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-21T04:06:51.975 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:06:51 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:06:51.645+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:06:51.975 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:06:51 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:06:51.645+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:06:52.236 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:06:52 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:06:52.091+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.624874+0000 front 2024-09-21T04:06:25.624992+0000 (oldest deadline 2024-09-21T04:06:50.924970+0000) 2024-09-21T04:06:52.236 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 21 04:06:51 smithi105 podman[67499]: 2024-09-21 04:06:51.876260636 +0000 UTC m=+0.016160789 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T04:06:52.236 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 21 04:06:51 smithi105 podman[67499]: 2024-09-21 04:06:51.997642125 +0000 UTC m=+0.137542277 container create 42463187e5cd904770c0cdd1220860619be8c0925296fbfb3bf353939eea9a17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-21T04:06:52.236 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 21 04:06:52 smithi105 podman[67499]: 2024-09-21 04:06:52.233989742 +0000 UTC m=+0.373889895 container init 42463187e5cd904770c0cdd1220860619be8c0925296fbfb3bf353939eea9a17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T04:06:52.252 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:51 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:51.829+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:16.804161+0000 front 2024-09-21T04:06:16.804301+0000 (oldest deadline 2024-09-21T04:06:40.204749+0000) 2024-09-21T04:06:52.252 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:51 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:51.829+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.105571+0000 front 2024-09-21T04:06:23.105625+0000 (oldest deadline 2024-09-21T04:06:48.405767+0000) 2024-09-21T04:06:52.252 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:06:52 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:06:52.017+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:06:52.252 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:06:52 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:06:52.017+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:06:52.376 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:06:52 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:06:52.031+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.156631+0000 front 2024-09-21T04:06:23.156561+0000 (oldest deadline 2024-09-21T04:06:48.456687+0000) 2024-09-21T04:06:52.377 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:51 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5[46374]: 2024-09-21T04:06:51.918+0000 7ff1cff98640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.980196+0000 front 2024-09-21T04:06:17.980118+0000 (oldest deadline 2024-09-21T04:06:43.780578+0000) 2024-09-21T04:06:52.377 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:51 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5[46374]: 2024-09-21T04:06:51.918+0000 7ff1cff98640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.481705+0000 front 2024-09-21T04:06:25.481806+0000 (oldest deadline 2024-09-21T04:06:47.181729+0000) 2024-09-21T04:06:52.377 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:06:51 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:06:51.904+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:06:52.378 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:06:51 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:06:51.904+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:06:52.571 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 21 04:06:52 smithi105 podman[67499]: 2024-09-21 04:06:52.237394119 +0000 UTC m=+0.377294275 container start 42463187e5cd904770c0cdd1220860619be8c0925296fbfb3bf353939eea9a17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0) 2024-09-21T04:06:52.572 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 21 04:06:52 smithi105 podman[67499]: 2024-09-21 04:06:52.325615051 +0000 UTC m=+0.465515221 container attach 42463187e5cd904770c0cdd1220860619be8c0925296fbfb3bf353939eea9a17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T04:06:52.572 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 21 04:06:52 smithi105 podman[67499]: 2024-09-21 04:06:52.42779159 +0000 UTC m=+0.567691753 container died 42463187e5cd904770c0cdd1220860619be8c0925296fbfb3bf353939eea9a17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T04:06:53.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:06:52 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:06:52.619+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:06:53.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:06:52 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:06:52.619+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:06:53.126 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:06:53 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:06:53.056+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.156631+0000 front 2024-09-21T04:06:23.156561+0000 (oldest deadline 2024-09-21T04:06:48.456687+0000) 2024-09-21T04:06:53.126 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:52 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5[46374]: 2024-09-21T04:06:52.913+0000 7ff1cff98640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.980196+0000 front 2024-09-21T04:06:17.980118+0000 (oldest deadline 2024-09-21T04:06:43.780578+0000) 2024-09-21T04:06:53.127 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:52 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5[46374]: 2024-09-21T04:06:52.913+0000 7ff1cff98640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.481705+0000 front 2024-09-21T04:06:25.481806+0000 (oldest deadline 2024-09-21T04:06:47.181729+0000) 2024-09-21T04:06:53.127 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:06:52 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:06:52.861+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:06:53.127 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:06:52 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:06:52.861+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:06:53.130 DEBUG:teuthology.orchestra.run.smithi105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.4.service' 2024-09-21T04:06:53.176 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:06:53.176 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T04:06:53.177 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T04:06:53.177 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.5 2024-09-21T04:06:53.252 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:52 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:52.786+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:16.804161+0000 front 2024-09-21T04:06:16.804301+0000 (oldest deadline 2024-09-21T04:06:40.204749+0000) 2024-09-21T04:06:53.252 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:52 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:52.786+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.105571+0000 front 2024-09-21T04:06:23.105625+0000 (oldest deadline 2024-09-21T04:06:48.405767+0000) 2024-09-21T04:06:53.253 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:06:53 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:06:53.001+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:06:53.253 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:06:53 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:06:53.001+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:06:53.512 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:53 smithi162 systemd[1]: Stopping Ceph osd.5 for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T04:06:53.568 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:06:53 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:06:53.100+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.624874+0000 front 2024-09-21T04:06:25.624992+0000 (oldest deadline 2024-09-21T04:06:50.924970+0000) 2024-09-21T04:06:53.828 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:53 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5[46374]: 2024-09-21T04:06:53.509+0000 7ff1d39ad640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:06:53.828 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:53 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5[46374]: 2024-09-21T04:06:53.509+0000 7ff1d39ad640 -1 osd.5 86 *** Got signal Terminated *** 2024-09-21T04:06:53.828 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:53 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5[46374]: 2024-09-21T04:06:53.509+0000 7ff1d39ad640 -1 osd.5 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T04:06:54.054 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:53 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:53.783+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:16.804161+0000 front 2024-09-21T04:06:16.804301+0000 (oldest deadline 2024-09-21T04:06:40.204749+0000) 2024-09-21T04:06:54.054 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:53 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:53.783+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.105571+0000 front 2024-09-21T04:06:23.105625+0000 (oldest deadline 2024-09-21T04:06:48.405767+0000) 2024-09-21T04:06:54.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:06:53 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:06:53.664+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:06:54.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:06:53 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:06:53.664+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:06:54.126 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:06:54 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:06:54.006+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.156631+0000 front 2024-09-21T04:06:23.156561+0000 (oldest deadline 2024-09-21T04:06:48.456687+0000) 2024-09-21T04:06:54.126 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:53 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5[46374]: 2024-09-21T04:06:53.915+0000 7ff1cff98640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.980196+0000 front 2024-09-21T04:06:17.980118+0000 (oldest deadline 2024-09-21T04:06:43.780578+0000) 2024-09-21T04:06:54.126 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:53 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5[46374]: 2024-09-21T04:06:53.915+0000 7ff1cff98640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.481705+0000 front 2024-09-21T04:06:25.481806+0000 (oldest deadline 2024-09-21T04:06:47.181729+0000) 2024-09-21T04:06:54.127 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:06:53 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:06:53.826+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:06:54.127 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:06:53 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:06:53.826+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:06:54.501 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:06:54 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:06:54.051+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:06:54.502 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:06:54 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:06:54.051+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:06:54.568 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:06:54 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:06:54.096+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.624874+0000 front 2024-09-21T04:06:25.624992+0000 (oldest deadline 2024-09-21T04:06:50.924970+0000) 2024-09-21T04:06:55.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:06:54 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:06:54.643+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:06:55.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:06:54 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:06:54.643+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:06:55.125 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:06:55 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:06:55.029+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.156631+0000 front 2024-09-21T04:06:23.156561+0000 (oldest deadline 2024-09-21T04:06:48.456687+0000) 2024-09-21T04:06:55.126 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:54 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5[46374]: 2024-09-21T04:06:54.866+0000 7ff1cff98640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.980196+0000 front 2024-09-21T04:06:17.980118+0000 (oldest deadline 2024-09-21T04:06:43.780578+0000) 2024-09-21T04:06:55.126 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:54 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5[46374]: 2024-09-21T04:06:54.866+0000 7ff1cff98640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.481705+0000 front 2024-09-21T04:06:25.481806+0000 (oldest deadline 2024-09-21T04:06:47.181729+0000) 2024-09-21T04:06:55.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:06:54 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:06:54.793+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:06:55.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:06:54 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:06:54.793+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:06:55.251 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:54 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:54.804+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:16.804161+0000 front 2024-09-21T04:06:16.804301+0000 (oldest deadline 2024-09-21T04:06:40.204749+0000) 2024-09-21T04:06:55.252 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:54 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:54.804+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.105571+0000 front 2024-09-21T04:06:23.105625+0000 (oldest deadline 2024-09-21T04:06:48.405767+0000) 2024-09-21T04:06:55.252 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:06:55 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:06:55.044+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:06:55.252 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:06:55 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:06:55.044+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:06:55.568 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:06:55 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:06:55.115+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.624874+0000 front 2024-09-21T04:06:25.624992+0000 (oldest deadline 2024-09-21T04:06:50.924970+0000) 2024-09-21T04:06:56.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:06:55 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:06:55.597+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:06:56.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:06:55 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:06:55.597+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:06:56.125 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:06:56 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:06:56.003+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.156631+0000 front 2024-09-21T04:06:23.156561+0000 (oldest deadline 2024-09-21T04:06:48.456687+0000) 2024-09-21T04:06:56.126 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:55 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5[46374]: 2024-09-21T04:06:55.892+0000 7ff1cff98640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.980196+0000 front 2024-09-21T04:06:17.980118+0000 (oldest deadline 2024-09-21T04:06:43.780578+0000) 2024-09-21T04:06:56.126 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:55 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5[46374]: 2024-09-21T04:06:55.892+0000 7ff1cff98640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.481705+0000 front 2024-09-21T04:06:25.481806+0000 (oldest deadline 2024-09-21T04:06:47.181729+0000) 2024-09-21T04:06:56.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:06:55 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:06:55.777+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:06:56.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:06:55 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:06:55.777+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:06:56.251 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:55 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:55.784+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:16.804161+0000 front 2024-09-21T04:06:16.804301+0000 (oldest deadline 2024-09-21T04:06:40.204749+0000) 2024-09-21T04:06:56.252 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:55 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:55.784+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.105571+0000 front 2024-09-21T04:06:23.105625+0000 (oldest deadline 2024-09-21T04:06:48.405767+0000) 2024-09-21T04:06:56.252 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:55 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:55.784+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:33.507936+0000 front 2024-09-21T04:06:33.507813+0000 (oldest deadline 2024-09-21T04:06:55.207744+0000) 2024-09-21T04:06:56.252 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:06:56 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:06:56.020+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:06:56.252 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:06:56 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:06:56.020+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:06:56.559 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:06:56 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:06:56.096+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.624874+0000 front 2024-09-21T04:06:25.624992+0000 (oldest deadline 2024-09-21T04:06:50.924970+0000) 2024-09-21T04:06:56.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:06:56 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:06:56.557+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:06:56.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:06:56 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:06:56.557+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:06:57.066 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:56 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:56.757+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:16.804161+0000 front 2024-09-21T04:06:16.804301+0000 (oldest deadline 2024-09-21T04:06:40.204749+0000) 2024-09-21T04:06:57.066 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:56 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:56.757+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.105571+0000 front 2024-09-21T04:06:23.105625+0000 (oldest deadline 2024-09-21T04:06:48.405767+0000) 2024-09-21T04:06:57.066 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:56 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:56.757+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:33.507936+0000 front 2024-09-21T04:06:33.507813+0000 (oldest deadline 2024-09-21T04:06:55.207744+0000) 2024-09-21T04:06:57.125 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:06:57 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:06:57.002+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.156631+0000 front 2024-09-21T04:06:23.156561+0000 (oldest deadline 2024-09-21T04:06:48.456687+0000) 2024-09-21T04:06:57.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:06:56 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:06:56.824+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:06:57.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:06:56 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:06:56.824+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:06:57.126 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:56 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5[46374]: 2024-09-21T04:06:56.908+0000 7ff1cff98640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.980196+0000 front 2024-09-21T04:06:17.980118+0000 (oldest deadline 2024-09-21T04:06:43.780578+0000) 2024-09-21T04:06:57.126 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:56 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5[46374]: 2024-09-21T04:06:56.908+0000 7ff1cff98640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.481705+0000 front 2024-09-21T04:06:25.481806+0000 (oldest deadline 2024-09-21T04:06:47.181729+0000) 2024-09-21T04:06:57.126 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:56 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5[46374]: 2024-09-21T04:06:56.908+0000 7ff1cff98640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:33.582998+0000 front 2024-09-21T04:06:33.582957+0000 (oldest deadline 2024-09-21T04:06:56.483071+0000) 2024-09-21T04:06:57.502 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:06:57 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:06:57.063+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:06:57.502 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:06:57 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:06:57.063+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:06:57.568 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:06:57 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:06:57.088+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.624874+0000 front 2024-09-21T04:06:25.624992+0000 (oldest deadline 2024-09-21T04:06:50.924970+0000) 2024-09-21T04:06:58.059 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:57 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:57.797+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:16.804161+0000 front 2024-09-21T04:06:16.804301+0000 (oldest deadline 2024-09-21T04:06:40.204749+0000) 2024-09-21T04:06:58.059 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:57 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:57.797+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.105571+0000 front 2024-09-21T04:06:23.105625+0000 (oldest deadline 2024-09-21T04:06:48.405767+0000) 2024-09-21T04:06:58.059 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:57 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:57.798+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:33.507936+0000 front 2024-09-21T04:06:33.507813+0000 (oldest deadline 2024-09-21T04:06:55.207744+0000) 2024-09-21T04:06:58.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:06:57 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:06:57.581+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:06:58.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:06:57 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:06:57.581+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:06:58.125 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:06:58 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:06:58.010+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.156631+0000 front 2024-09-21T04:06:23.156561+0000 (oldest deadline 2024-09-21T04:06:48.456687+0000) 2024-09-21T04:06:58.126 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:57 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5[46374]: 2024-09-21T04:06:57.900+0000 7ff1cff98640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.980196+0000 front 2024-09-21T04:06:17.980118+0000 (oldest deadline 2024-09-21T04:06:43.780578+0000) 2024-09-21T04:06:58.126 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:57 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5[46374]: 2024-09-21T04:06:57.900+0000 7ff1cff98640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.481705+0000 front 2024-09-21T04:06:25.481806+0000 (oldest deadline 2024-09-21T04:06:47.181729+0000) 2024-09-21T04:06:58.126 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:57 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5[46374]: 2024-09-21T04:06:57.900+0000 7ff1cff98640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:33.582998+0000 front 2024-09-21T04:06:33.582957+0000 (oldest deadline 2024-09-21T04:06:56.483071+0000) 2024-09-21T04:06:58.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:06:57 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:06:57.821+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:06:58.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:06:57 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:06:57.821+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:06:58.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:06:57 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:06:57.821+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:06:58.501 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:06:58 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:06:58.056+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:06:58.502 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:06:58 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:06:58.056+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:06:58.568 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:06:58 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:06:58.125+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.624874+0000 front 2024-09-21T04:06:25.624992+0000 (oldest deadline 2024-09-21T04:06:50.924970+0000) 2024-09-21T04:06:58.568 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:06:58 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:06:58.125+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:30.925648+0000 front 2024-09-21T04:06:30.925591+0000 (oldest deadline 2024-09-21T04:06:57.926083+0000) 2024-09-21T04:06:59.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:06:58 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:06:58.598+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:06:59.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:06:58 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:06:58.598+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:06:59.069 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:58 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:58.753+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:16.804161+0000 front 2024-09-21T04:06:16.804301+0000 (oldest deadline 2024-09-21T04:06:40.204749+0000) 2024-09-21T04:06:59.069 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:58 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:58.753+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.105571+0000 front 2024-09-21T04:06:23.105625+0000 (oldest deadline 2024-09-21T04:06:48.405767+0000) 2024-09-21T04:06:59.069 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:58 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:58.753+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:33.507936+0000 front 2024-09-21T04:06:33.507813+0000 (oldest deadline 2024-09-21T04:06:55.207744+0000) 2024-09-21T04:06:59.126 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:06:59 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:06:59.027+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.156631+0000 front 2024-09-21T04:06:23.156561+0000 (oldest deadline 2024-09-21T04:06:48.456687+0000) 2024-09-21T04:06:59.126 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:59 smithi162 podman[68071]: 2024-09-21 04:06:59.035519817 +0000 UTC m=+5.649081476 container died b9d6ed4ead0aba38ebb9ade2d164967bad1999bd712c8eff3180d61ac9bbf298 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-21T04:06:59.127 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:06:58 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:06:58.842+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:06:59.127 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:06:58 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:06:58.842+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:06:59.127 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:06:58 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:06:58.842+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:06:59.501 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:06:59 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:06:59.067+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:06:59.501 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:06:59 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:06:59.067+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:06:59.568 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:06:59 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:06:59.168+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.624874+0000 front 2024-09-21T04:06:25.624992+0000 (oldest deadline 2024-09-21T04:06:50.924970+0000) 2024-09-21T04:06:59.568 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:06:59 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:06:59.168+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:30.925648+0000 front 2024-09-21T04:06:30.925591+0000 (oldest deadline 2024-09-21T04:06:57.926083+0000) 2024-09-21T04:06:59.626 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:59 smithi162 podman[68071]: 2024-09-21 04:06:59.442498432 +0000 UTC m=+6.056060074 container cleanup b9d6ed4ead0aba38ebb9ade2d164967bad1999bd712c8eff3180d61ac9bbf298 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T04:06:59.626 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:59 smithi162 bash[68071]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5 2024-09-21T04:07:00.041 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:06:59 smithi162 podman[68086]: 2024-09-21 04:06:59.685788019 +0000 UTC m=+0.647851975 container remove b9d6ed4ead0aba38ebb9ade2d164967bad1999bd712c8eff3180d61ac9bbf298 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS) 2024-09-21T04:07:00.041 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:06:59 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:06:59.819+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:00.041 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:06:59 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:06:59.819+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:00.041 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:06:59 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:06:59.819+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:00.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:06:59 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:06:59.603+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:00.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:06:59 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:06:59.603+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:00.090 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:59 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:59.772+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:16.804161+0000 front 2024-09-21T04:06:16.804301+0000 (oldest deadline 2024-09-21T04:06:40.204749+0000) 2024-09-21T04:07:00.090 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:59 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:59.772+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.105571+0000 front 2024-09-21T04:06:23.105625+0000 (oldest deadline 2024-09-21T04:06:48.405767+0000) 2024-09-21T04:07:00.090 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:06:59 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:06:59.772+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:33.507936+0000 front 2024-09-21T04:06:33.507813+0000 (oldest deadline 2024-09-21T04:06:55.207744+0000) 2024-09-21T04:07:00.375 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:00 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:00.039+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.156631+0000 front 2024-09-21T04:06:23.156561+0000 (oldest deadline 2024-09-21T04:06:48.456687+0000) 2024-09-21T04:07:00.376 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:00 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:00.039+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.357843+0000 front 2024-09-21T04:06:34.357929+0000 (oldest deadline 2024-09-21T04:06:59.057892+0000) 2024-09-21T04:07:00.376 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:07:00 smithi162 podman[68173]: 2024-09-21 04:07:00.011897987 +0000 UTC m=+0.015865112 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T04:07:00.376 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:07:00 smithi162 podman[68173]: 2024-09-21 04:07:00.145264309 +0000 UTC m=+0.149231470 container create bb6d6e95360569df04e120e9dcc76080007b4b34c5abaa4d55dec2a224667d95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T04:07:00.501 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:00 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:00.087+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:07:00.502 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:00 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:00.087+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:07:00.568 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:00 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:00.218+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.624874+0000 front 2024-09-21T04:06:25.624992+0000 (oldest deadline 2024-09-21T04:06:50.924970+0000) 2024-09-21T04:07:00.568 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:00 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:00.218+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:30.925648+0000 front 2024-09-21T04:06:30.925591+0000 (oldest deadline 2024-09-21T04:06:57.926083+0000) 2024-09-21T04:07:00.789 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:07:00 smithi162 podman[68173]: 2024-09-21 04:07:00.381283018 +0000 UTC m=+0.385250133 container init bb6d6e95360569df04e120e9dcc76080007b4b34c5abaa4d55dec2a224667d95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T04:07:00.789 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:07:00 smithi162 podman[68173]: 2024-09-21 04:07:00.384621331 +0000 UTC m=+0.388588449 container start bb6d6e95360569df04e120e9dcc76080007b4b34c5abaa4d55dec2a224667d95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T04:07:00.790 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:07:00 smithi162 podman[68173]: 2024-09-21 04:07:00.473029801 +0000 UTC m=+0.476996931 container attach bb6d6e95360569df04e120e9dcc76080007b4b34c5abaa4d55dec2a224667d95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T04:07:00.790 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 21 04:07:00 smithi162 podman[68173]: 2024-09-21 04:07:00.575719412 +0000 UTC m=+0.579686528 container died bb6d6e95360569df04e120e9dcc76080007b4b34c5abaa4d55dec2a224667d95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-5-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-21T04:07:01.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:00 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:00.580+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:01.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:00 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:00.580+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:01.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:00 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:00.580+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:01.126 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:01 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:01.003+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.156631+0000 front 2024-09-21T04:06:23.156561+0000 (oldest deadline 2024-09-21T04:06:48.456687+0000) 2024-09-21T04:07:01.126 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:01 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:01.003+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.357843+0000 front 2024-09-21T04:06:34.357929+0000 (oldest deadline 2024-09-21T04:06:59.057892+0000) 2024-09-21T04:07:01.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:00 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:00.787+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:01.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:00 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:00.787+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:01.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:00 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:00.787+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:01.138 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:07:00 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:07:00.769+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:16.804161+0000 front 2024-09-21T04:06:16.804301+0000 (oldest deadline 2024-09-21T04:06:40.204749+0000) 2024-09-21T04:07:01.138 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:07:00 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:07:00.769+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.105571+0000 front 2024-09-21T04:06:23.105625+0000 (oldest deadline 2024-09-21T04:06:48.405767+0000) 2024-09-21T04:07:01.138 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:07:00 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:07:00.769+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:33.507936+0000 front 2024-09-21T04:06:33.507813+0000 (oldest deadline 2024-09-21T04:06:55.207744+0000) 2024-09-21T04:07:01.297 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.5.service' 2024-09-21T04:07:01.336 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:07:01.336 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T04:07:01.336 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-21T04:07:01.336 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.6 2024-09-21T04:07:01.501 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:07:01 smithi046 systemd[1]: Stopping Ceph osd.6 for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T04:07:01.502 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:01 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:01.135+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:07:01.502 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:01 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:01.135+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:07:01.502 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:01 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:01.135+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.604603+0000 front 2024-09-21T04:06:34.604771+0000 (oldest deadline 2024-09-21T04:07:00.504534+0000) 2024-09-21T04:07:01.570 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:01 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:01.245+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.624874+0000 front 2024-09-21T04:06:25.624992+0000 (oldest deadline 2024-09-21T04:06:50.924970+0000) 2024-09-21T04:07:01.570 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:01 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:01.245+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:30.925648+0000 front 2024-09-21T04:06:30.925591+0000 (oldest deadline 2024-09-21T04:06:57.926083+0000) 2024-09-21T04:07:02.002 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:07:01 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:07:01.643+0000 7f52f6506640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:07:02.002 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:07:01 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:07:01.643+0000 7f52f6506640 -1 osd.6 86 *** Got signal Terminated *** 2024-09-21T04:07:02.002 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:07:01 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:07:01.643+0000 7f52f6506640 -1 osd.6 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T04:07:02.002 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:07:01 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:07:01.819+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:16.804161+0000 front 2024-09-21T04:06:16.804301+0000 (oldest deadline 2024-09-21T04:06:40.204749+0000) 2024-09-21T04:07:02.002 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:07:01 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:07:01.819+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.105571+0000 front 2024-09-21T04:06:23.105625+0000 (oldest deadline 2024-09-21T04:06:48.405767+0000) 2024-09-21T04:07:02.002 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:07:01 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:07:01.819+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:33.507936+0000 front 2024-09-21T04:06:33.507813+0000 (oldest deadline 2024-09-21T04:06:55.207744+0000) 2024-09-21T04:07:02.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:01 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:01.626+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:02.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:01 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:01.626+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:02.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:01 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:01.626+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:02.126 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:02 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:02.046+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.156631+0000 front 2024-09-21T04:06:23.156561+0000 (oldest deadline 2024-09-21T04:06:48.456687+0000) 2024-09-21T04:07:02.126 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:02 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:02.046+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.357843+0000 front 2024-09-21T04:06:34.357929+0000 (oldest deadline 2024-09-21T04:06:59.057892+0000) 2024-09-21T04:07:02.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:01 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:01.834+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:02.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:01 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:01.834+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:02.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:01 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:01.834+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:02.501 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:02 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:02.164+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:07:02.502 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:02 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:02.164+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:07:02.502 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:02 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:02.164+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.604603+0000 front 2024-09-21T04:06:34.604771+0000 (oldest deadline 2024-09-21T04:07:00.504534+0000) 2024-09-21T04:07:02.568 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:02 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:02.220+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.624874+0000 front 2024-09-21T04:06:25.624992+0000 (oldest deadline 2024-09-21T04:06:50.924970+0000) 2024-09-21T04:07:02.568 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:02 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:02.220+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:30.925648+0000 front 2024-09-21T04:06:30.925591+0000 (oldest deadline 2024-09-21T04:06:57.926083+0000) 2024-09-21T04:07:03.058 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:02 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:02.787+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:03.058 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:02 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:02.787+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:03.058 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:02 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:02.787+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:03.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:02 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:02.628+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:03.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:02 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:02.628+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:03.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:02 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:02.628+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:03.203 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:07:02 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:07:02.829+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:16.804161+0000 front 2024-09-21T04:06:16.804301+0000 (oldest deadline 2024-09-21T04:06:40.204749+0000) 2024-09-21T04:07:03.203 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:07:02 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:07:02.829+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.105571+0000 front 2024-09-21T04:06:23.105625+0000 (oldest deadline 2024-09-21T04:06:48.405767+0000) 2024-09-21T04:07:03.203 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:07:02 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:07:02.829+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:33.507936+0000 front 2024-09-21T04:06:33.507813+0000 (oldest deadline 2024-09-21T04:06:55.207744+0000) 2024-09-21T04:07:03.376 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:03 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:03.055+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.156631+0000 front 2024-09-21T04:06:23.156561+0000 (oldest deadline 2024-09-21T04:06:48.456687+0000) 2024-09-21T04:07:03.376 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:03 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:03.055+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.357843+0000 front 2024-09-21T04:06:34.357929+0000 (oldest deadline 2024-09-21T04:06:59.057892+0000) 2024-09-21T04:07:03.501 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:03 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:03.200+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:07:03.501 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:03 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:03.200+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:07:03.502 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:03 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:03.200+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.604603+0000 front 2024-09-21T04:06:34.604771+0000 (oldest deadline 2024-09-21T04:07:00.504534+0000) 2024-09-21T04:07:03.568 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:03 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:03.206+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.624874+0000 front 2024-09-21T04:06:25.624992+0000 (oldest deadline 2024-09-21T04:06:50.924970+0000) 2024-09-21T04:07:03.568 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:03 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:03.206+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:30.925648+0000 front 2024-09-21T04:06:30.925591+0000 (oldest deadline 2024-09-21T04:06:57.926083+0000) 2024-09-21T04:07:04.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:03 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:03.659+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:04.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:03 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:03.659+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:04.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:03 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:03.659+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:04.106 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:03 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:03.744+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:04.106 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:03 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:03.744+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:04.107 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:03 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:03.744+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:04.229 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:07:03 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:07:03.832+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:16.804161+0000 front 2024-09-21T04:06:16.804301+0000 (oldest deadline 2024-09-21T04:06:40.204749+0000) 2024-09-21T04:07:04.229 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:07:03 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:07:03.832+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.105571+0000 front 2024-09-21T04:06:23.105625+0000 (oldest deadline 2024-09-21T04:06:48.405767+0000) 2024-09-21T04:07:04.229 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:07:03 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:07:03.832+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:33.507936+0000 front 2024-09-21T04:06:33.507813+0000 (oldest deadline 2024-09-21T04:06:55.207744+0000) 2024-09-21T04:07:04.375 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:04 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:04.104+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.156631+0000 front 2024-09-21T04:06:23.156561+0000 (oldest deadline 2024-09-21T04:06:48.456687+0000) 2024-09-21T04:07:04.376 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:04 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:04.104+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.357843+0000 front 2024-09-21T04:06:34.357929+0000 (oldest deadline 2024-09-21T04:06:59.057892+0000) 2024-09-21T04:07:04.376 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:04 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:04.104+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.058382+0000 front 2024-09-21T04:06:39.058476+0000 (oldest deadline 2024-09-21T04:07:03.158369+0000) 2024-09-21T04:07:04.501 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:04 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:04.226+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:07:04.502 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:04 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:04.226+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:07:04.502 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:04 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:04.226+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.604603+0000 front 2024-09-21T04:06:34.604771+0000 (oldest deadline 2024-09-21T04:07:00.504534+0000) 2024-09-21T04:07:04.568 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:04 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:04.187+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.624874+0000 front 2024-09-21T04:06:25.624992+0000 (oldest deadline 2024-09-21T04:06:50.924970+0000) 2024-09-21T04:07:04.568 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:04 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:04.187+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:30.925648+0000 front 2024-09-21T04:06:30.925591+0000 (oldest deadline 2024-09-21T04:06:57.926083+0000) 2024-09-21T04:07:04.568 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:04 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:04.187+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:40.227218+0000 front 2024-09-21T04:06:40.227320+0000 (oldest deadline 2024-09-21T04:07:03.727372+0000) 2024-09-21T04:07:05.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:04 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:04.671+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:05.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:04 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:04.671+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:05.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:04 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:04.671+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:05.103 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:04 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:04.729+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:05.103 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:04 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:04.729+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:05.103 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:04 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:04.729+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:05.103 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:04 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:04.729+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:05.252 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:07:04 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:07:04.864+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:16.804161+0000 front 2024-09-21T04:06:16.804301+0000 (oldest deadline 2024-09-21T04:06:40.204749+0000) 2024-09-21T04:07:05.252 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:07:04 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:07:04.864+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.105571+0000 front 2024-09-21T04:06:23.105625+0000 (oldest deadline 2024-09-21T04:06:48.405767+0000) 2024-09-21T04:07:05.252 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:07:04 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:07:04.864+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:33.507936+0000 front 2024-09-21T04:06:33.507813+0000 (oldest deadline 2024-09-21T04:06:55.207744+0000) 2024-09-21T04:07:05.376 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:05 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:05.101+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.156631+0000 front 2024-09-21T04:06:23.156561+0000 (oldest deadline 2024-09-21T04:06:48.456687+0000) 2024-09-21T04:07:05.376 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:05 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:05.101+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.357843+0000 front 2024-09-21T04:06:34.357929+0000 (oldest deadline 2024-09-21T04:06:59.057892+0000) 2024-09-21T04:07:05.376 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:05 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:05.101+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.058382+0000 front 2024-09-21T04:06:39.058476+0000 (oldest deadline 2024-09-21T04:07:03.158369+0000) 2024-09-21T04:07:05.568 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:05 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:05.193+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.624874+0000 front 2024-09-21T04:06:25.624992+0000 (oldest deadline 2024-09-21T04:06:50.924970+0000) 2024-09-21T04:07:05.568 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:05 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:05.193+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:30.925648+0000 front 2024-09-21T04:06:30.925591+0000 (oldest deadline 2024-09-21T04:06:57.926083+0000) 2024-09-21T04:07:05.568 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:05 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:05.193+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:40.227218+0000 front 2024-09-21T04:06:40.227320+0000 (oldest deadline 2024-09-21T04:07:03.727372+0000) 2024-09-21T04:07:05.751 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:05 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:05.276+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:07:05.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:05 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:05.276+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:07:05.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:05 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:05.276+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.604603+0000 front 2024-09-21T04:06:34.604771+0000 (oldest deadline 2024-09-21T04:07:00.504534+0000) 2024-09-21T04:07:06.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:05 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:05.629+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:06.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:05 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:05.629+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:06.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:05 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:05.629+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:06.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:05 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:05.744+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:06.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:05 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:05.744+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:06.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:05 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:05.744+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:06.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:05 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:05.744+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:06.252 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:07:05 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:07:05.888+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:16.804161+0000 front 2024-09-21T04:06:16.804301+0000 (oldest deadline 2024-09-21T04:06:40.204749+0000) 2024-09-21T04:07:06.252 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:07:05 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:07:05.888+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.105571+0000 front 2024-09-21T04:06:23.105625+0000 (oldest deadline 2024-09-21T04:06:48.405767+0000) 2024-09-21T04:07:06.252 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:07:05 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6[60579]: 2024-09-21T04:07:05.888+0000 7f52eeae9640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:33.507936+0000 front 2024-09-21T04:06:33.507813+0000 (oldest deadline 2024-09-21T04:06:55.207744+0000) 2024-09-21T04:07:06.568 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:06 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:06.177+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.624874+0000 front 2024-09-21T04:06:25.624992+0000 (oldest deadline 2024-09-21T04:06:50.924970+0000) 2024-09-21T04:07:06.568 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:06 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:06.177+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:30.925648+0000 front 2024-09-21T04:06:30.925591+0000 (oldest deadline 2024-09-21T04:06:57.926083+0000) 2024-09-21T04:07:06.568 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:06 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:06.177+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:40.227218+0000 front 2024-09-21T04:06:40.227320+0000 (oldest deadline 2024-09-21T04:07:03.727372+0000) 2024-09-21T04:07:06.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:06 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:06.137+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.156631+0000 front 2024-09-21T04:06:23.156561+0000 (oldest deadline 2024-09-21T04:06:48.456687+0000) 2024-09-21T04:07:06.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:06 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:06.137+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.357843+0000 front 2024-09-21T04:06:34.357929+0000 (oldest deadline 2024-09-21T04:06:59.057892+0000) 2024-09-21T04:07:06.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:06 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:06.137+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.058382+0000 front 2024-09-21T04:06:39.058476+0000 (oldest deadline 2024-09-21T04:07:03.158369+0000) 2024-09-21T04:07:06.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:06 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:06.275+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:07:06.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:06 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:06.275+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:07:06.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:06 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:06.275+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.604603+0000 front 2024-09-21T04:06:34.604771+0000 (oldest deadline 2024-09-21T04:07:00.504534+0000) 2024-09-21T04:07:06.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:06 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:06.275+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:40.504853+0000 front 2024-09-21T04:06:40.505012+0000 (oldest deadline 2024-09-21T04:07:05.805002+0000) 2024-09-21T04:07:07.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:06 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:06.593+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:07.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:06 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:06.593+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:07.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:06 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:06.593+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:07.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:06 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:06.593+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.934931+0000 front 2024-09-21T04:06:39.934951+0000 (oldest deadline 2024-09-21T04:07:05.834665+0000) 2024-09-21T04:07:07.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:06 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:06.778+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:07.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:06 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:06.778+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:07.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:06 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:06.778+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:07.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:06 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:06.778+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:07.431 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:07:07 smithi046 podman[101789]: 2024-09-21 04:07:07.101735525 +0000 UTC m=+5.566521227 container died 515deeb716a96185a55d95fdd3f570d39edeceba4b26de670e1f68c59757b988 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-21T04:07:07.431 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:07 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:07.254+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:07:07.431 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:07 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:07.254+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:07:07.431 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:07 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:07.254+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.604603+0000 front 2024-09-21T04:06:34.604771+0000 (oldest deadline 2024-09-21T04:07:00.504534+0000) 2024-09-21T04:07:07.431 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:07 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:07.254+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:40.504853+0000 front 2024-09-21T04:06:40.505012+0000 (oldest deadline 2024-09-21T04:07:05.805002+0000) 2024-09-21T04:07:07.568 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:07 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:07.142+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.624874+0000 front 2024-09-21T04:06:25.624992+0000 (oldest deadline 2024-09-21T04:06:50.924970+0000) 2024-09-21T04:07:07.568 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:07 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:07.142+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:30.925648+0000 front 2024-09-21T04:06:30.925591+0000 (oldest deadline 2024-09-21T04:06:57.926083+0000) 2024-09-21T04:07:07.568 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:07 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:07.142+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:40.227218+0000 front 2024-09-21T04:06:40.227320+0000 (oldest deadline 2024-09-21T04:07:03.727372+0000) 2024-09-21T04:07:07.625 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:07 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:07.159+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.156631+0000 front 2024-09-21T04:06:23.156561+0000 (oldest deadline 2024-09-21T04:06:48.456687+0000) 2024-09-21T04:07:07.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:07 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:07.159+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.357843+0000 front 2024-09-21T04:06:34.357929+0000 (oldest deadline 2024-09-21T04:06:59.057892+0000) 2024-09-21T04:07:07.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:07 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:07.159+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.058382+0000 front 2024-09-21T04:06:39.058476+0000 (oldest deadline 2024-09-21T04:07:03.158369+0000) 2024-09-21T04:07:07.751 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:07:07 smithi046 podman[101789]: 2024-09-21 04:07:07.601807801 +0000 UTC m=+6.066593542 container cleanup 515deeb716a96185a55d95fdd3f570d39edeceba4b26de670e1f68c59757b988 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T04:07:07.752 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:07:07 smithi046 bash[101789]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6 2024-09-21T04:07:08.068 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:07 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:07.580+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:08.069 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:07 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:07.580+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:08.069 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:07 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:07.580+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:08.069 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:07 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:07.580+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.934931+0000 front 2024-09-21T04:06:39.934951+0000 (oldest deadline 2024-09-21T04:07:05.834665+0000) 2024-09-21T04:07:08.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:07 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:07.812+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:08.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:07 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:07.812+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:08.127 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:07 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:07.812+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:08.127 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:07 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:07.812+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:08.189 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:07:07 smithi046 podman[101804]: 2024-09-21 04:07:07.844966096 +0000 UTC m=+0.740896232 container remove 515deeb716a96185a55d95fdd3f570d39edeceba4b26de670e1f68c59757b988 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T04:07:08.467 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:08 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:08.276+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:07:08.467 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:08 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:08.276+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:07:08.467 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:08 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:08.276+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.604603+0000 front 2024-09-21T04:06:34.604771+0000 (oldest deadline 2024-09-21T04:07:00.504534+0000) 2024-09-21T04:07:08.467 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:08 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:08.276+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:40.504853+0000 front 2024-09-21T04:06:40.505012+0000 (oldest deadline 2024-09-21T04:07:05.805002+0000) 2024-09-21T04:07:08.467 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:07:08 smithi046 podman[101894]: 2024-09-21 04:07:08.090266176 +0000 UTC m=+0.016644316 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T04:07:08.468 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:07:08 smithi046 podman[101894]: 2024-09-21 04:07:08.207897275 +0000 UTC m=+0.134275433 container create 4197a7d331920fdb40019c8ade1cc3641ca2f054d27edb023419f17771b16584 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0) 2024-09-21T04:07:08.468 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:07:08 smithi046 podman[101894]: 2024-09-21 04:07:08.465316961 +0000 UTC m=+0.391695094 container init 4197a7d331920fdb40019c8ade1cc3641ca2f054d27edb023419f17771b16584 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T04:07:08.568 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:08 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:08.097+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.624874+0000 front 2024-09-21T04:06:25.624992+0000 (oldest deadline 2024-09-21T04:06:50.924970+0000) 2024-09-21T04:07:08.568 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:08 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:08.097+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:30.925648+0000 front 2024-09-21T04:06:30.925591+0000 (oldest deadline 2024-09-21T04:06:57.926083+0000) 2024-09-21T04:07:08.568 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:08 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:08.097+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:40.227218+0000 front 2024-09-21T04:06:40.227320+0000 (oldest deadline 2024-09-21T04:07:03.727372+0000) 2024-09-21T04:07:08.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:08 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:08.167+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.156631+0000 front 2024-09-21T04:06:23.156561+0000 (oldest deadline 2024-09-21T04:06:48.456687+0000) 2024-09-21T04:07:08.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:08 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:08.167+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.357843+0000 front 2024-09-21T04:06:34.357929+0000 (oldest deadline 2024-09-21T04:06:59.057892+0000) 2024-09-21T04:07:08.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:08 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:08.167+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.058382+0000 front 2024-09-21T04:06:39.058476+0000 (oldest deadline 2024-09-21T04:07:03.158369+0000) 2024-09-21T04:07:08.752 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:07:08 smithi046 podman[101894]: 2024-09-21 04:07:08.469054208 +0000 UTC m=+0.395432331 container start 4197a7d331920fdb40019c8ade1cc3641ca2f054d27edb023419f17771b16584 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6-deactivate, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T04:07:08.752 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:07:08 smithi046 podman[101894]: 2024-09-21 04:07:08.556775999 +0000 UTC m=+0.483154144 container attach 4197a7d331920fdb40019c8ade1cc3641ca2f054d27edb023419f17771b16584 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T04:07:08.752 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 21 04:07:08 smithi046 podman[101894]: 2024-09-21 04:07:08.674373993 +0000 UTC m=+0.600752127 container died 4197a7d331920fdb40019c8ade1cc3641ca2f054d27edb023419f17771b16584 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T04:07:09.057 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:08 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:08.567+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:09.058 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:08 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:08.567+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:09.058 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:08 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:08.567+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:09.058 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:08 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:08.567+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.934931+0000 front 2024-09-21T04:06:39.934951+0000 (oldest deadline 2024-09-21T04:07:05.834665+0000) 2024-09-21T04:07:09.125 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:08 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:08.764+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:09.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:08 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:08.764+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:09.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:08 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:08.764+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:09.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:08 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:08.764+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:09.270 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.6.service' 2024-09-21T04:07:09.313 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:07:09.313 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-21T04:07:09.313 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-21T04:07:09.313 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.7 2024-09-21T04:07:09.318 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:09 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:09.056+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.624874+0000 front 2024-09-21T04:06:25.624992+0000 (oldest deadline 2024-09-21T04:06:50.924970+0000) 2024-09-21T04:07:09.318 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:09 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:09.056+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:30.925648+0000 front 2024-09-21T04:06:30.925591+0000 (oldest deadline 2024-09-21T04:06:57.926083+0000) 2024-09-21T04:07:09.318 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:09 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:09.056+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:40.227218+0000 front 2024-09-21T04:06:40.227320+0000 (oldest deadline 2024-09-21T04:07:03.727372+0000) 2024-09-21T04:07:09.501 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:09 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:09.293+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:07:09.502 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:09 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:09.293+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:07:09.502 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:09 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:09.293+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.604603+0000 front 2024-09-21T04:06:34.604771+0000 (oldest deadline 2024-09-21T04:07:00.504534+0000) 2024-09-21T04:07:09.502 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:09 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:09.293+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:40.504853+0000 front 2024-09-21T04:06:40.505012+0000 (oldest deadline 2024-09-21T04:07:05.805002+0000) 2024-09-21T04:07:09.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:09 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:09.134+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.156631+0000 front 2024-09-21T04:06:23.156561+0000 (oldest deadline 2024-09-21T04:06:48.456687+0000) 2024-09-21T04:07:09.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:09 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:09.134+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.357843+0000 front 2024-09-21T04:06:34.357929+0000 (oldest deadline 2024-09-21T04:06:59.057892+0000) 2024-09-21T04:07:09.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:09 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:09.134+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.058382+0000 front 2024-09-21T04:06:39.058476+0000 (oldest deadline 2024-09-21T04:07:03.158369+0000) 2024-09-21T04:07:09.634 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:09 smithi105 systemd[1]: Stopping Ceph osd.7 for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T04:07:09.634 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:09 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:09.569+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:09.634 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:09 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:09.569+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:09.634 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:09 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:09.569+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:09.635 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:09 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:09.569+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.934931+0000 front 2024-09-21T04:06:39.934951+0000 (oldest deadline 2024-09-21T04:07:05.834665+0000) 2024-09-21T04:07:10.014 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:09 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:09.632+0000 7f69fa777640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:07:10.014 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:09 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:09.632+0000 7f69fa777640 -1 osd.7 86 *** Got signal Terminated *** 2024-09-21T04:07:10.015 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:09 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:09.632+0000 7f69fa777640 -1 osd.7 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T04:07:10.015 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:10 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:10.011+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.624874+0000 front 2024-09-21T04:06:25.624992+0000 (oldest deadline 2024-09-21T04:06:50.924970+0000) 2024-09-21T04:07:10.015 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:10 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:10.011+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:30.925648+0000 front 2024-09-21T04:06:30.925591+0000 (oldest deadline 2024-09-21T04:06:57.926083+0000) 2024-09-21T04:07:10.015 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:10 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:10.011+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:40.227218+0000 front 2024-09-21T04:06:40.227320+0000 (oldest deadline 2024-09-21T04:07:03.727372+0000) 2024-09-21T04:07:10.105 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:09 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:09.774+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:10.105 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:09 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:09.774+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:10.105 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:09 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:09.774+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:10.105 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:09 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:09.774+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:10.375 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:10 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:10.101+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.156631+0000 front 2024-09-21T04:06:23.156561+0000 (oldest deadline 2024-09-21T04:06:48.456687+0000) 2024-09-21T04:07:10.376 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:10 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:10.101+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.357843+0000 front 2024-09-21T04:06:34.357929+0000 (oldest deadline 2024-09-21T04:06:59.057892+0000) 2024-09-21T04:07:10.376 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:10 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:10.101+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.058382+0000 front 2024-09-21T04:06:39.058476+0000 (oldest deadline 2024-09-21T04:07:03.158369+0000) 2024-09-21T04:07:10.751 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:10 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:10.335+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:07:10.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:10 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:10.335+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:07:10.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:10 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:10.335+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.604603+0000 front 2024-09-21T04:06:34.604771+0000 (oldest deadline 2024-09-21T04:07:00.504534+0000) 2024-09-21T04:07:10.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:10 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:10.335+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:40.504853+0000 front 2024-09-21T04:06:40.505012+0000 (oldest deadline 2024-09-21T04:07:05.805002+0000) 2024-09-21T04:07:10.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:10 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:10.545+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:10.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:10 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:10.545+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:10.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:10 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:10.545+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:10.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:10 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:10.545+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.934931+0000 front 2024-09-21T04:06:39.934951+0000 (oldest deadline 2024-09-21T04:07:05.834665+0000) 2024-09-21T04:07:11.125 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:10 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:10.735+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:11.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:10 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:10.735+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:11.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:10 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:10.735+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:11.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:10 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:10.735+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:11.318 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:10 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:10.976+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.624874+0000 front 2024-09-21T04:06:25.624992+0000 (oldest deadline 2024-09-21T04:06:50.924970+0000) 2024-09-21T04:07:11.318 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:10 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:10.976+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:30.925648+0000 front 2024-09-21T04:06:30.925591+0000 (oldest deadline 2024-09-21T04:06:57.926083+0000) 2024-09-21T04:07:11.318 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:10 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:10.976+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:40.227218+0000 front 2024-09-21T04:06:40.227320+0000 (oldest deadline 2024-09-21T04:07:03.727372+0000) 2024-09-21T04:07:11.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:11 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:11.148+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.156631+0000 front 2024-09-21T04:06:23.156561+0000 (oldest deadline 2024-09-21T04:06:48.456687+0000) 2024-09-21T04:07:11.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:11 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:11.148+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.357843+0000 front 2024-09-21T04:06:34.357929+0000 (oldest deadline 2024-09-21T04:06:59.057892+0000) 2024-09-21T04:07:11.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:11 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:11.148+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.058382+0000 front 2024-09-21T04:06:39.058476+0000 (oldest deadline 2024-09-21T04:07:03.158369+0000) 2024-09-21T04:07:11.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:11 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:11.313+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:07:11.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:11 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:11.313+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:07:11.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:11 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:11.313+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.604603+0000 front 2024-09-21T04:06:34.604771+0000 (oldest deadline 2024-09-21T04:07:00.504534+0000) 2024-09-21T04:07:11.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:11 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:11.313+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:40.504853+0000 front 2024-09-21T04:06:40.505012+0000 (oldest deadline 2024-09-21T04:07:05.805002+0000) 2024-09-21T04:07:11.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:11 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:11.313+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:45.805523+0000 front 2024-09-21T04:06:45.805494+0000 (oldest deadline 2024-09-21T04:07:11.105390+0000) 2024-09-21T04:07:11.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:11 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:11.526+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:11.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:11 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:11.526+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:11.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:11 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:11.526+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:11.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:11 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:11.526+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.934931+0000 front 2024-09-21T04:06:39.934951+0000 (oldest deadline 2024-09-21T04:07:05.834665+0000) 2024-09-21T04:07:12.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:11 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:11.740+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:12.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:11 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:11.740+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:12.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:11 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:11.740+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:12.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:11 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:11.740+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:12.318 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:12 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:12.012+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.624874+0000 front 2024-09-21T04:06:25.624992+0000 (oldest deadline 2024-09-21T04:06:50.924970+0000) 2024-09-21T04:07:12.318 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:12 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:12.012+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:30.925648+0000 front 2024-09-21T04:06:30.925591+0000 (oldest deadline 2024-09-21T04:06:57.926083+0000) 2024-09-21T04:07:12.318 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:12 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:12.012+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:40.227218+0000 front 2024-09-21T04:06:40.227320+0000 (oldest deadline 2024-09-21T04:07:03.727372+0000) 2024-09-21T04:07:12.318 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:12 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:12.012+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.728731+0000 front 2024-09-21T04:06:47.728709+0000 (oldest deadline 2024-09-21T04:07:11.828799+0000) 2024-09-21T04:07:12.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:12 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:12.198+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.156631+0000 front 2024-09-21T04:06:23.156561+0000 (oldest deadline 2024-09-21T04:06:48.456687+0000) 2024-09-21T04:07:12.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:12 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:12.198+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.357843+0000 front 2024-09-21T04:06:34.357929+0000 (oldest deadline 2024-09-21T04:06:59.057892+0000) 2024-09-21T04:07:12.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:12 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:12.198+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.058382+0000 front 2024-09-21T04:06:39.058476+0000 (oldest deadline 2024-09-21T04:07:03.158369+0000) 2024-09-21T04:07:12.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:12 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:12.198+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:46.059700+0000 front 2024-09-21T04:06:46.059472+0000 (oldest deadline 2024-09-21T04:07:11.859934+0000) 2024-09-21T04:07:12.751 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:12 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:12.361+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:07:12.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:12 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:12.361+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:07:12.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:12 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:12.361+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.604603+0000 front 2024-09-21T04:06:34.604771+0000 (oldest deadline 2024-09-21T04:07:00.504534+0000) 2024-09-21T04:07:12.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:12 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:12.361+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:40.504853+0000 front 2024-09-21T04:06:40.505012+0000 (oldest deadline 2024-09-21T04:07:05.805002+0000) 2024-09-21T04:07:12.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:12 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:12.361+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:45.805523+0000 front 2024-09-21T04:06:45.805494+0000 (oldest deadline 2024-09-21T04:07:11.105390+0000) 2024-09-21T04:07:12.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:12 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:12.511+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:12.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:12 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:12.511+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:12.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:12 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:12.511+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:12.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:12 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:12.511+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.934931+0000 front 2024-09-21T04:06:39.934951+0000 (oldest deadline 2024-09-21T04:07:05.834665+0000) 2024-09-21T04:07:13.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:12 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:12.786+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:13.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:12 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:12.786+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:13.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:12 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:12.786+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:13.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:12 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:12.786+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:13.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:12 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:12.786+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.271810+0000 front 2024-09-21T04:06:47.271916+0000 (oldest deadline 2024-09-21T04:07:12.471730+0000) 2024-09-21T04:07:13.318 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:13 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:13.011+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.624874+0000 front 2024-09-21T04:06:25.624992+0000 (oldest deadline 2024-09-21T04:06:50.924970+0000) 2024-09-21T04:07:13.318 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:13 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:13.011+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:30.925648+0000 front 2024-09-21T04:06:30.925591+0000 (oldest deadline 2024-09-21T04:06:57.926083+0000) 2024-09-21T04:07:13.318 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:13 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:13.011+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:40.227218+0000 front 2024-09-21T04:06:40.227320+0000 (oldest deadline 2024-09-21T04:07:03.727372+0000) 2024-09-21T04:07:13.318 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:13 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:13.011+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.728731+0000 front 2024-09-21T04:06:47.728709+0000 (oldest deadline 2024-09-21T04:07:11.828799+0000) 2024-09-21T04:07:13.625 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:13 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:13.240+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.156631+0000 front 2024-09-21T04:06:23.156561+0000 (oldest deadline 2024-09-21T04:06:48.456687+0000) 2024-09-21T04:07:13.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:13 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:13.240+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.357843+0000 front 2024-09-21T04:06:34.357929+0000 (oldest deadline 2024-09-21T04:06:59.057892+0000) 2024-09-21T04:07:13.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:13 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:13.240+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.058382+0000 front 2024-09-21T04:06:39.058476+0000 (oldest deadline 2024-09-21T04:07:03.158369+0000) 2024-09-21T04:07:13.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:13 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:13.240+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:46.059700+0000 front 2024-09-21T04:06:46.059472+0000 (oldest deadline 2024-09-21T04:07:11.859934+0000) 2024-09-21T04:07:13.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:13 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:13.363+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:07:13.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:13 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:13.363+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:07:13.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:13 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:13.363+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.604603+0000 front 2024-09-21T04:06:34.604771+0000 (oldest deadline 2024-09-21T04:07:00.504534+0000) 2024-09-21T04:07:13.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:13 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:13.363+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:40.504853+0000 front 2024-09-21T04:06:40.505012+0000 (oldest deadline 2024-09-21T04:07:05.805002+0000) 2024-09-21T04:07:13.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:13 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:13.363+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:45.805523+0000 front 2024-09-21T04:06:45.805494+0000 (oldest deadline 2024-09-21T04:07:11.105390+0000) 2024-09-21T04:07:13.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:13 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:13.488+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:13.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:13 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:13.488+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:13.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:13 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:13.488+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:13.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:13 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:13.488+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.934931+0000 front 2024-09-21T04:06:39.934951+0000 (oldest deadline 2024-09-21T04:07:05.834665+0000) 2024-09-21T04:07:14.125 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:13 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:13.809+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:14.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:13 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:13.809+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:14.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:13 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:13.809+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:14.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:13 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:13.809+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:14.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:13 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:13.809+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.271810+0000 front 2024-09-21T04:06:47.271916+0000 (oldest deadline 2024-09-21T04:07:12.471730+0000) 2024-09-21T04:07:14.318 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:14 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:14.018+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.624874+0000 front 2024-09-21T04:06:25.624992+0000 (oldest deadline 2024-09-21T04:06:50.924970+0000) 2024-09-21T04:07:14.318 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:14 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:14.018+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:30.925648+0000 front 2024-09-21T04:06:30.925591+0000 (oldest deadline 2024-09-21T04:06:57.926083+0000) 2024-09-21T04:07:14.318 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:14 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:14.018+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:40.227218+0000 front 2024-09-21T04:06:40.227320+0000 (oldest deadline 2024-09-21T04:07:03.727372+0000) 2024-09-21T04:07:14.318 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:14 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7[52342]: 2024-09-21T04:07:14.018+0000 7f69f2d5a640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.728731+0000 front 2024-09-21T04:06:47.728709+0000 (oldest deadline 2024-09-21T04:07:11.828799+0000) 2024-09-21T04:07:14.625 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:14 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:14.290+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.156631+0000 front 2024-09-21T04:06:23.156561+0000 (oldest deadline 2024-09-21T04:06:48.456687+0000) 2024-09-21T04:07:14.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:14 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:14.290+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.357843+0000 front 2024-09-21T04:06:34.357929+0000 (oldest deadline 2024-09-21T04:06:59.057892+0000) 2024-09-21T04:07:14.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:14 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:14.290+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.058382+0000 front 2024-09-21T04:06:39.058476+0000 (oldest deadline 2024-09-21T04:07:03.158369+0000) 2024-09-21T04:07:14.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:14 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:14.290+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:46.059700+0000 front 2024-09-21T04:06:46.059472+0000 (oldest deadline 2024-09-21T04:07:11.859934+0000) 2024-09-21T04:07:14.751 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:14 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:14.403+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:07:14.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:14 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:14.403+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:07:14.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:14 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:14.403+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.604603+0000 front 2024-09-21T04:06:34.604771+0000 (oldest deadline 2024-09-21T04:07:00.504534+0000) 2024-09-21T04:07:14.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:14 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:14.403+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:40.504853+0000 front 2024-09-21T04:06:40.505012+0000 (oldest deadline 2024-09-21T04:07:05.805002+0000) 2024-09-21T04:07:14.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:14 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:14.403+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:45.805523+0000 front 2024-09-21T04:06:45.805494+0000 (oldest deadline 2024-09-21T04:07:11.105390+0000) 2024-09-21T04:07:14.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:14 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:14.524+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:14.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:14 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:14.524+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:14.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:14 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:14.524+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:14.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:14 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:14.524+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.934931+0000 front 2024-09-21T04:06:39.934951+0000 (oldest deadline 2024-09-21T04:07:05.834665+0000) 2024-09-21T04:07:15.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:14 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:14.822+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:15.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:14 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:14.822+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:15.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:14 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:14.822+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:15.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:14 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:14.822+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:15.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:14 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:14.822+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.271810+0000 front 2024-09-21T04:06:47.271916+0000 (oldest deadline 2024-09-21T04:07:12.471730+0000) 2024-09-21T04:07:15.384 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:15 smithi105 podman[67601]: 2024-09-21 04:07:15.108461857 +0000 UTC m=+5.604939706 container died 38d4a10dd7701352caef963d57f9c5e8fa091ffca09d28dd769b1e3800c98c1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-09-21T04:07:15.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:15 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:15.304+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.156631+0000 front 2024-09-21T04:06:23.156561+0000 (oldest deadline 2024-09-21T04:06:48.456687+0000) 2024-09-21T04:07:15.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:15 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:15.304+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.357843+0000 front 2024-09-21T04:06:34.357929+0000 (oldest deadline 2024-09-21T04:06:59.057892+0000) 2024-09-21T04:07:15.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:15 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:15.304+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.058382+0000 front 2024-09-21T04:06:39.058476+0000 (oldest deadline 2024-09-21T04:07:03.158369+0000) 2024-09-21T04:07:15.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:15 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:15.304+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:46.059700+0000 front 2024-09-21T04:06:46.059472+0000 (oldest deadline 2024-09-21T04:07:11.859934+0000) 2024-09-21T04:07:15.751 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:15 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:15.355+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:07:15.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:15 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:15.355+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:07:15.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:15 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:15.355+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.604603+0000 front 2024-09-21T04:06:34.604771+0000 (oldest deadline 2024-09-21T04:07:00.504534+0000) 2024-09-21T04:07:15.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:15 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:15.355+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:40.504853+0000 front 2024-09-21T04:06:40.505012+0000 (oldest deadline 2024-09-21T04:07:05.805002+0000) 2024-09-21T04:07:15.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:15 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:15.355+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:45.805523+0000 front 2024-09-21T04:06:45.805494+0000 (oldest deadline 2024-09-21T04:07:11.105390+0000) 2024-09-21T04:07:15.768 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:15 smithi105 podman[67601]: 2024-09-21 04:07:15.482191389 +0000 UTC m=+5.978669242 container cleanup 38d4a10dd7701352caef963d57f9c5e8fa091ffca09d28dd769b1e3800c98c1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T04:07:15.768 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:15 smithi105 bash[67601]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7 2024-09-21T04:07:15.768 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:15 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:15.515+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:15.769 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:15 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:15.515+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:15.769 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:15 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:15.515+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:15.769 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:15 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:15.515+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.934931+0000 front 2024-09-21T04:06:39.934951+0000 (oldest deadline 2024-09-21T04:07:05.834665+0000) 2024-09-21T04:07:15.769 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:15 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:15.515+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:49.335185+0000 front 2024-09-21T04:06:49.335243+0000 (oldest deadline 2024-09-21T04:07:15.235390+0000) 2024-09-21T04:07:16.068 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:15 smithi105 podman[67616]: 2024-09-21 04:07:15.766796621 +0000 UTC m=+0.660009429 container remove 38d4a10dd7701352caef963d57f9c5e8fa091ffca09d28dd769b1e3800c98c1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731) 2024-09-21T04:07:16.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:15 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:15.791+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:16.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:15 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:15.791+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:16.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:15 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:15.791+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:16.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:15 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:15.791+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:16.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:15 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:15.791+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.271810+0000 front 2024-09-21T04:06:47.271916+0000 (oldest deadline 2024-09-21T04:07:12.471730+0000) 2024-09-21T04:07:16.372 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:16 smithi105 podman[67705]: 2024-09-21 04:07:15.980553745 +0000 UTC m=+0.015782056 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T04:07:16.372 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:16 smithi105 podman[67705]: 2024-09-21 04:07:16.117680626 +0000 UTC m=+0.152908918 container create 669d6c33bb36aae56ee785b82ed3fb705d5e0045230b00cb2a6ec885bb675673 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7-deactivate, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-21T04:07:16.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:16 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:16.316+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.156631+0000 front 2024-09-21T04:06:23.156561+0000 (oldest deadline 2024-09-21T04:06:48.456687+0000) 2024-09-21T04:07:16.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:16 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:16.316+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.357843+0000 front 2024-09-21T04:06:34.357929+0000 (oldest deadline 2024-09-21T04:06:59.057892+0000) 2024-09-21T04:07:16.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:16 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:16.316+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.058382+0000 front 2024-09-21T04:06:39.058476+0000 (oldest deadline 2024-09-21T04:07:03.158369+0000) 2024-09-21T04:07:16.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:16 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:16.316+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:46.059700+0000 front 2024-09-21T04:06:46.059472+0000 (oldest deadline 2024-09-21T04:07:11.859934+0000) 2024-09-21T04:07:16.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:16 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:16.391+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:07:16.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:16 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:16.391+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:07:16.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:16 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:16.391+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.604603+0000 front 2024-09-21T04:06:34.604771+0000 (oldest deadline 2024-09-21T04:07:00.504534+0000) 2024-09-21T04:07:16.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:16 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:16.391+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:40.504853+0000 front 2024-09-21T04:06:40.505012+0000 (oldest deadline 2024-09-21T04:07:05.805002+0000) 2024-09-21T04:07:16.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:16 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:16.391+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:45.805523+0000 front 2024-09-21T04:06:45.805494+0000 (oldest deadline 2024-09-21T04:07:11.105390+0000) 2024-09-21T04:07:16.818 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:16 smithi105 podman[67705]: 2024-09-21 04:07:16.370128697 +0000 UTC m=+0.405356989 container init 669d6c33bb36aae56ee785b82ed3fb705d5e0045230b00cb2a6ec885bb675673 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T04:07:16.819 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:16 smithi105 podman[67705]: 2024-09-21 04:07:16.373431583 +0000 UTC m=+0.408659884 container start 669d6c33bb36aae56ee785b82ed3fb705d5e0045230b00cb2a6ec885bb675673 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7-deactivate, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T04:07:16.819 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:16 smithi105 podman[67705]: 2024-09-21 04:07:16.470235616 +0000 UTC m=+0.505463911 container attach 669d6c33bb36aae56ee785b82ed3fb705d5e0045230b00cb2a6ec885bb675673 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T04:07:16.819 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 21 04:07:16 smithi105 podman[67705]: 2024-09-21 04:07:16.560331392 +0000 UTC m=+0.595559692 container died 669d6c33bb36aae56ee785b82ed3fb705d5e0045230b00cb2a6ec885bb675673 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-7-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T04:07:16.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:16 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:16.473+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:16.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:16 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:16.473+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:16.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:16 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:16.473+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:16.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:16 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:16.473+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.934931+0000 front 2024-09-21T04:06:39.934951+0000 (oldest deadline 2024-09-21T04:07:05.834665+0000) 2024-09-21T04:07:16.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:16 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:16.473+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:49.335185+0000 front 2024-09-21T04:06:49.335243+0000 (oldest deadline 2024-09-21T04:07:15.235390+0000) 2024-09-21T04:07:17.125 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:16 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:16.768+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:17.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:16 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:16.768+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:17.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:16 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:16.768+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:17.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:16 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:16.768+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:17.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:16 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:16.768+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.271810+0000 front 2024-09-21T04:06:47.271916+0000 (oldest deadline 2024-09-21T04:07:12.471730+0000) 2024-09-21T04:07:17.248 DEBUG:teuthology.orchestra.run.smithi105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.7.service' 2024-09-21T04:07:17.329 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:07:17.329 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-21T04:07:17.329 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-21T04:07:17.330 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.8 2024-09-21T04:07:17.502 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:17 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:17.426+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:17.502 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:17 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:17.426+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:17.503 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:17 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:17.426+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:17.503 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:17 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:17.426+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.934931+0000 front 2024-09-21T04:06:39.934951+0000 (oldest deadline 2024-09-21T04:07:05.834665+0000) 2024-09-21T04:07:17.503 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:17 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:17.426+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:49.335185+0000 front 2024-09-21T04:06:49.335243+0000 (oldest deadline 2024-09-21T04:07:15.235390+0000) 2024-09-21T04:07:17.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:17 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:17.360+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.156631+0000 front 2024-09-21T04:06:23.156561+0000 (oldest deadline 2024-09-21T04:06:48.456687+0000) 2024-09-21T04:07:17.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:17 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:17.360+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.357843+0000 front 2024-09-21T04:06:34.357929+0000 (oldest deadline 2024-09-21T04:06:59.057892+0000) 2024-09-21T04:07:17.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:17 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:17.360+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.058382+0000 front 2024-09-21T04:06:39.058476+0000 (oldest deadline 2024-09-21T04:07:03.158369+0000) 2024-09-21T04:07:17.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:17 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:17.360+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:46.059700+0000 front 2024-09-21T04:06:46.059472+0000 (oldest deadline 2024-09-21T04:07:11.859934+0000) 2024-09-21T04:07:17.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:17 smithi162 systemd[1]: Stopping Ceph osd.8 for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T04:07:17.751 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:17 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:17.422+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:07:17.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:17 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:17.422+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:07:17.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:17 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:17.422+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.604603+0000 front 2024-09-21T04:06:34.604771+0000 (oldest deadline 2024-09-21T04:07:00.504534+0000) 2024-09-21T04:07:17.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:17 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:17.422+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:40.504853+0000 front 2024-09-21T04:06:40.505012+0000 (oldest deadline 2024-09-21T04:07:05.805002+0000) 2024-09-21T04:07:17.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:17 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:17.422+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:45.805523+0000 front 2024-09-21T04:06:45.805494+0000 (oldest deadline 2024-09-21T04:07:11.105390+0000) 2024-09-21T04:07:18.126 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:17 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:17.644+0000 7f586a403640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:07:18.126 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:17 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:17.644+0000 7f586a403640 -1 osd.8 86 *** Got signal Terminated *** 2024-09-21T04:07:18.126 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:17 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:17.644+0000 7f586a403640 -1 osd.8 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T04:07:18.127 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:17 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:17.777+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:18.127 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:17 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:17.777+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:18.127 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:17 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:17.777+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:18.127 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:17 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:17.777+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:18.127 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:17 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:17.777+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.271810+0000 front 2024-09-21T04:06:47.271916+0000 (oldest deadline 2024-09-21T04:07:12.471730+0000) 2024-09-21T04:07:18.751 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:18 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:18.394+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:07:18.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:18 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:18.394+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:07:18.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:18 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:18.394+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.604603+0000 front 2024-09-21T04:06:34.604771+0000 (oldest deadline 2024-09-21T04:07:00.504534+0000) 2024-09-21T04:07:18.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:18 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:18.394+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:40.504853+0000 front 2024-09-21T04:06:40.505012+0000 (oldest deadline 2024-09-21T04:07:05.805002+0000) 2024-09-21T04:07:18.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:18 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:18.394+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:45.805523+0000 front 2024-09-21T04:06:45.805494+0000 (oldest deadline 2024-09-21T04:07:11.105390+0000) 2024-09-21T04:07:18.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:18 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:18.381+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:18.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:18 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:18.381+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:18.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:18 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:18.381+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:18.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:18 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:18.381+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.934931+0000 front 2024-09-21T04:06:39.934951+0000 (oldest deadline 2024-09-21T04:07:05.834665+0000) 2024-09-21T04:07:18.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:18 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:18.381+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:49.335185+0000 front 2024-09-21T04:06:49.335243+0000 (oldest deadline 2024-09-21T04:07:15.235390+0000) 2024-09-21T04:07:18.820 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:18 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:18.392+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.156631+0000 front 2024-09-21T04:06:23.156561+0000 (oldest deadline 2024-09-21T04:06:48.456687+0000) 2024-09-21T04:07:18.820 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:18 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:18.392+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.357843+0000 front 2024-09-21T04:06:34.357929+0000 (oldest deadline 2024-09-21T04:06:59.057892+0000) 2024-09-21T04:07:18.821 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:18 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:18.392+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.058382+0000 front 2024-09-21T04:06:39.058476+0000 (oldest deadline 2024-09-21T04:07:03.158369+0000) 2024-09-21T04:07:18.821 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:18 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:18.392+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:46.059700+0000 front 2024-09-21T04:06:46.059472+0000 (oldest deadline 2024-09-21T04:07:11.859934+0000) 2024-09-21T04:07:19.125 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:18 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:18.818+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:19.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:18 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:18.818+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:19.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:18 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:18.818+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:19.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:18 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:18.818+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:19.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:18 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:18.818+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.271810+0000 front 2024-09-21T04:06:47.271916+0000 (oldest deadline 2024-09-21T04:07:12.471730+0000) 2024-09-21T04:07:19.719 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:19 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:19.360+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:19.719 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:19 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:19.360+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:19.720 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:19 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:19.360+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:19.720 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:19 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:19.360+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.934931+0000 front 2024-09-21T04:06:39.934951+0000 (oldest deadline 2024-09-21T04:07:05.834665+0000) 2024-09-21T04:07:19.720 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:19 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:19.360+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:49.335185+0000 front 2024-09-21T04:06:49.335243+0000 (oldest deadline 2024-09-21T04:07:15.235390+0000) 2024-09-21T04:07:19.751 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:19 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:19.400+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:07:19.751 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:19 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:19.400+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:07:19.751 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:19 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:19.400+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.604603+0000 front 2024-09-21T04:06:34.604771+0000 (oldest deadline 2024-09-21T04:07:00.504534+0000) 2024-09-21T04:07:19.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:19 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:19.400+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:40.504853+0000 front 2024-09-21T04:06:40.505012+0000 (oldest deadline 2024-09-21T04:07:05.805002+0000) 2024-09-21T04:07:19.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:19 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:19.400+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:45.805523+0000 front 2024-09-21T04:06:45.805494+0000 (oldest deadline 2024-09-21T04:07:11.105390+0000) 2024-09-21T04:07:19.780 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:19 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:19.409+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.156631+0000 front 2024-09-21T04:06:23.156561+0000 (oldest deadline 2024-09-21T04:06:48.456687+0000) 2024-09-21T04:07:19.780 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:19 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:19.409+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.357843+0000 front 2024-09-21T04:06:34.357929+0000 (oldest deadline 2024-09-21T04:06:59.057892+0000) 2024-09-21T04:07:19.780 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:19 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:19.409+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.058382+0000 front 2024-09-21T04:06:39.058476+0000 (oldest deadline 2024-09-21T04:07:03.158369+0000) 2024-09-21T04:07:19.781 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:19 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:19.409+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:46.059700+0000 front 2024-09-21T04:06:46.059472+0000 (oldest deadline 2024-09-21T04:07:11.859934+0000) 2024-09-21T04:07:20.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:19 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:19.778+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:20.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:19 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:19.778+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:20.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:19 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:19.778+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:20.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:19 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:19.778+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:20.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:19 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:19.778+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.271810+0000 front 2024-09-21T04:06:47.271916+0000 (oldest deadline 2024-09-21T04:07:12.471730+0000) 2024-09-21T04:07:20.751 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:20 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:20.382+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:07:20.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:20 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:20.382+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:07:20.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:20 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:20.382+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.604603+0000 front 2024-09-21T04:06:34.604771+0000 (oldest deadline 2024-09-21T04:07:00.504534+0000) 2024-09-21T04:07:20.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:20 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:20.382+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:40.504853+0000 front 2024-09-21T04:06:40.505012+0000 (oldest deadline 2024-09-21T04:07:05.805002+0000) 2024-09-21T04:07:20.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:20 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:20.382+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:45.805523+0000 front 2024-09-21T04:06:45.805494+0000 (oldest deadline 2024-09-21T04:07:11.105390+0000) 2024-09-21T04:07:20.815 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:20 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:20.389+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.156631+0000 front 2024-09-21T04:06:23.156561+0000 (oldest deadline 2024-09-21T04:06:48.456687+0000) 2024-09-21T04:07:20.815 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:20 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:20.390+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.357843+0000 front 2024-09-21T04:06:34.357929+0000 (oldest deadline 2024-09-21T04:06:59.057892+0000) 2024-09-21T04:07:20.815 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:20 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:20.390+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.058382+0000 front 2024-09-21T04:06:39.058476+0000 (oldest deadline 2024-09-21T04:07:03.158369+0000) 2024-09-21T04:07:20.815 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:20 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:20.390+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:46.059700+0000 front 2024-09-21T04:06:46.059472+0000 (oldest deadline 2024-09-21T04:07:11.859934+0000) 2024-09-21T04:07:20.815 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:20 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:20.390+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:55.960846+0000 front 2024-09-21T04:06:55.960891+0000 (oldest deadline 2024-09-21T04:07:19.460999+0000) 2024-09-21T04:07:20.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:20 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:20.360+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:20.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:20 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:20.360+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:20.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:20 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:20.360+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:20.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:20 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:20.360+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.934931+0000 front 2024-09-21T04:06:39.934951+0000 (oldest deadline 2024-09-21T04:07:05.834665+0000) 2024-09-21T04:07:20.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:20 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:20.360+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:49.335185+0000 front 2024-09-21T04:06:49.335243+0000 (oldest deadline 2024-09-21T04:07:15.235390+0000) 2024-09-21T04:07:21.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:20 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:20.812+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:21.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:20 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:20.812+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:21.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:20 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:20.812+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:21.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:20 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:20.812+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:21.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:20 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:20.812+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.271810+0000 front 2024-09-21T04:06:47.271916+0000 (oldest deadline 2024-09-21T04:07:12.471730+0000) 2024-09-21T04:07:21.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:21 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:21.352+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.156631+0000 front 2024-09-21T04:06:23.156561+0000 (oldest deadline 2024-09-21T04:06:48.456687+0000) 2024-09-21T04:07:21.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:21 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:21.352+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.357843+0000 front 2024-09-21T04:06:34.357929+0000 (oldest deadline 2024-09-21T04:06:59.057892+0000) 2024-09-21T04:07:21.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:21 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:21.352+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.058382+0000 front 2024-09-21T04:06:39.058476+0000 (oldest deadline 2024-09-21T04:07:03.158369+0000) 2024-09-21T04:07:21.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:21 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:21.352+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:46.059700+0000 front 2024-09-21T04:06:46.059472+0000 (oldest deadline 2024-09-21T04:07:11.859934+0000) 2024-09-21T04:07:21.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:21 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:21.352+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:55.960846+0000 front 2024-09-21T04:06:55.960891+0000 (oldest deadline 2024-09-21T04:07:19.460999+0000) 2024-09-21T04:07:21.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:21 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:21.422+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:07:21.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:21 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:21.422+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:07:21.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:21 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:21.422+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.604603+0000 front 2024-09-21T04:06:34.604771+0000 (oldest deadline 2024-09-21T04:07:00.504534+0000) 2024-09-21T04:07:21.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:21 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:21.422+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:40.504853+0000 front 2024-09-21T04:06:40.505012+0000 (oldest deadline 2024-09-21T04:07:05.805002+0000) 2024-09-21T04:07:21.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:21 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:21.422+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:45.805523+0000 front 2024-09-21T04:06:45.805494+0000 (oldest deadline 2024-09-21T04:07:11.105390+0000) 2024-09-21T04:07:21.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:21 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:21.375+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:21.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:21 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:21.375+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:21.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:21 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:21.375+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:21.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:21 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:21.375+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.934931+0000 front 2024-09-21T04:06:39.934951+0000 (oldest deadline 2024-09-21T04:07:05.834665+0000) 2024-09-21T04:07:21.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:21 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:21.375+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:49.335185+0000 front 2024-09-21T04:06:49.335243+0000 (oldest deadline 2024-09-21T04:07:15.235390+0000) 2024-09-21T04:07:21.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:21 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:21.375+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:55.236044+0000 front 2024-09-21T04:06:55.236093+0000 (oldest deadline 2024-09-21T04:07:20.535891+0000) 2024-09-21T04:07:22.092 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:21 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:21.795+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:22.092 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:21 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:21.795+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:22.092 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:21 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:21.795+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:22.092 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:21 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:21.795+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:22.092 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:21 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:21.795+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.271810+0000 front 2024-09-21T04:06:47.271916+0000 (oldest deadline 2024-09-21T04:07:12.471730+0000) 2024-09-21T04:07:22.376 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:22 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:22.304+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:23.156631+0000 front 2024-09-21T04:06:23.156561+0000 (oldest deadline 2024-09-21T04:06:48.456687+0000) 2024-09-21T04:07:22.376 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:22 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:22.304+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.357843+0000 front 2024-09-21T04:06:34.357929+0000 (oldest deadline 2024-09-21T04:06:59.057892+0000) 2024-09-21T04:07:22.376 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:22 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:22.304+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.058382+0000 front 2024-09-21T04:06:39.058476+0000 (oldest deadline 2024-09-21T04:07:03.158369+0000) 2024-09-21T04:07:22.376 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:22 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:22.304+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:46.059700+0000 front 2024-09-21T04:06:46.059472+0000 (oldest deadline 2024-09-21T04:07:11.859934+0000) 2024-09-21T04:07:22.376 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:22 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8[52848]: 2024-09-21T04:07:22.304+0000 7f58629e6640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:55.960846+0000 front 2024-09-21T04:06:55.960891+0000 (oldest deadline 2024-09-21T04:07:19.460999+0000) 2024-09-21T04:07:22.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:22 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:22.425+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:07:22.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:22 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:22.425+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:07:22.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:22 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:22.425+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.604603+0000 front 2024-09-21T04:06:34.604771+0000 (oldest deadline 2024-09-21T04:07:00.504534+0000) 2024-09-21T04:07:22.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:22 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:22.425+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:40.504853+0000 front 2024-09-21T04:06:40.505012+0000 (oldest deadline 2024-09-21T04:07:05.805002+0000) 2024-09-21T04:07:22.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:22 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:22.425+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:45.805523+0000 front 2024-09-21T04:06:45.805494+0000 (oldest deadline 2024-09-21T04:07:11.105390+0000) 2024-09-21T04:07:22.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:22 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:22.339+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:22.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:22 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:22.339+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:22.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:22 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:22.339+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:22.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:22 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:22.339+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.934931+0000 front 2024-09-21T04:06:39.934951+0000 (oldest deadline 2024-09-21T04:07:05.834665+0000) 2024-09-21T04:07:22.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:22 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:22.339+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:49.335185+0000 front 2024-09-21T04:06:49.335243+0000 (oldest deadline 2024-09-21T04:07:15.235390+0000) 2024-09-21T04:07:22.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:22 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:22.339+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:55.236044+0000 front 2024-09-21T04:06:55.236093+0000 (oldest deadline 2024-09-21T04:07:20.535891+0000) 2024-09-21T04:07:23.011 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:22 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:22.751+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:23.011 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:22 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:22.751+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:23.011 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:22 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:22.751+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:23.011 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:22 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:22.751+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:23.011 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:22 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:22.751+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.271810+0000 front 2024-09-21T04:06:47.271916+0000 (oldest deadline 2024-09-21T04:07:12.471730+0000) 2024-09-21T04:07:23.313 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:23 smithi162 podman[68275]: 2024-09-21 04:07:23.009354879 +0000 UTC m=+5.486850395 container died dd0744cfeded8d5f824c531c3d359c75d90fd08e0aec6281204f73001a2b3111 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T04:07:23.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:23 smithi162 podman[68275]: 2024-09-21 04:07:23.419367331 +0000 UTC m=+5.896862847 container cleanup dd0744cfeded8d5f824c531c3d359c75d90fd08e0aec6281204f73001a2b3111 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-21T04:07:23.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:23 smithi162 bash[68275]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8 2024-09-21T04:07:23.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:23 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:23.445+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:07:23.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:23 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:23.445+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:07:23.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:23 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:23.445+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.604603+0000 front 2024-09-21T04:06:34.604771+0000 (oldest deadline 2024-09-21T04:07:00.504534+0000) 2024-09-21T04:07:23.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:23 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:23.445+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:40.504853+0000 front 2024-09-21T04:06:40.505012+0000 (oldest deadline 2024-09-21T04:07:05.805002+0000) 2024-09-21T04:07:23.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:23 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:23.445+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:45.805523+0000 front 2024-09-21T04:06:45.805494+0000 (oldest deadline 2024-09-21T04:07:11.105390+0000) 2024-09-21T04:07:23.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:23 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:23.318+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:23.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:23 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:23.318+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:23.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:23 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:23.318+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:23.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:23 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:23.318+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.934931+0000 front 2024-09-21T04:06:39.934951+0000 (oldest deadline 2024-09-21T04:07:05.834665+0000) 2024-09-21T04:07:23.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:23 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:23.318+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:49.335185+0000 front 2024-09-21T04:06:49.335243+0000 (oldest deadline 2024-09-21T04:07:15.235390+0000) 2024-09-21T04:07:23.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:23 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:23.318+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:55.236044+0000 front 2024-09-21T04:06:55.236093+0000 (oldest deadline 2024-09-21T04:07:20.535891+0000) 2024-09-21T04:07:24.026 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:23 smithi162 podman[68301]: 2024-09-21 04:07:23.670812847 +0000 UTC m=+0.662363895 container remove dd0744cfeded8d5f824c531c3d359c75d90fd08e0aec6281204f73001a2b3111 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-21T04:07:24.027 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:23 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:23.703+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:24.027 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:23 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:23.703+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:24.027 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:23 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:23.703+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:24.027 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:23 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:23.703+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:24.027 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:23 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:23.703+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.271810+0000 front 2024-09-21T04:06:47.271916+0000 (oldest deadline 2024-09-21T04:07:12.471730+0000) 2024-09-21T04:07:24.343 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:24 smithi162 podman[68388]: 2024-09-21 04:07:23.927003835 +0000 UTC m=+0.015875655 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T04:07:24.343 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:24 smithi162 podman[68388]: 2024-09-21 04:07:24.035001393 +0000 UTC m=+0.123873234 container create acb1533b3a52d4f5013091f558f2bab2d3ee3aad76994c8f9398bb44ce378e08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T04:07:24.343 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:24 smithi162 podman[68388]: 2024-09-21 04:07:24.265985975 +0000 UTC m=+0.354857775 container init acb1533b3a52d4f5013091f558f2bab2d3ee3aad76994c8f9398bb44ce378e08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T04:07:24.343 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:24 smithi162 podman[68388]: 2024-09-21 04:07:24.269265454 +0000 UTC m=+0.358137265 container start acb1533b3a52d4f5013091f558f2bab2d3ee3aad76994c8f9398bb44ce378e08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-21T04:07:24.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:24 smithi162 podman[68388]: 2024-09-21 04:07:24.340888443 +0000 UTC m=+0.429760245 container attach acb1533b3a52d4f5013091f558f2bab2d3ee3aad76994c8f9398bb44ce378e08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-21T04:07:24.626 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 21 04:07:24 smithi162 podman[68388]: 2024-09-21 04:07:24.466526054 +0000 UTC m=+0.555397863 container died acb1533b3a52d4f5013091f558f2bab2d3ee3aad76994c8f9398bb44ce378e08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-8-deactivate, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-21T04:07:24.751 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:24 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:24.470+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:07:24.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:24 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:24.470+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:07:24.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:24 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:24.470+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.604603+0000 front 2024-09-21T04:06:34.604771+0000 (oldest deadline 2024-09-21T04:07:00.504534+0000) 2024-09-21T04:07:24.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:24 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:24.470+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:40.504853+0000 front 2024-09-21T04:06:40.505012+0000 (oldest deadline 2024-09-21T04:07:05.805002+0000) 2024-09-21T04:07:24.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:24 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:24.470+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:45.805523+0000 front 2024-09-21T04:06:45.805494+0000 (oldest deadline 2024-09-21T04:07:11.105390+0000) 2024-09-21T04:07:24.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:24 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:24.331+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:24.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:24 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:24.331+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:24.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:24 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:24.331+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:24.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:24 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:24.331+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.934931+0000 front 2024-09-21T04:06:39.934951+0000 (oldest deadline 2024-09-21T04:07:05.834665+0000) 2024-09-21T04:07:24.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:24 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:24.331+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:49.335185+0000 front 2024-09-21T04:06:49.335243+0000 (oldest deadline 2024-09-21T04:07:15.235390+0000) 2024-09-21T04:07:24.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:24 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:24.331+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:55.236044+0000 front 2024-09-21T04:06:55.236093+0000 (oldest deadline 2024-09-21T04:07:20.535891+0000) 2024-09-21T04:07:25.054 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:24 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:24.694+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:25.055 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:24 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:24.694+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:25.055 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:24 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:24.694+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:25.055 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:24 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:24.694+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:25.055 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:24 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:24.694+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.271810+0000 front 2024-09-21T04:06:47.271916+0000 (oldest deadline 2024-09-21T04:07:12.471730+0000) 2024-09-21T04:07:25.055 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:24 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:24.694+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:54.172555+0000 front 2024-09-21T04:06:54.172599+0000 (oldest deadline 2024-09-21T04:07:24.173267+0000) 2024-09-21T04:07:25.073 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.8.service' 2024-09-21T04:07:25.112 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:07:25.113 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-21T04:07:25.113 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-21T04:07:25.113 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.9 2024-09-21T04:07:25.439 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:25 smithi046 systemd[1]: Stopping Ceph osd.9 for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T04:07:25.439 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:25 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:25.437+0000 7f8f38edb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:07:25.751 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:25 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:25.437+0000 7f8f38edb640 -1 osd.9 86 *** Got signal Terminated *** 2024-09-21T04:07:25.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:25 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:25.437+0000 7f8f38edb640 -1 osd.9 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T04:07:25.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:25 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:25.461+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:07:25.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:25 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:25.461+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:07:25.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:25 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:25.461+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.604603+0000 front 2024-09-21T04:06:34.604771+0000 (oldest deadline 2024-09-21T04:07:00.504534+0000) 2024-09-21T04:07:25.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:25 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:25.461+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:40.504853+0000 front 2024-09-21T04:06:40.505012+0000 (oldest deadline 2024-09-21T04:07:05.805002+0000) 2024-09-21T04:07:25.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:25 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:25.461+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:45.805523+0000 front 2024-09-21T04:06:45.805494+0000 (oldest deadline 2024-09-21T04:07:11.105390+0000) 2024-09-21T04:07:25.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:25 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:25.344+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:25.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:25 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:25.344+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:25.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:25 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:25.344+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:25.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:25 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:25.344+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.934931+0000 front 2024-09-21T04:06:39.934951+0000 (oldest deadline 2024-09-21T04:07:05.834665+0000) 2024-09-21T04:07:25.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:25 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:25.344+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:49.335185+0000 front 2024-09-21T04:06:49.335243+0000 (oldest deadline 2024-09-21T04:07:15.235390+0000) 2024-09-21T04:07:25.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:25 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:25.344+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:55.236044+0000 front 2024-09-21T04:06:55.236093+0000 (oldest deadline 2024-09-21T04:07:20.535891+0000) 2024-09-21T04:07:26.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:25 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:25.721+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:26.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:25 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:25.721+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:26.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:25 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:25.721+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:26.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:25 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:25.721+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:26.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:25 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:25.721+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.271810+0000 front 2024-09-21T04:06:47.271916+0000 (oldest deadline 2024-09-21T04:07:12.471730+0000) 2024-09-21T04:07:26.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:25 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:25.721+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:54.172555+0000 front 2024-09-21T04:06:54.172599+0000 (oldest deadline 2024-09-21T04:07:24.173267+0000) 2024-09-21T04:07:26.568 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:26 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:26.307+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:26.568 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:26 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:26.307+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:26.568 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:26 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:26.307+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:26.568 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:26 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:26.307+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.934931+0000 front 2024-09-21T04:06:39.934951+0000 (oldest deadline 2024-09-21T04:07:05.834665+0000) 2024-09-21T04:07:26.569 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:26 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:26.307+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:49.335185+0000 front 2024-09-21T04:06:49.335243+0000 (oldest deadline 2024-09-21T04:07:15.235390+0000) 2024-09-21T04:07:26.569 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:26 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:26.307+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:55.236044+0000 front 2024-09-21T04:06:55.236093+0000 (oldest deadline 2024-09-21T04:07:20.535891+0000) 2024-09-21T04:07:27.002 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:26 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:26.508+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:07:27.002 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:26 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:26.508+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:07:27.002 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:26 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:26.508+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.604603+0000 front 2024-09-21T04:06:34.604771+0000 (oldest deadline 2024-09-21T04:07:00.504534+0000) 2024-09-21T04:07:27.002 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:26 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:26.508+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:40.504853+0000 front 2024-09-21T04:06:40.505012+0000 (oldest deadline 2024-09-21T04:07:05.805002+0000) 2024-09-21T04:07:27.002 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:26 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:26.508+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:45.805523+0000 front 2024-09-21T04:06:45.805494+0000 (oldest deadline 2024-09-21T04:07:11.105390+0000) 2024-09-21T04:07:27.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:26 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:26.707+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:27.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:26 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:26.707+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:27.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:26 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:26.707+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:27.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:26 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:26.707+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:27.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:26 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:26.707+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.271810+0000 front 2024-09-21T04:06:47.271916+0000 (oldest deadline 2024-09-21T04:07:12.471730+0000) 2024-09-21T04:07:27.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:26 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:26.707+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:54.172555+0000 front 2024-09-21T04:06:54.172599+0000 (oldest deadline 2024-09-21T04:07:24.173267+0000) 2024-09-21T04:07:27.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:27 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:27.349+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:27.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:27 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:27.349+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:27.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:27 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:27.349+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:27.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:27 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:27.349+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.934931+0000 front 2024-09-21T04:06:39.934951+0000 (oldest deadline 2024-09-21T04:07:05.834665+0000) 2024-09-21T04:07:27.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:27 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:27.349+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:49.335185+0000 front 2024-09-21T04:06:49.335243+0000 (oldest deadline 2024-09-21T04:07:15.235390+0000) 2024-09-21T04:07:27.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:27 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:27.349+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:55.236044+0000 front 2024-09-21T04:06:55.236093+0000 (oldest deadline 2024-09-21T04:07:20.535891+0000) 2024-09-21T04:07:28.002 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:27 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:27.514+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:07:28.002 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:27 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:27.514+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:07:28.002 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:27 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:27.514+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.604603+0000 front 2024-09-21T04:06:34.604771+0000 (oldest deadline 2024-09-21T04:07:00.504534+0000) 2024-09-21T04:07:28.002 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:27 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:27.514+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:40.504853+0000 front 2024-09-21T04:06:40.505012+0000 (oldest deadline 2024-09-21T04:07:05.805002+0000) 2024-09-21T04:07:28.002 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:27 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:27.514+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:45.805523+0000 front 2024-09-21T04:06:45.805494+0000 (oldest deadline 2024-09-21T04:07:11.105390+0000) 2024-09-21T04:07:28.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:27 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:27.664+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:28.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:27 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:27.664+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:28.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:27 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:27.664+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:28.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:27 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:27.664+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:28.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:27 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:27.664+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.271810+0000 front 2024-09-21T04:06:47.271916+0000 (oldest deadline 2024-09-21T04:07:12.471730+0000) 2024-09-21T04:07:28.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:27 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:27.664+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:54.172555+0000 front 2024-09-21T04:06:54.172599+0000 (oldest deadline 2024-09-21T04:07:24.173267+0000) 2024-09-21T04:07:28.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:28 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:28.358+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:28.824 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:28 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:28.358+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:28.824 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:28 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:28.358+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:28.824 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:28 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:28.358+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.934931+0000 front 2024-09-21T04:06:39.934951+0000 (oldest deadline 2024-09-21T04:07:05.834665+0000) 2024-09-21T04:07:28.824 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:28 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:28.358+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:49.335185+0000 front 2024-09-21T04:06:49.335243+0000 (oldest deadline 2024-09-21T04:07:15.235390+0000) 2024-09-21T04:07:28.824 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:28 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:28.358+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:55.236044+0000 front 2024-09-21T04:06:55.236093+0000 (oldest deadline 2024-09-21T04:07:20.535891+0000) 2024-09-21T04:07:29.002 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:28 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:28.514+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:07:29.002 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:28 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:28.514+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:07:29.002 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:28 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:28.514+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.604603+0000 front 2024-09-21T04:06:34.604771+0000 (oldest deadline 2024-09-21T04:07:00.504534+0000) 2024-09-21T04:07:29.002 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:28 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:28.514+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:40.504853+0000 front 2024-09-21T04:06:40.505012+0000 (oldest deadline 2024-09-21T04:07:05.805002+0000) 2024-09-21T04:07:29.002 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:28 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:28.514+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:45.805523+0000 front 2024-09-21T04:06:45.805494+0000 (oldest deadline 2024-09-21T04:07:11.105390+0000) 2024-09-21T04:07:29.125 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:28 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:28.714+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:29.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:28 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:28.714+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:29.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:28 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:28.714+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:29.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:28 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:28.714+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:29.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:28 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:28.714+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.271810+0000 front 2024-09-21T04:06:47.271916+0000 (oldest deadline 2024-09-21T04:07:12.471730+0000) 2024-09-21T04:07:29.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:28 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:28.714+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:54.172555+0000 front 2024-09-21T04:06:54.172599+0000 (oldest deadline 2024-09-21T04:07:24.173267+0000) 2024-09-21T04:07:29.751 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:29 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:29.465+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.800642+0000 front 2024-09-21T04:06:17.800871+0000 (oldest deadline 2024-09-21T04:06:43.100820+0000) 2024-09-21T04:07:29.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:29 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:29.465+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:26.502968+0000 front 2024-09-21T04:06:26.503148+0000 (oldest deadline 2024-09-21T04:06:47.602894+0000) 2024-09-21T04:07:29.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:29 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:29.465+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.604603+0000 front 2024-09-21T04:06:34.604771+0000 (oldest deadline 2024-09-21T04:07:00.504534+0000) 2024-09-21T04:07:29.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:29 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:29.465+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:40.504853+0000 front 2024-09-21T04:06:40.505012+0000 (oldest deadline 2024-09-21T04:07:05.805002+0000) 2024-09-21T04:07:29.752 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:29 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9[66988]: 2024-09-21T04:07:29.465+0000 7f8f354c6640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:45.805523+0000 front 2024-09-21T04:06:45.805494+0000 (oldest deadline 2024-09-21T04:07:11.105390+0000) 2024-09-21T04:07:29.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:29 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:29.387+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:29.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:29 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:29.387+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:29.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:29 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:29.387+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:29.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:29 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:29.387+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.934931+0000 front 2024-09-21T04:06:39.934951+0000 (oldest deadline 2024-09-21T04:07:05.834665+0000) 2024-09-21T04:07:29.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:29 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:29.387+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:49.335185+0000 front 2024-09-21T04:06:49.335243+0000 (oldest deadline 2024-09-21T04:07:15.235390+0000) 2024-09-21T04:07:29.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:29 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:29.387+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:55.236044+0000 front 2024-09-21T04:06:55.236093+0000 (oldest deadline 2024-09-21T04:07:20.535891+0000) 2024-09-21T04:07:29.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:29 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:29.387+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2024-09-21T04:07:04.036984+0000 front 2024-09-21T04:07:04.037001+0000 (oldest deadline 2024-09-21T04:07:29.237051+0000) 2024-09-21T04:07:30.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:29 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:29.725+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:30.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:29 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:29.725+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:30.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:29 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:29.725+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:30.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:29 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:29.725+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:30.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:29 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:29.725+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.271810+0000 front 2024-09-21T04:06:47.271916+0000 (oldest deadline 2024-09-21T04:07:12.471730+0000) 2024-09-21T04:07:30.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:29 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:29.725+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:54.172555+0000 front 2024-09-21T04:06:54.172599+0000 (oldest deadline 2024-09-21T04:07:24.173267+0000) 2024-09-21T04:07:30.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:30 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:30.351+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:30.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:30 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:30.351+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:30.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:30 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:30.351+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:30.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:30 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:30.351+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.934931+0000 front 2024-09-21T04:06:39.934951+0000 (oldest deadline 2024-09-21T04:07:05.834665+0000) 2024-09-21T04:07:30.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:30 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:30.351+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:49.335185+0000 front 2024-09-21T04:06:49.335243+0000 (oldest deadline 2024-09-21T04:07:15.235390+0000) 2024-09-21T04:07:30.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:30 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:30.351+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:55.236044+0000 front 2024-09-21T04:06:55.236093+0000 (oldest deadline 2024-09-21T04:07:20.535891+0000) 2024-09-21T04:07:30.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:30 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:30.351+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2024-09-21T04:07:04.036984+0000 front 2024-09-21T04:07:04.037001+0000 (oldest deadline 2024-09-21T04:07:29.237051+0000) 2024-09-21T04:07:31.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:30 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:30.757+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:31.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:30 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:30.757+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:31.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:30 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:30.757+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:31.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:30 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:30.757+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:31.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:30 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:30.757+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.271810+0000 front 2024-09-21T04:06:47.271916+0000 (oldest deadline 2024-09-21T04:07:12.471730+0000) 2024-09-21T04:07:31.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:30 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:30.757+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:54.172555+0000 front 2024-09-21T04:06:54.172599+0000 (oldest deadline 2024-09-21T04:07:24.173267+0000) 2024-09-21T04:07:31.251 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:30 smithi046 podman[101998]: 2024-09-21 04:07:30.978814983 +0000 UTC m=+5.668041994 container died 7c926f50854171684358db6f5c28dc01b825530f5ef43f446a550eee8fc94b26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T04:07:31.698 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:31 smithi046 podman[101998]: 2024-09-21 04:07:31.42845876 +0000 UTC m=+6.117685824 container cleanup 7c926f50854171684358db6f5c28dc01b825530f5ef43f446a550eee8fc94b26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T04:07:31.698 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:31 smithi046 bash[101998]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9 2024-09-21T04:07:31.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:31 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:31.354+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:31.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:31 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:31.354+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:31.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:31 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:31.354+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:31.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:31 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:31.354+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.934931+0000 front 2024-09-21T04:06:39.934951+0000 (oldest deadline 2024-09-21T04:07:05.834665+0000) 2024-09-21T04:07:31.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:31 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:31.354+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:49.335185+0000 front 2024-09-21T04:06:49.335243+0000 (oldest deadline 2024-09-21T04:07:15.235390+0000) 2024-09-21T04:07:31.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:31 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:31.354+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:55.236044+0000 front 2024-09-21T04:06:55.236093+0000 (oldest deadline 2024-09-21T04:07:20.535891+0000) 2024-09-21T04:07:31.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:31 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:31.354+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2024-09-21T04:07:04.036984+0000 front 2024-09-21T04:07:04.037001+0000 (oldest deadline 2024-09-21T04:07:29.237051+0000) 2024-09-21T04:07:32.001 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:31 smithi046 podman[102013]: 2024-09-21 04:07:31.696661918 +0000 UTC m=+0.717295514 container remove 7c926f50854171684358db6f5c28dc01b825530f5ef43f446a550eee8fc94b26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T04:07:32.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:31 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:31.771+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:32.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:31 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:31.771+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:32.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:31 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:31.771+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:32.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:31 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:31.771+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:32.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:31 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:31.771+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.271810+0000 front 2024-09-21T04:06:47.271916+0000 (oldest deadline 2024-09-21T04:07:12.471730+0000) 2024-09-21T04:07:32.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:31 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:31.771+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:54.172555+0000 front 2024-09-21T04:06:54.172599+0000 (oldest deadline 2024-09-21T04:07:24.173267+0000) 2024-09-21T04:07:32.343 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:32 smithi046 podman[102104]: 2024-09-21 04:07:31.9609967 +0000 UTC m=+0.016151461 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T04:07:32.343 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:32 smithi046 podman[102104]: 2024-09-21 04:07:32.080840796 +0000 UTC m=+0.135995577 container create e589658df566411173ae221e6f6dd8766c65f47749c45f985cdb2e382ad863db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T04:07:32.343 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:32 smithi046 podman[102104]: 2024-09-21 04:07:32.26639395 +0000 UTC m=+0.321548698 container init e589658df566411173ae221e6f6dd8766c65f47749c45f985cdb2e382ad863db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T04:07:32.343 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:32 smithi046 podman[102104]: 2024-09-21 04:07:32.269735487 +0000 UTC m=+0.324890226 container start e589658df566411173ae221e6f6dd8766c65f47749c45f985cdb2e382ad863db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T04:07:32.343 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:32 smithi046 podman[102104]: 2024-09-21 04:07:32.341219866 +0000 UTC m=+0.396374633 container attach e589658df566411173ae221e6f6dd8766c65f47749c45f985cdb2e382ad863db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-21T04:07:32.751 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 21 04:07:32 smithi046 podman[102104]: 2024-09-21 04:07:32.466244626 +0000 UTC m=+0.521399372 container died e589658df566411173ae221e6f6dd8766c65f47749c45f985cdb2e382ad863db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-9-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T04:07:32.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:32 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:32.379+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:32.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:32 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:32.379+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:32.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:32 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:32.379+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:32.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:32 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:32.379+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.934931+0000 front 2024-09-21T04:06:39.934951+0000 (oldest deadline 2024-09-21T04:07:05.834665+0000) 2024-09-21T04:07:32.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:32 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:32.379+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:49.335185+0000 front 2024-09-21T04:06:49.335243+0000 (oldest deadline 2024-09-21T04:07:15.235390+0000) 2024-09-21T04:07:32.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:32 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:32.379+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:55.236044+0000 front 2024-09-21T04:06:55.236093+0000 (oldest deadline 2024-09-21T04:07:20.535891+0000) 2024-09-21T04:07:32.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:32 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:32.379+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2024-09-21T04:07:04.036984+0000 front 2024-09-21T04:07:04.037001+0000 (oldest deadline 2024-09-21T04:07:29.237051+0000) 2024-09-21T04:07:33.086 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.9.service' 2024-09-21T04:07:33.125 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:32 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:32.737+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:33.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:32 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:32.737+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:33.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:32 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:32.737+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:33.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:32 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:32.737+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:33.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:32 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:32.737+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.271810+0000 front 2024-09-21T04:06:47.271916+0000 (oldest deadline 2024-09-21T04:07:12.471730+0000) 2024-09-21T04:07:33.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:32 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:32.737+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:54.172555+0000 front 2024-09-21T04:06:54.172599+0000 (oldest deadline 2024-09-21T04:07:24.173267+0000) 2024-09-21T04:07:33.127 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:07:33.128 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-21T04:07:33.128 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-21T04:07:33.128 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.10 2024-09-21T04:07:33.453 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:33 smithi105 systemd[1]: Stopping Ceph osd.10 for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T04:07:33.453 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:33 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:33.359+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:33.454 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:33 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:33.359+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:33.454 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:33 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:33.359+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:33.454 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:33 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:33.359+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.934931+0000 front 2024-09-21T04:06:39.934951+0000 (oldest deadline 2024-09-21T04:07:05.834665+0000) 2024-09-21T04:07:33.454 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:33 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:33.359+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:49.335185+0000 front 2024-09-21T04:06:49.335243+0000 (oldest deadline 2024-09-21T04:07:15.235390+0000) 2024-09-21T04:07:33.454 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:33 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:33.359+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:55.236044+0000 front 2024-09-21T04:06:55.236093+0000 (oldest deadline 2024-09-21T04:07:20.535891+0000) 2024-09-21T04:07:33.454 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:33 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:33.359+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2024-09-21T04:07:04.036984+0000 front 2024-09-21T04:07:04.037001+0000 (oldest deadline 2024-09-21T04:07:29.237051+0000) 2024-09-21T04:07:33.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:33 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:33.451+0000 7fb7766d9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:07:33.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:33 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:33.451+0000 7fb7766d9640 -1 osd.10 86 *** Got signal Terminated *** 2024-09-21T04:07:33.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:33 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:33.451+0000 7fb7766d9640 -1 osd.10 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T04:07:34.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:33 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:33.733+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:34.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:33 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:33.733+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:34.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:33 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:33.733+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:34.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:33 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:33.733+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:34.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:33 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:33.733+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.271810+0000 front 2024-09-21T04:06:47.271916+0000 (oldest deadline 2024-09-21T04:07:12.471730+0000) 2024-09-21T04:07:34.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:33 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:33.733+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:54.172555+0000 front 2024-09-21T04:06:54.172599+0000 (oldest deadline 2024-09-21T04:07:24.173267+0000) 2024-09-21T04:07:34.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:34 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:34.361+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:34.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:34 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:34.361+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:34.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:34 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:34.361+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:34.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:34 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:34.361+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.934931+0000 front 2024-09-21T04:06:39.934951+0000 (oldest deadline 2024-09-21T04:07:05.834665+0000) 2024-09-21T04:07:34.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:34 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:34.361+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:49.335185+0000 front 2024-09-21T04:06:49.335243+0000 (oldest deadline 2024-09-21T04:07:15.235390+0000) 2024-09-21T04:07:34.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:34 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:34.361+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:55.236044+0000 front 2024-09-21T04:06:55.236093+0000 (oldest deadline 2024-09-21T04:07:20.535891+0000) 2024-09-21T04:07:34.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:34 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:34.361+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2024-09-21T04:07:04.036984+0000 front 2024-09-21T04:07:04.037001+0000 (oldest deadline 2024-09-21T04:07:29.237051+0000) 2024-09-21T04:07:35.125 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:34 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:34.740+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:35.125 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:34 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:34.740+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:35.125 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:34 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:34.740+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:35.125 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:34 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:34.740+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:35.125 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:34 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:34.740+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.271810+0000 front 2024-09-21T04:06:47.271916+0000 (oldest deadline 2024-09-21T04:07:12.471730+0000) 2024-09-21T04:07:35.125 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:34 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:34.740+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:54.172555+0000 front 2024-09-21T04:06:54.172599+0000 (oldest deadline 2024-09-21T04:07:24.173267+0000) 2024-09-21T04:07:35.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:35 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:35.392+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:35.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:35 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:35.392+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:35.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:35 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:35.392+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:35.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:35 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:35.392+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.934931+0000 front 2024-09-21T04:06:39.934951+0000 (oldest deadline 2024-09-21T04:07:05.834665+0000) 2024-09-21T04:07:35.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:35 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:35.392+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:49.335185+0000 front 2024-09-21T04:06:49.335243+0000 (oldest deadline 2024-09-21T04:07:15.235390+0000) 2024-09-21T04:07:35.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:35 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:35.392+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:55.236044+0000 front 2024-09-21T04:06:55.236093+0000 (oldest deadline 2024-09-21T04:07:20.535891+0000) 2024-09-21T04:07:35.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:35 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:35.392+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2024-09-21T04:07:04.036984+0000 front 2024-09-21T04:07:04.037001+0000 (oldest deadline 2024-09-21T04:07:29.237051+0000) 2024-09-21T04:07:36.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:35 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:35.724+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:36.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:35 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:35.724+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:36.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:35 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:35.724+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:36.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:35 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:35.724+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:36.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:35 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:35.724+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.271810+0000 front 2024-09-21T04:06:47.271916+0000 (oldest deadline 2024-09-21T04:07:12.471730+0000) 2024-09-21T04:07:36.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:35 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:35.724+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:54.172555+0000 front 2024-09-21T04:06:54.172599+0000 (oldest deadline 2024-09-21T04:07:24.173267+0000) 2024-09-21T04:07:36.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:36 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:36.393+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:36.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:36 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:36.393+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:36.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:36 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:36.393+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:36.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:36 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:36.393+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.934931+0000 front 2024-09-21T04:06:39.934951+0000 (oldest deadline 2024-09-21T04:07:05.834665+0000) 2024-09-21T04:07:36.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:36 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:36.393+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:49.335185+0000 front 2024-09-21T04:06:49.335243+0000 (oldest deadline 2024-09-21T04:07:15.235390+0000) 2024-09-21T04:07:36.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:36 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:36.393+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:55.236044+0000 front 2024-09-21T04:06:55.236093+0000 (oldest deadline 2024-09-21T04:07:20.535891+0000) 2024-09-21T04:07:36.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:36 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:36.393+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2024-09-21T04:07:04.036984+0000 front 2024-09-21T04:07:04.037001+0000 (oldest deadline 2024-09-21T04:07:29.237051+0000) 2024-09-21T04:07:37.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:36 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:36.734+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:37.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:36 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:36.734+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:37.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:36 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:36.734+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:37.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:36 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:36.734+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:37.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:36 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:36.734+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.271810+0000 front 2024-09-21T04:06:47.271916+0000 (oldest deadline 2024-09-21T04:07:12.471730+0000) 2024-09-21T04:07:37.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:36 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:36.734+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:54.172555+0000 front 2024-09-21T04:06:54.172599+0000 (oldest deadline 2024-09-21T04:07:24.173267+0000) 2024-09-21T04:07:37.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:37 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:37.365+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:37.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:37 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:37.365+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:37.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:37 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:37.365+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:37.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:37 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:37.365+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.934931+0000 front 2024-09-21T04:06:39.934951+0000 (oldest deadline 2024-09-21T04:07:05.834665+0000) 2024-09-21T04:07:37.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:37 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:37.365+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:49.335185+0000 front 2024-09-21T04:06:49.335243+0000 (oldest deadline 2024-09-21T04:07:15.235390+0000) 2024-09-21T04:07:37.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:37 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:37.365+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:55.236044+0000 front 2024-09-21T04:06:55.236093+0000 (oldest deadline 2024-09-21T04:07:20.535891+0000) 2024-09-21T04:07:37.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:37 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:37.365+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2024-09-21T04:07:04.036984+0000 front 2024-09-21T04:07:04.037001+0000 (oldest deadline 2024-09-21T04:07:29.237051+0000) 2024-09-21T04:07:38.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:37 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:37.707+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:38.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:37 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:37.707+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:38.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:37 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:37.707+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:38.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:37 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:37.707+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:38.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:37 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:37.707+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.271810+0000 front 2024-09-21T04:06:47.271916+0000 (oldest deadline 2024-09-21T04:07:12.471730+0000) 2024-09-21T04:07:38.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:37 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:37.707+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:54.172555+0000 front 2024-09-21T04:06:54.172599+0000 (oldest deadline 2024-09-21T04:07:24.173267+0000) 2024-09-21T04:07:38.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:38 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:38.376+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:15.430940+0000 front 2024-09-21T04:06:15.430609+0000 (oldest deadline 2024-09-21T04:06:38.930676+0000) 2024-09-21T04:07:38.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:38 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:38.376+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:25.932466+0000 front 2024-09-21T04:06:25.932615+0000 (oldest deadline 2024-09-21T04:06:50.032576+0000) 2024-09-21T04:07:38.818 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:38 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:38.376+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:34.034277+0000 front 2024-09-21T04:06:34.034089+0000 (oldest deadline 2024-09-21T04:06:59.934044+0000) 2024-09-21T04:07:38.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:38 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:38.376+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:39.934931+0000 front 2024-09-21T04:06:39.934951+0000 (oldest deadline 2024-09-21T04:07:05.834665+0000) 2024-09-21T04:07:38.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:38 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:38.376+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:49.335185+0000 front 2024-09-21T04:06:49.335243+0000 (oldest deadline 2024-09-21T04:07:15.235390+0000) 2024-09-21T04:07:38.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:38 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:38.376+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:55.236044+0000 front 2024-09-21T04:06:55.236093+0000 (oldest deadline 2024-09-21T04:07:20.535891+0000) 2024-09-21T04:07:38.819 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:38 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10[58589]: 2024-09-21T04:07:38.376+0000 7fb772cc4640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2024-09-21T04:07:04.036984+0000 front 2024-09-21T04:07:04.037001+0000 (oldest deadline 2024-09-21T04:07:29.237051+0000) 2024-09-21T04:07:39.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:38 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:38.740+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:39.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:38 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:38.740+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:39.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:38 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:38.740+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:39.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:38 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:38.740+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:39.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:38 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:38.740+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.271810+0000 front 2024-09-21T04:06:47.271916+0000 (oldest deadline 2024-09-21T04:07:12.471730+0000) 2024-09-21T04:07:39.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:38 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:38.740+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:54.172555+0000 front 2024-09-21T04:06:54.172599+0000 (oldest deadline 2024-09-21T04:07:24.173267+0000) 2024-09-21T04:07:39.270 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:39 smithi105 podman[67821]: 2024-09-21 04:07:39.001307182 +0000 UTC m=+5.677827540 container died bc151da30a8530c24caadede5890b8a8e5fdf8ee114f2d1504bda6f3629a85ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-21T04:07:39.568 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:39 smithi105 podman[67821]: 2024-09-21 04:07:39.359348066 +0000 UTC m=+6.035868432 container cleanup bc151da30a8530c24caadede5890b8a8e5fdf8ee114f2d1504bda6f3629a85ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True) 2024-09-21T04:07:39.568 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:39 smithi105 bash[67821]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10 2024-09-21T04:07:39.976 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:39 smithi105 podman[67837]: 2024-09-21 04:07:39.652294599 +0000 UTC m=+0.650241546 container remove bc151da30a8530c24caadede5890b8a8e5fdf8ee114f2d1504bda6f3629a85ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T04:07:40.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:39 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:39.701+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:40.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:39 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:39.701+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:40.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:39 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:39.701+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:40.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:39 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:39.701+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:40.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:39 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:39.701+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.271810+0000 front 2024-09-21T04:06:47.271916+0000 (oldest deadline 2024-09-21T04:07:12.471730+0000) 2024-09-21T04:07:40.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:39 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:39.701+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:54.172555+0000 front 2024-09-21T04:06:54.172599+0000 (oldest deadline 2024-09-21T04:07:24.173267+0000) 2024-09-21T04:07:40.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:39 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:39.701+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6820 osd.7 since back 2024-09-21T04:07:14.074799+0000 front 2024-09-21T04:07:14.074761+0000 (oldest deadline 2024-09-21T04:07:39.374695+0000) 2024-09-21T04:07:40.307 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:39 smithi105 podman[67926]: 2024-09-21 04:07:39.877013526 +0000 UTC m=+0.015975550 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T04:07:40.307 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:39 smithi105 podman[67926]: 2024-09-21 04:07:39.98653148 +0000 UTC m=+0.125493538 container create b7585c44ced36002d627a8da38fade2926569b6c9a8365006cb4379f4d35bf8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T04:07:40.308 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:40 smithi105 podman[67926]: 2024-09-21 04:07:40.205749874 +0000 UTC m=+0.344711892 container init b7585c44ced36002d627a8da38fade2926569b6c9a8365006cb4379f4d35bf8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD) 2024-09-21T04:07:40.308 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:40 smithi105 podman[67926]: 2024-09-21 04:07:40.20907218 +0000 UTC m=+0.348034190 container start b7585c44ced36002d627a8da38fade2926569b6c9a8365006cb4379f4d35bf8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T04:07:40.308 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:40 smithi105 podman[67926]: 2024-09-21 04:07:40.305758454 +0000 UTC m=+0.444720464 container attach b7585c44ced36002d627a8da38fade2926569b6c9a8365006cb4379f4d35bf8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T04:07:40.568 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 21 04:07:40 smithi105 podman[67926]: 2024-09-21 04:07:40.397129819 +0000 UTC m=+0.536091829 container died b7585c44ced36002d627a8da38fade2926569b6c9a8365006cb4379f4d35bf8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-21T04:07:40.979 DEBUG:teuthology.orchestra.run.smithi105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.10.service' 2024-09-21T04:07:41.018 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:07:41.018 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-21T04:07:41.018 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-21T04:07:41.019 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.11 2024-09-21T04:07:41.045 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:40 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:40.687+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:41.045 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:40 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:40.687+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:41.046 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:40 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:40.687+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:41.046 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:40 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:40.687+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:41.046 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:40 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:40.687+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.271810+0000 front 2024-09-21T04:06:47.271916+0000 (oldest deadline 2024-09-21T04:07:12.471730+0000) 2024-09-21T04:07:41.046 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:40 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:40.687+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:54.172555+0000 front 2024-09-21T04:06:54.172599+0000 (oldest deadline 2024-09-21T04:07:24.173267+0000) 2024-09-21T04:07:41.046 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:40 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:40.687+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6820 osd.7 since back 2024-09-21T04:07:14.074799+0000 front 2024-09-21T04:07:14.074761+0000 (oldest deadline 2024-09-21T04:07:39.374695+0000) 2024-09-21T04:07:41.331 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:41 smithi162 systemd[1]: Stopping Ceph osd.11 for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T04:07:41.626 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:41 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:41.328+0000 7f7440c7c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:07:41.626 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:41 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:41.328+0000 7f7440c7c640 -1 osd.11 86 *** Got signal Terminated *** 2024-09-21T04:07:41.626 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:41 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:41.328+0000 7f7440c7c640 -1 osd.11 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T04:07:42.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:41 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:41.686+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:42.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:41 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:41.686+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:42.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:41 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:41.686+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:42.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:41 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:41.686+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:42.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:41 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:41.686+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.271810+0000 front 2024-09-21T04:06:47.271916+0000 (oldest deadline 2024-09-21T04:07:12.471730+0000) 2024-09-21T04:07:42.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:41 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:41.686+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:54.172555+0000 front 2024-09-21T04:06:54.172599+0000 (oldest deadline 2024-09-21T04:07:24.173267+0000) 2024-09-21T04:07:42.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:41 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:41.686+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6820 osd.7 since back 2024-09-21T04:07:14.074799+0000 front 2024-09-21T04:07:14.074761+0000 (oldest deadline 2024-09-21T04:07:39.374695+0000) 2024-09-21T04:07:43.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:42 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:42.657+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:43.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:42 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:42.657+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:43.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:42 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:42.657+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:43.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:42 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:42.657+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:43.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:42 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:42.657+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.271810+0000 front 2024-09-21T04:06:47.271916+0000 (oldest deadline 2024-09-21T04:07:12.471730+0000) 2024-09-21T04:07:43.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:42 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:42.657+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:54.172555+0000 front 2024-09-21T04:06:54.172599+0000 (oldest deadline 2024-09-21T04:07:24.173267+0000) 2024-09-21T04:07:43.127 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:42 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:42.657+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6820 osd.7 since back 2024-09-21T04:07:14.074799+0000 front 2024-09-21T04:07:14.074761+0000 (oldest deadline 2024-09-21T04:07:39.374695+0000) 2024-09-21T04:07:44.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:43 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:43.650+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:44.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:43 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:43.650+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:44.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:43 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:43.650+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:44.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:43 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:43.650+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:44.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:43 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:43.650+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.271810+0000 front 2024-09-21T04:06:47.271916+0000 (oldest deadline 2024-09-21T04:07:12.471730+0000) 2024-09-21T04:07:44.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:43 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:43.650+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:54.172555+0000 front 2024-09-21T04:06:54.172599+0000 (oldest deadline 2024-09-21T04:07:24.173267+0000) 2024-09-21T04:07:44.127 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:43 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:43.650+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6820 osd.7 since back 2024-09-21T04:07:14.074799+0000 front 2024-09-21T04:07:14.074761+0000 (oldest deadline 2024-09-21T04:07:39.374695+0000) 2024-09-21T04:07:45.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:44 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:44.635+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:45.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:44 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:44.635+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:45.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:44 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:44.635+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:45.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:44 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:44.635+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:45.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:44 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:44.635+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.271810+0000 front 2024-09-21T04:06:47.271916+0000 (oldest deadline 2024-09-21T04:07:12.471730+0000) 2024-09-21T04:07:45.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:44 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:44.635+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:54.172555+0000 front 2024-09-21T04:06:54.172599+0000 (oldest deadline 2024-09-21T04:07:24.173267+0000) 2024-09-21T04:07:45.126 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:44 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:44.635+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6820 osd.7 since back 2024-09-21T04:07:14.074799+0000 front 2024-09-21T04:07:14.074761+0000 (oldest deadline 2024-09-21T04:07:39.374695+0000) 2024-09-21T04:07:45.876 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:45 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:45.585+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T04:06:17.066280+0000 front 2024-09-21T04:06:17.066318+0000 (oldest deadline 2024-09-21T04:06:39.966390+0000) 2024-09-21T04:07:45.876 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:45 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:45.585+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-21T04:06:21.568409+0000 front 2024-09-21T04:06:21.568377+0000 (oldest deadline 2024-09-21T04:06:51.568739+0000) 2024-09-21T04:07:45.876 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:45 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:45.585+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-21T04:06:31.569213+0000 front 2024-09-21T04:06:31.569186+0000 (oldest deadline 2024-09-21T04:06:56.869331+0000) 2024-09-21T04:07:45.876 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:45 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:45.585+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-21T04:06:38.470714+0000 front 2024-09-21T04:06:38.470796+0000 (oldest deadline 2024-09-21T04:07:04.370614+0000) 2024-09-21T04:07:45.876 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:45 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:45.585+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-21T04:06:47.271810+0000 front 2024-09-21T04:06:47.271916+0000 (oldest deadline 2024-09-21T04:07:12.471730+0000) 2024-09-21T04:07:45.876 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:45 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:45.585+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-21T04:06:54.172555+0000 front 2024-09-21T04:06:54.172599+0000 (oldest deadline 2024-09-21T04:07:24.173267+0000) 2024-09-21T04:07:45.876 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:45 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T04:07:45.585+0000 7f743925f640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.105:6820 osd.7 since back 2024-09-21T04:07:14.074799+0000 front 2024-09-21T04:07:14.074761+0000 (oldest deadline 2024-09-21T04:07:39.374695+0000) 2024-09-21T04:07:46.956 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:46 smithi162 podman[68491]: 2024-09-21 04:07:46.647982634 +0000 UTC m=+5.435060830 container died 83528f2e83127bd321dc0764fb62c9341617fe37d7050168b3eabb89323ebd0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T04:07:47.281 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:47 smithi162 podman[68491]: 2024-09-21 04:07:47.03701983 +0000 UTC m=+5.824098015 container cleanup 83528f2e83127bd321dc0764fb62c9341617fe37d7050168b3eabb89323ebd0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T04:07:47.281 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:47 smithi162 bash[68491]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11 2024-09-21T04:07:47.608 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:47 smithi162 podman[68508]: 2024-09-21 04:07:47.279714422 +0000 UTC m=+0.620955988 container remove 83528f2e83127bd321dc0764fb62c9341617fe37d7050168b3eabb89323ebd0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-21T04:07:47.876 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:47 smithi162 podman[68594]: 2024-09-21 04:07:47.508719159 +0000 UTC m=+0.015773497 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T04:07:47.876 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:47 smithi162 podman[68594]: 2024-09-21 04:07:47.622081577 +0000 UTC m=+0.129135915 container create b3061f0237f40f66ba15e6031bf5842a231f1509a153320c5df0a898b8a98e83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T04:07:47.876 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:47 smithi162 podman[68594]: 2024-09-21 04:07:47.840974232 +0000 UTC m=+0.348028582 container init b3061f0237f40f66ba15e6031bf5842a231f1509a153320c5df0a898b8a98e83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T04:07:47.876 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:47 smithi162 podman[68594]: 2024-09-21 04:07:47.844155203 +0000 UTC m=+0.351209550 container start b3061f0237f40f66ba15e6031bf5842a231f1509a153320c5df0a898b8a98e83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-21T04:07:48.376 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:47 smithi162 podman[68594]: 2024-09-21 04:07:47.924446929 +0000 UTC m=+0.431501280 container attach b3061f0237f40f66ba15e6031bf5842a231f1509a153320c5df0a898b8a98e83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T04:07:48.376 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:48 smithi162 podman[68594]: 2024-09-21 04:07:48.039299648 +0000 UTC m=+0.546353991 container died b3061f0237f40f66ba15e6031bf5842a231f1509a153320c5df0a898b8a98e83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T04:07:48.629 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 21 04:07:48 smithi162 podman[68617]: 2024-09-21 04:07:48.611212018 +0000 UTC m=+0.562315860 container remove b3061f0237f40f66ba15e6031bf5842a231f1509a153320c5df0a898b8a98e83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T04:07:48.635 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@osd.11.service' 2024-09-21T04:07:48.715 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:07:48.715 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-21T04:07:48.716 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-21T04:07:48.716 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.a 2024-09-21T04:07:49.001 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 21 04:07:48 smithi046 systemd[1]: Stopping Ceph mds.a for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T04:07:49.251 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 21 04:07:48 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-a[73874]: 2024-09-21T04:07:48.998+0000 7f39fe60d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:07:49.251 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 21 04:07:48 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-a[73874]: 2024-09-21T04:07:48.998+0000 7f39fe60d640 -1 mds.a *** got signal Terminated *** 2024-09-21T04:07:52.992 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 21 04:07:52 smithi046 podman[102205]: 2024-09-21 04:07:52.727068988 +0000 UTC m=+3.806432225 container died cabdd9be3786fd3ff2287062f0352ece87c6c22f7e5fadc75ffe79326d3f8f60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-a, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T04:07:53.252 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 21 04:07:53 smithi046 podman[102205]: 2024-09-21 04:07:53.16496797 +0000 UTC m=+4.244331269 container cleanup cabdd9be3786fd3ff2287062f0352ece87c6c22f7e5fadc75ffe79326d3f8f60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-a, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T04:07:53.252 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 21 04:07:53 smithi046 bash[102205]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-a 2024-09-21T04:07:53.705 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.a.service' 2024-09-21T04:07:53.728 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 21 04:07:53 smithi046 podman[102231]: 2024-09-21 04:07:53.474470661 +0000 UTC m=+0.739313273 container remove cabdd9be3786fd3ff2287062f0352ece87c6c22f7e5fadc75ffe79326d3f8f60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-a, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2) 2024-09-21T04:07:53.728 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 21 04:07:53 smithi046 systemd[1]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.a.service: Deactivated successfully. 2024-09-21T04:07:53.729 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 21 04:07:53 smithi046 systemd[1]: Stopped Ceph mds.a for a82de5ec-77cb-11ef-baf5-efdc52797490. 2024-09-21T04:07:53.729 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 21 04:07:53 smithi046 systemd[1]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.a.service: Consumed 1.110s CPU time. 2024-09-21T04:07:53.743 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:07:53.743 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-21T04:07:53.743 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-21T04:07:53.743 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.d 2024-09-21T04:07:54.001 INFO:journalctl@ceph.mds.d.smithi046.stdout:Sep 21 04:07:53 smithi046 systemd[1]: Stopping Ceph mds.d for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T04:07:54.502 INFO:journalctl@ceph.mds.d.smithi046.stdout:Sep 21 04:07:54 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-d[72758]: 2024-09-21T04:07:54.094+0000 7ff77e2b4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:07:54.502 INFO:journalctl@ceph.mds.d.smithi046.stdout:Sep 21 04:07:54 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-d[72758]: 2024-09-21T04:07:54.094+0000 7ff77e2b4640 -1 mds.d *** got signal Terminated *** 2024-09-21T04:07:57.996 INFO:journalctl@ceph.mds.d.smithi046.stdout:Sep 21 04:07:57 smithi046 podman[102337]: 2024-09-21 04:07:57.686425111 +0000 UTC m=+3.723828194 container died 4bd777eda35d9d4f3f29e009087d22bc5267c7f2dbc1f68838b761ea6efd0166 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-d, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T04:07:58.251 INFO:journalctl@ceph.mds.d.smithi046.stdout:Sep 21 04:07:58 smithi046 podman[102337]: 2024-09-21 04:07:58.085245089 +0000 UTC m=+4.122648173 container cleanup 4bd777eda35d9d4f3f29e009087d22bc5267c7f2dbc1f68838b761ea6efd0166 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-d, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T04:07:58.252 INFO:journalctl@ceph.mds.d.smithi046.stdout:Sep 21 04:07:58 smithi046 bash[102337]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-d 2024-09-21T04:07:58.427 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.d.service' 2024-09-21T04:07:58.462 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:07:58.462 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-21T04:07:58.462 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-21T04:07:58.462 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.g 2024-09-21T04:07:59.002 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 21 04:07:58 smithi046 systemd[1]: Stopping Ceph mds.g for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T04:07:59.002 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 21 04:07:58 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-g[73524]: 2024-09-21T04:07:58.780+0000 7fa582020640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:07:59.002 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 21 04:07:58 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-g[73524]: 2024-09-21T04:07:58.780+0000 7fa582020640 -1 mds.g *** got signal Terminated *** 2024-09-21T04:08:01.502 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 21 04:08:01 smithi046 podman[102456]: 2024-09-21 04:08:01.35127685 +0000 UTC m=+2.663571204 container died c065a7f44fa9fd0a292e4abdaeca8449f7dafbc4820e9699327ec1f1cec83bc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2) 2024-09-21T04:08:02.001 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 21 04:08:01 smithi046 podman[102456]: 2024-09-21 04:08:01.714363838 +0000 UTC m=+3.026658182 container cleanup c065a7f44fa9fd0a292e4abdaeca8449f7dafbc4820e9699327ec1f1cec83bc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-g, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-21T04:08:02.002 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 21 04:08:01 smithi046 bash[102456]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-g 2024-09-21T04:08:02.311 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.g.service' 2024-09-21T04:08:02.345 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:08:02.346 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-21T04:08:02.346 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-21T04:08:02.346 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.j 2024-09-21T04:08:02.670 INFO:journalctl@ceph.mds.j.smithi046.stdout:Sep 21 04:08:02 smithi046 systemd[1]: Stopping Ceph mds.j for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T04:08:03.001 INFO:journalctl@ceph.mds.j.smithi046.stdout:Sep 21 04:08:02 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-j[72381]: 2024-09-21T04:08:02.667+0000 7fefb463e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:08:03.001 INFO:journalctl@ceph.mds.j.smithi046.stdout:Sep 21 04:08:02 smithi046 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-j[72381]: 2024-09-21T04:08:02.667+0000 7fefb463e640 -1 mds.j *** got signal Terminated *** 2024-09-21T04:08:06.436 INFO:journalctl@ceph.mds.j.smithi046.stdout:Sep 21 04:08:06 smithi046 podman[102577]: 2024-09-21 04:08:06.135811801 +0000 UTC m=+3.570572315 container died 81f7489c3115c7425173fa3feedd29e23497715ee6a6a801c26e92b91ed39031 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-j, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T04:08:06.436 INFO:journalctl@ceph.mds.j.smithi046.stdout:Sep 21 04:08:06 smithi046 podman[102577]: 2024-09-21 04:08:06.434506195 +0000 UTC m=+3.869266753 container cleanup 81f7489c3115c7425173fa3feedd29e23497715ee6a6a801c26e92b91ed39031 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-j, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T04:08:06.751 INFO:journalctl@ceph.mds.j.smithi046.stdout:Sep 21 04:08:06 smithi046 bash[102577]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-j 2024-09-21T04:08:06.751 INFO:journalctl@ceph.mds.j.smithi046.stdout:Sep 21 04:08:06 smithi046 podman[102590]: 2024-09-21 04:08:06.635748126 +0000 UTC m=+0.492355596 container remove 81f7489c3115c7425173fa3feedd29e23497715ee6a6a801c26e92b91ed39031 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-j, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T04:08:06.778 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.j.service' 2024-09-21T04:08:06.811 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:08:06.811 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-21T04:08:06.811 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-21T04:08:06.811 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.b 2024-09-21T04:08:07.103 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 21 04:08:06 smithi105 systemd[1]: Stopping Ceph mds.b for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T04:08:07.568 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 21 04:08:07 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-b[63738]: 2024-09-21T04:08:07.101+0000 7f1f52216640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:08:07.568 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 21 04:08:07 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-b[63738]: 2024-09-21T04:08:07.101+0000 7f1f52216640 -1 mds.b *** got signal Terminated *** 2024-09-21T04:08:10.725 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 21 04:08:10 smithi105 podman[68028]: 2024-09-21 04:08:10.447003275 +0000 UTC m=+3.438755473 container died 03d3be8b83bd7c5a56ae3810e0d892bb8a06d50731f30e24940a77e68ec09377 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-b, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T04:08:11.068 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 21 04:08:10 smithi105 podman[68028]: 2024-09-21 04:08:10.826313041 +0000 UTC m=+3.818065237 container cleanup 03d3be8b83bd7c5a56ae3810e0d892bb8a06d50731f30e24940a77e68ec09377 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T04:08:11.068 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 21 04:08:10 smithi105 bash[68028]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-b 2024-09-21T04:08:11.214 DEBUG:teuthology.orchestra.run.smithi105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.b.service' 2024-09-21T04:08:11.249 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:08:11.249 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-21T04:08:11.249 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-21T04:08:11.249 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.e 2024-09-21T04:08:11.818 INFO:journalctl@ceph.mds.e.smithi105.stdout:Sep 21 04:08:11 smithi105 systemd[1]: Stopping Ceph mds.e for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T04:08:11.818 INFO:journalctl@ceph.mds.e.smithi105.stdout:Sep 21 04:08:11 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-e[63199]: 2024-09-21T04:08:11.580+0000 7f14e3bad640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:08:11.818 INFO:journalctl@ceph.mds.e.smithi105.stdout:Sep 21 04:08:11 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-e[63199]: 2024-09-21T04:08:11.580+0000 7f14e3bad640 -1 mds.e *** got signal Terminated *** 2024-09-21T04:08:15.865 INFO:journalctl@ceph.mds.e.smithi105.stdout:Sep 21 04:08:15 smithi105 podman[68163]: 2024-09-21 04:08:15.594791723 +0000 UTC m=+4.124023401 container died b46c8015761794af4ff000a5c63390113df4f55089312e27fa1d14a30d433342 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-e, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T04:08:16.224 INFO:journalctl@ceph.mds.e.smithi105.stdout:Sep 21 04:08:15 smithi105 podman[68163]: 2024-09-21 04:08:15.963042145 +0000 UTC m=+4.492273822 container cleanup b46c8015761794af4ff000a5c63390113df4f55089312e27fa1d14a30d433342 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-e, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T04:08:16.224 INFO:journalctl@ceph.mds.e.smithi105.stdout:Sep 21 04:08:15 smithi105 bash[68163]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-e 2024-09-21T04:08:16.388 DEBUG:teuthology.orchestra.run.smithi105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.e.service' 2024-09-21T04:08:16.422 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:08:16.422 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-21T04:08:16.423 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-21T04:08:16.423 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.h 2024-09-21T04:08:16.735 INFO:journalctl@ceph.mds.h.smithi105.stdout:Sep 21 04:08:16 smithi105 systemd[1]: Stopping Ceph mds.h for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T04:08:17.068 INFO:journalctl@ceph.mds.h.smithi105.stdout:Sep 21 04:08:16 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-h[63469]: 2024-09-21T04:08:16.733+0000 7fd563447640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:08:17.068 INFO:journalctl@ceph.mds.h.smithi105.stdout:Sep 21 04:08:16 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-h[63469]: 2024-09-21T04:08:16.733+0000 7fd563447640 -1 mds.h *** got signal Terminated *** 2024-09-21T04:08:20.419 INFO:journalctl@ceph.mds.h.smithi105.stdout:Sep 21 04:08:20 smithi105 podman[68281]: 2024-09-21 04:08:20.137463405 +0000 UTC m=+3.495725493 container died 7f1b2e9d006414e49fe417a19269c461dcc140dad8201dfcfb9af6ad50ba1121 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-h, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T04:08:20.777 INFO:journalctl@ceph.mds.h.smithi105.stdout:Sep 21 04:08:20 smithi105 podman[68281]: 2024-09-21 04:08:20.525101781 +0000 UTC m=+3.883363858 container cleanup 7f1b2e9d006414e49fe417a19269c461dcc140dad8201dfcfb9af6ad50ba1121 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-h, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T04:08:20.778 INFO:journalctl@ceph.mds.h.smithi105.stdout:Sep 21 04:08:20 smithi105 bash[68281]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-h 2024-09-21T04:08:20.901 DEBUG:teuthology.orchestra.run.smithi105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.h.service' 2024-09-21T04:08:20.933 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:08:20.933 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-21T04:08:20.934 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-21T04:08:20.934 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.k 2024-09-21T04:08:21.068 INFO:journalctl@ceph.mds.k.smithi105.stdout:Sep 21 04:08:21 smithi105 systemd[1]: Stopping Ceph mds.k for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T04:08:21.568 INFO:journalctl@ceph.mds.k.smithi105.stdout:Sep 21 04:08:21 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-k[62916]: 2024-09-21T04:08:21.270+0000 7fddfe3e9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:08:21.568 INFO:journalctl@ceph.mds.k.smithi105.stdout:Sep 21 04:08:21 smithi105 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-k[62916]: 2024-09-21T04:08:21.270+0000 7fddfe3e9640 -1 mds.k *** got signal Terminated *** 2024-09-21T04:08:23.089 INFO:journalctl@ceph.mds.k.smithi105.stdout:Sep 21 04:08:22 smithi105 podman[68406]: 2024-09-21 04:08:22.817317177 +0000 UTC m=+1.671596473 container died 0c584c8e6fd6068fae6c76a5be074dbba8c8c1440ad5c619ed42d277a1488bb0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-k, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-21T04:08:23.448 INFO:journalctl@ceph.mds.k.smithi105.stdout:Sep 21 04:08:23 smithi105 podman[68406]: 2024-09-21 04:08:23.195711606 +0000 UTC m=+2.049990908 container cleanup 0c584c8e6fd6068fae6c76a5be074dbba8c8c1440ad5c619ed42d277a1488bb0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T04:08:23.448 INFO:journalctl@ceph.mds.k.smithi105.stdout:Sep 21 04:08:23 smithi105 bash[68406]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-k 2024-09-21T04:08:23.609 DEBUG:teuthology.orchestra.run.smithi105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.k.service' 2024-09-21T04:08:23.640 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:08:23.641 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-21T04:08:23.641 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-21T04:08:23.641 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.c 2024-09-21T04:08:24.052 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 21 04:08:23 smithi162 systemd[1]: Stopping Ceph mds.c for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T04:08:24.309 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 21 04:08:24 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-c[64066]: 2024-09-21T04:08:24.049+0000 7f6117ffc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:08:24.309 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 21 04:08:24 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-c[64066]: 2024-09-21T04:08:24.049+0000 7f6117ffc640 -1 mds.c *** got signal Terminated *** 2024-09-21T04:08:25.626 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 21 04:08:25 smithi162 podman[68697]: 2024-09-21 04:08:25.485225203 +0000 UTC m=+1.652565969 container died 88adc97adf03b19d4a34b667fc7218a3b68e4486d056ba6bfd34699a77648cc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-c, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T04:08:26.376 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 21 04:08:26 smithi162 podman[68697]: 2024-09-21 04:08:26.032636369 +0000 UTC m=+2.199977135 container cleanup 88adc97adf03b19d4a34b667fc7218a3b68e4486d056ba6bfd34699a77648cc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T04:08:26.376 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 21 04:08:26 smithi162 bash[68697]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-c 2024-09-21T04:08:26.376 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 21 04:08:26 smithi162 podman[68721]: 2024-09-21 04:08:26.200355286 +0000 UTC m=+0.705502054 container remove 88adc97adf03b19d4a34b667fc7218a3b68e4486d056ba6bfd34699a77648cc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-c, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-21T04:08:26.419 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.c.service' 2024-09-21T04:08:26.455 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:08:26.456 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-21T04:08:26.456 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-21T04:08:26.456 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.f 2024-09-21T04:08:26.789 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 21 04:08:26 smithi162 systemd[1]: Stopping Ceph mds.f for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T04:08:27.125 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 21 04:08:26 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-f[63795]: 2024-09-21T04:08:26.786+0000 7f1794167640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:08:27.126 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 21 04:08:26 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-f[63795]: 2024-09-21T04:08:26.786+0000 7f1794167640 -1 mds.f *** got signal Terminated *** 2024-09-21T04:08:31.080 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 21 04:08:30 smithi162 podman[68831]: 2024-09-21 04:08:30.798202437 +0000 UTC m=+4.121720388 container died a992339f779d86189ee100d65351200579dfe31818987ee92a7d4d3a9cfb9efa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T04:08:31.376 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 21 04:08:31 smithi162 podman[68831]: 2024-09-21 04:08:31.177803648 +0000 UTC m=+4.501321599 container cleanup a992339f779d86189ee100d65351200579dfe31818987ee92a7d4d3a9cfb9efa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-f, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T04:08:31.376 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 21 04:08:31 smithi162 bash[68831]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-f 2024-09-21T04:08:31.565 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.f.service' 2024-09-21T04:08:31.587 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 21 04:08:31 smithi162 podman[68846]: 2024-09-21 04:08:31.420780097 +0000 UTC m=+0.620228776 container remove a992339f779d86189ee100d65351200579dfe31818987ee92a7d4d3a9cfb9efa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-f, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T04:08:31.588 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 21 04:08:31 smithi162 systemd[1]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.f.service: Deactivated successfully. 2024-09-21T04:08:31.588 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 21 04:08:31 smithi162 systemd[1]: Stopped Ceph mds.f for a82de5ec-77cb-11ef-baf5-efdc52797490. 2024-09-21T04:08:31.588 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 21 04:08:31 smithi162 systemd[1]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.f.service: Consumed 1.078s CPU time. 2024-09-21T04:08:31.598 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:08:31.598 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-21T04:08:31.599 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-21T04:08:31.599 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.i 2024-09-21T04:08:32.126 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 21 04:08:31 smithi162 systemd[1]: Stopping Ceph mds.i for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T04:08:32.126 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 21 04:08:31 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-i[64334]: 2024-09-21T04:08:31.922+0000 7feff7953640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:08:32.126 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 21 04:08:31 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-i[64334]: 2024-09-21T04:08:31.922+0000 7feff7953640 -1 mds.i *** got signal Terminated *** 2024-09-21T04:08:34.708 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 21 04:08:34 smithi162 podman[68953]: 2024-09-21 04:08:34.452878332 +0000 UTC m=+2.641831427 container died 44540b407dca7b3ea6d64784a47967b9f36d6275c36342325640cd2cfd508c47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-i, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T04:08:35.067 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 21 04:08:34 smithi162 podman[68953]: 2024-09-21 04:08:34.806044737 +0000 UTC m=+2.994997829 container cleanup 44540b407dca7b3ea6d64784a47967b9f36d6275c36342325640cd2cfd508c47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-i, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True) 2024-09-21T04:08:35.067 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 21 04:08:34 smithi162 bash[68953]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-i 2024-09-21T04:08:35.233 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.i.service' 2024-09-21T04:08:35.265 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:08:35.265 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-21T04:08:35.265 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-21T04:08:35.265 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.l 2024-09-21T04:08:35.579 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 21 04:08:35 smithi162 systemd[1]: Stopping Ceph mds.l for a82de5ec-77cb-11ef-baf5-efdc52797490... 2024-09-21T04:08:35.876 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 21 04:08:35 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-l[63514]: 2024-09-21T04:08:35.576+0000 7f14c4a06640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:08:35.876 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 21 04:08:35 smithi162 ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-l[63514]: 2024-09-21T04:08:35.576+0000 7f14c4a06640 -1 mds.l *** got signal Terminated *** 2024-09-21T04:08:39.876 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 21 04:08:39 smithi162 podman[69075]: 2024-09-21 04:08:39.592177419 +0000 UTC m=+4.119404663 container died b974010889a184f42bb595aba0e61feffd1bf267b221bc8b9151c3d0bb41d0e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-l, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-21T04:08:40.376 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 21 04:08:40 smithi162 podman[69075]: 2024-09-21 04:08:40.151219427 +0000 UTC m=+4.678446661 container cleanup b974010889a184f42bb595aba0e61feffd1bf267b221bc8b9151c3d0bb41d0e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-l, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T04:08:40.376 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 21 04:08:40 smithi162 bash[69075]: ceph-a82de5ec-77cb-11ef-baf5-efdc52797490-mds-l 2024-09-21T04:08:40.549 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a82de5ec-77cb-11ef-baf5-efdc52797490@mds.l.service' 2024-09-21T04:08:40.581 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:08:40.582 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-21T04:08:40.582 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T04:08:40.796 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting cluster with fsid: a82de5ec-77cb-11ef-baf5-efdc52797490 2024-09-21T04:08:43.334 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T04:08:43.538 INFO:teuthology.orchestra.run.smithi105.stdout:Deleting cluster with fsid: a82de5ec-77cb-11ef-baf5-efdc52797490 2024-09-21T04:08:46.034 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T04:08:46.234 INFO:teuthology.orchestra.run.smithi162.stdout:Deleting cluster with fsid: a82de5ec-77cb-11ef-baf5-efdc52797490 2024-09-21T04:08:48.668 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T04:08:48.703 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T04:08:48.736 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T04:08:48.763 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T04:08:48.765 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913479/remote/smithi046/crash 2024-09-21T04:08:48.765 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/crash -- . 2024-09-21T04:08:48.805 INFO:teuthology.orchestra.run.smithi046.stderr:tar: /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T04:08:48.805 INFO:teuthology.orchestra.run.smithi046.stderr:tar: Error is not recoverable: exiting now 2024-09-21T04:08:48.807 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913479/remote/smithi105/crash 2024-09-21T04:08:48.808 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar c -f - -C /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/crash -- . 2024-09-21T04:08:48.847 INFO:teuthology.orchestra.run.smithi105.stderr:tar: /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T04:08:48.847 INFO:teuthology.orchestra.run.smithi105.stderr:tar: Error is not recoverable: exiting now 2024-09-21T04:08:48.849 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913479/remote/smithi162/crash 2024-09-21T04:08:48.850 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/crash -- . 2024-09-21T04:08:48.884 INFO:teuthology.orchestra.run.smithi162.stderr:tar: /var/lib/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T04:08:48.884 INFO:teuthology.orchestra.run.smithi162.stderr:tar: Error is not recoverable: exiting now 2024-09-21T04:08:48.885 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T04:08:48.886 DEBUG:teuthology.orchestra.run.smithi046:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-21T04:08:48.928 INFO:tasks.cephadm:Compressing logs... 2024-09-21T04:08:48.928 DEBUG:teuthology.orchestra.run.smithi046:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T04:08:48.971 DEBUG:teuthology.orchestra.run.smithi105:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T04:08:48.973 DEBUG:teuthology.orchestra.run.smithi162:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T04:08:48.995 INFO:teuthology.orchestra.run.smithi046.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.0.log 2024-09-21T04:08:48.995 INFO:teuthology.orchestra.run.smithi046.stderr:: No such file or directory 2024-09-21T04:08:48.995 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.9.log 2024-09-21T04:08:48.998 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T04:08:48.998 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.0.log: /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T04:08:48.998 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.a.log 2024-09-21T04:08:49.003 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T04:08:49.003 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mon.a.log 2024-09-21T04:08:49.003 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.g.log 2024-09-21T04:08:49.003 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mon.a.log: 84.2%gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.6.log 2024-09-21T04:08:49.004 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T04:08:49.004 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph.log 2024-09-21T04:08:49.004 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.6.log: /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.g.log: 90.1% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T04:08:49.004 INFO:teuthology.orchestra.run.smithi046.stderr: 95.1% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.a.log.gz 2024-09-21T04:08:49.005 INFO:teuthology.orchestra.run.smithi162.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T04:08:49.006 INFO:teuthology.orchestra.run.smithi162.stderr:: No such file or directory 2024-09-21T04:08:49.006 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T04:08:49.006 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.i.log 2024-09-21T04:08:49.006 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-volume.log: /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mon.c.log 2024-09-21T04:08:49.006 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T04:08:49.006 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.11.log 2024-09-21T04:08:49.006 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mon.c.log: /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.2.log 2024-09-21T04:08:49.006 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.11.log: 81.4% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T04:08:49.006 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.5.log 2024-09-21T04:08:49.006 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph.log 2024-09-21T04:08:49.006 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.l.log 2024-09-21T04:08:49.006 INFO:teuthology.orchestra.run.smithi162.stderr: 90.3% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T04:08:49.006 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.8.log 2024-09-21T04:08:49.006 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.l.log: 87.8% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T04:08:49.007 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mgr.z.log 2024-09-21T04:08:49.007 INFO:teuthology.orchestra.run.smithi105.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.10.log 2024-09-21T04:08:49.008 INFO:teuthology.orchestra.run.smithi105.stderr:: No such file or directory 2024-09-21T04:08:49.008 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.1.log 2024-09-21T04:08:49.008 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.7.log 2024-09-21T04:08:49.008 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T04:08:49.008 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.b.log 2024-09-21T04:08:49.010 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.8.log: 95.1% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.l.log.gz 2024-09-21T04:08:49.010 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.c.log 2024-09-21T04:08:49.012 INFO:teuthology.orchestra.run.smithi046.stderr: 95.1% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.g.log.gz 2024-09-21T04:08:49.012 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.d.log 2024-09-21T04:08:49.012 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mgr.x.log 2024-09-21T04:08:49.012 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.j.log 2024-09-21T04:08:49.012 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mgr.x.log: 87.8% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T04:08:49.012 INFO:teuthology.orchestra.run.smithi046.stderr: 90.9% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T04:08:49.014 INFO:teuthology.orchestra.run.smithi046.stderr: 95.1% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.d.log.gz 2024-09-21T04:08:49.014 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mgr.z.log: 91.0% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T04:08:49.015 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.k.log 2024-09-21T04:08:49.016 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.4.log 2024-09-21T04:08:49.016 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T04:08:49.016 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T04:08:49.016 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph.audit.log: 90.2% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T04:08:49.016 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mgr.y.log 2024-09-21T04:08:49.016 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph.cephadm.log: 81.5% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T04:08:49.016 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph.log 2024-09-21T04:08:49.016 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mgr.y.log: 94.9% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.k.log.gz 2024-09-21T04:08:49.016 INFO:teuthology.orchestra.run.smithi105.stderr: 91.0% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T04:08:49.018 INFO:teuthology.orchestra.run.smithi162.stderr: 92.6% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mgr.z.log.gz 2024-09-21T04:08:49.019 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.f.log 2024-09-21T04:08:49.019 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T04:08:49.021 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.h.log 2024-09-21T04:08:49.021 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mon.b.log 92.6% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mgr.y.log.gz 2024-09-21T04:08:49.021 INFO:teuthology.orchestra.run.smithi105.stderr: 2024-09-21T04:08:49.021 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.e.log 2024-09-21T04:08:49.021 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mon.b.log: /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.h.log: 87.8% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T04:08:49.021 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T04:08:49.022 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.3.log 2024-09-21T04:08:49.022 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T04:08:49.024 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.f.log: 94.9% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.c.log.gz 2024-09-21T04:08:49.024 INFO:teuthology.orchestra.run.smithi162.stderr: 95.0% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.f.log.gz 2024-09-21T04:08:49.025 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.e.log: 95.0% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.h.log.gz 2024-09-21T04:08:49.026 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T04:08:49.027 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/cephadm.log: 94.9% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.e.log.gz 2024-09-21T04:08:49.027 INFO:teuthology.orchestra.run.smithi105.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T04:08:49.028 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.3.log: /var/log/ceph/cephadm.log: 94.9% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.j.log.gz 2024-09-21T04:08:49.028 INFO:teuthology.orchestra.run.smithi046.stderr: 93.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T04:08:49.268 INFO:teuthology.orchestra.run.smithi162.stderr: 91.7% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mon.c.log.gz 2024-09-21T04:08:49.368 INFO:teuthology.orchestra.run.smithi046.stderr: 90.2% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mgr.x.log.gz 2024-09-21T04:08:49.408 INFO:teuthology.orchestra.run.smithi162.stderr: 95.7% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.i.log.gz 2024-09-21T04:08:49.427 INFO:teuthology.orchestra.run.smithi105.stderr: 91.8% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mon.b.log.gz 2024-09-21T04:08:49.845 INFO:teuthology.orchestra.run.smithi046.stderr: 90.4% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mon.a.log.gz 2024-09-21T04:08:50.200 INFO:teuthology.orchestra.run.smithi105.stderr: 93.1% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.4.log.gz 2024-09-21T04:08:50.224 INFO:teuthology.orchestra.run.smithi046.stderr: 91.8% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.9.log.gz 2024-09-21T04:08:50.315 INFO:teuthology.orchestra.run.smithi162.stderr: 93.1% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.11.log.gz 2024-09-21T04:08:50.542 INFO:teuthology.orchestra.run.smithi162.stderr: 92.3% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.2.log.gz 2024-09-21T04:08:50.602 INFO:teuthology.orchestra.run.smithi046.stderr: 92.8% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.3.log.gz 2024-09-21T04:08:50.619 INFO:teuthology.orchestra.run.smithi046.stderr: 92.8% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.6.log.gz 2024-09-21T04:08:50.631 INFO:teuthology.orchestra.run.smithi105.stderr: 92.7% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.1.log.gz 2024-09-21T04:08:50.834 INFO:teuthology.orchestra.run.smithi046.stderr: 93.0% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.0.log.gz 2024-09-21T04:08:50.836 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-09-21T04:08:50.836 INFO:teuthology.orchestra.run.smithi046.stderr:real 0m1.852s 2024-09-21T04:08:50.836 INFO:teuthology.orchestra.run.smithi046.stderr:user 0m7.262s 2024-09-21T04:08:50.836 INFO:teuthology.orchestra.run.smithi046.stderr:sys 0m0.285s 2024-09-21T04:08:50.842 INFO:teuthology.orchestra.run.smithi162.stderr: 92.3% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.8.log.gz 2024-09-21T04:08:50.849 INFO:teuthology.orchestra.run.smithi105.stderr: 91.4% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.10.log.gz 2024-09-21T04:08:50.900 INFO:teuthology.orchestra.run.smithi105.stderr: 92.7% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.7.log.gz 2024-09-21T04:08:52.693 INFO:teuthology.orchestra.run.smithi162.stderr: 95.4% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-osd.5.log.gz 2024-09-21T04:08:52.694 INFO:teuthology.orchestra.run.smithi162.stderr: 2024-09-21T04:08:52.695 INFO:teuthology.orchestra.run.smithi162.stderr:real 0m3.707s 2024-09-21T04:08:52.695 INFO:teuthology.orchestra.run.smithi162.stderr:user 0m8.796s 2024-09-21T04:08:52.695 INFO:teuthology.orchestra.run.smithi162.stderr:sys 0m0.330s 2024-09-21T04:08:53.056 INFO:teuthology.orchestra.run.smithi105.stderr: 93.3% -- replaced with /var/log/ceph/a82de5ec-77cb-11ef-baf5-efdc52797490/ceph-mds.b.log.gz 2024-09-21T04:08:53.059 INFO:teuthology.orchestra.run.smithi105.stderr: 2024-09-21T04:08:53.059 INFO:teuthology.orchestra.run.smithi105.stderr:real 0m4.070s 2024-09-21T04:08:53.059 INFO:teuthology.orchestra.run.smithi105.stderr:user 0m10.750s 2024-09-21T04:08:53.059 INFO:teuthology.orchestra.run.smithi105.stderr:sys 0m0.354s 2024-09-21T04:08:53.059 INFO:tasks.cephadm:Archiving logs... 2024-09-21T04:08:53.059 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913479/remote/smithi046/log 2024-09-21T04:08:53.060 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T04:08:54.135 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913479/remote/smithi105/log 2024-09-21T04:08:54.135 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T04:08:55.653 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913479/remote/smithi162/log 2024-09-21T04:08:55.654 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T04:08:56.864 INFO:tasks.cephadm:Removing cluster... 2024-09-21T04:08:56.864 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 --force 2024-09-21T04:08:57.078 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting cluster with fsid: a82de5ec-77cb-11ef-baf5-efdc52797490 2024-09-21T04:08:57.347 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 --force 2024-09-21T04:08:57.552 INFO:teuthology.orchestra.run.smithi105.stdout:Deleting cluster with fsid: a82de5ec-77cb-11ef-baf5-efdc52797490 2024-09-21T04:08:57.824 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a82de5ec-77cb-11ef-baf5-efdc52797490 --force 2024-09-21T04:08:58.020 INFO:teuthology.orchestra.run.smithi162.stdout:Deleting cluster with fsid: a82de5ec-77cb-11ef-baf5-efdc52797490 2024-09-21T04:08:58.286 INFO:tasks.cephadm:Removing cephadm ... 2024-09-21T04:08:58.286 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T04:08:58.305 DEBUG:teuthology.orchestra.run.smithi105:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T04:08:58.322 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T04:08:58.338 INFO:tasks.cephadm:Teardown complete 2024-09-21T04:08:58.338 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T04:08:58.349 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T04:08:58.350 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T04:08:58.352 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T04:08:58.364 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T04:08:58.471 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T04:08:58.481 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T04:08:58.482 DEBUG:teuthology.orchestra.run.smithi046:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T04:08:58.484 DEBUG:teuthology.orchestra.run.smithi105:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T04:08:58.486 DEBUG:teuthology.orchestra.run.smithi162:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T04:08:58.499 INFO:teuthology.orchestra.run.smithi105.stderr:bash: line 1: ntpq: command not found 2024-09-21T04:08:58.500 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 1: ntpq: command not found 2024-09-21T04:08:58.501 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-09-21T04:08:58.504 INFO:teuthology.orchestra.run.smithi105.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T04:08:58.504 INFO:teuthology.orchestra.run.smithi105.stdout:=============================================================================== 2024-09-21T04:08:58.504 INFO:teuthology.orchestra.run.smithi105.stdout:^* hv01.front.sepia.ceph.com 3 6 377 18 -568us[ -568us] +/- 49ms 2024-09-21T04:08:58.504 INFO:teuthology.orchestra.run.smithi105.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 18 +1091us[+1091us] +/- 58ms 2024-09-21T04:08:58.504 INFO:teuthology.orchestra.run.smithi105.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 20 -498us[ -498us] +/- 63ms 2024-09-21T04:08:58.504 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T04:08:58.506 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T04:08:58.506 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-09-21T04:08:58.506 INFO:teuthology.orchestra.run.smithi162.stdout:^* hv01.front.sepia.ceph.com 3 6 377 18 -534us[ -531us] +/- 49ms 2024-09-21T04:08:58.506 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 22 +1114us[+1116us] +/- 58ms 2024-09-21T04:08:58.506 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 21 -471us[ -468us] +/- 63ms 2024-09-21T04:08:58.506 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T04:08:58.506 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T04:08:58.506 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2024-09-21T04:08:58.507 INFO:teuthology.orchestra.run.smithi046.stdout:^* hv01.front.sepia.ceph.com 3 6 377 19 -542us[ -543us] +/- 49ms 2024-09-21T04:08:58.507 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 20 +1113us[+1112us] +/- 58ms 2024-09-21T04:08:58.507 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 19 -476us[ -476us] +/- 63ms 2024-09-21T04:08:58.507 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T04:08:58.507 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T04:08:58.517 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T04:08:58.517 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T04:08:58.547 DEBUG:teuthology.orchestra.run.smithi046:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T04:08:58.635 DEBUG:teuthology.orchestra.run.smithi105:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T04:08:58.702 DEBUG:teuthology.orchestra.run.smithi162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T04:08:58.770 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T04:08:58.802 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T04:08:58.803 DEBUG:teuthology.orchestra.run.smithi105:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T04:08:58.830 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T04:08:58.830 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T04:08:58.857 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T04:08:58.858 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T04:08:58.868 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T04:08:58.889 INFO:teuthology.task.internal:Duration was 1877.682943 seconds 2024-09-21T04:08:58.889 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T04:08:58.923 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T04:08:58.923 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T04:08:58.925 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T04:08:58.928 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T04:08:58.964 INFO:teuthology.orchestra.run.smithi105.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T04:08:58.966 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T04:08:58.968 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T04:08:59.357 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T04:08:59.357 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi046.front.sepia.ceph.com 2024-09-21T04:08:59.357 DEBUG:teuthology.orchestra.run.smithi046:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T04:08:59.383 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi105.front.sepia.ceph.com 2024-09-21T04:08:59.384 DEBUG:teuthology.orchestra.run.smithi105:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T04:08:59.422 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi162.front.sepia.ceph.com 2024-09-21T04:08:59.422 DEBUG:teuthology.orchestra.run.smithi162:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T04:08:59.446 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T04:08:59.446 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T04:08:59.449 DEBUG:teuthology.orchestra.run.smithi105:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T04:08:59.465 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T04:08:59.513 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T04:08:59.513 DEBUG:teuthology.orchestra.run.smithi046:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T04:08:59.520 DEBUG:teuthology.orchestra.run.smithi105:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T04:08:59.532 DEBUG:teuthology.orchestra.run.smithi162:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T04:09:00.481 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T04:09:00.492 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T04:09:00.492 DEBUG:teuthology.orchestra.run.smithi046:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T04:09:00.517 DEBUG:teuthology.orchestra.run.smithi105:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T04:09:00.545 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T04:09:00.572 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T04:09:00.583 DEBUG:teuthology.orchestra.run.smithi046:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T04:09:00.585 DEBUG:teuthology.orchestra.run.smithi105:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T04:09:00.588 DEBUG:teuthology.orchestra.run.smithi162:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T04:09:00.607 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = core 2024-09-21T04:09:00.610 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern = core 2024-09-21T04:09:00.636 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = core 2024-09-21T04:09:00.655 DEBUG:teuthology.orchestra.run.smithi046:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T04:09:00.676 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T04:09:00.677 DEBUG:teuthology.orchestra.run.smithi105:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T04:09:00.709 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T04:09:00.709 DEBUG:teuthology.orchestra.run.smithi162:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T04:09:00.724 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T04:09:00.724 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T04:09:00.735 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T04:09:00.736 DEBUG:teuthology.misc:Transferring archived files from smithi046:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913479/remote/smithi046 2024-09-21T04:09:00.736 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T04:09:00.790 DEBUG:teuthology.misc:Transferring archived files from smithi105:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913479/remote/smithi105 2024-09-21T04:09:00.790 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T04:09:00.826 DEBUG:teuthology.misc:Transferring archived files from smithi162:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913479/remote/smithi162 2024-09-21T04:09:00.826 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T04:09:00.862 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T04:09:00.862 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T04:09:00.864 DEBUG:teuthology.orchestra.run.smithi105:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T04:09:00.867 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T04:09:00.911 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T04:09:00.924 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T04:09:00.924 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T04:09:00.976 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T04:09:00.976 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T04:09:00.979 DEBUG:teuthology.orchestra.run.smithi105:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T04:09:00.981 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T04:09:00.992 INFO:teuthology.orchestra.run.smithi046.stdout: 266055 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 04:09 /home/ubuntu/cephtest 2024-09-21T04:09:00.994 INFO:teuthology.orchestra.run.smithi105.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 04:09 /home/ubuntu/cephtest 2024-09-21T04:09:00.995 INFO:teuthology.orchestra.run.smithi162.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 04:09 /home/ubuntu/cephtest 2024-09-21T04:09:00.997 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T04:09:01.015 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T04:09:01.085 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/direct_io}} duration: 1877.6829426288605 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-21T04:09:01.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T04:09:01.167 INFO:teuthology.run:pass